Gilani was reportedly living in a presidential suite of four bedrooms on the sixth floor of the Aiwan-e-Sadr since his ouster in July.
Gilani said there was no political prisoner during his rule but his son was made one.
"I abandoned Aiwan-e-Sadr when things got beyond the limits of tolerance," Geo TV quoted Gilani as saying at his home in Lahore Saturday.
Gilani said that he left the presidency Saturday, the same day his son was held and that he did not contact President Asif Ali Zardari before leaving.
The former prime minister regretted that decisions were being made outside parliament. He also expressed his displeasure over removal of some top bureaucrats he had appointed.
"I have conveyed to the president that many federal secretaries and heads of organisations I had appointed have been removed by incumbent Prime Minister Raja Pervez Ashraf," Dawn had quoted Gilani as saying Saturday.
Gilani remained loyal to the ruling Pakistan People's Party and refused to follow court orders about writing to Swiss authorities for reopening graft cases against Zardari.
Islamabad: Former Pakistani prime minister Yousuf Raza Gilani has said that things had became unbearable for him to continue living at the presidency after his son was "held" at the gate.
First Published: Sunday, October 07, 2012, 18:19