On Thursday, Yadav met party chief Lalu Prasad and said he has no grudge against the state government.
Emerging from the meeting at 10 Circular Road residence of former chief minister Rabri Devi where he met RJD president Lalu Prasad, Raj Ballabh Yadav told reporters it was a courtesy visit to extend greetings of Durga Puja.
There was no word from Lalu Prasad on the meeting. The office at Rabri Devi's house also maintained it was a usual courtesy visit.
Raj Ballabh Yadav, the MLA from Nawada, said he has no complaint against the state government for going against his bail in the apex court.
"Government works according to a system. Chief Minister Nitish Kumar has not gone into appeal ... I do not have any grievance against the state government. Why you (mediapersons) are raising a question about the system," he said.
Replying to questions, Yadav said, "There is no serious charge against me. There is no FIR or statement of the victim under 164 CrPC against me."
The third term RJD MLA was suspended from the party in the wake of the rape allegation against him. The girl, a resident of Rahui in Nalanda, was raped allegedly at the MLA's house under Mufassil police station on February 6.
He was arrested in the case but got bail from the Patna High Court on Friday last.
Meanwhile, Deputy Chief Minister Tejaswi Prasad Yadav told reporters that the government was doing its duty and it is up to the court to see if the accused MLA is guilty.
"Let us leave the matter to the court to decide," Tejaswi Yadav, who is also the leader of RJD Legislature party in the state Assembly, said.
(With PTI inputs)
Read the update here: SC notice to Bihar MLA on plea challenging bail in rape case