Former Madhya Pradesh finance minister Raghavji, who recently quit after being accused of sodomy, was arrested on Tuesday.