Saints leave Gujarat to go to Ayodhya