It is believed that these caves were built in the 2nd century as restrooms for Jain monks by king Karavela of Meghavahana dynasty. It is one of the rarest and interesting monument of India. The caves are on two adjacent hills known as Udayagiri and Khandagiri known as Kumari mountain range were built for Jain monks.