Excavated by Ashoka and his son Dasaratha in the 3rd century BC, the seven caves in the hills of Barabar and Nagarjuni are the oldest rock-cut caves in the country. These are chambers cut into granite rock and stand out for the high polish on the interior surfaces. Inscriptions in the caves indicate that the rulers of Magadh made them for ascetics of the Ajivika sect. The entrances to some of the caves have been cut in a style reminiscent of Mauryan timber architecture of the time.

These caves were the inspiration for the Marabar Caves in E.M. Forster's book 'A Passage to India'.

Nearby is the Siddheshwar Hill with the Siddeshwarnath Temple from the 6th-7th Century CE. This hill has been identified as the one from which Gautam Buddha viewed the kingdom of Magadh. The path to the top passes numerous caves, inscriptions, rock carvings and sculpture.

Distance from Maksudpur: 15 km