This ancient monolith carved cave temple is located around 3 km from the city market on Bull Temple Road. Dedicated to Lord Shiva and Goddess Parvathi, the temple built by Kempe Gowda in the 9th century, is inside a natural cave in Gavipuram. It is said that among the two paths inside the cave, one leads to the temple town Shivaganga in Tumkur district and another to Kashi. Apart from the main idol, it also houses idols of Durga, Parvathi, Shakti Ganapathi and a rare idol of Agnimurthi.

Every year on Makar Sankranti Day, the temple witnesses a unique phenomenon that attracts thousands of devotees. On that day, at a particular moment in the evening, sun's rays passes between the horns of the stone Nandi Bull placed outside the temple, thereby illuminating the Gavi Ganagadareshwara idol (Shiva Linga) inside.