The Undavalli caves in Guntur district are situated at a distance of only 8km from Vijayawada. These ancient Hindu cave temples  are believed to be of the 4th and 5th century AD's. They are fine specimens of architectural and sculptural models carved out of solid rock. The temples are atop the high hills overlooking the Krishna river. A huge monolith of Lord Vishnu in lying position is worth seeing.