Just recently spent the week in Rumney. Camped at Mountain Pines Campground on route 25, only a 5 minute drive to the cliffs. $10 per person/night, Free showers (not that most climbers are concerned with that ), shaded and riverside sites and they allow dogs. Good spot!
http://www.mountainpinescampground.com