The founder of this site, QT Luong, shoots 5x7 and was a serious climber. I am not sure at what level his climbing was when he carried a view camera, but I suspect he did some challenging terrain.

But all things considered, 4x5 is a nice size threshold for going large - any smaller and you don't see a large enough difference over good digital or medium format film.