For me, it would be The Wall Climb/Pit of Despair. No wheel, no rock quarry, no rope swing, no rock slabs that stick out, and no pendulum. My arms are very weak. I can't even do 5 push-ups in a row without falling on my knees. I would have a hard time pulling myself up the wall into the middle room or the top room.
I think I would also have problems with the 3rd Observatory layout (aligning four cylindrical pieces of a puzzle). I'm not too familiar with what the puzzle is or what it looks like when completed. I'd probably be clueless in that room.
Also, when it comes to The Shrine of the Silver Monkey, remember this pattern: for the base, make sure the monkey tail is facing you; for the middle, make sure the belly that is sticking out (the taller side) is facing the camera; for the head, make sure the face is facing the camera. Remember this pattern if the show is ever brought back, as well as the room. Hopefully this same strategy will apply if the show and room is brought back.