It was always an inconvenience to begin in the Ledges in Season 3 because, not only did it take longer than the Crypt to enter and exit, but also because of the trouble of climbing up the wall if the Tomb door didn't open (which nearly always had a temple guard, anyway).
The contestants did have the option of shoving over the column with their hands, but this was only done twice in the third season.
As far as Season 1 goes, it was advantageous, temple guards aside, to enter the Cave of Scythes/Sighs/Size because it was a much shorter distance to the room than taking the awkward steps to the Gargoyle/Gong room.
In Season 2, it didn't really matter, yet teams usually preferred the Crypt to the Ledges.