I blame the consolitis, which butchered everything down into tiny mostly-independent loading zones.
The same engine and problems also applied to Thief 3, although it was less of an issue because your average speed of sneaking through the zones was slower. :p
It's a shame they had to cut the open world concept of the original and simplify it a ton just so they could fit on Xbox