Musicians can detect latency as little as 1ms. It changes the "feel" of the instrument/equipment. It took until recently for digital gear to feel similar to analog, because it's an enormous engineering challenge to get digital equipment to be as responsive as the simplest analog equipment.