Light has a speed and so does fibre
A signal covers about 200 km per millisecond in glass, and the route is never a straight line. London to New York is around 70ms on a good day and no server anywhere changes that. Sitting in the same city as your broker is the only thing that does.