For a specific game I'm assuming?

Its prolly because the server is hosted too far away from you, so its always going to be like that.

Or do you mean always in EVERY game?