The geographical location of the server has nothing to do with load time. Issues with load time of web site pages:
1. End user system. Memory, processor, multiple tasks running, Operating System, how full is the cache (cookies, browser history and junk like that)
2. Internet Provider to end user. Is it Broadband, DSL, Cable Modem, Dial Up or stolen connection from neighbors wireless network. Within these most IP's have different types of service so there is alot going on here.
3. Servers: Low quality/old servers, bad site configuration, large amount of video & such on page loading and so on and so on and so on.
Keep in mind that almost all hosts have huge set-ups for the purpose of allowing end users to pull pages on the servers. These are called Data Centers (some own them, some lease them) and in the end if it is the host issue it's usually related to old servers or overloaded servers. It's not due to geographical location of the server. Unless of course your host has it sitting in their mom's basement, but that's something entirely different.