.load() loading very small files slowly

.load() loading very small files slowly

I'm starting to use JQuery ajax and am seeing a second-2 delay in the loading of a line of text when I click on the link.

Here is the JQuery code
 $("a").click(function(e){
        e.preventDefault();
        e = this;
        $(".selected").removeClass("selected");
        $(this).addClass("selected");
        $("#content").slideUp('fast',function(){$(e.hash).load(e.href); }); 
        $("#content").slideDown();   
   });

Content should load when the slideUp is done but it normally doesn't change the content till halfway through the slide down because of the delay.
I've tried without the slideup/down but it still has this delay.

The content to load is at most 8 words.