problem with drop down on scroll...it is delaying

pls see the fiddle....when we scroll down animation on header is perfect but when we scroll up to $(document).scrollTop to "0" is needs to come to its normal position. http://jsfiddle.net/e4Rk5/1/