isotope hashchange back button problem

isotope hashchange back button problem

I'm currently having some problems using a hashchange function, in combination with the isotope plugin ( http://isotope.metafizzy.co) and it's filtering capabilities. Combined with a hashchange, I'm filtering divs allowing me to navigate in the browser without having to reload the page. On page load all the divs are filtered out (hidden) except for the actual filter buttons, which when clicked bring in the relevant content.

Full demo to show hashchange and back button:  http://jsfiddle.net/neal_fletcher/vcffM/16/show/ 

Clicking on 'ONE FILTER' brings in the relevant divs and attached a hash, then hitting the back button and going back, loads all the content, instead of only showing the filter button divs. Which is a bit of a problem, it's not working as it should, it should only show 'ONE FILTER' and 'TWO FILTER' divs when there is no hash in the url. I can't figure out how to achieve this, any suggestions would be greatly appreciated!