You have to fix the <head> stuff anyway, if the user will ever enter your site from anywhere but the main page.
Even if you yourself don't link anywhere but the main page, search engines are likely to find inside pages, and then users may be following links to inside pages.
Rule #1 for any JQM site: content of <head> should be the same for every page.
It's easy to accomplish with a bit of server-side help (server-side include) or a static site generator.
DON'T put anything extensive in <head>, since it is loaded with each page, and then usually discarded. Instead, just link to resources. That is, don't write a bunch of JS or styles in the <head> itself - do it in linked files.