Receiving Internal Server Error on Ajax calls intermittently

Receiving Internal Server Error on Ajax calls intermittently

I have a MVC .NET 4.5 web application running on 4 servers under IIS. 

Whenever I login into my web app and select a tab option, a GET request is fired. I am receiving below error when this request is triggered.

xhr.send( ( options.hascontent && options.data ) null ) 500 internal server error

If I keep refreshing the page, this data is getting returned intermittently. i.e. once it works and the other time it fails.

Also, this happens only when I use a load balanced VIP URL. It works fine using a direct URL.