Remove script

I have added a js file in my html file.
<script src="test.js" language="JavaScript"></script>
I want to remove the script from my file using jQuery.
I have tried using the following
jQuery('script[src="test.js"]').remove();
But the script is not getting removed.
Please suggest some way for removing the script using jQuery.