Selector for all elements that are not type=text or type=textarea

Selector for all elements that are not type=text or type=textarea

I need to add an event for all elements that are not text entry.

I have tried this

$(':not(input:text, input:textarea)')
$(':not(:text, :textarea)')

I tried to get it to work for just not type=text

$(':not(:text)')
$(':not(input:text)')

I can't seem to figure it out.
Anyone have any suggestions?