do i need to remove handlers before removing a DOM element?

do i need to remove handlers before removing a DOM element?

if i use jquery to attach a click or keyup handler to an element, and then later remove that element form the DOM, do i need to clean up/remove the handler first?