adding and removing an element

take a look at this fiddle...click any menu item(user stats,appointments...etc)...a blue arrow appears.

My goal is that when a menu item is clicked the arrow appears(as is the case now...) but the arrow appeared in a previously clicked menu item disappears from the DOM...something logical....so the user can have an idea where is he currently.

Something like that... but with the arrow.(this latest fiddle does not use jquery,something I do not want anyway)