Simply click on it in one of your views, it should be hilighted when it is selected, them hit delete on your keyboard. It will not make the object, brush or whatever dissapear in the 3D perspective, you must rebuild the map to update it in that view.