To delete a symbol, first select it by clicking on it with the left mouse button, then hit the Del key, or use the menu command:
Edit -> Delete