Cool, I figured it out, for anyone else who had the same problem, click Tools, Click selection mode, highlight whatever you don't want and hit the delete key. (Isn't it great how you can search for hours and only find what you're looking for after you ask someone)
I used units to test things a while back, and I'm pretty much done with my map. I've saved it and reloaded it a few times, so even if I wanted to undo my way back through all my changes to remove them, I can't anymore, I've looked through the overview manager, and searched through a couple...