The song, to me at least, is about letting go of a relationship that is dangerous. They had good memories together but it's not the same anymore. Instead of being positive influences on each other, they're only tearing each other apart. It's better to just go separate ways instead of hanging onto something that's causing pain.
Yes