Love the Song, Hate the Lyrics?

There are just some songs that I absolutely love, but hate the lyrics. Neko Case's "Never Turn Your Back on Mother Earth" is one such songs. The song is so preachy, it could have been written by a overly emotional teenager (but I repeat myself), except the actual music is gorgeous and I can't stop listening to it.

I guessing that's why I like a lot of French songs. I bet if I knew what they were really singing I wouldn't love the songs that much.