OK, contacted Olympus and they believe that the card reader is to blame.
I am shipping the card to them and they've advised that they will re-program it and ship it back to me. I bought the card less than a year ago so it'll be covered under warranty.
Other sites recommend just using the camera that you're taking photos with for formatting and deleting of pictures. I think I'll do that from now on.