It's really a personal choice, but be aware that if you ever decide to sell the coins you've cleaned, you'll have drastically reduced your target buying group. On top of that, they will be worth significantly less.
But if they are just for you and you prefer the look, then who is anyone else to judge. That said, in my opinion, if the collector value is more than a dollar, I would just leave it.