I'm convinced it makes a difference on days when there isn't an abundance around. Lots of oils can stain gear pretty badly though.
Instead of throwing out an anchovy for whatever reason, slice off a piece and try the good old anchovy stuffed hootchie.....