Spot Me If You Can

Riddle: I'm easy to spot and can be hard to get rid of. On some things I'm a nuisance, and on others I'm the main attraction. On those same things it's proper to remove me and on others it's cruel to take me. What am I?