How do I get them to break bad behaviors?

I have a baby who's just an absolute angel when I'm home. But when everyone leaves, she has a nasty habit of shredding any and all paper she can get to. Is there a solution?