When to start giving puppy more freedom:

I have an almost 14 week puppy, we’ve had him almost 3 weeks. He sleeps in his crate at night and for naps during the day. He has a play pen where he plays independently or be alone when we are doing things around the house. When he’s out of the crate + pen, he’s on a leash at all times pretty much. We have been giving him more time outside the pen (while he’s ok in the pen, he has been protesting a bit more.. which is to be expected I guess with more time outside of the pen). How long did it take for you to start giving your pup? How did you implement the slow changes? He’s doing pretty well with potty training, but he will have an accident here and there if we miss the signs of him having to pee (twice last week). I’ve read lots online and people say giving too much freedom too soon, is one of your biggest mistakes. Thank you in advance!