Feeling guilt about getting a puppy plz help

I got an adorable 12 week old pug puppy last Monday, I love him so dearly but I have so much guilt that I’m not being a good enough care taker. The main problem I seem to have is not trusting him to roam around in the house. I have a crate and I’ve been working on crate training him which is going ok, he only seems to cry in the crate when he’s super energetic and needs to play or go out. I also set up a puppy pen but he seems to absolutely hate and cry soooo much sometimes but other times he’s totally content. I just feel like I don’t want him wondering and eating things that are dangerous or possibly having accidents in the house so I need to put him in the crate or pen I just feel so guilty about it. I only work three days a week and I have to crate him those three days but I always make sure to come home mid-day to play/ walk/ feed/ bathroom but he’s a mess when I get home at night because he has been crated all day. This work schedule will change next month and my husband will be able to watch him on the weekends when I work but I feel guilty about it right now. I also feel like he does not ever want to cuddle or we have a hard time bonding and I can’t help but feel like he doesn’t like me because I’m not a good enough caregiver and have to crate or put him in a pen. Please give me any advice you have on training and bonding.