Struggling with Day Crating!

Hi all,

I am currently fostering an 11 week old pup, and we have had him for about a week. I am still a student (working on my thesis from home) and my wife works most days of the week. We are working at getting our pup better acquainted with his crate, and he is actually doing really well at night! A few whines here and there, but in only a week he's made a huge improvement. He's even gone the entire night (around 6 hours) without a potty break the past two days.

He is a busy boy, so to get any work done during the day, I typically have to crate him for an hour or two at a time. This is preceded and followed by extended play sessions outside, walks, bathroom breaks, and play time inside as well. When he is crated during the day, it is directly beside me. He has plenty of safe toys in his crate as well (though he prefers to chew his bed, grr). This is my first experience with a foster pup, I've only fostered older dogs that were already somewhat adjusted to a human lifestyle. This pup was kind of thrown onto me for a home, so I'm definitely out of my depth.

1. Am I doing the best thing possible for him here, or is his bit of whining and chewing his bed more of a destructive behaviour due to lack of attention?
2. Should I move his crate out of my office, to an area where he can't see me? Is him being right beside me working him up further, or teasing him unintentionally?
3. Any other ideas? I am doing my absolute best to give him as much time as possible, but I also feel like he should be sleeping way more than he is, at 11 weeks old. I feel like I am somehow not giving him enough attention to suitably tire him out. Just to be clear, the schedule is currently -> wake up 5am with wife -> potty, short play -> crate from 5:30-7:00am when I get up -> breakfast, play, walk, potty until 10:30am -> crate until 12:00pm, and cycle, until around 5pm when we take him for another walk, play, etc. until bedtime between 10pm and 11pm.

Bathroom breaks are roughly hourly throughout the day, sometimes 2 hours if he is asleep in his crate.

Thanks everyone!