feeding schedule and crate release

It’s been 2 weeks since we took home our 4.5 month rescue pup. The foster told me that his feed schedule was broken down to 2x day – breakfast and dinner time. I have continued this schedule. His last potty is around 11pm and he then gets crated for the night. He consistently whines about 4am and I wake up and carry him outside to his potty spot where he pees and poops. I then put him back in his crate and he settles for a couple more hours and then barks to come out around 6-7am. I then take him out to potty and feed him his breakfast. I want him to stay in the crate a bit longer in the morning. Would only feeding him once a day at dinner time train him to not bark in the early morning to get out of crate in order to get fed? He seems to associate being let out of crate in the morning with eating and he is very eager to get fed.