6 month puppy is affraid of my husband

Without going too much into the background story, we brought 6 month somewhat of a rescue puppy (golden doodle mix) into our home.

It is day 6 and he is much more comfortable, playful, affectionate and is super velcro to me.

However he is scared of my husband.. My husband is great with all the animals, all dogs at the parks and beaches love him and he adores animals. But each time he walks back to the common areas from his office room or comes back home pup behavior changes, he's hiding behind me, walks away from my husband with his tail and head down.. he looks scared of him.. My husband tries to give him treats, but even those he rarely acceps.

Best times are in the evenings, when we sit on the sofa, pup relaxes next to me and that's when my husband gets to pet him. Things start feeling better, but next day everything is completely back to square one.

A couple of male friends came by today and pup was not comfortable with them either.

We're guessing that men weren't kind to him in his previous home..

Any tips and advices are welcome on how to help him to feel safe and comfortable with my husband. I feel awful for both of them..