This is right, Windows can hold on to hardware resources while hibernating, including the network card.
Make sure you have disabled the fast startup option in the “Choose what the power buttons do” menu in Control Panel, and ensure the power button actually shuts down the computer instead of hibernation or something else. You have to enable changing settings that are unavailable to do it.
I’m not sure how up to date this image is, but here it is:
