Xbox One and AC1600 conflicts at times

Hello everyone. I've been having a few issues. Nothing too major but sometimes it gets annoying. I have an Xbox One. And there is a feature on it where if plugged into an power outlet it's still connected to the internet. It can download updates etc while I'm at work. But I've been noticing when I turn off the Xbox, while still plugged in to the wall outlet, it's not connected to the internet when I turn back on the Xbox. And I have to actually reset the Xbox a few times before it connects to the internet finally. It's never done that before so I'm assuming the modem and Xbox is conflicting somewhere. I'm plugged in directly to the Xbox via ethernet. Any solutions? Thank you.