XR500 and Orbi. Internet dropping

Hello.

I have an issue with internet dropping and requiring a reboot.

My set-up:  Spectrum 400 mbps, Arris TM1602 cable modem XR500 plugged directly into the cable modem, 2 XBOX Ones hard wired plus desktop computer, WiFi disabled on XR500; Orbi hard wired to XR500 and configured as an access point.

I've started working from home, wired setup to the Orbi.  

Recently after being on work laptop and roommate playing on XBOX one at the same s time, the internet speeds degrade so bad, I have to unplug the orbi, the xr500 and the modem then plug back in the "reset" the internet.  This used to be something I had to do weekly, now it's everyday.  When the speeds drop working in my work laptop and playing on Xbox is nearly impossible.  

Any suggestions on how to set my system up so the speeds won't degrade to the point of not being able to work or play?  I haven't called Spectrum yet because I want to make sure it's not an issue with the hardware.  Or do I need a different hardware set up to achieve what I need.

Thank you.