Inconsistent download speeds with modem or ISP

I'm seeing non consistent download speeds coming out of the modem with computer hard coded to modem during normal work week days and hours EST.  Seems better download speeds during off hours or on we...