Speed issue GS308

So I did a bit of troubleshooting today and took a look at the GS105 switch upstairs in the AV closet.  The port with the connection to the wall in the living room and connected to the R7960P router is showing as 1GB as both green lights are on.  However, the port that is connected to the wall jack in my office only has one green light, 100MB.  I cycled power on everything and no change.  I swapped ports around then cycled power and no change.  I plugged in a laptop computer directly to the GS105 and received the 1GB connection and test speeds were around 370MB (normal for Xfinity for me).  I plugged in the GS308 switch directly into the GS105 router and then connected a laptop to the GS308 and had the 1GB connection with about 370MB during the test, so normal speeds.  I just do not know why the speed is getting throttled down at the wall jack in my office.  I rechecked cabling again and all my house cable is Cat5e, my home is only 3 years old, and all my patch cables I use are Cat6 cabling.  I am at a loss of how it was working fine at 370MB with no issues from the wall but plugged into the switch the computer gets throttled back to 60-70MB.