10GBE with OS6 on ReadyNAS

OK, so I decided I didn't need 10GBE on my backup NAS and re-configured my network as follows:

Router to 1GbE switch (for all other items on my network)->

  2.5/10GbE switch (2 10Gb SFP+ and 4 2.5GbE RJ-45) ->

    PCs with 2.5GbE NIC card &  

    2.5GbE switch at NAS rack (via 2.5GbE RJ-45 and 30 meters of CAT7, but likely to change to 10GbE optical) ->

       Main NAS via 10GbE SFP+ via twinax cabling &

       Backup NAS via 2.5GbE RJ-45 (knowing they'll only connect at 1GbE) &

       1GbE switch for rest of rack.

I'm essentially saturating the 2.5GbE on reads but not quite reaching 2GbE on writes from PC to NAS.  I can live with that.  It's a big upgrade from 1GbE both ways.  But with the switches I got, I still have the option of going to a 10GbE NIC on my main PC if I upgrade the connection between the 10/2.5GbE switches to 10GbE optical).  The backup speed stays at 1GbE, but it happens at night and I really don't care how long it takes.  If I ever have to do a large data restore, I may change my thinking.  I think the 2GbE speed on writes is likely due to the NAS using RAID6.  It's a converted ReadyData 5200, so a bit old, which may have something to do with it.

But my reason for posting this is that I ran into an oddity that Googling gave me some clues on, but I ultimately just figured out with help from the NAS "Performance" display.  Initially, I was getting 2GbE for writes but limited to 1GbE on reads.  It turns out that was because I left a 1GbE connection from NAS to the rack 1GbE switch (as fallback in case my re-configuration to 10GbE failed) and hadn't reset everything.  The NAS display showed the writes over the 2GbE connection but writes over the 1GbE.  I disconnected the 1GbE, did a full reset of all devices in the link from PC to NAS, and then re-connected the 1GbE, and all was as it should be.  I may not have had to disconnect the 1GbE before I did the reset, but I did so and tested with and without the 1GbE re-connected.  But I'll likely disconnect that 1GbE permanently now that I know all is working via the 10GbE.  This was all likely due to something still being set in one of the routers for the MAC address translation to the IP address, as I kept the same IP address for the NAS 10GbE as the old 1GbE and switched the 1GbE to a different one so I didn't have to re-configure my drive mappings, NAS backups, etc.

Maybe my experience will help somebody else who's scratching their head after upgrading their intranet to 2.5 or 10GbE or is thinking of doing so.

BTW, the 2.5/10GbE switches I used are generic Chinese ones from Amazon.  I just picked one that currently had a discount, as there are 4 or 5 brands that look identical.  Same with the 2.5GbE NIC cards.  Time will tell how long they last, but they are working great now.  The Cat7 cable I used is also generic from Amazon, flat so I can run it under the carpet instead of having to go into the attic.  My previous Cat6 had become damaged (latch broke off and I have no tool for putting new connectors on flat cable), so I just replaced it with CAT7.  The old Cat6 likely would have worked fine at 2.5GbE, but it was a PITA to keep plugged in and I made the change as just a part of the upgrade.  If I go to optical, I likely will go to the attic because of the bend radius restriction and that the CAT7 runs under the carpet at two doors (not just at the edge of the wall like everywhere else) and stepping on optical cable isn't good for it, even with the padding of the carpet.  But I'll have to get somebody younger to make that run -- I don't go past the attic opening at my age.