1GbE speeds over 10GbE connections? MacOS

[Ukeyoner]

I was wondering if anyone is having this same expereince. I have a new 626x, all drives filled, x-raid, connected to a Netgear XS708E 10GbE router, and I'm getting very slow speeds over 10GbE. Not even 90MBs. I was getting better speeds though my Pioneer Pro.  My mac is connected to the router though a Promise Technolgy Sanlink2 by thunderbolt. I know I have to tinker with the settigs on each device to get the best performance, but it shouldn't be this slow, should it? 

Any advice would be appreciated.

[StephenB · Accepted solution]

---

@mdgm wrote:

I was thinking e.g. a 5400RPM hard disk in an iMac could be a bottleneck.

---

I agree that could easily be it.  iPerf would measure just the network, so the disks in the NAS and the iMAC wouldn't factor in - so it would help isolate the cause.

Can you copy from the thunderbolt RAID array to the NAS?  That's another way to take the imac disk out of the equation.

---

@mdgm wrote:

 With Jumbo Frames finding the right MTU for your environment can take a bit of work. I'm not sure if/how well Jumbo Frames work with 10G.

---

Though they should work just fine, I see no need for them with 10G.  So I would just turn them off, and use the normal 1500 MTU.

Also, if iPv6 is enabled in the NAS, try disabling it.

[mdgm-ntgr]

Please send in your logs (see the Sending Logs link in my sig). Is your Mac reporting a 10Gig connection to your switch or 1Gig?

Are you using CAT6A cables? If not you could try using those.

[Ukeyoner]

I emailed the logs. 

I'm using Cat 7 calbles actually. 

In my mac network utility it states a 10 Gbit/s link speed. 

On my router all the lights are greenm which on the XS708E indecates 10GbE supposedly.

Thank you for your time. 

-Mike Czerniuk

[mdgm-ntgr]

The logs were not attached to your email.

[mdgm-ntgr]

The logs show a 10GbE connection.

Could the hard disk in your Mac be the bottleneck?

[StephenB]

---

@mdgm wrote:

Could the hard disk in your Mac be the bottleneck?

---

If you are comfortable with ssh, you could try installing iperf on the NAS and the Mac.  That would let you see if this is a network issue or not.

[Ukeyoner]

I'm not sure how the Hard drives could be the bottleneck. I did throw in a mix of hard drive sizes for testing, but all of them are sata 3 and 7200 rpm. I would imagine 6 drives in raid 5 should be able to go faster than 90MBs. 

I have a half full 6 bay thunderbold 1 drive in a raid 5 that does 400MBs over a thundeboldt 2 connetion. I was hoping an emoty 626x would be ablt to go almost as fast as that. 

But I agree the 1Gb speeds is showing a bottleneck somewhere. 

[Ukeyoner]

I don't know anything about SSH. I would need to look into that. I am thinking that I have some settings set up wrong on one end or the other, I just can't figure out where. 

[mdgm-ntgr]

I was thinking e.g. a 5400RPM hard disk in an iMac could be a bottleneck.

You could try disabling Jumbo Frames and seeing what the performance is like with the default MTU.

With Jumbo Frames finding the right MTU for your environment can take a bit of work. I'm not sure if/how well Jumbo Frames work with 10G.

[StephenB · Accepted solution]

---

@mdgm wrote:

I was thinking e.g. a 5400RPM hard disk in an iMac could be a bottleneck.

---

I agree that could easily be it.  iPerf would measure just the network, so the disks in the NAS and the iMAC wouldn't factor in - so it would help isolate the cause.

Can you copy from the thunderbolt RAID array to the NAS?  That's another way to take the imac disk out of the equation.

---

@mdgm wrote:

 With Jumbo Frames finding the right MTU for your environment can take a bit of work. I'm not sure if/how well Jumbo Frames work with 10G.

---

Though they should work just fine, I see no need for them with 10G.  So I would just turn them off, and use the normal 1500 MTU.

Also, if iPv6 is enabled in the NAS, try disabling it.

[Ukeyoner]

The 626x is being accessed by a 2013 mac pro, 1 TB ssd. But I was copying from the thunderbolt raid to the nas. It's definitly not the host computer hard drive, although that would be even faster. I was using AJA and Blackmagic disk tests to check the transfer speed on the nas.  

Pv6 is enabled on the nas. I disabled it on one of the ports and now that port has disapeared from the network page. 

[Ukeyoner]

The 10GbE port showed back up when I logged out and back into admin page.

[Ukeyoner]

I think disabling  iPv6 did the trick. 

I'm now getting writes in the 400-600 range and reads in the 600-700 range. 

Thank you so much!

[StephenB]

I'm glad we could help.