NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Solved
LAG between GC752XP and GS728TPv2 giving incorrect bandwidth results
I have created a fiber dual SFP LAG using LACP between two netgear switches (GC752XP and GS728TPv2).
I then have two linux servers connected to the GC752XP running iperf3 -s and two clients hooked to GS728TPv2 running iperf3 -c.
I start iperf3 client on the GP box and it shows 940 Mbit (normal). I then start iperf3 client on the raspberrypi box in parrallel (but to the second linux server).
Long Running iperf3 client:
GP# iperf3 -c 192.168.9.2 -t 40 Connecting to host 192.168.9.2, port 5201 [ 4] local 192.168.8.22 port 55524 connected to 192.168.9.2 port 5201 [ ID] Interval Transfer Bandwidth Retr Cwnd [ 4] 0.00-1.00 sec 112 MBytes 935 Mbits/sec 50 396 KBytes [ 4] 1.00-2.00 sec 112 MBytes 940 Mbits/sec 10 433 KBytes [ 4] 2.00-3.01 sec 111 MBytes 921 Mbits/sec 0 535 KBytes [ 4] 3.01-4.00 sec 111 MBytes 941 Mbits/sec 22 462 KBytes [ 4] 4.00-5.00 sec 110 MBytes 924 Mbits/sec 37 431 KBytes [ 4] 5.00-6.00 sec 108 MBytes 908 Mbits/sec 133 249 KBytes [ 4] 6.00-7.01 sec 107 MBytes 891 Mbits/sec 36 375 KBytes [ 4] 7.01-8.01 sec 103 MBytes 869 Mbits/sec 0 472 KBytes [ 4] 8.01-9.01 sec 75.7 MBytes 634 Mbits/sec 157 158 KBytes [ 4] 9.01-10.00 sec 58.8 MBytes 496 Mbits/sec 10 212 KBytes [ 4] 10.00-11.00 sec 61.3 MBytes 513 Mbits/sec 158 151 KBytes [ 4] 11.00-12.00 sec 59.7 MBytes 502 Mbits/sec 99 151 KBytes [ 4] 12.00-13.00 sec 55.1 MBytes 462 Mbits/sec 97 156 KBytes [ 4] 13.00-14.00 sec 60.8 MBytes 510 Mbits/sec 87 204 KBytes [ 4] 14.00-15.00 sec 59.3 MBytes 496 Mbits/sec 125 134 KBytes [ 4] 15.00-16.00 sec 55.6 MBytes 468 Mbits/sec 76 161 KBytes [ 4] 16.00-17.00 sec 58.8 MBytes 493 Mbits/sec 77 161 KBytes [ 4] 17.00-18.01 sec 61.7 MBytes 515 Mbits/sec 110 191 KBytes [ 4] 18.01-19.01 sec 64.5 MBytes 540 Mbits/sec 77 209 KBytes [ 4] 19.01-20.01 sec 110 MBytes 921 Mbits/sec 0 321 KBytes [ 4] 20.01-21.00 sec 110 MBytes 927 Mbits/sec 44 324 KBytes [ 4] 21.00-22.01 sec 105 MBytes 873 Mbits/sec 0 359 KBytes [ 4] 22.01-23.01 sec 105 MBytes 879 Mbits/sec 0 402 KBytes [ 4] 23.01-24.00 sec 104 MBytes 876 Mbits/sec 0 402 KBytes [ 4] 24.00-25.01 sec 98.8 MBytes 824 Mbits/sec 0 402 KBytes [ 4] 25.01-26.01 sec 105 MBytes 883 Mbits/sec 11 315 KBytes [ 4] 26.01-27.01 sec 111 MBytes 929 Mbits/sec 0 447 KBytes [ 4] 27.01-28.00 sec 110 MBytes 936 Mbits/sec 147 362 KBytes [ 4] 28.00-29.00 sec 112 MBytes 940 Mbits/sec 0 550 KBytes [ 4] 29.00-30.00 sec 112 MBytes 940 Mbits/sec 21 376 KBytes [ 4] 30.00-31.00 sec 107 MBytes 895 Mbits/sec 66 272 KBytes
Interrupting iperf3 -c client.
pi@raspberrypi:~ $ iperf3 -c 192.168.9.12 -t 40 Connecting to host 192.168.9.12, port 5201 [ 5] local 192.168.8.52 port 50354 connected to 192.168.9.12 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 52.8 MBytes 443 Mbits/sec 57 236 KBytes [ 5] 1.00-2.00 sec 50.9 MBytes 427 Mbits/sec 33 74.9 KBytes [ 5] 2.00-3.00 sec 47.5 MBytes 398 Mbits/sec 59 133 KBytes [ 5] 3.00-4.00 sec 53.6 MBytes 449 Mbits/sec 109 177 KBytes [ 5] 4.00-5.00 sec 54.6 MBytes 458 Mbits/sec 121 132 KBytes [ 5] 5.00-6.00 sec 49.5 MBytes 415 Mbits/sec 83 167 KBytes [ 5] 6.00-7.00 sec 52.7 MBytes 442 Mbits/sec 100 177 KBytes [ 5] 7.00-8.00 sec 53.0 MBytes 445 Mbits/sec 88 177 KBytes [ 5] 8.00-9.00 sec 50.7 MBytes 425 Mbits/sec 109 147 KBytes [ 5] 9.00-10.00 sec 50.3 MBytes 422 Mbits/sec 54 123 KBytes
As one can see I get 940 Mbps, until I start the raspberrypi where the bandiwith drops to around 500 Mbps and summing the two back toegther gets in the area of 940 Mbps again. When the raspberrypi test is done GP goes back to 940 Mbps.
The logical conclusion is that both iperf3 streams are going down the same physical link. They should not be.
GC752XP config
GS752XP config
I have played a bit with the hasing algorthims, but I can't see how that would help in this case.
Flow control is off, STP/RTSP is on,MTU is 1522, using VLANs (but not for the test), no collision or errors on either switch for the LAG.
What do try next?
So........
My two linux servers were not located on the GC752XP as I had thought. Instead they were located on an adjacent switch. After moving them over to the GC752XP I get ~940Mbps to both servers when running the links in parrallel.
I have another mystery on the "adjacent switch" regarding why it's LAG doesn't work back to the GC752XP, but that is not for here.
6 Replies
Replies have been turned off for this discussion
Welcome to the community! :)
What is the current firmware version of both GC752XP and GS728TPv2 switches? If ever its not yet the latest version, I suggest you to update it then check if the same problem will occur.
The latest GC752XP firmware is v1.0.5.35 and you can download it here.
The latest GS728TPv2 firmware is v6.0.8.1 and you can download it here.
Regards,
DaneA
NETGEAR Community Team
Running from the two linux servers as clients to raspberrypi and GP as servers.
root@external:~# iperf3 -c 192.168.8.22 -t 40 Connecting to host 192.168.8.22, port 5201 [ 5] local 192.168.9.2 port 56324 connected to 192.168.8.22 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 114 MBytes 954 Mbits/sec 0 523 KBytes [ 5] 1.00-2.00 sec 98.5 MBytes 826 Mbits/sec 43 373 KBytes [ 5] 2.00-3.00 sec 112 MBytes 941 Mbits/sec 0 382 KBytes [ 5] 3.00-4.00 sec 112 MBytes 940 Mbits/sec 0 413 KBytes [ 5] 4.00-5.00 sec 111 MBytes 935 Mbits/sec 0 434 KBytes [ 5] 5.00-6.00 sec 112 MBytes 937 Mbits/sec 0 440 KBytes [ 5] 6.00-7.00 sec 110 MBytes 922 Mbits/sec 89 161 KBytes [ 5] 7.00-8.00 sec 60.7 MBytes 509 Mbits/sec 25 168 KBytes [ 5] 8.00-9.00 sec 57.4 MBytes 481 Mbits/sec 30 158 KBytes [ 5] 9.00-10.00 sec 56.3 MBytes 472 Mbits/sec 28 192 KBytes [ 5] 10.00-11.00 sec 56.3 MBytes 472 Mbits/sec 38 188 KBytes [ 5] 11.00-12.00 sec 53.8 MBytes 451 Mbits/sec 36 153 KBytes [ 5] 12.00-13.00 sec 49.7 MBytes 417 Mbits/sec 24 147 KBytes [ 5] 13.00-14.00 sec 53.6 MBytes 449 Mbits/sec 21 197 KBytes [ 5] 14.00-15.00 sec 56.4 MBytes 473 Mbits/sec 35 165 KBytes [ 5] 15.00-16.00 sec 57.0 MBytes 479 Mbits/sec 31 194 KBytes [ 5] 16.00-17.00 sec 101 MBytes 849 Mbits/sec 42 370 KBytes [ 5] 17.00-18.00 sec 111 MBytes 935 Mbits/sec 0 421 KBytes [ 5] 18.00-19.00 sec 113 MBytes 947 Mbits/sec 0 426 KBytes [ 5] 19.00-20.00 sec 112 MBytes 939 Mbits/sec 0 430 KBytes [ 5] 20.00-21.00 sec 110 MBytes 926 Mbits/sec 0 440 KBytes [ 5] 21.00-22.00 sec 112 MBytes 942 Mbits/sec 0 458 KBytes [ 5] 22.00-23.00 sec 112 MBytes 938 Mbits/sec 0 462 KBytes
root@hoth:~# iperf3 -c 192.168.8.52 Connecting to host 192.168.8.52, port 5201 [ 5] local 192.168.9.12 port 48664 connected to 192.168.8.52 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 49.6 MBytes 416 Mbits/sec 42 134 KBytes [ 5] 1.00-2.00 sec 55.7 MBytes 467 Mbits/sec 13 182 KBytes [ 5] 2.00-3.00 sec 55.2 MBytes 463 Mbits/sec 16 168 KBytes [ 5] 3.00-4.00 sec 55.7 MBytes 468 Mbits/sec 6 168 KBytes [ 5] 4.00-5.00 sec 57.9 MBytes 485 Mbits/sec 24 211 KBytes [ 5] 5.00-6.00 sec 63.3 MBytes 531 Mbits/sec 23 238 KBytes [ 5] 6.00-7.00 sec 58.8 MBytes 493 Mbits/sec 42 180 KBytes [ 5] 7.00-8.00 sec 56.2 MBytes 472 Mbits/sec 20 147 KBytes [ 5] 8.00-9.00 sec 54.9 MBytes 461 Mbits/sec 22 165 KBytes
Same effect as before. Direction does not matter.
I changed hash to:
1 Src/Dest MAC, incoming port
on the GS728TPv2 and ran the tests again with the client being on the GS728TPv2 side. I also changed STP on both switches off for the LAG. After doing that, it worked. ONCE. I then tried changing hash and STP combinations again to see which it was and I can't get it to work again. Looks like a bug here somewhere.
GP# iperf3 -c 192.168.9.2 -t 40 Connecting to host 192.168.9.2, port 5201 [ 4] local 192.168.8.22 port 55606 connected to 192.168.9.2 port 5201 [ ID] Interval Transfer Bandwidth Retr Cwnd [ 4] 0.00-1.00 sec 113 MBytes 949 Mbits/sec 21 352 KBytes [ 4] 1.00-2.00 sec 112 MBytes 936 Mbits/sec 32 297 KBytes [ 4] 2.00-3.00 sec 112 MBytes 941 Mbits/sec 20 461 KBytes [ 4] 3.00-4.00 sec 110 MBytes 923 Mbits/sec 64 372 KBytes [ 4] 4.00-5.00 sec 112 MBytes 940 Mbits/sec 10 419 KBytes [ 4] 5.00-6.00 sec 111 MBytes 935 Mbits/sec 99 461 KBytes
pi@raspberrypi:~ $ iperf3 -c 192.168.9.12 -t 40 Connecting to host 192.168.9.12, port 5201 [ 5] local 192.168.8.52 port 50430 connected to 192.168.9.12 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 89.7 MBytes 752 Mbits/sec 0 359 KBytes [ 5] 1.00-2.00 sec 86.9 MBytes 729 Mbits/sec 0 359 KBytes [ 5] 2.00-3.00 sec 86.9 MBytes 729 Mbits/sec 0 359 KBytes [ 5] 3.00-4.00 sec 89.5 MBytes 751 Mbits/sec 0 396 KBytes [ 5] 4.00-5.00 sec 87.1 MBytes 731 Mbits/sec 0 417 KBytes [ 5] 5.00-6.00 sec 87.1 MBytes 730 Mbits/sec 0 417 KBytes [ 5] 6.00-7.00 sec 87.2 MBytes 732 Mbits/sec 0 417 KBytes
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
