- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Network interfaces dropping
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Network interfaces dropping
Running the latest firmware. We have had a periodic issue with losing network connectivity to the NAS. The only way this can be restored is to power restart the NAS. After logging back in the gui logs don't show any issues, they do show the system restarting etc.
The NAS is connected via four ethernet links setup as two Bonds. Each bond of two ethernet links terminates on a separate Cisco 3560G switch which is setup with a port channel. Each Bond has it's own IP address.
When the issue occurs both switches show the port channels going down at exactly the same time. Other port channels on the switches remain up with no issues including those that carry the same vlan's as the port channel connected to the NAS.
The Cisco switches show the two physical ethernet interfaces dropping a few seconds apart and then the Port channel dropping immediately after they both go down, the weird this is that the two physicals come straight back up but the port channel remains down until we power reset.
I have tried manually shutting and no shutting the interfaces to try and get them to come back up but no luck.
What logs on the NAS should I be looking at to try and identify what's going on?
Cheers
Matt
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
What type of bonding are you using?
Was this configuration working fine for a long while before you started seeing the loss of network connectivity or has it never worked properly?
Please send in your logs (see the Sending Logs link in my sig).
A good place to start would be looking at network_settings.log
Other logs such as systemd-journal.log (the main system log), kernel.log, dmesg.log are also good places to look.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
Thanks for the reply.
The setup on the ReadyNAS is using LACP Layer3+4. The Cisco switch is set to LACP active mode.
Will upload the logs shortly.
Cheers
Matt
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
Have checked all the log files suggested and there is nothing before the loss of network connectivity that I can see.
Cheers
Matt
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
Is the Cisco Switch also configured to use layer 3+4?
I see a number of virtual adapters. Are you using iSCSI?
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
Thanks again for your reply.
As the switch is a layer 2 it doesn't have the option for layer 4. The load balance methods are not the same at each end however that shouldn't be causing any issues. We can certainly change it to layer 2+3 so both ends match however as we are running ISCSI most of the connections will end up running on a single link which defeats the purpose of link aggregation.
Cheers
Matt
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
The same method should be in use at both ends, I think. That's definitely worth trying.
In 6.9.4 (coming soon) we currently plan to add the option to restrict the use of an iSCSI group to an individual interface which you may also find useful.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
@mdgm-ntgr wrote:
The same method should be in use at both ends, I think. That's definitely worth trying.
It doesn't really matter to LACP, it is just a transmit policy to load-balance the physical links. It isn't negotiated, and the receiver needs to handle whatever transmit policy the sender chooses.
The disadvantage of layer 3+layer 4 is that it can result in overrunning a client gigabit link. That shouldn't drop the interface, but it would force the switch to drop packets (and TCP flow control to kick in) unless ethernet flow control is enabled.
Switching to layer 2 xmit hash is probably worth a try. But I think I'd remove one of the bonds next, and see if those physical ports remain up (and actually connected) when the other bond drops. It's not clear to me that this problem is actually related to the link aggregation.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
Thanks for all the replies. Because both bonds drop I lose visibility of what's occuring on the NAS but the logs don't show anything once I have power restarted it.
If I drop one of the Bonds then I don't have any redundancy whilst I am testing and this issue appears to be random and sometimes doesn't occur for three weeks so I am a little loathe to have no redundancy whilst I am waiting for this to recur.
I will definitely change the lacp configurations to match however I don't think this is the issue.
Cheers
Matt
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Re: Network interfaces dropping
Would changing one of them to ALB be an option?
@itworksnz wrote:
If I drop one of the Bonds then I don't have any redundancy whilst I am testing and this issue appears to be random and sometimes doesn't occur for three weeks so I am a little loathe to have no redundancy whilst I am waiting for this to recur.