× NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Orbi WiFi 7 RBE973
Reply

GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Nuclear_N
Star

GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Hi Friends,

 

I have 3 switches (GC110 and GC110P) managed via Insight.

 

A few months ago they all started crashing / restarting themselves - strangely about every 2 days, 6 hours (I kept a spreadsheet!). Each would restart by itself, and then be fine again for another couple of days.

 

All were on firmware 1.0.5.35 (latest) and I can find nothing useful in the log just prior to the crashes. On reboot it does say in the log "SIM Cnfgr_Thread - : sim_util.c(3927) 8 %% Switch was reset due to power disruption or unexpected restart." 

 

In desperation I reverted one switch back to 1.0.5.32, and it hasn't crashed since. The other two kept crashing.

 

I've now downgraded another one to 1.0.5.32 and it's been stable for 8+ days too.

 

The remaining switch I've left on 1.0.5.35 and it crashes almost like clockwork.

 

Anybody come across this before with firmware 1.0.5.35? Can't see anything in the firware release notes.

 

Thanks for any ideas! Smiley Very Happy

 

Nick.

 

Model: GC110|8-Port Gigabit Ethernet App Managed Smart Cloud Switch w/2 SFP Fiber Ports, GC110P|8-Port Gigabit Ethernet PoE App Managed Smart Cloud Switch w/2 SFP Fiber Ports
Message 1 of 25
schumaku
Guru

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Hard to guess. We are monitoring uptimes of > 110 days on all the the GC110x, GC510x, GC7nnx on v1.0.5.35. 

Message 2 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

I got lucky this evening and cleared the log only about 5 mins before a restart event.

 

Here is the beginning of the log (starting from bottom).

 

<9>1 2017-06-02T00:00:44.120Z 0.0.0.0-1 SIM Cnfgr_Thread - : sim_util.c(3927) 8 %% Switch was reset due to power disruption or unexpected restart.
<13>1 2017-06-02T00:00:44.099Z 0.0.0.0-1 OSAPI fp_main_task - : osapi_netlink.c(489) 7 %% Unable add the entry to /etc/iproute2/rt_protos.
<10>1 2017-06-02T00:00:44.051Z 0.0.0.0-1 General fp_main_task - : bootos.c(188) 6 %% Event(0xaaaaaaaa)
<13>1 2017-06-02T00:00:44.051Z 0.0.0.0-1 BSP fp_main_task - : bootos.c(172) 5 %% BSP initialization complete, starting switch firmware.
<13>1 2017-06-02T00:00:39.462Z 0.0.0.0-1 General fp_main_task - : sdm_template_mgr.c(488) 3 %% Booting with default SDM template Dual IPv4 and IPv6.
<14>1 2017-06-02T00:00:39.461Z 0.0.0.0-1 BSP fp_main_task - : sysbrds.c(190) 2 %% hpcBoardIdCheck: Detected boardType:0x1, unitType:0xa8343001, devId:0x8343
<14>1 2017-06-02T00:00:39.135Z 0.0.0.0-1 General procLOG - : procmgr.c(3685) 1 %% Application Terminated (user.start, ID = 7, PID = 1252

 

The timestamps are strange, I think because it's just restarted and hasn't yet synced time.

 

Full log attached.

 

Message 3 of 25
schumaku
Guru

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

@RaghuHR any hints for @Nuclear_N  ?

Message 4 of 25

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

I have around 10 GC110 and having exactly the same issue with all of them. Netgear need to urgently investigate this issue and release new firmware version if required.

Message 5 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Thank you for responding... I'm taking some consolation from the fact that I now know it isn't just me!

 

In the meantime (if it helps you) what I've done on each switch is install FW 1.0.5.35 as image1, and FW 1.0.5.32 as image2... and am running them all on image2 until I find a resolution. (Pic attached.)

 

Model: GC110|8-Port Gigabit Ethernet App Managed Smart Cloud Switch w/2 SFP Fiber Ports, GC110P|8-Port Gigabit Ethernet PoE App Managed Smart Cloud Switch w/2 SFP Fiber Ports
Message 6 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Here is a table of when the GC110 switches running FW 1.0.5.35 crashed and restarted.

 

All, strangely, crash and restart around that 2 day, 5 hour mark.

 

Unexpected RestartTimeUptime
19-Jan7am2 days, 6 hours
21-Jan12:30pm2 days, 5.5 hours
23-Jan5:45pm2 days, 5.25 hours
25-Jan7:45pm2 days, 2 hours
28-Jan12:20am2 days, 5 hours
30-Jan6:20am2 days, 6 hours
1-Feb10am2 days, 4 hours
3-Feb3:30pm2 days, 5.5 hours

 

Still no crashes at all on the same switches running FW 1.0.5.32.

 

Model: GC110|8-Port Gigabit Ethernet App Managed Smart Cloud Switch w/2 SFP Fiber Ports, GC110P|8-Port Gigabit Ethernet PoE App Managed Smart Cloud Switch w/2 SFP Fiber Ports
Message 7 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

I have logged this with Netgear Support (case 45663101).

 

Their initial suspicion is a bug in firmware 1.0.5.35 - to be confirmed.

 

If you're having the same issue, please hit the "Ditto" or "Me Too" button above so they know how widespread it is.

 

Message 8 of 25
Keith13
Initiate

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Same problem have 3 GC110P with firmware 1.0.5.35. Just reset every few days I have PEO cctv on them so loose the cameras for about 5 minuites which is really annoying

Model: GC110P|8-Port Gigabit Ethernet PoE App Managed Smart Cloud Switch w/2 SFP Fiber Ports
Message 9 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Message 10 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

If it helps anyone... removing the switches from Insight Management (changing them to locally managed mode) stops them crashing.

 

So it's something to do with Insight remote management and this firmware version.

 

Netgear L3 still working on it.

 

Message 11 of 25

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Did you hear anything back from L3 Support?

Message 12 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

They confirmed it's still open with their Insight engineers.

Message 13 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Netgear says they have reproduced the issue, and firmware fix is coming.

Message 14 of 25

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Do we know when the firmware fix is being released? 

Message 15 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Nope! They have been communicating regularly and sent me a beta firmware to test, but it didn't fix the issue. They're still working on it...

Message 16 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Update: Netgear support believes it's a memory leak, which sounds plausible to me.

They've given me another beta FW to test, and so far it's been stable for 12 days! Looking promising.

Message 17 of 25

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Hi,

 

Is the Beta firmware still working okay? Do we have any further information from Netgear?

Message 18 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

All looking good from my perspective - no crashing or issues after many weeks of testing.

 

Sounds like it was a memory leak in the firmware.

 

Netgear has closed the case and advised they'll be releasing a new FW version soon, but didn't give an ETA.

 

Message 19 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Still no ETA on the new firmware, or any further correspondence.

 

And they've closed the support case, so I can't follow up...

 

C'mon Netgear!  😒

Message 20 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

I called Netgear Support again today.

 

After over 3 months, still no ETA on the new firmware, but they have opened a new case which they say they will update once the firmware is available.

 

In the meantime I'm still running 1.0.5.32 (last stable release).

 

Nick.

Message 21 of 25

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Don't know why it takes them so long is issue new firmware... Are they definitely sure the firmware is going to be released or are they just waiting for the end of the product lifecycle to do nothing? 

Message 22 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

NFI I'm afraid.

 

Latest update (yesterday) was "Upon checking, we still don't have an ETA on the release of the latest firmware for this switch.

Per your request, we will keep the case open for you."

 

At least they are proactive in advising that nothing has happened? 🙄

 

Maybe we need more people to "me too" this thread!

 

Message 23 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

New firmware released today - V 1.0.5.36 apparently addresses the issue.

Haven't tried it yet.

 

Release notes say "addresses bug where switches may reboot unexpectedly if the UTC [time] offset is greater than 10" - which would definitely be the case where I live in Sydney, Australia. Apparently it was something applicable to certain time zones?

 

Fingers crossed and good luck everybody!

Message 24 of 25
Nuclear_N
Star

Re: GC110 & GC110P - Crashing / Restarting Every 2 Days on Firmware 1.0.5.35 (3 Switches)

Message 25 of 25
Discussion stats
  • 24 replies
  • 4633 views
  • 12 kudos
  • 4 in conversation
Announcements