× NETGEAR will be terminating ReadyCLOUD service by July 1st, 2023. For more details click here.
Orbi WiFi 7 RBE973
Reply

Re: FSCK Found Errors on Boot

steveoelliott
Luminary

FSCK Found Errors on Boot

Hi all,

Just rebooted my NAS today after 200 days uptime and thought I'd request a volume scan and it found errors! I've never had a power outage etc so am keen to know what could have caused this file system corruption? Anyu ideas???

I'm running 4.2.21 on a ReadyNAS Pro6

***** File system check forced at Fri Apr 26 20:08:38 WEST 2013 ***** fsck 1.41.14 (22-Dec-2010) e2fsck 1.42.3 (14-May-2012) Pass 1: Checking inodes, blocks, and sizes Inode 4195619, i_blocks is 3135728, should be 3135904. Fix? yes


Running additional passes to resolve blocks claimed by more than one inode...
Pass 1B: Rescanning for multiply-claimed blocks Multiply-claimed block(s) in inode 4195619: 167904376 167904377 167904378 167904379 167904380 167904381 167904382 167904383 167904384 167904385 167904386 167949296 167949297 167949298 167949299 167949300 167949301 167949302 167949303 167949304 167949305 167949306 Pass 1C: Scanning directories for inodes with multiply-claimed blocks Pass 1D: Reconciling multiply-claimed blocks (There are 1 inodes containing multiply-claimed blocks.)

File /PREMIER/Premier Automation Purchase OrdersApp V18.5.mdb (inode #4195619, mod time Fri Apr 26 20:07:42 2013)
has 22 multiply-claimed block(s), shared with 0 file(s):
Multiply-claimed blocks already reassigned or cloned.

Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information

/dev/c/c: ***** FILE SYSTEM WAS MODIFIED *****
/dev/c/c: 615898/30212096 files (13.6% non-contiguous), 62353456/483393536 blocks

All SMART data is perfect, no ATA or Recovered sectors. All drives off HCL and less than a year old.
Message 1 of 16
steveoelliott
Luminary

Re: FSCK Found Errors on Boot

I'm curious to know what this is all about:

File /PREMIER/Premier Automation Purchase OrdersApp V18.5.mdb (inode #4195619, mod time Fri Apr 26 20:07:42 2013)
has 22 multiply-claimed block(s), shared with 0 file(s):
Multiply-claimed blocks already reassigned or cloned.
Message 2 of 16
steveoelliott
Luminary

Re: FSCK Found Errors on Boot

Now have a case with support open 🙂
Message 3 of 16
steveoelliott
Luminary

Re: FSCK Found Errors on Boot

Case Number: 21042203
Message 4 of 16
steveoelliott
Luminary

Re: FSCK Found Errors on Boot

Well... I have some new and interesting information.

After deleting the file, and re-creating from backup, the file system got mounted read only and the following errors were logged:]

May 8 14:58:15 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904376:freeing already freed block (bit 1144)
May 8 14:58:15 despair kernel: Aborting journal on device dm-0-8.
May 8 14:58:15 despair kernel: EXT4-fs (dm-0): Remounting filesystem read-only
May 8 14:58:15 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904377:freeing already freed block (bit 1145)
May 8 14:58:15 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904378:freeing already freed block (bit 1146)
May 8 14:58:15 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904379:freeing already freed block (bit 1147)
May 8 14:58:15 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904380:freeing already freed block (bit 1148)
May 8 14:58:15 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904381:freeing already freed block (bit 1149)
May 8 14:58:15 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904382:freeing already freed block (bit 1150)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904383:freeing already freed block (bit 1151)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904384:freeing already freed block (bit 1152)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904385:freeing already freed block (bit 1153)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5124block 167904386:freeing already freed block (bit 1154)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949296:freeing already freed block (bit 13296)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949297:freeing already freed block (bit 13297)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949298:freeing already freed block (bit 13298)
May 8 14:58:16 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949299:freeing already freed block (bit 13299)
May 8 14:58:17 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949300:freeing already freed block (bit 13300)
May 8 14:58:17 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949301:freeing already freed block (bit 13301)
May 8 14:58:17 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949302:freeing already freed block (bit 13302)
May 8 14:58:17 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949303:freeing already freed block (bit 13303)
May 8 14:58:17 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949304:freeing already freed block (bit 13304)
May 8 14:58:17 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949305:freeing already freed block (bit 13305)
May 8 14:58:17 despair kernel: EXT4-fs error (device dm-0): mb_free_blocks:1411: group 5125block 167949306:freeing already freed block (bit 13306)


These are the same blocks slated as multiply claimed

And then running an FSCK, we got the following:

***** File system check forced at Wed May 8 15:16:50 WEST 2013 ***** fsck 1.41.14 (22-Dec-2010) e2fsck 1.42.3 (14-May-2012)
/dev/c/c: recovering journal
Pass 1: Checking inodes, blocks, and sizes Pass 2: Checking directory structure Pass 3: Checking directory connectivity Pass 4: Checking reference counts Pass 5: Checking group summary information Free blocks count wrong for group #5124 (28170, counted=28159).
Fix? yes

Free blocks count wrong for group #5125 (25861, counted=25850).
Fix? yes

Free blocks count wrong (420683133, counted=420644972).
Fix? yes

Free inodes count wrong (29595347, counted=29595271).
Fix? yes


/dev/c/c: ***** FILE SYSTEM WAS MODIFIED *****
/dev/c/c: 616825/30212096 files (13.6% non-contiguous), 62748564/483393536 blocks

Volume seems clean now after reboot and keeps coming back clean.

Any ideas based on this? The old Database was over 1.6 GB in size. The re-created one from backup is much smaller 33MB (as it was compacted before restoring). Once these DB files grow they don't get smaller until compacted. Although I'm sure file size should not have a bearing on this.

Many Thanks
Stephen Elliott
Message 5 of 16
evan2
NETGEAR Expert

Re: FSCK Found Errors on Boot

Hi steveoelliott,
File system is OK when you see the problem, it don't affect your data.
We have addon to avoid this released already.
5.3.8 also included fix, please update to 5.3.8.
Message 6 of 16
chirpa
Luminary

Re: FSCK Found Errors on Boot

evan wrote:
5.3.8 also included fix, please update to 5.3.8.
Where is it? Update server does not have it.

And if you read his original post, he is on x86 platform (4.2), so 5.3 firmware is no help.
steveoelliott wrote:
I'm running 4.2.21 on a ReadyNAS Pro6
Message 7 of 16
evan2
NETGEAR Expert

Re: FSCK Found Errors on Boot

Hi steveoelliott,
Sorry! I don't see your issue is on Pro6.
We found Inode error issue on 5.3 firmware, the issue has been fixed on 5.3.8,
I aksed a support to track your support case.
Message 8 of 16
Wish
Aspirant

Re: FSCK Found Errors on Boot

Evan,
Do you have a download link to 5.3.8?
Message 9 of 16
evan2
NETGEAR Expert

Re: FSCK Found Errors on Boot

5.3.8 is in process for release, I send PM to you, please check.
Message 10 of 16
Zaim
Aspirant

Re: FSCK Found Errors on Boot

That update didn't work for me at all, still getting the rubbish speeds. I have deleted more things to get 10% free, still very poor. I really give up on this, shouldn't have to deal with issue's like these on a expensive NAS.

18MB/s write and 22MB/s read is the absolute max i get.

when i initially got the nas I got around 40MB/s Write and 85+MB/s Read.
Message 11 of 16
steveoelliott
Luminary

Re: FSCK Found Errors on Boot

As already mentioned I am on x86 so 5.3.8 is not an option.

I've already got a case with support (21042203) but my issue is basically resolved now but am after a root cause and preventing it happening in future.
Message 12 of 16
steveoelliott
Luminary

Re: FSCK Found Errors on Boot

Well, in my case no root cause was found but I'm interested as to why debugfs doesn't return anything useful on the NAS device. Maybe it's something to do with the way the RAID is setup.
Message 13 of 16
mdgm-ntgr
NETGEAR Employee Retired

Re: FSCK Found Errors on Boot

There is a new firmware 4.2.23 coming soon with updated e2fsprogs. Hopefully this helps.

There is a 4.2.23-T6 beta firmware currently available.
Message 14 of 16
steveoelliott
Luminary

Re: FSCK Found Errors on Boot

Thanks... I presume the Kernel will be newer too.
Message 15 of 16
mdgm-ntgr
NETGEAR Employee Retired

Re: FSCK Found Errors on Boot

No, the kernel is still the same. It is highly unlikely that there will be a kernel update for RAIDiator-x86 4.2.x in the future.

The new ReadyNAS OS devices use the BTRFS filesystem and currently use the longterm 3.0.x kernel
Message 16 of 16
Top Contributors
Discussion stats
  • 15 replies
  • 2711 views
  • 0 kudos
  • 6 in conversation
Announcements