NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Solved
Recover files using Linux
Hi All, I had a problem with the NAS and I am doing the possible to recover some of the files connecting the disks to a Linux System. I used the following commands as suggested in another discus...
The next steps depend on how bad you want the data back, and what risks you want to take.
Of course, you can always contact NETGEAR for Data Recovery, they offer this kind of service as a contract.
While there are some pending sectors on sdf and sdf3 is clearly out of sync (not by much), I don't understand why sdc3 doesn't get included in the RAID array, though it shows bad blocks (mdadm output).
You could try to backup the superblocks (if not already done), then recreate the RAID array. But this could result in irrevocable data loss.
(I'm not 100% sure of what is the best approach at this stage.)
Based on the outputs you provided, I think there are two possibilities.
- Again, this is dangerous territory -
- Either try to recreate the RAID as "--assume-clean".
http://man7.org/linux/man-pages/man8/mdadm.8.html
- Or force the RAID array to assemble.
https://raid.wiki.kernel.org/index.php/RAID_Recovery#Trying_to_assemble_using_--force
For both:
- Either with sde3 sdd3 sdf3
- Or sde3 sdd3 sdc3
In theory, as you "--assume-clean" and only include three members, it shouldn't try to rewrite any block of data (but will overwrite the superblocks). So it shouldn't cause permanent damage. But it's a should.
Parameters from the output you provided:
/dev/sdd3: Magic : a92b4efc Version : 1.2 Feature Map : 0x0 Array UUID : 9c92d78d:3fa2e084:a32cf226:37d5c3c2 Name : 0e36f164:data-0 Creation Time : Sun Feb 1 21:32:44 2015 Raid Level : raid5 Raid Devices : 4 Avail Dev Size : 615438961 (293.46 GiB 315.10 GB) Array Size : 923158272 (880.39 GiB 945.31 GB) Used Dev Size : 615438848 (293.46 GiB 315.10 GB) Data Offset : 262144 sectors Super Offset : 8 sectors Unused Space : before=262064 sectors, after=113 sectors State : active Device UUID : a51d6699:b35d008c:d3e1f115:610f3d0f Update Time : Tue Oct 31 08:32:47 2017 Checksum : 3518f348 - correct Events : 14159 Layout : left-symmetric Chunk Size : 64K Device Role : Active device 1 Array State : AAA. ('A' == active, '.' == missing, 'R' == replacing)/dev/sdc3: Device Role : Active device 2 /dev/sdd3: Device Role : Active device 1 /dev/sde3: Device Role : Active device 0 /dev/sdf3: Device Role : Active device 3
That's what I would try:
# Backup superblocks for each partition - if not already done for partition in /dev/sd[a-f][0-9]; do echo "Backing up superblocks for $partition"; dd if=$partition of=/root/superblocks_$(basename $partition).mdsb bs=64k count=1; done ls -lh /root/superblocks_* # Backup of "mdadm --examine" for each partition - new for partition in /dev/sd[a-f][0-9]; do echo "Backing up mdadm information for $partition"; mdadm --examine $partition > mdadm_-E_$(basename $partition).txt; done ls -lh /root/mdadm_-E_* # Start all healthy RAID arrays - if not already done mdadm --assemble --verbose /dev/md126 /dev/sdc4 /dev/sdd4 /dev/sde5 /dev/sdf5 mdadm --assemble --verbose /dev/md125 /dev/sde4 /dev/sdf4 mdadm --assemble --verbose /dev/md127 /dev/sde6 /dev/sdf6 # Recreate the unhealthy RAID array - new mdadm --create --verbose --assume-clean --level=5 --raid-devices=4 --size=461579136K --chunk=64K --data-offset=131072K /dev/md124 /dev/sde3 /dev/sdd3 missing /dev/sdf3 # Check the integrity - do it again cat /proc/mdstat btrfs device scan btrfs filesystem show btrfsck --readonly /dev/md127 mount -o ro /dev/md127 /mnt btrfs filesystem usage /mnt
Hi Jak0lantash,
Unfortunately not all the steps recomemnded by you have been completed with success
Please have a look at the below:
root@ubuntu:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
md127 : active raid1 sde6[0] sdf6[1]
800803520 blocks super 1.2 [2/2] [UU]
md125 : active raid1 sde4[2] sdf4[3]
175686272 blocks super 1.2 [2/2] [UU]
md126 : active raid5 sdc4[6] sdf5[5] sde5[4] sdd4[3]
1992186528 blocks super 1.2 level 5, 32k chunk, algorithm 2 [4/4] [UUUU]
md122 : active raid1 sdc1[4] sdf1[6] sdd1[5] sde1[7]
4190208 blocks super 1.2 [4/4] [UUUU]
md123 : active raid10 sdf2[0] sdc2[3] sdd2[2] sde2[1]
1046528 blocks super 1.2 512K chunks 2 near-copies [4/4] [UUUU]
unused devices: <none>
root@ubuntu:~# mdadm --assemble --verbose --run /dev/md124 /dev/sde3 /dev/sdd3 /dev/sdc3
mdadm: looking for devices for /dev/md124
mdadm: /dev/sde3 is identified as a member of /dev/md124, slot 0.
mdadm: /dev/sdd3 is identified as a member of /dev/md124, slot 1.
mdadm: /dev/sdc3 is identified as a member of /dev/md124, slot 2.
mdadm: added /dev/sdd3 to /dev/md124 as 1
mdadm: added /dev/sdc3 to /dev/md124 as 2
mdadm: no uptodate device for slot 3 of /dev/md124
mdadm: added /dev/sde3 to /dev/md124 as 0
mdadm: failed to RUN_ARRAY /dev/md124: Input/output error
mdadm: Not enough devices to start the array.
root@ubuntu:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
md124 : inactive sdd3[4] sdc3[7] sde3[5]
923158441 blocks super 1.2
md127 : active raid1 sde6[0] sdf6[1]
800803520 blocks super 1.2 [2/2] [UU]
md125 : active raid1 sde4[2] sdf4[3]
175686272 blocks super 1.2 [2/2] [UU]
md126 : active raid5 sdc4[6] sdf5[5] sde5[4] sdd4[3]
1992186528 blocks super 1.2 level 5, 32k chunk, algorithm 2 [4/4] [UUUU]
md122 : active raid1 sdc1[4] sdf1[6] sdd1[5] sde1[7]
4190208 blocks super 1.2 [4/4] [UUUU]
md123 : active raid10 sdf2[0] sdc2[3] sdd2[2] sde2[1]
1046528 blocks super 1.2 512K chunks 2 near-copies [4/4] [UUUU]
unused devices: <none>
root@ubuntu:~# btrfs device scan
Scanning for Btrfs filesystems
root@ubuntu:~# btrfs filesystem show
warning, device 1 is missing
warning, device 1 is missing
Label: '0e36f164:data' uuid: 96549eaf-20c0-497d-b93c-9ebd91951afc
Total devices 4 FS bytes used 3.27TiB
devid 2 size 1.85TiB used 1.61TiB path /dev/md126
devid 3 size 167.55GiB used 167.55GiB path /dev/md125
devid 4 size 763.71GiB used 705.00GiB path /dev/md127
*** Some devices missing
root@ubuntu:~# btrfsck --readonly /dev/md127
warning, device 1 is missing
warning, device 1 is missing
Checking filesystem on /dev/md127
UUID: 96549eaf-20c0-497d-b93c-9ebd91951afc
checking extents
checking free space cache
checking fs roots
checking csums
checking root refs
checking quota groups
Counts for qgroup id: 0/257 are different
our: referenced 402350080 referenced compressed 402350080
disk: referenced 415600640 referenced compressed 415600640
diff: referenced -13250560 referenced compressed -13250560
our: exclusive 402350080 exclusive compressed 402350080
disk: exclusive 415600640 exclusive compressed 415600640
diff: exclusive -13250560 exclusive compressed -13250560
Counts for qgroup id: 0/259 are different
our: referenced 83044048896 referenced compressed 83044048896
disk: referenced 83037233152 referenced compressed 83037233152
diff: referenced 6815744 referenced compressed 6815744
our: exclusive 98304 exclusive compressed 98304
disk: exclusive 83063369728 exclusive compressed 83063369728
diff: exclusive -83063271424 exclusive compressed -83063271424
Counts for qgroup id: 0/260 are different
our: referenced 1244251586560 referenced compressed 1244251586560
disk: referenced 1244256391168 referenced compressed 1244256391168
diff: referenced -4804608 referenced compressed -4804608
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 1244277325824 exclusive compressed 1244277325824
diff: exclusive -1244277293056 exclusive compressed -1244277293056
Counts for qgroup id: 0/261 are different
our: referenced 32129851392 referenced compressed 32129851392
disk: referenced 32129884160 referenced compressed 32129884160
diff: referenced -32768 referenced compressed -32768
our: exclusive 98304 exclusive compressed 98304
disk: exclusive 32150831104 exclusive compressed 32150831104
diff: exclusive -32150732800 exclusive compressed -32150732800
Counts for qgroup id: 0/262 are different
our: referenced 579981201408 referenced compressed 579981201408
disk: referenced 579766308864 referenced compressed 579766308864
diff: referenced 214892544 referenced compressed 214892544
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 579775311872 exclusive compressed 579775311872
diff: exclusive -579775279104 exclusive compressed -579775279104
Counts for qgroup id: 0/263 are different
our: referenced 827849297920 referenced compressed 827849297920
disk: referenced 827485573120 referenced compressed 827485573120
diff: referenced 363724800 referenced compressed 363724800
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 829908611072 exclusive compressed 829908611072
diff: exclusive -829908578304 exclusive compressed -829908578304
Counts for qgroup id: 0/264 are different
our: referenced 1482752 referenced compressed 1482752
disk: referenced 1286144 referenced compressed 1286144
diff: referenced 196608 referenced compressed 196608
our: exclusive 1482752 exclusive compressed 1482752
disk: exclusive 1286144 exclusive compressed 1286144
diff: exclusive 196608 exclusive compressed 196608
Counts for qgroup id: 0/266 are different
our: referenced 10128928768 referenced compressed 10128928768
disk: referenced 10165301248 referenced compressed 10165301248
diff: referenced -36372480 referenced compressed -36372480
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 10186215424 exclusive compressed 10186215424
diff: exclusive -10186182656 exclusive compressed -10186182656
Counts for qgroup id: 0/268 are different
our: referenced 204127109120 referenced compressed 204127109120
disk: referenced 204126322688 referenced compressed 204126322688
diff: referenced 786432 referenced compressed 786432
our: exclusive 204127109120 exclusive compressed 204127109120
disk: exclusive 204126322688 exclusive compressed 204126322688
diff: exclusive 786432 exclusive compressed 786432
Counts for qgroup id: 0/335 are different
our: referenced 194561572864 referenced compressed 194561572864
disk: referenced 194667118592 referenced compressed 194667118592
diff: referenced -105545728 referenced compressed -105545728
our: exclusive 22695936 exclusive compressed 22695936
disk: exclusive 201282125824 exclusive compressed 201282125824
diff: exclusive -201259429888 exclusive compressed -201259429888
Counts for qgroup id: 0/635 are different
our: referenced 40960 referenced compressed 40960
disk: referenced 40960 referenced compressed 40960
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 40960 exclusive compressed 40960
diff: exclusive -8192 exclusive compressed -8192
Counts for qgroup id: 0/2754 are different
our: referenced 10559488 referenced compressed 10559488
disk: referenced 10526720 referenced compressed 10526720
diff: referenced 32768 referenced compressed 32768
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 40960 exclusive compressed 40960
diff: exclusive -8192 exclusive compressed -8192
Counts for qgroup id: 0/2755 are different
our: referenced 98304 referenced compressed 98304
disk: referenced 65536 referenced compressed 65536
diff: referenced 32768 referenced compressed 32768
our: exclusive 98304 exclusive compressed 98304
disk: exclusive 65536 exclusive compressed 65536
diff: exclusive 32768 exclusive compressed 32768
Counts for qgroup id: 0/2858 are different
our: referenced 32360566784 referenced compressed 32360566784
disk: referenced 32359649280 referenced compressed 32359649280
diff: referenced 917504 referenced compressed 917504
our: exclusive 98304 exclusive compressed 98304
disk: exclusive 32359645184 exclusive compressed 32359645184
diff: exclusive -32359546880 exclusive compressed -32359546880
Counts for qgroup id: 0/2859 are different
our: referenced 32768 referenced compressed 32768
disk: referenced 0 referenced compressed 0
diff: referenced 32768 referenced compressed 32768
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 0 exclusive compressed 0
diff: exclusive 32768 exclusive compressed 32768
Counts for qgroup id: 0/3842 are different
our: referenced 5056966656 referenced compressed 5056966656
disk: referenced 5056737280 referenced compressed 5056737280
diff: referenced 229376 referenced compressed 229376
our: exclusive 5056966656 exclusive compressed 5056966656
disk: exclusive 5056737280 exclusive compressed 5056737280
diff: exclusive 229376 exclusive compressed 229376
Counts for qgroup id: 0/3956 are different
our: referenced 32768 referenced compressed 32768
disk: referenced 0 referenced compressed 0
diff: referenced 32768 referenced compressed 32768
our: exclusive 32768 exclusive compressed 32768
disk: exclusive 0 exclusive compressed 0
diff: exclusive 32768 exclusive compressed 32768
found 3591169544192 bytes used, no error found
total csum bytes: 2780591748
total tree bytes: 5103910912
total fs tree bytes: 1800110080
total extent tree bytes: 169246720
btree space waste bytes: 599227477
file data blocks allocated: 4113154846720
referenced 4001220476928
root@ubuntu:~# mount -o ro /dev/md127 /mnt
mount: /mnt: wrong fs type, bad option, bad superblock on /dev/md127, missing codepage or helper program, or other error.
root@ubuntu:~# btrfs filesystem usage /mnt
ERROR: not a btrfs filesystem: /mnt
root@ubuntu:~# btrfsck --readonly /dev/md124
ERROR: superblock bytenr 65536 is larger than device size 0
ERROR: cannot open file system
root@ubuntu:~#
Thanks a lot for all the efforts you are doing to help me with this!
Gabriele
If one of the arrays don't start, no need to continue the steps with btrfs stuff, it will fail.
md124 failed to start. This is the array with an unsync member.
root@ubuntu:~# mdadm --assemble --verbose --run /dev/md124 /dev/sde3 /dev/sdd3 /dev/sdc3 mdadm: looking for devices for /dev/md124 mdadm: /dev/sde3 is identified as a member of /dev/md124, slot 0. mdadm: /dev/sdd3 is identified as a member of /dev/md124, slot 1. mdadm: /dev/sdc3 is identified as a member of /dev/md124, slot 2. mdadm: added /dev/sdd3 to /dev/md124 as 1 mdadm: added /dev/sdc3 to /dev/md124 as 2 mdadm: no uptodate device for slot 3 of /dev/md124 mdadm: added /dev/sde3 to /dev/md124 as 0 mdadm: failed to RUN_ARRAY /dev/md124: Input/output error mdadm: Not enough devices to start the array.
Does it work if you assemble the RAID with the unsync member (as unsynced)?
mdadm --assemble --verbose /dev/md124 /dev/sde3 /dev/sdd3 /dev/sdc3 /dev/sdf3
If not, please give the output of this:
for partition in /dev/sde3 /dev/sdd3 /dev/sdc3 /dev/sdf3; do echo "$partition: "; mdadm --examine $partition; done
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
