ReadyNAS 516 just upgraded to 6.7.1 and data volume has not loaded

[kentd]

Hi,

I just installed 6.7.1 and on re-boot the primary data volume has not loaded - and suggests removing the inactive volume.

I have two volumes, one of 6 drives in the RN516, this was a raid 6 volume called 'data' it was encrypted, and the usb key has always and is still in the NAS. (no problems rebooting any other time).

The 2nd volume is 5 drive volume in the EDA, called 'eda1', also raid6 and also encrypted. This volume has loaded fine and unlocked the encryption.

[Skywalker · Accepted solution]

/data-0/.timemachine was a subvolume, so a regular deletion didn't work.  I removed the subvolume and directory, and now everything is mounted normally.

[mdgm-ntgr]

Can you send in your logs (see the Sending Logs link in my sig)?

[kentd]

Hi, i cant seem to download the logs - all i get is this

[kentd]

Ok, i restarted the NAS again as couldnt get any logs. 

Have now got the logs and sent them to email address as instructed, but have now got the same problem with the EDA volume too.

[mdgm-ntgr]

Your 4GB root volume is pretty full. You should check why that is full and fix that as the first step.

[kentd]

Is there any instructions or link to how please?

[kentd]

Last login: Sun Jul 3 18:55:46 2016 from 192.168.7.180
root@KDNAS4:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 10M 4.0K 10M 1% /dev
/dev/md0 4.0G 3.7G 25M 100% /
tmpfs 1.9G 0 1.9G 0% /dev/shm
tmpfs 1.9G 4.0M 1.9G 1% /run
tmpfs 960M 1.1M 959M 1% /run/lock
tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup
/dev/mapper/eda1-0 17T 11T 6.0T 64% /eda1
/dev/sdl1 1.9G 917M 969M 49% /media/USB_FLASH_5
/dev/mapper/eda1-0 17T 11T 6.0T 64% /var/ftp/Movie1
/dev/mapper/eda1-0 17T 11T 6.0T 64% /var/ftp/TV2
root@KDNAS4:~# df-i
-bash: df-i: command not found
root@KDNAS4:~# df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
udev 490647 653 489994 1% /dev
/dev/md0 0 0 0 - /
tmpfs 491265 1 491264 1% /dev/shm
tmpfs 491265 999 490266 1% /run
tmpfs 491265 25 491240 1% /run/lock
tmpfs 491265 11 491254 1% /sys/fs/cgroup
/dev/mapper/eda1-0 0 0 0 - /eda1
/dev/sdl1 0 0 0 - /media/USB_FLASH_5
/dev/mapper/eda1-0 0 0 0 - /var/ftp/Movie1
/dev/mapper/eda1-0 0 0 0 - /var/ftp/TV2

root@KDNAS4:/# du -csh /var/log/*
4.0K /var/log/alternatives.log
1.5M /var/log/apache2
32K /var/log/apt
4.0K /var/log/btmp
4.0K /var/log/dbbroker.log
124K /var/log/dpkg.log
8.0K /var/log/faillog
6.3M /var/log/frontview
0 /var/log/fsck
71M /var/log/journal
12K /var/log/lastlog
56K /var/log/mysql
0 /var/log/mysql.err
0 /var/log/mysql.log
0 /var/log/news
136K /var/log/proftpd.log
2.0M /var/log/readynasd
260K /var/log/samba
224K /var/log/wtmp
81M total
root@KDNAS4:/# du -csh /var/*
0 /var/agentx
68M /var/backups
51M /var/cache
44M /var/cores
5.8T /var/ftp
80M /var/lib
0 /var/local
4.0K /var/lock
81M /var/log
0 /var/mail
8.0K /var/netatalk
40K /var/nuuo
0 /var/opt
9.6M /var/readynasd
0 /var/replicate
4.0K /var/run
4.0K /var/spool
0 /var/tmp
4.0K /var/www
5.8T total
root@KDNAS4:/# du -csh /var/log/frontview/*
140K /var/log/frontview/amazoncd.log
3.0M /var/log/frontview/amazoncd.log.old
1.2M /var/log/frontview/backup
4.0K /var/log/frontview/initrd.log
164K /var/log/frontview/msmtp.log
4.0K /var/log/frontview/password_recovery.log
460K /var/log/frontview/status.log
1.5M /var/log/frontview/status.log.old
6.3M total

Only apps i currently use are ReadyNAS Surveillance and Transmission.

[StephenB]

---

@kentd wrote:

Only apps i currently use are ReadyNAS Surveillance and Transmission.

---

Most likely it's transmission.

You are ignoring a lot of folders (/usr, /lib, /etc), and it is also possible that the data was written "underneath" a mount point (particularly /apps)

Try mounting the OS partition as /mnt, and then explore /mnt.  That will solve the data "underneath" problem.

# mount --bind / /mnt

 When done

# umount /mnt 

[kentd]

root@KDNAS4:/usr# du -csh /usr
360M /usr
360M total
root@KDNAS4:/usr# du -csh /lib
33M /lib
33M total
root@KDNAS4:/usr# du -csh /etc
12M /etc
12M total
root@KDNAS4:/usr# du -csh /apps
0 /apps
0 total
root@KDNAS4:/usr#

sorry i just dont know terminal, the commands, or what do do here. is there any remote support possible please?

[jak0lantash]

Maybe you want to upvote this "idea" as well: https://community.netgear.com/t5/Idea-Exchange-for-ReadyNAS/Change-the-incredibly-confusing-error-me...

[kentd]

Done

[jak0lantash]

Did you use the mount command given by @StephenB?

mount --bind / /mnt

Then look inside it:

cd /mnt
du -d1 -h

It will tell you which is the biggest folder, then cd into it and re-run:

cd <big_folder>
du -d1 -h

Repeat the operation until there is no more big folder, only the total is big, which means it's big file(s) in the current directory, then:

ls -lhS

When you're finished cleaning up the big files, unmount the temporary bind:

cd
umount /mnt

[kentd]

ok, here is the big folder ./controlc-wpbackup - this must have been written to here by an internal backup job rather than the data volume. 

Last login: Thu May 11 07:58:49 2017 from 192.168.7.26

root@KDNAS4:~# mount --bind / /mnt

root@KDNAS4:~# cd /mnt

root@KDNAS4:/mnt# du -d1 -h

6.7M ./bin

0 ./boot

24K ./dev

12M ./etc

33M ./lib

4.0K ./lib64

32K ./media

0 ./mnt

4.6M ./opt

0 ./proc

24K ./root

0 ./run

10M ./sbin

0 ./selinux

0 ./srv

0 ./sys

4.0K ./tmp

360M ./usr

335M ./var

0 ./home

0 ./apps

2.7G ./data

0 ./eda1

0 ./crypto_LUKS

3.6M ./lib32

35M ./data-0

29M ./frontview

3.6G .

root@KDNAS4:/mnt# cd data

root@KDNAS4:/mnt/data# du -d1 -h

0 ./AmazonCloudDrive

0 ./FamilyPics

237M ./KentandMing

0 ./controlc-orangefix

0 ./controlc-redjungle

2.5G ./controlc-wpbackup

0 ./Photos

0 ./scans

2.7G .

how do i just delete it? - its only a wordpress site backup and can go.

[StephenB]

You shouldn't have anything in /mnt/data since it is a mount point.

First check ./KentandMing - that also should be deleted, but you might first need to copy it somewhere. 

When you are sure there is nothing you want, then this should remove everything in it.

cd /mnt/data

rm -rf *

Just be careful that you are in the right folder!

[kentd]

ok, have removed all from mnt/data - the data in there was readynas backup jobs that were directed to the volume on the EDA, no idea why that happened.

[kentd]

ok, root volume seems normal again at 24% usage. There was data from backup jobs on the root - perhaps when the EDA wasnt available the data went there instead. What is next step to bring back 'data' volume on primary chassis please?

[kentd]

Is it ok to try boot the data volume again? what else is there to check?

[StephenB]

Try rebooting, and then see if you can get the log zipfile that @mdgm-ntgr requested.

[kentd]

Yes log files have been sent

[jak0lantash]

"df -i" is irrelevant on a RN516 as both the data volume and the OS volume use BTRFS.

Does it boot now? Is your data volume blue?

[kentd]

Hi, the unit reboots but the primary data volume is still not loading.

Is it because its not md126, or because it is encrypted too? (yes the USB with the encryption key is still in - and hasnt been removed)

[kentd]

@jak0lantash @StephenB @mdgm-ntgr can anyone please advise next step? is there a way to recover/reboot the data volume?

[mdgm-ntgr]

Can you send in a fresh set of logs (see the Sending Logs link in my sig)?

[kentd]

---

@mdgm wrote:

Can you send in a fresh set of logs (see the Sending Logs link in my sig)?

---

Yes, sent just now. Thanks for taking a look.

[Skywalker]

I see a /data-0 folder on your root volume.  Please check if that holds anything important; if not go ahead and remove it and reboot.  Your data volume should come back after that.