Re: Root 100% Full But Cannot Find Files to Delete in Root

Jonbooi · ‎2019-03-24

After a period of power outages (called Loadshedding), my ReadyNAS has started mailing me warnings: System volume root's usage is 100%.

Accesssing the NAS via SSH does not appear to help me as there is nothing that I can see to delete from the root folder.

#df -i gives me:

udev 63140 384 62756 1% /dev
/dev/md0 65536 21805 43731 34% /
tmpfs 63592 3 63589 1% /dev/shm
tmpfs 63592 531 63061 1% /run
tmpfs 63592 26 63566 1% /run/lock
tmpfs 63592 9 63583 1% /sys/fs/cgroup
/dev/md127 0 0 0 - /data
/dev/md127 0 0 0 - /home
/dev/md127 0 0 0 - /apps
/dev/md127 0 0 0 - /var/ftp/Recordings
tmpfs 63592 1 63591 1% /data/Backup/snapshot
tmpfs 63592 2 63590 1% /data/Documents/snapshot
/dev/md127 0 0 0 - /data/Documents/snapshot/m_25-01-2015
tmpfs 63592 1 63591 1% /data/JC-SILENC-Documents/snapshot
tmpfs 63592 1 63591 1% /data/Music/snapshot
tmpfs 63592 1 63591 1% /data/Pictures/snapshot
tmpfs 63592 1 63591 1% /data/readydrop/snapshot
tmpfs 63592 1 63591 1% /data/Videos/snapshot

#df -h gives:

udev 10M 4.0K 10M 1% /dev
/dev/md0 4.0G 3.9G 0 100% /
tmpfs 249M 8.0K 249M 1% /dev/shm
tmpfs 249M 600K 248M 1% /run
tmpfs 125M 1.1M 124M 1% /run/lock
tmpfs 249M 0 249M 0% /sys/fs/cgroup
/dev/md127 1.9T 1.2T 657G 65% /data
/dev/md127 1.9T 1.2T 657G 65% /home
/dev/md127 1.9T 1.2T 657G 65% /apps
/dev/md127 1.9T 1.2T 657G 65% /var/ftp/Recordings
tmpfs 4.0K 0 4.0K 0% /data/Backup/snapshot
tmpfs 4.0K 0 4.0K 0% /data/Documents/snapshot
/dev/md127 1.9T 1.2T 657G 65% /data/Documents/snapshot/m_25-01-2015
tmpfs 4.0K 0 4.0K 0% /data/JC-SILENC-Documents/snapshot
tmpfs 4.0K 0 4.0K 0% /data/Music/snapshot
tmpfs 4.0K 0 4.0K 0% /data/Pictures/snapshot
tmpfs 4.0K 0 4.0K 0% /data/readydrop/snapshot
tmpfs 4.0K 0 4.0K 0% /data/Videos/snapshot

I have looked at other posts but I am nervous to run the "balancing" commands if I do not know what the potential pitfalls are.

Thank you in advance for your assistance.

asimb · ‎2019-03-25

Please read the thread https://community.netgear.com/t5/Using-your-ReadyNAS-in-Business/System-volume-root-s-usage-is-xx-Th... posting 3 to understand what the problem really is. The solution is described in posting 7 and 10 or more compact by @StephenB here: https://community.netgear.com/t5/Using-your-ReadyNAS-in-Business/System-volume-root-s-usage-is-90-RN...

Jonbooi · ‎2019-03-25

Hi Asimb

I ran your steps but my NAS still seems to have the same problem. The files deleted were realy small. Here is what I got:

root@ClarkNAS:~# cd /var/lib/clamav
root@ClarkNAS:/var/lib/clamav# ls -lsh
total 456M
4.0K -rw-r--r-- 1 root root 48 Mar 5 20:49 antivir.ini
992K -rw-r--r-- 1 root root 990K Jan 2 22:13 bytecode.cld
4.0K drwxr-xr-x 3 root root 4.0K Mar 6 20:45 clamav-0bfde27197428f6299c8849d76b118e4.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 8 20:46 clamav-0c7352cea18351899285f8e003eef6ac.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 17 22:34 clamav-18013f2fe60a34940502a814dce46a23.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 18 06:28 clamav-3aa36e7326855db8469c6d03b1f2a695.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 9 20:47 clamav-760e8a6605633f9fc70f8b6f88341c3f.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 7 20:46 clamav-84c6330809ae8f5ac17cd9551c161e37.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 18 16:27 clamav-859eaa93f1734b1c9898e13bf4e2d4b8.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 15 22:34 clamav-92015282fe44cefcef7bee20110f9399.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 16 16:23 clamav-d6f473a00a18a86bf5d0c96ee2ce4762.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 17 12:30 clamav-f06258e6e3b3263848084b5943dca111.tmp
4.0K drwxr-xr-x 3 root root 4.0K Mar 17 02:30 clamav-f22af0ba02849df43253bb5b328e7618.tmp
162M -rw-r--r-- 1 root root 162M Mar 5 20:45 daily.cld
294M -rw-r--r-- 1 root root 294M Jun 8 2017 main.cld
4.0K -rw------- 1 root root 2.1K Mar 18 16:28 mirrors.dat

root@ClarkNAS:/var/lib/clamav# rm -r clamav-*.tmp
root@ClarkNAS:/var/lib/clamav# ls -lsh
total 456M
4.0K -rw-r--r-- 1 root root 48 Mar 5 20:49 antivir.ini
992K -rw-r--r-- 1 root root 990K Jan 2 22:13 bytecode.cld
162M -rw-r--r-- 1 root root 162M Mar 5 20:45 daily.cld
294M -rw-r--r-- 1 root root 294M Jun 8 2017 main.cld
4.0K -rw------- 1 root root 2.1K Mar 18 16:28 mirrors.dat
root@ClarkNAS:/var/lib/clamav#

Is there anything else to try?

Hopchen · ‎2019-03-25

Hi @Jonbooi

Yea, these small files that you removed aren't gotta cut it 🙂

You can remove the daily.cld and main.cld files as well. You should also turn off AV as that will be removed from the RN102 in the next firmware anyway. But this is not all that is taking space on the root volume. When those files are deleted, what does this command give you?

du -hd1 /var

Jonbooi · ‎2019-03-25

I also deleted the daily.cld and that has allowed me to reconnect to my NAS again.

I will monitor and see if that has sorted the problem.

I will also leave the antivrius deactivated from now on.

Thank you all.

Jonbooi · ‎2019-03-25

Hi Hopchen

Are my log files also a problem?

20K     /var/spool
4.8G    /var/ftp
487M    /var/lib
72M     /var/cache
8.0K    /var/www
84M     /var/backups
4.0K    /var/opt
4.0K    /var/agentx
4.0K    /var/local
44K     /var/nuuo
4.0K    /var/mail
12K     /var/readydrop
16K     /var/netatalk
9.6M    /var/readynasd
581M    /var/log
12K     /var/tmp
34M     /var/cores
6.1G    /var

Hopchen · ‎2019-03-25

Yea, you could go a bit deeper to clean out some more. Output of:

du -hd1 /var/log

StephenB · ‎2019-03-25

There are some mount points that might be getting in your way.

So start by entering

mount --bind / /mnt

That mounts sysroot as /mnt.

Then search /mnt.

When you're done with /mnt, you unmount it with

cd /
umount /mnt

The cd matters, the umount will fail if you are in a folder of /mnt.