NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.

Forum Discussion

tommyhackett's avatar
tommyhackett
Aspirant
Apr 04, 2019

System volume root usage (/dev/md0) at 100%

I have recently began getting the error message in logs “Volume: System volume root's usage is 100%. This condition should not occur under normal conditions. Contact technical support.

 

Some searching in the forums has lead me to use some basic command line tools to search for the problem.

 

Looking at disk space:

 

root@TXHReadyNAS:~# df -h

Filesystem      Size  Used Avail Use% Mounted on

udev             10M  4.0K   10M   1% /dev

/dev/md0        3.7G  3.7G     0 100% /

tmpfs          1009M  8.0K 1009M   1% /dev/shm

tmpfs          1009M  432K 1009M   1% /run

tmpfs           505M  996K  504M   1% /run/lock

tmpfs          1009M     0 1009M   0% /sys/fs/cgroup

/dev/md127      1.9T  730G  1.2T  40% /data

/dev/md127      1.9T  730G  1.2T  40% /apps

/dev/md127      1.9T  730G  1.2T  40% /home

 

It appears that the problem is /dev/md0 being at 100% usage.

 

Searching for large files:

 

root@TXHReadyNAS:~# cd //

root@TXHReadyNAS://#

root@TXHReadyNAS://# du -hsx * | sort -rh | head -10

du: cannot access 'proc/15544/task/15544/fd/3': No such file or directory

du: cannot access 'proc/15544/task/15544/fdinfo/3': No such file or directory

du: cannot access 'proc/15544/fd/3': No such file or directory

du: cannot access 'proc/15544/fdinfo/3': No such file or directory

948M apps

323M var

196M usr

30M lib

30M frontview

16M chunk-stream0-00821.m4s

16M chunk-stream0-00689.m4s

16M chunk-stream0-00601.m4s

16M chunk-stream0-00466.m4s

15M chunk-stream0-00833.m4s

 

With apps being the largest directory I searched there too:

 

root@TXHReadyNAS://# cd apps

root@TXHReadyNAS://apps# du -hsx * | sort -rh | head -10

828M plexmediaserver-annapurna

68K transmissionr6

0 DO_NOT_DELETE

 

I’m not sure that the second part was anything to be alarmed by, but I don’t have much experience with command line tools so can’t go much further on my own.

 

Logs are also warning me that my Volume data is degraded. I thought I would approach the root usage problem first but felt this might be worth mentioning.

 

I’m using

Model: ReadyNAS 202

Firmware: 6.9.5

 

I have everything backed up onto external storage so am ready to go.

 

Would really appreciate if anyone could help.

4 Replies

  • StephenB's avatar
    StephenB
    Guru - Experienced User

    tommyhackett wrote:

     

    16M chunk-stream0-00821.m4s

    16M chunk-stream0-00689.m4s

    16M chunk-stream0-00601.m4s

    16M chunk-stream0-00466.m4s

    15M chunk-stream0-00833.m4s

     


    Delete all of these chunk files.  They are remnants of plex real-time transcoding - they really shouldn't be writing them to the root, but that's something to take up with the plex folks.

     

    Are there more of these?  The four in your post don't account for all of the space use (only ~80 MB of it).

     


    tommyhackett wrote:

     

    root@TXHReadyNAS://# du -hsx * | sort -rh | head -10

    du: cannot access 'proc/15544/task/15544/fd/3': No such file or directory

    du: cannot access 'proc/15544/task/15544/fdinfo/3': No such file or directory

    du: cannot access 'proc/15544/fd/3': No such file or directory

    du: cannot access 'proc/15544/fdinfo/3': No such file or directory

    948M apps

     


    apps is actually a mount point to the data volume, so it isn't part of the problem here.  The "du" errors are also related to mount points.

     

    It's best to remount the root volume, and search that - it avoids these issues, and can uncover space usage that is hidden underneath mount points.  It's also much faster.

     

    So start by entering 

    mount --bind / /mnt

    That mounts sysroot as /mnt.

     

    Then analyze space on /mnt

     

    When done, you unmount it with

    cd /
    umount /mnt

    The cd matters, the umount will fail if you are in a folder of /mnt.

    • tommyhackett's avatar
      tommyhackett
      Aspirant

      Hi, thanks for the response. I did a little more searching just after I made the post and think I'm in a good place now.

       

      You're right, there were more of the chunk files (1461 written to the root!) and removing them appears to have solved my problem.

       

      After doing that, I think I'm ok with root looking like:

       

      root@TXHReadyNAS:~# cd /

      root@TXHReadyNAS:/# ls -1

      1

      apps

      bin

      boot

      data

      dev

      etc

      frontview

      home

      init-stream0.m4s

      init-stream1.m4s

      lib

      lost+found

      media

      mnt

      opt

      proc

      root

      run

      sbin

      selinux

      srv

      sys

      tmp

      usr

      var

       

      root@TXHReadyNAS:/# df -h

      Filesystem      Size  Used Avail Use% Mounted on

      udev             10M  4.0K   10M   1% /dev

      /dev/md0        3.7G  649M  2.9G  19% /

      tmpfs          1009M  8.0K 1009M   1% /dev/shm

      tmpfs          1009M  468K 1009M   1% /run

      tmpfs           505M 1000K  504M   1% /run/lock

      tmpfs          1009M     0 1009M   0% /sys/fs/cgroup

      /dev/md127      1.9T  729G  1.2T  40% /data

      /dev/md127      1.9T  729G  1.2T  40% /home

      /dev/md127      1.9T  729G  1.2T  40% /apps

       

      I'm really not sure what could have caused Plex to behave this way initially, perhaps I did something wrong when installing/updating it some time. Any way, I have removed and reinstalled Plex using the GUI. No signs yet that it is writing unwanted stuff to the root again, but I will have to keep an eye on it I guess.

       

       

      • StephenB's avatar
        StephenB
        Guru - Experienced User

        You should probably remove these two also, as they were also left there by plex.

        init-stream0.m4s
        init-stream1.m4s

NETGEAR Academy

Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology! 

Join Us!

ProSupport for Business

Comprehensive support plans for maximum network uptime and business peace of mind.

 

Learn More