NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
LogicX
Feb 16, 2014Aspirant
btrfs locking at 74% on 6.1.6
I'm running 6.1.6 final - I STARTED with a fresh install and rebuild on a 6.1.6RC
I had all my data offloaded; I started copying it back.
I've since updated to 6.1.6 final.
I am now copying it back.
As I got into the 70% range, I started to have performance problems.
I would see some btrfs processes spiking CPU; and top reports most CPU usage going to 'wait' times.
Load increases to 30+ and the system becomes unresponsive. Data copies to the system crawl to a halt.
I stop transfers and the system eventually recovers (sometimes I have to reboot it).
So long as I don't add more data; it works great -- but all efforts to add additional data seems to create problems.
I'm quite sure my btrfs block size should be the new; larger size -- but is there a command I can run to confirm?
If I'm running the larger block size; it would appear there's still a major problem here!
Open to suggestions of what to do!
I'd really like to use the last 3TB of my NAS!
/dev/md127 11T 8.1T 2.9T 74% /data
I had all my data offloaded; I started copying it back.
I've since updated to 6.1.6 final.
I am now copying it back.
As I got into the 70% range, I started to have performance problems.
I would see some btrfs processes spiking CPU; and top reports most CPU usage going to 'wait' times.
Load increases to 30+ and the system becomes unresponsive. Data copies to the system crawl to a halt.
I stop transfers and the system eventually recovers (sometimes I have to reboot it).
So long as I don't add more data; it works great -- but all efforts to add additional data seems to create problems.
I'm quite sure my btrfs block size should be the new; larger size -- but is there a command I can run to confirm?
If I'm running the larger block size; it would appear there's still a major problem here!
Open to suggestions of what to do!
I'd really like to use the last 3TB of my NAS!
/dev/md127 11T 8.1T 2.9T 74% /data
17 Replies
Replies have been turned off for this discussion
- mdgm-ntgrNETGEAR Employee RetiredDownload the logs.
In btrfs.log what do you see for the nodesize and the leafsize for /dev/md127 ?
Can you post the contents of your initrd.log ? - LogicXAspirantnodesize 16384
leafsize 16384
Full content of initird.log is 3 lines:
[2014/02/02 22:37:04] Factory default initiated by Frontview!
[2014/02/02 22:37:35] Defaulting to X-RAID2 mode, RAID level 5
[2014/02/02 22:37:58] Factory default initiated on ReadyNASOS 6.1.6. - PigletLuminaryInteresting. I did a factory reset on my 104 with 6.1.6 the other day and my nodesize and leafsize are both 32768 ...
- vandermerweMasterLogicX
Are you running 6.1.6 on an Ultra (this is in your profile) ? - LogicXAspirantTrue. Don't hate me for running 6.1.6 on a RNDU6000 :oops:
vandermerwe wrote: LogicX
Are you running 6.1.6 on an Ultra (this is in your profile) ? - mdgm-ntgrNETGEAR Employee RetiredAre you sure that's the leafsize for /dev/md127 not /dev/md0. Can you PM the full contents of btrfs.log
In the logs what does os_version.log contain?
From your initrd.log it looks like you are still running a RC?
What services are you using? Are you using iSCSI?
Do you have any apps installed? - LogicXAspirantMy apologies! Yes, I quoted /dev/md0 by mistake.
/dev/md127 says:
nodesize 32768
leafsize 32768
os_version.log: ReadyNASOS!!version=6.1.6,time=1390873255,arch=x86_64
I'm quite sure I upgraded to 6.1.6 final... but open to trying again if that does not appear to be the case.
no iSCSI
I have plex app installed
I use SMB, FTP, AFP, DLNA
I've managed to get to 80% usage; but my CPU usage spiked so high and never returned for hours -- I couldn't execute any commands and had to hard restart.
/dev/md127 11T 8.7T 2.3T 80% /datamdgm wrote: Are you sure that's the leafsize for /dev/md127 not /dev/md0. Can you PM the full contents of btrfs.log
In the logs what does os_version.log contain?
From your initrd.log it looks like you are still running a RC?
What services are you using? Are you using iSCSI?
Do you have any apps installed? - mdgm-ntgrNETGEAR Employee RetiredYou are running RC13.
If you were running the final release os_version.log would look like this:
ReadyNASOS!!version=6.1.6,time=1391111179,arch=x86_64
When you run top do any of your services in particular (other than btrfs ones) stand out as using lots of CPU? - LogicXAspirantI can upgrade to final (but I'll wait to hear from you that I should since we're in the middle of troubleshooting)
Plex is often running and scanning -- but nothing too crazy.
I was just able to get it to almost lock up with a huge load due to lftp mirroring a directory to the server --
transfer started at 60MB/sec -- after a few seconds it slowed to kbs (halted, really) -- and I was SSH'd in -- wouldn't even execute my 'w' command to see the load. :/
After about 10 minutes the load finally dropped below 20 and it executed
I ran top to see a process md127_raid5 using a lot of CPU
Repeating the transfer with top running shows the following competing for CPU:
proftpd
md127_raid5
flush-btrfs-2
kswapd0
Load is holding around 5
Transfer going 30-35MB/sec
And now after a few minutes it locked up again.
Here's what top looks like: https://www.dropbox.com/s/08bus9zeiss1lds/Screenshot%202014-02-17%2001.30.32.png
Note the 99.5% wait
Then it finally refreshed 1 time a few minutes later:
https://www.dropbox.com/s/30r4ubjlxp9abzf/Screenshot%202014-02-17%2001.32.14.png
Many more minutes later as it finally recovered, it looked like:
https://www.dropbox.com/s/k9u5xsgy65rr637/Screenshot%202014-02-17%2001.35.14.png
(note the drastically reduced wait time, sky-high load which is dropping) - mdgm-ntgrNETGEAR Employee RetiredI would suggest updating to the final release. Shouldn't be many changes but better to troubleshoot on that than an old beta.
Related Content
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!