NETGEAR is aware of a growing number of phone and online scams. To learn how to stay safe click here.
Forum Discussion
Solved
Size of files/folders vs "size on disk" MASSIVELY different?
Hi there, I'm on my NVX via a windows 8.1 machine, just going through some image folders and tidying up a little, when I realised there is a simply massive disparity between the "size" and the "size on disk" reported by the folder/file properties when browsing the share in Windows.
I really do mean massive. A folder with 144kB of data is listed as being 400MB in size, for example. More: 6MB > 1.05GB. 102MB > 7.03GB. 152MB > 74GB.
I've read somewhere that the ReadyNAS may report unusually high filesizes as this somehow speeds up SMB. Is this what's happening here? All my data seems to be intact (it is also backed up, by the way), I'm mostly wondering if this is an effect of having just expanded the array (went from 1.36TB to 2.7ish today as I swapped in a larger drive). I suppose I should add that I've never noticed this before, either, although my observational skills are not stellar so perhaps it's slipped under my radar over the last year or so :D
Oh, should also add that this is only really happening in the pictures and documents share as far as I can see right now. No hidden files are present (that I can find, anyway). Does not seem to correlate with file quantity but does seem worse where smaller files are involved (documents, pics). Big files in the movies, software folders etc are not showing the same disparity.
Hoping this is normal!! :)
I really do mean massive. A folder with 144kB of data is listed as being 400MB in size, for example. More: 6MB > 1.05GB. 102MB > 7.03GB. 152MB > 74GB.
I've read somewhere that the ReadyNAS may report unusually high filesizes as this somehow speeds up SMB. Is this what's happening here? All my data seems to be intact (it is also backed up, by the way), I'm mostly wondering if this is an effect of having just expanded the array (went from 1.36TB to 2.7ish today as I swapped in a larger drive). I suppose I should add that I've never noticed this before, either, although my observational skills are not stellar so perhaps it's slipped under my radar over the last year or so :D
Oh, should also add that this is only really happening in the pictures and documents share as far as I can see right now. No hidden files are present (that I can find, anyway). Does not seem to correlate with file quantity but does seem worse where smaller files are involved (documents, pics). Big files in the movies, software folders etc are not showing the same disparity.
Hoping this is normal!! :)
- I ran again the volume consistency check manually and it found volume scan was needed, so rebooted with the vol scan, it reported fixed problems...re-ran the scrub - that finished good in approx 7hrs. Problem still there on file count....so I installed TreeSize Pro - to find out in the 100+ folders - which one tripped the size, and low & behold - found the single file showing 16TB in size (yes, impossible on a NAS with only 2.6TB). It was a quickbooks file. Zero clue how, but I opened the file, backed it up, resaved and now the file size reports normal at 58mb. Whew!!! TG for treesize pro finding exactly what file. The wonders of why or how this can happen, but guess any corrupt file can produce strange results.
I am sure CP now will be happy I am not trying to push 17.1TB of data ...thru our unlimited data plan. :)
23 Replies
Replies have been turned off for this discussion
- This sounds very different from the windows 8 problem - which is specific to SMB. I am running Crashplan with 4.2.26, and am not seeing any symptoms like this.
It sounds to me like something weird has happened with your file system. Maybe you should poke around with SSH? - I noticed it by adding crashplan, and even if I used the windows explorer - same thing. Not sure what to even look for thru SSH (which I have turned on) to know what is bad/good. Hate to do a full rebuild if it can be avoided. Any pointers what I should be looking for? I am not any type of linux pro, but have gone thru enough to get info out of it.
- start with
cd /c/
df -h .
and tell us what it says. - Filesystem Size Used Avail Use% Mounted on
/dev/md0 4.0G 1.6G 2.3G 42% /
tmpfs 16K 0 16K 0% /USB
/dev/c/c 2.7T 630G 2.0T 24% /c
/dev/c/c_2014_02_25_03_00
2.7T 630G 2.0T 24% /c_2014_02_25_03_00
/dev/sdf1 280G 280G 0 100% /USB/USB_HDD_1
ma-storage:/c# - Thanks. So ssh confirms that you are only using 630 GB.
Are you running crashplan on the Windows Server, or did you install it on the NAS? - CP is loaded on the NAS. However, it was only when I loaded it that I saw it misrepresent the size. Even if I use the windows file explorer to the readynas, it shows the same bogus behaviour when you right click/properties on the share.
- You are set up for only one share? Or only one share shows the problem?
I can't think of any straightforward mechanism for CP to corrupt the file system in this way.
Perhaps there are links in the share that are creating the discrepancy? You can try navigating to the share, and then entering
du . -sh
That should align with the df command you entered before.
Then try
du . -shD
and see if you get a different answer.
From practical point of view, the simplest approach might be to save the share to a PC or USB drive, delete it, and re-create it. Perhaps then run the maintenance programs (scrub and volume checks). - I have multiple shares, just this one is the largest. I navigated to the share, did the du -sh, it shows 167G, I did the same at the root and it matches from the df - which is 630G.
I did the du -shD at the root folder - and the response was: 630G
Doing the same at the share - and the response was: 167G
Is it possible the readynas does not handle this many files/folders? I would be surprised, but something it tripping this up. I have the room, I may copy all the files from this share, to a new share - then try a directory size check....I am also going to try to get a directory size from a windows 7 PC - maybe 2003 server does not like it.
Note to add - I did a directory check for size on the snap folder - it does the same thing from my 2003 server - shows bogus 15TB total size.
I went to a win7 pc, highlighted all the folders in the share to get properties - same issue, after it gets to about 100gb, and around 770,000 files, it jumps rapidly to 105gb, 110gb, 130gb then 15.1TB in a matter of seconds after letting it count for about 10 minutes. - It is weird that CP is getting a different size from du and df, since CP is accessing the ext file system, and not using SAMBA.
I am thinking this is perhaps an issue in a specific share - whichever one that Win7 was scanning when it suddenly jumped. Can you remove that one share from the highlight, and see if that is the case?
Did you try opening a support ticket? - This is only the one share of a half dozen I have the issue with, and with the -snap folder of this share also having the same issue - is it possible a folder inside the share can do this? If so, that will be next to impossible to figure out. :)
If CP does not use Samba to get its directory info, then this does seem to be beyond a windows thing (as evidenced I get the same result from Win7 as I so 2003 server file explorer).
I ran the online consistency check - that came up clean. Although I ran the disk scrub with auto parity fix , after about 3hrs - it bombed at 64%. In checking SMART, 3 of the 5 drives show 2 reallocated sectors...not horrible - but wonder if that may be it.
NETGEAR Academy
Boost your skills with the Netgear Academy - Get trained, certified and stay ahead with the latest Netgear technology!
Join Us!
