I have SSH'd into my 316 and am doing cp and mv's... trying to move a bunch of data from one share to another (/data/share1 to /data/share2).It's slow. Like, really slow (maybe 90 seconds per GB). Is this a limitation with SMB, BTFRS, Linux, or ReadyNAS? Is this to b expected or are there ways to speed it up?Thanks,John

https://www.readynas.com/forum/viewtopi ... 35#p422574

This is really awesome - you saved me so much time it's not even funny!Thanks!

For posterity, the post from that thread reads:Skywalker wrote:StephenB wrote:Xophile wrote:Isn't it possible to move data between shares directly with BTRFS?Each share is set up as a btrfs subvolume. That allows you to control snapshots on a share-by-share basis.A direct consequence is that moving files from one share to another is done as a copy/delete - the same as moving files between two disks on a PC.Well, not exactly. You can "instantly" copy files around between subvolumes using cp --reflink, and then remove the original. So, to move a file from the Backup share to the Documents share, you could do:# cp -a --reflink /data/Backup/file /data/Documents/# rm /data/Backup/fileSeriously? Really?!So which folder should I put my downloads into? Transmission downloads to the /data/Downloads/ share on my system.Now I have to move all files using an SSH terminal? All because I am using the /data/Videos /data/Music /data/Pictures shares that were there out of the box...?On the NV+, I could of course map to /c/ and use this to move between shares. I had assumed this was the case with the 104 - simply map to /data/How can it be acceptable that ordinary move operations are not possible on this device? What is being done to address this? Aside from forcing users to use a single share? The fact that BTRFS has this limitation is irrelevant - I need to be able to move large files without coping them...!

rotordave wrote:How can it be acceptable that ordinary move operations are not possible on this device? What is being done to address this? Aside from forcing users to use a single share? The fact that BTRFS has this limitation is irrelevant - I need to be able to move large files without coping them...!You apparently missed a post further down: Skywalker wrote:...future firmware releases will support this sort of operation via SMB2's FSCTL_SRV_COPYCHUNK command, which is for server-side copies. But I don't know which SMB clients use that command, other than Windows Server 2012.It seems to me that the web ui could also use the --reflink option.The bottom line is that it works this way for now. Netgear might be able to put in limited support for --reflink in various spots. But this is a tradeoff - the snapshots are also a feature that many users want. The ability to turn snapshots on/off on a share-by-share basis is also needed, and supporting that means that moves between shares (subvolumes) are treated as copy/delete by the file system. Some users will prefer the snapshot control, others don't care about snapshots, and would rather have the direct move. I imagine there could also be a setting when you create the share that doesn't set it up as a subvolume - permanently disabling snapshots. There'd be no way to undo that without deleting the share. You could attempt to do this manually in ssh. Rename "Downloads" temporarily in SSH, and create a Downloads folder manually with the normal permissions. There might be some side effects, but if it works you'd end up with a downloads folder that is not a subvolume.

StephenB wrote:You apparently missed a post further down: Skywalker wrote:...future firmware releases will support this sort of operation via SMB2's FSCTL_SRV_COPYCHUNK command, which is for server-side copies. But I don't know which SMB clients use that command, other than Windows Server 2012.It seems to me that the web ui could also use the --reflink option.The bottom line is that it works this way for now. Netgear might be able to put in limited support for --reflink in various spots. But this is a tradeoff - the snapshots are also a feature that many users want. The ability to turn snapshots on/off on a share-by-share basis is also needed, and supporting that means that moves between shares (subvolumes) are treated as copy/delete by the file system. Some users will prefer the snapshot control, others don't care about snapshots, and would rather have the direct move. I agree that it would be a lot simpler for Netgear to include support for the --reflink option in the GUI, particularly as they can refuse support if SSH access is enabled. As the prime purpose of a NAS is file storage and management I think this is a fairly basic request. I move files between different folders and shares on a pretty regular basis on my main machine and also a WHS server, I'd like to be able to do the same efficiently and immediately on the ReadyNAS. I don't yet fully understand all the implications of the snapshot capability but I believe I read another thread in which a user found that his disk usage seemed too high after moving some files. It turned out that the reason was snapshot storage left over in the folder from which the files had been moved. Deleting those snapshots solved the excess usage issue.If Netgear were to implement the "--reflink" method in the GUI for a move command and add an option to choose to either move or delete the related snapshots that would seem to solve both the above requirements you mention? As I understand it after a "--reflink" move the files would still be stored in the same physical location/blocks so the snapshots would still be relevant, just referenced from a different share?Or am I missing a complication which makes that not possible?

Copy/move between shares is sloooooooooooow...

42 Replies

Replies have been turned off for this discussion

Roxy1
Apprentice
Oct 04, 2014
Firmware is 5.3.10

Not doing too well so far.
At first I got :

Then I reset everything and this time I got System Error 53, network path not found.
StephenB
Guru - Experienced User
Oct 04, 2014
Net use */delete should have taken care of the "multiple connection" error. Clearly there was something maintaining another connection that was using different credentials - possibly you left a windows explorer pane open to the NAS?

Try again using the NAS IP address instead of its name.
Roxy1
Apprentice
Oct 04, 2014
I've tried it with the IP address and the message is :

After the initial response of password being invalid, it then pops up the line about entering password which I do, and it spits back the Error 5.
StephenB
Guru - Experienced User
Oct 04, 2014
Did you enter the NAS admin password when prompted? You can put it into the command line btw
net use Z: \\192.168.1.88\c /user:admin password

Also, are you logged into Windows as "admin"? Or are you using a different user name?
Roxy1
Apprentice
Oct 04, 2014
Hey, yes I did enter the password and I get the same System error 5, Access is denied.

Very strange as I can easily logon to the NAS box via my web browser or Windows Explorer. Additionally I can map a drive in Explorer as well.

Windows login is admin, only user on here.
StephenB
Guru - Experienced User
Oct 04, 2014
Ok.

The first password error is because you are using the admin account in Windows. Windows by default will present your log-on credentials to the NAS. It should have taken the second password entry though. I don't have any v2 platforms, so I can't duplicate your setup.

You could try changing your windows password temporarily to match the NAS admin password, and reboot the PC - that might change the behavior.

Another thing you could try is changing the NAS admin password, and then changing it back.
Roxy1
Apprentice
Oct 04, 2014
Changing the NAS password did work and it mounted the root drive

I went ahead and did a test by moving some files between folders while in that same single explorer pane of the mounted volume, and the behavior was the same.
Now what should I do?

Not sure if this is relevant however in the NAS options I can have it as 'Local Users' or 'Active Directory.' I'm currently using the former.
StephenB
Guru - Experienced User
Oct 04, 2014
If you are opening the "C" volume, and are moving files within it, Windows should be doing a "real" move not a copy/delete. Even if you open two windows using that volume, moves between those two windows should be a real move. Certainly that is what happens on my Windows 7 system with the OS4 NAS I have (pro, NV+ v1, duo v1).

OS6 also works that way, but moving between shares is slower there due to the way btrfs is set up. But your NAS doesn't use btrfs, it uses ext.

Local users is what I also use, that really isn't relevant to this behavior.

So I guess I'm not sure what you should try next.
Roxy1
Apprentice
Oct 04, 2014
Oh, so it's not btrfs!

Hmm.,.

I went over your kind posts here as well viewtopic.php?f=21&t=67194 though didn't glean anything extra.

Also, I remember reading that if you use the NAS' web GUI to move files, it's instantaneous. Though I don't have the option to move files or folders. All I get is new, remove or refresh (folder); open, download or refresh(file).
Once I had the NAS up and running initially, I quickly noticed the lack of folder options and figured there'd be a third party application that extended the feature however I have yet to find one.
Roxy1
Apprentice
Oct 04, 2014
In the GUI, I have the option to enable the folders as SMB, AFP, NFS, FTP, RSYNC and HTTP. Currently it's just SMB ticked.

I've done a reboot of the host computer and the NAS box. I setup a fresh network pathing to \c and tried to copy/paste data from one share folder to another. Nearly always it tries to send the data over the network (I guess this is the part where it copies to the host computer temporarily and then writes it to the NAS drives). However every once in a while an intra-share copy/paste is instant.

I also noticed that some folder cannot be edited(copied to, copied from) now that I've changed the password to the NAS box. Which is strange since I can still view them.
I don't have any special permission setup. Trying to edit security options in Windows gives access denied.

Forum Discussion

Copy/move between shares is sloooooooooooow...

42 Replies

Related Content

ReadyNAS NV+ 4.1.16 - Unable to copy, move, delete, or rename files or folders

Initiate a local copy or move on the server, then disconnect while the task runs to completion

Cannot Move/Copy folders

File Move/Copy Leads to Lockup

Backup (move/copy) share + snapshots to new ReadyNAS?

NETGEAR Academy

ProSupport for Business