Post your performance results

Hello all, I'd like some help/comments about my configuration, since I'm not seeing great performance.

I started a thread for comments in a separate thread, however I can't post the link due to forum policy for new users. The subject for the thread is: <b>Subpar Read Performance in 3 X 500MB Configuration</b>.


Test Rig:
IO Meter 2006
Xeon 5140 @ 2.33Ghz
4.00 GB Ram.
WD Raptor Drive

ReadNAS NV+ setup:
[X-RAID]
RAIDiator 4.00c1-p2 [1.00a037]
RAM: 1024 MB [2.5-3-3-7] (Patriot PC2700)
Volume C: Online, X-RAID (Expandable RAID), 3 disks, 0% of 907GB used

Raid Disks:
1. Seagate ST3500630NS [465 GB] (came with the unit)
2. Seagate ST3500630NS [465 GB] (came with the unit)
3. Seagate ST3500320NS [465 GB] (added on)

Full Data Journaling is disabled.


Using the IOmeter tests specified at the beginning of the thread I get the following:

Over 100Mbit Ether:

Read from NAS Server: 6.1 MB/sec
Write to NAS Server: 8.2 MB/sec

Compared to our Current Samba share:

Read from old server: 10.3 MB/Sec
Write to old server: 11.0 MB/Sec

If I do a direct connect between my machine and the NAS I can pull 1000Mbit (Jumbo frames off) with the following results...

Read from NAS Server: 12.7 MB/sec
Write to NAS Server: 16.9 MB/sec


So I'm fairly disappointed with the result, especially my read values off the NAS under 100Mbit. (The NAS will be put into production on a 100Mbit ether, so I'm not concerned with the GigEth performance).

I also ran the performance tests with journaling disabled, with similar results.

The Drive I added (the 320NS) has the SN04 firmware, which has caused others problems with syncing. I don't see anything in the logs that suggest problems.

Should I return the 320NS and get the 630NS? Will I see any IO improvement by adding a 4th drive to the array?

Thanks!

SM

Here is the setup:

Intel 1000 Pro GT NIC
Apple airport extreme N Gigabit
Readynas NV+ , 1 GB RAM, 4x seagate 1TB ES.2 in X-Raid

PC is 1.7 GHz P4 with 512 MB ram

Readynas is about 20% full.

When I run iometer with 2048000 sectors and 256kb read/write blocks, I get ~ 23 MB / sec reads and 11 MB/sec writes. Writes seem particularly slow. I have journaling on, full journaliing off, fast CIFS enabled.

Looking in the logs i find it strange how the drives are partitioned:

Jan 29 22:48:40 nas kernel: hdc: hdc1 hdc2 hdc3 <hdc5>
!!!!Jan 29 22:48:40 nas kernel: hde: unknown partition table
Jan 29 22:48:40 nas kernel: hdg: hdg1 hdg2 hdg3 <hdg5>
Jan 29 22:48:40 nas kernel: hdi: hdi1 hdi2 hdi3 <hdi5>

PV /dev/hdc5 VG c lvm2 [682.62 GB / 0 free]
PV /dev/hdc6 VG c lvm2 [246.62 GB / 0 free]
PV /dev/hdg5 VG c lvm2 [929.28 GB / 0 free]
PV /dev/hdi5 VG c lvm2 [929.28 GB / 83.66 GB free]

Any ideas on how to speed up the NAS?

I am seeing terrible performance from mine - 6.74mbps read and 9.42 write using the downloaded iometer file. Specs are:

System: IBM X series Xeon 3.0 server, 3gb ram, 15k scsi mirror, broadcom gigabit

LAN: Netgear GS724T gigabit, jumbo frames on

Readynas: Gigabit, jumbo frames on, disk cache on, journaling off, fast cifs writes off (multi user data on the NAS), using presupplied Seagate ST3250620AS x 4 in RAID-5.

Little or no tcp retransmits, disks showing no errors :(

Ok, here are my greatly improved results after upgrading to the V4p2 firmware and doing a factory reset (all data gone). I don't have IOMeter, but I did run SiSoft Sandra, which I believe to be generally accurate.

Detailed Benchmark Results
Buffered Read : 44.64MB/s
Sequential Read : 37.67MB/s
Random Read : 27.69MB/s
Buffered Write : 47.00MB/s
Sequential Write : 35.79MB/s
Random Write : 36.94MB/s
Random Access Time : 10ms

This is a ReadyNAS NV with 256 MB and 4x 750 GB Seagate drives with X-RAID. Network is a Netgear GS105. Computer for benchmarking is a Dell Poweredge 400SC server with 2.4 GHz processor, Intel 1000 MT Lan.

Jumbo frames are on.

So, now I'll just see how that transfer rate holds up while reloading all of my stuff from the PC to the ReadyNAS.

Update: After 8.5 hours of real world data transfer from my temporary storage back to the ReadyNAS, the average write speed is 25 MB/s.

Overall, still pretty good. Better than I was seeing before....

From my MAC I can upload about 500MB / minute which is about 8.3 MB/s. My Infrant is X-RAID 2 disks, fast CIF writes version 4 firmware. This is kind of what I expect from my experience at work. My understanding is that X-RAID is kind of like LVM disk spanning with a parity disk so you won't get a huge boost from multiple disks either.

Here at work our fast servers have 30 or more disks in RAID 5 sets and they only just manage to fill a gig pipe. Memory caching can ruin your performance tests if you don't transfer a lot more than your RAM can cache.

petery wrote:

From my MAC I can upload about 500MB / minute which is about 8.3 MB/s. My Infrant is X-RAID 2 disks, fast CIF writes version 4 firmware. This is kind of what I expect from my experience at work. My understanding is that X-RAID is kind of like LVM disk spanning with a parity disk so you won't get a huge boost from multiple disks either. Here at work our fast servers have 30 or more disks in RAID 5 sets and they only just manage to fill a gig pipe. Memory caching can ruin your performance tests if you don't transfer a lot more than your RAM can cache.

I can upload for hours at 25 MB/s to my ReadyNAS.

At work we have a 14 disk RAID 50 that pushes around 700 MB/s locally, but is limited over the network to about 70 MB/s since we don't have Jumbo frames on our work LAN.

I would check your setup for Jumbo frames and the other performance settings. You should be able to reach higher 8 MB/s.

phrozen wrote:
I can upload for hours at 25 MB/s to my ReadyNAS. At work we have a 14 disk RAID 50 that pushes around 700 MB/s locally, but is limited over the network to about 70 MB/s since we don't have Jumbo frames on our work LAN. I would check your setup for Jumbo frames and the other performance settings. You should be able to reach higher 8 MB/s.

What RAID settings are you using on your ReadyNAS?

See below.

Jumbo frames on, 9000 MTU set on the Desktop.

Optimize for OS X: Off (I'm a windows only shop)
Enable Fast USB Writes: On (probably no effect)
Disable full data journaling: Yes
Disable journaling: yes
Enable fast CIFS writes: Yes

phrozen wrote:

Ok, here are my greatly improved results after upgrading to the V4p2 firmware and doing a factory reset (all data gone). I don't have IOMeter, but I did run SiSoft Sandra, which I believe to be generally accurate. Detailed Benchmark Results Buffered Read : 44.64MB/s Sequential Read : 37.67MB/s Random Read : 27.69MB/s Buffered Write : 47.00MB/s Sequential Write : 35.79MB/s Random Write : 36.94MB/s Random Access Time : 10ms This is a ReadyNAS NV with 256 MB and 4x 750 GB Seagate drives with X-RAID. Network is a Netgear GS105. Computer for benchmarking is a Dell Poweredge 400SC server with 2.4 GHz processor, Intel 1000 MT Lan. Jumbo frames are on. So, now I'll just see how that transfer rate holds up while reloading all of my stuff from the PC to the ReadyNAS. Update: After 8.5 hours of real world data transfer from my temporary storage back to the ReadyNAS, the average write speed is 25 MB/s. Overall, still pretty good. Better than I was seeing before....

My Infrant is running version=4.00c1-p2 and in X-RAID mode with 2 500GB Disks. I just purchased it a week ago and it came with the current version of firmware installed.

ReadyNAS NV+
Connected 1000 Mbit / Full-Duplex (Auto Negotiation)
MTU: 1500
Jumbo Frames: Not Enabled
Disabled full data journaling.
Enabled journaling.
Optimize for OS X enabled (Might change that...)
Enable fast CIFS writes.
Disabled fast USB disk writes.

Network setup: (Cat 6 cables)

ReadyNAS NV+ connected to GS608 Gigabit Switch (Version 2).
Dell Win XP 2.4GHz with Gigabit Ethernet connected to Netgear GS608 (PC's Jumbo Frames: Not Enabled).
GS608 connected to Linksys WRT54G.
WRT54G connected to Motorola Cable Modem.

The WRT54G router is 10/100 and lights up Amber in the GS608. All my IP addresses are fixed. I have the WINS server on the ReadyNAS NV+ enabled as well as DHCP.

Speed Test Results:
ReadyNAS NV+ HDVideo_1Play Throughput(MB/s) 10.53
ReadyNAS NV+ HDVideo_2Play Throughput(MB/s) 10.735
ReadyNAS NV+ HDVideo_3Play Throughput(MB/s) 11.142
ReadyNAS NV+ HDVideo_4Play Throughput(MB/s) 11.187
ReadyNAS NV+ HDVideo_1Record Throughput(MB/s) 15.363
ReadyNAS NV+ HDVideo_1Play_1Record Throughput(MB/s) 11.635
ReadyNAS NV+ HDVideo_2Play_2Record Throughput(MB/s) 11.961
ReadyNAS NV+ HDPlayWithOffice Throughput(MB/s) 8.899
ReadyNAS NV+ HDPlayWithBackup Throughput(MB/s) 10.078
ReadyNAS NV+ ContentCreation Throughput(MB/s) 4.556
ReadyNAS NV+ OfficeProductivity Throughput(MB/s) 2.155
ReadyNAS NV+ DataBackup Throughput(MB/s) 12.09
ReadyNAS NV+ DataRestore Throughput(MB/s) 10.949
ReadyNAS NV+ FileCopyToNAS Throughput(MB/s) 14.852
ReadyNAS NV+ FileCopyFromNAS Throughput(MB/s) 10.158
ReadyNAS NV+ DirectoryCopyToNAS Throughput(MB/s) 1.255
ReadyNAS NV+ DirectoryCopyFromNAS Throughput(MB/s) 7.474
ReadyNAS NV+ PhotoAlbum Throughput(MB/s) 3.239
ReadyNAS NV+ HDVideo_1Play ReadSize(B) 261259
ReadyNAS NV+ HDVideo_1Play WriteSize(B) 0
ReadyNAS NV+ HDVideo_2Play ReadSize(B) 261239
ReadyNAS NV+ HDVideo_2Play WriteSize(B) 0
ReadyNAS NV+ HDVideo_3Play ReadSize(B) 260685
ReadyNAS NV+ HDVideo_3Play WriteSize(B) 0
ReadyNAS NV+ HDVideo_4Play ReadSize(B) 260298
ReadyNAS NV+ HDVideo_4Play WriteSize(B) 0
ReadyNAS NV+ HDVideo_1Record ReadSize(B) 0
ReadyNAS NV+ HDVideo_1Record WriteSize(B) 262144
ReadyNAS NV+ HDVideo_1Play_1Record ReadSize(B) 261180
ReadyNAS NV+ HDVideo_1Play_1Record WriteSize(B) 262144
ReadyNAS NV+ HDVideo_2Play_2Record ReadSize(B) 260524
ReadyNAS NV+ HDVideo_2Play_2Record WriteSize(B) 262144
ReadyNAS NV+ HDPlayWithOffice ReadSize(B) 58465
ReadyNAS NV+ HDPlayWithOffice WriteSize(B) 4166
ReadyNAS NV+ HDPlayWithBackup ReadSize(B) 254540
ReadyNAS NV+ HDPlayWithBackup WriteSize(B) 32767
ReadyNAS NV+ ContentCreation ReadSize(B) 1307
ReadyNAS NV+ ContentCreation WriteSize(B) 12303
ReadyNAS NV+ OfficeProductivity ReadSize(B) 2231
ReadyNAS NV+ OfficeProductivity WriteSize(B) 1822
ReadyNAS NV+ DataBackup ReadSize(B) 1024
ReadyNAS NV+ DataBackup WriteSize(B) 32766
ReadyNAS NV+ DataRestore ReadSize(B) 1045242
ReadyNAS NV+ DataRestore WriteSize(B) 0
ReadyNAS NV+ FileCopyToNAS ReadSize(B) 0
ReadyNAS NV+ FileCopyToNAS WriteSize(B) 65536
ReadyNAS NV+ FileCopyFromNAS ReadSize(B) 65534
ReadyNAS NV+ FileCopyFromNAS WriteSize(B) 0
ReadyNAS NV+ DirectoryCopyToNAS ReadSize(B) 70
ReadyNAS NV+ DirectoryCopyToNAS WriteSize(B) 41417
ReadyNAS NV+ DirectoryCopyFromNAS ReadSize(B) 65536
ReadyNAS NV+ DirectoryCopyFromNAS WriteSize(B) 0
ReadyNAS NV+ PhotoAlbum ReadSize(B) 2937
ReadyNAS NV+ PhotoAlbum WriteSize(B) 203
ReadyNAS NV+ HDVideo_1Play AveReadTime(usecs) 24790
ReadyNAS NV+ HDVideo_1Play AveWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_1Play AveOpenTime(usecs) 86215
ReadyNAS NV+ HDVideo_2Play AveReadTime(usecs) 24309
ReadyNAS NV+ HDVideo_2Play AveWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_2Play AveOpenTime(usecs) 106263
ReadyNAS NV+ HDVideo_3Play AveReadTime(usecs) 23379
ReadyNAS NV+ HDVideo_3Play AveWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_3Play AveOpenTime(usecs) 25944
ReadyNAS NV+ HDVideo_4Play AveReadTime(usecs) 23227
ReadyNAS NV+ HDVideo_4Play AveWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_4Play AveOpenTime(usecs) 101155
ReadyNAS NV+ HDVideo_1Record AveReadTime(usecs) 0
ReadyNAS NV+ HDVideo_1Record AveWriteTime(usecs) 17040
ReadyNAS NV+ HDVideo_1Record AveOpenTime(usecs) 109855
ReadyNAS NV+ HDVideo_1Play_1Record AveReadTime(usecs) 29052
ReadyNAS NV+ HDVideo_1Play_1Record AveWriteTime(usecs) 14391
ReadyNAS NV+ HDVideo_1Play_1Record AveOpenTime(usecs) 99059
ReadyNAS NV+ HDVideo_2Play_2Record AveReadTime(usecs) 28004
ReadyNAS NV+ HDVideo_2Play_2Record AveWriteTime(usecs) 14271
ReadyNAS NV+ HDVideo_2Play_2Record AveOpenTime(usecs) 73413
ReadyNAS NV+ HDPlayWithOffice AveReadTime(usecs) 5986
ReadyNAS NV+ HDPlayWithOffice AveWriteTime(usecs) 1002
ReadyNAS NV+ HDPlayWithOffice AveOpenTime(usecs) 20570
ReadyNAS NV+ HDPlayWithBackup AveReadTime(usecs) 25710
ReadyNAS NV+ HDPlayWithBackup AveWriteTime(usecs) 3238
ReadyNAS NV+ HDPlayWithBackup AveOpenTime(usecs) 111959
ReadyNAS NV+ ContentCreation AveReadTime(usecs) 788
ReadyNAS NV+ ContentCreation AveWriteTime(usecs) 1809
ReadyNAS NV+ ContentCreation AveOpenTime(usecs) 47841
ReadyNAS NV+ OfficeProductivity AveReadTime(usecs) 815
ReadyNAS NV+ OfficeProductivity AveWriteTime(usecs) 874
ReadyNAS NV+ OfficeProductivity AveOpenTime(usecs) 56383
ReadyNAS NV+ DataBackup AveReadTime(usecs) 9472
ReadyNAS NV+ DataBackup AveWriteTime(usecs) 2704
ReadyNAS NV+ DataBackup AveOpenTime(usecs) 102045
ReadyNAS NV+ DataRestore AveReadTime(usecs) 95444
ReadyNAS NV+ DataRestore AveWriteTime(usecs) 0
ReadyNAS NV+ DataRestore AveOpenTime(usecs) 38767
ReadyNAS NV+ FileCopyToNAS AveReadTime(usecs) 0
ReadyNAS NV+ FileCopyToNAS AveWriteTime(usecs) 4404
ReadyNAS NV+ FileCopyToNAS AveOpenTime(usecs) 115286
ReadyNAS NV+ FileCopyFromNAS AveReadTime(usecs) 6445
ReadyNAS NV+ FileCopyFromNAS AveWriteTime(usecs) 0
ReadyNAS NV+ FileCopyFromNAS AveOpenTime(usecs) 36961
ReadyNAS NV+ DirectoryCopyToNAS AveReadTime(usecs) 951
ReadyNAS NV+ DirectoryCopyToNAS AveWriteTime(usecs) 4665
ReadyNAS NV+ DirectoryCopyToNAS AveOpenTime(usecs) 30503
ReadyNAS NV+ DirectoryCopyFromNAS AveReadTime(usecs) 6287
ReadyNAS NV+ DirectoryCopyFromNAS AveWriteTime(usecs) 0
ReadyNAS NV+ DirectoryCopyFromNAS AveOpenTime(usecs) 59523
ReadyNAS NV+ PhotoAlbum AveReadTime(usecs) 861
ReadyNAS NV+ PhotoAlbum AveWriteTime(usecs) 1504
ReadyNAS NV+ PhotoAlbum AveOpenTime(usecs) 49465
ReadyNAS NV+ HDVideo_1Play MaxReadTime(usecs) 420844
ReadyNAS NV+ HDVideo_1Play MaxWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_1Play MaxOpenTime(usecs) 86215
ReadyNAS NV+ HDVideo_2Play MaxReadTime(usecs) 214537
ReadyNAS NV+ HDVideo_2Play MaxWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_2Play MaxOpenTime(usecs) 136779
ReadyNAS NV+ HDVideo_3Play MaxReadTime(usecs) 193359
ReadyNAS NV+ HDVideo_3Play MaxWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_3Play MaxOpenTime(usecs) 68849
ReadyNAS NV+ HDVideo_4Play MaxReadTime(usecs) 210626
ReadyNAS NV+ HDVideo_4Play MaxWriteTime(usecs) 0
ReadyNAS NV+ HDVideo_4Play MaxOpenTime(usecs) 174110
ReadyNAS NV+ HDVideo_1Record MaxReadTime(usecs) 0
ReadyNAS NV+ HDVideo_1Record MaxWriteTime(usecs) 54710
ReadyNAS NV+ HDVideo_1Record MaxOpenTime(usecs) 109855
ReadyNAS NV+ HDVideo_1Play_1Record MaxReadTime(usecs) 469048
ReadyNAS NV+ HDVideo_1Play_1Record MaxWriteTime(usecs) 216028
ReadyNAS NV+ HDVideo_1Play_1Record MaxOpenTime(usecs) 113696
ReadyNAS NV+ HDVideo_2Play_2Record MaxReadTime(usecs) 717505
ReadyNAS NV+ HDVideo_2Play_2Record MaxWriteTime(usecs) 135060
ReadyNAS NV+ HDVideo_2Play_2Record MaxOpenTime(usecs) 87510
ReadyNAS NV+ HDPlayWithOffice MaxReadTime(usecs) 196719
ReadyNAS NV+ HDPlayWithOffice MaxWriteTime(usecs) 201560
ReadyNAS NV+ HDPlayWithOffice MaxOpenTime(usecs) 71257
ReadyNAS NV+ HDPlayWithBackup MaxReadTime(usecs) 129430
ReadyNAS NV+ HDPlayWithBackup MaxWriteTime(usecs) 160326
ReadyNAS NV+ HDPlayWithBackup MaxOpenTime(usecs) 149608
ReadyNAS NV+ ContentCreation MaxReadTime(usecs) 105583
ReadyNAS NV+ ContentCreation MaxWriteTime(usecs) 77392
ReadyNAS NV+ ContentCreation MaxOpenTime(usecs) 98989
ReadyNAS NV+ OfficeProductivity MaxReadTime(usecs) 98858
ReadyNAS NV+ OfficeProductivity MaxWriteTime(usecs) 253322
ReadyNAS NV+ OfficeProductivity MaxOpenTime(usecs) 1141376
ReadyNAS NV+ DataBackup MaxReadTime(usecs) 9472
ReadyNAS NV+ DataBackup MaxWriteTime(usecs) 206983
ReadyNAS NV+ DataBackup MaxOpenTime(usecs) 102045
ReadyNAS NV+ DataRestore MaxReadTime(usecs) 538755
ReadyNAS NV+ DataRestore MaxWriteTime(usecs) 0
ReadyNAS NV+ DataRestore MaxOpenTime(usecs) 38767
ReadyNAS NV+ FileCopyToNAS MaxReadTime(usecs) 0
ReadyNAS NV+ FileCopyToNAS MaxWriteTime(usecs) 65936
ReadyNAS NV+ FileCopyToNAS MaxOpenTime(usecs) 115286
ReadyNAS NV+ FileCopyFromNAS MaxReadTime(usecs) 184620
ReadyNAS NV+ FileCopyFromNAS MaxWriteTime(usecs) 0
ReadyNAS NV+ FileCopyFromNAS MaxOpenTime(usecs) 36961
ReadyNAS NV+ DirectoryCopyToNAS MaxReadTime(usecs) 951
ReadyNAS NV+ DirectoryCopyToNAS MaxWriteTime(usecs) 57822
ReadyNAS NV+ DirectoryCopyToNAS MaxOpenTime(usecs) 313404
ReadyNAS NV+ DirectoryCopyFromNAS MaxReadTime(usecs) 67892
ReadyNAS NV+ DirectoryCopyFromNAS MaxWriteTime(usecs) 0
ReadyNAS NV+ DirectoryCopyFromNAS MaxOpenTime(usecs) 89579
ReadyNAS NV+ PhotoAlbum MaxReadTime(usecs) 194522
ReadyNAS NV+ PhotoAlbum MaxWriteTime(usecs) 24633
ReadyNAS NV+ PhotoAlbum MaxOpenTime(usecs) 116298


Any ideas for improving the network speeds?

Turn on jumbo frames. That's about as well as you'll do without them.