× NETGEAR will be terminating ReadyCLOUD service by July 1st, 2023. For more details click here.
Orbi WiFi 7 RBE973
Reply

Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

reulnl
Aspirant

Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

Hi,

 

My ReadyNAS Ultra 6 X-RAID2 (with dual redundancy) configuration was:

/dev/sda = 2TB

/dev/sdb = 3TB
/dev/sdc = 2TB
/dev/sdd = 3TB
/dev/sde = 4TB (3TB assigned)
/dev/sdf = 3TB

 

This configuration gave me a total Volume Capacity of 9250GB.

 

This week I've replaced /dev/sda and /dev/sdc by 4TB disks:

/dev/sda = 4TB (3TB assigned)
/dev/sdb = 3TB
/dev/sdc = 4TB (3TB assigned)
/dev/sdd = 3TB
/dev/sde = 4TB (3TB assigned)
/dev/sdf = 3TB

 

Although RAIDiatior is telling me that 3TB on each disk has been assigned my total Volume Capacity is still 9250GB, where I expected that it should have been increased by approx. 2TB.

 

Anyone who could help me sorting out why this volume is not expanding?

 

# lvdisplay
  --- Logical volume ---
  LV Name                /dev/c/c
  VG Name                c
  LV UUID                58i8fT-VZhX-ntye-IWZX-mxhr-uDci-snOtLM
  LV Write Access        read/write
  LV Status              available
  # open                 1
  LV Size                9.07 TB
  Current LE             148592
  Segments               2
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:0
# pvdisplay
  --- Physical volume ---
  PV Name               /dev/md2
  VG Name               c
  PV Size               7.26 TB / not usable 0
  Allocatable           yes (but full)
  PE Size (KByte)       65536
  Total PE              118944
  Free PE               0
  Allocated PE          118944
  PV UUID               E3ORym-0inG-l1CX-gueV-NZIV-mGUI-vR4JG4

  --- Physical volume ---
  PV Name               /dev/md3
  VG Name               c
  PV Size               1.82 TB / not usable 0
  Allocatable           yes
  PE Size (KByte)       65536
  Total PE              29808
  Free PE               160
  Allocated PE          29648
  PV UUID               eiX7nG-hwof-NbMi-ulKJ-mSLx-71HI-2MH6zK

 

Message 1 of 7

Accepted Solutions
reulnl
Aspirant

Re: Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

After unmounting volume c I've resized the physical volume /dev/md3 (since the RAID6 array has already been expended) and extendend the logical volume with 1.82T. After that I've resized the ext4 filesystem on /dev/c/c:

 

pvresize /dev/md3
lvextend -L +1.82T -n /dev/c/c /dev/md3
resize2fs -pf /dev/c/c

 

Now is everything as I expected it to be:

 

 

df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/md0              4.0G  1.4G  2.5G  37% /
tmpfs                  16K     0   16K   0% /USB
/dev/c/c               11T  8.8T  2.1T  82% /c

 

View solution in original post

Message 5 of 7

All Replies
reulnl
Aspirant

Re: Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

Device         : /dev/md0
Create Time    : 1422057868
Update Time    : 1443276361
RAID Level     : 1
RAID Capacity  : 4193268
Disk Size      : 4193268
Chunk Size     : 0
Disks          : 6
RAID Disks     : 6
Active Disks   : 6
Working Disks  : 6
Failed Disks   : 0
Spare Disks    : 0
State          : 1 [ Clean ]

Disk  Device         RAID Disk  Maj/Min     Sectors   State
---------------------------------------------------------------------------
  3   /dev/sdd1          3        8/49      8388608    6 [ Active Sync ]
  4   /dev/sdf1          4        8/81      8388608    6 [ Active Sync ]
  5   /dev/sde1          5        8/65      8388608    6 [ Active Sync ]
  6   /dev/sdb1          1        8/17      8388608    6 [ Active Sync ]
  7   /dev/sda1          0        8/ 1      8388608    6 [ Active Sync ]
  8   /dev/sdc1          2        8/33      8388608    6 [ Active Sync ]

Device         : /dev/md1
Create Time    : 1422057869
Update Time    : 1443275269
RAID Level     : 6
RAID Capacity  : 2096896
Disk Size      : 524224
Chunk Size     : 65536
Disks          : 6
RAID Disks     : 6
Active Disks   : 6
Working Disks  : 6
Failed Disks   : 0
Spare Disks    : 0
State          : 1 [ Clean ]

Disk  Device         RAID Disk  Maj/Min     Sectors   State
---------------------------------------------------------------------------
  3   /dev/sdd2          3        8/50      1048576    6 [ Active Sync ]
  4   /dev/sdf2          4        8/82      1048576    6 [ Active Sync ]
  5   /dev/sde2          5        8/66      1048576    6 [ Active Sync ]
  6   /dev/sdb2          1        8/18      1048576    6 [ Active Sync ]
  7   /dev/sda2          0        8/ 2      1048576    6 [ Active Sync ]
  8   /dev/sdc2          2        8/34      1048576    6 [ Active Sync ]

Device         : /dev/md2
Create Time    : 1422057869
Update Time    : 1443275327
RAID Level     : 6
RAID Capacity  : 7795170816
Disk Size      : 1948792704
Chunk Size     : 65536
Disks          : 6
RAID Disks     : 6
Active Disks   : 6
Working Disks  : 6
Failed Disks   : 0
Spare Disks    : 0
State          : 1 [ Clean ]

Disk  Device         RAID Disk  Maj/Min     Sectors   State
---------------------------------------------------------------------------
  3   /dev/sdd3          3        8/51   3897587825    6 [ Active Sync ]
  4   /dev/sdf3          4        8/83   3897587825    6 [ Active Sync ]
  5   /dev/sde3          5        8/67   3897587825    6 [ Active Sync ]
  6   /dev/sdb3          1        8/19   3897587825    6 [ Active Sync ]
  7   /dev/sda3          0        8/ 3   3897587825    6 [ Active Sync ]
  8   /dev/sdc3          2        8/35   3897587825    6 [ Active Sync ]

Device         : /dev/md3
Create Time    : 1425388768
Update Time    : 1443275265
RAID Level     : 6
RAID Capacity  : 1953501568
Disk Size      : 976750784
Chunk Size     : 65536
Disks          : 4
RAID Disks     : 4
Active Disks   : 4
Working Disks  : 4
Failed Disks   : 0
Spare Disks    : 0
State          : 1 [ Clean ]

Disk  Device         RAID Disk  Maj/Min     Sectors   State
---------------------------------------------------------------------------
  0   /dev/sdb4          0        8/20   1953503959    6 [ Active Sync ]
  1   /dev/sdd4          1        8/52   1953503959    6 [ Active Sync ]
  2   /dev/sdf4          2        8/84   1953503959    6 [ Active Sync ]
  3   /dev/sde4          3        8/68   1953503959    6 [ Active Sync ]
***** partition output for sda *****

Disk /dev/sda: 7814037168 sectors, 3.6 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 76EE7EDB-3A00-4090-8FDD-7D66A76AB142
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 7814037134
Partitions will be aligned on 8-sector boundaries
Total free space is 1953508133 sectors (931.5 GiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              64         8388671   4.0 GiB     FD00  
   2         8388672         9437247   512.0 MiB   FD00  
   3         9437248      3907025072   1.8 TiB     FD00  
   4      3907025080      5860529038   931.5 GiB   FD00  

Disk /dev/sda: 486401 cylinders, 255 heads, 63 sectors/track
Units = cylinders of 8257536 bytes, blocks of 1024 bytes, counting from 0

   Device Boot Start     End   #cyls    #blocks   Id  System
/dev/sda1          0+      -       0- 2147483647+  ee  EFI GPT
/dev/sda2          0       -       0          0    0  Empty
/dev/sda3          0       -       0          0    0  Empty
/dev/sda4          0       -       0          0    0  Empty




***** partition output for sdb *****

Disk /dev/sdb: 5860533168 sectors, 2.7 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): CB1B757F-1C9C-48FC-B52D-53B3E61E33B1
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 5860533134
Partitions will be aligned on 8-sector boundaries
Total free space is 4133 sectors (2.0 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              64         8388671   4.0 GiB     FD00  
   2         8388672         9437247   512.0 MiB   FD00  
   3         9437248      3907025072   1.8 TiB     FD00  
   4      3907025080      5860529038   931.5 GiB   FD00  

Disk /dev/sdb: 364801 cylinders, 255 heads, 63 sectors/track
Units = cylinders of 8257536 bytes, blocks of 1024 bytes, counting from 0

   Device Boot Start     End   #cyls    #blocks   Id  System
/dev/sdb1          0+      -       0- 2147483647+  ee  EFI GPT
/dev/sdb2          0       -       0          0    0  Empty
/dev/sdb3          0       -       0          0    0  Empty
/dev/sdb4          0       -       0          0    0  Empty




***** partition output for sdc *****

Disk /dev/sdc: 7814037168 sectors, 3.6 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 26850ED4-3BD9-4159-951D-CE703075D0BA
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 7814037134
Partitions will be aligned on 8-sector boundaries
Total free space is 1953508133 sectors (931.5 GiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              64         8388671   4.0 GiB     FD00  
   2         8388672         9437247   512.0 MiB   FD00  
   3         9437248      3907025072   1.8 TiB     FD00  
   4      3907025080      5860529038   931.5 GiB   FD00  

Disk /dev/sdc: 486401 cylinders, 255 heads, 63 sectors/track
Units = cylinders of 8257536 bytes, blocks of 1024 bytes, counting from 0

   Device Boot Start     End   #cyls    #blocks   Id  System
/dev/sdc1          0+      -       0- 2147483647+  ee  EFI GPT
/dev/sdc2          0       -       0          0    0  Empty
/dev/sdc3          0       -       0          0    0  Empty
/dev/sdc4          0       -       0          0    0  Empty




***** partition output for sdd *****

Disk /dev/sdd: 5860533168 sectors, 2.7 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): D8A1E088-BFA7-4B1B-8E15-50AD0423FBAF
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 5860533134
Partitions will be aligned on 8-sector boundaries
Total free space is 4133 sectors (2.0 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              64         8388671   4.0 GiB     FD00  
   2         8388672         9437247   512.0 MiB   FD00  
   3         9437248      3907025072   1.8 TiB     FD00  
   4      3907025080      5860529038   931.5 GiB   FD00  

Disk /dev/sdd: 364801 cylinders, 255 heads, 63 sectors/track
Units = cylinders of 8257536 bytes, blocks of 1024 bytes, counting from 0

   Device Boot Start     End   #cyls    #blocks   Id  System
/dev/sdd1          0+      -       0- 2147483647+  ee  EFI GPT
/dev/sdd2          0       -       0          0    0  Empty
/dev/sdd3          0       -       0          0    0  Empty
/dev/sdd4          0       -       0          0    0  Empty




***** partition output for sde *****

Disk /dev/sde: 7814037168 sectors, 3.6 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 8AD8C6B1-0605-48ED-AFC7-196328709D28
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 7814037134
Partitions will be aligned on 8-sector boundaries
Total free space is 1953508133 sectors (931.5 GiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              64         8388671   4.0 GiB     FD00  
   2         8388672         9437247   512.0 MiB   FD00  
   3         9437248      3907025072   1.8 TiB     FD00  
   4      3907025080      5860529038   931.5 GiB   FD00  

Disk /dev/sde: 486401 cylinders, 255 heads, 63 sectors/track
Units = cylinders of 8257536 bytes, blocks of 1024 bytes, counting from 0

   Device Boot Start     End   #cyls    #blocks   Id  System
/dev/sde1          0+      -       0- 2147483647+  ee  EFI GPT
/dev/sde2          0       -       0          0    0  Empty
/dev/sde3          0       -       0          0    0  Empty
/dev/sde4          0       -       0          0    0  Empty




***** partition output for sdf *****

Disk /dev/sdf: 5860533168 sectors, 2.7 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): DADEA7E4-B0AF-4CBF-A0E8-E4AA09E024C8
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 5860533134
Partitions will be aligned on 8-sector boundaries
Total free space is 4133 sectors (2.0 MiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              64         8388671   4.0 GiB     FD00  
   2         8388672         9437247   512.0 MiB   FD00  
   3         9437248      3907025072   1.8 TiB     FD00  
   4      3907025080      5860529038   931.5 GiB   FD00  

Disk /dev/sdf: 364801 cylinders, 255 heads, 63 sectors/track
Units = cylinders of 8257536 bytes, blocks of 1024 bytes, counting from 0

   Device Boot Start     End   #cyls    #blocks   Id  System
/dev/sdf1          0+      -       0- 2147483647+  ee  EFI GPT
/dev/sdf2          0       -       0          0    0  Empty
/dev/sdf3          0       -       0          0    0  Empty
/dev/sdf4          0       -       0          0    0  Empty
Message 2 of 7
StephenB
Guru

Re: Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

Did you try rebooting?

 

Also, there is an 8 TiB growth limit from the factory install (or the more recent factory default).  Is it possible that you have reached that limit?  Is there anything in the logs that suggests that expansion has failed?

Message 3 of 7
reulnl
Aspirant

Re: Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

Rebooting didn't solve my problem.

 

I've started with a capacity of 7.5TB, so the 8 TiB growth limit should not be a problem. The logs are not stating anything usefull, besides that it is trying to extend the logical volume by "0" bytes:

 

[2015/09/26 15:03:15  3419] LINE 4374: exec command: lvextend /dev/c/c -l +0
  New size (148592 extents) matches existing size (148592 extents)

Since mdadm was showing that the partitions sda4 and sdc4 are not part of md3 (RAID 6), I'm now trying to add them manually:

 

mdadm --add /dev/md3 /dev/sda4
mdadm --add /dev/md3 /dev/sdc4
mdadm -v --grow --raid-devices=6 /dev/md3

Within 10 hours the restriping of md3 should be finished and hopefully I will be able to extend the logical volume after that.

 

cat /proc/mdstat
Personalities : [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md3 : active raid6 sdc4[5] sda4[4] sdb4[0] sde4[3] sdf4[2] sdd4[1]
      1953501568 blocks super 1.2 level 6, 64k chunk, algorithm 2 [6/6] [UUUUUU]
      [=====>...............]  reshape = 27.2% (265943836/976750784) finish=590.4min speed=20062K/sec

md2 : active raid6 sda3[7] sde3[5] sdf3[4] sdd3[3] sdc3[8] sdb3[6]
      7795170816 blocks super 1.2 level 6, 64k chunk, algorithm 2 [6/6] [UUUUUU]

md1 : active raid6 sda2[7] sde2[5] sdf2[4] sdd2[3] sdc2[8] sdb2[6]
      2096896 blocks super 1.2 level 6, 64k chunk, algorithm 2 [6/6] [UUUUUU]

md0 : active raid1 sda1[7] sde1[5] sdf1[4] sdd1[3] sdc1[8] sdb1[6]
      4193268 blocks super 1.2 [6/6] [UUUUUU]

unused devices: <none>

 

Message 4 of 7
reulnl
Aspirant

Re: Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

After unmounting volume c I've resized the physical volume /dev/md3 (since the RAID6 array has already been expended) and extendend the logical volume with 1.82T. After that I've resized the ext4 filesystem on /dev/c/c:

 

pvresize /dev/md3
lvextend -L +1.82T -n /dev/c/c /dev/md3
resize2fs -pf /dev/c/c

 

Now is everything as I expected it to be:

 

 

df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/md0              4.0G  1.4G  2.5G  37% /
tmpfs                  16K     0   16K   0% /USB
/dev/c/c               11T  8.8T  2.1T  82% /c

 

Message 5 of 7
IcyK
Tutor

Re: Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

Is far as I know from answers around the internet, RAID 6 bij default needs at least 4 drives (of the same size, that is) to operate (which is strange as technically for dual reduncandy 3 should be enough). I guess if you added a 4th 4TB drive, it would have expanded as expected.

It's good to know one can manually override this behaviour.

Message 6 of 7
mdgm-ntgr
NETGEAR Employee Retired

Re: Ultra 6 - X-RAID 2 (dual redundancy) volume not expanding

RAID-6 does require a minimum of four disks.


The volume capacity now is the same as it would have been with 6x3TB disks. If another 4TB disk is added then offline volume expansion may be possible to expand it a further couple of TB.

Message 7 of 7
Top Contributors
Discussion stats
  • 6 replies
  • 2855 views
  • 0 kudos
  • 4 in conversation
Announcements