Как мы тестировали software defined storage aka Virtual SAN

IT , software defined storage.



.

:

  • 3 SuperMicro X9SCL/X9SCM :
  • Intel E3-1220V2: 4 cores x 3.1 GHz
  • RAM — 16 Gb
  • RAID Adaptec 6405E: 2300GB SAS 10K, 1x180GB SSD — JBOD
  • 2x500GB SATA 7.4K .
  • 2x1GB NIC

Virtual SAN , Starwind VSAN - , , VMWARE VSAN , , - , . VMWARE VSAN business-critical . Nutanix EMC ScaleIO.

ScaleIO software defined virtial SAN EMC, ( for non-production use!) — — , - , SSD .( , SSD ). hi-end enterprise IBM XIV — — 1.

:
  • These are the minimum system requirements for a ScaleIO 1.31 and 1.32 implementation:
  • ScaleIO 1.31 and 1.32 solution is only supported on ESXi 5.5 GA.
  • Three ESXi servers with 100 GB of free capacity per server
  • 1 Gbps network
  • Four 7,200 rpm SATA disks per node


1.32 .

, production VMWARE Hyper-V, VMWARE ESXi 6.0. , ScaleIO XEN, ESXi, Hyper-V, , Windows 2012 r2 SSD 2012 R2 , . ( )

ESXi appliance VCENTER VMWARE. — ESXi Adaptec 6405E, VMWARE HCL.
Adaptec (Offline-Bundles and VIB) VMWARE VMWARE powercli — .

VCENTER appliance vmware powercli ScaleIO datastore ScaleIO .ova ( ScaleIO).

ScaleIO.

:
— protection domain storage pool',
— storage pool' (, HDD SSD, )
— , FaultSets, . , ZeroPadding Policy, RAM Cache policy , Spare policy.

ScaleIO SSD ! . SSD , flash-only pool — !


read\write cache RAID , , RAM CACHE, protection domain, ! ( 16GB RAM 1.3GB , )

2 VLAN: management data, 4- ( ) SVM (SVM — ScaleIO Virtual Machine) management IP DATA IP . ( , 10 ).

4 SVM 3- (SVM — ScaleIO Virtual Machine), 8cpu ( 2 : 2 4 vcpu), 12Gb .

SVM node1 — primary mdm, sds, sdc
SVM node2 — secondary mdm, sds, sdc
SVM node3 — tie breaker, sdc
SVM — gateway — ( , , maintenance)

mdm — Meta Data Manager —
sds — ScaleIO data server — RDM VMWARE (raw disk mapping)
sdc — ScaleIO data client — VMWARE . , ScaleIO , SVM.

, SDC , ScaleIO VMWARE LUN datastore, iSCSI.



, VLAN IP SVM. :

Failed: Add SDS device ScaleIO-4c1885e7 to Storage Pool hdds (ScaleIO — Timeout)

. , — retry. , SVM 2 :

Failed: Add SDS device ScaleIO-4c1885eb to Storage Pool hdds (ScaleIO — The SDS is already attached to this MDM)

… , SVM, secondary mdm, - RDM , SDS. .

«deploy scaleio environment» , , , , VLAN IP , .

volume . GUI: GUI dashboard windows, GUI VMWARE, - Gateway. cli — .

— volume GUI VMWARE.



, ! «» . storage pool HDDs ( 6 SAS 3- ) total capacity limit 1.6B ( 6300GB), volume c … . , CLI . SSH MDM SVM — :

ScaleIO-10-1-4-203:~ # scli --query_storage_pool --protection_domain_name pd2 --storage_pool_name hdds
Error: MDM failed command.  Status: Invalid session. Please login and try again.


?

MDM: - can't connect localhost:6611

gateway . — ! CLI.

userguide ScaleIO CLI Basics, , CLI , , :
ScaleIO-10-1-4-203:~ # scli --login --username admin
Enter password:


CLI .

scli --query_storage_pool --protection_domain_name pd2 --storage_pool_name hdds

Storage Pool hdds (Id: 574711eb00000000) has 0 volumes and
544.0 GB (557056 MB) available for volume allocation
Background device scanner: Disabled
Zero padding is disabled
Spare policy: 34% out of total
Uses RAM Read Cache
RAM Read Cache write handling mode is 'cached'
 1.6 TB (1667 GB) total capacity
 1.1 TB (1100 GB) unused capacity
 567.1 GB (580708 MB) spare capacity


, ? 544GB?! ? ? (. ):



.. raw storage pool' HDDs: 1.6 567.1 GB spare capacity = 1.1TB unused capacity. Spare Capacity Spare Policy . , , Storage Capacity 1\N , storage pool, N (. 3 storage pool'e, spare capacity 1\3 1.6TB ( ) 567.1 GB (580708 MB).

, 1.1TB storage pool volume. ScaleIO 2 , 1.1TB 2 , volume 544.0 GB.

( 85-130\, , , IOPS):



Nutanix Comminity Edition 4.5 — non-commercial

Nutanix, , … . Nutanix hypervisor ( VMWARE Vcenter) «», NFS high-availability.

, ESXi . Community Edition, :

— 4
— 4 ( SSD, 18 TB (3 x 6 TB HDDs))
— Intel c VT-x 4
— Advanced Host Controller Interface (AHCI) SATA
— LSI IT mode (Nutanix testing shows better performance than IR)
— 16 GB ( 32 GB — 16 )
— SSD 200 GB
— SSD 300GB ( 400,480)

ADAPTEC 6405E SAS Nutanix, SAS ( SATA SSD . ).

: — 8GB ( 8GB, 16, hypervisor KVM (Acropolis) CVM — control virtual machine — !), CVM .

:

— 16
— 2 HDD SATA 500GB
— 1 SSD 500GB
— 24GB + 300GB SSD , .



Community Edition — KVM — , VMWARE ESXi.

(CVM — control virtual machine), 2 12 — .

: StorageContainer Replication Factor 2, 50% ( , 3 , 2 SATA 500 , 6 + SSD 2.88 TB 1.44 TB ).

NFS: , VMWARE 5.5 datastore , storage vmotion , FC 4Gb\sec ( — 10G infiniband).

60GB VMWARE 24 Nutanix. FC enterprise 13 .

iso c windows vmware nfs (1Gb/s) — 34MB/sec.

vswitch — cli.

: . Nutanix VLAN, . VLAN — , — , GUI ! .

Windows guests CDROM VirtIO ( ( iso ): fedoraproject.org/wiki/Windows_Virtio_Drivers#Direct_download)

guest vm windows 2012 R2 7 , — , SSD.

IDE ( VirtIO ), — .

HA , , , , ( ),
3- , Critial — , , . ( 1 2-). VMWARE .

, Prism Nutanix CE ( ) . , , , , VCENTER.

, : Symantec Veeam KVM … , , ().

Nutanix , , , -: ). Nutanix VMWARE EXSi.

, «» . — .

Source: https://habr.com/ru/post/de383157/


All Articles