Top Banner
QCT: Avoid the mess, deploy with a validated solution Veda Shankar Director of Emerging Technology QCT
28

Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

Jan 22, 2018

Download

Technology

Red_Hat_Storage
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

QCT:Avoidthemess,deploywithavalidatedsolution

VedaShankarDirectorofEmergingTechnology

QCT

Page 2: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

• AboutQCT• RedHatStorageonQCTCloudServers• QCTRedHatCeph Storage Solutions• QCTRedHatGluster Storage Solutions• QCTBigDataStudy• QCTCenterofExcellence

Agenda

2

Page 3: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

• QCT(QuantaCloudTechnology) wasannouncedasasubsidiaryofQuantaComputer in2012

• QuantaComputer isafortuneglobal500companywithover$30Brevenue• QCToffersafull spectrumofown-branddatacenterproductsandservices

directlyto• Hyperscaledatacenter• CSPsandTelcos• Largeenterprises

• Productlinesinclude• Servers,storage,networkswitches,integratedracksystemsandcloud

solutions• Suiteofconfiguration,integration,andoptimizationservicestohelpconfigure

bestproductcombination

3

Page 4: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

QCTProvidesCompleteProductLinewithHyperscalePerformance,FlexibleConfigurationandEnsuredCompatibility

Reliability

Agility

Scalability

Serviceability

Efficiency

Storage

Server

Racks

NetworkSwitch

Page 5: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

QCTSolutionLandscapeExtendCloudBusinesstoCloudSolutions

Page 6: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

• Flexiblerack-basedappliances• Startsmall,growover time

• Extendtomulti-rackclusters• OptimizethekWperrackwithinyourpower

footprint

• HAconfiguration• 3Foundationnodes

• 3+Storagenodes

• Scalablechoice• 5-20Computenodesperrack

• 3-8StoragenodesscaledwithComputenodesforbalancedperformance

NetworkQuantaMesh T3048-LY8

QuantaMesh T1048-LB9

StorageQuantaGrid D51B-2U

Compute + FoundationQuantaGrid D51B-1U

Example:QCTRacklevel OpenStackConfiguration

Page 7: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

QCTStorageSolutionsWorkwithRedHatandIntelonCeph andGluster storage

7

QxStor RedHatCephStorageEdition• ThroughputOptimized• Cost/capacityOptimized• IOPSOptimized

QxStor RedHatGlusterStorageEdition• ThroughputOptimized• Cost/capacityOptimized

HWProductlines• OCP-OpenRack• OCP-OCS• Scorpio

• 1GSwitch• 10GSwitch• 25GSwitch• 40GSwitch• 100GSwitch

• Cloud server• GPUserver

• Storageserver• JBOD/JBOF• Cluster Server

QxStor Solutions

Page 8: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

Ceph – Pre-configuredand Easy to OrderQCTQxStor Red Hat Ceph Storage Edition

ThroughputOptimized

• Densest1UCephbuildingblock

• Smaller failuredomain

• Obtain bestthroughput&density at once

• Scale at high scale 2x 280TB

• Block or ObjectStorage, Video,Audio,Image,Streamingmedia, Big Data

• 3xreplicationUSE

CASE

QxStor RCT-400QxStor RCT-200

Cost/Capacity Optimized

QxStor RCC-400

• Maximize storage capacity• Highestdensity560TB* rawcapacityperchassis

• Object storage, Archive,Backup, Enterprise Dropbox

• Erasurecoding

D51PH-1ULH T21P-4U

*Optional model, oneMB per chassis, can support 620TB raw capacity

IOPS Optimized

QxStor RCI-300

• All FlashDesign• Lowest latency• Performance & capacity SKUs

• Database, HPC, MissionCritical Applications

• 3x replication

D51BP-1UComing soon

Page 9: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

9

SHAREDFILEWORKLOADS ENTRY (>100TB*) SMALL(500TB*) MEDIUM(>1PB*) LARGE(>2PB*)

THROUGHPUTOPTIMIZED

QxStor RCT-20016xD51PH-1ULH (16U)• 12x8TBHDDs• 3xSSDsforjournal• 1xdualport10GbE• 3xreplica

QxStor RCT-4006x T21P-4U/Dual(24U)• 2x35x8TBHDDs• 2x2xPCIe SSDsforjournal• 2xsingleport40GbE• 3xreplica

QxStor RCT-40011xT21P-4U/Dual(44U)• 2x35x8TBHDDs• 2x2xPCIe SSDsforjournal• 2xsingleport40GbE• 3xreplica

COST/CAPACITYOPTIMIZED

IOPSOPTIMIZED

NA NA

QxStor RCC-400Nx T21P-4U/Dual• 2x35x8TBHDDs• 0xSSDsforjournal• 2xdualport10GbE• ErasureCoding4:2

QxStor RCT-2004xD51PH-1ULH (4U)• 12x8TBHDDs• 3xSSDsforjournal• 1xdualport10GbE• 3xreplica

QxStor RCI-300Nx D51BP-1U• 2x E5-2695/2699 v4 or• 4xNVMe forOSDs• 2xdualport10GbE Coming soon

QxStor Red Hat Ceph Storage Configurations

*Usablestoragecapacity

Page 10: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

10

Optimized and Validated QCT QxStor Ceph

0

2000

4000

6000

8000

10000

12000

14000

0 1 2 3 4 5 6

MB/secp

erCluster

CephOSDServerQuan6ty

RCT-200ReadThroughput

RCT-200WriteThroughput

RCT-400ReadThroughput

RCT-400WriteThroughput

0

10

20

30

40

50

60

70

80

90

100

RCT-200(12DisksperOSD) RCC-400(35DisksperOSD)

MBy

tes/

sec/disk

Sequen>alRead/Disk

Sequen>alWrite/Disk

Linearscale-outperformance Outstanding Scale-up Performance

Over 2x better performance (40G vs 10G on RGT-400)

10G40G

50% better write and 33% lower latencyby using SSD fpr Ceph Journal on RGT-400

Page 11: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

ThroughputOptimizedLargeFiles

• Suitableforlargefiles(e.g.GBfiles)• Distributedreplicatedvolume• Raid6storage

QxStor RGT-400(LF)QxStor RGT-200(LF)

Throughput OptimizedSmallFiles

QxStor RGT-200(SF)

D51PH-1ULH T21P-4U

• Suitablefor smallfiles(e.g.50KBimages orMB audios)

• Distributedreplicated volume• Raid6storage• SSDs forhottier

Cost/Capacity Optimized

• Maximizedcapacityforcolddata• Erasure-codedvolumes• JBODstorage

QxStor RGC-400QxStor RGC-200

D51PH-1ULH D51PH-1ULH T21P-4U

• File BasedWorkloads• File Archive & Backup

• CCTV & Surveillance• Media & EntertainmentUSE CASE

Gluster – Pre-configuredand Easy to OrderQCTQxStor Red Hat Gluster Storage Edition

Page 12: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

QxStor Red Hat Gluster Storage ConfigurationsSHAREDFILEWORKLOADS ENTRY (GREATER THAN

100TB USABLE)SMALL(UPTO500TBUSABLE)

MEDIUM(GREATERTHAN1PB USABLE)

LARGE(GREATERTHAN2PBUSABLE)

THROUGHPUTOPTIMIZED(SMALLFILEPERFORMANCE)

4x QxStor RGT-200(SF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 4xSSDHotTier• 1xdualport10GbE• ServerNodeQty:4 (160TB

Usable)

14x QxStor RGT-200(SF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 4xSSDHotTier• 1xdualport10GbE• ServerNodeQty:14(560TBUsable)

N/A

THROUGHPUTOPTIMIZED(LARGE-FILEPERFORMANCE)

4x QxStor RGT-200(LF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 1xdualport10GbE• ServerNodeQty:4(160TB

Usable)

14x QxStor RGT-200(LF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 1xdualport10GbE• ServerNodeQty:14(560TB

Usable)

5x QxStor RGT-400(LF)• 2xReplicatedVolume• 2x35x8TBHDDs(withRAID6)• 2xsingleport40GbE• ServerNodeQty:10 (1.1PBUsable)

COST/CAPACITYOPTIMIZED(LARGE-FILEARCHIVE)

6x QxStor RGC-200• ErasureCodedVolume• 12x8TBHDDs(JBODmode)• 1xdualport10GbE• ServerNodeQty:6(384TB

Usable)

8x QxStor RGC-200• ErasureCodedVolume• 12x8TBHDDs(JBODmode)• 1xdualport10GbE• ServerNodeQty:8 (512TB

Usable)

4x QxStor RGC-400• ErasureCodedVolume• 2x24x8TBHDDs(JBODmode)• 2xdualport10GbE• ServerNodeQty:8 (1PBUsable)

Page 13: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

QxStor RedHatGluster StorageTestPerformance

13

Read Write

2xreplication - D51PH-1ULH12disks/nodeRAID6

Erasurecoding(4:2)- D51PH-1ULH12disks/nodeJBOD

Page 14: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

14

MORESIMPLICITYLESSCOMPLEXITY

QCT ships pre-installed RedHatCeph/Gluster Storage

Page 15: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

Make Ceph & Gluster Easy to AdoptFrom configuration optimization to deployment& process optimization

15

Object,BlockStorage

QxStor RedHatCephStorage

EasyConfig

EasyOrder

EasyInstall

EasyRollout

SoftwareDefinedNASFileStorage

QxStor RedHatGlusterStorage

OptimizedCeph/GlusterRef Architecture

QCT QxStorCeph/GlusterSKUs

Red HatStoragepre-installed

Red Hat Storageappliancebundles

Page 16: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

16

QCT QxStor Ceph – Easy to RolloutEasyConfig

EasyOrder

EasyInstall

EasyRollout

• Hardwarebaremetalprovisioning(Kickstart)- Customers’ defined server host namesand networking information

• QCT Ceph SKUoptions• Ceph-Ansbile

- MON/OSDnodeassignment- Apply Journal/OSDbasedonSKU- Networktopology defined(singleNIC/dualNIC)

- Cephsoftwarepackagedeployment

Fullrack/clusterlevelCephdeploymentfrombaremetal

Simplifythedeploymentprocess

ReadyforProduction

EasytoMaintain

Coming soon

Page 17: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

ThreeStepsto Make Ceph Up and Running BMC

Cluster

Public/Deployment

Network CablingRack &Stack Up & Running

1 2 3

Page 18: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

18

QCT BareMetal ISO File

Shipping

EasyConfig

EasyOrder

EasyInstall

EasyRollout

QxStor RedHatGluster Storage

QCT QxStor Gluster – Easy to InstallComing soon

Page 19: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

19

FromPre-InstalledtoPre-Configured

QxStor GlusterDeploymentKit@QCT factory

Gdeploy (Ansible)

EasyConfig

EasyOrder

EasyInstall

EasyRollout

QCT QxStor Gluster – Easy to Rollout

• Hardwarebaremetalprovisioning (Kickstart)- RHGSISOinstallation- Alldependencypackagesinstalled

• QCT Gluster SKU options• Ansible playbookwithgdeploy

- LVMconfiguration- Bricksconfiguration- Profilecustomization- Clusterinitialization

InQ12017

Page 20: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

CephMonitors

ApacheHadoop*

Networking

CephOSDx8

Hadoop with Ceph* on QCT PlatformPhysicalarchitecture

QCTSolutionCenter

20

Page 21: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

IntelCASandCephJournalConfiguration

21

Page 22: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

22

Validated Solution: Apache Hadoop* with Ceph* StorageProof-of-concept (POC)builtbyIntelandQCT

DisaggregatestorageandcomputeinHadoopbyusingCeph

storageinsteadofdirect-attached

storage(DAS)

OptimizeperformancewithIntel®CacheAccelerationSoftware(Intel®CAS)andIntel®SSDsusingNVMe*• Resolveinput/output(I/O)bottlenecks

• Providebettercustomerservice-level-agreement(SLA)support

• Provideuptoa60%I/Operformanceimprovement1

Page 23: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

Buildingabest-in-classarchitecture

23

Page 24: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

2424

POC/Forum

ForstimulatingdiscussionbetweenQCT,solutionproviders,customers

Collaboration

AmongQCT,RedHat,Intelandvaluedcustomers

Showcase

Leadingedgesolutions andinnovativetechnology

Platform

Fortestingandbenchmarknewproductandsolutiondevelopment

QCTCenterofExcellenceRedHatCeph Storage– ObjectStorageCenterofExcellence

Page 25: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

CenterofExcellence(COE)

25

Ceph 5.6PB* ObjectCluster– RCT-400ThroughputOptimized20xCephOSDNodes,eachnodewith280TB• CPU:E5-2650v4x2• RAM:128GB2400MHz• HDD:8TBSATASeagate x35• NVMe SSD:IntelP3700Series800Gx2• NIC:QCTOCPCX3Pro40Gsingleport• SASController:S2PMEZZ/B3008• BootOS:Intel S3510Series120G

QxStor RCT-400

*rawcapacity

ClientCluster(QCTMultinode Server)40xNodes,eachnodewith• CPU:E5-2620v3x2orhigherCPUspecx2• RAM:64GB+• NIC:QCTOCP82599ES10GSFP+dualportT41S-2U

Page 26: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2

Node 1

Node 2

Node 3

Node 4

S2S

Node 1Node 2

S2P

40gb * 10

10gb * 24LY8

LY6 LY6

LY640gb * 5 40gb * 5

40gb * 3 40gb * 3

40gb * 10

40gb 40gb

40gb * 12

10gb * 24LY8

40gb * 3 40gb * 3

10gb * 24LY8

40gb * 3 40gb * 3

10gb * 8LY8

40gb * 3 40gb * 3

40gb * 10

LY640gb * 5 40gb * 5

40gb * 10

40gb * 12

40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb

10gb * 24

Node 1

Node 2

Node 3

Node 4

S2S

Node 1

Node 2

Node 3

Node 4

S2S

Node 1

Node 2

Node 3

Node 4

S2S

10gb * 8

MLAG

Leaf switch(Storage)

Leaf switch(Workload

Server)

Spine switch

Node 1Node 2

40gb 40gb

S2P S2P S2P S2P S2P S2P S2P S2P S2P

Node 1

Node 2

Node 3

Node 4

S2S

10gb * 24

Node 1

Node 2

Node 3

Node 4

S2S

Node 1

Node 2

Node 3

Node 4

S2S

Node 1

Node 2

Node 3

Node 4

S2S

10gb * 24

Node 1

Node 2

Node 3

Node 4

S2S

Node 1

Node 2

Node 3

Node 4

S2S

COENetworkDiagram

26

RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400CEPHCLUSTER

CLIENTS

Page 27: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

Visit www.QCT.io for more information:• Solution BriefQCTandIntelHadoopOverCeph Architecture• ReferenceArchitectureRedHatCeph StorageonQCTServers• ReferenceArchitectureRedHatGluster StorageonQCTServers• Datasheet QxStor Red Hat Ceph Storage• Solution BriefDeployingRedHatCeph StorageonQCTservers• Solution Brief Containerized Ceph for On-Demand, Hyperscale Storage

For More Information…

27

Page 28: Red Hat Storage Day New York - QCT: Avoid the mess, deploy with a validated solution

www.QCT.io

Lookingforinnovativecloudsolution?CometoQCT,whoelse?

28