QCT: Avoid the mess, deploy with a validated solution Veda Shankar Director of Emerging Technology QCT
Jan 22, 2018
QCT:Avoidthemess,deploywithavalidatedsolution
VedaShankarDirectorofEmergingTechnology
QCT
• AboutQCT• RedHatStorageonQCTCloudServers• QCTRedHatCeph Storage Solutions• QCTRedHatGluster Storage Solutions• QCTBigDataStudy• QCTCenterofExcellence
Agenda
2
• QCT(QuantaCloudTechnology) wasannouncedasasubsidiaryofQuantaComputer in2012
• QuantaComputer isafortuneglobal500companywithover$30Brevenue• QCToffersafull spectrumofown-branddatacenterproductsandservices
directlyto• Hyperscaledatacenter• CSPsandTelcos• Largeenterprises
• Productlinesinclude• Servers,storage,networkswitches,integratedracksystemsandcloud
solutions• Suiteofconfiguration,integration,andoptimizationservicestohelpconfigure
bestproductcombination
3
QCTProvidesCompleteProductLinewithHyperscalePerformance,FlexibleConfigurationandEnsuredCompatibility
Reliability
Agility
Scalability
Serviceability
Efficiency
Storage
Server
Racks
NetworkSwitch
QCTSolutionLandscapeExtendCloudBusinesstoCloudSolutions
• Flexiblerack-basedappliances• Startsmall,growover time
• Extendtomulti-rackclusters• OptimizethekWperrackwithinyourpower
footprint
• HAconfiguration• 3Foundationnodes
• 3+Storagenodes
• Scalablechoice• 5-20Computenodesperrack
• 3-8StoragenodesscaledwithComputenodesforbalancedperformance
NetworkQuantaMesh T3048-LY8
QuantaMesh T1048-LB9
StorageQuantaGrid D51B-2U
Compute + FoundationQuantaGrid D51B-1U
Example:QCTRacklevel OpenStackConfiguration
QCTStorageSolutionsWorkwithRedHatandIntelonCeph andGluster storage
7
QxStor RedHatCephStorageEdition• ThroughputOptimized• Cost/capacityOptimized• IOPSOptimized
QxStor RedHatGlusterStorageEdition• ThroughputOptimized• Cost/capacityOptimized
HWProductlines• OCP-OpenRack• OCP-OCS• Scorpio
• 1GSwitch• 10GSwitch• 25GSwitch• 40GSwitch• 100GSwitch
• Cloud server• GPUserver
• Storageserver• JBOD/JBOF• Cluster Server
QxStor Solutions
Ceph – Pre-configuredand Easy to OrderQCTQxStor Red Hat Ceph Storage Edition
ThroughputOptimized
• Densest1UCephbuildingblock
• Smaller failuredomain
• Obtain bestthroughput&density at once
• Scale at high scale 2x 280TB
• Block or ObjectStorage, Video,Audio,Image,Streamingmedia, Big Data
• 3xreplicationUSE
CASE
QxStor RCT-400QxStor RCT-200
Cost/Capacity Optimized
QxStor RCC-400
• Maximize storage capacity• Highestdensity560TB* rawcapacityperchassis
• Object storage, Archive,Backup, Enterprise Dropbox
• Erasurecoding
D51PH-1ULH T21P-4U
*Optional model, oneMB per chassis, can support 620TB raw capacity
IOPS Optimized
QxStor RCI-300
• All FlashDesign• Lowest latency• Performance & capacity SKUs
• Database, HPC, MissionCritical Applications
• 3x replication
D51BP-1UComing soon
9
SHAREDFILEWORKLOADS ENTRY (>100TB*) SMALL(500TB*) MEDIUM(>1PB*) LARGE(>2PB*)
THROUGHPUTOPTIMIZED
QxStor RCT-20016xD51PH-1ULH (16U)• 12x8TBHDDs• 3xSSDsforjournal• 1xdualport10GbE• 3xreplica
QxStor RCT-4006x T21P-4U/Dual(24U)• 2x35x8TBHDDs• 2x2xPCIe SSDsforjournal• 2xsingleport40GbE• 3xreplica
QxStor RCT-40011xT21P-4U/Dual(44U)• 2x35x8TBHDDs• 2x2xPCIe SSDsforjournal• 2xsingleport40GbE• 3xreplica
COST/CAPACITYOPTIMIZED
IOPSOPTIMIZED
NA NA
QxStor RCC-400Nx T21P-4U/Dual• 2x35x8TBHDDs• 0xSSDsforjournal• 2xdualport10GbE• ErasureCoding4:2
QxStor RCT-2004xD51PH-1ULH (4U)• 12x8TBHDDs• 3xSSDsforjournal• 1xdualport10GbE• 3xreplica
QxStor RCI-300Nx D51BP-1U• 2x E5-2695/2699 v4 or• 4xNVMe forOSDs• 2xdualport10GbE Coming soon
QxStor Red Hat Ceph Storage Configurations
*Usablestoragecapacity
10
Optimized and Validated QCT QxStor Ceph
0
2000
4000
6000
8000
10000
12000
14000
0 1 2 3 4 5 6
MB/secp
erCluster
CephOSDServerQuan6ty
RCT-200ReadThroughput
RCT-200WriteThroughput
RCT-400ReadThroughput
RCT-400WriteThroughput
0
10
20
30
40
50
60
70
80
90
100
RCT-200(12DisksperOSD) RCC-400(35DisksperOSD)
MBy
tes/
sec/disk
Sequen>alRead/Disk
Sequen>alWrite/Disk
Linearscale-outperformance Outstanding Scale-up Performance
Over 2x better performance (40G vs 10G on RGT-400)
10G40G
50% better write and 33% lower latencyby using SSD fpr Ceph Journal on RGT-400
ThroughputOptimizedLargeFiles
• Suitableforlargefiles(e.g.GBfiles)• Distributedreplicatedvolume• Raid6storage
QxStor RGT-400(LF)QxStor RGT-200(LF)
Throughput OptimizedSmallFiles
QxStor RGT-200(SF)
D51PH-1ULH T21P-4U
• Suitablefor smallfiles(e.g.50KBimages orMB audios)
• Distributedreplicated volume• Raid6storage• SSDs forhottier
Cost/Capacity Optimized
• Maximizedcapacityforcolddata• Erasure-codedvolumes• JBODstorage
QxStor RGC-400QxStor RGC-200
D51PH-1ULH D51PH-1ULH T21P-4U
• File BasedWorkloads• File Archive & Backup
• CCTV & Surveillance• Media & EntertainmentUSE CASE
Gluster – Pre-configuredand Easy to OrderQCTQxStor Red Hat Gluster Storage Edition
QxStor Red Hat Gluster Storage ConfigurationsSHAREDFILEWORKLOADS ENTRY (GREATER THAN
100TB USABLE)SMALL(UPTO500TBUSABLE)
MEDIUM(GREATERTHAN1PB USABLE)
LARGE(GREATERTHAN2PBUSABLE)
THROUGHPUTOPTIMIZED(SMALLFILEPERFORMANCE)
4x QxStor RGT-200(SF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 4xSSDHotTier• 1xdualport10GbE• ServerNodeQty:4 (160TB
Usable)
14x QxStor RGT-200(SF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 4xSSDHotTier• 1xdualport10GbE• ServerNodeQty:14(560TBUsable)
N/A
THROUGHPUTOPTIMIZED(LARGE-FILEPERFORMANCE)
4x QxStor RGT-200(LF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 1xdualport10GbE• ServerNodeQty:4(160TB
Usable)
14x QxStor RGT-200(LF)• 2xReplicatedVolume• 12x8TBHDDs(withRAID6)• 1xdualport10GbE• ServerNodeQty:14(560TB
Usable)
5x QxStor RGT-400(LF)• 2xReplicatedVolume• 2x35x8TBHDDs(withRAID6)• 2xsingleport40GbE• ServerNodeQty:10 (1.1PBUsable)
COST/CAPACITYOPTIMIZED(LARGE-FILEARCHIVE)
6x QxStor RGC-200• ErasureCodedVolume• 12x8TBHDDs(JBODmode)• 1xdualport10GbE• ServerNodeQty:6(384TB
Usable)
8x QxStor RGC-200• ErasureCodedVolume• 12x8TBHDDs(JBODmode)• 1xdualport10GbE• ServerNodeQty:8 (512TB
Usable)
4x QxStor RGC-400• ErasureCodedVolume• 2x24x8TBHDDs(JBODmode)• 2xdualport10GbE• ServerNodeQty:8 (1PBUsable)
QxStor RedHatGluster StorageTestPerformance
13
Read Write
2xreplication - D51PH-1ULH12disks/nodeRAID6
Erasurecoding(4:2)- D51PH-1ULH12disks/nodeJBOD
14
MORESIMPLICITYLESSCOMPLEXITY
QCT ships pre-installed RedHatCeph/Gluster Storage
Make Ceph & Gluster Easy to AdoptFrom configuration optimization to deployment& process optimization
15
Object,BlockStorage
QxStor RedHatCephStorage
EasyConfig
EasyOrder
EasyInstall
EasyRollout
SoftwareDefinedNASFileStorage
QxStor RedHatGlusterStorage
OptimizedCeph/GlusterRef Architecture
QCT QxStorCeph/GlusterSKUs
Red HatStoragepre-installed
Red Hat Storageappliancebundles
16
QCT QxStor Ceph – Easy to RolloutEasyConfig
EasyOrder
EasyInstall
EasyRollout
• Hardwarebaremetalprovisioning(Kickstart)- Customers’ defined server host namesand networking information
• QCT Ceph SKUoptions• Ceph-Ansbile
- MON/OSDnodeassignment- Apply Journal/OSDbasedonSKU- Networktopology defined(singleNIC/dualNIC)
- Cephsoftwarepackagedeployment
Fullrack/clusterlevelCephdeploymentfrombaremetal
Simplifythedeploymentprocess
ReadyforProduction
EasytoMaintain
Coming soon
ThreeStepsto Make Ceph Up and Running BMC
Cluster
Public/Deployment
Network CablingRack &Stack Up & Running
1 2 3
18
QCT BareMetal ISO File
Shipping
EasyConfig
EasyOrder
EasyInstall
EasyRollout
QxStor RedHatGluster Storage
QCT QxStor Gluster – Easy to InstallComing soon
19
FromPre-InstalledtoPre-Configured
QxStor GlusterDeploymentKit@QCT factory
Gdeploy (Ansible)
EasyConfig
EasyOrder
EasyInstall
EasyRollout
QCT QxStor Gluster – Easy to Rollout
• Hardwarebaremetalprovisioning (Kickstart)- RHGSISOinstallation- Alldependencypackagesinstalled
• QCT Gluster SKU options• Ansible playbookwithgdeploy
- LVMconfiguration- Bricksconfiguration- Profilecustomization- Clusterinitialization
InQ12017
CephMonitors
ApacheHadoop*
Networking
CephOSDx8
Hadoop with Ceph* on QCT PlatformPhysicalarchitecture
QCTSolutionCenter
20
IntelCASandCephJournalConfiguration
21
22
Validated Solution: Apache Hadoop* with Ceph* StorageProof-of-concept (POC)builtbyIntelandQCT
DisaggregatestorageandcomputeinHadoopbyusingCeph
storageinsteadofdirect-attached
storage(DAS)
OptimizeperformancewithIntel®CacheAccelerationSoftware(Intel®CAS)andIntel®SSDsusingNVMe*• Resolveinput/output(I/O)bottlenecks
• Providebettercustomerservice-level-agreement(SLA)support
• Provideuptoa60%I/Operformanceimprovement1
Buildingabest-in-classarchitecture
23
2424
POC/Forum
ForstimulatingdiscussionbetweenQCT,solutionproviders,customers
Collaboration
AmongQCT,RedHat,Intelandvaluedcustomers
Showcase
Leadingedgesolutions andinnovativetechnology
Platform
Fortestingandbenchmarknewproductandsolutiondevelopment
QCTCenterofExcellenceRedHatCeph Storage– ObjectStorageCenterofExcellence
CenterofExcellence(COE)
25
Ceph 5.6PB* ObjectCluster– RCT-400ThroughputOptimized20xCephOSDNodes,eachnodewith280TB• CPU:E5-2650v4x2• RAM:128GB2400MHz• HDD:8TBSATASeagate x35• NVMe SSD:IntelP3700Series800Gx2• NIC:QCTOCPCX3Pro40Gsingleport• SASController:S2PMEZZ/B3008• BootOS:Intel S3510Series120G
QxStor RCT-400
*rawcapacity
ClientCluster(QCTMultinode Server)40xNodes,eachnodewith• CPU:E5-2620v3x2orhigherCPUspecx2• RAM:64GB+• NIC:QCTOCP82599ES10GSFP+dualportT41S-2U
Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2Node 1Node 2
Node 1
Node 2
Node 3
Node 4
S2S
Node 1Node 2
S2P
40gb * 10
10gb * 24LY8
LY6 LY6
LY640gb * 5 40gb * 5
40gb * 3 40gb * 3
40gb * 10
40gb 40gb
40gb * 12
10gb * 24LY8
40gb * 3 40gb * 3
10gb * 24LY8
40gb * 3 40gb * 3
10gb * 8LY8
40gb * 3 40gb * 3
40gb * 10
LY640gb * 5 40gb * 5
40gb * 10
40gb * 12
40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb 40gb
10gb * 24
Node 1
Node 2
Node 3
Node 4
S2S
Node 1
Node 2
Node 3
Node 4
S2S
Node 1
Node 2
Node 3
Node 4
S2S
10gb * 8
MLAG
Leaf switch(Storage)
Leaf switch(Workload
Server)
Spine switch
Node 1Node 2
40gb 40gb
S2P S2P S2P S2P S2P S2P S2P S2P S2P
Node 1
Node 2
Node 3
Node 4
S2S
10gb * 24
Node 1
Node 2
Node 3
Node 4
S2S
Node 1
Node 2
Node 3
Node 4
S2S
Node 1
Node 2
Node 3
Node 4
S2S
10gb * 24
Node 1
Node 2
Node 3
Node 4
S2S
Node 1
Node 2
Node 3
Node 4
S2S
COENetworkDiagram
26
RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400 RCT-400CEPHCLUSTER
CLIENTS
Visit www.QCT.io for more information:• Solution BriefQCTandIntelHadoopOverCeph Architecture• ReferenceArchitectureRedHatCeph StorageonQCTServers• ReferenceArchitectureRedHatGluster StorageonQCTServers• Datasheet QxStor Red Hat Ceph Storage• Solution BriefDeployingRedHatCeph StorageonQCTservers• Solution Brief Containerized Ceph for On-Demand, Hyperscale Storage
For More Information…
27
www.QCT.io
Lookingforinnovativecloudsolution?CometoQCT,whoelse?
28