Page 1
© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.
Deepak Singh - Amazon Web ServicesChristos Kalantzis - NetflixSteven Jones - Amazon Web Services
November 15, 2013
Bringing Your Applications to the Fast Lane
Friday, November 15, 13
Page 2
Hello!
Friday, November 15, 13
Page 3
3Friday, November 15, 13
Page 4
Instance Types
Friday, November 15, 13
Page 5
Performance
Friday, November 15, 13
Page 6
Generations
Friday, November 15, 13
Page 7
Many instance types
Friday, November 15, 13
Page 8
Friday, November 15, 13
Page 9
Building Blocks
Friday, November 15, 13
Page 10
General PurposeCompute-optimizedMemory-optimizedStorage-optimizedGPUMicro
M1, M3C1, CC2M2, CR1HI1, HS1CG1, G2Micro
Friday, November 15, 13
Page 11
Workload optimized
Friday, November 15, 13
Page 12
Compute-optimized
Friday, November 15, 13
Page 13
CC2
Friday, November 15, 13
Page 14
2.6 GHz Intel Xeon E5-2670
Friday, November 15, 13
Page 15
16 cores/32 vCPU
Friday, November 15, 13
Page 16
10 Gbps cluster networking
Friday, November 15, 13
Page 17
High Performance Linpack
Friday, November 15, 13
Page 18
Cores 17024
Rmax 240.09
Rpeak 354.12
cc2.8xlarge
Friday, November 15, 13
Page 19
I/O
Friday, November 15, 13
Page 20
HI1 instances
Friday, November 15, 13
Page 21
High random I/O performance
Friday, November 15, 13
Page 22
SSDs
Friday, November 15, 13
Page 23
Netflix and HI1
Christos Kalantzis
Friday, November 15, 13
Page 24
Advantages of using hi1.4xlarge with C*
• Higher application speed• Efficient operations & better data quality• Cost savings
Friday, November 15, 13
Page 25
Higher Application Speeds
• Compared m2.4xlarge & hi1.xlarge• 6 node C* cluster with 250 GB data on each node• Used following Cassandra Stress tool & Options
from three m2.4xlarge clients:–cassandra-stress -d [server-list] -t 25 -r -p 7102 -n 1000000000 -k -o
READ
Friday, November 15, 13
Page 26
Higher Application Speeds
Cassandra-stress C*
C*
C*
C*
C*
C*Cassandra-stress
Cassandra-stress
Friday, November 15, 13
Page 27
m2.4xlarge results
Throughput Speed
Friday, November 15, 13
Page 28
hi1.4xlarge results
Throughput Speed
Friday, November 15, 13
Page 29
Higher Application Speeds
• 40X throughput• Better Latencies
–~37X AVG–~109X 95th %ile–~110X 99th %ile
Friday, November 15, 13
Page 30
Efficient C* Operations & Better Data Quality
• Cassandra => “benefit now, pay later”–Immutable SSTABLES need to be compacted–Can compact faster & with less impact
• Eventual Consistency–Repairs run more often–Increased Consistency without higher CL calls
Friday, November 15, 13
Page 31
Cost Savings
• Can now have multi-tenant clusters–Savings immediate on the second application–m2.4xlarge is $1.640 per hour–hi1.4xlarge is $3.100 per hour
C*App A&B
C*App A&B
C*App A&B
C*App A&B
C*App A&B
C*App A&B
C*App A
C*App A
C*App A
C*App A
C*App A
C*App A
C*App B
C*App B
C*App B
C*App B
C*App B
C*App B
Friday, November 15, 13
Page 32
Cost Savings
• Use Less Nodes–Data : Memory ratio can now be bigger–Cluster size doesn’t need to be doubled as often
Friday, November 15, 13
Page 33
Cost Savings
• Smaller Operational Footprint–Less clusters–Smaller operational teams–Less fire-fighting–Team can focus on automation
Friday, November 15, 13
Page 34
hi1.4xlarge caveats
• 10 Gbps not attained (in our model)–Need to be part of the same Cluster Placement Group–Netflix cross-zone availability model excludes CPG
• Not same as bare metal SSD running on Linux–Virtualization obfuscates some SSD advantages
Friday, November 15, 13
Page 35
Memory-optimized
Friday, November 15, 13
Page 36
244 GiB of RAM
Friday, November 15, 13
Page 37
2.6 GHz Intel Xeon E5 2670
Friday, November 15, 13
Page 38
10 Gbps cluster networking
Friday, November 15, 13
Page 39
In-memory distributed analytics
Friday, November 15, 13
Page 40
e.g. SAP HANA
Friday, November 15, 13
Page 41
Steven JonesAmazon Web Services
Friday, November 15, 13
Page 42
SAP ERP
Friday, November 15, 13
Page 43
SAP ERP
Friday, November 15, 13
Page 44
SAP ERP
Friday, November 15, 13
Page 45
SAP ERP BI
Friday, November 15, 13
Page 46
SAP ERP BI
Friday, November 15, 13
Page 47
SAP ERP BI
Friday, November 15, 13
Page 48
SAP ERP BI
Friday, November 15, 13
Page 49
SAP ERP BI
Aggregates
Friday, November 15, 13
Page 50
SAP ERP BI
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 51
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 52
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 53
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 54
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 55
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 56
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 57
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 58
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 59
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 60
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 61
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 62
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 63
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 64
SAP ERP BITREXBWA
AggregatesPre-Defined
Queries
Friday, November 15, 13
Page 65
Magnetic Disk
SSD/Flash
RAM
CPU Cache
CPU Register
Latency
Storage Type
Friday, November 15, 13
Page 66
Magnetic Disk
SSD/Flash
RAM
CPU Cache
CPU Register
Latency
Storage Type
RAM is up to 100,000 x Faster
Friday, November 15, 13
Page 67
http://tinyurl.com/hana-perf
SAP HANAHigh Performance Analytic Appliance
aka In-Memory Database Platform
Friday, November 15, 13
Page 68
SAP ERP BIHANA
Friday, November 15, 13
Page 69
SAP ERPHANA
Friday, November 15, 13
Page 70
EC2 Cluster Compute instances
2 x Intel Xeon E5-2670 processors32 vCPUs with hyperthreading
64-bit60.5 GB RAM
10 Gigabit Network
2 x Intel Xeon E5-2670 processors
32 vCPUs with hyperthreading
64-bit
244 GB RAM
10 Gigabit Network
NUMA and Turbo Support
cc2.8xlarge cr1.8xlarge
New
All c* instances support high-performance (10 gigabit) networking to Elastic Block Storage volumes (EBS)
Friday, November 15, 13
Page 71
SAP HANA on AWS
1,776 Core HANA Cluster on AWS
60B Rows | 8M Rows/s | 3M Queries/h | 330ms
Friday, November 15, 13
Page 72
Where to go for HANASAP Developer Center http://bit.ly/aws-hana-devFree SAP license AWS Marketplacehttp://bit.ly/
aws-hana-one99¢ / hr SAP License
SAP HANA Marketplacehttp://bit.ly/aws-hana-byolBYOL
Friday, November 15, 13
Page 73
New generations
Friday, November 15, 13
Page 74
Latest Generation Hardware
Friday, November 15, 13
Page 75
Hardware features, e.g. AVX
Friday, November 15, 13
Page 76
SSDs
Friday, November 15, 13
Page 77
Enhanced Networking
Friday, November 15, 13
Page 78
Better price-performance
Friday, November 15, 13
Page 79
C3
Friday, November 15, 13
Page 80
Best raw compute capacity
Friday, November 15, 13
Page 81
2.8 GHz Intel Xeon E5-2680v2(Ivy Bridge)
Friday, November 15, 13
Page 82
Clustering as a “feature”
Friday, November 15, 13
Page 83
Friday, November 15, 13
Page 84
Friday, November 15, 13
Page 85
High Performance Linpack
Friday, November 15, 13
Page 86
Cores 26496
Rmax 484.18
Rpeak 593.87
c3.8xlarge
Friday, November 15, 13
Page 87
0"
100"
200"
300"
400"
500"
600"
CC1" CC2" C3"
Rmax%
Friday, November 15, 13
Page 88
Cores 8192
Rmax 163.9
Rpeak 183.5
c3.8xlarge
Friday, November 15, 13
Page 89
I2
Friday, November 15, 13
Page 90
Coming Soon
Friday, November 15, 13
Page 91
Best Price for IOPS
Friday, November 15, 13
Page 92
More sizes
Friday, November 15, 13
Page 93
More SSD
Friday, November 15, 13
Page 94
More IOPS
Friday, November 15, 13
Page 95
More memory
Friday, November 15, 13
Page 96
Friday, November 15, 13
Page 97
350,000+ random read IOPS320,000+ random write IOPS
i2.8xlarge
Friday, November 15, 13
Page 98
175,000+ random read IOPS160,000+ random write IOPS
i2.4xlarge
Friday, November 15, 13
Page 99
Enhanced Networking
Friday, November 15, 13
Page 100
Enhanced Networking
Low latencyLow jitter
Very high PPS performance
Friday, November 15, 13
Page 101
cc2.8xlarge+ c3.8xlarge+ c3.8xlarge+(enhanced)+
cc2.8xlarge+ c3.8xlarge+ c3.8xlarge+(enhanced)+
Latency
PPS
Friday, November 15, 13
Page 102
p50$
p90$
p999$
p100$
Low network jitter
Friday, November 15, 13
Page 103
General PurposeCompute-optimizedMemory-optimizedStorage-optimizedGPUMicro
M1, M3C1, CC2, C3M2, CR1HI1, I2, HS1CG1, G2Micro
Friday, November 15, 13
Page 104
General PurposeCompute-optimizedMemory-optimizedStorage-optimizedGPUMicro
M1, M3C1, CC2, C3M2, CR1HI1, I2, HS1CG1, G2Micro
Friday, November 15, 13
Page 105
More to come
Friday, November 15, 13
Page 106
Please give us your feedback on this presentation
As a thank you, we will select prize winners daily for completed surveys!
CPN203 Thank You
Friday, November 15, 13