[D13] 次世代型インメモリデータベース SAP HANA その最新技術を理解する by Toshihisa Hanaki

• 1. SAP HANA SAP 2013/11/13

2. SAPSAP SAPSAP SAP SAP 2013 SAP AG. All rights reserved.2 3. 2013 SAP AG. All rights reserved.3 4. 5. SAP OLTP OLAP SAPVS // 2013 SAP AG. All rights reserved.5 6. DEEP ORHIGH SPEED DEEP HIGH SPEED BROAD SIMPLE 2013 SAP AG. All rights reserved.REAL -TIME SIMPLE 6 7. OLTPOLAP HW Yesterday SAP HANA cache 2013 SAP AG. All rights reserved.OLTP + OLAPIn-memory acceleration H/W 7 8. Cache Query Results QueryAggregates Indexes SAP HANA Data WarehouseETLOperational Data Store CopyData 2013 SAP AG. All rights reserved.9 9. OLTPOLAP5DB Deep Broad Real-time 2013 SAP AG. All rights reserved.High Speed Simple 10 10. OLTPOLAP1 Hasso Plattner 1 SAP HANA ETLETLCacheVS(DRAM) 3 2013 SAP AG. All rights reserved.11 11. 12. DBMSMulti-Core Architecture64bit address space8 CPU x 10 Cores per blade1 TB in current serversMassive parallel scaling with many bladesDramatic decline in price/performanceCPUL3 CacheL3 CacheL3 CacheL3 CacheL3 CacheL3 CacheL3 CacheL3 Cache OLTP+OLAP ONLY (Dynamic Aggregation)Logging and Backup Solid State 2013 SAP AG. All rights reserved.FlashHDD 13 13. DB; SAP HANA Country France Italy Italy SpainProduct corn wheat corn rice456corn1000457Italywheat900458Sales 1000 900 600 800FranceItalycorn600459Order 456 457 458 459Spainrice800Row order organization456 457 458 459France Italy Italy Spaincorn wheat corn rice1000 900 600 800Single-record access: SELECT * FROM SalesOrders Single-scan aggregation: WHERE Order = 457 SELECT Country, SUM(sales) FROM SalesOrders WHERE Product=corn GROUP BY CountryColumn order organization 2013 SAP AG. All rights reserved.14 14. 1 ROW ID5 No 456 457 458 459 460France Italy Spain Italy Denmarkcorn wheat rice rice corn1000 900 600 800 5006461Denmarkrice6007462 463Belgium Italyrice rice600 11001 2 3 48 2013 SAP AG. All rights reserved.1 2 3 4 5Belgium Denmark France Italy Spain Dictionary 5 entries, so need 3 bits to encode! (bit fields) 1 2 3 4 5 6 7 83 4 5 4 2 2 1 4No 460 1 2 3 4 57 5,6 1 2,4,8 3 No 15 15. 2 Columnnar Run-length Encoding Logical Table ROW ID 1 2 3 4 5 6 7 8No 456 457 458 459 460 461 462 463France corn 1000 Italy wheat 900 Spain rice 600 Italy rice 800 Denmark corn 500 Denmark rice 600 Belgium rice 600 Italy rice 11001 2 3 4 5Belgium Denmark France Italy Spain 3 4 5 4 2x2 1 4 1 corn 2 wheat 3 rice1 2 3x2 1 3x3 2013 SAP AG. All rights reserved.16 16. Write Read (New) Read Write (New)Write (New) (New)Read """New" 2013 SAP AG. All rights reserved.17 17. SQL 2013 SAP AG. All rights reserved. quant. 150 60 100 45 75 84 96 162 45 366type 43 12 12 33 33 12 32 43 12 33core 1sales $1000 $900 $600 $800 $500core 2$750$600 $600 $1100 $450 $2000Acore 3 Bcore 418 18. 19. OLTP + OLAP in Columnar databaseEnd-to-end Data ProcessingApplication ProcessingPredictivePrescriptiveMachine LearningOperational AnalyticsApplication LayerSentiment IntelligenceSAP HANAIn-Memory Database layer(Main Memory)SAP HANA (Main Memory)LibrariesSAP HANA (Main Memory)TransactionsSensorsSpatial/GIS 2013 SAP AG. All rights reserved. Text Graph 20 20. SAP HANA SAP Business Suite and BW ABAP App ServerSQLMDXRJSONOpen ConnectivitySAP HANA SQL, SQLScript, JavaScript & & UI HADOOPSAP HANA 2013 SAP AG. All rights reserved.21 21. SAP HANA Native Application Basics Presentation logic o GUI o PC etc Control flow logic o o XS Calculation logic o / o SAP HANA 2013 SAP AG. All rights reserved.22 22. SAP HANA OLAP HANA View TBD R 2013 SAP AG. All rights reserved.SQL TWebRSASHANASAS 23 23. BI DB 2013 SAP AG. All rights reserved.24 24. AFL(Application Function Library)AFL Application Function o SAPAFLC++ o Pridictive Analysis LibraryBusiness Function LibraraySPS05) AFL o SAP HANA o AFLSQLScript o SPS5 SPS6Application Function ModelerGUI 2013 SAP AG. All rights reserved.25 25. Predictive Analysis Library (PAL) HANA Predictive Analysis Library SAP HANA PALHANA Predictive Analysis Library PALHANA HANA PMML 2013 SAP AG. All rights reserved.PAL qC4.5 q qCHAID q qq qk-qq q q qqK-means q ABCqq q q q 26 26. PALAFMSPS6AFM(Application Function Manager) AFL GUI SQL HANA StudioHANA ClientRegi) AFL o AFL__SYS_AFL_AFLPAL o Object PrivilegeREPOSITORY_RESET o Package Privilege:REPO_PACKAGE_ROOT XS 2013 SAP AG. All rights reserved.27 27. Business Functional Library(BFL) HANAHANA Business Function Business Function Library SAP HANA q Annual Depreciationq LeaseqCumulateq Linar Average Year on Year) q Cyclesq Max Valueq Days q Delay Stockq Moving Average & Moving Sumq Discounted Cash Flowq Net present Valueq Driverq Outlook Business Function Libraryq Feed BFLHANA HANA q Forecast Agents 2013 SAP AG. All rights reserved.q Forecast Driverq Payment q Proportion q Rateq Fundsq Seasonal Complexq FutureqStock Flowq Growq Timeq Lagq Volume Drive28 28. 2013 SAP AG. All rights reserved.29 29. R R 4000Predictive Analysis SAP R R 4000SAP HANA SAP Predictive Algorithm Library) 2013 SAP AG. All rights reserved.30 30. SAP HANA Extended Application Services (SAP HANA XS) SAP HANA SAP HANA SAP HANA JavaScript,SQLScriptHANA View ODATA, JSON, XMLA HTML5 / SAPUI5 HTTP / SMTP TCO SAP HANA 2013 SAP AG. All rights reserved.31 31. SAP HANA Smart Data Access BenefitsTransactions + Analytics DB HANA SAP HANA HANA TablesVirtual TablesHeterogeneous data sources IQTeradataASEHadoop SAP HANA 2013 SAP AG. All rights reserved. SAP HANA to Hadoop (Hive) Teradata SAP Sybase ASE SAP Sybase IQ Oracle SQL Server 32 32. SAP HANA Existing Technology CalculationApplication LayerOther Database LayerSAP HANA Future Strategy Application LayerSAP HANA Database LayerCalculationSmart Data AccessExtract Transform LatencyOther DatabasesOther Databases 2013 SAP AG. All rights reserved.33 33. 34. 12 DB NFSSSDFusionIO 3 5 Note: 2013 SAP AG. All rights reserved. SASPersistence Storage HANA Appliance3rd 3rd NFSSymantec NetBackup Infomatica SAS 35 35. N+1 2013 SAP AG. All rights reserved.node01node02node03node04 backupSAP SAP HANA DB DB partition 1DB partition 2DB partition 3- SAP HANA DB master node- SAP HANA DB backup master- SAP HANA DBhot-standby - SAP HANA DBshared lesystem HDDashHDDashHDDashHDDash36 36. SAP HANA Disaster Tolerance: WARMData Center 1Data Center 2OS: DNS, hostnames Primary (active) Nam e Serv er Inde x serv erNam e Serv er Inde x serv erNam e Serv er Inde x serv erSecondary Transfer byHANA database kernel(active, data pre-loaded) Name Serve rName Serve rName Serve rIndex serverIndex serverIndex serverHA Solution Partner HA Solution PartnerOS: Mounts Data Data Volumes Volumes Log Volume 2013 SAP AG. All rights reserved.Data Data Volumes Volumes Log VolumeLog VolumeLog VolumePlanned Innovation: This is the current state of planning and may be changed by SAP at any time.37 37. Campus clusterMetro clusterGeo cluster SyncAsync SyncRPO 0 RTO < 30 minProductionLocal standbyRemote standby systems 2013 SAP AG. All rights reserved.39 38. SAP HANA Studio Eclipse PAL 2013 SAP AG. All rights reserved.JavaScript BFLHTML5 GUISQL MDX 41 39. SAP HANA Appliance SAP HANA Technology PartnersSAP HANA Hardware PartnersSAP HANA Cloud Offering 2013 SAP AG. All rights reserved.42 40. SAP HANA T n Suite on HANA XSMLLLCPU20Core20Core40Core80Core40Core80Core nS128GB256GB512GB1TB1TB2TB or 4TB XL CPU20Core40Core80Core256GB512GB1TBMax Node16Node16Node or 56Node2013/5/29 56Node 2013 SAP AG. All rights reserved.43 41. SAP HANA One on AWS Developer Edition HANASAP HANAAWS 3 HANAAWS EC2$0.62/hr Virtual CPUsMemory (GB)Storage (GB)m2.xlarge217.1154m2.2xlarge434.2154m2.4xlarge868.4154Size HANA StudioWindows on EC2AWS URL http://scn.sap.com/docs/DOC-28294 2013 SAP AG. All rights reserved.44 42. SAP HANA:Infrastructure subscription by AWS SAP HANA1GB5http://www.saphana.com/docs/DOC-4181 2013 SAP AG. All rights reserved.45 43. SAP HANA: Infrastructure subscription by SAPUS 2013 SAP AG. All rights reserved.46 44. SAP HANA Cloud Offerings On-PremiseCloudSAP HANA ApplianceSAP HANA OneSAP HANA: SAP HANA: SAP HANA; Infrastructure Platform as a Managed Subscription Service Services SAP HANA PAASSAP HANA Amazon Web ServicesSAP, Amazon Web Services (AWS), SavvisSAPSAP& SAP Business Suite on HANA SAP BW on HANA POC 64GB-1TB 60GB 16vCPU(cc2.8xla rge)SAP:128GB-1 TB AWS: 244GB-1.44TB1GB-750GB 2013 SAP AG. All rights reserved.47 45. SAP HANA Academy 300SAP HANAhttp://www.saphana.com/ community/implement/hanaacademy 2013 SAP AG. All rights reserved.SAP HANA http://www.youtube.com/playlist? list=PLa30ZrX-1P6RLRayqbjY2n4qydjrgjW mk 48 46. 1115 Session4 14:00-14:45 B35:SAP Sybase IQ, Hadoop1115 Session5 15:00-15:45 B35:SAP HANA[] SAP SAP 2013 SAP AG. All rights reserved. 49 47. Thank [email protected]