1 2009 Calpont Corporation Calpont Calpont Open Source Open Source Columnar Storage Columnar Storage Engine for Engine for Scalable MySQL Scalable MySQL Data Warehousing Data Warehousing April 22, 2009 April 22, 2009 MySQL User Conference MySQL User Conference Santa Clara, CA Santa Clara, CA Jim Tommaney Jim Tommaney Chief Product Architect Chief Product Architect [email protected][email protected]
12
Embed
Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009
Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa Clara, CA Jim Tommaney Chief Product Architect [email protected]. In a Nutshell. Calpont built… a columnar storage engine optimized for data warehousing - PowerPoint PPT Presentation
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Enables shared nothing and shared everything storage
Enables partition elimination Built-in failover
Controller
• Work distribution• Final results
management and aggregation
Independent scalability and tunable concurrency
Multi-threaded to take advantage of multi-core HW platforms
Worker
• Scale-out cache management
• Distributed scan, filter, join and aggregation operations
• Resource management
Independent scalability and tunable performance
Multi-threaded to take advantage of multi-core HW platforms
Data
• High Speed Bulk Load• Transactional DML and
DDL• Online schema
extensions
Enables concurrent reads and writes, non-blocking read enabled
Multi-threaded to take advantage of multi-core HW platforms
MySQLDirectorMySQLDirector
ExtentMapExtentMap
PerformanceModule
UserModule
6
2009 Calpont Corporation
Calpont OAM
Scalable Building Blocks
UserModule n
UserModule 1
Scale out for Performance
Scale out for User Concurrency
• Add User Modules to scale user concurrency• Add Performance Modules to scale performance• Calpont OAM provides robust administration capabilities and monitors system health
• Each User Module can distribute work across all Performance Modules
PerformanceModule 1
PerformanceModule 2
PerformanceModule 3
PerformanceModule n
7
2009 Calpont Corporation
Multiple Storage Architectures Enabled by the Calpont Extent Map