What’s New in Denodo Platform 6.0 Dr. Alberto Pan, Chief Technical Officer
What’s New in DenodoPlatform 6.0Dr. Alberto Pan, Chief Technical Officer
Agenda1.Main Drivers of Denodo 6.0
2.Performance in BigData Scenarios
3.Managing Enterprise Wide Deployments
4.Agile Data Development
5.Information Self-Service
Main Drivers for Denodo 6.0
Dynamic Query Optimizer for Big Data
Support for new analytical data sources
Support for new analytic functions
New Information Self-Service Tool
New ODBC Driver
Enhancements in Tableau integration
Workload Management: Denodo Resource Manager
Monitoring and Diagnosing Tool
New VDP Admin Tool
GIT Support
Performance in BigData Scenarios
Information Self-service
Enterprise Wide Deployments
Agile Development
Main Drivers for Denodo 6.0
Dynamic Query Optimizer for Big Data
Support for new analytical data sources
Support for new analytic functions
New Information Self-Service Tool
New ODBC Driver
Enhancements in Tableau integration
Workload Management: Denodo Resource Manager
Monitoring and Diagnosing Tool
New VDP Admin Tool
GIT Support
Performance in BigData Scenarios
Information Self-service
Enterprise Wide Deployments
Agile Development
5
Dynamic Query Optimizer for BigDataBest Performance Even When Processing Billions of Rows
Move processing to the data paradigm
Fully automated optimization decisions
Considers characteristics of BigData Sources
Find more details at: datavirtualization.bloghttp://www.datavirtualizationblog.com/myths-in-data-virtualization-performance/
6
Query Optimizer for BigData: ExampleBest Performance Even When Processing Billions of Rows
Performance Comparison of Physical vs Logical Scenario
Big Data volumes
TPC-DS benchmark
Find more details at: datavirtualization.bloghttp://www.datavirtualizationblog.com/physical-logical-data-warehouse-performance-numbers/
Sales(Netezza)
Customers(Oracle) Items
(SQLServer)290M
2M 400K
7
Query Optimizer for BigData: ExamplePhysical vs Logical DW Performance
Query Description Rows ReturnedAVG Time Physical (all data in Netezza)
AVG Time Logical
Optimization Technique (automatically chosen by Denodo6.0)
Total sales by customer 1,99 M 20975 ms 21457 msFull group bypushdown
Total sales by customer and year between 2000 and 2004 5,51 M 52313 ms 59060 ms
Full group bypushdown
Total sales by item brand 31,35 K 4697 ms 5330 msPartial group bypushdown
Total sales by item where sale price less than current list price 17,05 K 3509 ms 5229 ms
On the fly data movement
8
New adapter for Apache Spark
New adapter for Redshift
Enhanced Integration withVertica, Teradata andImpala
Enhanced Connectivity for BigData SourcesEnhanced Adapters for the BigData Ecosystem
MarketingSales ExecutiveSupport
Database
Apps
Warehouse Cloud
Big Data
Documents AppsNo SQL
Main Drivers for Denodo 6.0
Dynamic Query Optimizer for Big Data
Support for new analytical data sources
Support for new analytic functions
New Information Self-Service Tool
New ODBC Driver
Enhancements in Tableau integration
Workload Management: Denodo Resource Manager
Monitoring and Diagnosing Tool
New VDP Admin Tool
GIT Support
Performance in BigData Scenarios
Information Self-service
Enterprise Wide Deployments
Agile Development
Denodo Resource Manager (1)
■ Rules Classify Sessions into Groups (e.g. by user, application,…)
■ E.g. Sessions from application ‘single customer view’ are assigned to group called ‘high priority_transactional
Allocate Resources according to Business Priorities
Denodo Resource Manager (2)
■ Apply Restrictions for Each Group.
Allocate Resources according to Business Priorities
Denodo Resource Manager (and 3)
■ Restrictions can apply to each individual query in a group or to the set of all queries in the group
Allocate Resources according to Business Priorities
13
Monitor current state of servers and clusters
Inspect sessions, queries(with real-time trace), connections,...
Inspect data sources activity, cache load processes and content,...
Monitoring and Diagnosing Tool (1)Graphical Monitoring and Diagnosing of Servers and Clusters
Go back in time to the moment where a problem happened
Diagnose root cause of the problem
14
Monitoring and Diagnosing Tool (2)Graphical Monitoring and Diagnosing of Servers and Clusters
Start monitoring a server/environment by double clicking in an item
Diagnostic information about an specific server can be loaded by an option of the right context menu
Environments can be edited or synchronized
15
Monitoring and Diagnosing Tool (and 3)Graphical Monitoring and Diagnosing of Servers and Clusters
State: Summary of the state of the server/environment
Resources: physical resources (memory, cpu,…)
Requests: including real-time execution trace
Session: Currently opened sessions, including client application
Cache: cache load processes, cache contents,...
Datasources: pools state, active requests,...
Threads: priorities, CPU usage,...
Errors: Inspect logged errors and warnings
… and many others
Filter and sort information by any criteria
Main Drivers for Denodo 6.0
Dynamic Query Optimizer for Big Data
Support for new analytical data sources
Support for new analytic functions
New Information Self-Service Tool
New ODBC Driver
Enhancements in Tableau integration
Workload Management: Denodo Resource Manager
Monitoring and Diagnosing Tool
New VDP Admin Tool
GIT Support
Performance in BigData Scenarios
Information Self-service
Enterprise Wide Deployments
Agile Development
Multiple Tabs
MultipleDatabases
New VDP Admin Tool (1)
17
New VDP Admin Tool (2)
Collapsable Work Areas
18
New VDP Admin Tool (3)
19
Customizable Workspace
New VDP Admin Tool (and 4)
20
Syntax Highlighting and Code
Completion
Main Drivers for Denodo 6.0
Dynamic Query Optimizer for Big Data
Support for new analytical data sources
Support for new analytic functions
New Information Self-Service Tool
New ODBC Driver
Enhancements in integration with BI tools
Workload Management: Denodo Resource Manager
Monitoring and Diagnosing Tool
New VDP Admin Tool
GIT Support
Performance in BigData Scenarios
Information Self-service
Enterprise Wide Deployments
Agile Development
22
Information Discovery and Self-Service (1)Graphically Expose Data Views to Business Users
Search and Query Data andMetadata
Browse data associations
Transform and combine views
Publish results to Denodo or your favourite reporting tool
Find more details at: datavirtualization.bloghttp://www.datavirtualizationblog.com/data-exploration-and-self-service-bi-welcome-to-the-dataweb/
23
Information Discovery and Self-Service (2)Browse associations between data views
24
Information Discovery and Self-Service (3)Inspect Data Lineage
25
Information Discovery and Self-Service (4)Search Content in All Views
26
Information Discovery and Self-Service (and 5)Query, Combine and Transform Data Views
Thanks!
www.denodo.com [email protected]
© Copyright Denodo Technologies. All rights reservedUnless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.