Top Banner
© 2013 ADAPTIVE COMPUTING, INC. 1 Big Workflow Accelerate Insights Unify – Optimize – Guarantee
20

Big Workflow Launch from Adaptive Computing

Jan 17, 2015

Download

Technology

insideHPC

In this slidecast, Rob Clyde from Adaptive Computing describes Big Workflow-- the convergence of Cloud, Big Data, and HPC in enterprise computing.

"The explosion of big data, coupled with the collisions of HPC and cloud, is driving the evolution of big data analytics," said Rob Clyde, CEO of Adaptive Computing. "A Big Workflow approach to big data not only delivers business intelligence more rapidly, accurately and cost effectively, but also provides a distinct competitive advantage. We are confident that Big Workflow will enable enterprises across all industries to leverage big data that inspires game-changing, data-driven decisions."

Learn more: http://bit.ly/bigworkflow
Watch the video presentation: http://wp.me/p3RLHQ-bp2
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.1

Big Workflow

Accelerate InsightsUnify – Optimize – Guarantee

Page 2: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.2 © 2013 ADAPTIVE COMPUTING, INC.2

▪ Experts in scheduling and optimization software for

cloud, big data and HPC

▪ 10+ years battle-tested technology

▪ 50+ patents issued or pending

▪ Backed by top-tier investors:

▪ Global partnerships:

Adaptive Computing Highlights

Partners:

Page 3: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.3 © 2013 ADAPTIVE COMPUTING, INC.

▪ Oil & Gas/Energy▪ Finance, Insurance▪ Manufacturing▪ Government

▪ Research▪ Pharma, Life Sciences,

Bioinformatics, Atmospheric, etc.

Broad Customer Base

Page 4: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.4 © 2013 ADAPTIVE COMPUTING, INC.4

Intelligent Workload Management for HPC

Productivity acceleration

Uptime automation

Auto SLA enforcement

Grid- & Cloud-ready management

SYSTEM • Max utilization 90-99%• Max job throughput• 20%+ lower power

USER• Simple submit/manage• Faster time to results

ADMIN• Reduce management

time/cost/complexity

• Prevent job failures

• Auto-respond to failures

• Reduce missed deadlines

• Reduce support costs

• Auto adjust workload to meet SLAs

• Balance competing priorities

• Share resources fairly

• Auto enforce usage budgets

• More efficiently meet workload demand

• Pay-for-use showback and chargeback

• Extend collaboration• Dynamic resource

provision/re-purpose• Share workload across

wide area grids

Page 5: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.5 © 2013 ADAPTIVE COMPUTING, INC.5

Full Cloud Lifecycle

Optimized Cloud

Agile Service Delivery

Automated Management

Adaptive Services and Resources

Self-service catalog requests

Optimized service placement

Auto provisioning

Showback and chargeback for usage

Reporting and management dashboard

Capacity management optimization

Auto incident responseAuto maintenance and future reservations

Auto power management to reduce costs

Auto VM migration to maintain performance

Auto self-healing

Auto decomissioning

Maximize utilization, reduce costs/complexity

Deliver services fast, efficiently and successfully

Adapt services to meet SLA’s, demand, and changing conditions

Across the Service Lifecycle

Basic Cloud

Page 6: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.6

It’s not just about HPC or cloud for efficiency –

It’s about HPC + Cloud for a purpose: Accelerate Insights

Solving the Big Data Challenge

Page 7: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.77 © 2013 ADAPTIVE COMPUTING, INC.

Traditional IT Cloud▪ Equilibrium/ Uptime ▪ Steady state - run forever▪ Many apps per server▪ Light compute load▪ Light data load▪ No scheduling needed▪ Examples

▪ Email servers▪ Web servers▪ CRM systems

Simulation & Big Data Analysis ▪ Changing needs and load▪ Run until insights▪ Many servers per app▪ Compute intensive▪ Data intensive ▪ Scheduling crucial▪ Examples

▪ Monte Carlo simulations▪ Recommender systems▪ Weather prediction

Traditional IT vs. Big Data

Page 8: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.8 © 2013 ADAPTIVE COMPUTING, INC.8

Leverage Big Data for Data Driven Decisions

Today’s Business Must

Accelerate Insights

To Gain A Competitive Advantage

Page 9: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.9 © 2013 ADAPTIVE COMPUTING, INC.9

What’s the Big Deal About Big Data

Gartner Quotes

In Gartner's 2013 big data study, information and business leaders most often associate the term "opportunity" with “big data”.

Results from the Gartner-Forbes 2012 Board of Directors Survey revealed that 50% of respondents see IT as a way to change the rules of competition in their industry.

Enhanced information use, including big data, is key to enhancing business performance in many industries.

Page 10: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.10 © 2013 ADAPTIVE COMPUTING, INC.10

Challenges in the Data Center

▪ The data center is the logjam ▪ Process intensive data analysis and simulation

▪ Manual▪ Time-consuming▪ Multi step ▪ Complex dependencies ▪ Multi application▪ Under/over used, siloed environments

▪ IT can collect and store data▪ IT struggles to extract results to impact the business

Page 11: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.11 © 2013 ADAPTIVE COMPUTING, INC.11

Eliminate the Logjam

▪ Streamline the workflow ▪ By leveraging

▪ Scheduling and optimization▪ Advanced policies▪ All data center environments - HPC, Cloud and Big Data

▪ Big Data + Workflow = Big Workflow

▪ Eliminate the logjam with Big Workflow

Page 12: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.12 © 2013 ADAPTIVE COMPUTING, INC.12

Big Workflow Accelerates Insights that Inspire Game-Changing, Data-Driven Decision

▪ Unify datacenter resources ▪ As a single, adaptive ecosystem▪ Public and Private Cloud▪ HPC▪ VMs and Bare Metal

▪ Optimize the analysis process▪ Increase throughput and productivity▪ Reduce cost, complexity and errors

▪ Guarantee Service to the business▪ Ensure SLAs▪ Maximize Uptime▪ Prove services were delivered▪ Verify resources were allocated fairly

Page 13: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.13

REALLY BIG DATA DigitalGlobe Case Study

Global Satellite Imagery Provider

Page 14: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.14 © 2013 ADAPTIVE COMPUTING, INC.14

DigitalGlobe –

Page 15: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.15 © 2013 ADAPTIVE COMPUTING, INC.15

DigitalGlobe’s Big Data Challenges

Page 16: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.16 © 2013 ADAPTIVE COMPUTING, INC.16

Big Data Challenges

Page 17: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.17 © 2013 ADAPTIVE COMPUTING, INC.17

Big Data Challenges

Each Year Digital Globe Collects

Page 18: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.18 © 2013 ADAPTIVE COMPUTING, INC.18

Typhoon Haiyan

▪ How can DigitalGlobe Respond <90 mins.?

▪ Moab is at the data center core▪ Breaks down siloes▪ Increases maximum workflow

capacity ▪ Optimizes the analysis process

▪ “Without Moab, DigitalGlobe could not do what we do responsively”

Several hours before Typhoon Haiyan made landfall, DG activated FirstLook. In the first few days, 19,000 square kilometers of imagery, in the hardest hit areas, was collected.

Page 19: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.19 © 2013 ADAPTIVE COMPUTING, INC.19

IDC Agrees

"The most surprising findings of the 2013 study are the substantially increased penetration of co-processors and accelerators at HPC sites around the world, along with the large proportion of sites that are applying Big Data technologies and methods to their problems, and the steady growth in cloud computing for HPC.”

▪ Big Data Growth–$10.9 billion in 2013 –$23.8 billion in 2016

▪ High Performance Data Analysis Report–67% said they perform Big Data analysis on their HPC systems, –30% of the available computing cycles devoted on average to Big Data analysis work

▪ Cloud Computing Report– The sites exploiting cloud computing to address parts of their HPC workloads rose from

13.8% in 2011 to 23.5% in 2013, with public and private cloud use about equally represented

“Two thirds of HPC sites are now performing big data analysis as part of their HPC workloads, as well as an uptick in combined uses of cloud computing and supercomputing. As there is no shortage of big data to analyze and no sign of it slowing down, combined uses of cloud and HPC will occur with greater frequency, creating market opportunities for solutions such as Adaptive’s Big Workflow.”

October 21032013 Worldwide HPC End User Study

Page 20: Big Workflow Launch from Adaptive Computing

© 2013 ADAPTIVE COMPUTING, INC.20

BIG WORKFLOWIt’s not just about HPC or cloud for efficiency

It’s about HPC + Cloud for a purpose:

Accelerate Insights