WSV207. Cluster Public Cloud Servers On-Premises Servers Desktop Workstations Application Logic.

wsv207_Introducing Windows HPC Server

Introducing Windows HPC ServerDavid ChappellPrincipalChappell & AssociatesWSV2075/19/2011 6:18 PM 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

1AgendaCluster Computing with Windows HPC Server: The Basics

Using Windows HPC Server: Application Types

The Technology of Windows HPC Server: A Closer Look2 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.5/19/2011Cluster Computing with Windows HPC Server: The Basics5/19/2011 6:18 PM 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3Whats the Problem?Some applications run too slowly on a single computerSplitting them up into chunks, then running those chunks in parallel on multiple computers can speed them up

Doing this effectively requires creating a compute cluster, with:Tools to create and manage the clusterA scheduler for running applications on the clusterMore . . .4 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.5/19/2011What is a Cluster?A modern viewA cluster is a group of machines that act in a unified way to run parallel applications

A modern cluster can contain three types of nodes:Servers running on-premises Desktop workstations running on-premises Servers running in a public cloud5 2008 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.5/19/2011Cluster

Public Cloud Servers

On-PremisesServersRunning a Parallel Application on a ClusterAn illustrationDesktopWorkstations

ApplicationLogicLogicLogicLogicLogic6What is Windows HPC Server?Windows HPC Server is a version of Windows Server that includes technology for creating, using, and managing a compute clusterThis talk describes Windows HPC Server 2008 R2 SP2, available in mid-2011

A Windows HPC cluster includes:A head node running on-premisesSome number of compute nodes running on-premises and/or on Windows Azure

Head NodeWindows HPCServerWindows HPC Application

Windows AzureWindows HPC Server

Windows 7Compute NodesA Windows HPC Application on a ClusterClientCluster ManagementLogicLogicLogicJob Scheduling8Using Windows HPC Server: Application Types5/19/2011 6:18 PM 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9Using Windows HPC ServerFour types of applications (jobs)MPI applications

Embarrassingly parallel applications

Excel applications

Big data applicationsMPI ApplicationsBasicsComponents in the job interact with each other while the job runsUsing the Message Passing Interface (MPI)Commonly rely on high-bandwidth networks

What theyre used for:Simulations: car crashes, nuclear reactions, building materialsTypically with packaged applicationsA common goal is to learn how something behaves in the real world without physically creating and testing itMPI JobLogicLogicLogicLogicLogicLogicLogicLogicLogicMPI ApplicationsAn illustration1) Submit job2) Get resultsClient12Embarrassingly Parallel ApplicationsBasicsComponents in the job do not interact with each other while the job runsTwo categories:Parametric sweep jobs: run independent EXEs on each compute nodeSOA jobs: run WCF services on each compute node

What theyre used for:Financial services, such as pricing a bondTypically with custom applicationsA common goal is to explore many possible futures, then use the results to predict a likely outcomeEmbarrassingly Parallel JobEmbarrassingly Parallel ApplicationsAn illustrationLogicLogicLogicLogicLogicLogicLogicLogicLogic1) Submit job2) (Optionally) Interact with applicationClient3) Get results14Excel ApplicationsBasicsOptions:Run Excel 2010 on each node in the clusterRun the logic of an Excel user-defined function (UDF) on the clusterUse Excel as the client for a SOA job

What theyre used for:Offloading Excel calculations onto a cluster for better performanceExcel ApplicationsAn illustration1) Submit workbook2) Get results

ExcelWorkbookExcelWorkbookExcelWorkbookExcelWorkbookExcelWorkbookExcelWorkbookExcelWorkbookExcelWorkbookExcelWorkbookExcel16Big Data ApplicationsBasicsThe goal is to use many disk drives in parallel to rapidly read large amounts of unstructured dataBig data applications are I/O bound, not CPU boundWindows HPC Server provides LINQ to HPC for thisFormerly code-named Dryad

What theyre used for:Examining large amounts of log data, e.g., from a Web farmCorrelating ad spend with trafficCreating search engine indexesMore . . .LINQ to HPC JobBig Data ApplicationsAn illustration1) Submit job2) Get resultsDataDataDataLogicLogicLogicDataDataDataLogicLogicLogicDataLogicDataLogicDataLogicLINQ to HPC Client18The Technology of Windows HPC Server: A Closer Look5/19/2011 6:18 PM 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19

Compute Nodes

Head NodeManaging a ClusterWhat Windows HPC Server providesClientHPC Management ServiceHPC Management ServiceHPC Management ServiceHPC Cluster Manager20HPC Cluster ManagerFive viewsConfiguration: Setting up the network for a cluster, adding users, etc.Node Management: Adding and removing nodes, monitoring the status of a clusters nodesJob Management: Submitting, monitoring, and managing cluster applicationsDiagnostics: Running diagnostic tests on one or more nodes in the clusterCharts and Reports: Providing information about the clusters behaviorHPC Cluster ManagerNode Management view: List

List of nodes in the clusterView selectionDetails about a particular nodeHPC Cluster ManagerNode Management view: Heat map

Each square represents a compute nodeEach color shows a performance counter value

Windows HPC JobHPC Job Scheduler

Head NodeCompute NodesRunning a JobIllustrating the processClient

1) Submit job2) Place job in queue4) Monitor jobLogicNodeManagerLogicNodeManagerJobManager Console3) Select and run jobJob Queue24Running a JobOptionsJobs can be submitted in many ways:Command line, PowerShell, .NET API, browser, etc.

The HPC Job Scheduler implements two scheduling options:Queued: Runs jobs in first-come, first-served fashionAlthough higher-priority jobs can displace lower-priority jobsBalanced: Gives as manyqueued jobs as possible the minimum resources they requireAny remaining resources are then allocated to higher-priority jobs Running a JobMonitoring job progress

List of jobs currently running on the clusterAnother option for submitting new jobsDetails about a particular jobSOA Job

Head NodeCompute NodesRunning a SOA JobA closer lookClient

2) Schedule and start job3) Hand off job to broker nodeHPC Job Scheduler4) Connect client with broker nodeWCF ServiceWCF Service6) Pass requests toservices

Broker NodeRequest QueueClient7) Return results1) Submit job5) Submit requests27Supporting Big DataLINQ to HPC applications are the newest option in Windows HPC ServerThe technology first shipped in Windows HPC Server 2008 R2 SP2

Challenges:Storing big data: Addressed by the Distributed Storage Catalog (DSC)Writing applications that process big data: Addressed by LINQ to HPCDistributed Storage Catalog DSC File Set

HeadNodeCompute Nodes

Supporting Big DataIllustrating the DSCDSC FileDSC FileDSC File29LINQ to HPC JobLINQ to HPC Client

Compute Nodes

DSC File SetDataDataDataSupporting Big DataData locality in LINQ to HPC jobsLogicLogicLogic30

DSCFileDSCFileLINQ to HPC Job

Distributed Storage CatalogHPC Job SchedulerClusterOn-Premises Servers

Head NodeClient2) Schedule and start job3) Find DSC files in input DSC file setSupporting Big DataRunning a LINQ to HPC job4) Start and run jobs logicLogicLogicLINQ toHPC Client1) Execute LINQ to HPC query and submit job31

Cluster Computing on WindowsThe evolution of Windows HPC Server

Kinds of Compute NodesKinds of Applications2006MPI jobsOn-premises servers2008MPI jobs, SOA jobsOn-premises servers2011MPI jobs, SOA jobs, Excel, Big dataOn-premises servers, desktop workstations, cloud instances2010MPI jobs, SOA jobs, ExcelOn-premises servers, desktop workstations32About the SpeakerDavid Chappell is Principal of Chappell & Associates (www.davidchappell.com) in San Francisco, California. Through his speaking, writing, and consulting, he helps people around the world understand, use, and make better decisions about new technology. David has been the keynote speaker for more than a hundred events and conferences on five continents, and his seminars have been attended by tens of thousands of IT decision makers, architects, and developers in forty countries. His books have been published in a dozen languages and used regularly in courses at MIT, ETH Zurich, and other universities. In his consulting practice, he has helped clients such as Hewlett-Packard, IBM, Microsoft, Stanford University, and Target Corporation adopt new technologies, market new products, train their sales staffs, and create business plans. Earlier in his career, David wrote networking software, chaired a U.S. national standards working group, and played keyboards with the Peabody-award-winning Childrens Radio Theater. He holds a B.S. in Economics and an M.S. in Computer Science, both from the University of Wisconsin-Madison.

33Track ResourcesDont forget to visit the Cloud Power area within the TLC (Blue Section) to see product demos and speak with experts about the Server & Cloud Platform solutions that help drive your business forward.You can also find the latest information about our products at the following links: Windows Azure - http://www.microsoft.com/windowsazure/Microsoft System Center - http://www.microsoft.com/systemcenter/Microsoft Forefront - http://www.microsoft.com/forefront/Windows Server - http://www.microsoft.com/windowsserver/ Cloud Power - http://www.microsoft.com/cloud/ Private Cloud - http://www.microsoft.com/privatecloud/ 34Tech Ed North America 20105/19/2011 6:18 PM 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Resourceswww.microsoft.com/techedSessions On-Demand & Community

Microsoft Certification & Training ResourcesResources for IT ProfessionalsResources for Developerswww.microsoft.com/learning http://microsoft.com/technet http://microsoft.com/msdn

Learninghttp://northamerica.msteched.comConnect. Share. Discuss.

35Tech Ed North America 20105/19/2011 6:18 PM 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Complete an evaluation on CommNet and enter to win!

36Tech Ed North America 20105/19/2011 6:18 PM 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Scan the Tag to evaluate this session now on myTechEd Mobile37Tech Ed North America 20105/19/2011 6:18 PM 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

38