Top Banner
Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1
31

Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Jun 10, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux and Linux clusters at IBM

September 13, 2000

David TurekVice President, Deep Computing and Web Servers

IBM

1

Page 2: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Windows NT38%

Linux16%

NetWare 3.x, 4.x, 5.x23%

Combined Unix19%

Other NOS4%

1998 Market Size = 4.4 M Units

Windows NT38%

Linux25%

NetWare 3.x, 4.x, 5.x19%

Combined Unix15%

Other NOS3%

1999 Market Size = 5.5 M Units

* IDC Jan 2000

Why Linux is Important........Customer demand is very high and growing fast

WW Server OperatingSystems Shipments (New Licenses)

1.3M Units - 92% YTY Growth

2

Page 3: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux has established itself in the e-business marketMindshare is strong among software developersSignificant opportunity exists for "value-add"

Conclusions

Applications *Web Servers (45%)Networking (42%)Email/Messaging (38%)Database (28%)File/Print (26%)

* Figures represent % of current Linux install base. Source: IDC Nov. 1999

Where is Linux having an Impact ?

Very high Apache (66%) and Linux (31%)** penetration of web serversMany SMBs & small ISPsAction in autonomous departments; bottoms-upCIOs have discovered they already have Linux

Observations

**Netcraft Web Server Survey, April 2000

3

Page 4: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Web/Intranet Server

Appl Development

Database

E-mail/messaging

Network file/print

Systems mgmt

Network mgmt

**Server Farm

E-commerce server

Thin servers

ERP

Other

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8*Source: Information Week

Where will Linux be having an impact?Server - based use of Linux - Next 12 Months

JAN FEB MAR APR MAY JUN JUL AUG

**Includes HPC Clusters

4

Page 5: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

The Spectrum of Linux

IntelligentNetworking

Supercomputing

PervasiveComputing

5

Page 6: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

What is IBM's Linux Strategy ?

IBM's Linux Focus

Services

Actions

WW Support, Training, Professional and Consulting

Services offerings

Software Key products ported to Linux (DB2, WebSphere,Tivoli, Lotus Domino, VA Java, MQSeries,

etc)

HardwareNetfinity servers, ThinkPad and Intellistation clients (Intel-based)

RS/6000 servers, NUMA-Q and S/390

AlliancesWW Partners with Caldera, Red

Hat, SuSE, & TurboLinux on solution delivery and support

Open Source Significant code contributions and technical resources working with

the open source community6

Page 7: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Open Source & Alliances

Open Source(Community Engaged)

Projects: Networking, File systems (Journalled File System), cluster installation, logical volume manager, glibc/mathlib work, kernel performance, IA-64 port, PPC port, S/390, Linux Standards Base, kernel scalability,print

IBM UNIX Community

Linux Summit II/II: Boeblingen - June, Austin - Nov.External Web site: http://oss.software.ibm.com/developerworks/ opensource/linux

RedhatCaldera

SuSETurboLinux

Four Major Distributions

All 4: Netfinity, Thinkpad, Intellistation supportNetfinity preloads for Caldera, Red Hat,TurboLinux and SuSE Linux for S/390 distribution agreements signed with SuSE and TurboLinuxIGS contracts for Level 3 support - all 4IBM software support contracts in place - all 4Joint marketing agreements in place - all 4

OEM agreements: for WebSphere App Server and VisualAge for Java in all eBuilder products shipped

RedHat.com/marketplace online store opened with IBM h/w and s/w content via ShopIBM links.

Support for RS/6000 including the B50 "pizzazz" in April

OEM Agreement: DB2DB2 w/ TurboLinux DataServer Pro in China

7

Page 8: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

$200 million Linux initiative in each of Europe and Asia Pacific markets including creation of Linux development centers

Centers allow customers and key ISV's to transition their applications to Linux

Support application development on all IBM servers

Centers located in: Paris and Montpellier in France; Greenock and Hursley in the UK; Boeblingen in Germany; Warsaw in Poland; Budapest in Hungary; and in AP -- Tokyo, Shanghai, Beijing, Taipei, Seoul, Bangalore.

Efforts will further the adoption of Linux in Europe and AP

Worldwide Linux Commitment

8

Page 9: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Industry’s first independent, non-profit lab for developers adding enterprise capabilities to Linux

IBM, Hewlett-Packard, Intel, NEC, Caldera, Dell, Linuxcare, LynuxWorks, Red Hat, SGI, SuSE, TurboLinux and VA Linux

Provides Open Source developers with a centralized enterprise development environment for sharing development ideas and innovations

Projects are expected to range from tools development to kernel projects

Initial lab based in Portland, Oregon with 12/00 target open date

Open Source Development Lab Announcement: August 30 2000

9

Page 10: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux represents an important emerging HPC market requirement

"In scientific computing, Linux has proven to be very muscular... government agencies, colleges and companies are using the Beowulf class of clusters running Linux to solve intensive computational needs."

Standish Group, May 2000

Extend leadership in High Performance Computing#1 in Top500 Supercomputer ListWorld's fastest Supercomputer

Linux is an entrenched Internet technology Already #2 reference platform for application development, will be pervasive over timeMore than 3000 HPC applications

Why is IBM doing Linux Clusters?

10

Page 11: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Why is IBM doing Linux Clusters?

Expected future transition from HPC to commercial market embrace

Provides for a sustainable business model over time

Commercial applications are coming, including existing IBM middleware contributions (MQSeries, DB2, Websphere)

Historical proof points from RS/6000 SP program

Scientific & Technical

Decision Support, Data Mining

Internet, e-business, Collaborative Computing

Transaction Processing

Server Consolidation11

Page 12: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Cluster Market Adoption Life Cycle

Number of

Adopters

Time

Early Adopters

Early Majority

Late Majority

Attributes:Attributes:Viewed as innovators by industry Culture of risk takingStrong in-house skills/expertiseIn-house control of applicationsHigher sensitivity to price

Industry examples:Industry examples:Higher educationGovernment & research labs Certain subsets of:

Petroleum & ManufacturingInternet / WebLife sciencesFinance

12

Page 13: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

How we are approaching this marketplace...Select customer engagements with key Partners including Universities, Labs, ISVs

collaboration with IBM to address problems like scaling and performance issues early in product life cycle

explore new technology paths and associations. ex., Vista Azul project

Open Source development partnerships

Develop initial set of Cluster offerings on IA-32, with infusions of IBM and non-IBM hardware and software

Over time, appeal to broader set of industry segments and customers via increased ISV and channel capabilities

13

Page 14: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Announced at LinuxWorld (US) on August 15.

Objectives:

Deliver a set of easy-to-order, pre-configured, validated Linux Cluster offerings on Netfinity (IA-32) hardware of various sizes complete with supporting software, OEM components, and optional IBM services for established competitive prices.

Value Proposition:

For initial solution, primary value to customers is integration and validation, including Systems Assurance review

Follow-on solutions will be based upon software technology leadership -- much of which will come from RS/6000 SP portfolio

IBM Solution Series for Linux Clusters

14

Page 15: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

IBM Solution Series for Linux Clusters (continued)

Solution Series provides a vehicle for customers to quickly and efficiently order and install a Linux cluster

Helps to accelerate industry movement from early adopter to early and late majority stages

Solution Series will expand to POWER and IA-64 architecture based offerings in the future.

Worldwide Announce and delivery plans underway.

15

Page 16: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

IBM Netfinity

IBM Netfinity 4500R rack-optimized servers pre-installed in enterprise racks shipped in configurations of 8, 16, 32 and 64 nodes

OEM Hardware

Myricom's Myrinet Scalable Cluster Interconnect

Extreme Networks' ethernet switchesEquinox terminal servers

IBM Linux Cluster - Package Profile

Hardware Components

16

Page 17: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Software Stack on

CD

Linux Utility for Cluster Installation (LUI)Portland Group compilers for C, C++, Fortran90 with native OpenMPTime-limited version Etnus TotalView multiprocess debugger Portable Batch System (PBS) job scheduler ScaLAPACK math libraries MPICH Samples and benchmarks

Tested with all 4 major Linux Distributions

IBM Linux Cluster - Package Profile

Software Components

17

Page 18: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

IBM Solution Series for Linux clusters Software roadmap

3Q00 1Q01 2Q01 3Q01OSS and ISV Software

Network Install Utility (LUI)Base Remote HW ControlMPICHPBSPortland Group CompilersEtnus Totalview (optional)LAPACK/ScaLAPACK

IBM Software Distributed System Management Server (DSM)-liteGeneral Parallel File System (GPFS)High Availability Topology Services (HATS)High Availability Group Services (HAGS)Resource Monitoring and Control (RMC)

DSM Server

GA Scale 8,16,32,64-node 32-node 64-node 128-node

18

Page 19: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

19

Page 20: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Backup slides follow...

20

Page 21: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

University of New Mexico - "Vista Azul"

Hyper-clusterRS/6000 SP Netfinity Linux Cluster

21

Page 22: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

LinuxLinuxIntegrationIntegration InfrastructureInfrastructure

InnovationInnovation

Toward an open e-business world

22

Page 23: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

IBM's Linux Distribution Partners...

WW partnerships now for hardware, software, services, solutions & marketing IBM strategy is distribution neutral among partners

We partner on individual projects to minimize time-to-market & maximize benefit to mutual customers

Current projects:

Caldera OpenLinux eServer & eBuilderincludes IBM WebSphere App Server

RedHat.com/marketplace open source MarketPlace includes IBM Netfinity, IBM Software offerings

SuSE support for IBM HW (S/390 & RS/6000)reseller agreement for all IBM Software

TurboLinux S/390 partnerDB2 database OEM partner

23

Page 24: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Solutions for specific markets...Enterprise, Dot.com, SMB, Academia

Enterprise Customers - Linux for S/390. Benefits:New Linux applications to S/390 customersEnhanced Quality of Service platform for Linux Inherent cost savings of consolidating Linux server imagesUpgrade existing Linux apps with middleware connections providing near memory speeds to backend data/transactions

IBM ISP Solution Series & Red Hat Linux ProfessionalNefinity 4000R rack mounted server + software installerPreconfigured, Pretested open source applications

plus optional install of DB2 and WebSphere Application Server

IBM Small Business Pack with Netfinity 1000 ServersRadical pricing: Domino, DB2 & WebSphere App Server

$499.00 per server for up to 100 users (user licenses separate)Netfinity 1000 servers starting at $1344.00 or $45/monthPerfect platform for ISVs targeting small business

e-business Technology in Academia program highlighting Linux!

For

TurboLinux & SuSE

4000R

IBM & LotusSoftware

24

Page 25: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Enablement - PlatformsNetFinity

13 models certified with all four distributionsPreloads with 4000R & 100052 ServerProven Apps - testing @ 11 SPCs WW

IntellistationAll 2D models certifiedEnabling 3D models

ThinkpadPreload available Certification on 5 commercial platformsAll NEW models certified at releaseReleasing device specs to leverage internal/external communities

Network StationRed Hat toolkit available on Web for 2800 & 2200

S/390Run Linux native, in LPAR or as VM Guest

Linux distribution partners: SuSE, TurboLinuxIGS Support & servicesIBM M/W: UDB, WebSphere, MQ Series, DB2 connect, CICS gateway, IMS connectISVs: BMC, Software AG

RS/6000Native: technology port underway - productization plans under evaluation

ST&E target (exploit PPC perf)On AIX: Linux API support on AIX. Linux apps exploit AIX QOS.

e-business applications

AS/400 Run native kernel in LPAR

Linux ClustersUofNM cluster (512 processors, Netfinity servers)Initiated open source project for cluster installation

Pre-configured/tested (64-way) clusters

NUMA-Q Run native kernel

In quad initially/NUMA later

25

Page 26: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Enablement - IBM MiddlewareWebSphere

Shipping: WebSphere Application Server (AS) 2.03, Standard Edition on Intel for Caldera & Red Hat Linux( English only). OEM agreement with CalderaWebSphere AS 3.5 or all 4 distributions (English only)In Linux for S/390

MQSeriesMQSeries client Beta release in 1999 remains technology release

LotusShipping: Domino 5.03 on all 4 distributions with DBCS

Tools Support

Shipping: IBM JVM V1.1.8 on all 4 distributions and licensing agreements signed with all 4 to distribute IBM technology.

DB2 UDB

Tivoli

Java Support

Shipping: DB2 V6.1 on all 4 distributions with English and DBCS enablement OEM agreement with TurboDB2 V7.1 announced on all 4 distributions

Shipping: Framework end-point support for Red Hat only

Shipping: VisualAge for JavaTop Page web designer

Shipped: 12,000 IBM Linux Application Developer's Kits YTD. No charge development use only kit with:

DB2 UDB V6.1 WebSphere AS, Std 2.03Lotus Domino 5.02VisualAge for JavaIBM JVM for Linux

26

Page 27: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Enablement - Global Services

Professional Services

Service & Support

Education & TrainingEstablished: core Linux services offerings for Intel Architecture Servers (announced 8/99)

Infrastructure consulting and planningInstallationConfigurationApplication enablement

IGS Linux Strategy team established Developing key solution offerings

e-business solution setclustering solution setASP/ISP solution setDeveloping S/390 consulting skills

Delivered: Courses in 20 countriesCourses delivered in 5 languagesCourses offered: Via classroom and Via web

Available: Worldwide 24x7 Support Line (L1/L2/L3)Linux OS Support added to IGS Support LineEnabled Account Advocate and Advanced Support offerings Enabling Linux 390 support infrastructure

27

Page 28: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Portable &InterchangeableBusiness Logic

Portable &Interchangeable Presentation

Portable & InterchangeableData & Vocabularies

Portable Development & Operating Environment

Next Generation Internet

LinuxFree Standards Group

Java

HTML(Web)

tm XML

Trusted Networking Services

Integrated Standards & Open Source

Portability assured when applications are built using open standard technologies

28

Page 29: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Cluster Market Adoption Life Cycle

Number of

Adopters

Time

Early Early AdoptersAdopters

Attributes:Attributes:Viewed as innovators by industry Culture of risk takingStrong in-house skills/expertiseIn-House control of applicationsHigher sensitivity to price

Industry examples:Industry examples:Higher educationGovernment & research labs Certain subsets of:

Petroleum & ManufacturingInternet / WebLife sciencesFinance

29

Page 30: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Cluster Market Adoption Life Cycle

Number of

Adopters

Time

Early MajorityEarly Majority

Attributes:Attributes:Build bridge between innovators & late majorityEmphasis on standards & re-use potentialDrive ease of useRisk tolerantLooking for competitive advantage/time to marketthrough technology use

30

Page 31: Linux and Linux clusters at IBM€¦ · Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1. Windows NT 38% Linux 16%

Linux Cluster Market Adoption Life Cycle

Number of

Adopters

Time

Late MajorityLate Majority

Attributes:Attributes:Risk averseHigh requirement for availabilityHeavy reliance on ISVs & outside company support, including a willingness to outsourceLess sensitivity to priceStandards are critical

31