Linux and Linux clusters at IBM September 13, 2000 David Turek Vice President, Deep Computing and Web Servers IBM 1
Linux and Linux clusters at IBM
September 13, 2000
David TurekVice President, Deep Computing and Web Servers
IBM
1
Windows NT38%
Linux16%
NetWare 3.x, 4.x, 5.x23%
Combined Unix19%
Other NOS4%
1998 Market Size = 4.4 M Units
Windows NT38%
Linux25%
NetWare 3.x, 4.x, 5.x19%
Combined Unix15%
Other NOS3%
1999 Market Size = 5.5 M Units
* IDC Jan 2000
Why Linux is Important........Customer demand is very high and growing fast
WW Server OperatingSystems Shipments (New Licenses)
1.3M Units - 92% YTY Growth
2
Linux has established itself in the e-business marketMindshare is strong among software developersSignificant opportunity exists for "value-add"
Conclusions
Applications *Web Servers (45%)Networking (42%)Email/Messaging (38%)Database (28%)File/Print (26%)
* Figures represent % of current Linux install base. Source: IDC Nov. 1999
Where is Linux having an Impact ?
Very high Apache (66%) and Linux (31%)** penetration of web serversMany SMBs & small ISPsAction in autonomous departments; bottoms-upCIOs have discovered they already have Linux
Observations
**Netcraft Web Server Survey, April 2000
3
Web/Intranet Server
Appl Development
Database
E-mail/messaging
Network file/print
Systems mgmt
Network mgmt
**Server Farm
E-commerce server
Thin servers
ERP
Other
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8*Source: Information Week
Where will Linux be having an impact?Server - based use of Linux - Next 12 Months
JAN FEB MAR APR MAY JUN JUL AUG
**Includes HPC Clusters
4
The Spectrum of Linux
IntelligentNetworking
Supercomputing
PervasiveComputing
5
What is IBM's Linux Strategy ?
IBM's Linux Focus
Services
Actions
WW Support, Training, Professional and Consulting
Services offerings
Software Key products ported to Linux (DB2, WebSphere,Tivoli, Lotus Domino, VA Java, MQSeries,
etc)
HardwareNetfinity servers, ThinkPad and Intellistation clients (Intel-based)
RS/6000 servers, NUMA-Q and S/390
AlliancesWW Partners with Caldera, Red
Hat, SuSE, & TurboLinux on solution delivery and support
Open Source Significant code contributions and technical resources working with
the open source community6
Open Source & Alliances
Open Source(Community Engaged)
Projects: Networking, File systems (Journalled File System), cluster installation, logical volume manager, glibc/mathlib work, kernel performance, IA-64 port, PPC port, S/390, Linux Standards Base, kernel scalability,print
IBM UNIX Community
Linux Summit II/II: Boeblingen - June, Austin - Nov.External Web site: http://oss.software.ibm.com/developerworks/ opensource/linux
RedhatCaldera
SuSETurboLinux
Four Major Distributions
All 4: Netfinity, Thinkpad, Intellistation supportNetfinity preloads for Caldera, Red Hat,TurboLinux and SuSE Linux for S/390 distribution agreements signed with SuSE and TurboLinuxIGS contracts for Level 3 support - all 4IBM software support contracts in place - all 4Joint marketing agreements in place - all 4
OEM agreements: for WebSphere App Server and VisualAge for Java in all eBuilder products shipped
RedHat.com/marketplace online store opened with IBM h/w and s/w content via ShopIBM links.
Support for RS/6000 including the B50 "pizzazz" in April
OEM Agreement: DB2DB2 w/ TurboLinux DataServer Pro in China
7
$200 million Linux initiative in each of Europe and Asia Pacific markets including creation of Linux development centers
Centers allow customers and key ISV's to transition their applications to Linux
Support application development on all IBM servers
Centers located in: Paris and Montpellier in France; Greenock and Hursley in the UK; Boeblingen in Germany; Warsaw in Poland; Budapest in Hungary; and in AP -- Tokyo, Shanghai, Beijing, Taipei, Seoul, Bangalore.
Efforts will further the adoption of Linux in Europe and AP
Worldwide Linux Commitment
8
Industry’s first independent, non-profit lab for developers adding enterprise capabilities to Linux
IBM, Hewlett-Packard, Intel, NEC, Caldera, Dell, Linuxcare, LynuxWorks, Red Hat, SGI, SuSE, TurboLinux and VA Linux
Provides Open Source developers with a centralized enterprise development environment for sharing development ideas and innovations
Projects are expected to range from tools development to kernel projects
Initial lab based in Portland, Oregon with 12/00 target open date
Open Source Development Lab Announcement: August 30 2000
9
Linux represents an important emerging HPC market requirement
"In scientific computing, Linux has proven to be very muscular... government agencies, colleges and companies are using the Beowulf class of clusters running Linux to solve intensive computational needs."
Standish Group, May 2000
Extend leadership in High Performance Computing#1 in Top500 Supercomputer ListWorld's fastest Supercomputer
Linux is an entrenched Internet technology Already #2 reference platform for application development, will be pervasive over timeMore than 3000 HPC applications
Why is IBM doing Linux Clusters?
10
Why is IBM doing Linux Clusters?
Expected future transition from HPC to commercial market embrace
Provides for a sustainable business model over time
Commercial applications are coming, including existing IBM middleware contributions (MQSeries, DB2, Websphere)
Historical proof points from RS/6000 SP program
Scientific & Technical
Decision Support, Data Mining
Internet, e-business, Collaborative Computing
Transaction Processing
Server Consolidation11
Linux Cluster Market Adoption Life Cycle
Number of
Adopters
Time
Early Adopters
Early Majority
Late Majority
Attributes:Attributes:Viewed as innovators by industry Culture of risk takingStrong in-house skills/expertiseIn-house control of applicationsHigher sensitivity to price
Industry examples:Industry examples:Higher educationGovernment & research labs Certain subsets of:
Petroleum & ManufacturingInternet / WebLife sciencesFinance
12
How we are approaching this marketplace...Select customer engagements with key Partners including Universities, Labs, ISVs
collaboration with IBM to address problems like scaling and performance issues early in product life cycle
explore new technology paths and associations. ex., Vista Azul project
Open Source development partnerships
Develop initial set of Cluster offerings on IA-32, with infusions of IBM and non-IBM hardware and software
Over time, appeal to broader set of industry segments and customers via increased ISV and channel capabilities
13
Announced at LinuxWorld (US) on August 15.
Objectives:
Deliver a set of easy-to-order, pre-configured, validated Linux Cluster offerings on Netfinity (IA-32) hardware of various sizes complete with supporting software, OEM components, and optional IBM services for established competitive prices.
Value Proposition:
For initial solution, primary value to customers is integration and validation, including Systems Assurance review
Follow-on solutions will be based upon software technology leadership -- much of which will come from RS/6000 SP portfolio
IBM Solution Series for Linux Clusters
14
IBM Solution Series for Linux Clusters (continued)
Solution Series provides a vehicle for customers to quickly and efficiently order and install a Linux cluster
Helps to accelerate industry movement from early adopter to early and late majority stages
Solution Series will expand to POWER and IA-64 architecture based offerings in the future.
Worldwide Announce and delivery plans underway.
15
IBM Netfinity
IBM Netfinity 4500R rack-optimized servers pre-installed in enterprise racks shipped in configurations of 8, 16, 32 and 64 nodes
OEM Hardware
Myricom's Myrinet Scalable Cluster Interconnect
Extreme Networks' ethernet switchesEquinox terminal servers
IBM Linux Cluster - Package Profile
Hardware Components
16
Software Stack on
CD
Linux Utility for Cluster Installation (LUI)Portland Group compilers for C, C++, Fortran90 with native OpenMPTime-limited version Etnus TotalView multiprocess debugger Portable Batch System (PBS) job scheduler ScaLAPACK math libraries MPICH Samples and benchmarks
Tested with all 4 major Linux Distributions
IBM Linux Cluster - Package Profile
Software Components
17
IBM Solution Series for Linux clusters Software roadmap
3Q00 1Q01 2Q01 3Q01OSS and ISV Software
Network Install Utility (LUI)Base Remote HW ControlMPICHPBSPortland Group CompilersEtnus Totalview (optional)LAPACK/ScaLAPACK
IBM Software Distributed System Management Server (DSM)-liteGeneral Parallel File System (GPFS)High Availability Topology Services (HATS)High Availability Group Services (HAGS)Resource Monitoring and Control (RMC)
DSM Server
GA Scale 8,16,32,64-node 32-node 64-node 128-node
18
19
Backup slides follow...
20
University of New Mexico - "Vista Azul"
Hyper-clusterRS/6000 SP Netfinity Linux Cluster
21
LinuxLinuxIntegrationIntegration InfrastructureInfrastructure
InnovationInnovation
Toward an open e-business world
22
IBM's Linux Distribution Partners...
WW partnerships now for hardware, software, services, solutions & marketing IBM strategy is distribution neutral among partners
We partner on individual projects to minimize time-to-market & maximize benefit to mutual customers
Current projects:
Caldera OpenLinux eServer & eBuilderincludes IBM WebSphere App Server
RedHat.com/marketplace open source MarketPlace includes IBM Netfinity, IBM Software offerings
SuSE support for IBM HW (S/390 & RS/6000)reseller agreement for all IBM Software
TurboLinux S/390 partnerDB2 database OEM partner
23
Linux Solutions for specific markets...Enterprise, Dot.com, SMB, Academia
Enterprise Customers - Linux for S/390. Benefits:New Linux applications to S/390 customersEnhanced Quality of Service platform for Linux Inherent cost savings of consolidating Linux server imagesUpgrade existing Linux apps with middleware connections providing near memory speeds to backend data/transactions
IBM ISP Solution Series & Red Hat Linux ProfessionalNefinity 4000R rack mounted server + software installerPreconfigured, Pretested open source applications
plus optional install of DB2 and WebSphere Application Server
IBM Small Business Pack with Netfinity 1000 ServersRadical pricing: Domino, DB2 & WebSphere App Server
$499.00 per server for up to 100 users (user licenses separate)Netfinity 1000 servers starting at $1344.00 or $45/monthPerfect platform for ISVs targeting small business
e-business Technology in Academia program highlighting Linux!
For
TurboLinux & SuSE
4000R
IBM & LotusSoftware
24
Linux Enablement - PlatformsNetFinity
13 models certified with all four distributionsPreloads with 4000R & 100052 ServerProven Apps - testing @ 11 SPCs WW
IntellistationAll 2D models certifiedEnabling 3D models
ThinkpadPreload available Certification on 5 commercial platformsAll NEW models certified at releaseReleasing device specs to leverage internal/external communities
Network StationRed Hat toolkit available on Web for 2800 & 2200
S/390Run Linux native, in LPAR or as VM Guest
Linux distribution partners: SuSE, TurboLinuxIGS Support & servicesIBM M/W: UDB, WebSphere, MQ Series, DB2 connect, CICS gateway, IMS connectISVs: BMC, Software AG
RS/6000Native: technology port underway - productization plans under evaluation
ST&E target (exploit PPC perf)On AIX: Linux API support on AIX. Linux apps exploit AIX QOS.
e-business applications
AS/400 Run native kernel in LPAR
Linux ClustersUofNM cluster (512 processors, Netfinity servers)Initiated open source project for cluster installation
Pre-configured/tested (64-way) clusters
NUMA-Q Run native kernel
In quad initially/NUMA later
25
Linux Enablement - IBM MiddlewareWebSphere
Shipping: WebSphere Application Server (AS) 2.03, Standard Edition on Intel for Caldera & Red Hat Linux( English only). OEM agreement with CalderaWebSphere AS 3.5 or all 4 distributions (English only)In Linux for S/390
MQSeriesMQSeries client Beta release in 1999 remains technology release
LotusShipping: Domino 5.03 on all 4 distributions with DBCS
Tools Support
Shipping: IBM JVM V1.1.8 on all 4 distributions and licensing agreements signed with all 4 to distribute IBM technology.
DB2 UDB
Tivoli
Java Support
Shipping: DB2 V6.1 on all 4 distributions with English and DBCS enablement OEM agreement with TurboDB2 V7.1 announced on all 4 distributions
Shipping: Framework end-point support for Red Hat only
Shipping: VisualAge for JavaTop Page web designer
Shipped: 12,000 IBM Linux Application Developer's Kits YTD. No charge development use only kit with:
DB2 UDB V6.1 WebSphere AS, Std 2.03Lotus Domino 5.02VisualAge for JavaIBM JVM for Linux
26
Linux Enablement - Global Services
Professional Services
Service & Support
Education & TrainingEstablished: core Linux services offerings for Intel Architecture Servers (announced 8/99)
Infrastructure consulting and planningInstallationConfigurationApplication enablement
IGS Linux Strategy team established Developing key solution offerings
e-business solution setclustering solution setASP/ISP solution setDeveloping S/390 consulting skills
Delivered: Courses in 20 countriesCourses delivered in 5 languagesCourses offered: Via classroom and Via web
Available: Worldwide 24x7 Support Line (L1/L2/L3)Linux OS Support added to IGS Support LineEnabled Account Advocate and Advanced Support offerings Enabling Linux 390 support infrastructure
27
Portable &InterchangeableBusiness Logic
Portable &Interchangeable Presentation
Portable & InterchangeableData & Vocabularies
Portable Development & Operating Environment
Next Generation Internet
LinuxFree Standards Group
Java
HTML(Web)
tm XML
Trusted Networking Services
Integrated Standards & Open Source
Portability assured when applications are built using open standard technologies
28
Linux Cluster Market Adoption Life Cycle
Number of
Adopters
Time
Early Early AdoptersAdopters
Attributes:Attributes:Viewed as innovators by industry Culture of risk takingStrong in-house skills/expertiseIn-House control of applicationsHigher sensitivity to price
Industry examples:Industry examples:Higher educationGovernment & research labs Certain subsets of:
Petroleum & ManufacturingInternet / WebLife sciencesFinance
29
Linux Cluster Market Adoption Life Cycle
Number of
Adopters
Time
Early MajorityEarly Majority
Attributes:Attributes:Build bridge between innovators & late majorityEmphasis on standards & re-use potentialDrive ease of useRisk tolerantLooking for competitive advantage/time to marketthrough technology use
30
Linux Cluster Market Adoption Life Cycle
Number of
Adopters
Time
Late MajorityLate Majority
Attributes:Attributes:Risk averseHigh requirement for availabilityHeavy reliance on ISVs & outside company support, including a willingness to outsourceLess sensitivity to priceStandards are critical
31