InfiniBand® Trade Association & OpenFabrics Alliance December 2013
Jan 15, 2015
InfiniBand Trade Association (IBTA)
Global member organization dedicated to developing, maintaining and furthering the InfiniBand specification Architecture specification – RDMA (Remote Direct Memory Access) software architecture – InfiniBand, up to 56Gb/s and 168Gb/s per port – RDMA over Converged Ethernet (RoCE)
Responsible for compliance and interoperability testing of commercial products
Markets and promotes InfiniBand and RoCE from an industry perspective – Online, marketing and public relations engagements – IBTA-sponsored technical events and resources
OpenFabrics Alliance (OFA)
Home of OpenFabrics Software (OFS) delivering RDMA to performance demanding applications – Delivers support for high performance applications – Support for Linux distributions and Microsoft Windows Server
operating systems
Promoting the benefits of RDMA application acceleration to data center, cloud and HPC users – Server and storage connectivity – High performance, low latency, virtualized, highly efficient
applications
OFA Promoting Developer and User Participation Developers Annual developers’ workshop Birds of a Feather events at International Supercomputing Conference (ISC) and
Supercomputing Conference (SC) Interoperability events at UNH IOL
Users Community-driven events for OFS users
– Sharing experience and ideas – Collaborate over common issues and feed requests into the development community
User community communication tools – Email list for distributing comments, questions, and answers – http://lists.openfabrics.org/cgi-bin/mailman/listinfo/users
Microsoft and Emulex Join the IBTA
Expanding the Steering Committee leadership – Microsoft announcement during SC13 – Emulex announced September 30
Adding their support to RDMA technologies with a strong enterprise perspective
Practical perspective of deploying RDMA for storage, cloud, and other applications
Steering committee members
The Need for RoCEv2
Extending functionality
L3 routing – RoCEv1 delivers RDMA within single
Ethernet L2 domain
– L3 is pervasive in modern datacenters
– Datacenter networks now require RDMA across L3 domains
Further enhancements for scalability
L2 L2 L2
L2 Domain L2 Domain L2 Domain
OpenFramework Work Group
Formed to develop, test, and distribute: – Extensible, open source framework that provides access to high-
performance fabric interfaces and services – Extensible, open source interfaces aligned with ULP and application needs
for high-performance fabric services
Apply application-centric I/O design principles Objectives – Maximize performance for more classes of applications – Maximize the return on investment being made in
computer systems by their owners and operators
HPC & Data Centers Demand RDMA
Essential for Scientific, Enterprise and Cloud Computing I/O is central to achieving highest performance Efficient computing reduces power, cooling and space requirements OS bypass enables fastest access to remote data Scalable storage to meet growing demand Delivers direct access to data over the WAN
Benefits of RDMA Low latency and CPU overhead High network utilization Efficient data transfer Support for message passing, sockets and storage protocols Supported by all major operating systems
OFS and Ethernet
High performance and scalable RDMA over Ethernet with iWARP and RoCE – iWARP adapters deliver up to 40Gb/s with 1.9µs latency
– RoCE adapters deliver up to 40Gb/s with 1.0µs latency
Accelerates applications in an Ethernet infrastructure
– Supports Hadoop, Memcached, databases, LLM, virtualization
– Storage solutions including OpenStorage, MS SMB3
– Direct connections to long distance WAN and Internet links
OFS and InfiniBand
Highest performance, scalability and efficiency for HPC, enterprise, cloud and Web 2.0 networks – Bandwidth up to 56Gb/s
– Latencies less than 1us
– Scales to tens of thousands of nodes
Interconnect of choice for world’s fastest supercomputers
Enables the highest system efficiencies for TOP500 supercomputer clusters
OFS and InfiniBand in the TOP500
48 percent of the world’s most powerful Petaflop capable systems
The highest systems utilization in the TOP500
80% of the accelerator-based systems
*According to November 2013 TOP500 list
InfiniBand Roadmap
Activities at SC13
Thank You