Redhat summit b tolleyv7

Copyright © 2012 Solarflare Communications, Slide 1March 20th, 2012

OPEN CLOUD INFRASTRUCTURE BUILT ONRED HAT TECHNOLOGIES

Bruce Tolley, PhD

Optimizing Server I/O For OpenStack: Platform Hardware Choices Matter!

13 June 2013


Network Hardware Choices Matter: KVM Support• Clouds and OpenStack promise the evolution of IT

– Flexibility, automation, scale of compute, storage and networking• Server Virtualization in general enables the commoditization of hardware, use of industry standard servers. The end of vendor lock in(?)• Need hardware support for KVM in the network interface software and hardware (NIC)

– performance to deliver SLAs and QOS with a Cloud• Hypervisor bypass to eliminate bottlenecks

• Plug-in architecture to support both app acceleration and hypervisor services (e.g. migration)


Introducing Solarflare

• High-performance, low-latency 10GbE server adapters

• Power the networks at all the banks and exchanges

• Out of the box support: Red Hat Enterprise Linux with KVM, Red Hat Enterprise Virtualization for Servers and Desktop

• Partner with Arista, Azul, Cisco, Fusion-io, Juniper, Red Hat, Vmware

• OEM with IBM and HP

• Over 700 customers worldwide

• OpenStack Partner


Broad Platform Support for Linux and OpenSource

• High performance, low-latency– < 7uS 1⁄2 RTT UDP latency

• Full integration into Linux kernel• Actively improving Linux networking

– Solarflare is the maintainer of “ethtool”– Linux kernel RFS offload in hardware (w/Google)

• Multiple OpenSource and FreeBSD products• We also do Windows, Vmware, and Solaris


OpenStack and Cloud Computing

• Cloud Networking– Virtualization, democratization, scalability,– Commoditization of infrastructure

• Programmable network features– LANs, IP addresses,VLANs– Security Groups, Role based access control

(RBAC)

• Need network interfaces hardware and software(NICs) to support KVM

• Near Bare metal performance SLAs and QoS over Cloud infrastructure


Slide 6 of 9 | PROPRIETARY AND CONFIDENTIAL

SR-IOV for Virtual Operating Systems (KVM)

Solarflare Hybrid SR-IOV Model

Typical SR-IOV Implementation

Traditional Virtualization (no SR-IOV)

Full hypervisor-based services and management, but poor network performance

Improved performance, but loss of hypervisor-based services and management (eg, live migration)

Improved performance AND full hypervisor-based services and management


2.79 3.365.8

8.1510.1

16.6

9.3

17.4 18.3

9.32

16.8

33.4

0

5

10

15

20

25

30

35

40

I/O

Per

form

ance

(Gbp

s)

Solarflare Hybrid SR-IOV Performance Advantage

No SR-IOV

With SR-IOV

0

5

10

15

20

25

30

35

40

1 VM 4 VMs

No SR-IOV

With SR-IOV

Bare Metal Performance for Guest Applications

Traffic Unidirectional Bi-directional Bi-directional Unidirectional Bi-directional Bi-directional

10GbE ports 1 1 2 1 1 2

* Solarflare test results

• Solarflare scales and delivers near line-rate performance


• Solarflare achieved the three best SPECvirt_sc2010 results for 2, 4, 8 processor configurations

• Industry-leading SPECvirt_sc2010 scores achieved with Red Hat Enterprise Linux (RHEL) using KVM and Solarflare Adapters

Future Proof for the Highest VM DensitySPECvirt Benchmarks

2352 2442

4603 4682

7424

8956

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

10000

RHEL 6.2 (KVM)Intel x520

RHEV 3 (KVM)Solarflare


RHEL 6.1 (KVM)Solarflare


RHEL 6.1 (KVM)Solarflare

2 processors 4 processors 8 processors

Solarflare with SR-IOV delivers record performance with 21% increase!

Comparison based on best performing systems published at www.spec.org as of 25 June 2012. SPEC® and the benchmark SPECvirt_sc® are registered trademarks of the Standard Performance Evaluation Corporation. For more information about SPECvirt_sc2010, see www.spec.org/virt_sc2010/.


Solarflare and Red Hat

• Out-of-Box Accelerated Networking Support for– Red Hat Enterprise Linux with KVM Hypervisor– Red Hat Enterprise Virtualization for Servers and Desktop– Red Hat Enterprise MRG– Red Hat Storage

• Partnerships and Certifications– Red Hat OpenStack– Red Hat Enterprise Linux Certified– Red Hat Ready ISV Partner– Open Virtualization Alliance Member– RHEL and KVM product documentation including

• Red Hat Performance Brief – “Using Solarflare OpenOnload to Achieve Extreme Low Latency on Red Hat Enterprise Linux 6”

• Solarflare Solution Brief – “Unified SR-IOV for Red Hat Linux KVM”

*Based on best performing systems published at www.spec.org as of Dec 6, 2012

http://www.spec.org/


Summary and Conclusions• Clouds and OpenStack promise the evolution of IT

– Flexibility, automation, scale of compute, storage, and networking• Server virtualization in general enables the commoditization of hardware, use of industry standard servers. The end of vendor lock in (?)• Still need hardware support for KVM in the platform and the network interface software and hardware (NIC)

– performance to deliver SLAs and QOS with a Cloud• Hypervisor bypass to eliminate bottlenecks• Plug-in architecture to support both app acceleration and hypervisor services (e.g. VM and storage migration)

Solarflare+Redhat Office of CTO: “Make the NICs Move, Adventures in Performance Tuning”

11:00 am, Friday, Room 304


BACKUP SLIDES


VMVM

NIC

VM VM VM

driver

TCP/IP

driver

TCP/IP

driver

TCP/IP

driver

TCP/IP

driver

TCP/IP

KVM Host

VNICVNICVNICVNICVNICVNIC

PF VF VF VF

VNICVNICVNICVNICVNICVNIC

VNICVNICVNIC

Bridge

Improving KVM Performance & Scalability

• Core scaling enhances performance

– Spreads I/O across all CPU cores

– Improves 10GbE performance scalability

– VM / vNIC core alignment– Mitigates hypervisor becoming

I/O bottleneck

• SR-IOV acceleration– Near native performance– VM direct access to VF / vNIC

• More vNICs & VFs = better scaling across all VMs

– Solarflare = 2048 vNICs

Redhat summit b tolleyv7

Technology

solarflare communications

red hat linux kvm

linux networking solarflare

solarflare openonload

solarflare highperformance

red hat performance

red hatenterprise linux

hardware support