Top Banner
RHCE Loopback Virtual Meetup December 2, 2010
36

RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at [email protected]! Upload

Apr 14, 2018

Download

Documents

buithien
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

RHCE Loopback Virtual Meetup December 2, 2010

Page 2: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

2

Welcome!

Participating from Red Hat today:

Tim Burke, Vice President of Platform Engineering Jan Mark Holzer, Senior Consulting Engineer Gunnar Hellekson, Chief Technology Strategist, Public

Sector Erich Morisse, Solutions Architect Randy Russell, Director of Certification

Agenda

Some quick program updates RHEL 6 Technical Overview Discussion

Page 3: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

3

Events, etc.

San Jose RHCE Loopback Event: December 16

Interested in a Loopback in your area?

Contact us at [email protected]! Upload your video:

http://www.youtube.com/results?search_query=rhceloopback

Page 4: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

4

Changes to the Certification Program

Page 5: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

Red Hat Enterprise Linux 6

Technical OverviewTim Burke

December 2010

Page 6: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

6

Major Themes

Optimized for today's IT

deployments

Scale – PerformanceSecurity – Resource control

Manageability

Virtualization

Host and Guest optimizationCloud Foundation

Green IT

Power Management

Lifecycle

Long term stabilityFuture proof

Page 7: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

7

Facts and Figures

Red Hat Enterprise Linux 6Released November 10th, 2010

First new major release for 3 ½ years

85% more packages thanRed Hat Enterprise Linux 5

Represents more than 600 personyears by Red Hat engineers

14,631: resolved issues from partner,

customer & community reports

1,821 requested features included10,587 completed builds

847 features & fixes verifiedby partner QA teams

37GB of content2,058 SRPMs; 21,957 binary RPMs

3,900 additional kernelenhancements to 2.6.32

Red Hat engineers are basedin 26 countries

Kernel based on 2.6.32 with many features from .33 & .34Red Hat is the lead developer of kernel features

Red Hat Enterprise Linux design allows smooth integration of future features

Page 8: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

8

Red Hat: Leading Development

Documentation,Dev & I18N

Dev, QA & H/WCertification

KernelDevelopment

Middleware

Identity &Authentication

CompilerDevelopment

Virtualization

Middleware

Storage &File Systems

Commands &Utilities Dev & QA

ISV Certification

Page 9: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

9

Performance

Performance enhancements in every component

Component Feature

CPU/Kernel NUMA – Ticketed spinlocks; Completely fair scheduler; Extensive use of Read Copy Update (RCU)

Memory Caching and NUMA enhancementsLarge memory optimizations: Transparent HugePages

Virtualization Large SMP virtual machines: guests with up to 64 CPUsBlock: Async-I/O; Network: Kernel network support

Disk/Network Per LUN flush daemonsMulti-queue Network drivers

Page 10: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

10

Performance: SMP Scalability

1-cpu 4-cpu 8-cpu 16-cpu 32-cpu 64-cpu0

10000

20000

30000

40000

50000

60000

70000

80000

64 CPU Scalability - Stream BenchmarkIntel EX 64-cpu, 128GB, FC

RHEL 6 PhysicalRHEL 6 Virtual

Mem

ory

BW

(M

B/s

ec)

Excellent, linear scalability; minimal virtualization overhead

Note: With this h/w, at 32 CPUs socket bandwidth is saturated64-cpu result is with hyperthreading enabled

Page 11: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

11

Performance: NUMA

1-cpu 8-cpu 16-cpu 32-cpu0

10

20

30

40

50

60

110.0%

115.0%

120.0%

125.0%

RHEL6 Non-Uniform-Memory-Access (NUMA diff w/ Stream Benchmark on Intel EX)

RHEL6 nonumaRHEL6 numa% NUMA

Number of CPUs

Pe

rfo

rma

nce

in G

B/s

ec

NUMA enhancements deliver valuable performance gains

Page 12: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

12

Performance: NUMA Applications

Sybase ASE oltp(k) - 2-socket AMDOracle oltp(k) – 4-socket IntelEX

SAS kjobs/sec 8-socket IntelEX

0

100

200

300

400

500

600

0

0.2

0.4

0.6

0.8

1

1.2

1.4

1.6

1.8

1.131.2

1.54

RHEL6 NUMA Application Performance

NoNUMANUMA%NUMA Gain

App

lica

tion

Pe

rfo

rman

ce

NUMA enhancements deliver valuable performance gains

Page 13: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

13

RHEL5.5 to RHEL6 AMQP TCP/IP msg/sec

10 Gbit Ethernet (Mellanox) 10 Gbit Ethernet (Mellanox)

8 16 32 64 128 256 512 1024 2048

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

RHEL5 vs RHEL6 (preliminary)

Message Rates

RHEL5.5 RHEL6

Message Size (Bytes)

Me

ssa

ge

s / S

eco

nd

Page 14: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

14

Performance: Network

8 16 32 64 128 256 512 1024 20480

200000

400000

600000

800000

1000000

1200000

Comparing RHEL5.5 Infiniband with RHEL6 10Gb with RoCE

RHEL5.5 Infiniband RHEL6 RoCE

Message Size (Bytes)

Mes

sag

es/S

ec

RoCE support is unique to Red Hat(RDMA over Converged Ethernet)

Page 15: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

15

Scalability: CPUs

Page 16: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

16

Scalability: Memory

Page 17: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

17

Scalability: File Systems

Ext4: 16 TB XFS: 100 TB

Page 18: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

18

Green IT

Reduces power consumption at multiple layers in the software stack

Component Feature

Utilities Power audit to reduce power consumption, E.G. convert utilities to event-based algorithms

File System Intelligent drive spin-downFile metadata I/O reduction: relatime mount option

Kernel Tickless kernel enables extended low power states for idle systems

CPU Core/CPU idling in lightly loaded SMP systems; applies for virtual guests

I/O Dynamic power adjustment to PCIe & SATA links via ASPM & ALPM

Page 19: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

19

Green IT: Power Management

RHEL 5.4 RHEL 5.5 RHEL 60

20

40

60

80

100

120

140

160

Idle power consumption (W), measured on Nehalem-EP

Po

wer

co

nsu

mp

tion 20% Reduction

20% Reduction

Page 20: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

20

Green IT: Tools

Enable developers and system administrators to minimize power consumption

Powertop Identifies power hungry applications and system services

Tuned - adaptive tuning daemon Power down idle peripherals Latency policy scripts Provides a variety of power tuning profiles

Documentation to application developers and system administrators on tips and tricks

Page 21: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

21

Red Hat Enterprise Linux 6Red Hat Enterprise Virtualization

Virtualization

Enhancements to make Virtualization ubiquitous

More Consolidation(Kernel Samepage Merging)

Enterprise Application I/O (Direct I/O with SR-IOV)

Double Level Security(KVM & Svirt/SELinux)

Resource Control(with Control Groups)

Leadership Scalability(64 CPUs + 256GB per Guest)

Live Migration(base product feature)

Minimized Overhead(85-95% of physical)

Page 22: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

22

Virtualization

Deliver enhancements to make Virtualization ubiquitous

Performance: Commonly 85%-95% of bare metal, including I/O bound workloads

Scalability: Host: 96 cores; 2 TB RAM Guest: 64 CPUs; 256 GB RAM

Advanced capabilities: Live Migration; CPU/Mem resource control Memory page sharing (KSM); SR-IOV; VT-D; SE-Linux security

Hypervisor integrated into the Linux kernel All features accrue to Red Hat Enterprise Virtualization, which

also provides sophisticated management capabilities

Page 23: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

23

Virtualization: Resource Management

Virt Guest A50% CPU50% Mem

Virt Guest B25% CPU25% Mem

Application Z25% CPU25% Mem

Network40% net 40% net 20% net

60% 20%20% I/O

Storage

Ability to manage large system resources effectively Control Group (Cgroups) for CPU/Memory/Network/Disk Benefit: guarantee Quality of Service Ideal for: Virtualization/Cloud deployments

Page 24: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

24

Virtualization: Svirt Security

Applying security labels to individual guest virtual machines and their resources

Guest Isolation achieved withSELinux Mandatory AccessControls (MAC)

Protect against untrustedGuest VM

Protect against Hostmisconfiguration

Prevents unauthorizedaccess of Guests/Host

Builds on existing, provensecurity mechanisms & controls

Page 25: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

25

Reliability, Availability, Serviceability (RAS)

Enable replacement of high-end RISC/Unix Based on new hardware/software capabilities

Advanced error recovery/reporting CPU and memory hot add Machine Check Architecture

Intelligent recovery from CPU/memory errors Enhanced error reporting for PCI devices (PCI-AER & APEI)

Rapid file system recovery (up to 10x faster than RHEL 5) E.G. Fsck for 1TB filesystem (45 million files): Ext3 = 1 hour, Ext4 =

6 minutes.

DIF/DIX: End-to-end data checksumming

ABRT: Automated bug reporting with “phone home”

Page 26: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

26

Development

Complete, modern, development environment

Red Hat is a technical leader on all these initiatives

Extensive compiler/toolchain: OpenJDK: runtime and open Browser/Web Start plugins Gcc 4.4: OpenMP3 conformance & C++ enhancements Glibc: NUMA/malloc speed enhancements GDB debugger: multithread/process debugging Systemtap: Linux Dtrace for kernel/user/Java Eclipse: CDT for Java, C, C++

Page 27: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

27

Security

Capabilities for new deployment models, virtual servers & clouds

Sandbox: control of applications within an SELinux domain Kiosk: run secure kiosk Live OS with SELinux enforcement XACE: secure independent MLS windows environment SSSD: robust client for LDAP & Kerberos authentication Key Escrow: secure storage & recovery of encryption keys Minimal Install: lowest possible attack surface for core OS Security Standards

NSS: FIPS 140-2 certified cryptographic library SHA256: release management tools meeting FISMA

requirements OpenSwan: RFC 5114 and Cisco VPN compliant

Page 28: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

28

Networking

Enhancements cover multiple interconnects, transmission algorithms, and broad RFC support

Performance optimizations Multi-queue transmit & multi-CPU receive for NUMA scalability RCU SMP locking optimization across networking stack SR-IOV enables a virtual server to saturate a 10GbE link Virt - Raw socket mode – kernel net I/O avoids prior context switch

10GbE Driver support – on card switch and 8-16 pci devices Data Center Bridging (DCB) support

802.1p VLAN tags; 802.1Qaz (grouping); 802.1Qbb (flow control) FCoE (Fibre Channel over Ethernet)

Performance improvements throughout the storage stack RDMA support – over 10GbE (RoCE) & Infiniband

Ideal for low-latency messaging & large packets

Page 29: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

29

Filesystems & Storage

Multiple file systems for different capabilities Ext4: new system default file system - faster, more scalable XFS and GFS: options for very large storage, and clustered

environments NFS 4.0/1: enhanced encryption and IPv6

Storage enhancements for data integrity, SSDs, Virtualization DIF/DIX: data checksumming from HBA <-> disk I/O alignment & size awareness: allows storage access

optimizations Virtual server storage optimizations: SR-IOV, NPIV, VSAN Thin provisioning & Block discard: assist SSD wear leveling Extensive LVM enhancements: online resize; multipathing;

mirroring; snapshots; encryption

Page 30: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

30

Interoperability and Deployment

Installation using Workload Profiles/Personalities

Minimal install option provides minimal security attack surface

SHA256 support for strengthened Red Hat package integrity

Microsoft Interoperability

Client support for Windows2008 R2 active directory

File/Print (Samba) file sharing

Ipv6 & Windows 7 domainsupport

Encryption between client& server

Smart Management Add-onprovides manageability,monitoring and provisioning

Page 31: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

31

Compatibility

Most applications will transfer directly from Red Hat Enterprise Linux 5 to Red Hat Enterprise Linux 6

Compatibility libraries for older Red Hat Enterprise Linux versions are provided for applications that need them

Documentation & white-papers provided to simplify migration: Planning guide Configuration tips for system

administrators Documentation on configuration

file changes Software packaging mapping

across releases Consulting services for planning & executing migration

Page 32: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

32

Desktop

Complete update of desktop application set

Significant advances: Laptop/mobile/wireless

Graphics (KMS, DR12, OpenGL 3D)

Hardware – multi-monitor, dynamicinput devices, bluteooth + 3Gwireless, smartcard

PackageKit – lockdown support, application security levels

MS Exchange 2007/2010 interop (OpenChange & Evolution)

GNOME 2.28 and KDE 4.3.0

Red Hat is the largest contributor to GNOME development

GNOME Contributions

Company Commits %

1 None 101823 23.45

2 Unknown 73558 16.94

3 Red Hat 70790 16.30

4 Novell 45349 10.44

5 Collabora 21684 4.99

6 Intel 11160 2.57

7 Fluendo 10218 2.35

8 Lanedo 10090 2.32

9 Independent 8922 2.05

10 Sun 8862 2.04

...

16 Canonical 4487 1.03Source: Neary ConsultingGNOME Census, August 2010

Page 33: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

33

Product/Support Lifecycle

Designed to allow: Long-term stable deployment No hardware/application re-certification after updates ISV/application ecosystem: stable User/Kernel API/ABIs maintained

for product life Allows ongoing feature updates with continuous stability

7 year core lifecycle; additional 3 years optionally available

Year 1 Year 2 Year 3 Year 4 Year 5 Year 6 Year 7

Production 1(Approximately 4 years)

Production 2(Approximately 1 year)

Production 3(Approximately 2 years)

Year 8 Year 9 Year 10

Optional:Extended Lifecycle Support

(3 years)

Page 34: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

34

Summary

Extensive enhancements covering all dimensionsof an enterprise-class operating system

Benefits for end-users, private & public ITorganizations, developers & hardware suppliers

Delivered by the world's leading developer& supplier of open source solutions

A long-term, stable application environment forphysical, virtual and cloud deployments

An easy-to-configure product packaging model,with high quality services

Red Hat Enterprise Linux 6 provides:

Capabilities that scale from the laptop to SMB,mid-range, enterprise & mainframe deployments

Page 35: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

35

Red Hat Enterprise Linux 6

Red Hat EnterpriseVirtualization

IntegratedVirtualization

3rd PartyVirtualization

JBoss EnterpriseMiddleware

3rd PartyMiddleware

Open SourceApplications

3rd PartyApplications

Virtual GuestOperating Systems

VirtualEnvironments

Physical Infrastructure

Cloud Infrastructure

At the Heart of IT

Page 36: RHCE Loopback Virtual Meetup - Red Hat · 3 Events, etc. San Jose RHCE Loopback Event: December 16 Interested in a Loopback in your area? Contact us at rhceloopback@redhat.com! Upload

THANK YOU!

Questions