Solaris 10 - uibk.ac.attf/lehre/ss07/bs/vorlesungen/Solaris Vortrag... · Sun Microsystems GesmbH Wienerbergstrasse 3/VII A- 1101 Wien Solaris 10 DI Gerald Hartl Account Manager for

Sun Microsystems GesmbH Wienerbergstrasse 3/VII A- 1101 Wien

Solaris 10

DI Gerald HartlAccount Manager for Education and Research

Agenda

• Short Solaris 10 Overview

• Introduction to Solaris Internals

• Memory

• File System

• Q&A

Short Solaris 10 Overview

• 1982 - Sun Microsystems Inc.

• 1984 - SunOS 1.0FFS from 4.2 BSD

Solaris 10

Solaris 10 InnovationsOverview

... and over 600 projecets

HighestAvailability

withPredictive

Self Healing

MaximumSecuritybased on

Trusted Solaris

OptimalMonitoring

withDTrace

Secure andEffective

Consolidationwith

SolarisContainern

ExtremePerformance

Solaris 10Same Ideas about Consolidation

Container 1:Web-Server

Container 2:App-Server

Container 3:Database

Memory PCI-E I/O

134GB/s Interconnect

Cor

e #1

Cor

e #2

Cor

e #3

L2 Cache

Cor

e #4

Cor

e #5

Cor

e #6

Cor

e #7

Cor

e #8

Container and Ultra/OpenSPARC T1Blade Shelf on a Chip

• Network consolidation on chip> Higher performance (chip bandwidth)

• Container can be assignedto cores> Optimize Resource

utilization

• Sandbox for application

Container 1:Web-Server

Container 2:App-Server

Container 3:Database

Memory PCI-E I/O

134GB/s Interconnect

Cor

e #1

Cor

e #2

Cor

e #3

L2 Cache

Cor

e #4

Cor

e #5

Cor

e #6

Cor

e #7

Cor

e #8

OS Virtualisation Trends

• More OS instances

> More administratin required

• Strong seperation

• Higher costs (HW or license)

More Flexibility

Stronger Seperation

Hardware Partitions Virtual Machines OS Virtualisation Resource Management

Dynamic SystemDomains

Solaris Container(Zones + SRM)

Solaris ResourceManager (SRM) VMware

Hardware Consolidation OS Consolidation

• Only one OS instance

> Simple administration

• Less seperation (HW)

• More flexibility

• Extreme reliability> No data without checksums> Selfhealing datastore

• Simple administration> Single line instead of scripts> Includes Volume Manager

• Highest capacity> 128bit filesystem

• High performance

• Add ons modules available

ZFS: The Ultimate Filesystem

The ZFS Idea

• Volume Manager andFilesystem> Reduce complexity> Simple administration> Increase resource utilization

• Innovative architecture> No filesystem check required> Mirroring, Snapshot, RAID-Z,

compression, ...

• Solaris 10U3

Server

ZFS

1

ZFS

2

ZFS

3

ZFS

4

ZFS Storage Pool

c0t0d0 c0t0d1 c0t2d0

Example Filesystem

/home/bob

c0t0d0 c0t1d0RAID1

/home/ann /home/sue

In the Past# format... (long interactive session omitted)

# metadb -a -f disk1:slice0 disk2:slice0

# metainit d10 1 1 disk1:slice1d10: Concat/Stripe is setup# metainit d11 1 1 disk2:slice1d11: Concat/Stripe is setup# metainit d20 -m d10d20: Mirror is setup# metattach d20 d11d20: submirror d11 is attached



# newfs /dev/md/rdsk/d20newfs: construct a new file system /dev/md/rdsk/d20: (y/n)? y... (many pages of 'superblock backup' output omitted)# mount /dev/md/dsk/d20 /export/home/ann# vi /etc/vfstab ... while in 'vi', type this exactly:/dev/md/dsk/d20 /dev/md/rdsk/d20 /export/home/ann ufs 2 yes -

# newfs /dev/md/rdsk/d21newfs: construct a new file system /dev/md/rdsk/d21: (y/n)? y... (many pages of 'superblock backup' output omitted)# mount /dev/md/dsk/d21 /export/home/ann# vi /etc/vfstab ... while in 'vi', type this exactly:/dev/md/dsk/d21 /dev/md/rdsk/d21 /export/home/bob ufs 2 yes -

# newfs /dev/md/rdsk/d22newfs: construct a new file system /dev/md/rdsk/d22: (y/n)? y... (many pages of 'superblock backup' output omitted)# mount /dev/md/dsk/d22 /export/home/sue# vi /etc/vfstab ... while in 'vi', type this exactly:/dev/md/dsk/d22 /dev/md/rdsk/d22 /export/home/sue ufs 2 yes -

# format... (long interactive session omitted)# metattach d12 disk3:slice1d12: component is attached# metattach d13 disk4:slice1d13: component is attached# metattach d21# growfs -M /export/home/bob /dev/md/rdsk/d21/dev/md/rdsk/d21:... (many pages of 'superblock backup' output omitted)

With ZFS

• Create a storage pool named “home”# zpool create home mirror c0t0d0 c0t1d0

• Create a filesysteme for “ann”, “bob” and “sue”# zfs create home/ann# zfs create home/bob# zfs create home/sue

• Add new disk to pool# zpool add home mirror c1t0d0 c1t1d0

http://www.opensolaris.org/os/ http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src

Introduction to Solaris Internals

Solaris Kernel Architecture

Source: Solaris Internals, page 15

Solaris Kernel Architecture

• System call interface

• Process execution and scheduling

• Memory management

• Resource management

• File systems

• I/O bus and device management

• Kernel facilities (clock, timers, ...)

• Networking


Global Thread Priorities


Lightweight Process (LWP)The kernel visible execution context for a user thread

Global Thread Priorities


Solaris Resource Management


Zones in Solaris


Components of a Process


Core Process Componentsusr/src/uts/common/sys/proc.h


• Address space• Credentials (UID, GID)• Process links• CPU utilization• Signals• Threads• Microstate accounting• User area (uarea)• Procfs• Resource management

Process Structures


Thread Statesusr/src/uts/common/sys/thread.h


Processor Abstractions


Processor Abstractions

• CPU partitions

• Processor sets

• Resource pools

• Locality groups (lgroups, MPO)Solaris 9, Memory Placement Optimization


Memory

Virtual to Physical Memory Management


Solaris Virtual Memory Layers


Virtual Address Spaces

• Executable textbinary, read only with execute permissions

• Executable datamapped read/write/private

• Heap spacememory allocated by malloc()

• Process stackanonymous memory and is mapped read/write


Virtual Address Spaces


Address Space Layout - UltraSPARC


Address Space Layout - x86 & x64


The Stack

Solaris Version Maximum Heap Size Notes

Solaris x86 32bit mode 2GBytes by default

Boot option kernel basecan be moved to allowlarger process addressspace

Solaris x64 64bit mode 16EBytes Virtually unlimited

SPARC 64bit mode 16TBytes on UltraSPARC I/II16EBytes Virtually unlimited


Memory Mapped Files


Tracing the VM System

sol10# ./vm.d <pid>sol10# more vm.d

:::BEGIN{ start = timestamp;}

syscall:::/$target == pid/{ trace((timestamp - start) / 1000);}

::add_physmem:,::sptcreate:,...::sptdestroy:,::va_to_pfn:/$target == pid/{ trace((timestamp - start) / 1000);}


Tracing the VM System

0 => munmap 31940 -> as_unmap 31990 -> as_findseg 32060 <- as_findseg 32090 -> segvn_unmap 32110 -> segvn_lockop 32170 <- segvn_lockop 32190 -> hat_unload_callback 32210 -> page_get_pagesize 32360 <- page_get_pagesize 32370 -> hat_page_setattr 32390 <- hat_page_setattr 32400 -> free_vp_pages 32470 -> page_share_cnt 32520 -> hat_page_getshare 32550 <- hat_page_getshare 32560 <- page_share_cnt 32580 <- free_vp_pages 32590 <- hat_unload_callback 32610 -> seg_free 32630 -> as_removeseg 32650 <- as_removeseg 32700 -> segvn_free 3272...


Virtual Address Space Management


Virtual Address Space Management


The address space subsystem manages the following> Duplication of address spaces, for fork()> Destruction of address spaces, for exit()> Creation of new segments within an address space> Removal of segments from an address space> Setting and amangement of page protection for an

address space> Page fault routing for an address space> Page locking and advice for an address space> Management of watchpoints for an address space

Page Faults in Address Spaces


Segment Drivers


The vnode Segment seg_vn


• Executable text

• Executable data

• Heap and stack (anonymous memory)

• Shared libraries

• Mapped files

The vnode Segment seg_vn


Anonymous Memory


Virtual Memory Watchpoints


File System

File System Framework


Process Level File Abstractions


Virtual File System (vfs) Interface


The mount Method


The Mounted vfs List


The vnode


The Life Cycle of a vnode


File System I/O


read() and write() System Calls


Source

• Solaris™ Internals: Solaris 10 and OpenSolaris Kernel Architecture, Second EditionBy Richard McDougall, Jim MauroPublisher: Prentice HallPub Date: July 10, 2006Print ISBN-10: 0-13-148209-2Print ISBN-13: 978-0-13-148209-8Pages: 1072

>FREE AND UNLIMITED ACCESS TOSUN PROFESSIONAL COURSES

REGISTER TODAY AT:https://learningconnection.sun.com

Do not get yourself nuts...WE MAKE IT EASY FOR YOU!

>GET 60% DISCOUNT ON PROFESSIONAL CERTIFICATIONS FROM PROMTERICS

http://www.sun.com/edu/program/sai

Sun Microsystems GesmbH Wienerbergstrasse 3/VII A- 1101 Wien

Solaris 10Q&A

DI Gerald HartlAccount Manager for Education and Research

Solaris 10 - uibk.ac.attf/lehre/ss07/bs/vorlesungen/Solaris Vortrag... · Sun Microsystems GesmbH Wienerbergstrasse 3/VII A- 1101 Wien Solaris 10 DI Gerald Hartl Account Manager for

Documents