First C A Meeting

First RussianCA meeting

ЖирновМиша

ФилиппШубин

Gary Serda

Шубин Алексей

Белокрылов Александр

Александр Белокрылов

Паша Вотчитцев

Что такое JAVA(SUNW)

Software

Services Storage

Servers

Network.com

™

The Information Age Has Just Begun!

Data Center Application Edge Client

Нельзя организовать сообщество без вложений!

JXTA java.sun.com

Looking Glass

java.com

, .Процессоры Серверы и пр

• Niagara 2

> http://www.sun.com/processors/niagara/• Rock

> http://blogs.sun.com/jonathan/entry/rock_arrived

• Thumper

> http://www.sun.com/servers/x64/x4500/

LibrarySoftware

DataProtectionSoftware

DataMgmt.

Software

Tape Drives

SL 8500

T9x40 T10000

L1400 9990 9985

Virtual Storage Manager

Storage Area Network Switches

Encryption KeyManagement

4e/4/5

5Xx0 NAS VTL

Storage Portfolio

USE IMPROVE EVANGELIZE


Solaris 10

X Window System

Hardware

GNOME

Solaris and GNU/Linux

GNU utilities

System libraries

Linux kernel

POSIX+ extensions

Mozilla Firefox, Mozilla Thunderbird, OpenOffice.org, ...

UNIX utilities

POSIX

Solaris kernel


Solaris 10Что я могу делать под

Solaris?


Solaris 10

Дистрибутивы Solaris● Поддерживаемый Sun

– Solaris 10

– Solaris Express Community Edition (каждые 2 недели)

– Solairs Express Developer Edition (каждые 3 месяца)

● Community– BeleniX (LiveCD x86)

– Nexenta (GNU/Opensolaris)

– Martux (Sparc LiveCD)

– Schillix

● NEW! Проект Indiana!

http://blogs.sun.com/SFilippp


Solaris 10

Project Indiana● .. is what everyone is talking about in

OpenSolaris land.● Is the promising new OpenSolaris binary

distribution● Lead by Ian Murdock: The 'Ian' in Debian.● Great new features you always wanted in

Solaris.


Solaris 10

Project Indiana (cont'd)● Network based apt-like binary package

management called the Universal Packaging system

● The cool new Distro-constructor!• Simply select packages from repository• Customize look and feel• and spread your own distribution!

● www.opensolaris.org/os/project/indiana/


Solaris 10

? Что такое Зоны?Контейнеры

Zones

+Resource Management

=Containers

Изолированные экземпляры Solaris (> 8000), собственная/разделяемая файловая система, собственный root-вый доступ, собственные настройки сети....Группирует набор процессов в “пулы”, Управление ресурсами между процессами

Способ легковесной виртуализации ОС....


Solaris 10

?Что позволяют делать Зоны● Создание для каждого студента

Unix собственной среды для различных ( root- экспериментов с возможностью вого

)доступа● “ ” Создание песочницы для

, программистов для сборки и установкиприложений

● Создание тестовых окружений для новыхприложений

● Разделение вычислительных ресурсов между различными пользователями

● Объединение нескольких серверов в один● !Эмуляция нескольких серверов на одном


Solaris 10

Solaris ДемонстрацияZones/Containers

Pentium Mobile Centrino, Solaris 10 x86

Global Zone1 Processor Share192.168.1.128

Web Zone3 Proacessor Shares192.168.1.150

Software Zone2 Processor Shares192.168.1.151

/usr, /platform, /sbin, /lib (r/o)(r/o)

/etc, /var /etc, /var (r/w) /etc, /var (r/w)

/usr/local /usr/local (r/w)

/cdrom /cdrom

(resource management becomes much more fun on multi-processor machines)

Solaris - может все проектBrandz

• Возможность запускать приложения других – Solaris ОС без перекомпиляции ядро

.эмулирует системные вызовы

• Возможно установить полноценные ОС в зону

• :Доступные виртулизации

> Linux-зона

> Windows

> Mac OS X .... ожидаетсяhttp://www.opensolaris.org/os/community/brandz/

Linux- зона

Можно запускать не только бинарные Linux – программы,

но и установить Linux в зону.

Примеры - http://sunhelp.ru

http://sunhelp.ru/

Windows в Solaris =)

Интересные ссылки по виртуализации

• Brandz http://www.opensolaris.org/os/community/brandz/

• Crossbow виртуализация сетевых интерфейсов http://www.opensolaris.org/os/project/crossbow/

• Sun'овский вариант Xen и не только:> http://www.openxvm.org/

• Руководство по системному администрированию: контейнеры в Solaris – управление ресурсами и зонами http://docs.sun.com/app/docs/doc/820-2979?l=ru&q=%D0%97%D0%BE%D0%BD%D1%8B

• LDOMS – виртуализация by Niagara http://www.sun.com/servers/coolthreads/ldoms/index.xml

http://www.opensolaris.org/os/project/crossbow/


Solaris 10

DTrace Features● Dynamic Instrumentation

– Zero probe effect when disabled● Unified Instrumentation

– Instrument both kernel and applications

– Can follow flow-control across boundaries● Kernel Instrumentation

– Can instrument in-kernel subsystems like virtual memory, synchronization, scheduler

● Data Integrity– Errors always reported


Solaris 10

DTrace Features● Arbitrary Actions● Predicates

– Take action only when condition is met

● High-level Control Language– C-like language describes predicates &

actions

– All ANSI C operators (add, subtract, etc)

– Access to kernel variables and data types

● User-defined variables● Data aggregation


Solaris 10

Sample D-Light screen-shot

Source: Sun Microsystems, Inc.

+35%In an

Afternoon

Online ParcelTrackingSystem

+80%In a Day

FuturesForecastingApplication

+267%In 2 Days

MessageHanding

Benchmark


Solaris 10

More about D-Light at● Demo of D-Light at

http://sunfeedroom.sun.com/linking/index.jsp?skin=twoclip&fr_story=FEEDROOM192569

● D-Light tutorial at http://blogs.sun.com/solarisdev/entry/project_d_light_tutorial


Solaris 10DTrace Results on Production

Systems

Source: Sun Microsystems, Inc.

+32%In a

Morning

FinancialDatabase

+35%In an

Afternoon

Online ParcelTrackingSystem

+80%In a Day

FuturesForecastingApplication

+267%In 2 Days

+300%In 5 Hours

MessageHanding

Benchmark

DataRouting

Application

Интересные ссылки по D-trace

• Chime - GUI проект для D-trace> http://www.opensolaris.org/os/project/dtrace-chime/

• Коллекция D-trace скриптов> http://www.dtracescripts.com/


Solaris 10

Traditional Volumes● Abstraction: virtual disk● Partition/volume for each

FS● Grow/shrink by hand● Each FS has limited

bandwidth● Storage is fragmented,

stranded

ZFS Pooled Storage● Abstraction: malloc/free● No partitions to manage● Grow/shrink

automatically● All bandwidth always

available● Pool allows space to be

shared

Storage PoolVolume

FS

Volume

FS

Volume

FS ZFS ZFS ZFS

Volumes versus ZFS


Solaris 10

● Create a storage pool named “home” # zpool create home mirror disk1 disk2

● Create filesystems “ann”, “bob”, “sue” # zfs create home/ann /export/home/ann

# zfs create home/bob /export/home/bob

# zfs create home/sue /export/home/sue

● Add more space to the “home” pool # zpool add home mirror disk3 disk4

ZFS Administration


Solaris 10

● Turn on compression for Ann's data # zfs compression=on home/ann

● Limit Bob to a quota of 10G # zfs quota=10g home/bob

● Guarantee Sue a reservation of 20G # zfs reservation=20g home/sue

● Take a snapshot of Ann's filesystem # zfs create home/ann@tuesday

ZFS Administration – Cool Features

Интересные ссылки по ZFS

• Слайды> http://www.opensolaris.org/os/community/zfs/docs/

zfs_last.pdf

• Учебные материалы> http://www.opensolaris.org/os/project/dtrace-chime/

• Интересные видео> http://www.infoworld.com/archives/videoTemplate.jsp?Id=1152&type=Screencasts&tag=Storage> http://www.youtube.com/watch?v=1zw8V8g5eT0

http://www.opensolaris.org/os/project/dtrace-chime/

http://www.infoworld.com/archives/videoTemplate.jsp?Id=1152&type=Screencasts&tag=Storage

Интересные ссылки по Solaris

• Отличная презентация про Open Solaris> http://www.slideshare.net/gnunify/open-solaris

• Все необходимое:> http://www.opensolaris.org

http://www.slideshare.net/gnunify/open-solaris

http://www.opensolaris.org/

NetBeans 6.0

What Is NetBeans?

• A comprehensive, modular Java IDE> Out-of-box support for Java SE, Java EE, Java ME> Large set of 3rd party modules (plug-in's)> Intuitive drag-and-drop development> Debugger, Profiler, Refactoring, etc...

• Free and open-source based> Open source since June, 2000> Large community of users and developers

• A platform for building applications> Rich client Java applications> Rich framework of windows, menus, tool bars, actions

What's New In NetBeans 6.0?

• Code editor enhancements• Ruby, JRuby, & Ruby on Rails support (*)• Easier installation and upgrading• Swing GUI data binding (+)• Integrated profiling, profiling � points� (+)• Integrated visual web features (*)• Mobility graphical game builder (*)• SOA & UML enhancements• Netbeans platform enhancements

(*) Topic of an additional tech demo session(+) Will see later in this tech demo session

Matisse GUI Builder (Demo)Java Desktop Database App• Swing Application Framework

• Beans Binding

• Java Persistence API

• Matisse GUI Builder

http://www.netbeans.org/kb/60/ide-gui-db-prev.html

Mobile Visual Game Builder

Out of the Box Java EE 5 Support

• Web application development (+)• Java EE 5 Support (+)• Debugging, testing, profiling• Struts and JavaServer Faces (JSF)• JBoss 4, WebLogic 9, WebSphere• Web services development (client + service) (+)• AJAX app development (Blueprints)• EJB application development

(+) Will see demo later in this session

Developer Collaboration

• Develop applications collaboratively

• Code-aware instant messaging

• Share entire development environment

• Multi-party file editing

• Conduct code reviews

• Collaborative debugging

• share.java.net public collaboration server

Debugging & Profiling

• Visual debugging (breakpoints, watchpoints)• Remote debugging of a process• On-the-fly code fixing• Debug JSP, Servlets, monitor HTTP Traffic• View, suspend, resume threads• Monitor thread activity• CPU time & visual method call-graph data• Object-centric view: # allocated, live, age• JVM telemetry: heap usage, garbage collection

Debugging & Profiling (Demo)

http://www.netbeans.org/kb/55/profiler-tutorial.html

HPC

Tokyo Institute of TechnologyNow delivering 47.38 TFLOPS38.18 TFLOPS in 31 Days using CRS 6 Linked sub-clusters

8 Voltaire Infiniband switches42 Sun Fire x4500 Data Servers80+ Racks360 Clearspeed FP accelerators655 Sun Fire x4600 Servers10,480 Opteron cores21 TeraBytes RAM1 PetaByte storage

Sun N1 Grid Engine Sun N1 System Manager Lustre parallel file system

Asia's fastest supercomputer

Galaxy 4 Thumper

InfinibandTier 2 Switch

100+ 7

1

Galaxy 4 Thumper


100+ 7

1

Galaxy 4 Thumper


100+ 7

1

Galaxy 4 Thumper


100+ 7

1

Galaxy 4 Thumper


100+ 7

1

x4600 x4500


100+ 7

1



CP

UOpteron GHz 2.1Flops/clock/core 4Cores per chip 4

Co

mpu

te n

ode

Sockets 4Cores 16Gflops 134Mem BW (GBps) 24Mem size (GB) 32Off-node BW (GBps) 4Approx watts 600Nodes/Rack 48

Disk drives 48Raw storage size (TB) 24Storage BW (GBps) 1Nodes/Rack 9

Sys

tem

Compute Nodes 3,936Compute cores 62,976Tflops 529 RatiosBisection BW (TBps) 7.9 0.015 B / FMem BW (TBps) 94 0.18 B / FMem size (TiB) 123 0.23 B / FBulk Store nodes 72Storage size (TB) 1,728 3.3 B / FStorage BW (TBps) 0.07 0.00014 B / FTotal Racks 95Approx total Sq feet 2,037 260 Tflops / KsqftApprox total Mwatts 2.4 224 Tflops / MW

Sto

rage

No

de

4 x 4 2-GBDDR2 DIMMs

3,936 Compute nodes in 82 C48 racks

One 4x DDRIB port per blade

(4 GBps)

Four cablesper shelf

Opt

4 socketsx 4 coresx 4 flops

72 Bulk Storage nodes in 8 racksX4500 (4 RU)

2 sockets x2 cores

Ranger Configuration Details

48 x500 GBdrives

OptPCI-X PCI-XPCI-X PCI-X PCI-X

IB HCA

8 SATA

drives

8 SATA

drives

8 SATA

drives

8 SATA

drives

8 SATA

drives

8 SATA

drives

2 GigE

2 GigE

IB HCA

Opt

OptPegasus 4S

Blade12-

bladeShelf

PCIe PCIe

Opt

OptHT2

PCIe fromeach blade

11 otherbladesin shelf

Magnum switch2,160 ports

IB leafswitch

NEM

HCA

24-port switch

HCAHCAHCAHCAHCAHCAHCAHCAHCAHCAHCA

Magnum switch2,160 ports


Solaris 10

Sun Studio - Integrated C/C++/Fortran Оптимизирующие

компиляторы

(dbx)Продвинутый отладчик

Memory Leak Detection/Analysis (RTC)

Аналазитор производительности

Поддержка многоядерных и многопроцессорных систем

Многопоточные библиотеки

Анализатор потоков

OpenMP 2.5 API, MPI Поддержка

IDE NetBeansоснованное на

dmake – параллельный ираспределенный

, Сообщество разработчиков, поддержка треннинги

Sun Studio 12 Официальный релиз с полной поддержкой

: Sparc Solaris, Intel ПлатформыSolaris, Intel Linux (SUSE, RedHat)

Sun Studio ExpressPreview следующего релиза

D-Light – , удобное легковесное средство профилирования

– Все беслатно для любогоиспользования

Sun Studio Software


Solaris 10

Sun Studio – Cool Tools● Графический отладчик и анализотор производительности● Memory Leak and Access Detection● GCCfss (GCC for Sparc Systems)● Data Race Detection Tool (DRDT)● ATS – Automatic Tuning System● Binary Improvement Tool (BIT) and Link-Time Optimizer● Simple Performance Optimization Tool (SPOT)● Distribute Make (dmake)● Compiler Commentary● Automatic Parallelization & Vectorization● Native Connector Tool● X-Designer GUI Builder


Solaris 10

Автоматическое распараллеливание #include <math.h> #include <stdio.h>

#define N 10000000

double a[N], b[N], c[N]; double sum = 0.0;

void main(void) {

int i = 0;

loop:

a[i] = sin(i); b[i] = cos(i); c[i] = a[i]*a[i] + b[i]*b[i]; sum += c[i];

i = i+1;

if ( i < N ) goto loop;

printf("sum = %f\n", sum);

}

OMP_NUM_THREADS=1 timex ./a.outsum = 10000000.000000

real 39.95user 33.14sys 1.24


real 22.45user 33.59sys 1.10


real 11.19user 33.40sys 1.21

Sun Studio 11 против GCC

Compression

FPGA Circuits

Combinatorial

Chess: Game

Word Processing

Compute visual

Group theory &

Database

Compression

Simulated annea

200

300

400

500

600

700

800

900

467

412

290

623

420

671

417

873

439

522

360 342

226

398

342300

266

466

322

414

SPECint CPU2000 PerformanceUltraSPARC III+ 1.0GHz

46% betterRange:22% -124%

Compression

FPGA Circ

GCC Combinatoria

Chess: Gam

Word Proc

Compute visu

PERL

Group theo

Database

Compression

Simulated

500

750

1000

1250

1500

1750

2000

2250

2500

1178 1185

1650

953

2322

1534

1242

2118

1194

1873

1539

13581245

1101

1413

627

2078

10031068

1493

1265

1739

1161 1214

SPECint CPU2000 PerformanceOpteron (2.4GHz)


Physics/Chromo

Shallow Water

MultiGrid Solver

Parabolic/Elliptic

3-D Graphics

Image Recogniti

Seismic Wave

Image Processi

Computational Che

Number Theory

Finite Element

High Energy Phys

Meterology:pollutan

0500

10001500200025003000350040004500500055006000650070007500

883

1501

545 741 561

7506

1181 1321

317 228469 377 569

250 217 110 172 151 165 98 235 112 180 215 133 232

SPECfp CPU2000 PerformanceUltraSPARC III+ 1.0GHz

352% betterRange:26% - 4449%

Physics/Chro

Shallow Wat

MultiGrid Solv

Parabolic/Ellip

3-D Graphics

Image Reco

Seismic Wav

Image Proc

Computationa

Number Theo

Finite Elem

High Energy

Meterology:p

600

8501100

1350

16001850

21002350

26002850

31003350

3600

2161

3599

1488

1835

1380

2062

1309

2458

1140

1400 1466

749

1887

1329 1274

754

999

15411731

941

1146 1217 12361096

640

1344

SPECfp CPU2000 PerformanceOpteron (2.4GHz)


Sun Studio11

GCC

Интервалы: расширение для наукоемких задач

• Учет дискретности представления аналоговых данных, погрешности аппаратного округления, подсчет суммарной погрешности результата

• Различные режими округления дают различные результаты

f90 intx.f90 -fround=nearest; a.out

1.0000595

f90 intx.f90 -fround=positive; a.out

1.0001191

f90 intx.f90 -fround=negative; a.out

1.0

• Интервалы дают возможность получить границы погрешности вычисления

f90 intx.f90 -xarch=sse2 -xia; a.out

[1.0,1.0001191]

N1 Grid Engine Overview• Dynamic

Resource Management> Job Scheduling> Resource

monitoring > Policy

administration> User

authentication and access control

> Accounting and reporting

User Interfaces

N1 Grid Engine

Graphical Command-line

<java/><java/>

Programmatic (DRMAA)

<c/><c/>

Programmatic (DRMAA)

Browser (accounting)

Supported Platforms

Master Host Compute Host

Solaris 7, 8, 9, 10 on SPARCSolaris 8, 9, 10 on x86Solaris 10 on x64

Solaris 7, 8, 9, 10 on SPARCSolaris 8, 9, 10 on x86Solaris 10 on x64

Linux kernel 2.4-2.6 onx86/x64 (any distribution)

Linux kernel 2.4-2.6 onx86/x64 (any distribution)

Windows 2000/XP Pro,2000/2003 Server

Mac OS X on PPC

AIX 4.3, 5.1, 5.3

HP-UX 11.x

Irix 6.5

More Information

• Main product page:> http://www.sun.com/gridware/

• Open source project site:> http://gridengine.sunsource.net/

• Community site:> http://gridengine.info/

• Open source Service Domain Manager site:> http://hedeby.sunsource.net/

Sun Labs

http://research.sun.com/

What is Sun SPOT?

• A Java platform for developing applications for wireless networks and small devices

• Applications such as:> Robotics> Art> Toys> Personal electronics> Commercial Applications> Telemetries

Sun SPOT Device

• Basic device has three layers> Battery> Processor Board with

Wireless Communication> Sensor Board (add-on

card)

• Processor Board alone acts as a base-station

• User programs the device entirely in Java using Netbeans.

Sun SPOT Hardware

• Processor Board> 180 Mhz 32-bit ARM920T core, 512K

RAM, 4M Flash> 2.4 Ghz 802.15.4 radio with integrated

antenna> USB interface

• Sensor board> 2G/6G 3-axis accelerometer> light and temperature sensors> 8 3-color LEDS, 2 momentary switches,

6 analog inputs, 5 GPIO pins and 4 high current output pins and a ADC.

Sun SPOT Resources• Project Sun SPOT http://www.sunspotworld.com/

> Sun SPOT documents and applications notes> Short Video demos> Classroom Curriculum> Discussion Forum

• David's Blog: http://blogs.sun.com/davidgs/> Latest news, other informal information on Sun SPOT

• The Squawk Projecthttp://research.sun.com/projects/squawk/> Sun Microsystems official Squawk research project page

http://www.sunspotworld.com/

http://blogs.sun.com/davidgs/

http://research.sun.com/projects/squawk/

Wonderlandhttp://research.sun.com/projects/mc/mpk20.htmlhttp://research.sun.com/projects/dashboard.php?id=85http://www.projectdarkstar.com/

Другие интересные проекты Sun Labs• Fortress

> http://research.sun.com/projects/plrg/Fortress/overview.html

• Proximity communications> http://www.bio-itworld.com/newsitems/2005/sept2005/09-13-05-news-sun

• Search in music > http://research.sun.com/projects/dashboard.php?id=153

• Security, Cryptography, and Policy> http://research.sun.com/projects/dashboard.php?id=35

И много других: http://research.sun.com/projects/

http://research.sun.com/projects/plrg/Fortress/overview.html

http://www.bio-itworld.com/newsitems/2005/sept2005/09-13-05-news-sun

http://research.sun.com/projects/dashboard.php?id=153

http://research.sun.com/projects/dashboard.php?id=35

Полезные ресурсы

• blogs.sun.com• blogs.sun.com/jonathan• developers.sun.ru• developers.sun.com• sun.com• ru.sun.com• sunhelp.ru

О чем мы не упоминали и о чем стоит узнать• Blackbox• Glassfish• JavaFX

Мы• http://developers.sun.ru/

• http://ru.sun.com/research/teachingmaterials.html

• /CA Page

• http://developers.sun.com/

• http://developers.sun.com/academic

• http://www.sun.com/edu/programs/sai/

• java.net, OpenSolaris.org, and NetBeans.org

• http://www.educationcommons.org

http://developers.sun.ru/

http://ru.sun.com/research/teachingmaterials.html

http://developers.sun.com/

http://developers.sun.com/academic

http://www.sun.com/edu/programs/sai/

Что делать кроме презентаций?

• Локализация NetBeans• http://www.educationcommons.org/projects/display/CA/Get+Involved