Top Banner
- 1 - uMeteo-K Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul Nation al Uuiv, KOREA) Byung-Lyol Le e (NCAM/KMA, KOREA) 17 17 th th APAN Meetings APAN Meetings arch Collaborations Among Institut arch Collaborations Among Institut Employing Grid Technology Employing Grid Technology January 29, 2004 Hawaii Imin International Conference Center University of Hawaii, Honolulu, Hawai i, USA
57

UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

Mar 27, 2015

Download

Documents

Alex Waddell
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 1 -

uMeteo-KuMeteo-K

Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA)

Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA)

Byung-Lyol Lee (NCAM/KMA, KOREA)

1717thth APAN Meetings APAN Meetings

Research Collaborations Among InstitutionsResearch Collaborations Among InstitutionsEmploying Grid TechnologyEmploying Grid Technology

January 29, 2004

Hawaii Imin International Conference CenterUniversity of Hawaii, Honolulu, Hawaii, USA

Page 2: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 2 -

uMeteo-KuMeteo-K

Main GoalsMain Goals

Establishment of uMeteo-K, ubiquitous Korea meteorological research cooperation system

Page 3: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 3 -

uMeteo-KuMeteo-K

About uMeteo-KAbout uMeteo-K

The concept of virtual lab. for interdisciplinary meteorological researches

- Cooperation meteorological research environment (Access Grid)- Parallelized numerical weather/climate prediction modeling (Computational Grid)- Virtual server for large meteorological data (Data Grid)

Grid technology is essential to accomplishment

Page 4: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 4 -

uMeteo-KuMeteo-K

uMeteo-K AchievementuMeteo-K Achievement(Apr., 2003 - present)(Apr., 2003 - present)

Establishment of virtual cooperation research environment using Access Grid

Pilot operation of numerical weather prediction system under Computational Grid environment

Establishment of data grid, application of virtual scenarios for uMeteo-K

Page 5: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 5 -

uMeteo-KuMeteo-K

PKNU video-conferencing & AG roomPKNU video-conferencing & AG room

Page 6: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 6 -

uMeteo-KuMeteo-K

Video device-1

Video device-2

Animation capture device

Audio device

Mother Board

CPUs

RAM

ODD

FDD

SCSI-FDD

Specifications Remarks

Processor & Memory

P-2.4GHz zeon dual CPU & 1GB RAM

Windows XP

Video x 2Matrox G550 Dual AGP slot-type & ATI 7000 32M DDR PCI slot-type

More than1024 x

768

Audio Sound blaster LiveFull

Duplex

Animationcapture

Osprey 210 PCI64bit

support

Speaker & Microphone

5.1ch. PC speaker, Mic.

CameraSony EVI-D30 (Polycom View Station)Logitech Quickcam Pro 4000

independent duplex

video conferenci

ng

Monitor1024 x 768 x 4(four monitors installed)

PKNU room node AG server spec.PKNU room node AG server spec.

Page 7: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 7 -

uMeteo-KuMeteo-K

PKNU QuickBrigde server installedPKNU QuickBrigde server installed

bridge.pknu.ac.kr : uMeteo-K bridge server

- Supporting to connect PIG without Multicasting network

- Operating uMeteo-K homepage server

- Registered uMeteo-K virtual venues service (ANL)

- Operating the Quick bridge server (bridge.pknu.ac.kr :210.107.209.219)

Page 8: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 8 -

uMeteo-KuMeteo-K

SystemProcess & memory

Dual Intel Xeon 2.4 GHz /1GB DDR /40 GB SCSI HDD / Giga Bit Ethernet

Video CardMatrox G550 Dual AGPATI Radeon 9000 Dual PCI

Audio Capture CardSoundBlaster Live De

Video Capture CardOsprey 230 PCI

Speaker-MicrophoneSpeaker-Mic.Speaker

AKG SR40 + HT40 (cordless mic. & receiver)Creative INSPiRE 5.1 5700 Digital

CameraAnalog CameraUSB Camera

Sony EVI-D30Logitech Quickcam Pro4000

Display DeviceProjectLCD Monitor

Sharp LCD Projector XG-C40Samsung SyncMaster 157X

EtcS/W

RackProjector ScreenTriangle support

MS WindowsXP ProfessionalMS OfficeXPStandard Rack Cabinet 8U

uMeteo-K portable AG sever spec.uMeteo-K portable AG sever spec.

Page 9: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 9 -

uMeteo-KuMeteo-K

uMeteo-K AG instrumentsuMeteo-K AG instruments

- Camera : EVI-D30 camera

- Mic. : cordless & boundary mic.

- Echo remove unit

Page 10: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 10 -

uMeteo-KuMeteo-K

uMeteo-K new AG configurationuMeteo-K new AG configuration

KMAKMA

PKNU(부경대 )

PKNU(부경대 )

KISTIKISTI

MulticastUnicast

Quick Bridge

ANLMeteorological

University

PKNU

KISTIKISTI

KMAKMASNU

KAISTKAISTKJISTKJIST

KMAKMAKMA

KMAKMA

Unicast

MeteorologicalOrganization

KMAKMA

Unicast

OtherUsers

APAG

AG

Page 11: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 11 -

uMeteo-KuMeteo-K

PKNU Venue-server registered to ANLPKNU Venue-server registered to ANL

Page 12: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 12 -

uMeteo-KuMeteo-K

Remote PPTRemote PPT- Sharing presentation data and connecting with AG

- The data sharing through simple virtual host configuration

Page 13: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 13 -

uMeteo-KuMeteo-K

VNC Server & ViewerVNC Server & Viewer- VNC stands for Virtual Network Computing.

- VNC allows you to view and interact with one computer (the "server") using a simple program (the "viewer") on another computer anywhere.

- The two computers don't even have to be the same type OS.

Page 14: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 14 -

uMeteo-KuMeteo-K

Sample of VNC Server & ViewerSample of VNC Server & Viewer

Page 15: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 15 -

uMeteo-KuMeteo-K

번호 일시 회의명 목적 참여기관

1 2003.  4. 23. uMeteo-K AG test 그리드사업 참여연구기관들의 네트웍 현황파악 PKNU, SNU, NCAM

2 2003.  6.  3. uMeteo-K AG test 유니캐스팅네트웍의 활용도 재고 부경대 , 서울대 , 워싱턴 ( 수원기상대 )

3 2003.  6. 20. uMeteo-K AG test VRVS 형의 협업그리드 활용 및 원격화상회의 부경대 , 서울대 , 수원기상대 , 기상청

4 2003.  7.  8. 그리드 연구기관 모임 국가그리드 기반구축 참여기관의 협업시스템 점검 부경대 , 서울대 , 기상청 , KISTI

5 2003. 7. 13. SNU & Tokyo Univ. Seminar 서울대와 동경대 간의 기상분야 세미나 시청 서울대 , 동경대 , 부경대 , 수원기상대

6 2003.  7. 31. 중간발표 대비 점검 국제영상회의실 네트웍 점검 및 RPPT test 부경대 , 수원기상대 , 한국과학기술원

7 2003.  8. 26. GFK 중간보고 및 발표 사업성과 중간보고 전 국가 그리드 기반 구축 사업단

8 2003.  8. 27. 제 16 차 APAN 국제회의 아시아 태평양 네트웍분야의 신기술 및 동향파악 부경대 , 수원기상대 , 기상청 , 미국 , 독일

9 2003.  9.  3. 한국과학기술원 홍보자료 제작 한국과학기술원 홍보용 책자 및 동영상 제작 부경대 , 한국과학기술원

10 2003.  9. 25. CAgM/ETSIDN 회의 농업기상분야 관계자 회의 부경대 , 수원기상대 , 연세대

11 2003. 10. 23. 부산외국어대 국제통역원 강의 AG 를 이용한 국제통역의 새로운 가능성 제시 부경대 , 부산외국어대학교

12 2003. 11. 9. uMeteo-K 8th Workshop 국가그리드 기반사업 계획 수립 및 추진전략 회의 부경대 , 성균관대 , 서울대 , 기상청

13 2003. 11. 21. 2th 레이더 전문가 협의회 국내 기상 레이더 전문가 회의 부경대 , 경북대 , 기상청

14 2003. 12. 1. Winter G.F.K. Workshop Grid 관련사업 평가 및 시연 KISTI, PKNU, SNU, NCAM, SKKU

15 2003. 12. 18. GLOBEC Workshop 워크샵 참가 및 발표 NFRDI, KSITI, PKNU, JAPAN

16 2003. 12. 23. 슈퍼컴퓨팅 성공사례발표 정통부 차관 초청 슈퍼컴퓨팅 성공사례 시연 PKNU, SNU, NCAM, KISTI

17 2004. 1. 6. 초청세미나 일본해양과학기술청의 연구분야 소개 PKNU, JAPAN Frontier Institution

18 2004. 1. 9. Workshop on Grid-tech. 튜토리얼 개최 및

Seminar : international (4) + domestic (14) Seminar : international (4) + domestic (14) Co-work and general use : 60Co-work and general use : 60

Samples of uMeteo-K AG operationSamples of uMeteo-K AG operation

Page 16: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 16 -

uMeteo-KuMeteo-K

uMeteo-K AG operationuMeteo-K AG operation

Page 17: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 17 -

uMeteo-KuMeteo-K

Meteorology Session on 16th APAN meeting

Marriot Hotel, Busan, Korea <Aug. 26~27, 2003>

Page 18: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

ICSYM/PKNUICSYM/PKNU

2003 uMeteo-K2003 uMeteo-K

- 18 -

2003 Grid Forum Korea Winter meetings at Chosun Hotel, Seoul <Dec. 1~2, 2003>

Page 19: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

ICSYM/PKNUICSYM/PKNU

2003 uMeteo-K2003 uMeteo-K

- 19 -

GLOBEC workshop at NFRDI, Korea <Dec. 17~18, 2003>

Page 20: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

ICSYM/PKNUICSYM/PKNU

2003 uMeteo-K2003 uMeteo-K

- 20 -

Tera Computing and Network Demonstration, KISTI <Dec. 23, 2003>

Page 21: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

ICSYM/PKNUICSYM/PKNU

2003 uMeteo-K2003 uMeteo-K

- 21 -

Workshop on Grid Technology for Environmental study at PKNU <Jan. 8~10, 2004>

Page 22: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 22 -

uMeteo-KuMeteo-K

uMeteo-K AG 2.0 tutorialsuMeteo-K AG 2.0 tutorials

uMeteo-K meeting & tutorials at PKNU, Busan, Korea <Jan. 8~10, 2004>

Page 23: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 23 -

uMeteo-KuMeteo-K

Costs & Benefits Analysis for uMeteo-K AGCosts & Benefits Analysis for uMeteo-K AG번호 기간 회의명 출장지 회의방식 ( 단위 : 원 ) AG 방식

1 2003.  4. 23. uMeteo-K AG test 국내전문가ⅹ 2 인ⅹ 2 일 = 400,000 +α

AG 구축 비용

- AG 서버 4,000,000 ( 주변기기포함 ) - 고화질 디스플레이 패널 4,000,000 - 영상회의 전용카메라 8,000,000

국제영상회의실 시설설치 비용

: 15,000,000

2 2003.  6.  3. uMeteo-K AG test 국내전문가ⅹ 2 인ⅹ 2 일 = 400,000 +α

3 2003.  6. 20. uMeteo-K AG test 국내전문가ⅹ 3 인ⅹ 2 일 = 600,000 +α

4 2003.  7.  8. 그리드 연구기관 모임 국내전문가ⅹ 8 인ⅹ 2 일 = 1600,000 +α

5 2003.  7. 13. SNU & Tokyo Uni. 세미나 국내전문가ⅹ 8 인 + 국외전문가ⅹ 8 인 = 8,800,000 +α

6 2003.  7. 31. 중간발표 대비 점검 ( 국내전문가ⅹ 1 인 + 수행연구원ⅹ 2 인 ) 2ⅹ 일 = 300,000 +α

7 2003.  8. 26. GFK 중간보고 및 발표 ( 국내전문가ⅹ 1 인 + 수행연구원ⅹ 2 인 ) 2ⅹ 일 = 300,000 +α

8 2003.  8. 27. 16th APAN 국제회의 ( 국내전문가ⅹ 5 인 ) 6ⅹ 일 + 국외전문가ⅹ 5 인 = 8,000,000 +α

9 2003.  9.  3. KISTI 홍보자료 제작 ( 국내전문가ⅹ 5 인 + 수행연구원ⅹ 3 인 ) 2ⅹ 일 = 800,000 +α

10 2003.  9. 25. CAgM/ETSIDN 회의 국외전문가ⅹ 5 인 + 국내전문가ⅹ 3 인 = 7,800,000 +α

11 2003. 10. 23. 부산외국어대학교 강의 국내전문가ⅹ 1 인 + 수행연구원ⅹ 2 인 = 200,000 +α

12 2003. 11. 9. uMeteo-K 8th Workshop ( 국내전문가ⅹ 6 인 + 수행연구원ⅹ 4 인 ) 3ⅹ 일 = 2,700,000 +α

13 2003. 11. 21. 2th 레이더 전문가 협의회 ( 국내전문가ⅹ 4 인 + 수행연구원ⅹ 4 인 ) 2ⅹ 일 = 1,200,000 +α

14 2003. 12. 1. Winter G.F.K workshop ( 국내전문가ⅹ 1 인 + 수행연구원ⅹ 3 인 ) 3ⅹ 일 = 750,000 +α

15 2003. 12. 18. GLOBEC Workshop ( 국내전문가ⅹ 1 인 + 수행연구원ⅹ 2 인 ) 2ⅹ 일 = 400,000 +α

16 2003. 12. 23. 슈퍼컴퓨팅 성공사례발표 ( 국내전문가ⅹ 1 인 + 수행연구원ⅹ 2 인 ) 2ⅹ 일 = 400,000 +α

17 2004. 1. 6. 초청 세미나 국외전문가ⅹ 1 인 =1,000,000 +α

18 2004. 1. 9. Workshop on Grid-tech.( 국내전문가ⅹ 6 인 + 수행연구원ⅹ 6 인 ) 3ⅹ 일 =2,700,0000 +α

Benefits/Costs USD 32k +α USD 27k국내 전문가 1 인 =100,000 원 , 국외전문가 1 인 =1,000,000 원 , 수행연구원 1 인 =5 만원

Page 24: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 24 -

uMeteo-KuMeteo-K

Differences between AG 1.2 and AG 2.0Differences between AG 1.2 and AG 2.01. Easy Venue Server configuration and usage2. Instead of PIG, using individual Venue Server 3. Complexity about Certification Authority4. Sharing Data, Sharing Application, Sharing Service enforced5. GUI6. Service total Management about Access Grid utility

Data sharing

Remote controll

bridge direct access

Manage total applicationsthrough one program

Manage total applicationsthrough different programs

AG 1.2 AG 2.0

client server server server

client client

Page 25: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 25 -

uMeteo-KuMeteo-K

Operate AG 2.0 – (1) Video ConferencingOperate AG 2.0 – (1) Video Conferencing

Page 26: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 26 -

uMeteo-KuMeteo-K

Operate AG 2.0 – (2) Sharing DataOperate AG 2.0 – (2) Sharing Data

Page 27: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 27 -

uMeteo-KuMeteo-K

Operate AG 2.0 – (3) Data DownloadOperate AG 2.0 – (3) Data Download

Page 28: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 28 -

uMeteo-KuMeteo-K

Operate AG 2.0 – (4) Shared BrowerOperate AG 2.0 – (4) Shared Brower

Page 29: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 29 -

uMeteo-KuMeteo-K

Operate AG 2.0 – (5) Shared PresentationOperate AG 2.0 – (5) Shared Presentation

Page 30: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 30 -

uMeteo-KuMeteo-K

• Enable face-to-face meeting activities

• What can be done:– Sharing Data– Shared Applications– Text chat

• Applications:– Shared Presentation– Shared Web browser– Whiteboard– Voting Tool– Question & Answer Tool– Shared Desktop Tool

• Integrate legacy single-user apps

• Communicates media addresses to node service

Client Services & ApplicationsClient Services & Applications

Page 31: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 31 -

uMeteo-KuMeteo-K

• uMeteo-K computational grid test-bed

(Two clusters utilized and each cluster has 4 nodes)

< A node’s specification>

CPU Pentium 4 1.8 Ghz

RAM 1G SDRAM

HDD EIDE 40G

VGA No

Network Internal : 10/100 Fast Ethernet

External : KOREN

uMeteo-K CG Testbed uMeteo-K CG Testbed

Page 32: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 32 -

uMeteo-KuMeteo-K

NAS storage sever

NAS storage sever

10/100 switch hub

Monitoring system

UPS

4 nodes ( single CPU ) cluster

Electrometer KOREN 10/100 Ethernet

4 nodes ( single CPU ) cluster

uMeteo-K CG Testbed ConfigurationuMeteo-K CG Testbed Configuration

Page 33: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 33 -

uMeteo-KuMeteo-K

• Independent simple CA has installed at each master node.

• Simulating the severe weather, typhoon Mae-mi

• A group of slave nodes is controlled by each master node’s PBS

scheduler

Globus linkage between testbed clustersGlobus linkage between testbed clusters

CA-A

Master ACA-B

Master B

slaves slavesPBS PBS

Page 34: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 34 -

uMeteo-KuMeteo-K

subject : /O=uMeteoK/OU=pknuGB_A01/OU=pknu.ac.kr/CN=globus/CN=proxyissuer : /O=uMeteoK/OU=pknuGB_A01/OU=pknu.ac.kr/CN=globusidentity : /O=uMeteoK/OU=pknuGB_A01/OU=pknu.ac.kr/CN=globustype : full legacy globus proxystrength : 512 bitspath : /tmp/x509up_u533timeleft : 7:52:58

subject : /O=uMeteoK/OU=pknuGB_B01/OU=pknu.ac.kr/CN=globus05/CN=proxyissuer : /O=uMeteoK/OU=pknuGB_B01/OU=pknu.ac.kr/CN=globus05identity : /O=uMeteoK/OU=pknuGB_B01/OU=pknu.ac.kr/CN=globus05type : full legacy globus proxystrength : 512 bitspath : /tmp/x509up_u535timeleft : 7:52:43

- CA-A

- CA-B

CA information of each clusterCA information of each cluster

Page 35: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 35 -

uMeteo-KuMeteo-K

uMeteo-K CG testbed monitoringuMeteo-K CG testbed monitoring

Page 36: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 36 -

uMeteo-KuMeteo-K

Non-hydrostatic NWP model developed by PSU/NCARNon-hydrostatic NWP model developed by PSU/NCAR

KMA’s operational model for short-term forecastKMA’s operational model for short-term forecast

Parallel NWP model for realtime short-term forecastParallel NWP model for realtime short-term forecast

MM5 (Mesoscale Model Version 5)

Page 37: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 37 -

uMeteo-KuMeteo-K

Sep. 12, 2003 09:00 LST~ Sep. 13, 2003 09:00 LST

Precipitation, MSLP & Wind for 24 HRs

Precipitation MSLP and Wind

Page 38: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 38 -

uMeteo-KuMeteo-K

Parallel MM5 Benchmarks with GLOBUS

Average job waiting time (including CA) : 25 sec

The required time for 3600 sec (1 hour) model integration

The required time for 86400 sec (1 day) model integration

MPICH 35 sec

MPICH-G2 42 sec

MPICH 10 min 38 sec

MPICH-G2 12 min 47 sec

Single CPU 67 min 12 sec

Page 39: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 39 -

uMeteo-KuMeteo-K

Connecting to KISTI testbedConnecting to KISTI testbed

subject : /O=Grid/O=Globus/OU=pknu.ac.kr/CN=cgtest/CN=proxy/CN=proxyissuer : /O=Grid/O=Globus/OU=pknu.ac.kr/CN=cgtest/CN=proxytype : fullstrength : 512 bitspath : /tmp/x509up_p2358.fileEaIRDc.1timeleft : 7:28:17

- CA infomation

gsissh -p 2222 venus.gridcenter.or.kr

- Conneting to venus.gridcenter.or.kr using gsissh

gsincftpput -p 2811 venus.gridcenter.or.kr ./ ~/MM5.targsincftpput -p 2811 venus.gridcenter.or.kr ./ ~/CReSS.tar

- File transfer to venus.gridcenter.or.kr using gsincftpput and gsincftpget

Page 40: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 40 -

uMeteo-KuMeteo-K

• It is successful to compile MM5 ( Mesoscale Model version 5 ) and CReSS ( Cloud resolving Storm Simulator)• It is successful to run CReSS, but fail to run MM5 because testbed is not supported some library and routine.

Running weather numerical modelRunning weather numerical model

+( &(resourceManagerContact="venus.gridcenter.or.kr") (count=8) (label="subjob 0") (environment=(GLOBUS_DUROC_SUBJOB_INDEX 0) (LD_LIBRARY_PATH /usr/local/gt2/lib/)) (directory="/home/ngrid/ngrid017/CReSS1.3m") (executable="/home/ngrid/ngrid017/CReSS1.3m/run.sh"))( &(resourceManagerContact="jupiter.gridcenter.or.kr") (count=8) (label="subjob 8") (environment=(GLOBUS_DUROC_SUBJOB_INDEX 1) (LD_LIBRARY_PATH /usr/local/gt2/lib/)) (directory="/home/ngrid/ngrid017/CReSS1.3m") (executable="/home/ngrid/ngrid017/CReSS1.3m/run.sh"))

- rsl file to run CReSS

Page 41: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 41 -

uMeteo-KuMeteo-K

CReSS (Cloud Resolving Storm simulator)

Research & development in Nagoya Univ., JapanResearch & development in Nagoya Univ., JapanResearch & development in Nagoya Univ., JapanResearch & development in Nagoya Univ., Japan

Non-hydrostatic compressible dynamic modelNon-hydrostatic compressible dynamic modelNon-hydrostatic compressible dynamic modelNon-hydrostatic compressible dynamic model

Meso-to-cloud scale simulation systemMeso-to-cloud scale simulation system Inclusion of a detailed cloud Inclusion of a detailed cloud .. microphysical processes microphysical processes

It takes many times for simulation.

Meso-to-cloud scale simulation systemMeso-to-cloud scale simulation system Inclusion of a detailed cloud Inclusion of a detailed cloud .. microphysical processes microphysical processes

It takes many times for simulation.

Performance of parallel processingPerformance of parallel processingPerformance of parallel processingPerformance of parallel processing

Page 42: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 42 -

uMeteo-KuMeteo-K

Downburst Simulation for 21000 sec.

< Wind vector in y section [m s-1] >

Page 43: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 43 -

uMeteo-KuMeteo-K

Parallel CReSS Benchmarks with GLOBUS

The required time for 21000 sec (1 hour) model integration in uMeteoK Testbed

The required time for 21000 sec (1 hour) model integration in KISTI Testbed

Jupiter 8 nodes 16 min 39 sec

Venus 8 nodes 15 min 35 sec

Jupiter 4 nodes + Venus 4 nodes 715min 13 sec

Jupiter 8 nodes + Venus 8 nodes

PKNU cluster 8 nodes (MPICH) 15 min 49 sec

PKNU A 4 nodes + PKNU B 4 nodes 16 min 39 sec

Page 44: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 44 -

uMeteo-KuMeteo-K

GASS

- Simple, Multi-protocol file transfer Tools, integrated with GRAM

GridFTP

- Provides high-performance, reliable data transfer for modern WANS

Data Grid in Globus ToolsData Grid in Globus ToolsData Transport & Access

Data Replica Catalog

- Provides a catalog service for keeping track of replicated datasets

Replica Management

- Provides services for creating and managing replicated datasets

Data Replication and Management

Page 45: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 45 -

uMeteo-KuMeteo-K

Data grid for climate prediction Data grid for climate prediction Data transportation

SNU

KISTI

Supercom

PKNU

Observation data

Forecast output

Forecast output

NASA

NCEP KMA

Model output

Model output

Data input Data input

Wu-Ftp Connecting

KMA

Supercom

NASA

Model output

Atmospheric e-science Data Grid

Forecast output

Model output

Page 46: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 46 -

uMeteo-KuMeteo-K

Hardware structure of Data-GRIDHardware structure of Data-GRID

Linux serverIntel Dual CPU

Linux serverIntel Dual CPU

Linux serverIntel Dual CPU

cdldata

cpsdata

climate

Disk Raid2.3TB

Disk Raid1.8TB

Disk Raid500G

Linux serverIntel Dual CPU

neosky15

Linux serverIntel Dual CPU

pknuGB01

KORENNetwork

KORENNetwork

KORENNetwork

Disk Raid1.2TB

Disk Raid500G

Seoul National University

Korea MeteorologyAdministration

Pukyong NationalUniversity

Page 47: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 47 -

uMeteo-KuMeteo-K

Overview Data gridOverview Data gridldapadd Adding the uMeteoK-DataGrid to LDAP server

Adding the Test-catalog to LDAP server

Creating the Test-Collection in the test-catalog

Register location for test-collection (snu-kma-pknu)

Create & Register & list file-list for all location

Copy file snu->kma or snu->pknu

List all location where some files can be found

Delete the files & location

Delete the Test-collection & Test-catalog

ldapadd

Globus-replica-management

Globus-replica-management

Globus-replica-Management& catalog

Globus-replica-management

Globus-replica-catalog

Globus-replica-management

Globus-replica-management

Page 48: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 48 -

uMeteo-KuMeteo-K

Grid FTPGrid FTP

Using ‘globus-url-copy’Secured ftpIncluding Globus Tool kit

Grid-ftp

Using ‘NCFTP’ Programsreliable and re-startable data transferparallel and Striped Data transferAutomatic negotiation of TCP buffer/window sizes

GSINCFTP

Globus Tool kit

Grid-Proxy-Init

Data transfer &Access

Data grid middleware

User certification

Page 49: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 49 -

uMeteo-KuMeteo-K

Data Grid in Globus ToolsData Grid in Globus ToolsGlobus Toolkit install-process

It appear that Test Result of Globus Software(globusrun) is successful

Grid Software : Globus 2.4 Toolkit

CA Software : SimpleCA

Result of run /bin/data

Grid-proxy-init

Globus-personal-gatekeeper

Globusrun

Page 50: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 50 -

uMeteo-KuMeteo-K

Data Grid in Globus ToolsData Grid in Globus ToolsGSINCFTP Testing - Successful

SNU-SNU- Cdldata climate

SNU-KMA- Cdldata Neosky15

SNU-PKNU- Cdldata PknuGB01

Page 51: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 51 -

uMeteo-KuMeteo-K

Replica management Replica management

- Layer on other Grid services GSI, transport, information service

- Use LDAP as catalog form at and protocol, for consistency

- Use as a building block for other tools

Characteristic of Replica management

- LDAP object classes for representing logical-to physical mapping in an LDAP catalog- Low-level replica catalog * globus_replica_catalog library * manipulate replica catalog-High-level replica catalog * globus_replica_manager library * Combines calls to file transfer operation calls to low-level API functions

Replica catalog

Page 52: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 52 -

uMeteo-KuMeteo-K

Replica Catalog Structure Replica Catalog Structure

Logical Collection

Global & regionalObservation data

File: AMIP2 Jan 1997

File: AMIP2 Jan 1997

Replica catalog

Logical Collection

Global & regionalPrediction data

File: NCEP Jan 1997

File: NCEP Jan 1997

Logical Collection

Global & regionalObservation data

Logical Collection

Global & regionalObservation data

Logical File parent

Logical FileJan 1999

Logical FileFeb 1997

File: NCEP Jan 1997File: NCEP Jan 1997

…Protocol : gsi-ftp

Address: gsi-ftp://cdldata.snu.ac.kr/cdldata1

File: NCEP Jan 1997File: NCEP Jan 1997

…Protocol : gsi-ftp

Address: gsi-ftp://cpsata.snu.ac.kr/cdldata2

Logical FileJan 1997

Logical FileJan 1999

Page 53: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 53 -

uMeteo-KuMeteo-K

Data Replication Management TestData Replication Management TestLocation A

host name : climate.snu.ac.krSlapd & Grid-FTP running

Logical Name : climate prediction ALocation : /home/globus/dataList of file : climatePrediction 1

climatePrediction 2climatePrediction 3

Location B host name : cdldata.snu.ac.kr

Slapd & Grid-FTP runningLogical Name : climate prediction B

Location : /home/ymyang/dataList of file : climatePrediction 4

climatePrediction 5climatePrediction 6

Copy Delete Copy Delete

Page 54: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 54 -

uMeteo-KuMeteo-K

Data Grid in Globus ToolsData Grid in Globus ToolsScenario for globus replica service – between ‘cdldata’ of SNU and ‘pknuGB01’ of PKNU

Running Shell Script for globus replica services

In the Copy command, there is someProblem that it is available to copy

a file from SNU to PKNU, but it Occurred error when doing opposite.We suppose that it result in from

Firewall policy of PKNU Computing Agency

Page 55: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 55 -

uMeteo-KuMeteo-K

In the futureIn the future•Multicasting network might be necessary for duplex Access Grid. => Currently, ICSYM/PKNU and NCAM/KMA within uMeteo-K used unicast quick bridge network (KISTI supported)

•Enhancement of display panel and improvement of sound quality might be necessary. =>Update to AG version 2.0

•An urgent repair might be necessary for the failure on the common DNS identification among members of uMeteo-K

•Addition to uMeteo-K CG testbed nodes

• Between SNU and KMA, we is about to testing Globus replica service

• Application of realistic scenarios for uMeteo-K

Page 56: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 56 -

uMeteo-KuMeteo-K

Future plan of uMeteo-KFuture plan of uMeteo-K

Ocean Grid

NDP Grid

APCN Grid

Environ Grid

Energy Grid

Hydrologic Grid

N*Grid

CAgM Grid

uMeteo-KuMeteo-K

Page 57: UMeteo-K - 1 - Principle Investigator : Jai-Ho Oh (Pukyong National Univ, KOREA) Co-researchers: In-Sik Kang (Seoul National Uuiv, KOREA) Byung-Lyol Lee.

- 57 -

uMeteo-KuMeteo-K

Thank you for your Thank you for your attention!attention!