0 Copyright 2016 FUJITSU Fujitsu HPC Solutions Empowering Science & Research …. and no worries. Ashok Chaudhary Sr. Application Analyst Fujitsu India Fujitsu World Tour 2016
0 Copyright 2016 FUJITSU
Fujitsu HPC Solutions Empowering Science & Research …. and no worries.
Ashok Chaudhary Sr. Application Analyst Fujitsu India
Fujitsu World Tour 2016
1 Copyright 2016 FUJITSU
This session is about: We underline, here, Fujitsu’s High Performance Computing(HPC) competence and how Fujitsu is helping hundreds of scientists and researchers in Indian academia & research to redefine their science environment and streamlined processes to enhance throughput.
Fujitsu World Tour 2016
You just do the science and leave the High-end computation worries to us ……
2 Copyright 2016 FUJITSU
Technological revolution had taken over biological evolution by far.
Fujitsu World Tour 2016
Today – Data-Intensive High-end computing Science ……….. Scientists are overwhelmed with humongous data from many different sources
Data captured by instruments
Data generated by simulations
Data generated by sensor networks
Few thousand years of Experimental Science description of natural phenomenon
Few hundred years of Theoretical Science Newton’s Laws, Maxwell’s Equations
Few decades of Computational Science Simulation of complex Science
3 Copyright 2016 FUJITSU
Human Society
Contributing to a secure and prosperous society, through new drug development and improved weather forecasting.
Creating a Better Life Health & Safety
Innovating Manufacturing Industry
Powerful new innovating manufacturing methods through high-speed ,accurate analysis / simulation.
Unveiling Mysteries Science
Exploring the origins of humankind ,space, and the universe through high-speed data processing and simulation.
Why ? Scientific & Technical Computing
Scientific & Technical computing has brought about not only "problem-solving" but also "creating new value".
6 Copyright 2016 FUJITSU
High Performance & Technical Computing
Experience and Tradition Means Achievements
7 Copyright 2016 FUJITSU
Fujitsu in Scientific / Technical Computing Aerospace
Japan Aerospace Exploration Agency (JAXA)
Advanced Research Institute for Cosmic Ray Research of Tokyo
Meteorology Japan Meteorology Agency
Astronomy National Astronomical Observatory of Japan
Manufacturing
Super-Kamiokande/
Image from Kamioka Observatory, Institute for
Cosmic Ray Research, University of Tokyo
Image from Japan
Meteorology Agency Supercomputer 「FX1」/
Image from JAXA
Greenhouse gases Observing
Satellite 「IBUKI」/
Image from JAXA
Supercomputer 「HX600」/
Image from Kyoto University
Supercomputer
Optical Telescope 「Subaru」/
Image from National
Astronomical Observatory of
Japan
Educational Institute Kyoto University -
8 Copyright 2016 FUJITSU
Technology Solutions PRIMERGY based HPC Ecosystem
Services and Support
Japan Global lead in High Performance Computing
Strategy, Development, Services and Support
Systems Europe,
ict GmbH - a company
HPC certified expert partner program
HPC application champions
Benchmarking Laboratories
Research & Development
Fujitsu’s HPC competency network
9 Copyright 2016 FUJITSU
High Performance Computing tradition
AP3000
PRIMEPOWER
HPC2500
FX1
K computer
FX10
Japan’s First
Vector (Array)
Supercomputer
(1977)
F230-75APU
VPP5000
VPP300/700
VPP500
VP Series
NWT*
PRIMERGY BX900 / BX400 PRIMERGY RX200 AP1000
FX100
Japan’s Largest
Cluster in Top500
(July 2004)
Top500 1st.
(Nov. 1993)
Gordon Bell Prize
(1994, 95, 96
Top500 1st.
(June and
November 2011)
PRIMERGY CX400-M1
PRIMERGY CX400-M2
PRIMERGY CX600-M1
10 Copyright 2016 FUJITSU
Augsburg factory
77000 m² total space / 35000 m² dedicated to production
Daily production
10000 mainboards for Fujitsu products and Industry customers
14000 thin clients, PCs, Workstations and mobile PCs
1200 servers and storage systems
80 racks integration
12 Copyright 2016 FUJITSU
What is the Parallel Application Lab ?
The lab is running as part of Fujitsu Systems Europe activities since 1996. Mission is to be a center of excellence in parallel programming, from mastering key technologies to providing consultancy and customer support world wide
Past and current activities Deep involvement in technologies development (Fujitsu MPI-2 and related performance analysis tools
Investigation of new HPC solutions like XEON-PHI, parallel file systems and new interconnect technologies
Port, adapt and tune large industrial applications on Fujitsu platforms (SPARC or Intel based), sustain Fujitsu performance benchmark activities.
Work in close cohesion with end users to innovate.
The team Multi-disciplinary team of experts covering most of scientific computing areas including computer science,
mathematics, computational fluid dynamic, climate and weather forecast, life science, physics and astrophysics.
13 Copyright 2016 FUJITSU
Study and tuning of numerical models
Weather forecast and climate modeling:
Unified Model from UK-Met and Harmony from HIRLAM Consortium
and COSMO
Life science and multiple integrated cores
technology evaluation with NCBI-Blast, GROMACS, …
Deep imaging for oil exploration
RTM Algorithms
Architecture for small and medium
sized cluster
Resource optimization and performance tuning toward best ratio price /performance for SMEs and small to medium
research groups
Smooth Integration new IOs technologies inside
compute nodes
Integrated Data Analytic solutions with latest MIC Technology from Intel
Integration and application on
boarding for HPC-Gateway
Development and tuning of complex applications with remote vizualization
solution
On Boarding of application in the web
based HPC-Gateway for end users
On-going activities
15 Copyright 2016 FUJITSU
The “K” Computer
The Largest commercial system in production:
No. 4 On the TOP500
700000 cores / 1410TB memory
Fujitsu Interconnect
11280TFlops peak / 10510TFlops Linpack
16 Copyright 2016 FUJITSU
ITER Project (Spain)
No. 138 on TOP500 (SC2013)
273,97 Tflops Rmax Linpack
17 Copyright 2016 FUJITSU
Fujitsu HPC-Gateway
INTELLIGENT APPLICATION PLATFORM for Business Managers, End-user and Administrators
~
Simplicity Expertise
18 Copyright 2016 FUJITSU
Democratising HPC
HPC expert
Standardise processes
Remote visualisation
Traceability, machine
learning
HPC consumers
Higher productivity and
throughput
New applications and
physics
New processes
FTS CONFIDENTIAL
HPC Gateway accompanies and enable users across the increasing spectrum of needs
HPC calculators
First applications
New domains
Consumer processes
Exp
onen
tial
use
r b
ase
19 Copyright 2016 FUJITSU
Adaptable productive interface, coherent integrated workplace
Seamless on/off-premise service approach
Work with expert and intelligent methods
Full oversight
Analytics for description, prediction and prescription
Tracking and auditing
Benefits to all
Business manager End-User IT Administrator
Secure and robust usage
Lower issue support, more value-adding development
Enhanced view of resource accounting
20 Copyright 2016 FUJITSU
Gateway Platform Architecture
Platform Database
REST API
Desktop Web Application Python, Curl, CLI
Client GUI
Workflow
Cluster Agent
Batc
h
manag
er
OS
Data
File
s
Applications
Cluster Agent
Batc
h
manag
er
OS
Data
File
s
Applications
Cluster Agent
Batc
h
manag
er
OS
Data
File
s
Applications
Cluster Agent
Batc
h
manag
er
OS
Data
File
s
Applications
21 Copyright 2016 FUJITSU
User Perspective
Intuitive interface
Web desktop Inline wiki docs Dashboard option Self-defined layout
REST API
Applications Monitoring
Fast simple 2D graphing
Real-time job data First “at a glance”
review of app
Mobility Data collection
Mobile device app Compact input Alerts/progress reports
Encoded application methods Dynamic and extendable
automated workflows Record inputs
Remote Visualisation
Interactive and lossless transmission of 3D graphics
Collaboration through team sharing of remote desktop
Multi-user mode
Attach existing GUI Integrate with Gateway
Platform functions Enable command-line actions
Attach existing GUI Integrate with Gateway
Platform functions Enable command-line actions
Record and track usage Identify trends and links Optimise processes
Projects/Teams
Structure applications and data around business
In-built security layer Role-based access
22 Copyright 2016 FUJITSU
Gateway as a Consolidated Global Workplace
Unique web desktop for productivity at first login for novice and expert users
Central access to global services and data
Simplicity in work management and collaboration
Seamless multi-cluster and multi-site scale-out
23 Copyright 2016 FUJITSU
Full Production Dashboard
Self-service organisation of windows and tools for own operational needs
24 Copyright 2016 FUJITSU
80M Engineers + Non-engineers
Application Editing – Creating relevant interface
Standard view with
application controls,
basic batch setup
and auto/explicit run
directory
8M Engineers
750K CAE Users
Source: Cambashi, Beyond CAE, Front End Analytics (2014)
Emerging concept of apps help bring
a wider range of users into simulation
Cross between workflow and
traditional simulation suite
Apps speak language of intended
user – for simulation analyst and
design engineer
Advanced view with
detailed batch
controls and direct
application control file
input
Dedicated app for
targeted model and
precise parameters
25 Copyright 2016 FUJITSU
Application Management
Service interface to methods
for applications, processes
or workflows
Controlled view of available
methods
Wiki inline documentation,
tooltips for common
commands
Tagging for search and filter
Easy application onboarding
26 Copyright 2016 FUJITSU
Project
Project
Team
Team
User Management
Access to objects and data controlled by Team and Project structures
Graphical administration interface
Identity mapped to system credentials
FIles
Mount points
Tasks
Project
Mem
ber
Edit
or
Adm
inis
trat
or Methods
Monitors
Processes
Team M
emb
er
Edit
or
Adm
inis
trat
or
Identity
27 Copyright 2016 FUJITSU
Dynamic Application Result Monitoring
Embedded with application method
Tabular and graph-based tracking of application metrics
Extraction application dependent
Self-service plots
28 Copyright 2016 FUJITSU
Rich File Exploration
All expected features plus range
of useful extras
Enhanced with file-specific and
dynamic functions
Direct activation of Remote
Terminal
Viewer for image files
Access controlled by team
membership
29 Copyright 2016 FUJITSU
Remote visualisation options
Dynamic monitoring within the
web desktop
Precision design/engineering with
accelerated imaging