Top Banner
www.nasa.gov Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research Center, Moffett Field, CA [email protected] (650) 604-4411 March 10, 2016
40

Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Apr 30, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

www.nasa.gov

Project Status Report High End Computing Capability Strategic Capabilities Assets Program

Dr. Rupak Biswas – Project Manager NASA Ames Research Center, Moffett Field, CA [email protected] (650) 604-4411

March 10, 2016

Page 2: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Next-Generation LTO-7 Technology Triples HECC Tape Storage Capacity

Mission Impact: Enhancing the tape library infrastructure enables HECC to keep pace with the ever-increasing data storage requirements of science and engineering users supporting NASA missions.

HECC’s archived user data grows by an average of 3 petabytes (PB) per month. Currently, the archive system contains approximately 111 PB of dual-copy data.

POCs: Bob Ciotti, [email protected], (650) 604-4408, NASA Advanced Supercomputing (NAS) Division; Davin Chan, [email protected], (650) 604-3613, NAS Division, CSC Government Solutions LLC

•  HECC engineers deployed Linear Tape Open (LTO-7), the next-generation tape technology, on the archive system. With this new technology, the tape library tripled in storage capacity.

•  LTO-7 is the 7th generation of the LTO tape format and stores 6 terabytes (TB) of uncompressed data per tape. Previously, HECC utilized LTO-5/6 technology that stored 1.5/2.5 TB per tape.

•  With this significant increase in tape capacity, the HECC archive systems can store approximately half-an-exabyte of data, with compression.

•  Data stored on the existing LTO-5/6 technology will be migrated over time to the LTO-7 media, and the move will be transparent to users.

2

Page 3: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

HECC Completes System Downtime Maintenance Activities

Mission Impact: Regular maintenance on the HECC systems provides a stable and well performing system for NASA users.

HECC engineers perform as much maintenance as possible without downtime on the Pleiades supercomputer and other resources, but changes that have the potential to be disruptive to users are planned for dedicated times.

•  HECC engineers completed dedicated time activities to deploy patches on Feb 18-19, as part of a patching schedule for HECC systems.

•  In addition to the system patches, activities completed during the downtime included: –  Firmware updates on the storage and InfiniBand

subsystems. –  Lustre filesystem patches and integrity

checking. –  Replacing failing hardware components. –  System stability and performance testing.

•  These maintenance activities were completed ahead of schedule and the systems were released back into production earlier than planned.

3

POCs: Bob Ciotti, [email protected], (650) 604-4408, NASA Advanced Supercomputing (NAS) Division; Davin Chan, [email protected], (650) 604-3613, NAS Division, CSC Government Solutions LLC

Page 4: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

New Monitoring Display Means Quicker, More Efficient System Support

Mission Impact: By improving the tools to monitor HECC resources, engineers and support staff can resolve issues more quickly and provide a better computing environment for users.

The newly deployed Heads-Up Display (HUD) provides a dashboard status of HECC resources to help staff quickly identify system issues.

•  HECC engineers deployed into production a modernized version of the in-house Heads-Up Display (HUD) system that Control Room staff use for system status reporting.

•  The original version of the HUD was developed 10 years ago, and it was becoming difficult to add enhancements and maintain the code. A year ago, staff began a project to modernize the code, with the goal to improve maintainability and simplify the configuration.

•  The HUD v2 project reduced the size of the codebase by a factor of 3 and significantly improved the maintainability of the code, which takes advantage of modern web technologies to improve the user interface.

4

POCs: Bob Ciotti, [email protected], (650) 604-4408, NASA Advanced Supercomputing (NAS) Division; Davin Chan, [email protected], (650) 604-3613, NAS Division, CSC Government Solutions LLC

Page 5: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

APP Team Simplifies Use of Application-Based Tests

Mission Impact: Simplifying the process of application-based testing saves time required to change the system and can result in a more stable environment for the user community.

Creation of an automated test application follows the workflow shown in the diagram above. The Script Generator (on the left side in yellow) produces both compilation and run scripts. The Verification and Recording software (on the right side in yellow) validates the results of a test run, compares performance to reference values, and stores results in a database.

POCs: Henry Jin, [email protected], NASA Advanced Supercomputing (NAS) Division; Robert Hood, [email protected], NAS Division, CSC Government Solutions LLC

•  HECC’s Applications Performance and Productivity (APP) team developed a set of scripts that allow staff outside the group to initiate application-based tests.

•  The scripts run the six applications from the SBU benchmark suite together with the NAS Parallel Benchmarks, and can be used to test proposed system configuration changes.

•  In addition to testing the correctness of execution, the scripts also report the duration of each run and compare that to a reference value. This facilitates detection of performance regressions, which sometimes occur after system configuration changes.

•  The APP team is extending this work to create a database of performance results that can be used to study system architectures and monitor system performance over an extended period.

5

Templates & parameters

Verification & Recording

Benchmark Source

Compilation Script

Run Script

Results Databases

Input Data

Job Results

System Information

Executable Script

Generator

Page 6: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Tools Team Upgrades HECC Incident Management System to BMC Remedy 9.1

Mission Impact: The Remedy 9.1 upgrade provides staff at the NAS facility with the most current features available and enhances the ticketing system used to manage HECC assets and user calls.

The BMC Remedy suite is used at the NASA Advanced Supercomputing facility to provide support functionality for incident, user problem, and asset management.

POC: Aqeel Rehman, [email protected], (650) 604-4566, NASA Advanced Supercomputing Division, Intrinsyx

6

•  HECC’s Tools team upgraded the Remedy incident, problem, and asset management system from version 8.1 to the latest version 9.1.

•  Enhancements available with the Remedy 9.1 upgrade include: –  Full text searches of all attachments and fields. –  Web-based “smart reporting” service with out-of-

the-box dashboard for creating and managing reports.

–  Improvements to the process of reconciling local customizations on upgrades.

–  Enhancements to the integration and application programming interface areas, and for moving code from development to production.

•  Team accomplishments during this upgrade included converting and testing Remedy customizations, upgrading to an Oracle 12c database, enabling Oracle case insensitivity on the database, and syncing the data for production cutover.

Page 7: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

HECC Tools Team Upgrades Oracle 11g Databases to Oracle 12c

Mission Impact: The Oracle 12c upgrade of ticketing, account management, and accounting databases provides HECC with the most current features available for Oracle databases and enhances our ability to maintain these databases.

Oracle databases are used for HECC’s Pleiades accounting reports, user account management, and the Remedy incident and asset management system.

POC: Mi Young Koo, [email protected], (650) 604-4528, NASA Advanced Supercomputing Division, CSC Government Solutions LLC

•  HECC’s Tools team upgraded the databases used for the Remedy incident management system and for HECC usage accounting and reporting from Oracle 11g to Oracle 12c.

•  Enhancements in release 12c include: –  Improved system resource usage and management with

a new multi-tenant container. –  Pluggable databases that provide ease in cloning

databases, and container databases that can be more systematically patched.

–  Oracle Enterprise Manager, which provides a single efficient, time-saving management console for backups and restores across all databases.

•  Accomplishments during this upgrade included conversion, testing, and transition of major Oracle databases for: Remedy incident and asset management; MicroStrategy HECC accounting reports; and LAMS, the local account management system used to manage accounts on the HECC systems, NAS servers and user systems. The Tools team updated all accesses to these databases to use Oracle 12c wallet credentialed connections.

7

Page 8: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Faster hyperwall Animation Converter Increases Visualization Group Productivity

Mission Impact: HECC Visualization team members can create new animations faster, and display animations from presenters (for example, for demonstrations or conferences) on the hyperwall more quickly.

Photo of the mini-hyperwall displaying a 4K Ultra-High Definition animation that shows 25 years of data from the North American Forest Dynamics study. The animation was converted using the new converter application.

POC: David Ellsworth, [email protected], (650) 604-0721, NASA Advanced Supercomputing Division, CSC Government Solutions LLC

•  The HECC in-house “makegiantmovie” animation converter was recently rewritten so it runs 28 times faster.

•  The speedup is due to a new and much faster animation encoder (FFMPEG), and the software no longer writes intermediate files to disk.

•  The converter is used to create high-resolution 4K (Ultra-High Definition) and higher animation files that can be played on the hyperwall and mini-hyperwall at the NAS facility.

•  Features of the new converter include: –  Can create animation files directly from a single

MPEG animation file input instead of only accepting uncompressed images.

–  New options allow the converter to do some calculations previously done by the user.

•  A future enhancement will allow the tool to be used on multiple nodes of a cluster.

8

Page 9: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

ESS Team Develops New Red Hat Enterprise Linux Release 7 Standard for HECC Systems

Mission Impact: The Red Hat Enterprise Linux Release 7 upgrade will provide staff at the NAS facility with the most current features available in Release 7 and access to the latest software applications.

Red Hat Enterprise Linux Release 7, the next generation of Red Hat’s comprehensive suite of operating systems, designed for mission-critical enterprise computing.

POC: Chris Shaw, [email protected], (650) 604-4354, NASA Advanced Supercomputing Division, CSC Government Solutions LLC

•  The Engineering Servers and Services (ESS) team developed the new OS standard to be used for the infrastructure servers and workstations. This standard, based on Red Hat Enterprise Linux Release 7, is being used for the upgrade of over 250 systems.

•  Enhancements offered by the new standard include support for: –  XFS filesystem, allowing filesystems up to 500 terabytes in

size. –  Linux Unified Key System (LUKS) version 4.10.1 disk

encryption, providing faster multi-threaded encryption. –  Firewalld, enabling the firewall configuration to be updated

without stopping/restarting a system. –  Systemd, allowing applications and services to start at boot

time. –  NAStruck version 2, allowing backups of XFS filesystems at a

faster, more efficient rate. –  CFEngine 3, providing full configuration control for all Red

Hat 7 modules. –  Center for Internet Security (CIS) Benchmark configurations

for Red Hat 7. •  The upgrade of the servers and workstations from Red Hat

Enterprise Linux Release 6 to the new Red Hat Enterprise Linux Release 7 standard will be systematically completed over the next couple of years.

9

Page 10: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Projecting Sea Level Rise by Modeling the Evolution of Ice Sheets * Mission Impact: Understanding and projecting the

evolution of polar ice sheets is a priority for the global science community. By leveraging HECC resources, scientists can complete jobs in hours, compared to weeks on conventional computing resources.

This image from the Ice Sheet System Model represents the computed velocities for the entire continent of Antarctica. Brown and green represent relatively slow ice surface velocities (fractions of meters per year to a few meters per year). Blue and purple represent much faster velocities, ranging up to 3,000 meters per year.

POCs: Gilberto Perez, [email protected], University of California, Irvine; Eric Larour, [email protected], (818) 970.8032, Jet Propulsion Laboratory

•  A team at NASA’s Jet Propulsion Laboratory (JPL) and the University of California at Irvine (UCI) use Pleiades extensively to accurately model the evolution of ice sheets and understand how freshwater fluxes to the ocean will impact sea level rise in the coming decades.

•  Using the open-source Ice Sheet System Model (ISSM) software, developed at JPL/UCI, the team’s results have had a widespread impact on the cryosphere scientific community. Among their contributions: –  ISSM’s automatic differentiation feature, which enables a new

generation of spatiotemporal inversion algorithms that can assimilate NASA remote sensing data into projections of the state of polar ice caps in a changing climate.

–  Optimization of bedrock topography data, and creation of physically consistent bedrock topography for the entire Greenland ice sheet.

–  Improvements in modeled physical processes, for example: calving front dynamics for outlet glaciers in Greenland; ice/ocean interactions for ice streams flowing into the Antarctic Ocean; hydrology for ice/bed conditions under melting glaciers; and paleo reconstructions for model spin-ups over long time periods.

•  While ISSM can be deployed in a wide range of HEC environments, the JPL team’s reliance on Pleiades is of particular importance—they regularly complete large simulation runs involving thousands of computational nodes on the system.

10

* HECC provided supercomputing resources and services in support of this work

Page 11: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

SLS Ignition Overpressure/Sound Suppression Water System Simulations *

Mission Impact: Simulations run on Pleiades identified problems that led to critical design changes in the SLS Ignition Overpressure/Sound Suppression system, avoiding expensive redesigns and delays that would have occurred if the problems had been detected much later during full-scale testing activities.

Simulation of the Ignition Overpressure/Sound Suppression (IOP/SS) system projecting water during ignition, depicted by a light blue isosurface under the Space Launch System’s RS-25 liquid engines. Note the undesirable water splash upward between the two engine banks.

11

POC: Jeff West, [email protected], (256) 544-6309, NASA Marshall Space Flight Center

•  Researchers at NASA’s Marshall Space Flight Center are running simulations on Pleiades to analyze the Ignition Overpressure/Sound Suppression (IOP/SS) water system for the agency’s next-generation heavy-lift launch vehicle, the Space Launch System (SLS). –  The IOP/SS system will use water spray to mitigate

the overpressure and sound waves caused by the ignition of the SLS liquid engine rockets and solid rocket boosters (SRBs), preventing these effects from harming the vehicle.

–  Using a new volume-of-fluid model developed with the Loci-STREAM computational fluid dynamics code, the researchers simulated the SLS launch environment with early IOP/SS system designs to determine optimal placement of the water spray.

–  The simulation results identified water projection patterns that adversely affected both the SRBs and the Hydrogen Burn-off Igniter (HBOI) subsystem, leading to significant improvements in both the IOP/SS and HBOI designs.

•  New simulations will quantitatively predict the IOP/SS system’s mitigation of the IOP event, providing additional data for SLS design teams.

* HECC provided supercomputing resources and services in support of this work

Page 12: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

HECC Facility Hosts Several Visitors and Tours in February 2016

HECC’s Nick Bonifas (center right) takes social media guests and members of the press on a tour through the main computer room at the NAS facility as part of the State of NASA/Budget Rollout media event.

POC: Gina Morello, [email protected], (650) 604-4462, NASA Advanced Supercomputing Division

•  HECC hosted 5 tour groups in February; guests learned about the agency-wide missions being supported by HECC assets, and some groups also viewed the D-Wave 2X quantum computer system. Visitors this month included: –  Davut Kavranoglu, Chief Science & Technology

Advisor to the President of the Republic of Turkey; and other Turkish delegates who were guests of Eugene Tu, NASA Ames Center Director.

–  Traditional media experts and invited social media guests covering the State of NASA/Budget Rollout media event at Ames; the NAS facility was one of the tour stops.

–  Jerry Davis, Ames’ Chief Information Officer, received a HECC project overview and security summary from NAS managers.

–  Students from the Lassen Astrobiology Internship Program (Red Bluff High School, Lassen Volcanic National Park - National Park Service) visited NAS as part of their center tour.

12

Page 13: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Papers

•  “Using Gas Clouds to Probe the Accretion Flow Around SgrA*: G2’s Delayed Pericenter Passage,” A.-M. Madigan, M. McCourt. R. O’Leary, arXiv:1602.02760 [astro-ph.HE], February 8, 2016. * http://arxiv.org/abs/1602.02760

•  “Modelling the Central Constant Emission X-ray Component of η Carinae,” C. Russell, et al., Monthly Notices of the Royal Astronomical Society, vol. 457, issue 2, February 11, 2016. * http://mnras.oxfordjournals.org/content/early/2016/02/11/mnras.stw339.abstract

•  “Impact of Uncertainties in Atmospheric Boundary Conditions on Ocean Model Solutions,” A. Chaudhuri, R. Ponte, G. Forget, Ocean Modeling, February 12, 2016. * http://www.sciencedirect.com/science/article/pii/S1463500316000226

•  “Halo and Subhalo Demographics with Planck Cosmological Parameters: Bolshoi-Planck and MultiDark-Planck Simulations,” A. Rodriguez-Puebla, et al., arXiv:1602.04813 [astro-ph.CO], February 15, 2016. * http://arxiv.org/abs/1602.04813

•  “Suppression of Collisionless Magnetic Reconnection in Asymmetric Current Sheets,” Y.-H. Liu, M. Hesse, arXiv:1602.05118 [physics.plasm-ph], February 16, 2016. * http://arxiv.org/abs/1602.05118

13

* HECC provided supercomputing resources and services in support of this work

Page 14: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Papers (cont.)

•  “Neptune’s Orbital Migration Was Grainy, Not Smooth,” D. Nesvorny, D. Vokrouhlicky, arXiv:1602.06988 [astro-ph.EP], February 22, 2016. * http://arxiv.org/abs/1602.06988

•  “Skylon Aerospace Plane and Its Aerodynamics and Plumes,” U. Mehta, M. Aftosmis, J. Bowles, S. Pandya, Journal of Spacecraft and Rockets (AIAA), February 26, 2016.* http://arc.aiaa.org/doi/abs/10.2514/1.A33408

•  “Dawn-Dusk Asymmetries in Rotating Magnetospheres: Lessons from Modeling Saturn,” X. Jia, M. Kivelson, Journal of Geophysical Research: Space Physics, February 27, 2016. * http://onlinelibrary.wiley.com/doi/10.1002/2015JA021950/full

14

* HECC provided supercomputing resources and services in support of this work

Page 15: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

News and Events

•  A Stellar Collaboration: Supercomputing and NASA’s IRIS Observatory, NAS Image Feature, January 27, 2016—Using images from NASA’s Interface Region Imaging Spectrograph (IRIS) spacecraft and the Pleiades supercomputer, scientists are producing simulations that may help explain how the outer solar atmosphere is shaped and heated. http://www.nas.nasa.gov/publications/articles/feature_IRIS_Carlsson.html –  Pleiades Supercomputer Simulations Help Explain NASA’s IRIS Solar Observatory Findings,

NASA Ames Image Feature, February 1, 2016. http://www.nasa.gov/ames/image-feature/pleiades-supercomputer-simulations-help-explain-nasa-s-iris-solar-observatory-findings

–  Pleiades Supercomputer Simulations Help Explain NASA’s IRIS Solar Observatory Findings, Colorado Space News, February 3, 2016. http://www.coloradospacenews.com/pleiades-supercomputer-simulations-help-explain-nasas-iris-solar-observatory-findings/

•  NASA’s Investment in HPC is Supercharging Scientific Research, NetApp GovDataDownload Blog, February 5, 2016—Government and industry partnership has helped develop the high-end computing resources that will take humans to Mars, such as NASA’s flag-ship supercomputer, Pleiades, which is helping scientists push our knowledge of the universe further. http://govdatadownload.com/2016/02/05/nasas-investment-in-hpc-is-supercharging-scientific-research/

15

Page 16: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

News and Events (cont.)

•  Faster, Quieter, Cleaner: How NASA Imagines the 737 of 2035, CNET, February 24, 2016—CNET talks with NAS Division scientist Nateri Madavan about the future of commercial aircraft, during NASA Administrator Charles Bolden’s visit to Ames Research Center. Engineers and researchers across the agency are working together with industry partners to develop cleaner, faster, and quieter planes for more eco-friendly skies. http://www.cnet.com/news/faster-quieter-cleaner-how-nasa-imagines-the-737-of-2035/

•  Exomoons in the Hunt for Extraterrestrial Life: NASA Is Looking for a Real-Life Pandora, Outer Places, February 26, 2016—NASA is kicking the search for the first exomoon into gear, and researchers will use Pleiades to simulate billions of star-planet-moon configurations and compare results with Kepler data. http://www.outerplaces.com/science/item/11368-exomoons-in-the-hunt-for-extraterrestrial-life-astronomers-are-looking-for-a-real-life-pandora

16

Page 17: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

HECC Utilization

17

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Pleiades Endeavour Merope Production

Share Limit

Job Drain

Dedtime Drain

Limits Exceeded

Unused Devel Queue

Insufficient CPUs

Held

Queue Not Schedulable

Non-Chargable

Not Schedulable

No Jobs

Dedicated

Down

Degraded

Boot

Used

February 2016

Page 18: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

HECC Utilization Normalized to 30-Day Month

18

0

2,000,000

4,000,000

6,000,000

8,000,000

10,000,000

12,000,000

14,000,000

16,000,000

18,000,000

Stan

dard

Bill

ing

Uni

ts

NAS  

NLCS  

NESC  

SMD  

HEOMD  

ARMD  

Alloc.  to  Orgs  

Page 19: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

HECC Utilization Normalized to 30-Day Month

19

0

1

2

3

4

5

6

7

8

9

Stan

dard

Bill

ing

Uni

ts in

Mill

ions

ARMD ARMD Allocation With Agency Reserve

ARMD

1 2 3 4 5

6 7

1 8  Ivy  Bridge  Racks  added  mid-­‐Feb;  8  Ivy  Bridge  Racks  added  late  Feb  to  Pleiades  

2 4  Ivy  Bridge  Racks  added  mid-­‐March  to  Pleaides

3 6  Westmere  Racks  added  to  Merope,  Merope  Harpertown  reMred

4 16  Westmere  Racks  reMred,  3  Ivy  Bridge  Racks  added,  15  Haswell  Racks  added  to                                  Pleiades;  10  Nehalem  Racks  and  2  Westmere  Racks  added  to  Merope    

5 16  Westmere  Racks  reMred  from  Pleiades    

6 14  Haswell  racks  added  to  Pleiades  7 7  Merope  Nehalem  Racks  removed  from  Merope  

8 7  Merope  Westmere  Racks  added  to  Merope                

0

1

2

3

4

5

6

7

8

9

Stan

dard

Bill

ing

Uni

ts in

Mill

ions

HEOMD NESC HEOMD+NESC Allocation

HEOMD, NESC

6

5432

1

7

0

1

2

3

4

5

6

7

8

9

Stan

dard

Bill

ing

Uni

ts in

Mill

ions

SMD SMD Allocation With Agency Reserve

SMD

2

1 3

4

5

6 7

Page 20: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Tape Archive Status

20

0

30

60

90

120

150

180

210

240

270

Unique File Data Unique Tape Data Total Tape Data Tape Capacity Tape Library Capacity

Peta

Byt

es

Capacity

Used

HECC

Non Mission Specific NAS

NLCS

NESC

SMD

HEOMD

ARMD

February 2016

Page 21: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Tape Archive Status

21

0

30

60

90

120

150

180

210

240

270

Peta

Byt

es Tape Library Capacity

Tape Capacity

Total Tape Data

Unique Tape Data

Page 22: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Pleiades: SBUs Reported, Normalized to 30-Day Month

22

0

2,000,000

4,000,000

6,000,000

8,000,000

10,000,000

12,000,000

14,000,000

16,000,000

18,000,000

Stan

dard

Bill

ing

Uni

ts

NAS

NLCS

NESC

SMD

HEOMD

ARMD

Alloc. to Orgs

Page 23: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Pleiades: Devel Queue Utilization

23

0

250,000

500,000

750,000

1,000,000

1,250,000

1,500,000

1,750,000

2,000,000

2,250,000

2,500,000

Stan

dard

Bill

ing

Uni

ts

NAS

NLCS

NESC

SMD

HEOMD

ARMD

Devel Queue Alloc.

Page 24: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Pleiades: Monthly Utilization by Job Length

24

0  

500,000  

1,000,000  

1,500,000  

2,000,000  

2,500,000  

3,000,000  

3,500,000  

4,000,000  

0  -­‐  1  hours   >  1  -­‐  4  hours   >  4  -­‐  8  hours   >  8  -­‐  24  hours   >  24  -­‐  48  hours   >  48  -­‐  72  hours   >  72  -­‐  96  hours  >  96  -­‐  120  hours   >  120  hours  

Stan

dard  Billing  Units  

Job  Run  Time  (hours)  February 2016

Page 25: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Pleiades: Monthly Utilization by Size and Mission

25

0  

500,000  

1,000,000  

1,500,000  

2,000,000  

2,500,000  

3,000,000  

3,500,000  

1  -­‐  32   33  -­‐  64   65  -­‐  128   129  -­‐  256   257  -­‐  512   513  -­‐  1024   1025  -­‐  2048   2049  -­‐  4096   4097  -­‐  8192   8193  -­‐  16384  

Stan

dard  Billing  Units  

Job  Size  (cores)  

NAS  

NLCS  

NESC  

SMD  

HEOMD  

ARMD  

   

February 2016

Page 26: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Pleiades: Monthly Utilization by Size and Length

26

0  

500,000  

1,000,000  

1,500,000  

2,000,000  

2,500,000  

3,000,000  

3,500,000  

1  -­‐  32   33  -­‐  64   65  -­‐  128   129  -­‐  256   257  -­‐  512   513  -­‐  1024  1025  -­‐  2048  2049  -­‐  4096  4097  -­‐  8192   8193  -­‐  16384  

Stan

dard  Billing  Units  

Job  Size  (cores)  

>  120  hours  

>  96  -­‐  120  hours  

>  72  -­‐  96  hours  

>  48  -­‐  72  hours  

>  24  -­‐  48  hours  

>  8  -­‐  24  hours  

>  4  -­‐  8  hours  

>  1  -­‐  4  hours  

0  -­‐  1  hours  

February 2016

Page 27: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Pleiades: Average Time to Clear All Jobs

27

0  

24  

48  

72  

96  

120  

144  

168  

192  

216  

240  

264  

Mar-­‐15   Apr-­‐15   May-­‐15   Jun-­‐15   Jul-­‐15   Aug-­‐15   Sep-­‐15   Oct-­‐15   Nov-­‐15   Dec-­‐15   Jan-­‐16   Feb-­‐16  

Hours  

ARMD   HEOMD/NESC   SMD      

Page 28: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Pleiades: Average Expansion Factor

28

 1.00    

 2.00    

 3.00    

 4.00    

 5.00    

 6.00    

 7.00    

 8.00    

 9.00    

 10.00    

Mar-­‐15   Apr-­‐15   May-­‐15   Jun-­‐15   Jul-­‐15   Aug-­‐15   Sep-­‐15   Oct-­‐15   Nov-­‐15   Dec-­‐15   Jan-­‐16   Feb-­‐16  

ARMD   HEOMD   SMD  

Page 29: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Endeavour: SBUs Reported, Normalized to 30-Day Month

29

0

10,000

20,000

30,000

40,000

50,000

60,000

70,000

80,000

90,000

100,000

Stan

dard

Bill

ing

Uni

ts

NAS

NLCS

NESC

SMD

HEOMD

ARMD

Alloc. to Orgs

Page 30: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Endeavour: Monthly Utilization by Job Length

30

0  

2,000  

4,000  

6,000  

8,000  

10,000  

0  -­‐  1  hours   >  1  -­‐  4  hours   >  4  -­‐  8  hours   >  8  -­‐  24  hours   >  24  -­‐  48  hours   >  48  -­‐  72  hours   >  72  -­‐  96  hours  >  96  -­‐  120  hours   >  120  hours  

Stan

dard  Billing  Units  

Job  Run  Time  (hours)  February 2016

Page 31: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Endeavour: Monthly Utilization by Size and Mission

31

0  

2,000  

4,000  

6,000  

8,000  

10,000  

12,000  

14,000  

16,000  

1  -­‐  32   33  -­‐  64   65  -­‐  128   129  -­‐  256   257  -­‐  512   513  -­‐  1024  

Stan

dard  Billing  Units  

Job  Size  (cores)  

NAS  

NESC  

SMD  

HEOMD  

ARMD  

   

February 2016

Page 32: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Endeavour: Monthly Utilization by Size and Length

32

0  

2,000  

4,000  

6,000  

8,000  

10,000  

12,000  

14,000  

16,000  

1  -­‐  32   33  -­‐  64   65  -­‐  128   129  -­‐  256   257  -­‐  512   513  -­‐  1024  

Stan

dard  Billing  Units  

Job  Size  (cores)  

>  120  hours  

>  96  -­‐  120  hours  

>  72  -­‐  96  hours  

>  48  -­‐  72  hours  

>  24  -­‐  48  hours  

>  8  -­‐  24  hours  

>  4  -­‐  8  hours  

>  1  -­‐  4  hours  

0  -­‐  1  hours  

February 2016

Page 33: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Endeavour: Average Time to Clear All Jobs

33

0  

12  

24  

36  

48  

60  

72  

Mar-­‐15   Apr-­‐15   May-­‐15   Jun-­‐15   Jul-­‐15   Aug-­‐15   Sep-­‐15   Oct-­‐15   Nov-­‐15   Dec-­‐15   Jan-­‐16   Feb-­‐16  

Hours  

ARMD   HEOMD/NESC   SMD      

Page 34: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Endeavour: Average Expansion Factor

34

 1.00    

 1.50    

 2.00    

 2.50    

 3.00    

 3.50    

 4.00    

Mar-­‐15   Apr-­‐15   May-­‐15   Jun-­‐15   Jul-­‐15   Aug-­‐15   Sep-­‐15   Oct-­‐15   Nov-­‐15   Dec-­‐15   Jan-­‐16   Feb-­‐16  

ARMD   HEOMD   SMD  

Page 35: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Merope: SBUs Reported, Normalized to 30-Day Month

35

0

100,000

200,000

300,000

400,000

500,000

600,000

700,000

Stan

dard

Bill

ing

Uni

ts

NAS

NLCS

NESC

SMD

HEOMD

ARMD

Alloc. to Orgs

Page 36: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Merope: Monthly Utilization by Job Length

36

0  

50,000  

100,000  

150,000  

200,000  

250,000  

300,000  

0  -­‐  1  hours   >  1  -­‐  4  hours   >  4  -­‐  8  hours   >  8  -­‐  24  hours   >  24  -­‐  48  hours   >  48  -­‐  72  hours   >  72  -­‐  96  hours  >  96  -­‐  120  hours   >  120  hours  

Stan

dard  Billing  Units  

Job  Run  Time  (hours)  February 2016

Page 37: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project 37

Merope: Monthly Utilization by Size and Mission

0  

50,000  

100,000  

150,000  

200,000  

250,000  

1  -­‐  32   33  -­‐  64   65  -­‐  128   129  -­‐  256   257  -­‐  512   513  -­‐  1024   1025  -­‐  2048   2049  -­‐  4096   4097  -­‐  8192   8193  -­‐  16384  

Stan

dard  Billing  Units  

Job  Size  (cores)  

NAS  

NESC  

SMD  

HEOMD  

ARMD  

   

February 2016

Page 38: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project 38

Merope: Monthly Utilization by Size and Length

0  

50,000  

100,000  

150,000  

200,000  

250,000  

1  -­‐  32   33  -­‐  64   65  -­‐  128   129  -­‐  256   257  -­‐  512   513  -­‐  1024   1025  -­‐  2048  2049  -­‐  4096  4097  -­‐  8192   8193  -­‐  16384  

Stan

dard  Billing  Units  

Job  Size  (cores)  

>  120  hours  

>  96  -­‐  120  hours  

>  72  -­‐  96  hours  

>  48  -­‐  72  hours  

>  24  -­‐  48  hours  

>  8  -­‐  24  hours  

>  4  -­‐  8  hours  

>  1  -­‐  4  hours  

0  -­‐  1  hours  

February 2016

Page 39: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Merope: Average Time to Clear All Jobs

39

0  

6  

12  

18  

24  

30  

36  

Mar-­‐15   Apr-­‐15   May-­‐15   Jun-­‐15   Jul-­‐15   Aug-­‐15   Sep-­‐15   Oct-­‐15   Nov-­‐15   Dec-­‐15   Jan-­‐16   Feb-­‐16  

Hours  

ARMD   HEOMD/NESC   SMD      

Page 40: Project Status Report - NAS Home · Project Status Report High End Computing Capability Strategic Capabilities Assets Program Dr. Rupak Biswas – Project Manager NASA Ames Research

Mar 10, 2016 National Aeronautics and Space Administration High-End Computing Capability Project

Merope: Average Expansion Factor

40

 1.00    

 2.00    

 3.00    

 4.00    

 5.00    

 6.00    

 7.00    

Mar-­‐15   Apr-­‐15   May-­‐15   Jun-­‐15   Jul-­‐15   Aug-­‐15   Sep-­‐15   Oct-­‐15   Nov-­‐15   Dec-­‐15   Jan-­‐16   Feb-­‐16  

ARMD   HEOMD   SMD