YOU ARE DOWNLOADING DOCUMENT

Please tick the box to continue:

Transcript
Page 1: Stanford: Solving the HPC Data Deluge

HPC Storage at Stanford University!

William Law Stanford Research Computing Center [email protected]!

Page 2: Stanford: Solving the HPC Data Deluge

We are a new center!

Working across disciplines, across the university.!

Page 3: Stanford: Solving the HPC Data Deluge

The grand tradition is for each research cluster to be a stand alone island.!

Page 4: Stanford: Solving the HPC Data Deluge

Backups? Who needs ‘em.! Oh, we do.!

Page 5: Stanford: Solving the HPC Data Deluge

Storage!

• AFS

• box.com

• GPFS

• Lustre

• NFS

• Full HW solutions (panasas, isilon, netapp)!

Page 6: Stanford: Solving the HPC Data Deluge

Data Transfer!

• Aspera (Enterprise, Faspex)

• Globus Online

• box.com!

Page 7: Stanford: Solving the HPC Data Deluge

Concerns!

•  IOPS

•  Storage Growth

•  Sharing/Transfer/Workflows

•  Data Integrity

•  Backups

•  Long Term Data Retention/Sustainability (who pays?)

•  Security and Compliance (and dealing with PHI)

•  Cost!

Page 8: Stanford: Solving the HPC Data Deluge

Path Forward!

Standardize platforms Use open protocols for access Provide access to common storage pools across resources!

Page 9: Stanford: Solving the HPC Data Deluge

Related Documents