HSA FOR APPLICATION PROGRAMMING Wen-mei W. Hwu CTO, MulticoreWare, Inc. Professor University of Illinois, Urbana-Champaign
Jul 04, 2015
HSA FOR APPLICATION
PROGRAMMING
Wen-mei W. Hwu
CTO, MulticoreWare, Inc.
Professor University of Illinois, Urbana-Champaign
CURRENT GPU COMPUTING PAIN
POINTS
Kernel launch overhead
Limited virtual and physical memory space
Extra data movement in I/O and networking
Tedious host code
Multiple source code development
KERNEL LAUNCH OVERHEAD
DESIRED DATA TRANSFER BEHAVIOR
Main Memory
(DRAM)
GPU card
(or other Accelerator cards)
CPU
DMADevice
Memory
Network I/O
Disk I/O
SAMOS 2013
ACTUAL DATA TRANSFER BEHAVIOR
Main Memory
(DRAM)
GPU card
(or other Accelerator cards)
CPU
DMADevice
Memory
Network I/O
Disk I/O
Each additional copy
diminishes application-
perceived bandwidth
SAMOS 2013
HSA COMMON ADDRESS SPACE
STANDARDIZED USER-LEVEL QUEUES
LOW OVERHEAD KERNEL LAUNCH
DYNAMIC COMPILATION AND BINARY
COMPATIBLITY
FAMILIAR COMPUTATION ORGANIZATION
EXAMPLE: COMPUTER VISION
EXAMPLE EXECUTION TIME
TOOLS WORKING GROUP
Tools Group will be looking at foundation for Developer Tools (compilation,
debugging and performance analysis)
Working with the working group to insure the right interface are in place Compilation,
Debugging, and Performance Analysis initially
We act as stewards for
LLVM backend for generating HSAIL (AMD/MCW)
HSA functional simulator with GDB support (AMD/MCW)
HSA performance simulator (AMD)
Loader Library for Simulator - BRIG object loading support ( AMD)
Longer Terms will spawn sub-group that will drive requirement for language
support for HSA
C, C++, C++ AMP
Java (JVM, Dalvik)
Python
JavaScript
DSL…
…Hwu 2013
CURRENT TIME TABLE
Kickoff Conference and Refined Charter –
November 2013
Tools Roadmap – December 2013
Initial Tools – December 2013
Initial Language Tool Chains – January 2013
Hwu 2013
Please join us and contribute!
HAS BOOK IN THE MAKING
Audience
Performance application developers
System architects
Component architects
Software stack developers
Hwu 2013
Heterogeneous System Architecture
For Application Programming
EDITORIAL BOARD
Gaster, Benedict – Qualcomm
Hegde Manju - AMD
Hwu, Wen-mei - MulticoreWare/UIUC
Jablin, Thomas – MultcoreWare
Lokhmotov, Anton – ARM
Lu, Chien-Ping – MediaTek
Whitecotton, Bob - AMD
Hwu 2013
CURRENT TABLE OF CONTENTS
HSA Overview (50 pages)
Chapter 1: What is HSA? (Hwu/Jablin)
Chapter 2: The HSA Architecture (Hwu/Jablin/Others)
Chapter 3: A Programmer's View of HSA (Hwu/Jablin)
Chapter 4: The Tools Framework for HAS,
(Hwu/Jablin/Others)
Chapter 5: Mapping of Classical algorithms onto the
HSA Architecture (Hwu/Jablin)
Hwu 2013
CURRENT TABLE OF CONTENTS (CONT.)
Representative Workloads:
Chapter 6: Photography, Minh Do, Professor UIUC, CTO
Personify
Chapter 7: Video-Audio Search, Ren Wu, Baidu
Chapter 8: Augmented Reality Chein-ping Lu, MeidaTek
Chapter 9: Biometrics (Face Detection) Mike Jones, MERL
& Harris Gasparakis, AMD
Chapter 10: Audio-Video processing Bill Herz, Sr. Fellow
AMD
Hwu 2013
CURRENT TABLE OF CONTENTS (CONT.)
Chapter 11: Ray-Tracing, TBD
Chapter 12: Natural user Interfaces, Navneett Dallal,
CEO Flutter
Chapter 13: Physics Processing, Ronald Fedkiw,
Professor Stanford U. and Eftychios Sifakis
Chapter 14: Graphics enhancement, Ignacio Vargas, CTO,
Nextlimit (Interested)
Chapter 15: Communications and networking, Don Banks-
Cisco (Interested)
Chapter 16: Data/Business Analytics , Zubin Dowlaty,
CTO Mu Sigma
Hwu 2013
CURRENT TABLE OF CONTENTS (CONT.)
Chapter 17: Hadoop, Memcached and cloud frameworks,
Bharath Mundlapudi, CTO Orzota
Chapter 18: Bioinformatics Wu Feng, VirginiaTech
Chapter 19: Scientific Computations, Byunghyun Jang,
Univ Miss.
Chapter 20: Computer Aided Design and Engineering,
Martin Wong, Professor UIUC
Chapter 21: Oil and Gas, Nacho Navarro, UPC/BSC
(interested)
Hwu 2013
CURRENT TABLE OF CONTENTS (CONT.)
Chapter 22: Financial Services & Analysis, Surra
Yanamadala, CA VP
Chapter 23: Computer Vision facial expression,
Elnar Hajiyev, Realeye
Chapter 24: Legacy Code Interoperability, Wen-
mei and Tom Jablin, MCW
Chapter 25: Java for HSA, Gary Frost, AMD
Hwu 2013
MAJOR UPCOMING MILESTONES
Author Algorithm and Code Due – February 2014
Author Chapters Due – April 2014
Review Due Back to Authors – May 2014
Chapters to Elsevier – June 2014
Books available – October 2014
Hwu 2013
THANK YOU!
ANY MORE QUESTIONS?
Hwu 2013