TTG Apptimizer Dramatic increase in the speed of computations Pavel Ivanov, PhD Co-founder and Deputy CEO [email protected]
TTG ApptimizerDramatic increase
in the speed of computations
Pavel Ivanov, PhD
Co-founder and Deputy [email protected]
About ttgLabs● Founded: 2010
● Focus: optimization of computational software
● Products and services
● TTG Apptimizer toolkit for automatic software optimization
● ad hoc projects on speeding up customer software
● Customers: Russian and European companies
● Team:
● leading experts in software optimization
● 25+ years of experience in parallel computing, high
performance computing (HPC) and optimization
● Skolkovo resident: from 2012 (IT cluster)
Businesses worldwide struggle to speed up
their computations● Speed of computations is critical in many industries
● financial
● machinery and metal working
● oil & gas
● biotechnology
● medicine
● …
● Potential solutions
● Buy/update the hardware
● Develop new algorithms/software
● Improve/optimize the existing software
Graphics cards, the most promising solution● Different types of processors
● Massive computations are performed on graphics
accelerators (GPUs)
● 3072 cores (NVIDIA GM200)
vs 18 cores (Intel Xeon E5-2699v3)
● at least 10-fold performance gain
● much better energy efficiency
● much less $$ for 1 GFLOPS
Graphics cards, the most promising solution. But…
…Great Possibilities translate into Big Problems
• Performance is far below expectations
• Endless hardware upgrades
• Hardware efficiency could be much better
A challenge the enterprises face worldwide● Real performance is much beyond the expectations
● 10-30% performance gain rather than 10+ fold
THE REASON: the software is not optimized
Apps in a hybrid world. A two-edged sword
• HMPP (Caps enterprise)
• PGI Accelerator
(NVIDIA/The Portland
Group)
• Libra (GpuSystems)
• Xcelerit SDK (Xcelerit)
• StarPU
• …
• HMPP Autotuning
Directives
• Intel ArBB
Development/Porting Optimization
Mostly
solved
Mostly
open … so far
Let your software optimize itself !
• Manually
• Time- and resource-
consuming
• An endless game
• Software optimizes
itself in runtime
• Extremely cost-effective
• Once and forever
• Minimal changes in the
source code
Traditional approach Our approach: AUTOTUNING
Multifold performance gain.
AUTOMATICALLY !
• HMPP (Caps enterprise)
• PGI Accelerator
(NVIDIA/The Portland
Group)
• Libra (GpuSystems)
• Xcelerit SDK (Xcelerit)
• StarPU
• …
• HMPP Autotuning
Directives
• Intel ArBB
Development/Porting Optimization
Mostly
SolvedNOW SOLVED !
TTG Apptimizer
Apps in a hybrid world. A two-edged sword
TTG Apptimizer: a universal autotuning toolkit
TTG Apptimizer: as simple as 1-2-3
RESULTS for GPU-oriented software
● For highly optimized SW – 10% performance increase
● In general – 1,5- to 3-fold performance increase
● Add several lines to your source code
● Compile with TTG Apptimizer
● Run
0 2 4 6 8 10 12 14 16
Traditional approach (per year)
TTG Apptimizer (once)
Video Streams. Optimization efforts, days
TTG Apptimizer: customer benefits
● Saving time and money by 10-fold (at least)
● Dramatic boost in software performance
● Shorter time-to-market for computations-
driven products and services
● Less demands for developers’ skills
● Computations can be performed in the cloud
Potential applications● Simulations in geophysics and industrial geology
● Engineering models and industrial design● machinery and metal working
● power production
● Biotechnology and medicine● bioinformatics and genomics
● drug design
● Video processing● telemedicine
● video surveillance
● video analytics
● Big Data analysis
Projects (proof of concept)● Commercial projects for Russian and European customers
● engineering models
● thermal physics
● simulations in life science
● molecular dynamics
● image processing
● video processing
ttgLabs value proposition (1/2)
● If the customer uses in-house developed software, we
offer● licensing of TTG Apptimizer toolkit with full technical
support
OR
● porting the company’s source code to hybrid
platforms using
● embedding our autotuning technology
● deployment assistance
● technical support
● training and consulting
ttgLabs value proposition (2/2)
● If the customer uses or is ready to use an open source
software we offer● porting the open source code to hybrid platforms
● embedding our autotuning technology
● full deployment
● comprehensive technical support (bug fixing,
software upgrades,...)
● training and consulting
We are looking for partnerships with● Customers from various industries provided
● computations are business-critical
● the company already uses OR is potentially ready to use
GPUs/hybrid systems (on premise or in the cloud)
● the source code is at place or potentially can be available for
optimization
● Vendors of computations-intensive apps
● that use or are ready to port their software to
GPUs/hybrid systems
● Local resellers/system integrators
● focused on computations-intensive solutions,
software and/or services
Requests for further information are welcome
ttgLabs.com
Pavel Ivanov
+7 903 121 1420