TTG Apptimizer
Dramatic increase
in the speed of computations
Pavel Ivanov, PhD
Co-founder and Deputy CEO
p_ivanov@ttgLabs.com
About ttgLabs
● Founded: 2010
● Focus: optimization of computational software
● Products and services
● TTG Apptimizer toolkit for automatic software optimization
● ad hoc projects on speeding up customer software
● Customers: Russian and European companies
● Team:
● leading experts in software optimization
● 25+ years of experience in parallel computing, high
performance computing (HPC) and optimization
● Skolkovo resident: from 2012 (IT cluster)
Businesses worldwide struggle to speed up
their computations
● Speed of computations is critical in many industries
● financial
● machinery and metal working
● oil & gas
● biotechnology
● medicine
● …
● Potential solutions
● Buy/update the hardware
● Develop new algorithms/software
● Improve/optimize the existing software
Graphics cards, the most promising solution
● Different types of processors
● Massive computations are performed on graphics
accelerators (GPUs)
● 3072 cores (NVIDIA GM200)
vs 18 cores (Intel Xeon E5-2699v3)
● at least 10-fold performance gain
● much better energy efficiency
● much less $$ for 1 GFLOPS
Graphics cards, the most promising solution. But…
…Great Possibilities translate into Big Problems
• Performance is far below expectations
• Endless hardware upgrades
• Hardware efficiency could be much better
A challenge the enterprises face worldwide
● Real performance is much beyond the expectations
● 10-30% performance gain rather than 10+ fold
THE REASON: the software is not optimized
Apps in a hybrid world. A two-edged sword
• HMPP (Caps enterprise)
• PGI Accelerator
(NVIDIA/The Portland
Group)
• Libra (GpuSystems)
• Xcelerit SDK (Xcelerit)
• StarPU
• …
• HMPP Autotuning
Directives
• Intel ArBB
Development/Porting Optimization
Mostly
solved
Mostly
open … so far
Let your software optimize itself !
• Manually
• Time- and resource-
consuming
• An endless game
• Software optimizes
itself in runtime
• Extremely cost-effective
• Once and forever
• Minimal changes in the
source code
Traditional approach Our approach: AUTOTUNING
Multifold performance gain.
AUTOMATICALLY !
• HMPP (Caps enterprise)
• PGI Accelerator
(NVIDIA/The Portland
Group)
• Libra (GpuSystems)
• Xcelerit SDK (Xcelerit)
• StarPU
• …
• HMPP Autotuning
Directives
• Intel ArBB
Development/Porting Optimization
Mostly
Solved
NOW SOLVED !
TTG Apptimizer
Apps in a hybrid world. A two-edged sword
TTG Apptimizer: a universal autotuning toolkit
TTG Apptimizer: as simple as 1-2-3
RESULTS for GPU-oriented software
● For highly optimized SW – 10% performance increase
● In general – 1,5- to 3-fold performance increase
● Add several lines to your source code
● Compile with TTG Apptimizer
● Run
0 2 4 6 8 10 12 14 16
Traditional approach (per year)
TTG Apptimizer (once)
Video Streams. Optimization efforts, days
TTG Apptimizer: customer benefits
● Saving time and money by 10-fold (at least)
● Dramatic boost in software performance
● Shorter time-to-market for computations-
driven products and services
● Less demands for developers’ skills
● Computations can be performed in the cloud
Potential applications
● Simulations in geophysics and industrial geology
● Engineering models and industrial design
● machinery and metal working
● power production
● Biotechnology and medicine
● bioinformatics and genomics
● drug design
● Video processing
● telemedicine
● video surveillance
● video analytics
● Big Data analysis
Projects (proof of concept)
● Commercial projects for Russian and European customers
● engineering models
● thermal physics
● simulations in life science
● molecular dynamics
● image processing
● video processing
ttgLabs value proposition (1/2)
● If the customer uses in-house developed software, we
offer
● licensing of TTG Apptimizer toolkit with full technical
support
OR
● porting the company’s source code to hybrid
platforms using
● embedding our autotuning technology
● deployment assistance
● technical support
● training and consulting
ttgLabs value proposition (2/2)
● If the customer uses or is ready to use an open source
software we offer
● porting the open source code to hybrid platforms
● embedding our autotuning technology
● full deployment
● comprehensive technical support (bug fixing,
software upgrades,...)
● training and consulting
We are looking for partnerships with
● Customers from various industries provided
● computations are business-critical
● the company already uses OR is potentially ready to use
GPUs/hybrid systems (on premise or in the cloud)
● the source code is at place or potentially can be available for
optimization
● Vendors of computations-intensive apps
● that use or are ready to port their software to
GPUs/hybrid systems
● Local resellers/system integrators
● focused on computations-intensive solutions,
software and/or services
Requests for further information are welcome
ttgLabs.com
Pavel Ivanov
p_ivanov@ttgLabs.com
+7 903 121 1420

ttgLabs - basic presentation (October 2015)_ENG

  • 1.
    TTG Apptimizer Dramatic increase inthe speed of computations Pavel Ivanov, PhD Co-founder and Deputy CEO p_ivanov@ttgLabs.com
  • 2.
    About ttgLabs ● Founded:2010 ● Focus: optimization of computational software ● Products and services ● TTG Apptimizer toolkit for automatic software optimization ● ad hoc projects on speeding up customer software ● Customers: Russian and European companies ● Team: ● leading experts in software optimization ● 25+ years of experience in parallel computing, high performance computing (HPC) and optimization ● Skolkovo resident: from 2012 (IT cluster)
  • 3.
    Businesses worldwide struggleto speed up their computations ● Speed of computations is critical in many industries ● financial ● machinery and metal working ● oil & gas ● biotechnology ● medicine ● … ● Potential solutions ● Buy/update the hardware ● Develop new algorithms/software ● Improve/optimize the existing software
  • 4.
    Graphics cards, themost promising solution ● Different types of processors ● Massive computations are performed on graphics accelerators (GPUs) ● 3072 cores (NVIDIA GM200) vs 18 cores (Intel Xeon E5-2699v3) ● at least 10-fold performance gain ● much better energy efficiency ● much less $$ for 1 GFLOPS
  • 5.
    Graphics cards, themost promising solution. But… …Great Possibilities translate into Big Problems • Performance is far below expectations • Endless hardware upgrades • Hardware efficiency could be much better
  • 6.
    A challenge theenterprises face worldwide ● Real performance is much beyond the expectations ● 10-30% performance gain rather than 10+ fold THE REASON: the software is not optimized
  • 7.
    Apps in ahybrid world. A two-edged sword • HMPP (Caps enterprise) • PGI Accelerator (NVIDIA/The Portland Group) • Libra (GpuSystems) • Xcelerit SDK (Xcelerit) • StarPU • … • HMPP Autotuning Directives • Intel ArBB Development/Porting Optimization Mostly solved Mostly open … so far
  • 8.
    Let your softwareoptimize itself ! • Manually • Time- and resource- consuming • An endless game • Software optimizes itself in runtime • Extremely cost-effective • Once and forever • Minimal changes in the source code Traditional approach Our approach: AUTOTUNING Multifold performance gain. AUTOMATICALLY !
  • 9.
    • HMPP (Capsenterprise) • PGI Accelerator (NVIDIA/The Portland Group) • Libra (GpuSystems) • Xcelerit SDK (Xcelerit) • StarPU • … • HMPP Autotuning Directives • Intel ArBB Development/Porting Optimization Mostly Solved NOW SOLVED ! TTG Apptimizer Apps in a hybrid world. A two-edged sword
  • 10.
    TTG Apptimizer: auniversal autotuning toolkit
  • 11.
    TTG Apptimizer: assimple as 1-2-3 RESULTS for GPU-oriented software ● For highly optimized SW – 10% performance increase ● In general – 1,5- to 3-fold performance increase ● Add several lines to your source code ● Compile with TTG Apptimizer ● Run 0 2 4 6 8 10 12 14 16 Traditional approach (per year) TTG Apptimizer (once) Video Streams. Optimization efforts, days
  • 12.
    TTG Apptimizer: customerbenefits ● Saving time and money by 10-fold (at least) ● Dramatic boost in software performance ● Shorter time-to-market for computations- driven products and services ● Less demands for developers’ skills ● Computations can be performed in the cloud
  • 13.
    Potential applications ● Simulationsin geophysics and industrial geology ● Engineering models and industrial design ● machinery and metal working ● power production ● Biotechnology and medicine ● bioinformatics and genomics ● drug design ● Video processing ● telemedicine ● video surveillance ● video analytics ● Big Data analysis
  • 14.
    Projects (proof ofconcept) ● Commercial projects for Russian and European customers ● engineering models ● thermal physics ● simulations in life science ● molecular dynamics ● image processing ● video processing
  • 15.
    ttgLabs value proposition(1/2) ● If the customer uses in-house developed software, we offer ● licensing of TTG Apptimizer toolkit with full technical support OR ● porting the company’s source code to hybrid platforms using ● embedding our autotuning technology ● deployment assistance ● technical support ● training and consulting
  • 16.
    ttgLabs value proposition(2/2) ● If the customer uses or is ready to use an open source software we offer ● porting the open source code to hybrid platforms ● embedding our autotuning technology ● full deployment ● comprehensive technical support (bug fixing, software upgrades,...) ● training and consulting
  • 17.
    We are lookingfor partnerships with ● Customers from various industries provided ● computations are business-critical ● the company already uses OR is potentially ready to use GPUs/hybrid systems (on premise or in the cloud) ● the source code is at place or potentially can be available for optimization ● Vendors of computations-intensive apps ● that use or are ready to port their software to GPUs/hybrid systems ● Local resellers/system integrators ● focused on computations-intensive solutions, software and/or services
  • 18.
    Requests for furtherinformation are welcome ttgLabs.com Pavel Ivanov p_ivanov@ttgLabs.com +7 903 121 1420