MM-4095, Innovating with AMD Multimedia Technologies, by Amit Mookerjee and Carl Wakeland

1,968 views

Published on

Presentation MM-4095, Innovating with AMD Multimedia Technologies, by Amit Mookerjee and Carl Wakeland at the AMD Developer Summit (APU13) November 11-13, 2013.

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,968
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
26
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

MM-4095, Innovating with AMD Multimedia Technologies, by Amit Mookerjee and Carl Wakeland

  1. 1. INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES AMIT MOOKERJEE SENIOR MANAGER, MEDIA SOFTWARE SOLUTIONS, AMD CARL WAKELAND FELLOW DESIGN ENGINEER, AMD
  2. 2. AMD Media SDK Enabling Developers to Provide the Best Multimedia Experiences on the AMD platform
  3. 3. Multimedia Experiences on AMD Video Editing/Transcode Cloud Gaming Wireless Display Video Conferencing Remote Desktop Video Playback 3 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  4. 4. AMD MULTIMEDIA SOFTWARE STACK Applications ISV ISV MFT MFT ISV MFT Media SDK AMD Media Framework (AMF) DirectX OpenCL Driver AMD HW 4 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 OpenGL
  5. 5. MEDIA SDK1.0 SUMMARY MFTs for leveraging Media HW accelerator blocks for video encoding/decoding Video Quality MFT for video pre/post processing AMF-DEM library for use in low latency applications Support for Windows 7/8 Desktop as well as Windows 8 Store Application* * AMF-DEM library only supports classic desktop applications 5 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  6. 6. MEDIA SDK1.0 VALUE FOR DEVELOPERS  Leverage AMD’s industry leading multimedia IP ‒ Leverage well known video processing features like AMD Steady VideoTM ‒ Leverage the unique VCE-DEM feature on AMD APUs/dGPUs in low latency applications like wireless display and remote desktop  Optimal use of Heterogeneous Compute in Multimedia Apps ‒ eg. Buffer sharing on GPU, DX to OpenCL inter-op  Reduce Time to Market for Multimedia ISVs ‒ Optimized sample code for targeted application use cases ‒ Developer collateral and support via forum 6 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  7. 7. MEDIA SDK ROADMAP Q4 Q1 Q2 Q3 APU13 2013 2014 Media SDKv1.0 Beta Media SDKv1.0 GA Media SDKv1.1 Nov Jan Jun MediaSDKv1.0: MediaSDKv1.1: - - - Video quality MFT for video processing AMF-DEM library for low latency apps Windows 8 Store Support 7 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 - AMF library for video encode/decode/processing Multi-GPU support Cloud gaming support Q4
  8. 8. Beta Announcement & Demos
  9. 9. ADDITIONAL INFORMATION Fast, easy mobile computing and gaming; Victor Chin @ Splashtop; 2:45-3:30pm, Nov 12 ScreenMirror – A Unified screen mirroring solution; Nao Yoshikawa @ ArcSoft;11:0011:45am,Nov 12 Miracast with AMD Wireless Display Technology; Daryl Sartain @ AMD ; 5:00-5:45pm,Nov 12 RapidFire API; Dmitry Kozlov @ AMD ; 4:00-4:45pm, Nov 12 Bay Area Multimedia Meetup - http://www.meetup.com/Bay-Area-MultimediaMeetup-Group/ 9 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  10. 10. AMD TRUEAUDIO PROCESSOR CARL WAKELAND FELLOW DESIGN ENGINEER, AMD
  11. 11. BENEFITS OF AMD TRUEAUDIO ACCELERATION FOR GAMERS  Raising the bar for the audio gaming experience on PC ‒ More audio objects and higher-resolution sound environments, with minimal workload added to the CPU ‒ Eliminate the workload uncertainty factor sound designers have when relying completely on CPU-based offload ‒ TrueAudio provides a baseline of bonus audio processing throughput that sound designers can add to their typical 10% CPU utilization budget  Enhanced headset experience ‒ Implement enhanced environmental 3D object positioning using position information from the game engine ‒ TrueAudio works inside the game application itself. OS audio stack is not involved ** All features above are dependent on 3rd Party ISVs such as game developers, audio middleware, etc.. 11 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  12. 12. OTHER POTENTIAL TRUEAUDIO USES  Content management ‒Audio search pre and post-processing ‒ Quickly navigate through hundreds of sounds to find just the one you want ‒ Pick distinct songs out of your library just by pointing the mouse and listening  Professional Audio Processing ‒Client digital audio workstation applications ‒Use TrueAudio to accelerate : ‒ Music creation with complete control over every aspect of the sound and add custom effects ‒ Add dozens of layers of sound, music and dialogue to your movie masterpiece ** All features above are dependent on 3rd Party ISVs, audio middleware, etc.. 12 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  13. 13. AMD TRUEAUDIO HARDWARE ARCHITECTURE Tensilica HiFi EP Subsystem Bus Routing and Bridging DSP0 Address Translation Interrupt Routing GPU Interrupt Clock/Reset/Pwr Control I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM AMD TRUEAUDIO Registers Semaphore I/F Sync Memory Client/Target MMIO MMIO Debug JTAG Bus Bridging Tensilica HiFi EP Subsystem Address Translation DSP1 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM Routing and Arbitration Streaming DMA Engine Address Translation Memory Bus Interface with scattergather Translation Apertures Tensilica HiFi EP Subsystem DSP2 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM 13 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 384 K Shared Instruction/Data RAM Memory
  14. 14. AMD TRUEAUDIO DSP FEATURES Tensilica HiFi EP Subsystem  Tensilica HiFi EP instruction set DSP0 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM Tensilica HiFi EP Subsystem D-Cache 32KB  Tensilica Xtensa SP float support, DP assistance (also supports some transcendentals)  32 KB instruction and data caches  8 KB of scratch RAM used for fast local operations DSP1 I-Cache 32KB  Three Audio Optimized DSP cores 8 KB Scratch RAM Tensilica HiFi EP Subsystem  External power/clock management for clock freq/voltage (up to 900 MHz) DSP2 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM 14 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  15. 15. AMD TRUEAUDIO SPECIFIC HARDWARE FEATURES  Streaming DMA engine ‒ Multichannel with programmable descriptors, IOC ‒ Scatter gather architecture  Internal Shared memory ‒ 384 KB of shared internal memory, 8 KB banks ‒ Independently arbitrated for con concurrent access of DMA and each DSP Bus Routing and Bridging ‒ Up to 64 MB addressable space in frame buffer GPU Interrupt Address Translation Clock/Reset/Pwr Control AMD TRUEAUDIO Registers Semaphore I/F Sync Memory Client/Target MMIO MMIO Debug JTAG Bus Bridging Address Translation  Bus interface to frame buffer/system memory ‒ High performance, low latency access to frame buffer memory Interrupt Routing Routing and Arbitration Streaming DMA Engine Address Translation Memory Bus Interface with scattergather Translation Apertures ‒ Windowed into internal AMD TRUEAUDIO system memory space 15 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 384 K Shared Instruction/Data RAM Memory
  16. 16. AUDIO ALGORITHMS COMPLETED AND IN DEVELOPMENT  AMD is engaged with tools and plugin developers to accelerate the following with TrueAudio: ‒AudioKinetic ‒ Convolution reverb ‒ GenAudio AstoundSound RTI positional audio ‒FMOD ‒ FMOD Reverb ‒ ML1 Limiter from McDSP ‒ Others to be announced 16 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  17. 17. ACCESSING AMD TRUEAUDIO FUNCTIONALITY FROM APPLICATIONS Apps & Game Engines w/ Middleware Support Game Engines w/ Integrated Sound Engine Middleware API Audio Middleware Higher-Level API Optional API Abstraction Layer(s) AMD Audio API TrueAudio User-mode Services Library 17 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 AMD Audio API  Audio Middleware ‒ Audio Middleware is responsible for audio engine framework ‒ Audio algorithms typically ship with middleware - these can be accelerated with TrueAudio accessible through AMD Audio API  Game Engines ‒ Game engines can integrate sound engine, but most work with audio middleware vendors such as FMOD, AudioKinetic
  18. 18. TRUEAUDIO ENABLEMENT FOR DEVELOPERS  3rd Party Middleware Integration ‒ Less integration work required ‒ Use existing high level Middleware API to accelerate plugins w/ TrueAudio  Choose from native middleware plugins or 3rd party ‒ Middleware licensing required 18 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 Game Engine Middleware API Middleware Plugins (ie. FMOD, AudioKinetic) 3rd Party Plugins (ie. McDSP) Middleware AMD Audio API AMD TrueAudio
  19. 19. AUDIO DATA FLOW & OUTPUT SUPPORT Application / Game Audio Middleware Effects & Algorithms AMD TRUEAUDIO 19 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 Sound Card Driver OS Driver Stack Audio Assets 3.5mm Audio Jack USB Audio Driver USB HDMI/D P Audio Driver HDMI/DP
  20. 20. SUMMARY  Programmable audio pipeline grants artistic freedom to game audio engineers for sound processing  Easy to access through popular audio libraries used by top game developers  Fundamentally redefines the nature of a modern PC graphics card  Spatialization, reverb, mastering limiters and simultaneous voice decode are only the beginning 20 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  21. 21. DISCLAIMER & ATTRIBUTION The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical errors. The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to product and roadmap changes, component and motherboard version changes, new model and/or product releases, product differences between differing manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. AMD assumes no obligation to update or otherwise correct or revise this information. However, AMD reserves the right to revise this information and to make changes from time to time to the content hereof without obligation of AMD to notify any person of such revisions or changes. AMD MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE CONTENTS HEREOF AND ASSUMES NO RESPONSIBILITY FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION. AMD SPECIFICALLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE. IN NO EVENT WILL AMD BE LIABLE TO ANY PERSON FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF AMD IS EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. ATTRIBUTION © 2013 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and/or other jurisdictions. Windows is a registered trademark of Microsoft Corporation. Other names are for informational purposes only and may be trademarks of their respective owners. 21 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  22. 22. DISCLAIMER & ATTRIBUTION Images used in this presentation are courtesy of CyberLink, Irrational Games and Square Enix ©2013 Take - Two Interactive Software, Inc. Developed by Irrational Games. BioShock, BioShock Infinite, Irrational Games, 2K Games, Take - Two Interactive Software and their respective logos are all trademarks of Take-Two Interactive Software, Inc. The ratings icon is a trademark of the Entertainment Software Association. All other trademarks are property of their respective owners. All rights reserved. ©2013 Tomb Raider © SQUARE ENIX, Ltd. SQUARE ENIX and the SQUARE ENIX logo are registered trademarks or trademarks of Square Enix Holdings Co., Ltd. Lara Croft, Tomb Raider, Crystal Dynamics, the Crystal Dynamics logo, Eidos, and the Eidos logo are trademarks of SQUARE ENIX, Ltd. All other trademarks are the property of their respective owners. All rights reserved. 22 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

×