Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Building a Deep Learning (Dream) Machine

2,427 views

Published on

Building a Deep Learning (Dream) Machine: DIY hardware hacking for the uninitiated. Talk given at Data Science London Meetup. 27 June 2016

Published in: Education
  • Be the first to comment

Building a Deep Learning (Dream) Machine

  1. 1. Building a Deep Learning (Dream) Machine DIY hardware hacking for the uninitiated Roelof Pieters @graphific http://www.graph-technologies.com 27 June 2016
  2. 2. http://graphific.github.io/
  3. 3. How: Machine Thank you gamers!
  4. 4. Why - Cheaper * - Can do things you can’t do in the cloud - Desktop = faster experiment iteration - Remote still possible - Customize to your own needs - Fun! * in my own particular case
  5. 5. Points to think about - How many GPUs now and later - Motherboard (40 lanes / 16x8x8x8 configuration for 4 GPUs) - Chassis with enough space + air flow - 4 GPUs: 7 PCIe slots (last GPU can be mounted at the bottom using only one slot) - CPU: good enough, as much cores as GPUs, make sure CPU supports 40 PCIe lanes, some new Haswell CPUs only support 32; - RAM: 2x of total GPU memory - SSD = nice if data doesn’t fit into GPU+RAM (or hdfs reads from disk): get larger SSD than your largest dataset - Mechanical disks: plenty of storage - PSU: don’t save on efficiency (titanium/platinum) - Cooling: Water (hard diy) or Fan (easy/cheap but noisy)
  6. 6. I: HARDWARE
  7. 7. How: Machine
  8. 8. How: Machine
  9. 9. How: Machine (2)
  10. 10. II: SOFTWARE
  11. 11. https://github. com/deeplearningpari s/dl-machine
  12. 12. And so on...
  13. 13. http://gitxiv.com/
  14. 14. http://www.creativeai.net/
  15. 15. GTX 1080
  16. 16. Drive PX 2 P100
  17. 17. EPGU
  18. 18. PGU
  19. 19. READ MORE
  20. 20. http://graphific.github.io/
  21. 21. https: //hackaday. io/project/1207 0-32-tflop- deep-learning- gpu-box
  22. 22. http://timdettmers. com/2015/03/09/dee p-learning- hardware-guide/
  23. 23. https://timdettmers. wordpress. com/2014/08/14/whi ch-gpu-for-deep- learning/

×