Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC

378 views

Published on

HPC DAY 2017 - http://www.hpcday.eu/

FlyElephant Solutions for Data Science and HPC

Dmitry Spodarets | CEO at FlyElephant

Published in: Technology
  • Be the first to comment

  • Be the first to like this

HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC

  1. 1. FlyElephant Solutions for Data Science and HPC Dmitry Spodarets HPC DAY 2017
  2. 2. SolutionCompany overview 2014 FOUNDED 8 employees worldwide Locations Odessa (Ukraine) Dnipro (Ukraine) Passau (Germany) Biel (Switzerland) Partners The main focus of business: ● Data Science ● BigData ● High Performance Computing The Best Cloud Startup
  3. 3. Our computing infrastructures (60 data centers)
  4. 4. Data Science + HPC
  5. 5. Healthcare Financial Retail Life Sciences Manufacturing Automotive Oil & Gas Aerospace
  6. 6. Process Training model Deployed Model  Live Data Historical Data Result Creating model
  7. 7. Process Training model Deployed Model  Live Data Historical Data Result Creating model
  8. 8. Hardware & Software for Data Science Various hardware Various software
  9. 9. Hardware & Software for HPC Various hardware Various software
  10. 10. Hybrid Infrastructure
  11. 11. Containers Docker Singularity
  12. 12. Containers
  13. 13. Docker (Dockerfile) FROM gcr.io/tensorflow/tensorflow MAINTAINER Dmitry Spodarets <d.spodarets@flyelephant.net> RUN apt update && apt -y upgrade && apt -y install git curl wget CMD /run_jupyter.sh
  14. 14. Docker Hub
  15. 15. Docker Store
  16. 16. Docker ● docker images ● docker run -it --cpus="2" --name mycont registry.flyelephant.net/tensorflow ● docker exec -i -t mycont bash ● docker ps ● docker stats ● docker stop CONTAINER ID ● docker start CONTAINER ID ● docker rm CONTAINER ID
  17. 17. Docker Machine •Amazon Web Services •Digital Ocean •Exoscale •Generic •Google Compute Engine •IBM Softlayer •Microsoft Azure •Microsoft Hyper-V •OpenStack •Oracle •VirtualBox •Rackspace •VMware Fusion •VMware v •Cloud Air •VMware vSphere docker-machine create --driver azure --azure-subscription-id subscription-id --azure-resource-group resourcename --azure-ssh-user user --azure-size machine-name docker-machine ssh machine-name
  18. 18. nvidia-docker https://github.com/NVIDIA/nvidia-docker
  19. 19. What about containers for HPC?
  20. 20. Singularity
  21. 21. Singularity •First public release in April 2016, followed by a massive uptake •HPC Wire Editor’s choice: Top Technologies to Watch for 2017 •Simple integration with resource managers, InfiniBand, GPUs, MPI, file systems, and supports multiple architectures (x86_64, PPC, ARM, etc..) •Limits user’s privileges (inside user == outside user) •No root owned container daemon •Network images are supported via URIs and all require local caching: ○ docker:// - This will pull a container from Docker Hub ○ http://, https:// - This will pull an image or tarball from the URL, cache and run it ○ shub:// - Pull an image from the Singularity Hub http://singularity.lbl.gov/
  22. 22. Singularity - Usage Examples $ python ./hello.py Hello World: The Python version is 2.7.5 $ sudo singularity exec --writable /tmp/debian.img apt-get install python … $ singularity exec /tmp/debian.img python ./hello.py Hello World: The Python version is 2.7.12 Webinar "Introduction to Singularity" https://youtu.be/h5rDnCA3NJA
  23. 23. Singularity HUB https://singularity-hub.org
  24. 24. Contributors to Singularity
  25. 25. How our company helps businesses use containers and HPC technologies ?
  26. 26. ALL-IN-ONE AUTOMATED WORKFLOW PLATFORM
  27. 27. FlyElephant helps to prototype, run and scale data science models and engineering simulations on-premise or in the cloud to deliver the best results faster.
  28. 28. ● Computing Resources ● Ready Environments ● Process Automation ● Collaboration FlyElephant Features ● File Management ● API & CLI ● Marketplace ● Security
  29. 29. Computing Resources 60 data centers
  30. 30. Computing Resources NVIDIA TESLA V100 ● 2 x PCI Tesla V100 ● 2 x Intel Xeon E5-2630v4 ● 2.2 GHz, 128 GB RAM ● 960 GB SSD, 40 Gbps Port Will be available for tests from October 30th. For more details, please contact us.
  31. 31. Ready Environments ● Images Repository With Custom Software. ● Web Applications. ● Full SSH access. ● Remote Desktops. Get your ready environment in < 30 sec!
  32. 32. Ready Environments Jupyter Notebook
  33. 33. Ready Environments Supported Software We can easily add software you need!
  34. 34. Ready Environments Remote Desktop
  35. 35. Ready Environments FlowVision Case
  36. 36. Process Automation ● Deploying the infrastructure. ● Running Jobs. ● Sequences of Jobs. ● Scaling. ● Publishing Jobs as REST APIs. Process automation helps to go 10X faster.
  37. 37. Collaboration ● Public and private projects ● Sharing jobs and their result ● Team Management ● Expert Community Increase team’s productivity through rapid exchange of knowledge between members and expert support from community.
  38. 38. What our customers say about us
  39. 39. Hybrid Infrastructure
  40. 40. Core capabilities: ● Ready for using your local computing infrastructure. ● All platform functionalities available. ● Easy to get an extra our computing resources. ● Customer responsive support team.
  41. 41. Use Case 1 Connect computing resources to online FlyElephant Platform
  42. 42. Use Case 2 Full local infrastructure and extra computing resources through FlyElephant Platform.
  43. 43. Use Case 3 Full local infrastructure and special computing resources through FlyElephant Platform.
  44. 44. Thank you! Please contact me for a live demo or partnership. Dmitry Spodarets d.spodarets@flyelephant.net www.flyelephant.net

×