Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
FlyElephant Solutions for
Data Science and HPC
Dmitry Spodarets
HPC DAY 2017
SolutionCompany overview
2014
FOUNDED
8 employees worldwide
Locations
Odessa (Ukraine)
Dnipro (Ukraine)
Passau (Germany)
B...
Our computing infrastructures
(60 data centers)
Data Science + HPC
Healthcare
Financial
Retail
Life Sciences Manufacturing
Automotive Oil & Gas
Aerospace
Process
Training
model
Deployed
Model 
Live
Data
Historical
Data
Result
Creating
model
Process
Training
model
Deployed
Model 
Live
Data
Historical
Data
Result
Creating
model
Hardware & Software for
Data Science
Various hardware
Various software
Hardware & Software for
HPC
Various hardware
Various software
Hybrid Infrastructure
Containers
Docker Singularity
Containers
Docker (Dockerfile)
FROM gcr.io/tensorflow/tensorflow
MAINTAINER Dmitry Spodarets <d.spodarets@flyelephant.net>
RUN apt up...
Docker Hub
Docker Store
Docker
● docker images
● docker run -it --cpus="2" --name mycont registry.flyelephant.net/tensorflow
● docker exec -i -t m...
Docker Machine
•Amazon Web Services
•Digital Ocean
•Exoscale
•Generic
•Google Compute Engine
•IBM Softlayer
•Microsoft Azu...
nvidia-docker
https://github.com/NVIDIA/nvidia-docker
What about containers
for HPC?
Singularity
Singularity
•First public release in April 2016, followed by a massive uptake
•HPC Wire Editor’s choice: Top Technologies ...
Singularity - Usage Examples
$ python ./hello.py
Hello World: The Python version is 2.7.5
$ sudo singularity exec --writab...
Singularity HUB
https://singularity-hub.org
Contributors to Singularity
How our company helps businesses use
containers and HPC technologies ?
ALL-IN-ONE AUTOMATED WORKFLOW PLATFORM
FlyElephant helps to prototype, run and scale
data science models and engineering simulations
on-premise or in the cloud
t...
● Computing Resources
● Ready Environments
● Process Automation
● Collaboration
FlyElephant Features
● File Management
● A...
Computing Resources
60 data centers
Computing Resources
NVIDIA TESLA V100
● 2 x PCI Tesla V100
● 2 x Intel Xeon E5-2630v4
● 2.2 GHz, 128 GB RAM
● 960 GB SSD, ...
Ready Environments
● Images Repository With Custom Software.
● Web Applications.
● Full SSH access.
● Remote Desktops.
Get...
Ready Environments
Jupyter Notebook
Ready Environments
Supported Software
We can easily add software you need!
Ready Environments
Remote Desktop
Ready Environments
FlowVision Case
Process Automation
● Deploying the infrastructure.
● Running Jobs.
● Sequences of Jobs.
● Scaling.
● Publishing Jobs as RE...
Collaboration
● Public and private projects
● Sharing jobs and their result
● Team Management
● Expert Community
Increase ...
What our customers say about us
Hybrid Infrastructure
Core capabilities:
● Ready for using your local computing infrastructure.
● All platform functionalities available.
● Easy...
Use Case 1
Connect computing resources to online
FlyElephant Platform
Use Case 2
Full local infrastructure and extra computing resources
through FlyElephant Platform.
Use Case 3
Full local infrastructure and special computing resources
through FlyElephant Platform.
Thank you!
Please contact me for a live demo or
partnership.
Dmitry Spodarets
d.spodarets@flyelephant.net
www.flyelephant....
HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC
HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC
HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC
HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC
HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC
Upcoming SlideShare
Loading in …5
×

HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC

651 views

Published on

HPC DAY 2017 - http://www.hpcday.eu/

FlyElephant Solutions for Data Science and HPC

Dmitry Spodarets | CEO at FlyElephant

Published in: Technology
  • Be the first to comment

  • Be the first to like this

HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC

  1. 1. FlyElephant Solutions for Data Science and HPC Dmitry Spodarets HPC DAY 2017
  2. 2. SolutionCompany overview 2014 FOUNDED 8 employees worldwide Locations Odessa (Ukraine) Dnipro (Ukraine) Passau (Germany) Biel (Switzerland) Partners The main focus of business: ● Data Science ● BigData ● High Performance Computing The Best Cloud Startup
  3. 3. Our computing infrastructures (60 data centers)
  4. 4. Data Science + HPC
  5. 5. Healthcare Financial Retail Life Sciences Manufacturing Automotive Oil & Gas Aerospace
  6. 6. Process Training model Deployed Model  Live Data Historical Data Result Creating model
  7. 7. Process Training model Deployed Model  Live Data Historical Data Result Creating model
  8. 8. Hardware & Software for Data Science Various hardware Various software
  9. 9. Hardware & Software for HPC Various hardware Various software
  10. 10. Hybrid Infrastructure
  11. 11. Containers Docker Singularity
  12. 12. Containers
  13. 13. Docker (Dockerfile) FROM gcr.io/tensorflow/tensorflow MAINTAINER Dmitry Spodarets <d.spodarets@flyelephant.net> RUN apt update && apt -y upgrade && apt -y install git curl wget CMD /run_jupyter.sh
  14. 14. Docker Hub
  15. 15. Docker Store
  16. 16. Docker ● docker images ● docker run -it --cpus="2" --name mycont registry.flyelephant.net/tensorflow ● docker exec -i -t mycont bash ● docker ps ● docker stats ● docker stop CONTAINER ID ● docker start CONTAINER ID ● docker rm CONTAINER ID
  17. 17. Docker Machine •Amazon Web Services •Digital Ocean •Exoscale •Generic •Google Compute Engine •IBM Softlayer •Microsoft Azure •Microsoft Hyper-V •OpenStack •Oracle •VirtualBox •Rackspace •VMware Fusion •VMware v •Cloud Air •VMware vSphere docker-machine create --driver azure --azure-subscription-id subscription-id --azure-resource-group resourcename --azure-ssh-user user --azure-size machine-name docker-machine ssh machine-name
  18. 18. nvidia-docker https://github.com/NVIDIA/nvidia-docker
  19. 19. What about containers for HPC?
  20. 20. Singularity
  21. 21. Singularity •First public release in April 2016, followed by a massive uptake •HPC Wire Editor’s choice: Top Technologies to Watch for 2017 •Simple integration with resource managers, InfiniBand, GPUs, MPI, file systems, and supports multiple architectures (x86_64, PPC, ARM, etc..) •Limits user’s privileges (inside user == outside user) •No root owned container daemon •Network images are supported via URIs and all require local caching: ○ docker:// - This will pull a container from Docker Hub ○ http://, https:// - This will pull an image or tarball from the URL, cache and run it ○ shub:// - Pull an image from the Singularity Hub http://singularity.lbl.gov/
  22. 22. Singularity - Usage Examples $ python ./hello.py Hello World: The Python version is 2.7.5 $ sudo singularity exec --writable /tmp/debian.img apt-get install python … $ singularity exec /tmp/debian.img python ./hello.py Hello World: The Python version is 2.7.12 Webinar "Introduction to Singularity" https://youtu.be/h5rDnCA3NJA
  23. 23. Singularity HUB https://singularity-hub.org
  24. 24. Contributors to Singularity
  25. 25. How our company helps businesses use containers and HPC technologies ?
  26. 26. ALL-IN-ONE AUTOMATED WORKFLOW PLATFORM
  27. 27. FlyElephant helps to prototype, run and scale data science models and engineering simulations on-premise or in the cloud to deliver the best results faster.
  28. 28. ● Computing Resources ● Ready Environments ● Process Automation ● Collaboration FlyElephant Features ● File Management ● API & CLI ● Marketplace ● Security
  29. 29. Computing Resources 60 data centers
  30. 30. Computing Resources NVIDIA TESLA V100 ● 2 x PCI Tesla V100 ● 2 x Intel Xeon E5-2630v4 ● 2.2 GHz, 128 GB RAM ● 960 GB SSD, 40 Gbps Port Will be available for tests from October 30th. For more details, please contact us.
  31. 31. Ready Environments ● Images Repository With Custom Software. ● Web Applications. ● Full SSH access. ● Remote Desktops. Get your ready environment in < 30 sec!
  32. 32. Ready Environments Jupyter Notebook
  33. 33. Ready Environments Supported Software We can easily add software you need!
  34. 34. Ready Environments Remote Desktop
  35. 35. Ready Environments FlowVision Case
  36. 36. Process Automation ● Deploying the infrastructure. ● Running Jobs. ● Sequences of Jobs. ● Scaling. ● Publishing Jobs as REST APIs. Process automation helps to go 10X faster.
  37. 37. Collaboration ● Public and private projects ● Sharing jobs and their result ● Team Management ● Expert Community Increase team’s productivity through rapid exchange of knowledge between members and expert support from community.
  38. 38. What our customers say about us
  39. 39. Hybrid Infrastructure
  40. 40. Core capabilities: ● Ready for using your local computing infrastructure. ● All platform functionalities available. ● Easy to get an extra our computing resources. ● Customer responsive support team.
  41. 41. Use Case 1 Connect computing resources to online FlyElephant Platform
  42. 42. Use Case 2 Full local infrastructure and extra computing resources through FlyElephant Platform.
  43. 43. Use Case 3 Full local infrastructure and special computing resources through FlyElephant Platform.
  44. 44. Thank you! Please contact me for a live demo or partnership. Dmitry Spodarets d.spodarets@flyelephant.net www.flyelephant.net

×