Converging Big Data and
Application Infrastructure
Steven Pousty
OpenShift/Red Hat
@TheSteve0 on Twitter, IRC,SmugMug,Github,
Ingress, Instagram, Skype,and
Goals
1. Brief introduction to how things have evolved
2. Talk about what we have now
3. Demo of this in practice
4. Have fun!
Assumptions
1. You have written a web app at some point in your life
2. You know some basics of Spark and such
Where are we coming from
What about Apps?
This page intentionally left blank
Next Era
Welcome to Paradise
We have had some great developments
1. People figured out how to make commodity hardware do great things
2. Distributed software has gotten better
3. Programming languages have gotten easier
4. CS has put effort into statistical libraries
5. The browser has grown up
Example framework
Docker Containers
Kubernetes (via OpenShift)
Node.JS and Python
Spark (via Oshinko)
WINNING!
See it in Action
Wrap up
We are lucky
We can still do analysis on our desktop if we want
But now we can easily integrate
1. Data or APIs
2. Statistics and Machine Learning
3. Interactive Web Applications
To Do this on your own:
1. To run your own OpenShift either:
https://www.openshift.org/vm/
Or
oc cluster up (get oc here - https://github.com/openshift/origin/releases )
2. To get Oshinko:
https://github.com/radanalyticsio then you need oshinko-rest and oshinko-
console
3. For the word analysis app get it here:
https://github.com/ophicleide
We LOVE pull requests
Fin!

Converging Big Data and Application Infrastructure by Steven Poutsy

  • 2.
    Converging Big Dataand Application Infrastructure Steven Pousty OpenShift/Red Hat @TheSteve0 on Twitter, IRC,SmugMug,Github, Ingress, Instagram, Skype,and
  • 3.
    Goals 1. Brief introductionto how things have evolved 2. Talk about what we have now 3. Demo of this in practice 4. Have fun!
  • 4.
    Assumptions 1. You havewritten a web app at some point in your life 2. You know some basics of Spark and such
  • 5.
    Where are wecoming from
  • 10.
  • 11.
  • 12.
  • 16.
  • 17.
    We have hadsome great developments 1. People figured out how to make commodity hardware do great things 2. Distributed software has gotten better 3. Programming languages have gotten easier 4. CS has put effort into statistical libraries 5. The browser has grown up
  • 18.
    Example framework Docker Containers Kubernetes(via OpenShift) Node.JS and Python Spark (via Oshinko)
  • 20.
  • 21.
    See it inAction
  • 22.
  • 23.
    We are lucky Wecan still do analysis on our desktop if we want But now we can easily integrate 1. Data or APIs 2. Statistics and Machine Learning 3. Interactive Web Applications
  • 24.
    To Do thison your own: 1. To run your own OpenShift either: https://www.openshift.org/vm/ Or oc cluster up (get oc here - https://github.com/openshift/origin/releases ) 2. To get Oshinko: https://github.com/radanalyticsio then you need oshinko-rest and oshinko- console 3. For the word analysis app get it here: https://github.com/ophicleide We LOVE pull requests
  • 25.