Downloaded 25 times
Uploaded bySri Ambati
Sparkling Water Meetup: Deep Learning for Public Safety
The document discusses the integration of H2O.ai's Sparkling Water with Spark to create scalable machine learning applications, particularly focusing on deep learning for public safety using open city data. It describes the platform's capabilities, including its user-friendly API, efficient computation, and production-ready ML algorithms. The document also highlights a specific application predicting arrest probabilities in Chicago based on crime, weather, and socioeconomic data.
More Related Content
Similar to Sparkling Water Meetup: Deep Learning for Public Safety
Sparkling Water Meetup: Deep Learning for Public Safety
- 1. Michal Malohlava, AlexTellez, Amy Wang and H2O.ai Building Machine Learning Applications with Sparkling Water Series 04/22/2015 Meetup Deep Learning for Public Safety: Fighting Crime with Open City Data
- 2.
- 3. Where is thecode? https://github.com/h2oai/sparkling-water/ blob/master/examples/scripts/README.md
- 4. Scalable Machine Learning ForSmarter Applications
- 5.
- 6. Scalable Applications Distributed Able toprocess huge amount of data from different sources Easy to develop and experiment Powerful machine learning engine inside
- 7.
- 8.
- 9.
- 10. Open-source distributed executionplatform User-friendly API for data transformation based on RDD Platform components - SQL, MLLib, text mining Multitenancy Large and active community
- 11. Open-source scalable machine learningplatform Tuned for efficient computation and memory use Production ready machine learning algorithms R, Python, Java, Scala APIs Interactive UI, robust data parser
- 13. Sparkling Water Provides Transparent integrationof H2O with Spark ecosystem Transparent use of H2O data structures and algorithms with Spark API Excels in existing Spark workflows requiring advanced Machine Learning algorithms Platform for building Smarter Applications
- 14. Sparkling Water Design spark-submit Spark Master JVM Spark Worker JVM Spark Worker JVM Spark Worker JVM SparklingWater Cluster Spark Executor JVM H2O Spark Executor JVM H2O Spark Executor JVM H2O Sparkling App implements ? Regular Spark application containing also Sparkling Water classes
- 15. Data Distribution H2O H2O H2O Sparkling WaterCluster Spark Executor JVM Data Source (e.g. HDFS) H2O RDD Spark Executor JVM Spark Executor JVM Spark RDD RDDs and DataFrames share same memory space toRDD toH2OFrame
- 16.
- 17. Deep Learning for PublicSafety: Fighting Crime with OPEN City Data Predict probability of arrest
- 18.
- 19. OPEN CRIME DATA CrimeDataset: Crimes from 2001 - Present Day ~ 4.6 million crimes
- 20. THE WINDY CITY HarvestChicago Weather data since 2001
- 21. SOCIOECONOMIC FACTORS Crimes segmentedinto Community Area IDs Percent of households below poverty, unemployed, etc.
- 22. H2O.ai Machine Intelligence 22 Crime("02/08/2015 11:43:58PM", 1811, “NARCOTICS", “STREET", false, 422, 4, 7, 46, 18) Crime("02/08/2015 11:00:39 PM", 1150, "DECEPTIVE PRACTICE", “RESIDENCE", false, 923, 9, 14, 63, 11) ARREST? Predict arrest prob for crime events
- 23.
- 24. H2O.ai Machine Intelligence CrimesCensusWeather 24 Data munging SparkSQL join Split table Collect models metrics Evaluate models and score new crimes Deep Learning GBM
- 25.
- 26. Where is thecode? https://github.com/h2oai/sparkling-water/ blob/master/examples/scripts/
- 27.
- 28. More info aboutapp https://kddnuggets.com/2015/04/ deep-learning-fight-crime.html Complete app code at GitHub https://github.com/h2oai/ sparkling-water/
- 29. Checkout H2O.ai TrainingBooks http://learn.h2o.ai/ Checkout H2O.ai Blog http://h2o.ai/blog/ Checkout H2O.ai Youtube Channel https://www.youtube.com/user/0xdata Checkout GitHub https://github.com/h2oai/sparkling-water Meetups https://meetup.com/ More info
- 30. Learn more ath2o.ai Follow us at @h2oai Thank you! Sparkling Water is open-source ML application platform combining power of Spark and H2O