Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

SQL and Search with Spark in your browser

427 views

Published on

SQL and Search with Spark in your browser

Published in: Technology
  • Be the first to comment

SQL and Search with Spark in your browser

  1. 1. SQL AND SEARCH WITH SPARK
 IN YOUR BROWSER Romain Rigaux
  2. 2. 100 000
  3. 3. WEB INTERFACE FOR ANALYZING DATA WITH APACHE HADOOP 
 FREE AND OPEN SOURCE —> USER TOOL WHAT IS HUE?
  4. 4. CORE FEATURE: QUERY 1. Explore 2. Compose 3. Productionize
  5. 5. 1. PREPARE, BROWSE
  6. 6. LIGHT ETL
 http://livy.io/
  7. 7. INDEXER
 morphline.conf schema.xml + + Collection
  8. 8. 2. COMPOSE
  9. 9. EDITOR(S)
 API HS2 HS2 oozie solr Oracle, PostgreSQL, MySQL, JDBC, Phoenix, MR, ...
  10. 10. SEARCH DASHBOARDS
 /select /admin/collections /get /luke... /add_widget /zoom_in /select_facet /select_range... REST AJAX Templates + JS Model state:CA
  11. 11. 3. PRODUCTIONIZE
  12. 12. WORKFLOWS HDFS file Saved query
  13. 13. SCHEDULER
 /data/20160601 /data/20160602 /data/20160603 ... year=2016,month=06,day=01 year=2016,month=06,day=02 year=2016,month=06,day=03 ... Instance wf 1 Instance wf 2 Instance wf 3 Instance wf 4 workflow.xml coordinator.xml
  14. 14. DEMO TIME
 Bank auditing: > 10 000$
  15. 15. WHAT IS NEXT 
 - Improved Query experience - Richer SQL experience - Metadata search - Single page layout UI
  16. 16. TWITTER @gethue USER GROUP hue-user@ WEBSITE http://gethue.com LEARN http://learn.gethue.com THANKS!


×