Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
SQL AND SEARCH WITH
SPARK

IN YOUR BROWSER
Romain Rigaux
100 000
WEB INTERFACE FOR ANALYZING DATA
WITH APACHE HADOOP


FREE AND OPEN SOURCE
—> USER TOOL
WHAT IS HUE?
CORE FEATURE: QUERY 1. Explore
2. Compose
3. Productionize
1. PREPARE, BROWSE
LIGHT ETL

http://livy.io/
INDEXER

morphline.conf
schema.xml
+
+
Collection
2. COMPOSE
EDITOR(S)

API
HS2
HS2
oozie
solr
Oracle, PostgreSQL, MySQL, JDBC, Phoenix, MR, ...
SEARCH DASHBOARDS

/select
/admin/collections
/get
/luke...
/add_widget
/zoom_in
/select_facet
/select_range...
REST AJAX
...
3. PRODUCTIONIZE
WORKFLOWS
HDFS file
Saved query
SCHEDULER

/data/20160601
/data/20160602
/data/20160603
...
year=2016,month=06,day=01
year=2016,month=06,day=02
year=2016,...
DEMO
TIME

Bank auditing: > 10 000$
WHAT IS NEXT 

- Improved Query experience
- Richer SQL experience
- Metadata search
- Single page layout UI
TWITTER
@gethue
USER GROUP
hue-user@
WEBSITE
http://gethue.com
LEARN
http://learn.gethue.com
THANKS!

Hue architecture in the Hadoop ecosystem and SQL Editor
Hue architecture in the Hadoop ecosystem and SQL Editor
Upcoming SlideShare
Loading in …5
×

Hue architecture in the Hadoop ecosystem and SQL Editor

Hue architecture in the Hadoop ecosystem and live demo of new Editor.

  • Be the first to comment

Hue architecture in the Hadoop ecosystem and SQL Editor

  1. 1. SQL AND SEARCH WITH SPARK
 IN YOUR BROWSER Romain Rigaux
  2. 2. 100 000
  3. 3. WEB INTERFACE FOR ANALYZING DATA WITH APACHE HADOOP 
 FREE AND OPEN SOURCE —> USER TOOL WHAT IS HUE?
  4. 4. CORE FEATURE: QUERY 1. Explore 2. Compose 3. Productionize
  5. 5. 1. PREPARE, BROWSE
  6. 6. LIGHT ETL
 http://livy.io/
  7. 7. INDEXER
 morphline.conf schema.xml + + Collection
  8. 8. 2. COMPOSE
  9. 9. EDITOR(S)
 API HS2 HS2 oozie solr Oracle, PostgreSQL, MySQL, JDBC, Phoenix, MR, ...
  10. 10. SEARCH DASHBOARDS
 /select /admin/collections /get /luke... /add_widget /zoom_in /select_facet /select_range... REST AJAX Templates + JS Model state:CA
  11. 11. 3. PRODUCTIONIZE
  12. 12. WORKFLOWS HDFS file Saved query
  13. 13. SCHEDULER
 /data/20160601 /data/20160602 /data/20160603 ... year=2016,month=06,day=01 year=2016,month=06,day=02 year=2016,month=06,day=03 ... Instance wf 1 Instance wf 2 Instance wf 3 Instance wf 4 workflow.xml coordinator.xml
  14. 14. DEMO TIME
 Bank auditing: > 10 000$
  15. 15. WHAT IS NEXT 
 - Improved Query experience - Richer SQL experience - Metadata search - Single page layout UI
  16. 16. TWITTER @gethue USER GROUP hue-user@ WEBSITE http://gethue.com LEARN http://learn.gethue.com THANKS!


    Be the first to comment

    Login to see the comments

  • jxauwxj

    Jul. 4, 2016
  • junxiaowang2

    Aug. 9, 2016
  • yasukazunagatomi

    Dec. 12, 2016
  • adambloom

    Apr. 24, 2017

Hue architecture in the Hadoop ecosystem and live demo of new Editor.

Views

Total views

2,241

On Slideshare

0

From embeds

0

Number of embeds

812

Actions

Downloads

48

Shares

0

Comments

0

Likes

4

×