Introduction to TreasureData Cloud
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,001
On Slideshare
982
From Embeds
19
Number of Embeds
5

Actions

Shares
Downloads
42
Comments
0
Likes
4

Embeds 19

https://twitter.com 10
http://192.168.0.100 6
http://54.64.11.67 1
http://hubot-clb-2081983768.ap-northeast-1.elb.amazonaws.com 1
http://54.199.180.60 1

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Jazz's Lightening Talk 巨量資料的新商業模式? 雲端資料分析服務 雲端運算 Cloud Computing 2014-03-08 巨量資料 Big Data Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 1
  • 2. 爵士閃電講 巨量資料的新商業模式? 他山之石可以攻錯! https://www.moedict.tw/他山之石可以攻錯 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 2
  • 3. 爵士閃電講 巨量資料的新商業模式? 他山之石可以攻錯! 案例: 從日誌蒐集到線上分析 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 3
  • 4. 生、流、存、算、用、看 圖 1. Big Data Lifecycle 與產業發展 http://fredbigdata.blogspot.tw/2013/06/big-data-lifecycle.html 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 4
  • 5. Data Science Workflow 資料模型 / 模式 資料 擷取 蒐集 資料 整理 凈化 資料 儲存 管理 特徵 萃取 視覺化分析 互動式查詢 說故事 結果闡釋 Data Analysis: Just One Component of the Data Science Workflow, By Ben Lorica, 'Big Data Now 2013', OR'eilly 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 5
  • 6. Life of Big Data :蒐、存、取、析、用 蒐 存 析 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 取 用 6
  • 7. Treasure Data Cloud 的商業定位 生 蒐 流 存 取 算 析 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 用 看 7
  • 8. Data Flow of Log Analysis 生 2014-03-08 流 存 算 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 用 看 8
  • 9. Data Flow of Log Analysis (Enhanced ?) 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 9
  • 10. td-agent / flunetd Unstructure → Unstructure Unstructure → Structured 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 10
  • 11. 爵士閃電講 巨量資料的新商業模式? 他山之石可以攻錯! 從日誌蒐集到線上分析 Live Demo: Treasure Data Cloud 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 11
  • 12. 爵士閃電講 < 聲明 > @ 2014-03-08 本人與 TreasureData 公司無任何利益關係 ( 不代表未來不會合作 ) 以下純屬個人的用戶經驗分享 PS. 順便學一下 UI / UX 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 12
  • 13. 1. Visit Web Console https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 13
  • 14. 2. Sign up for free testing account https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 14
  • 15. 3. Read Quick Start Tutorial https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 15
  • 16. 4. Understand SampleDB Data Structure https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 16
  • 17. 5. Submit Query …. online! https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 17
  • 18. Running via AJAX / RESTful method https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 18
  • 19. 6. Get the result interactively https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 19
  • 20. Possible Use Cases https://console.treasuredata.com/login 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 20
  • 21. Support High Availability 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com 21
  • 22. fluentd plugins ( in_XXX, out_XXX ) 2014-03-08 Hadoop Ecosystem Workshop Q1 2014 jazzwang@etusolution.com http://fluentd.org/plugin/ 22