Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

From Data Analytics to Fast Data Intelligence

3,313 views

Published on

1) How to understand users with Data Analytics ?
2) How to build Real-time Music Recommender System from Data Stream ?
3) How to boost profit with Cross Sale in Real-time ?
Key Ideas to build Fast Data Intelligence Platform from Open Source Tools:
+ Apache Kafka
+ Apache Spark
+ RFX framework

Published in: Data & Analytics

From Data Analytics to Fast Data Intelligence

  1. 1. From Data Analytics to Fast Data Intelligence Key ideas to build Fast Data Intelligence Platform from Open Source Tools ○ Apache Kafka ○ Apache Spark ○ RFX framework Presented by @tantrieuf31 http://nguyentantrieu.info
  2. 2. about me ? ● Fullstack Engineer and Tech Lead at AdsPlay and iTVAd, startup projects from FPT Telecom ● Founder at RFXLab.com, building RFX framework and Fast Data Intelligence Platform for Data-driven Organization ● Blogger at http://engineering.adsplay.net
  3. 3. Abstract 1. How to understand users with data analytics ? 2. How to build real-time recommender system from data stream ? 3. How to boost profit with cross sale in real-time ? We will go through all these case studies and build a simple demo with Open Source Tools.
  4. 4. What is Fast Data Intelligence ? http://www.tibco.com/blog/2015/03/27/how-analytics- facilitates-fast-data
  5. 5. Why is Data Intelligence ?
  6. 6. Analytics could help us see “what’s Going on”
  7. 7. and we could see trending events in real-time: Does Vietnamese love football ?correlation said YES
  8. 8. Predictive Data Analytics would help us boosting Sale Revenue / Profit Log events Reactive events
  9. 9. KEY IDEA: DATAFLOW ANALYTICS
  10. 10. Key ideas of Analytical Data Intelligence Platform - by RFXLab.com
  11. 11. Fast Data Intelligence Architecture
  12. 12. Where is Fast Data used in production ?
  13. 13. Case Study 1: Fast Data Intelligence for E-commerce
  14. 14. Question: Guessing which items user want to buy from heatmap data ?
  15. 15. Case Study 2: Fast Data Intelligence for Music Industry
  16. 16. Ok, see real code
  17. 17. Alternating Least Squares Algorithm
  18. 18. Ok, put the Data Science to Music Taste https://github.com/trieu/learn-spark
  19. 19. Awesome Open Source Projects to follow Native Kafka: https://github. com/edenhill/librdkafka/ PHP Kafka: https://github. com/EVODelavega/phpkafka Chart Library https://github.com/nvd3-community/nvd3 RFX-Report https://github.com/rfxlab/rfx-report
  20. 20. Awesome Open Source Projects to follow RFXLab.com (Tools that made in Vietnam) ◎ http://www.rfxlab.com ◎ https://github.com/rfxlab Kafka : http://kafka.apache.org Hadoop http://hadoop.apache.org VertX : http://vertx.io Apache Spark https://spark.apache.org
  21. 21. Good ref books
  22. 22. More info at http://engineering.adsplay.net

×