Recommended
Recommended
More Related Content
Similar to Spark2 upload
Similar to Spark2 upload (20)
Recently uploaded
Recently uploaded (20)
Spark2 upload
- 1. Journey into Merouane Azami Dijon, 29 November 2018
- 2. ‣ Why Spark ? ‣ What is Spark ? ‣ Spark features ‣ Core Concept ‣ Spark Components ‣ Component interactions ‣ Conclusion ! /232 Outline
- 3. ‣ Master’s Degree in AI ‣ Senior Software Engineer ‣ Merousoft SARL Founder ‣ IT Consultant !3 About Me Merouane Azami ! /233! /233
- 4. “Because we live in the era of Big Data and tremendous Data are generated” Why Spark ? ! /234
- 5. Why Spark ? Not Convincing ! /235
- 6. “Analysing Big Data for Business Decision making” Why Spark ? Which means were are talking about money ! /236
- 7. “Can you show me how does it work ?” ! /237
- 8. “Apache Spark is a fast and general-purpose cluster computing system” What is Spark ? ! /238
- 10. Spark’s features They sorted 100TB of data using only $144 US ! /2310
- 11. Ease of use Write applications quickly in Java, Scala, Python, R, and SQL. Spark’s features piece of cake ! /2311
- 12. Ease of use example Spark’s features df = spark.read.json(“logs.json") df.where("age > 21”) .select(“name.first") .show() ! /2312
- 13. Runs Everywhere Spark’s features ! /2313
- 14. Spark Core Concept RDD is the fundamental data structure ! /2314
- 21. Spark’s Components SPARK CORE SPARK SQL SPARK STREAMING SPARK GRAPHX SPARK MLLIB ! /2321 Disk Database
- 22. Spark is an excitingtechnology that isworthy to know Conclusion ! /2322