SlideShare a Scribd company logo
1 of 15
Download to read offline
Unlock your Learning Potential !
ISO 9001:2008
Certified Company
Course details:
Course Code : MYT953
Course Name :Apache Spark and
Scala
Course duration: Fast track – 4 weeks
Regular weekdays – 6 weeks
Week End – 8 weeks
Training mode:
instructor led class training | Live virtual training
Contact: +91 90191 91856
Email:info@mytectra.com
Web: www.mytectra.com
SPARK AND HADOOP DISTRIBUTED FILE
SYSTEM
 What is Spark
 Comparison with Hadoop
 Components of Spark
Spark Components, Common Spark Algorithms-
Iterative Algorithms, Graph Analysis, Machine
Learning
 Apache Spark- Introduction, Consistency, Availability, Partition
 Unified Stack Spark
 Spark Components
 Comparison with Hadoop – Scalding example, mahout, storm, graph
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
Running Spark On A Cluster, Writing Spark
Applications Using Python, Java, Scala
 Explain python example
 Show installing a spark
 Explain driver program
 Explaining spark context with example
 Define weakly typed variable
 Combine scala and java seamlessly
 Explain concurrency and distribution
 Explain what is trait
 Explain higher order function with example
 Define OFI scheduler
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
 Advantages of Spark
 Example of Lamda using spark
 Explain Mapreduce with example
RDD And Its Operation
 Difference between RISC and CISC
 Define Apache Mesos
 Cartesian product between two RDD
 Define count
 Define Filter
 Define Fold
 Define API Operations
 Define Factors
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
Spark, Hadoop, And The Enterprise Data Centre,
Common Spark Algorithms
 How hadoop cluster is different from spark
 Define writing data
 Explain sequence file and its usefulness
 Define protocol buffers
 Define text file, CSV, Object Files and File System
 Define sparse metrics
 Explain RDD and Compression
 Explain data stores and its usefulness
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
Spark Streaming
 Define Elastic Search
 Explain Streaming and its usefulness
 Apache bookkeeper
 Define Dstream
 Define Mapreduce word count
 Explain Paraquet
 Scala ORM
 Define Mlib
 Explain multi graphix and its usefulness
 Define property graph
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
Spark Persistence In Spark
 Persistence
 Motivation
 Example
 Transformation
 Scala and Python
 Examples – K-means
 Latent Dirichlet Allocation (LDA)
Broadcast And Accumulator
 Motivation
 Broadcast Variables
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
 Example: Join
 Alternative if one table is small
 Better version with broadcast
 How to create a Broadcast
 Accumulators motivation
 Accumulator Rules
 Custom accumulators
 Another common use
 Creating an accumulator using spark context object
Spark SQLAnd RDD
 Spark SQL main capabilities
 Spark SQL usage diagram
 Spark SQL
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
 Important topics in Spark SQL- Data frames
 Twitter language analysis
Introduction Of Scala
 Scala Overview
Pattern Matching
 Advantages of Scala
 REPL (Read Evaluate print loop)
 Language Features
 Type Interface
 Higher order function
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
 Option
 Pattern Matching
 Collection
 Currying
 Traits
 Application Space
Executing The Scala Code
 Uses of scala interpreter
 Example of static object timer in scala
 Testing of String equality in scala
 Implicit classes in scala with examples
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
 Recursion in scala
 Currying in scala with examples
 Classes in scala
Classes Concept In Scala
 Constructor
 Constructor overloading
 Prop erties
 Abstract classes
 Type hierarchy in Scala
 Object equality
 Val and var methods
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
Case Classes And Pattern Matching
 Sealed traits
 Case classes
 Constant pattern in case classes
 Wild card pattern
 Variable pattern
 Constructor pattern
 Tuple pattern
Concepts Of Traits With Example
 Java equivalents
 Advantages of traits
 Avoiding boilerplate code
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
 Linearization of traits
 Modelling a real world example
Scala Java Interoperability
 How traits are implemented in scala and java
 How extending multiple traits is handled
Scala Collections
 Classification of scala collections
 Iterable
 Iterator and iterable
 List sequence example in scala
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
Mutable Collections Vs. Immutable Collections
 Array in scala
 List in scala
 Difference between list and list buffer
 Array buffer
 Queue in scala
 Dequeue in scala
 Mutable queue in scala
 Stacks in scala
 Sets and maps in scala Tuples
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com
Use Case Bobsrockets Package
 Different import types
 Selective imports
 Testing-Assertions
 Scala test case- scala test fun. Suite
 Junit test in scala
 Interface for Junit via Junit 3 suite in scala test
 SBT
 Directory structure for packaging scala application
myTectra Learning Solutions private Limited
Bangalore-BTM Layout/
+91 90191 91856/ info@mytectra.com / www.mytectra.com

More Related Content

What's hot

What’s New in the Berkeley Data Analytics Stack
What’s New in the Berkeley Data Analytics StackWhat’s New in the Berkeley Data Analytics Stack
What’s New in the Berkeley Data Analytics StackTuri, Inc.
 
Machine Learning using Apache Spark MLlib
Machine Learning using Apache Spark MLlibMachine Learning using Apache Spark MLlib
Machine Learning using Apache Spark MLlibIMC Institute
 
Modern classification techniques
Modern classification techniquesModern classification techniques
Modern classification techniquesmark_landry
 
AI powered emotion recognition: From Inception to Production - Global AI Conf...
AI powered emotion recognition: From Inception to Production - Global AI Conf...AI powered emotion recognition: From Inception to Production - Global AI Conf...
AI powered emotion recognition: From Inception to Production - Global AI Conf...Apache MXNet
 
Better {ML} Together: GraphLab Create + Spark
Better {ML} Together: GraphLab Create + Spark Better {ML} Together: GraphLab Create + Spark
Better {ML} Together: GraphLab Create + Spark Turi, Inc.
 
Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15
Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15
Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15MLconf
 
2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...
2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...
2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...DB Tsai
 
Machine Learning with Scala
Machine Learning with ScalaMachine Learning with Scala
Machine Learning with ScalaSusan Eraly
 

What's hot (8)

What’s New in the Berkeley Data Analytics Stack
What’s New in the Berkeley Data Analytics StackWhat’s New in the Berkeley Data Analytics Stack
What’s New in the Berkeley Data Analytics Stack
 
Machine Learning using Apache Spark MLlib
Machine Learning using Apache Spark MLlibMachine Learning using Apache Spark MLlib
Machine Learning using Apache Spark MLlib
 
Modern classification techniques
Modern classification techniquesModern classification techniques
Modern classification techniques
 
AI powered emotion recognition: From Inception to Production - Global AI Conf...
AI powered emotion recognition: From Inception to Production - Global AI Conf...AI powered emotion recognition: From Inception to Production - Global AI Conf...
AI powered emotion recognition: From Inception to Production - Global AI Conf...
 
Better {ML} Together: GraphLab Create + Spark
Better {ML} Together: GraphLab Create + Spark Better {ML} Together: GraphLab Create + Spark
Better {ML} Together: GraphLab Create + Spark
 
Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15
Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15
Misha Bilenko, Principal Researcher, Microsoft at MLconf SEA - 5/01/15
 
2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...
2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...
2014-10-20 Large-Scale Machine Learning with Apache Spark at Internet of Thin...
 
Machine Learning with Scala
Machine Learning with ScalaMachine Learning with Scala
Machine Learning with Scala
 

Similar to Apache Spark and Scala Training in Bangalore myTectra

Use of standards and related issues in predictive analytics
Use of standards and related issues in predictive analyticsUse of standards and related issues in predictive analytics
Use of standards and related issues in predictive analyticsPaco Nathan
 
DASK and Apache Spark
DASK and Apache SparkDASK and Apache Spark
DASK and Apache SparkDatabricks
 
Introduction to Spark ML
Introduction to Spark MLIntroduction to Spark ML
Introduction to Spark MLHolden Karau
 
Python Interview Questions And Answers 2019 | Edureka
Python Interview Questions And Answers 2019 | EdurekaPython Interview Questions And Answers 2019 | Edureka
Python Interview Questions And Answers 2019 | EdurekaEdureka!
 
Apache Spark - Intro to Large-scale recommendations with Apache Spark and Python
Apache Spark - Intro to Large-scale recommendations with Apache Spark and PythonApache Spark - Intro to Large-scale recommendations with Apache Spark and Python
Apache Spark - Intro to Large-scale recommendations with Apache Spark and PythonChristian Perone
 
BigDL webinar - Deep Learning Library for Spark
BigDL webinar - Deep Learning Library for SparkBigDL webinar - Deep Learning Library for Spark
BigDL webinar - Deep Learning Library for SparkDESMOND YUEN
 
Orchestrating the Intelligent Web with Apache Mahout
Orchestrating the Intelligent Web with Apache MahoutOrchestrating the Intelligent Web with Apache Mahout
Orchestrating the Intelligent Web with Apache Mahoutaneeshabakharia
 
Running Presto and Spark on the Netflix Big Data Platform
Running Presto and Spark on the Netflix Big Data PlatformRunning Presto and Spark on the Netflix Big Data Platform
Running Presto and Spark on the Netflix Big Data PlatformEva Tse
 
(BDT303) Running Spark and Presto on the Netflix Big Data Platform
(BDT303) Running Spark and Presto on the Netflix Big Data Platform(BDT303) Running Spark and Presto on the Netflix Big Data Platform
(BDT303) Running Spark and Presto on the Netflix Big Data PlatformAmazon Web Services
 
Apache® Spark™ 1.6 presented by Databricks co-founder Patrick Wendell
Apache® Spark™ 1.6 presented by Databricks co-founder Patrick WendellApache® Spark™ 1.6 presented by Databricks co-founder Patrick Wendell
Apache® Spark™ 1.6 presented by Databricks co-founder Patrick WendellDatabricks
 

Similar to Apache Spark and Scala Training in Bangalore myTectra (20)

Ruby on Rails Training in Bangalore Classroom, Online
Ruby on Rails Training in Bangalore Classroom, OnlineRuby on Rails Training in Bangalore Classroom, Online
Ruby on Rails Training in Bangalore Classroom, Online
 
Use of standards and related issues in predictive analytics
Use of standards and related issues in predictive analyticsUse of standards and related issues in predictive analytics
Use of standards and related issues in predictive analytics
 
Best Apache Kafka Training in Bangalore. Join myTectra
Best Apache Kafka Training in Bangalore. Join myTectraBest Apache Kafka Training in Bangalore. Join myTectra
Best Apache Kafka Training in Bangalore. Join myTectra
 
DASK and Apache Spark
DASK and Apache SparkDASK and Apache Spark
DASK and Apache Spark
 
Catalyst optimizer
Catalyst optimizerCatalyst optimizer
Catalyst optimizer
 
Introduction to Spark ML
Introduction to Spark MLIntroduction to Spark ML
Introduction to Spark ML
 
Big Data and Hadoop training in Bangalore by myTectra
Big Data and Hadoop training in Bangalore by myTectraBig Data and Hadoop training in Bangalore by myTectra
Big Data and Hadoop training in Bangalore by myTectra
 
Best Web Designing Training in Bangalore by myTectra
Best Web Designing Training in Bangalore by myTectraBest Web Designing Training in Bangalore by myTectra
Best Web Designing Training in Bangalore by myTectra
 
Python Interview Questions And Answers 2019 | Edureka
Python Interview Questions And Answers 2019 | EdurekaPython Interview Questions And Answers 2019 | Edureka
Python Interview Questions And Answers 2019 | Edureka
 
Best Embedded System Training in Bangalore by myTectra
Best Embedded System Training in Bangalore by myTectraBest Embedded System Training in Bangalore by myTectra
Best Embedded System Training in Bangalore by myTectra
 
Apache Spark - Intro to Large-scale recommendations with Apache Spark and Python
Apache Spark - Intro to Large-scale recommendations with Apache Spark and PythonApache Spark - Intro to Large-scale recommendations with Apache Spark and Python
Apache Spark - Intro to Large-scale recommendations with Apache Spark and Python
 
Qlikview Training in Bangalore by myTectra
Qlikview Training in Bangalore by myTectraQlikview Training in Bangalore by myTectra
Qlikview Training in Bangalore by myTectra
 
Qlikview Training in Bangalore by myTectra
Qlikview Training in Bangalore by myTectraQlikview Training in Bangalore by myTectra
Qlikview Training in Bangalore by myTectra
 
BigDL webinar - Deep Learning Library for Spark
BigDL webinar - Deep Learning Library for SparkBigDL webinar - Deep Learning Library for Spark
BigDL webinar - Deep Learning Library for Spark
 
Ruby on Rail Training in Bangalore by myTectra
Ruby on Rail Training in Bangalore by myTectraRuby on Rail Training in Bangalore by myTectra
Ruby on Rail Training in Bangalore by myTectra
 
Ruby on Rail Training in Bangalore by myTectra
Ruby on Rail Training in Bangalore by myTectraRuby on Rail Training in Bangalore by myTectra
Ruby on Rail Training in Bangalore by myTectra
 
Orchestrating the Intelligent Web with Apache Mahout
Orchestrating the Intelligent Web with Apache MahoutOrchestrating the Intelligent Web with Apache Mahout
Orchestrating the Intelligent Web with Apache Mahout
 
Running Presto and Spark on the Netflix Big Data Platform
Running Presto and Spark on the Netflix Big Data PlatformRunning Presto and Spark on the Netflix Big Data Platform
Running Presto and Spark on the Netflix Big Data Platform
 
(BDT303) Running Spark and Presto on the Netflix Big Data Platform
(BDT303) Running Spark and Presto on the Netflix Big Data Platform(BDT303) Running Spark and Presto on the Netflix Big Data Platform
(BDT303) Running Spark and Presto on the Netflix Big Data Platform
 
Apache® Spark™ 1.6 presented by Databricks co-founder Patrick Wendell
Apache® Spark™ 1.6 presented by Databricks co-founder Patrick WendellApache® Spark™ 1.6 presented by Databricks co-founder Patrick Wendell
Apache® Spark™ 1.6 presented by Databricks co-founder Patrick Wendell
 

More from myTectra Learning Solutions Private Ltd

More from myTectra Learning Solutions Private Ltd (20)

Best Ansible Training in Bangalore. Join myTectra Now
Best Ansible Training in Bangalore. Join myTectra NowBest Ansible Training in Bangalore. Join myTectra Now
Best Ansible Training in Bangalore. Join myTectra Now
 
Best Oracle Apps Technical Training in Bangalore.myTectra
Best Oracle Apps Technical Training in Bangalore.myTectraBest Oracle Apps Technical Training in Bangalore.myTectra
Best Oracle Apps Technical Training in Bangalore.myTectra
 
Best Oracle PL SQL Training in Bangalore. Join myTectra
Best Oracle PL SQL Training in Bangalore. Join myTectraBest Oracle PL SQL Training in Bangalore. Join myTectra
Best Oracle PL SQL Training in Bangalore. Join myTectra
 
Best ExtJS Training in Bangalore. Join myTectra Now
Best ExtJS Training in Bangalore. Join myTectra NowBest ExtJS Training in Bangalore. Join myTectra Now
Best ExtJS Training in Bangalore. Join myTectra Now
 
The MapReduce Design Patterns Training in Banhgalore
The MapReduce Design Patterns Training in BanhgaloreThe MapReduce Design Patterns Training in Banhgalore
The MapReduce Design Patterns Training in Banhgalore
 
Statistics Essentials for Analytics Training in Bangalore
Statistics Essentials for Analytics Training in BangaloreStatistics Essentials for Analytics Training in Bangalore
Statistics Essentials for Analytics Training in Bangalore
 
C Programming and Data Structures Training In Bangalore
C Programming and Data Structures Training In BangaloreC Programming and Data Structures Training In Bangalore
C Programming and Data Structures Training In Bangalore
 
Essentials of Professional VLSI Digital Design Training
Essentials of Professional VLSI Digital Design TrainingEssentials of Professional VLSI Digital Design Training
Essentials of Professional VLSI Digital Design Training
 
The Predictive Modelling in R Training in Bangalore
The Predictive Modelling in R Training in BangaloreThe Predictive Modelling in R Training in Bangalore
The Predictive Modelling in R Training in Bangalore
 
The Best Comprehensive MapReduce Training in Bangalore
The Best Comprehensive MapReduce Training in BangaloreThe Best Comprehensive MapReduce Training in Bangalore
The Best Comprehensive MapReduce Training in Bangalore
 
Decision Tree Modeling Using R Training in Bangalore
Decision Tree Modeling Using R Training in BangaloreDecision Tree Modeling Using R Training in Bangalore
Decision Tree Modeling Using R Training in Bangalore
 
The Persistence with Hibernate Training in Bangalore
The Persistence with Hibernate Training in BangaloreThe Persistence with Hibernate Training in Bangalore
The Persistence with Hibernate Training in Bangalore
 
Design Patterns Training From myTectra in Bangalore
Design Patterns Training From myTectra in BangaloreDesign Patterns Training From myTectra in Bangalore
Design Patterns Training From myTectra in Bangalore
 
The Apache Solr Training From myTectra in Bangalore
The Apache Solr Training From myTectra in BangaloreThe Apache Solr Training From myTectra in Bangalore
The Apache Solr Training From myTectra in Bangalore
 
The Best Microsoft Project 2013 Training in Bangalore
The Best Microsoft Project 2013 Training in BangaloreThe Best Microsoft Project 2013 Training in Bangalore
The Best Microsoft Project 2013 Training in Bangalore
 
Six Sigma Green Belt Training in Bangalore,By myTectra
Six Sigma Green Belt Training in Bangalore,By myTectraSix Sigma Green Belt Training in Bangalore,By myTectra
Six Sigma Green Belt Training in Bangalore,By myTectra
 
The Measuring Social Media ROI Training in Bangalore
The Measuring Social Media ROI Training in BangaloreThe Measuring Social Media ROI Training in Bangalore
The Measuring Social Media ROI Training in Bangalore
 
CRM Salesforce Training From myTectra in Bangalore
CRM Salesforce Training From myTectra in BangaloreCRM Salesforce Training From myTectra in Bangalore
CRM Salesforce Training From myTectra in Bangalore
 
The Apache Ambari Training From myTectra in Bangalore
The Apache Ambari Training From myTectra in BangaloreThe Apache Ambari Training From myTectra in Bangalore
The Apache Ambari Training From myTectra in Bangalore
 
Analytics For Retail Banking Training in Bangalore
Analytics For Retail Banking Training in BangaloreAnalytics For Retail Banking Training in Bangalore
Analytics For Retail Banking Training in Bangalore
 

Recently uploaded

Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...RKavithamani
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 

Recently uploaded (20)

Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 

Apache Spark and Scala Training in Bangalore myTectra

  • 1. Unlock your Learning Potential ! ISO 9001:2008 Certified Company Course details: Course Code : MYT953 Course Name :Apache Spark and Scala Course duration: Fast track – 4 weeks Regular weekdays – 6 weeks Week End – 8 weeks Training mode: instructor led class training | Live virtual training Contact: +91 90191 91856 Email:info@mytectra.com Web: www.mytectra.com
  • 2. SPARK AND HADOOP DISTRIBUTED FILE SYSTEM  What is Spark  Comparison with Hadoop  Components of Spark Spark Components, Common Spark Algorithms- Iterative Algorithms, Graph Analysis, Machine Learning  Apache Spark- Introduction, Consistency, Availability, Partition  Unified Stack Spark  Spark Components  Comparison with Hadoop – Scalding example, mahout, storm, graph myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 3. Running Spark On A Cluster, Writing Spark Applications Using Python, Java, Scala  Explain python example  Show installing a spark  Explain driver program  Explaining spark context with example  Define weakly typed variable  Combine scala and java seamlessly  Explain concurrency and distribution  Explain what is trait  Explain higher order function with example  Define OFI scheduler myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 4.  Advantages of Spark  Example of Lamda using spark  Explain Mapreduce with example RDD And Its Operation  Difference between RISC and CISC  Define Apache Mesos  Cartesian product between two RDD  Define count  Define Filter  Define Fold  Define API Operations  Define Factors myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 5. Spark, Hadoop, And The Enterprise Data Centre, Common Spark Algorithms  How hadoop cluster is different from spark  Define writing data  Explain sequence file and its usefulness  Define protocol buffers  Define text file, CSV, Object Files and File System  Define sparse metrics  Explain RDD and Compression  Explain data stores and its usefulness myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 6. Spark Streaming  Define Elastic Search  Explain Streaming and its usefulness  Apache bookkeeper  Define Dstream  Define Mapreduce word count  Explain Paraquet  Scala ORM  Define Mlib  Explain multi graphix and its usefulness  Define property graph myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 7. Spark Persistence In Spark  Persistence  Motivation  Example  Transformation  Scala and Python  Examples – K-means  Latent Dirichlet Allocation (LDA) Broadcast And Accumulator  Motivation  Broadcast Variables myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 8.  Example: Join  Alternative if one table is small  Better version with broadcast  How to create a Broadcast  Accumulators motivation  Accumulator Rules  Custom accumulators  Another common use  Creating an accumulator using spark context object Spark SQLAnd RDD  Spark SQL main capabilities  Spark SQL usage diagram  Spark SQL myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 9.  Important topics in Spark SQL- Data frames  Twitter language analysis Introduction Of Scala  Scala Overview Pattern Matching  Advantages of Scala  REPL (Read Evaluate print loop)  Language Features  Type Interface  Higher order function myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 10.  Option  Pattern Matching  Collection  Currying  Traits  Application Space Executing The Scala Code  Uses of scala interpreter  Example of static object timer in scala  Testing of String equality in scala  Implicit classes in scala with examples myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 11.  Recursion in scala  Currying in scala with examples  Classes in scala Classes Concept In Scala  Constructor  Constructor overloading  Prop erties  Abstract classes  Type hierarchy in Scala  Object equality  Val and var methods myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 12. Case Classes And Pattern Matching  Sealed traits  Case classes  Constant pattern in case classes  Wild card pattern  Variable pattern  Constructor pattern  Tuple pattern Concepts Of Traits With Example  Java equivalents  Advantages of traits  Avoiding boilerplate code myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 13.  Linearization of traits  Modelling a real world example Scala Java Interoperability  How traits are implemented in scala and java  How extending multiple traits is handled Scala Collections  Classification of scala collections  Iterable  Iterator and iterable  List sequence example in scala myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 14. Mutable Collections Vs. Immutable Collections  Array in scala  List in scala  Difference between list and list buffer  Array buffer  Queue in scala  Dequeue in scala  Mutable queue in scala  Stacks in scala  Sets and maps in scala Tuples myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com
  • 15. Use Case Bobsrockets Package  Different import types  Selective imports  Testing-Assertions  Scala test case- scala test fun. Suite  Junit test in scala  Interface for Junit via Junit 3 suite in scala test  SBT  Directory structure for packaging scala application myTectra Learning Solutions private Limited Bangalore-BTM Layout/ +91 90191 91856/ info@mytectra.com / www.mytectra.com