SlideShare a Scribd company logo
1 of 18
SCALA in CY 2014: 
Gaining Business Momentum 
by 
Russ Hertzberg
Agenda 
• Rapid Growth Phase for the Platform Ecosystem & 
Developer Community 
• Spawning A Popular Early Stage Hadoop Sub-system 
• Spark, Databricks, and Spark-ups (Spark Based Startups) 
• A Successful Relationship: Scala in a Java World 
• Developments to Monitor: 
• The Future of Typesafe and Databricks 
• Scala Platforms & ‘New Data Management’ Ecosystems 
• Game Changing Applications 
• Opportunities and Actions in Scala for Ukraine Software 
Developers
Growth Indicators: Conferences and User 
Groups 
• Spark Summit December 
2013…450 Attendees, 2 
Days 
• Spark Summit July 
2014…1200 Attendees, 3 
Days 
• Scala By the Bay (San 
Francisco): 1983 
Members 
• New York Scala: 1935 
Members
Growth Indicators: Code Contribution 
* Github, Summer 2014
Growth Indicators: Application 
Diversification 
• Genomic Analysis @ UC 
Berkely AMPLab (Spark 
Based) 
• Real Time Online Advertising 
Auctions (Sharethrough) 
• Middleware Platform (J9) 
• Integrated Online Ticketing 
and Event Mgmt. (Ticketfly) 
• Next Generation Email Anti- 
Spam Service (Heluna)
Growth Indicators: Professional Investors 
• Typesafe: Greylock Partners, Juniper 
Networks, Shasta Ventures 
• Databricks: New Enterprise 
Associates, Andreeson Horowitz 
• Other Startup Investors: a16z, Sierra 
Ventures, Mission Ventures, UMC 
Capital, Bosch Venture Capital, 
Artiman Ventures, Sofinnova 
Ventures, Intel Capital, SingTel 
Innov8, Investor Growth Capital, 
QuestMark Partners, TransLink 
Capital, Goldman Sachs 
• Early Stage Big $$ Example: $107M @ 
http://www.guavus.com/ 
Big Data Investors 
Have Big Bucks for Scala Related 
Software Ventures
Apache Spark 
• Launched in January of 2010 
• New Hadoop Component up 
to 100X Faster than Map 
Reduce, with Stream 
Processing 
• Written in Scala with Scala, 
Java, and Python APIs 
• Latest Release on May 30, 
2014 with 110 Contributors
Spark and Databricks 
• ‘Creators’ of Spark 
• Spin Out Company from 
Berkeley AMPLab 
• Just raised $33M B Round 
• Dozens of Production 
Deployments as of July 2014 
• Moving the New Platform 
Quickly: 
• More SQL Connectors 
• MLLIB R Integration 
• Flume Streaming
Spark Ups…Startups Creating a ‘Spark’ 
Ecosystem 
• Adatao 
• Alpine 
• Graphflow 
• Guavus 
• Sharethrough
Spark Ups…Startups Creating a ‘Spark’ 
Ecosystem, and More! 
• Adatao 
• Alpine 
• Graphflow 
• Guavus 
• Sharethrough 
• Plus the Hadoop Disti 
Integrations: 
• Cloudera 
• Hortonworks 
• MapR 
• IBM 
• SAP Hanna Integration 
and SAP Certified Spark 
Distribution
Scala in a Java World 
Cooperation 
• Run on JVMs 
• Use with Existing Java 
Libraries 
• Support for Java Generics 
in Scala 
• Use Java Data Structures 
As Is in Scala 
Competition 
• The Full Typesafe 
Platform 
• Akka and Actors 
• Play Framework 
• Big Momentum for Scala 
in Next Gen Data 
Management 
• Java 8 Oracle Reaction
Competition is Good!
The Future (or end game) of Typesafe 
• Gamify It! 
• Acquisition in 1, 3, 5, or 
n years? 
• If Acquired, By Whom? 
• Private Forever? 
• Initial Public Offering and 
a Long Term Platform 
ISV?
The Future (or end game) of Databricks 
• Gamify It! 
• Acquisition in 1, 3, 5, or 
n years? 
• If Acquired, By Whom? 
• Private Forever? 
• Initial Public Offering and 
a Long Term Platform 
ISV?
Scala Platforms and Evolving Data 
Management Ecosystems 
• Processing Enough Data 
to Create Radical New 
Knowledge and Value is 
the Goal 
• Scala and Scala Platforms 
are a Strategic Driver in 
this High Growth Software 
Segment Attracting Big 
Bucks 
• Harness and Harvest More 
Data for Useful Purposes!
Game Changing Applications 
• Healthcare Genome 
Processing…New 
Frontiers in Mind/Body 
Knowledge & Disease 
Treatment 
• Mobile Device 
Behavioral Insight…to 
Create Autonomic Life 
Improvement 
• Mining Social Network 
Data…a billion API 
requests per day!
Opportunities and Potential Action Items in 
Scala for Ukraine Software Developers 
1. In Projects with Architecture Control, Evaluate Scala 
Fairly! (do not default to Java because you have body 
count) 
2. Leap into Spark or Others Will Beat You 
3. Think About Platform Technologies You Can Build 
Yourself to Make Your Own Services More Valuable and 
Efficient. Invest Intellectual Energy in Your Own 
Intellectual Property 
4. Educate and Certify More Scala Developers
Some Link References 
• http://www.typesafe.com/company/casestudies 
• http://databricks.com/ 
• http://blog.mikiobraun.de/2014/01/apache-spark.html 
• http://radar.oreilly.com/2013/11/how-companies-are-using-spark. 
html 
• https://amplab.cs.berkeley.edu/benchmark/ 
• https://github.com/twitter/scalding 
• http://www.theserverside.com/feature/The-Scala-debate-demystified- 
Balancing-the-rants-with-the-raves 
• http://boldradius.com/blog-post/ 
UwO3nQEAAA3xKXiL/five-tips-for-onboarding-scala-developers

More Related Content

What's hot

Modern data warehouse with Azure
Modern data warehouse with AzureModern data warehouse with Azure
Modern data warehouse with AzureNilesh Gule
 
Part 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure SynapsePart 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure SynapseNilesh Gule
 
Enterprise Metadata Integration
Enterprise Metadata IntegrationEnterprise Metadata Integration
Enterprise Metadata IntegrationDr. Mirko Kämpf
 
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...Spark Summit
 
Spark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion StoicaSpark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion StoicaDatabricks
 
Tokyo azure meetup #2 big data made easy
Tokyo azure meetup #2   big data made easyTokyo azure meetup #2   big data made easy
Tokyo azure meetup #2 big data made easyTokyo Azure Meetup
 
Time Series Analysis Using an Event Streaming Platform
 Time Series Analysis Using an Event Streaming Platform Time Series Analysis Using an Event Streaming Platform
Time Series Analysis Using an Event Streaming PlatformDr. Mirko Kämpf
 
Build Your Own Recommendation Engine
Build Your Own Recommendation EngineBuild Your Own Recommendation Engine
Build Your Own Recommendation EngineSri Ambati
 
Real time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsReal time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsShankar Manian
 
Spark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu AdunuthulaSpark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu AdunuthulaSpark Summit
 
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift Amazon Web Services Korea
 
The need for more agile analytics platforms.
The need for more agile analytics platforms.The need for more agile analytics platforms.
The need for more agile analytics platforms.Amy Hodler
 
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)Spark Summit
 
CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4Michael Kehoe
 
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
 Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr... Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...Databricks
 
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...Alexander Dean
 
Spark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham ChopraSpark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham ChopraSpark Summit
 
Realtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIORealtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIOJozo Kovac
 

What's hot (20)

ASPgems - kappa architecture
ASPgems - kappa architectureASPgems - kappa architecture
ASPgems - kappa architecture
 
Modern data warehouse with Azure
Modern data warehouse with AzureModern data warehouse with Azure
Modern data warehouse with Azure
 
Part 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure SynapsePart 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure Synapse
 
Enterprise Metadata Integration
Enterprise Metadata IntegrationEnterprise Metadata Integration
Enterprise Metadata Integration
 
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
 
Spark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion StoicaSpark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
 
Tokyo azure meetup #2 big data made easy
Tokyo azure meetup #2   big data made easyTokyo azure meetup #2   big data made easy
Tokyo azure meetup #2 big data made easy
 
Time Series Analysis Using an Event Streaming Platform
 Time Series Analysis Using an Event Streaming Platform Time Series Analysis Using an Event Streaming Platform
Time Series Analysis Using an Event Streaming Platform
 
Build Your Own Recommendation Engine
Build Your Own Recommendation EngineBuild Your Own Recommendation Engine
Build Your Own Recommendation Engine
 
Super charged prototyping
Super charged prototypingSuper charged prototyping
Super charged prototyping
 
Real time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsReal time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflows
 
Spark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu AdunuthulaSpark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu Adunuthula
 
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
 
The need for more agile analytics platforms.
The need for more agile analytics platforms.The need for more agile analytics platforms.
The need for more agile analytics platforms.
 
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
 
CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4
 
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
 Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr... Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
 
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
 
Spark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham ChopraSpark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham Chopra
 
Realtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIORealtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIO
 

Viewers also liked

Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)MHF Tylösandsseminariet
 
When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...Almer Postma
 
Tesi c torras
Tesi c torrasTesi c torras
Tesi c torras10CH60R65
 
презентациялоготипа2
презентациялоготипа2презентациялоготипа2
презентациялоготипа2nika_v
 
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Traian Rebedea
 
China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...Beijing Zeefer Consulting Ltd.
 
Sebastian keckert status of the hzb quadrupole resonator
Sebastian keckert   status of the hzb quadrupole resonatorSebastian keckert   status of the hzb quadrupole resonator
Sebastian keckert status of the hzb quadrupole resonatorthinfilmsworkshop
 
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]Felex Lau
 
Formato de clase 8y9 acronyms
Formato de clase 8y9 acronymsFormato de clase 8y9 acronyms
Formato de clase 8y9 acronymsEvelin Peña
 

Viewers also liked (9)

Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
 
When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...
 
Tesi c torras
Tesi c torrasTesi c torras
Tesi c torras
 
презентациялоготипа2
презентациялоготипа2презентациялоготипа2
презентациялоготипа2
 
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
 
China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...
 
Sebastian keckert status of the hzb quadrupole resonator
Sebastian keckert   status of the hzb quadrupole resonatorSebastian keckert   status of the hzb quadrupole resonator
Sebastian keckert status of the hzb quadrupole resonator
 
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
 
Formato de clase 8y9 acronyms
Formato de clase 8y9 acronymsFormato de clase 8y9 acronyms
Formato de clase 8y9 acronyms
 

Similar to Scala Jday 2014

Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)Databricks
 
Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019Gravy Analytics
 
Databricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User GroupDatabricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User GroupPaco Nathan
 
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...confluent
 
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...confluent
 
2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato Review2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato ReviewHang Li
 
What's New in IBM Streams V4.1
What's New in IBM Streams V4.1What's New in IBM Streams V4.1
What's New in IBM Streams V4.1lisanl
 
IBM Strategy for Spark
IBM Strategy for SparkIBM Strategy for Spark
IBM Strategy for SparkMark Kerzner
 
Intro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWSIntro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWSSri Ambati
 
BDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of sparkBDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of sparkJerry Wen
 
End-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache SparkEnd-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache SparkBurak Yavuz
 
Apache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath LakkundiApache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath LakkundiDatabricks
 
Media_Entertainment_Veriticals
Media_Entertainment_VeriticalsMedia_Entertainment_Veriticals
Media_Entertainment_VeriticalsPeyman Mohajerian
 
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...Lillian Pierson
 
Architecting an Open Source AI Platform 2018 edition
Architecting an Open Source AI Platform   2018 editionArchitecting an Open Source AI Platform   2018 edition
Architecting an Open Source AI Platform 2018 editionDavid Talby
 
Spark One Platform Webinar
Spark One Platform WebinarSpark One Platform Webinar
Spark One Platform WebinarCloudera, Inc.
 
Big data and AI in Socialbakers
Big data and AI in SocialbakersBig data and AI in Socialbakers
Big data and AI in Socialbakersppetr82
 
Spark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan KesslerSpark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan KesslerSpark Summit
 
Himansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloperHimansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloperHimansu Behera
 

Similar to Scala Jday 2014 (20)

Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)
 
Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019
 
Databricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User GroupDatabricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User Group
 
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
 
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
 
2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato Review2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato Review
 
What's New in IBM Streams V4.1
What's New in IBM Streams V4.1What's New in IBM Streams V4.1
What's New in IBM Streams V4.1
 
IBM Strategy for Spark
IBM Strategy for SparkIBM Strategy for Spark
IBM Strategy for Spark
 
Dev Ops Training
Dev Ops TrainingDev Ops Training
Dev Ops Training
 
Intro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWSIntro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWS
 
BDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of sparkBDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of spark
 
End-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache SparkEnd-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache Spark
 
Apache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath LakkundiApache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
 
Media_Entertainment_Veriticals
Media_Entertainment_VeriticalsMedia_Entertainment_Veriticals
Media_Entertainment_Veriticals
 
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
 
Architecting an Open Source AI Platform 2018 edition
Architecting an Open Source AI Platform   2018 editionArchitecting an Open Source AI Platform   2018 edition
Architecting an Open Source AI Platform 2018 edition
 
Spark One Platform Webinar
Spark One Platform WebinarSpark One Platform Webinar
Spark One Platform Webinar
 
Big data and AI in Socialbakers
Big data and AI in SocialbakersBig data and AI in Socialbakers
Big data and AI in Socialbakers
 
Spark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan KesslerSpark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan Kessler
 
Himansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloperHimansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloper
 

Recently uploaded

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...OnePlan Solutions
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...Health
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVshikhaohhpro
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxComplianceQuest1
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdfWave PLM
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsJhone kinadey
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providermohitmore19
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️anilsa9823
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AIABDERRAOUF MEHENNI
 

Recently uploaded (20)

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
 

Scala Jday 2014

  • 1. SCALA in CY 2014: Gaining Business Momentum by Russ Hertzberg
  • 2. Agenda • Rapid Growth Phase for the Platform Ecosystem & Developer Community • Spawning A Popular Early Stage Hadoop Sub-system • Spark, Databricks, and Spark-ups (Spark Based Startups) • A Successful Relationship: Scala in a Java World • Developments to Monitor: • The Future of Typesafe and Databricks • Scala Platforms & ‘New Data Management’ Ecosystems • Game Changing Applications • Opportunities and Actions in Scala for Ukraine Software Developers
  • 3. Growth Indicators: Conferences and User Groups • Spark Summit December 2013…450 Attendees, 2 Days • Spark Summit July 2014…1200 Attendees, 3 Days • Scala By the Bay (San Francisco): 1983 Members • New York Scala: 1935 Members
  • 4. Growth Indicators: Code Contribution * Github, Summer 2014
  • 5. Growth Indicators: Application Diversification • Genomic Analysis @ UC Berkely AMPLab (Spark Based) • Real Time Online Advertising Auctions (Sharethrough) • Middleware Platform (J9) • Integrated Online Ticketing and Event Mgmt. (Ticketfly) • Next Generation Email Anti- Spam Service (Heluna)
  • 6. Growth Indicators: Professional Investors • Typesafe: Greylock Partners, Juniper Networks, Shasta Ventures • Databricks: New Enterprise Associates, Andreeson Horowitz • Other Startup Investors: a16z, Sierra Ventures, Mission Ventures, UMC Capital, Bosch Venture Capital, Artiman Ventures, Sofinnova Ventures, Intel Capital, SingTel Innov8, Investor Growth Capital, QuestMark Partners, TransLink Capital, Goldman Sachs • Early Stage Big $$ Example: $107M @ http://www.guavus.com/ Big Data Investors Have Big Bucks for Scala Related Software Ventures
  • 7. Apache Spark • Launched in January of 2010 • New Hadoop Component up to 100X Faster than Map Reduce, with Stream Processing • Written in Scala with Scala, Java, and Python APIs • Latest Release on May 30, 2014 with 110 Contributors
  • 8. Spark and Databricks • ‘Creators’ of Spark • Spin Out Company from Berkeley AMPLab • Just raised $33M B Round • Dozens of Production Deployments as of July 2014 • Moving the New Platform Quickly: • More SQL Connectors • MLLIB R Integration • Flume Streaming
  • 9. Spark Ups…Startups Creating a ‘Spark’ Ecosystem • Adatao • Alpine • Graphflow • Guavus • Sharethrough
  • 10. Spark Ups…Startups Creating a ‘Spark’ Ecosystem, and More! • Adatao • Alpine • Graphflow • Guavus • Sharethrough • Plus the Hadoop Disti Integrations: • Cloudera • Hortonworks • MapR • IBM • SAP Hanna Integration and SAP Certified Spark Distribution
  • 11. Scala in a Java World Cooperation • Run on JVMs • Use with Existing Java Libraries • Support for Java Generics in Scala • Use Java Data Structures As Is in Scala Competition • The Full Typesafe Platform • Akka and Actors • Play Framework • Big Momentum for Scala in Next Gen Data Management • Java 8 Oracle Reaction
  • 13. The Future (or end game) of Typesafe • Gamify It! • Acquisition in 1, 3, 5, or n years? • If Acquired, By Whom? • Private Forever? • Initial Public Offering and a Long Term Platform ISV?
  • 14. The Future (or end game) of Databricks • Gamify It! • Acquisition in 1, 3, 5, or n years? • If Acquired, By Whom? • Private Forever? • Initial Public Offering and a Long Term Platform ISV?
  • 15. Scala Platforms and Evolving Data Management Ecosystems • Processing Enough Data to Create Radical New Knowledge and Value is the Goal • Scala and Scala Platforms are a Strategic Driver in this High Growth Software Segment Attracting Big Bucks • Harness and Harvest More Data for Useful Purposes!
  • 16. Game Changing Applications • Healthcare Genome Processing…New Frontiers in Mind/Body Knowledge & Disease Treatment • Mobile Device Behavioral Insight…to Create Autonomic Life Improvement • Mining Social Network Data…a billion API requests per day!
  • 17. Opportunities and Potential Action Items in Scala for Ukraine Software Developers 1. In Projects with Architecture Control, Evaluate Scala Fairly! (do not default to Java because you have body count) 2. Leap into Spark or Others Will Beat You 3. Think About Platform Technologies You Can Build Yourself to Make Your Own Services More Valuable and Efficient. Invest Intellectual Energy in Your Own Intellectual Property 4. Educate and Certify More Scala Developers
  • 18. Some Link References • http://www.typesafe.com/company/casestudies • http://databricks.com/ • http://blog.mikiobraun.de/2014/01/apache-spark.html • http://radar.oreilly.com/2013/11/how-companies-are-using-spark. html • https://amplab.cs.berkeley.edu/benchmark/ • https://github.com/twitter/scalding • http://www.theserverside.com/feature/The-Scala-debate-demystified- Balancing-the-rants-with-the-raves • http://boldradius.com/blog-post/ UwO3nQEAAA3xKXiL/five-tips-for-onboarding-scala-developers