SlideShare a Scribd company logo
SCALA in CY 2014: 
Gaining Business Momentum 
by 
Russ Hertzberg
Agenda 
• Rapid Growth Phase for the Platform Ecosystem & 
Developer Community 
• Spawning A Popular Early Stage Hadoop Sub-system 
• Spark, Databricks, and Spark-ups (Spark Based Startups) 
• A Successful Relationship: Scala in a Java World 
• Developments to Monitor: 
• The Future of Typesafe and Databricks 
• Scala Platforms & ‘New Data Management’ Ecosystems 
• Game Changing Applications 
• Opportunities and Actions in Scala for Ukraine Software 
Developers
Growth Indicators: Conferences and User 
Groups 
• Spark Summit December 
2013…450 Attendees, 2 
Days 
• Spark Summit July 
2014…1200 Attendees, 3 
Days 
• Scala By the Bay (San 
Francisco): 1983 
Members 
• New York Scala: 1935 
Members
Growth Indicators: Code Contribution 
* Github, Summer 2014
Growth Indicators: Application 
Diversification 
• Genomic Analysis @ UC 
Berkely AMPLab (Spark 
Based) 
• Real Time Online Advertising 
Auctions (Sharethrough) 
• Middleware Platform (J9) 
• Integrated Online Ticketing 
and Event Mgmt. (Ticketfly) 
• Next Generation Email Anti- 
Spam Service (Heluna)
Growth Indicators: Professional Investors 
• Typesafe: Greylock Partners, Juniper 
Networks, Shasta Ventures 
• Databricks: New Enterprise 
Associates, Andreeson Horowitz 
• Other Startup Investors: a16z, Sierra 
Ventures, Mission Ventures, UMC 
Capital, Bosch Venture Capital, 
Artiman Ventures, Sofinnova 
Ventures, Intel Capital, SingTel 
Innov8, Investor Growth Capital, 
QuestMark Partners, TransLink 
Capital, Goldman Sachs 
• Early Stage Big $$ Example: $107M @ 
http://www.guavus.com/ 
Big Data Investors 
Have Big Bucks for Scala Related 
Software Ventures
Apache Spark 
• Launched in January of 2010 
• New Hadoop Component up 
to 100X Faster than Map 
Reduce, with Stream 
Processing 
• Written in Scala with Scala, 
Java, and Python APIs 
• Latest Release on May 30, 
2014 with 110 Contributors
Spark and Databricks 
• ‘Creators’ of Spark 
• Spin Out Company from 
Berkeley AMPLab 
• Just raised $33M B Round 
• Dozens of Production 
Deployments as of July 2014 
• Moving the New Platform 
Quickly: 
• More SQL Connectors 
• MLLIB R Integration 
• Flume Streaming
Spark Ups…Startups Creating a ‘Spark’ 
Ecosystem 
• Adatao 
• Alpine 
• Graphflow 
• Guavus 
• Sharethrough
Spark Ups…Startups Creating a ‘Spark’ 
Ecosystem, and More! 
• Adatao 
• Alpine 
• Graphflow 
• Guavus 
• Sharethrough 
• Plus the Hadoop Disti 
Integrations: 
• Cloudera 
• Hortonworks 
• MapR 
• IBM 
• SAP Hanna Integration 
and SAP Certified Spark 
Distribution
Scala in a Java World 
Cooperation 
• Run on JVMs 
• Use with Existing Java 
Libraries 
• Support for Java Generics 
in Scala 
• Use Java Data Structures 
As Is in Scala 
Competition 
• The Full Typesafe 
Platform 
• Akka and Actors 
• Play Framework 
• Big Momentum for Scala 
in Next Gen Data 
Management 
• Java 8 Oracle Reaction
Competition is Good!
The Future (or end game) of Typesafe 
• Gamify It! 
• Acquisition in 1, 3, 5, or 
n years? 
• If Acquired, By Whom? 
• Private Forever? 
• Initial Public Offering and 
a Long Term Platform 
ISV?
The Future (or end game) of Databricks 
• Gamify It! 
• Acquisition in 1, 3, 5, or 
n years? 
• If Acquired, By Whom? 
• Private Forever? 
• Initial Public Offering and 
a Long Term Platform 
ISV?
Scala Platforms and Evolving Data 
Management Ecosystems 
• Processing Enough Data 
to Create Radical New 
Knowledge and Value is 
the Goal 
• Scala and Scala Platforms 
are a Strategic Driver in 
this High Growth Software 
Segment Attracting Big 
Bucks 
• Harness and Harvest More 
Data for Useful Purposes!
Game Changing Applications 
• Healthcare Genome 
Processing…New 
Frontiers in Mind/Body 
Knowledge & Disease 
Treatment 
• Mobile Device 
Behavioral Insight…to 
Create Autonomic Life 
Improvement 
• Mining Social Network 
Data…a billion API 
requests per day!
Opportunities and Potential Action Items in 
Scala for Ukraine Software Developers 
1. In Projects with Architecture Control, Evaluate Scala 
Fairly! (do not default to Java because you have body 
count) 
2. Leap into Spark or Others Will Beat You 
3. Think About Platform Technologies You Can Build 
Yourself to Make Your Own Services More Valuable and 
Efficient. Invest Intellectual Energy in Your Own 
Intellectual Property 
4. Educate and Certify More Scala Developers
Some Link References 
• http://www.typesafe.com/company/casestudies 
• http://databricks.com/ 
• http://blog.mikiobraun.de/2014/01/apache-spark.html 
• http://radar.oreilly.com/2013/11/how-companies-are-using-spark. 
html 
• https://amplab.cs.berkeley.edu/benchmark/ 
• https://github.com/twitter/scalding 
• http://www.theserverside.com/feature/The-Scala-debate-demystified- 
Balancing-the-rants-with-the-raves 
• http://boldradius.com/blog-post/ 
UwO3nQEAAA3xKXiL/five-tips-for-onboarding-scala-developers

More Related Content

What's hot

ASPgems - kappa architecture
ASPgems - kappa architectureASPgems - kappa architecture
ASPgems - kappa architecture
Juantomás García Molina
 
Modern data warehouse with Azure
Modern data warehouse with AzureModern data warehouse with Azure
Modern data warehouse with Azure
Nilesh Gule
 
Part 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure SynapsePart 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure Synapse
Nilesh Gule
 
Enterprise Metadata Integration
Enterprise Metadata IntegrationEnterprise Metadata Integration
Enterprise Metadata Integration
Dr. Mirko Kämpf
 
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
Spark Summit
 
Spark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion StoicaSpark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion StoicaDatabricks
 
Tokyo azure meetup #2 big data made easy
Tokyo azure meetup #2   big data made easyTokyo azure meetup #2   big data made easy
Tokyo azure meetup #2 big data made easy
Tokyo Azure Meetup
 
Time Series Analysis Using an Event Streaming Platform
 Time Series Analysis Using an Event Streaming Platform Time Series Analysis Using an Event Streaming Platform
Time Series Analysis Using an Event Streaming Platform
Dr. Mirko Kämpf
 
Build Your Own Recommendation Engine
Build Your Own Recommendation EngineBuild Your Own Recommendation Engine
Build Your Own Recommendation Engine
Sri Ambati
 
Super charged prototyping
Super charged prototypingSuper charged prototyping
Super charged prototyping
Michael Stephenson
 
Real time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsReal time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflows
Shankar Manian
 
Spark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu AdunuthulaSpark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu Adunuthula
Spark Summit
 
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Amazon Web Services Korea
 
The need for more agile analytics platforms.
The need for more agile analytics platforms.The need for more agile analytics platforms.
The need for more agile analytics platforms.
Amy Hodler
 
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark Summit
 
CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4Michael Kehoe
 
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
 Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr... Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
Databricks
 
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Alexander Dean
 
Spark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham ChopraSpark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark Summit
 
Realtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIORealtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIO
Jozo Kovac
 

What's hot (20)

ASPgems - kappa architecture
ASPgems - kappa architectureASPgems - kappa architecture
ASPgems - kappa architecture
 
Modern data warehouse with Azure
Modern data warehouse with AzureModern data warehouse with Azure
Modern data warehouse with Azure
 
Part 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure SynapsePart 3 - Modern Data Warehouse with Azure Synapse
Part 3 - Modern Data Warehouse with Azure Synapse
 
Enterprise Metadata Integration
Enterprise Metadata IntegrationEnterprise Metadata Integration
Enterprise Metadata Integration
 
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
The Little Warehouse That Couldn't Or: How We Learned to Stop Worrying and Mo...
 
Spark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion StoicaSpark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
Spark Summit East 2015 Keynote -- Databricks CEO Ion Stoica
 
Tokyo azure meetup #2 big data made easy
Tokyo azure meetup #2   big data made easyTokyo azure meetup #2   big data made easy
Tokyo azure meetup #2 big data made easy
 
Time Series Analysis Using an Event Streaming Platform
 Time Series Analysis Using an Event Streaming Platform Time Series Analysis Using an Event Streaming Platform
Time Series Analysis Using an Event Streaming Platform
 
Build Your Own Recommendation Engine
Build Your Own Recommendation EngineBuild Your Own Recommendation Engine
Build Your Own Recommendation Engine
 
Super charged prototyping
Super charged prototypingSuper charged prototyping
Super charged prototyping
 
Real time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflowsReal time monitoring of hadoop and spark workflows
Real time monitoring of hadoop and spark workflows
 
Spark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu AdunuthulaSpark Summit Keynote by Seshu Adunuthula
Spark Summit Keynote by Seshu Adunuthula
 
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
Kengo Horiuchi, SaaS Business Born in the Cloud :: AWS Partner Techshift
 
The need for more agile analytics platforms.
The need for more agile analytics platforms.The need for more agile analytics platforms.
The need for more agile analytics platforms.
 
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
Spark and Hadoop at Production Scale-(Anil Gadre, MapR)
 
CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4CouchbasetoHadoop_Matt_Michael_Justin v4
CouchbasetoHadoop_Matt_Michael_Justin v4
 
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
 Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr... Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
Using Spark-Solr at Scale: Productionizing Spark for Search with Apache Solr...
 
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
Snowplow and Kinesis - Presentation to the inaugural Amazon Kinesis London Us...
 
Spark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham ChopraSpark and Online Analytics: Spark Summit East talky by Shubham Chopra
Spark and Online Analytics: Spark Summit East talky by Shubham Chopra
 
Realtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIORealtime streaming architecture in INFINARIO
Realtime streaming architecture in INFINARIO
 

Viewers also liked

Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
MHF Tylösandsseminariet
 
When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...
Almer Postma
 
Tesi c torras
Tesi c torrasTesi c torras
Tesi c torras
10CH60R65
 
презентациялоготипа2
презентациялоготипа2презентациялоготипа2
презентациялоготипа2nika_v
 
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Traian Rebedea
 
China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...Beijing Zeefer Consulting Ltd.
 
Sebastian keckert status of the hzb quadrupole resonator
Sebastian keckert   status of the hzb quadrupole resonatorSebastian keckert   status of the hzb quadrupole resonator
Sebastian keckert status of the hzb quadrupole resonator
thinfilmsworkshop
 
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]Felex Lau
 
Formato de clase 8y9 acronyms
Formato de clase 8y9 acronymsFormato de clase 8y9 acronyms
Formato de clase 8y9 acronyms
Evelin Peña
 

Viewers also liked (9)

Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
Mobil IT och oskyddade trafikanter (Emeli Adell, Trivector)
 
When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...When you are what you own: do physically attractive people benefit more from ...
When you are what you own: do physically attractive people benefit more from ...
 
Tesi c torras
Tesi c torrasTesi c torras
Tesi c torras
 
презентациялоготипа2
презентациялоготипа2презентациялоготипа2
презентациялоготипа2
 
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
Extraction of Socio-Semantic Data from Chat Conversations in Collaborative Le...
 
China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...China glass ceramics enamel production equipment mfg. industry profile cic364...
China glass ceramics enamel production equipment mfg. industry profile cic364...
 
Sebastian keckert status of the hzb quadrupole resonator
Sebastian keckert   status of the hzb quadrupole resonatorSebastian keckert   status of the hzb quadrupole resonator
Sebastian keckert status of the hzb quadrupole resonator
 
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
DBS IB Chinese Lang and Lit - 雷雨作者與作品與現實 [PRESENTER VERSION]
 
Formato de clase 8y9 acronyms
Formato de clase 8y9 acronymsFormato de clase 8y9 acronyms
Formato de clase 8y9 acronyms
 

Similar to Scala Jday 2014

Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)
Databricks
 
Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019
Gravy Analytics
 
Databricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User GroupDatabricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User Group
Paco Nathan
 
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
confluent
 
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
confluent
 
2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato Review2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato Review
Hang Li
 
What's New in IBM Streams V4.1
What's New in IBM Streams V4.1What's New in IBM Streams V4.1
What's New in IBM Streams V4.1
lisanl
 
IBM Strategy for Spark
IBM Strategy for SparkIBM Strategy for Spark
IBM Strategy for Spark
Mark Kerzner
 
Dev Ops Training
Dev Ops TrainingDev Ops Training
Dev Ops Training
Spark Summit
 
Intro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWSIntro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWS
Sri Ambati
 
BDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of sparkBDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of spark
Jerry Wen
 
End-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache SparkEnd-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache Spark
Burak Yavuz
 
Apache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath LakkundiApache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Databricks
 
Media_Entertainment_Veriticals
Media_Entertainment_VeriticalsMedia_Entertainment_Veriticals
Media_Entertainment_VeriticalsPeyman Mohajerian
 
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Lillian Pierson
 
Architecting an Open Source AI Platform 2018 edition
Architecting an Open Source AI Platform   2018 editionArchitecting an Open Source AI Platform   2018 edition
Architecting an Open Source AI Platform 2018 edition
David Talby
 
Spark One Platform Webinar
Spark One Platform WebinarSpark One Platform Webinar
Spark One Platform Webinar
Cloudera, Inc.
 
Big data and AI in Socialbakers
Big data and AI in SocialbakersBig data and AI in Socialbakers
Big data and AI in Socialbakers
ppetr82
 
Spark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan KesslerSpark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan Kessler
Spark Summit
 
Himansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloperHimansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloperHimansu Behera
 

Similar to Scala Jday 2014 (20)

Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)Announcing Databricks Cloud (Spark Summit 2014)
Announcing Databricks Cloud (Spark Summit 2014)
 
Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019Transitioning from Java to Scala for Spark - March 13, 2019
Transitioning from Java to Scala for Spark - March 13, 2019
 
Databricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User GroupDatabricks Meetup @ Los Angeles Apache Spark User Group
Databricks Meetup @ Los Angeles Apache Spark User Group
 
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
Bringing Streaming Data To The Masses: Lowering The “Cost Of Admission” For Y...
 
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
Kafka: Journey from Just Another Software to Being a Critical Part of PayPal ...
 
2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato Review2015 Data Science Summit @ dato Review
2015 Data Science Summit @ dato Review
 
What's New in IBM Streams V4.1
What's New in IBM Streams V4.1What's New in IBM Streams V4.1
What's New in IBM Streams V4.1
 
IBM Strategy for Spark
IBM Strategy for SparkIBM Strategy for Spark
IBM Strategy for Spark
 
Dev Ops Training
Dev Ops TrainingDev Ops Training
Dev Ops Training
 
Intro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWSIntro to Machine Learning with H2O and AWS
Intro to Machine Learning with H2O and AWS
 
BDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of sparkBDTC2015 databricks-辛湜-state of spark
BDTC2015 databricks-辛湜-state of spark
 
End-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache SparkEnd-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache Spark
 
Apache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath LakkundiApache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
Apache Spark At Apple with Sam Maclennan and Vishwanath Lakkundi
 
Media_Entertainment_Veriticals
Media_Entertainment_VeriticalsMedia_Entertainment_Veriticals
Media_Entertainment_Veriticals
 
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
Big Data 2.0 - How Spark technologies are reshaping the world of big data ana...
 
Architecting an Open Source AI Platform 2018 edition
Architecting an Open Source AI Platform   2018 editionArchitecting an Open Source AI Platform   2018 edition
Architecting an Open Source AI Platform 2018 edition
 
Spark One Platform Webinar
Spark One Platform WebinarSpark One Platform Webinar
Spark One Platform Webinar
 
Big data and AI in Socialbakers
Big data and AI in SocialbakersBig data and AI in Socialbakers
Big data and AI in Socialbakers
 
Spark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan KesslerSpark Summit EU talk by Stephan Kessler
Spark Summit EU talk by Stephan Kessler
 
Himansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloperHimansu-Java&BigdataDeveloper
Himansu-Java&BigdataDeveloper
 

Recently uploaded

GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
Alina Yurenko
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Globus
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
Ortus Solutions, Corp
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Crescat
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
Google
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Globus
 
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi ArabiaTop 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
Yara Milbes
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
AMB-Review
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
Donna Lenk
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Globus
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 

Recently uploaded (20)

GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
 
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI AppAI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
AI Fusion Buddy Review: Brand New, Groundbreaking Gemini-Powered AI App
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi ArabiaTop 7 Unique WhatsApp API Benefits | Saudi Arabia
Top 7 Unique WhatsApp API Benefits | Saudi Arabia
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 

Scala Jday 2014

  • 1. SCALA in CY 2014: Gaining Business Momentum by Russ Hertzberg
  • 2. Agenda • Rapid Growth Phase for the Platform Ecosystem & Developer Community • Spawning A Popular Early Stage Hadoop Sub-system • Spark, Databricks, and Spark-ups (Spark Based Startups) • A Successful Relationship: Scala in a Java World • Developments to Monitor: • The Future of Typesafe and Databricks • Scala Platforms & ‘New Data Management’ Ecosystems • Game Changing Applications • Opportunities and Actions in Scala for Ukraine Software Developers
  • 3. Growth Indicators: Conferences and User Groups • Spark Summit December 2013…450 Attendees, 2 Days • Spark Summit July 2014…1200 Attendees, 3 Days • Scala By the Bay (San Francisco): 1983 Members • New York Scala: 1935 Members
  • 4. Growth Indicators: Code Contribution * Github, Summer 2014
  • 5. Growth Indicators: Application Diversification • Genomic Analysis @ UC Berkely AMPLab (Spark Based) • Real Time Online Advertising Auctions (Sharethrough) • Middleware Platform (J9) • Integrated Online Ticketing and Event Mgmt. (Ticketfly) • Next Generation Email Anti- Spam Service (Heluna)
  • 6. Growth Indicators: Professional Investors • Typesafe: Greylock Partners, Juniper Networks, Shasta Ventures • Databricks: New Enterprise Associates, Andreeson Horowitz • Other Startup Investors: a16z, Sierra Ventures, Mission Ventures, UMC Capital, Bosch Venture Capital, Artiman Ventures, Sofinnova Ventures, Intel Capital, SingTel Innov8, Investor Growth Capital, QuestMark Partners, TransLink Capital, Goldman Sachs • Early Stage Big $$ Example: $107M @ http://www.guavus.com/ Big Data Investors Have Big Bucks for Scala Related Software Ventures
  • 7. Apache Spark • Launched in January of 2010 • New Hadoop Component up to 100X Faster than Map Reduce, with Stream Processing • Written in Scala with Scala, Java, and Python APIs • Latest Release on May 30, 2014 with 110 Contributors
  • 8. Spark and Databricks • ‘Creators’ of Spark • Spin Out Company from Berkeley AMPLab • Just raised $33M B Round • Dozens of Production Deployments as of July 2014 • Moving the New Platform Quickly: • More SQL Connectors • MLLIB R Integration • Flume Streaming
  • 9. Spark Ups…Startups Creating a ‘Spark’ Ecosystem • Adatao • Alpine • Graphflow • Guavus • Sharethrough
  • 10. Spark Ups…Startups Creating a ‘Spark’ Ecosystem, and More! • Adatao • Alpine • Graphflow • Guavus • Sharethrough • Plus the Hadoop Disti Integrations: • Cloudera • Hortonworks • MapR • IBM • SAP Hanna Integration and SAP Certified Spark Distribution
  • 11. Scala in a Java World Cooperation • Run on JVMs • Use with Existing Java Libraries • Support for Java Generics in Scala • Use Java Data Structures As Is in Scala Competition • The Full Typesafe Platform • Akka and Actors • Play Framework • Big Momentum for Scala in Next Gen Data Management • Java 8 Oracle Reaction
  • 13. The Future (or end game) of Typesafe • Gamify It! • Acquisition in 1, 3, 5, or n years? • If Acquired, By Whom? • Private Forever? • Initial Public Offering and a Long Term Platform ISV?
  • 14. The Future (or end game) of Databricks • Gamify It! • Acquisition in 1, 3, 5, or n years? • If Acquired, By Whom? • Private Forever? • Initial Public Offering and a Long Term Platform ISV?
  • 15. Scala Platforms and Evolving Data Management Ecosystems • Processing Enough Data to Create Radical New Knowledge and Value is the Goal • Scala and Scala Platforms are a Strategic Driver in this High Growth Software Segment Attracting Big Bucks • Harness and Harvest More Data for Useful Purposes!
  • 16. Game Changing Applications • Healthcare Genome Processing…New Frontiers in Mind/Body Knowledge & Disease Treatment • Mobile Device Behavioral Insight…to Create Autonomic Life Improvement • Mining Social Network Data…a billion API requests per day!
  • 17. Opportunities and Potential Action Items in Scala for Ukraine Software Developers 1. In Projects with Architecture Control, Evaluate Scala Fairly! (do not default to Java because you have body count) 2. Leap into Spark or Others Will Beat You 3. Think About Platform Technologies You Can Build Yourself to Make Your Own Services More Valuable and Efficient. Invest Intellectual Energy in Your Own Intellectual Property 4. Educate and Certify More Scala Developers
  • 18. Some Link References • http://www.typesafe.com/company/casestudies • http://databricks.com/ • http://blog.mikiobraun.de/2014/01/apache-spark.html • http://radar.oreilly.com/2013/11/how-companies-are-using-spark. html • https://amplab.cs.berkeley.edu/benchmark/ • https://github.com/twitter/scalding • http://www.theserverside.com/feature/The-Scala-debate-demystified- Balancing-the-rants-with-the-raves • http://boldradius.com/blog-post/ UwO3nQEAAA3xKXiL/five-tips-for-onboarding-scala-developers