BigData Week 2014 Belgium: Velocity

•

0 likes•687 views

French version of a talk given for the Big Data week, this is a poor export of this online one: http://slides.com/noootsab/bdw14

Technology

ANDY PETRELLA
VITESSE DE
TRAITEMENT DES
DONNÉES

NO,
REALLY?
@noootsab
http://ska-
la.blogspot.be/

PENDANT QUE NOUS LISONS CECI,
TROP DE DONNÉES NOUS ÉCHAPPENT...
... enfin, si nous ne faisons rien
!

Énergies
NOUS VIVONS PLONGÉ DANS UN FLUX DE
DONNÉES...
...mais ce n'est pas nouveau
Transactions
bancaires
Bourse
Téléphonie
Supply
chains

Un million d'events à la
seconde
Comment se figurer:
LE FLUX DE DONNÉES S'ACCÉLÈRE ET
DÉPASSE LA PERCEPTION HUMAINE

2012 2014 ·-· CHAQUE MINUTE
3.125 347.222
pics uploaded Flickr/Whatsapp
47.000 48.000
downloads
Apple
3.600 216.000
pics shared
Instagram
100.000
277.000microtexts
Twitter
sharesFacebook
2.000.000
4.000.000queries
Google
hours Youtube
messages
Emails48 72
204.000.000
204.000.000
684.478 2.460.000
PLUS DE FLUX, PLUS RAPIDE

Les appareils connectés...
SAAS
MMORPG
`SOCIAL`
NETWORKS
Générations: all
checked
DATA DÉLUGE

Lean
Cloud
Functional
Programming
Distributed
computing
Lambda
Architecture
LES MÉTHODOLOGIES ET LES
TECHNOLOGIES S'Y SONT ADAPTÉES.
ELLES SONT
PRÈTES!
Agile

TECHNOLOGIES DISTRIBUÉES
Spark-Streaming
Berkeley (airbnb, amazon, twitter)
S4
Amazon
Storm
Twitter
Kafka + Sanza
LinkedInData Freeway + Puma
Facebook

Marketing
SAV
Capacity
planning
Qualité
Environnement
Optimisation de
Production
EXEMPLES

More from Andy Petrella

Data Observability Best PracicesAndy Petrella

How to Build a Global Data MappingAndy Petrella

Interactive notebooksAndy Petrella

Governance complianceAndy Petrella

Data science governance and GDPRAndy Petrella

Data science governance : what and howAndy Petrella

Scala: the unpredicted lingua franca for data scienceAndy Petrella

Agile data science with scalaAndy Petrella

Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...Andy Petrella

What is a distributed data science pipeline. how with apache spark and friends.Andy Petrella

Towards a rebirth of data science (by Data Fellas)Andy Petrella

Distributed machine learning 101 using apache spark from a browser devoxx.b...Andy Petrella

Spark Summit Europe: Share and analyse genomic data at scaleAndy Petrella

Leveraging mesos as the ultimate distributed data science platformAndy Petrella

Data Enthusiasts London: Scalable and Interoperable data services. Applied to...Andy Petrella

Spark meetup london share and analyse genomic data at scale with spark, adam...Andy Petrella

Distributed machine learning 101 using apache spark from the browserAndy Petrella

Liège créative: Open ScienceAndy Petrella

BioBankCloud: Machine Learning on Genomics + GA4GH @ Med at ScaleAndy Petrella

What is Distributed Computing, Why we use Apache SparkAndy Petrella

More from Andy Petrella (20)

Data Observability Best Pracices

How to Build a Global Data Mapping

Interactive notebooks

Governance compliance

Data science governance and GDPR

Data science governance : what and how

Scala: the unpredicted lingua franca for data science

Agile data science with scala

Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...

What is a distributed data science pipeline. how with apache spark and friends.

Towards a rebirth of data science (by Data Fellas)

Distributed machine learning 101 using apache spark from a browser devoxx.b...

Spark Summit Europe: Share and analyse genomic data at scale

Leveraging mesos as the ultimate distributed data science platform

Data Enthusiasts London: Scalable and Interoperable data services. Applied to...

Spark meetup london share and analyse genomic data at scale with spark, adam...

Distributed machine learning 101 using apache spark from the browser

Liège créative: Open Science

BioBankCloud: Machine Learning on Genomics + GA4GH @ Med at Scale

What is Distributed Computing, Why we use Apache Spark