2015 ist "Big Data" im Gartner Hype Cycle Report verschwunden, und Business-Intelligence-Lösungen finden vor allem in der Cloud neue Beachtung. BI-Experten freuen sich, den Big-Data-Hype mit all seinen neuen Technologien überstanden zu haben. Was passiert aber wirklich in der Praxis? Datengetriebene Firmen erkennen Lambda-Architekturen als geeignete Plattformen, um Daten in Echtzeit und Batch-Modus zu verarbeiten und um flexibel auf neue Anforderungen zu reagieren. In diesen Lambda-Architekturen finden neue Big-Data-Technologien und bewährte BI-Lösungen zusammen, und nur zusammen wird neuer Geschäftswert erzeugt. Dieser Vortrag erklärt Lambda-Architekturen und bringt Big Data sowie BI zusammen.

1. Page 1Glomex GmbH – A ProSiebenSat.1 Media SE company
Dr. rer. nat. Markus Schmidberger, Data Platform Architect
@cloudHPC
Big Data ist tot –
Es lebe Business Intelligenz?
CeBIT 2015

2. Page 2Glomex GmbH – A ProSiebenSat.1 Media SE company
Gartner Hype Cycle 2015
Where is Big Data
in 2015 / 2016 ?
2014
2013
2012
2011
?

3. Page 3Glomex GmbH – A ProSiebenSat.1 Media SE company
Glomex: A ProSiebenSat.1 company
No.1 Ad sales house in GSA
~2bn video views per year
50+ online & mobile platforms
20 years of technical excellence
Where We Come From
No.1 TV broadcaster in Germany

4. Page 4Glomex GmbH – A ProSiebenSat.1 Media SE company
Networking effects – The power of
unifying many big players in one platform
TOTAL COST OF OWNERSHIP
CONTENT PRODUCTION RISK
REACH
INNOVATION COST
eCPM
Multi-tenant traffic pooling
International syndication
CAPEX pooling
Aggregated content performance data
Hyper-targeted advertising

5. Page 5Glomex GmbH – A ProSiebenSat.1 Media SE company
Glomex – The Global Media Exchange
Publishers
Content providers
Video Value Platform
Media Delivery Platform
Media Exchange Platform
Glomex
External broadcasters
Web-only content owners
Non-P7S1 publishers

6. Page 6Glomex GmbH – A ProSiebenSat.1 Media SE company
CDN
OperationsCDN
Operations
Glomex: The Global Media Exchange
Streaming
Infrastructure
CDN
Operations
Client /
Player

7. Page 7Glomex GmbH – A ProSiebenSat.1 Media SE company
Data Platform Vision
CDN Video-Player (Web, App)
Media Asset
Management
Transcoding
Video Platform
Data Platform
User-generated Data System-generated Data
Analytics Billing
Monitoring Content Discovery

8. Page 8Glomex GmbH – A ProSiebenSat.1 Media SE company
Strategic Profile – Data PlatformLevelofCompetence
BI Big Data
BI & Big Data
Machine Learning
Scalability
Real-time
Report Centric
Complete Value Chain
OLAP

9. Page 9Glomex GmbH – A ProSiebenSat.1 Media SE company
Data Platform - Architecture
Cloud-Based Architecture
Amazon Web Services
Modern Analytics
Workflows and Machine
Learning Methods
Modern Data Architecture
MicroServices

10. Page 10Glomex GmbH – A ProSiebenSat.1 Media SE company
Amazon Web Services
#1: Agility
#3: Continual Iteration
and Innovation
#2: Platform Breadth
#4: Cost Savings and
Flexibility

11. Page 11Glomex GmbH – A ProSiebenSat.1 Media SE company
Big Data World
Amazon
Glacier
S3 DynamoDB
RDS
EMR
Amazon
Redshift
Data PipelineAmazon Kinesis
Cassandra
CloudSearch
Kinesis-
enabled
app
Lambda ML
SQS
ElastiCache
DynamoDB
Streams

12. Page 12Glomex GmbH – A ProSiebenSat.1 Media SE company
ingest /
collect
store process /
analyze
consume /
visualize
Simplify Data Processing
data answers
Time to Answer (Latency)
Throughput
Cost

13. Page 13Glomex GmbH – A ProSiebenSat.1 Media SE company
Collect Store Analyze Consume
A
iOS Android
Web Apps
Logstash
Amazon
RDS
Amazon
DynamoDB
Amazon
ES
Amazon
S3
Apache
Kafka
Amazon
Glacier
Amazon
Kinesis
Amazon
DynamoDB
Amazon
Redshift
Impala
Pig
Amazon ML
Streaming
Amazon
Kinesis
AWS
Lambda
AmazonElasticMapReduce
Amazon
ElastiCache
SearchSQLNoSQLCache
StreamProcessingBatchInteractive
Logging
StreamStorage
IoTApplications
FileStorage
Analysis&Visualization
Hot
Cold
Warm
Hot
Slow
Hot
ML
Fast
Fast
Amazon
QuickSight
Transactional Data
File Data
Stream Data
Notebooks
Predictions
Apps & APIs
Mobile
Apps
IDE
Search Data
ETL

14. Page 14Glomex GmbH – A ProSiebenSat.1 Media SE company
MicroServices

15. Page 15Glomex GmbH – A ProSiebenSat.1 Media SE company
Lambda Architecture
Graphic provided by http://soutier.de/

16. Page 16Glomex GmbH – A ProSiebenSat.1 Media SE company
Lambda Architecture

17. Page 17Glomex GmbH – A ProSiebenSat.1 Media SE company
Summary
Lambda
Architecture
• Combines
batch &
real-time
• Enables BI
& Big Data
AWS Cloud
• Enables
agility
• Makes us
fast and
scalable
Team
• We are all
engineers
• Cross-
functionality
provides
new
insights
BI & Big Data
• Enables
new
business
insights
• Makes us
faster

18. Page 18Glomex GmbH – A ProSiebenSat.1 Media SE company
Dr. rer. nat. Markus Schmidberger, Data Platform Architect
@cloudHPC
Big Data ist tot –
Es lebe Business Intelligenz?
CeBIT 2015
We are hiring …
• Data Scientists
• Data Engineers
• Project Managers