Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
SC4 Pilot 1
L. Selmi - BDE - Societal Challenge on
Transport
Brussels
22.09.2016
The Societal Challenge
L. Selmi - BDE - Societal Challenge on
Transport
From a data perspective we
see endless streams of ...
Objective of the SC4 Pilots
L. Selmi - BDE - Societal Challenge on
Transport
A scalable, fault-tolerant and flexible
platf...
Microservice Architecture
L. Selmi - BDE - Societal Challenge on
Transport
Message Broker
L. Selmi - BDE - Societal Challenge on
Transport
Apache Kafka is a high-throughput
distributed durable mess...
Kafka Cluster
L. Selmi - BDE - Societal Challenge on
Transport
Apache Kafka
Stream and Batch
Processor
L. Selmi - BDE - Societal Challenge on
Transport
Apache Flink is an open source
platform for di...
Flink Cluster
L. Selmi - BDE - Societal Challenge on
Transport
Apache Flink
Storage and Indexing
L. Selmi - BDE - Societal Challenge on
Transport
Elasticsearch is a distributed open
source document ...
Elasticsearch Cluster
L. Selmi - BDE - Societal Challenge on
Transport
Rserve
L. Selmi - BDE - Societal Challenge on
Transport
R is a free software environment for
statistical computing. It is ...
Pilot 1 Architecture
L. Selmi - BDE - Societal Challenge on
Transport
BDE Components
L. Selmi - BDE - Societal Challenge on
Transport
A Pipeline
L. Selmi - BDE - Societal Challenge on
Transport
SC4 - Pilot 1 Visualization
L. Selmi - BDE - Societal Challenge on
Transport
SC4 Pilot 1 can process
real-time FCD data fo...
Future Work
L. Selmi - BDE - Societal Challenge on
Transport
◎ Pilot 2: integration of the FCD
historical data and predict...
Upcoming SlideShare
Loading in …5
×

SC4 Workshop 2: Luigi Selmi : Big Data Europe Transport Pilot

123 views

Published on

Luigi Selmi : Big Data Europe Transport Pilot

Published in: Technology
  • Be the first to comment

  • Be the first to like this

SC4 Workshop 2: Luigi Selmi : Big Data Europe Transport Pilot

  1. 1. SC4 Pilot 1 L. Selmi - BDE - Societal Challenge on Transport Brussels 22.09.2016
  2. 2. The Societal Challenge L. Selmi - BDE - Societal Challenge on Transport From a data perspective we see endless streams of data collected by sensors and devices immersed in a graph of infrastructures
  3. 3. Objective of the SC4 Pilots L. Selmi - BDE - Societal Challenge on Transport A scalable, fault-tolerant and flexible platform based on open source frameworks that can process unbounded data sets and graphs.
  4. 4. Microservice Architecture L. Selmi - BDE - Societal Challenge on Transport
  5. 5. Message Broker L. Selmi - BDE - Societal Challenge on Transport Apache Kafka is a high-throughput distributed durable messaging system Apache Kafka
  6. 6. Kafka Cluster L. Selmi - BDE - Societal Challenge on Transport Apache Kafka
  7. 7. Stream and Batch Processor L. Selmi - BDE - Societal Challenge on Transport Apache Flink is an open source platform for distributed stream and batch data processing. Apache Flink
  8. 8. Flink Cluster L. Selmi - BDE - Societal Challenge on Transport Apache Flink
  9. 9. Storage and Indexing L. Selmi - BDE - Societal Challenge on Transport Elasticsearch is a distributed open source document database built on top of Apache Lucene
  10. 10. Elasticsearch Cluster L. Selmi - BDE - Societal Challenge on Transport
  11. 11. Rserve L. Selmi - BDE - Societal Challenge on Transport R is a free software environment for statistical computing. It is used in the pilot to run the map-matching and the prediction algorithms. The R Project
  12. 12. Pilot 1 Architecture L. Selmi - BDE - Societal Challenge on Transport
  13. 13. BDE Components L. Selmi - BDE - Societal Challenge on Transport
  14. 14. A Pipeline L. Selmi - BDE - Societal Challenge on Transport
  15. 15. SC4 - Pilot 1 Visualization L. Selmi - BDE - Societal Challenge on Transport SC4 Pilot 1 can process real-time FCD data for map-matching and aggregations (e.g. average speed)
  16. 16. Future Work L. Selmi - BDE - Societal Challenge on Transport ◎ Pilot 2: integration of the FCD historical data and prediction algorithm ◎ Pilot 3: more data sets (BT sensors, NYC taxi data, OpenStreetMap)

×