The document discusses empowering communities with big data technologies through lowering barriers to using big data. It describes the Big Data Europe consortium and platform, which consists of three layers - hardware, a resource manager, and big data applications. The platform packages big data components like HDFS, Spark, and Kafka in Docker containers to solve specific problems, and provides installation instructions and technical support contacts.

1. Empowering Communities with
Data Technologies
Fraunhofer IAIS - coordinatorSC Workshops
BIG DATA EUROPE

2. Rationale
 Show societal value of Big Data
 Lower barrier for using big data technologies
o Required effort and resources
o Limited data science skills
 Help establishing cross-
lingual/organizational/domain Data Value Chains
4-oct.-16

3. BigDataEurope: Consortium

4. Stakeholder Engagement Cycle

5. Open-Source Technologies for Big Data Apps
4-oct.-16www.big-data-europe.eu
5

6. Big Data – Technologies vs 3Vs
www.big-data-europe.eu
Volume
VelocityVariety
Storm

7. Big Data Technology - Groups
4-oct.-16www.big-data-europe.eu
Big Data
Technologies
Data Storage
Technologies
Data
Processing
Workflow
Coordination
Querying/
Processing
Search
Data
Export/
Import
Data
Analysis
Text Mining

8. Big Data Europe Platform
4-oct.-16www.big-data-europe.eu
BDE platform consists of 3 layers:
• the hardware layer
• a resource manager – Docker Swarm – and
• Big Data applications running on top
An application can be seen as a pipeline consisting of multiple components,
like HDFS, Spark and Kafka, which are wired together in order to solve a specific Big Data
problem. The components will be packaged in Docker containers and glued together
with Docker Compose.

9. Big Data Europe Platform
4-oct.-16www.big-data-europe.eu
https://www.big-data-europe.eu/howto-install-the-bde-platform/
https://github.com/big-data-europe
Youtube: Getting Started With BDE Platform
Install BDE platform
Technical support: TENFORCE
Aad Versteden aad.versteden@tenforce.com
Erika Pauwels erika.pauwels@tenforce.com