SlideShare a Scribd company logo
Big Data
Technical Benchmarking
Arne J. Berre, SINTEF,
Todor Ivanov, Univ. Frankfurt,
Tomas Pariente Lobo, Atos
BDVe – Databench Webinar, October 9, 2018
10/10/2018 DataBench Project - GA Nr 780966 1
Technical Benchmarks in Databench Workflow
2© IDC
2© IDC
Technical BenchmarksBusiness Benchmarks
Goals&Objectives
• The DataBench Toolbox will be a component-based system of both vertical (holistic/business/data type driven)
and horizontal (technical area based) big data benchmarks. following the layered architecture provide by the
BDVA reference model.
Holistic benchmarking approach for big data
• It should be able to work or integrate with existing benchmarking initiatives and resources where possible.
Not reinventing the wheel, but use wheels to build a new car
• The Toolbox will investigate gaps of industrial significance in the big data benchmarking field and contribute to
overcome them.
Filling gaps
• The Toolbox will implement ways to derive as much as possible the DataBench technical metrics and business
KPIs from the metrics extracted from the integrated benchmarking.
Homogenising metrics
• It will include a web-based visualization layer to assist to the final users to specify their benchmarking
requirements, such as selected benchmark, data generators, workloads, metrics and the preferred data, volume
and velocity, as well as searching and monitoring capabilities.
Web user interface
10-10-2018 5www.bdva.eu
BDV Reference Model
Identifying and Selecting Benchmarks
7
23
Domain/Sector/Busi
ness solutions KPIs
(Manufact,
Transport, Energy,..
Business
Transport
Manufacturing
Energy
.. Domain X …
22 Standards x x x x x x x x x x
MetaData x
Graph, Network x x x x x x x x x x x
Text, NLP, Web x x x x x x x x x x x x x x x x x x x x x x
Image, Audio x x x x
Spatio Temp x x
Time Series, IoT x x x x x x x
Structured, BI x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x
18 Visual Analytics x
17
Industrial Analytics
(Descriptive,
Diagnostic,
Predictive,
Prescriptive)
x x x x
16
Machine Learning,
AI, Data Science
x x x x x x x x x x x x
Streaming/ Realtime
Processing x x x x x x x
Interactive
Processing
x x x x x x x x x x x x x x x x x x x x x x x
Batch Processing x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x
Data
Privacy/Security
15
Data
Governance/Mgmt
x
14 Data Storage x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x
19
Communication &
Connectivity
x x
9
Cloud Services &
HPC, Edge x x x x x x
TPC-H
TPC-DSv1
LinearRoad
HadoopWorkloadExamples
GridMix
PigMix
MRBench
CALDA
HiBench
YCSB
SWIM
CloudRank-D
PUMABenchmarkSuite
CloudeSuite
MRBS
AMPLabBigDataBenchmark
BigBench
BigDataBench
LinkBench
BigFrame
PRIMEBALL
SemanticPublishingBenchmark(SPB)
SocialNetworkBenchmark
StreamBench
TPCx-HS
SparkBench
TPCx-V
BigFUN
TPC-DSv2
TPCx-BB
Graphalytics
YahooStreamingBenchmark(YSB)
DeepBench
DeepMark
TensorFlowBenchmarks
Fathom
AdBench
RIoTBench
HobbitBenchmark
TPCx-HSv2
BigBenchV2
Sanzu
Pennmachinelearningbenchmark(PMLB)
OpenMLbenchmarksuites
Senska
DAWNBench/MLPerf
IDEBench
ABench
1999
2002
2004
2009
2011
2018
BDVA Reference Model
2016
2017
2014
Verticals,incl.DatatypesAnalytics,Processing,DataManagement,Infra
Benchmarks
2015
2013
2012
2010
2008
2007
Updating with
new Benchmarks
Identifying and Selecting Benchmarks
Dimensions of Technical Benchmarks
9
Summary
Category Year Name Type Domain Data Type
Micro-
benchmarks
2010 HiBench Micro-benchmark Suite
Micro-benchmarks, Machine
Learning, SQL, Websearch,
Graph, Streaming Benchmarks
Structured, Text,
Web Graph
2015 SparkBench Micro-benchmark Suite
Machine Learning, Graph
Computation, SQL, Streaming
Application
Structured, Text,
Web Graph
2010 YCSB Micro-benchmark cloud OLTP operations Structured
2017 TPCx-IoT Micro-benchmark
workloads on typical IoT
Gateway systems
Structured, IoT
Application
Benchmarks
2015
Yahoo Streaming
Benchmark
Application Streaming
Benchmark
advertisement analytics pipeline
Structured, Time
Series
2013 BigBench/TPCx-BB
Application End-to-end
Benchmark
a fictional product retailer
platform
Structured, Text,
JSON logs
2017 BigBench V2
Application End-to-end
Benchmark
a fictional product retailer
platform
Structured, Text,
JSON logs
2018
ABench (Work-in-
Progress)
Big Data Architecture Stack
Benchmark
set of different workloads
Structured, Text,
JSON logs
10
Some of the benchmarks to integrate (I)
Year Name Type
2010 HiBench Big data benchmark suite for evaluating different big data frameworks. 19
workloads including synthetic micro-benchmarks and real-world applications from
6 categories which are micro, machine learning, sql, graph, websearch and
streaming.
2015 SparkBench System for benchmarking and simulating Spark jobs. Multiple workloads
organized in 4 categories.
2010 Yahoo! Cloud System
Benchmark (YSCB)
Evaluates performance of different “key-value” and “cloud” serving systems,
which do not support the ACID properties. The YCSB++ , an extension, includes
many additions such as multi-tester coordination for increased load and eventual
consistency measurement.
2017 TPCx-IoT Based on YCSB, but with significant changes. Workloads of data ingestion and
concurrent queries simulating workloads on typical IoT Gateway systems. Dataset
with data from sensors from electric power station(s)
11
Micro-benchmarks:
Some of the benchmarks to integrate (II)
Year Name Type
2015 Yahoo Streaming
Benchmark (YSB)
The Yahoo Streaming Benchmark is a streaming application benchmark
simulating an advertisement analytics pipeline.
2013 BigBench/TPCx-BB BigBench is an end-to-end, technology agnostic, application-level
benchmark that tests the analytical capabilities of a Big Data platform. It is
based on a fictional product retailer business model.
2017 BigBench V2 Similar to BigBench, BigBench V2 is an end-to-end, technology agnostic,
application-level benchmark that tests the analytical capabilities of a Big
Data platform
2018 ABench (Work-in-
Progress)
New type of multi-purpose Big Data benchmark covering many big data
scenarios and implementations. Extends other benchmarks such as
BigBench
12
Application-oriented benchmarks:
▪ The BigBench specification comprises
two key components:
▪ a data model specification
▪ a workload/query specification.
▪ The structured part of the BigBench data
model is adopted from the TPC-DS data
model
▪ The data model specification is
implemented by a data generator, which
is based on an extension of PDGF.
▪ BigBench 1.0 workload specification
consists of 30 queries/workloads (10
structured from TPC-DS, and 20 adapted
from a McKinsey report on Big Data use
cases and opportunities).
▪ BigBench 2.0 …
The BigBench data model
The BigBench 2.0 overview
Rabi T., et al. The Vision of BigBench 2.0, 2016.
Proceedings of the Fourth Workshop on Data
analytics in the Cloud. Article No. 3,
http://blog.cloudera.com/blog/2014/11/bigbench-toward-an-industry-standard-benchmark-for-big-data-analytics/
▪ Benchmark any step of the Linked Data
lifecycle
▪ Ensure that benchmarking results can be
found, accessed, integrated and reused
easily (FAIR principles)
▪ Benchmark Big Data platforms by being the
first distributed benchmarking platform for
Linked data.
▪ The Hobbit platform comprises several
components:
▪ Single components are implemented as
independent containers.
▪ Communication between these components is
done via a message bus.
▪ Everything is dockerized, from the
benchmarked system to all the components
Principles:
• Users can test systems with the HOBBIT
benchmarks without having to worry about
finding standardized hardware
• New benchmarks can be easily created and
added to the platform by third parties.
• The evaluation can be scaled out to large datasets
and on distributed architectures.
• The publishing and analysis of the results of
different systems can be carried out in a uniform
manner across the different benchmarks.
Summary
• DataBench:
• A framework for big data benchmarking for PPP projects and big data practitioners
• We will provide methodology and tools
• Added value:
• An umbrella to access to multiple benchmarks
• Homogenized technical metrics
• Derived business KPIs,
• A community around
• PPP projects, industrial partners (BDVA and beyond) and benchmarking initiatives are
welcomed to work with us, either to use our framework or to add new benchmarks
Big Data Benchmark session at EBDVF'2018
10/10/2018 DataBench Project - GA Nr 780966 17
Monday November 12th, 1700 – 1830,EBDVF'2018, Vienna
Arne.J.Berre@sintef.no
todor@dbis.cs.uni-frankfurt.de
tomas.parientelobo@atos.net
Evidence Based Big Data Benchmarking to
Improve Business Performance

More Related Content

What's hot

Virtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for BenchmarkingVirtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Big Data Value Association
 
Mapping presentation THAG big data from space
Mapping presentation THAG big data from spaceMapping presentation THAG big data from space
Mapping presentation THAG big data from space
Bartosz Szkudlarek
 
Using dask for large systems of financial models
Using dask for large systems of financial modelsUsing dask for large systems of financial models
Using dask for large systems of financial models
Petr Wolf
 
Building the DataBench Workflow and Architecture
Building the DataBench Workflow and ArchitectureBuilding the DataBench Workflow and Architecture
Building the DataBench Workflow and Architecture
t_ivanov
 
SC1 Workshop 2 Pilot instantiations
SC1 Workshop 2 Pilot instantiationsSC1 Workshop 2 Pilot instantiations
SC1 Workshop 2 Pilot instantiations
BigData_Europe
 
Academia to industry looking back on a decade of ml
Academia to industry looking back on a decade of mlAcademia to industry looking back on a decade of ml
Academia to industry looking back on a decade of ml
Mikio L. Braun
 
Accelerating Time to Research Using CloudBank
Accelerating Time to Research Using CloudBankAccelerating Time to Research Using CloudBank
Accelerating Time to Research Using CloudBank
Sanjay Padhi, Ph.D
 
Tag.bio aws public jun 08 2021
Tag.bio aws public jun 08 2021 Tag.bio aws public jun 08 2021
Tag.bio aws public jun 08 2021
Sanjay Padhi, Ph.D
 
Demystify Big Data Breakfast Briefing - Juergen Urbanski, T-Systems
Demystify Big Data Breakfast Briefing - Juergen Urbanski, T-SystemsDemystify Big Data Breakfast Briefing - Juergen Urbanski, T-Systems
Demystify Big Data Breakfast Briefing - Juergen Urbanski, T-Systems
Hortonworks
 
P. Struijs, Toward the Use of Big Data for European Statistics
P. Struijs, Toward the Use of Big Data for European StatisticsP. Struijs, Toward the Use of Big Data for European Statistics
P. Struijs, Toward the Use of Big Data for European Statistics
Istituto nazionale di statistica
 
Self-Service Analytics with Guard Rails
Self-Service Analytics with Guard RailsSelf-Service Analytics with Guard Rails
Self-Service Analytics with Guard Rails
Denodo
 
Build a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo CarsBuild a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo Cars
Neo4j
 
SDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der Plattform
SDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der PlattformSDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der Plattform
SDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der Plattform
Smart Data Innovation Lab
 
HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...
HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...
HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...
Big Data Spain
 
Ogi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokisOgi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokis
OpenGovIntelligence
 
Graphs in Telecommunications - Jesus Barrasa, Neo4j
Graphs in Telecommunications - Jesus Barrasa, Neo4jGraphs in Telecommunications - Jesus Barrasa, Neo4j
Graphs in Telecommunications - Jesus Barrasa, Neo4j
Neo4j
 
"How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig...
"How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig..."How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig...
"How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig...
Data Science Milan
 
A Multi-agent Approach for Processing Industrial Enterprise Data
A Multi-agent Approach for Processing Industrial Enterprise DataA Multi-agent Approach for Processing Industrial Enterprise Data
A Multi-agent Approach for Processing Industrial Enterprise Data
FAST-Lab. Factory Automation Systems and Technologies Laboratory, Tampere University of Technology
 
Weekly Meeting 8.pdf
Weekly Meeting 8.pdfWeekly Meeting 8.pdf
Weekly Meeting 8.pdf
ZixunZhou
 
DataBench Toolbox in a Nutshell
DataBench Toolbox in a NutshellDataBench Toolbox in a Nutshell
DataBench Toolbox in a Nutshell
DataBench
 

What's hot (20)

Virtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for BenchmarkingVirtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
Virtual BenchLearning - DeepHealth - Needs & Requirements for Benchmarking
 
Mapping presentation THAG big data from space
Mapping presentation THAG big data from spaceMapping presentation THAG big data from space
Mapping presentation THAG big data from space
 
Using dask for large systems of financial models
Using dask for large systems of financial modelsUsing dask for large systems of financial models
Using dask for large systems of financial models
 
Building the DataBench Workflow and Architecture
Building the DataBench Workflow and ArchitectureBuilding the DataBench Workflow and Architecture
Building the DataBench Workflow and Architecture
 
SC1 Workshop 2 Pilot instantiations
SC1 Workshop 2 Pilot instantiationsSC1 Workshop 2 Pilot instantiations
SC1 Workshop 2 Pilot instantiations
 
Academia to industry looking back on a decade of ml
Academia to industry looking back on a decade of mlAcademia to industry looking back on a decade of ml
Academia to industry looking back on a decade of ml
 
Accelerating Time to Research Using CloudBank
Accelerating Time to Research Using CloudBankAccelerating Time to Research Using CloudBank
Accelerating Time to Research Using CloudBank
 
Tag.bio aws public jun 08 2021
Tag.bio aws public jun 08 2021 Tag.bio aws public jun 08 2021
Tag.bio aws public jun 08 2021
 
Demystify Big Data Breakfast Briefing - Juergen Urbanski, T-Systems
Demystify Big Data Breakfast Briefing - Juergen Urbanski, T-SystemsDemystify Big Data Breakfast Briefing - Juergen Urbanski, T-Systems
Demystify Big Data Breakfast Briefing - Juergen Urbanski, T-Systems
 
P. Struijs, Toward the Use of Big Data for European Statistics
P. Struijs, Toward the Use of Big Data for European StatisticsP. Struijs, Toward the Use of Big Data for European Statistics
P. Struijs, Toward the Use of Big Data for European Statistics
 
Self-Service Analytics with Guard Rails
Self-Service Analytics with Guard RailsSelf-Service Analytics with Guard Rails
Self-Service Analytics with Guard Rails
 
Build a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo CarsBuild a car with Graphs, Fabien Batejat, Volvo Cars
Build a car with Graphs, Fabien Batejat, Volvo Cars
 
SDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der Plattform
SDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der PlattformSDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der Plattform
SDIC'16 - Betrieb des Smart Data Innovation Labs - Vorstellung der Plattform
 
HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...
HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...
HOW TO APPLY BIG DATA ANALYTICS AND MACHINE LEARNING TO REAL TIME PROCESSING ...
 
Ogi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokisOgi conf delft_v1_evangelos_kalampokis
Ogi conf delft_v1_evangelos_kalampokis
 
Graphs in Telecommunications - Jesus Barrasa, Neo4j
Graphs in Telecommunications - Jesus Barrasa, Neo4jGraphs in Telecommunications - Jesus Barrasa, Neo4j
Graphs in Telecommunications - Jesus Barrasa, Neo4j
 
"How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig...
"How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig..."How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig...
"How Pirelli uses Domino and Plotly for Smart Manufacturing" by Alberto Arrig...
 
A Multi-agent Approach for Processing Industrial Enterprise Data
A Multi-agent Approach for Processing Industrial Enterprise DataA Multi-agent Approach for Processing Industrial Enterprise Data
A Multi-agent Approach for Processing Industrial Enterprise Data
 
Weekly Meeting 8.pdf
Weekly Meeting 8.pdfWeekly Meeting 8.pdf
Weekly Meeting 8.pdf
 
DataBench Toolbox in a Nutshell
DataBench Toolbox in a NutshellDataBench Toolbox in a Nutshell
DataBench Toolbox in a Nutshell
 

Similar to BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct 9, 2018

Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...
Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...
Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...
DataBench
 
DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...
DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...
DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...
DataBench
 
13 pv-do es-18-bigdata-v3
13 pv-do es-18-bigdata-v313 pv-do es-18-bigdata-v3
13 pv-do es-18-bigdata-v3
Aravindharamanan S
 
BigData Analysis
BigData AnalysisBigData Analysis
Relating Big Data Business and Technical Performance Indicators, Barbara Pern...
Relating Big Data Business and Technical Performance Indicators, Barbara Pern...Relating Big Data Business and Technical Performance Indicators, Barbara Pern...
Relating Big Data Business and Technical Performance Indicators, Barbara Pern...
DataBench
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigData_Europe
 
Agile Testing Days 2017 Intoducing AgileBI Sustainably - Excercises
Agile Testing Days 2017 Intoducing AgileBI Sustainably - ExcercisesAgile Testing Days 2017 Intoducing AgileBI Sustainably - Excercises
Agile Testing Days 2017 Intoducing AgileBI Sustainably - Excercises
Raphael Branger
 
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Matt Stubbs
 
Paris FOD Meetup #5 Cognizant Presentation
Paris FOD Meetup #5 Cognizant PresentationParis FOD Meetup #5 Cognizant Presentation
Paris FOD Meetup #5 Cognizant Presentation
Abdelkrim Hadjidj
 
What is the future of data strategy?
What is the future of data strategy?What is the future of data strategy?
What is the future of data strategy?
Denodo
 
JASPERSOFT LIVE DEMO - NAM
JASPERSOFT LIVE DEMO - NAMJASPERSOFT LIVE DEMO - NAM
JASPERSOFT LIVE DEMO - NAM
TIBCO Jaspersoft
 
WSO2 Machine Learner - Product Overview
WSO2 Machine Learner - Product OverviewWSO2 Machine Learner - Product Overview
WSO2 Machine Learner - Product Overview
WSO2
 
Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...
Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...
Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...
Accelerite
 
Resume
ResumeResume
Resume
Tushar Gupta
 
A technical Introduction to Big Data Analytics
A technical Introduction to Big Data AnalyticsA technical Introduction to Big Data Analytics
A technical Introduction to Big Data Analytics
Pethuru Raj PhD
 
WSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product OverviewWSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product Overview
WSO2
 
Bitrock manufacturing
Bitrock manufacturing Bitrock manufacturing
Bitrock manufacturing
cosma_r
 
BDE SC3.3 Workshop - BDE review: Scope and Opportunities
 BDE SC3.3 Workshop -  BDE review: Scope and Opportunities BDE SC3.3 Workshop -  BDE review: Scope and Opportunities
BDE SC3.3 Workshop - BDE review: Scope and Opportunities
BigData_Europe
 
Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19
Prof.Balakrishnan S
 
Big Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of AnalyticsBig Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of Analytics
BigDataExpo
 

Similar to BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct 9, 2018 (20)

Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...
Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...
Building the DataBench Workflow and Architecture, Todor Ivanov, Bench 2019 - ...
 
DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...
DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...
DataBench Toolbox Demo, Ivan Martinez, Tomas Pariente Lobo, BDV Meet-Up Riga,...
 
13 pv-do es-18-bigdata-v3
13 pv-do es-18-bigdata-v313 pv-do es-18-bigdata-v3
13 pv-do es-18-bigdata-v3
 
BigData Analysis
BigData AnalysisBigData Analysis
BigData Analysis
 
Relating Big Data Business and Technical Performance Indicators, Barbara Pern...
Relating Big Data Business and Technical Performance Indicators, Barbara Pern...Relating Big Data Business and Technical Performance Indicators, Barbara Pern...
Relating Big Data Business and Technical Performance Indicators, Barbara Pern...
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal Pilots
 
Agile Testing Days 2017 Intoducing AgileBI Sustainably - Excercises
Agile Testing Days 2017 Intoducing AgileBI Sustainably - ExcercisesAgile Testing Days 2017 Intoducing AgileBI Sustainably - Excercises
Agile Testing Days 2017 Intoducing AgileBI Sustainably - Excercises
 
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
Big Data LDN 2017: How Big Data Insights Become Easily Accessible With Workfl...
 
Paris FOD Meetup #5 Cognizant Presentation
Paris FOD Meetup #5 Cognizant PresentationParis FOD Meetup #5 Cognizant Presentation
Paris FOD Meetup #5 Cognizant Presentation
 
What is the future of data strategy?
What is the future of data strategy?What is the future of data strategy?
What is the future of data strategy?
 
JASPERSOFT LIVE DEMO - NAM
JASPERSOFT LIVE DEMO - NAMJASPERSOFT LIVE DEMO - NAM
JASPERSOFT LIVE DEMO - NAM
 
WSO2 Machine Learner - Product Overview
WSO2 Machine Learner - Product OverviewWSO2 Machine Learner - Product Overview
WSO2 Machine Learner - Product Overview
 
Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...
Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...
Shareinsights an-end-to-end-implementation-of-the-modern-analytics-archi...
 
Resume
ResumeResume
Resume
 
A technical Introduction to Big Data Analytics
A technical Introduction to Big Data AnalyticsA technical Introduction to Big Data Analytics
A technical Introduction to Big Data Analytics
 
WSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product OverviewWSO2 Data Analytics Server - Product Overview
WSO2 Data Analytics Server - Product Overview
 
Bitrock manufacturing
Bitrock manufacturing Bitrock manufacturing
Bitrock manufacturing
 
BDE SC3.3 Workshop - BDE review: Scope and Opportunities
 BDE SC3.3 Workshop -  BDE review: Scope and Opportunities BDE SC3.3 Workshop -  BDE review: Scope and Opportunities
BDE SC3.3 Workshop - BDE review: Scope and Opportunities
 
Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19Big Data Driven Solutions to Combat Covid' 19
Big Data Driven Solutions to Combat Covid' 19
 
Big Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of AnalyticsBig Data Expo 2015 - Pentaho The Future of Analytics
Big Data Expo 2015 - Pentaho The Future of Analytics
 

More from Big Data Value Association

Data Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharingData Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharing
Big Data Value Association
 
Key Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplaceKey Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplace
Big Data Value Association
 
GDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharingGDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharing
Big Data Value Association
 
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Big Data Value Association
 
Three pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and PrivacyThree pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Big Data Value Association
 
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Big Data Value Association
 
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
Big Data Value Association
 
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
Big Data Value Association
 
BDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionalsBDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionals
Big Data Value Association
 
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
Big Data Value Association
 
BDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshopBDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshop
Big Data Value Association
 
BDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshopBDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshop
Big Data Value Association
 
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
Big Data Value Association
 
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector WebinarBigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
Big Data Value Association
 
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector WebinarBigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
Big Data Value Association
 
Policy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical OverviewPolicy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical Overview
Big Data Value Association
 
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Big Data Value Association
 
Policy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against RadicalisationPolicy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against Radicalisation
Big Data Value Association
 
BDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborationsBDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborations
Big Data Value Association
 
BDVA i Spaces - ITA Aragón
BDVA i Spaces - ITA AragónBDVA i Spaces - ITA Aragón
BDVA i Spaces - ITA Aragón
Big Data Value Association
 

More from Big Data Value Association (20)

Data Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharingData Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharing
 
Key Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplaceKey Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplace
 
GDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharingGDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharing
 
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
 
Three pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and PrivacyThree pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
 
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
 
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
 
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
 
BDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionalsBDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionals
 
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
 
BDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshopBDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshop
 
BDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshopBDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshop
 
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
 
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector WebinarBigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
 
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector WebinarBigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
 
Policy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical OverviewPolicy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical Overview
 
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
 
Policy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against RadicalisationPolicy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against Radicalisation
 
BDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborationsBDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborations
 
BDVA i Spaces - ITA Aragón
BDVA i Spaces - ITA AragónBDVA i Spaces - ITA Aragón
BDVA i Spaces - ITA Aragón
 

Recently uploaded

Digital Transformation Frameworks: Driving Digital Excellence
Digital Transformation Frameworks: Driving Digital ExcellenceDigital Transformation Frameworks: Driving Digital Excellence
Digital Transformation Frameworks: Driving Digital Excellence
Operational Excellence Consulting
 
TIMES BPO: Business Plan For Startup Industry
TIMES BPO: Business Plan For Startup IndustryTIMES BPO: Business Plan For Startup Industry
TIMES BPO: Business Plan For Startup Industry
timesbpobusiness
 
Dpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian Matka
Dpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian MatkaDpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian Matka
Dpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian Matka
➒➌➎➏➑➐➋➑➐➐Dpboss Matka Guessing Satta Matka Kalyan Chart Indian Matka
 
Zodiac Signs and Food Preferences_ What Your Sign Says About Your Taste
Zodiac Signs and Food Preferences_ What Your Sign Says About Your TasteZodiac Signs and Food Preferences_ What Your Sign Says About Your Taste
Zodiac Signs and Food Preferences_ What Your Sign Says About Your Taste
my Pandit
 
Best practices for project execution and delivery
Best practices for project execution and deliveryBest practices for project execution and delivery
Best practices for project execution and delivery
CLIVE MINCHIN
 
Best Competitive Marble Pricing in Dubai - ☎ 9928909666
Best Competitive Marble Pricing in Dubai - ☎ 9928909666Best Competitive Marble Pricing in Dubai - ☎ 9928909666
Best Competitive Marble Pricing in Dubai - ☎ 9928909666
Stone Art Hub
 
Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...
Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...
Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...
Herman Kienhuis
 
Ellen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women Magazine
Ellen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women MagazineEllen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women Magazine
Ellen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women Magazine
CIOWomenMagazine
 
How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....
How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....
How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....
Lacey Max
 
Negotiation & Presentation Skills regarding steps in business communication, ...
Negotiation & Presentation Skills regarding steps in business communication, ...Negotiation & Presentation Skills regarding steps in business communication, ...
Negotiation & Presentation Skills regarding steps in business communication, ...
UdayaShankarS1
 
Industrial Tech SW: Category Renewal and Creation
Industrial Tech SW:  Category Renewal and CreationIndustrial Tech SW:  Category Renewal and Creation
Industrial Tech SW: Category Renewal and Creation
Christian Dahlen
 
Innovation Management Frameworks: Your Guide to Creativity & Innovation
Innovation Management Frameworks: Your Guide to Creativity & InnovationInnovation Management Frameworks: Your Guide to Creativity & Innovation
Innovation Management Frameworks: Your Guide to Creativity & Innovation
Operational Excellence Consulting
 
The latest Heat Pump Manual from Newentide
The latest Heat Pump Manual from NewentideThe latest Heat Pump Manual from Newentide
The latest Heat Pump Manual from Newentide
JoeYangGreatMachiner
 
Income Tax exemption for Start up : Section 80 IAC
Income Tax  exemption for Start up : Section 80 IACIncome Tax  exemption for Start up : Section 80 IAC
Income Tax exemption for Start up : Section 80 IAC
CA Dr. Prithvi Ranjan Parhi
 
How to Buy an Engagement Ring.pcffbhfbfghfhptx
How to Buy an Engagement Ring.pcffbhfbfghfhptxHow to Buy an Engagement Ring.pcffbhfbfghfhptx
How to Buy an Engagement Ring.pcffbhfbfghfhptx
Charleston Alexander
 
Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.
Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.
Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.
AnnySerafinaLove
 
Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...
Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...
Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...
IPLTech Electric
 
Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...
Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...
Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...
Neil Horowitz
 
Satta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel Chart
Satta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel ChartSatta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel Chart
Satta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel Chart
➒➌➎➏➑➐➋➑➐➐Dpboss Matka Guessing Satta Matka Kalyan Chart Indian Matka
 
NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...
NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...
NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...
BBPMedia1
 

Recently uploaded (20)

Digital Transformation Frameworks: Driving Digital Excellence
Digital Transformation Frameworks: Driving Digital ExcellenceDigital Transformation Frameworks: Driving Digital Excellence
Digital Transformation Frameworks: Driving Digital Excellence
 
TIMES BPO: Business Plan For Startup Industry
TIMES BPO: Business Plan For Startup IndustryTIMES BPO: Business Plan For Startup Industry
TIMES BPO: Business Plan For Startup Industry
 
Dpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian Matka
Dpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian MatkaDpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian Matka
Dpboss Matka Guessing Satta Matta Matka Kalyan Chart Indian Matka
 
Zodiac Signs and Food Preferences_ What Your Sign Says About Your Taste
Zodiac Signs and Food Preferences_ What Your Sign Says About Your TasteZodiac Signs and Food Preferences_ What Your Sign Says About Your Taste
Zodiac Signs and Food Preferences_ What Your Sign Says About Your Taste
 
Best practices for project execution and delivery
Best practices for project execution and deliveryBest practices for project execution and delivery
Best practices for project execution and delivery
 
Best Competitive Marble Pricing in Dubai - ☎ 9928909666
Best Competitive Marble Pricing in Dubai - ☎ 9928909666Best Competitive Marble Pricing in Dubai - ☎ 9928909666
Best Competitive Marble Pricing in Dubai - ☎ 9928909666
 
Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...
Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...
Presentation by Herman Kienhuis (Curiosity VC) on Investing in AI for ABS Alu...
 
Ellen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women Magazine
Ellen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women MagazineEllen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women Magazine
Ellen Burstyn: From Detroit Dreamer to Hollywood Legend | CIO Women Magazine
 
How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....
How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....
How are Lilac French Bulldogs Beauty Charming the World and Capturing Hearts....
 
Negotiation & Presentation Skills regarding steps in business communication, ...
Negotiation & Presentation Skills regarding steps in business communication, ...Negotiation & Presentation Skills regarding steps in business communication, ...
Negotiation & Presentation Skills regarding steps in business communication, ...
 
Industrial Tech SW: Category Renewal and Creation
Industrial Tech SW:  Category Renewal and CreationIndustrial Tech SW:  Category Renewal and Creation
Industrial Tech SW: Category Renewal and Creation
 
Innovation Management Frameworks: Your Guide to Creativity & Innovation
Innovation Management Frameworks: Your Guide to Creativity & InnovationInnovation Management Frameworks: Your Guide to Creativity & Innovation
Innovation Management Frameworks: Your Guide to Creativity & Innovation
 
The latest Heat Pump Manual from Newentide
The latest Heat Pump Manual from NewentideThe latest Heat Pump Manual from Newentide
The latest Heat Pump Manual from Newentide
 
Income Tax exemption for Start up : Section 80 IAC
Income Tax  exemption for Start up : Section 80 IACIncome Tax  exemption for Start up : Section 80 IAC
Income Tax exemption for Start up : Section 80 IAC
 
How to Buy an Engagement Ring.pcffbhfbfghfhptx
How to Buy an Engagement Ring.pcffbhfbfghfhptxHow to Buy an Engagement Ring.pcffbhfbfghfhptx
How to Buy an Engagement Ring.pcffbhfbfghfhptx
 
Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.
Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.
Anny Serafina Love - Letter of Recommendation by Kellen Harkins, MS.
 
Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...
Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...
Sustainable Logistics for Cost Reduction_ IPLTech Electric's Eco-Friendly Tra...
 
Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...
Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...
Brian Fitzsimmons on the Business Strategy and Content Flywheel of Barstool S...
 
Satta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel Chart
Satta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel ChartSatta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel Chart
Satta Matka Dpboss Matka Guessing Kalyan Chart Indian Matka Kalyan panel Chart
 
NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...
NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...
NIMA2024 | De toegevoegde waarde van DEI en ESG in campagnes | Nathalie Lam |...
 

BDVe Webinar Series: DataBench – Benchmarking Big Data. Arne Berre. Tue, Oct 9, 2018

  • 1. Big Data Technical Benchmarking Arne J. Berre, SINTEF, Todor Ivanov, Univ. Frankfurt, Tomas Pariente Lobo, Atos BDVe – Databench Webinar, October 9, 2018 10/10/2018 DataBench Project - GA Nr 780966 1
  • 2. Technical Benchmarks in Databench Workflow 2© IDC 2© IDC Technical BenchmarksBusiness Benchmarks
  • 3. Goals&Objectives • The DataBench Toolbox will be a component-based system of both vertical (holistic/business/data type driven) and horizontal (technical area based) big data benchmarks. following the layered architecture provide by the BDVA reference model. Holistic benchmarking approach for big data • It should be able to work or integrate with existing benchmarking initiatives and resources where possible. Not reinventing the wheel, but use wheels to build a new car • The Toolbox will investigate gaps of industrial significance in the big data benchmarking field and contribute to overcome them. Filling gaps • The Toolbox will implement ways to derive as much as possible the DataBench technical metrics and business KPIs from the metrics extracted from the integrated benchmarking. Homogenising metrics • It will include a web-based visualization layer to assist to the final users to specify their benchmarking requirements, such as selected benchmark, data generators, workloads, metrics and the preferred data, volume and velocity, as well as searching and monitoring capabilities. Web user interface
  • 6. 7 23 Domain/Sector/Busi ness solutions KPIs (Manufact, Transport, Energy,.. Business Transport Manufacturing Energy .. Domain X … 22 Standards x x x x x x x x x x MetaData x Graph, Network x x x x x x x x x x x Text, NLP, Web x x x x x x x x x x x x x x x x x x x x x x Image, Audio x x x x Spatio Temp x x Time Series, IoT x x x x x x x Structured, BI x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x 18 Visual Analytics x 17 Industrial Analytics (Descriptive, Diagnostic, Predictive, Prescriptive) x x x x 16 Machine Learning, AI, Data Science x x x x x x x x x x x x Streaming/ Realtime Processing x x x x x x x Interactive Processing x x x x x x x x x x x x x x x x x x x x x x x Batch Processing x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x Data Privacy/Security 15 Data Governance/Mgmt x 14 Data Storage x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x 19 Communication & Connectivity x x 9 Cloud Services & HPC, Edge x x x x x x TPC-H TPC-DSv1 LinearRoad HadoopWorkloadExamples GridMix PigMix MRBench CALDA HiBench YCSB SWIM CloudRank-D PUMABenchmarkSuite CloudeSuite MRBS AMPLabBigDataBenchmark BigBench BigDataBench LinkBench BigFrame PRIMEBALL SemanticPublishingBenchmark(SPB) SocialNetworkBenchmark StreamBench TPCx-HS SparkBench TPCx-V BigFUN TPC-DSv2 TPCx-BB Graphalytics YahooStreamingBenchmark(YSB) DeepBench DeepMark TensorFlowBenchmarks Fathom AdBench RIoTBench HobbitBenchmark TPCx-HSv2 BigBenchV2 Sanzu Pennmachinelearningbenchmark(PMLB) OpenMLbenchmarksuites Senska DAWNBench/MLPerf IDEBench ABench 1999 2002 2004 2009 2011 2018 BDVA Reference Model 2016 2017 2014 Verticals,incl.DatatypesAnalytics,Processing,DataManagement,Infra Benchmarks 2015 2013 2012 2010 2008 2007 Updating with new Benchmarks
  • 8. Dimensions of Technical Benchmarks 9
  • 9. Summary Category Year Name Type Domain Data Type Micro- benchmarks 2010 HiBench Micro-benchmark Suite Micro-benchmarks, Machine Learning, SQL, Websearch, Graph, Streaming Benchmarks Structured, Text, Web Graph 2015 SparkBench Micro-benchmark Suite Machine Learning, Graph Computation, SQL, Streaming Application Structured, Text, Web Graph 2010 YCSB Micro-benchmark cloud OLTP operations Structured 2017 TPCx-IoT Micro-benchmark workloads on typical IoT Gateway systems Structured, IoT Application Benchmarks 2015 Yahoo Streaming Benchmark Application Streaming Benchmark advertisement analytics pipeline Structured, Time Series 2013 BigBench/TPCx-BB Application End-to-end Benchmark a fictional product retailer platform Structured, Text, JSON logs 2017 BigBench V2 Application End-to-end Benchmark a fictional product retailer platform Structured, Text, JSON logs 2018 ABench (Work-in- Progress) Big Data Architecture Stack Benchmark set of different workloads Structured, Text, JSON logs 10
  • 10. Some of the benchmarks to integrate (I) Year Name Type 2010 HiBench Big data benchmark suite for evaluating different big data frameworks. 19 workloads including synthetic micro-benchmarks and real-world applications from 6 categories which are micro, machine learning, sql, graph, websearch and streaming. 2015 SparkBench System for benchmarking and simulating Spark jobs. Multiple workloads organized in 4 categories. 2010 Yahoo! Cloud System Benchmark (YSCB) Evaluates performance of different “key-value” and “cloud” serving systems, which do not support the ACID properties. The YCSB++ , an extension, includes many additions such as multi-tester coordination for increased load and eventual consistency measurement. 2017 TPCx-IoT Based on YCSB, but with significant changes. Workloads of data ingestion and concurrent queries simulating workloads on typical IoT Gateway systems. Dataset with data from sensors from electric power station(s) 11 Micro-benchmarks:
  • 11. Some of the benchmarks to integrate (II) Year Name Type 2015 Yahoo Streaming Benchmark (YSB) The Yahoo Streaming Benchmark is a streaming application benchmark simulating an advertisement analytics pipeline. 2013 BigBench/TPCx-BB BigBench is an end-to-end, technology agnostic, application-level benchmark that tests the analytical capabilities of a Big Data platform. It is based on a fictional product retailer business model. 2017 BigBench V2 Similar to BigBench, BigBench V2 is an end-to-end, technology agnostic, application-level benchmark that tests the analytical capabilities of a Big Data platform 2018 ABench (Work-in- Progress) New type of multi-purpose Big Data benchmark covering many big data scenarios and implementations. Extends other benchmarks such as BigBench 12 Application-oriented benchmarks:
  • 12. ▪ The BigBench specification comprises two key components: ▪ a data model specification ▪ a workload/query specification. ▪ The structured part of the BigBench data model is adopted from the TPC-DS data model ▪ The data model specification is implemented by a data generator, which is based on an extension of PDGF. ▪ BigBench 1.0 workload specification consists of 30 queries/workloads (10 structured from TPC-DS, and 20 adapted from a McKinsey report on Big Data use cases and opportunities). ▪ BigBench 2.0 … The BigBench data model The BigBench 2.0 overview Rabi T., et al. The Vision of BigBench 2.0, 2016. Proceedings of the Fourth Workshop on Data analytics in the Cloud. Article No. 3, http://blog.cloudera.com/blog/2014/11/bigbench-toward-an-industry-standard-benchmark-for-big-data-analytics/
  • 13.
  • 14. ▪ Benchmark any step of the Linked Data lifecycle ▪ Ensure that benchmarking results can be found, accessed, integrated and reused easily (FAIR principles) ▪ Benchmark Big Data platforms by being the first distributed benchmarking platform for Linked data. ▪ The Hobbit platform comprises several components: ▪ Single components are implemented as independent containers. ▪ Communication between these components is done via a message bus. ▪ Everything is dockerized, from the benchmarked system to all the components Principles: • Users can test systems with the HOBBIT benchmarks without having to worry about finding standardized hardware • New benchmarks can be easily created and added to the platform by third parties. • The evaluation can be scaled out to large datasets and on distributed architectures. • The publishing and analysis of the results of different systems can be carried out in a uniform manner across the different benchmarks.
  • 15. Summary • DataBench: • A framework for big data benchmarking for PPP projects and big data practitioners • We will provide methodology and tools • Added value: • An umbrella to access to multiple benchmarks • Homogenized technical metrics • Derived business KPIs, • A community around • PPP projects, industrial partners (BDVA and beyond) and benchmarking initiatives are welcomed to work with us, either to use our framework or to add new benchmarks
  • 16. Big Data Benchmark session at EBDVF'2018 10/10/2018 DataBench Project - GA Nr 780966 17 Monday November 12th, 1700 – 1830,EBDVF'2018, Vienna