SlideShare a Scribd company logo
1 of 21
Download to read offline
Dusan Jakovetic
University of Novi Sad, Faculty of Sciences, Serbia
Virtual BenchLearning Webinar
July 8, 2020
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 780787
Industrial-Driven Big Data as
a Self-Service Solution
Brief introduction to I-BiDaaS
I-BiDaaS pipeline, architecture & technologies
I-BiDaaS & BDVA reference model
Benchmarking landscape and opportunities @ I-BiDaaS
Outline
2
Identity card
http://www.ibidaas.eu/ @Ibidaas https://www.linkedin.com/in/i-bidaas/
3
Consortium
1. FOUNDATION FOR RESEARCH AND TECHNOLOGY HELLAS (FORTH)
2. BARCELONA SUPERCOMPUTING CENTER - CENTRO NACIONAL DE
SUPERCOMPUTACION (BSC)
3. IBM ISRAEL - SCIENCE AND TECHNOLOGY LTD (IBM)
4. CENTRO RICERCHE FIAT SCPA (CRF)
5. SOFTWARE AG (SAG)
6. CAIXABANK, S.A (CAIXA)
7. THE UNIVERSITY OF MANCHESTER (UNIMAN)
8. ECOLE NATIONALE DES PONTS ET CHAUSSEES (ENPC)
9. ATOS SPAIN SA (ATOS)
10. AEGIS IT RESEARCH LTD (AEGIS)
11. INFORMATION TECHNOLOGY FOR MARKET LEADERSHIP (ITML)
12. UNIVERSITY OF NOVI SAD FACULTY OF SCIENCES SERBIA (UNSPMF)
13. TELEFONICA INVESTIGACION Y DESARROLLO SA (TID)
4
A complete and safe environment for
methodological big data experimentation
Tool and services to increase the quality of
data analytics
A Big Data as a Self-Service solution
that helps in breaking silos and boosts
EU's data-driven economy
Tools and services for fast ingestion and
consolidation of both realistic and fabricated
data
Tools and services for the management of
heterogeneous infrastructures
Increases impact in research community and
contributes to industrial innovation capacity
5
Key messages
• Expert mode
Analyze your DataUsers
• Import your data
• Self-service mode
Data
• Fabricate Data
• Stream & Batch Analytics
• Expert: Upload your code
• Self-service: Select an
algorithm from the pool
Results
• Visualize the results
• Share models
Do it yourself
In a flexible
manner
Break data silos Safe environment Interact with Big Data
technologies
Increase speed of data
analysis
Cope with the rate of data
asset growth
Intra- and inter-
domain data-flow
Benefits of using I-BiDaaS
• Co-develop mode
I-BiDaaS pipeline
• Co-develop: custom end-to-
end application
• Tokenize data
6
• Expert mode
Analyze your DataUsers
• Import your data
• Self-service mode
Data
• Fabricate Data
• Stream & Batch Analytics
• Expert: Upload your code
• Self-service: Select an
algorithm from the pool
Results
• Visualize the results
• Share models
Do it yourself
In a flexible
manner
Break data silos Safe environment Interact with Big Data
technologies
Increase speed of data
analysis
Cope with the rate of data
asset growth
Intra- and inter-
domain data-flow
Benefits of using I-BiDaaS
• Co-develop mode
• Co-develop: custom end-to-
end application
• Tokenize data
7
Flexible solution
I-BiDaaS pipeline
• Expert mode
Analyze your DataUsers
• Import your data
• Self-service mode
Data
• Fabricate Data
• Stream & Batch Analytics
• Expert: Upload your code
• Self-service: Select an
algorithm from the pool
Results
• Visualize the results
• Share models
Do it yourself
In a flexible
manner
Break data silos Safe environment Interact with Big Data
technologies
Increase speed of data
analysis
Cope with the rate of data
asset growth
Intra- and inter-
domain data-flow
Benefits of using I-BiDaaS
• Co-develop mode
• Co-develop: custom end-to-
end application
• Tokenize data
Data sharing
& breaking silos
8
I-BiDaaS pipeline
• Expert mode
Analyze your DataUsers
• Import your data
• Self-service mode
Data
• Fabricate Data
• Stream & Batch Analytics
• Expert: Upload your code
• Self-service: Select an
algorithm from the pool
Results
• Visualize the results
• Share models
Do it yourself
In a flexible
manner
Break data silos Safe environment Interact with Big Data
technologies
Increase speed of data
analysis
Cope with the rate of data
asset growth
Intra- and inter-
domain data-flow
Benefits of using I-BiDaaS
• Co-develop mode
• Co-develop: custom end-to-
end application
• Tokenize data
9
I-BiDaaS pipeline
• Expert mode
Analyze your DataUsers
• Import your data
• Self-service mode
Data
• Fabricate Data
• Stream & Batch Analytics
• Expert: Upload your code
• Self-service: Select an
algorithm from the pool
Results
• Visualize the results
• Share models
Do it yourself
In a flexible
manner
Break data silos Safe environment Interact with Big Data
technologies
Increase speed of data
analysis
Cope with the rate of data
asset growth
Intra- and inter-
domain data-flow
Benefits of using I-BiDaaS
• Co-develop mode
• Co-develop: custom end-to-
end application
• Tokenize data
10
I-BiDaaS pipeline
The I-BiDaaS solution:
Architecture & technologies
Medium to long term business decisions
Data
Fabrication
Platform
(IBM)
Refined
specifications
for data
fabrication
GPU-accelerated Analytics
(FORTH)
Apama Complex Event
Processing (SAG)
Streaming Analytics
Batch Processing
Advanced ML (UNSPMF)
COMPsProgramming
Model(BSC)
Query Partitioning
Infrastructurelayer: Private cloud; Commodity cluster; GPUs
Pre-defined
Queries
SQL-like
interface
Domain
Language
Programming
API
User Interface
Resource managementand orchestration (ATOS)
Advanced
Visualis.
Advanced IT services for
Big Data processing tasks;
Open source pool of ML
algorithms
Data ingestion
Programming
Interface /
Sequential
Programming
(AEGIS+SAG)
(AEGIS)
COMPsRuntime
(BSC)
Distributed
large scale
layer
Application layer
UniversalMessaging(SAG)
TestData
Fabrication(IBM)
Meta-
data;
Data
descri-
ption
Hecuba tools
(BSC)
Short term decisions
real time alerts
Model structure improvements
Learnedpatterns correlations
11
WP2:
Data, user interface, visualization
Technologies:
• IBM TDF
• SAG UM
• AEGIS AVT
Medium to long term business decisions
Data
Fabrication
Platform
(IBM)
Refined
specifications
for data
fabrication
GPU-accelerated Analytics
(FORTH)
Apama Complex Event
Processing (SAG)
Streaming Analytics
Batch Processing
Advanced ML (UNSPMF)
COMPs Programming
Model (BSC)
Query Partitioning
Infrastructure layer: Private cloud; Commodity cluster; GPUs
Pre-defined
Queries
SQL-like
interface
Domain
Language
Programming
API
User Interface
Resource management and orchestration (ATOS)
Advanced
Visualis.
Advanced IT services for
Big Data processing tasks;
Open source pool of ML
algorithms
Programming
Interface /
Sequential
Programming
(AEGIS+SAG)
(AEGIS)
COMPs Runtime
(BSC)
Distributed
large scale
layer
Application layer
UniversalMessaging(SAG)
DataFabrication
Platform(IBM)
Meta-
data;
Data
descri-
ption
Hecuba tools
(BSC)
Short term decisions
real time alerts
Model structure improvements
Learned patterns correlations
12
http://ibidaas.eu/tools
13
Medium to long term business decisions
Data
Fabrication
Platform
(IBM)
Refined
specifications
for data
fabrication
GPU-accelerated Analytics
(FORTH)
Apama Complex Event
Processing (SAG)
Streaming Analytics
Batch Processing
Advanced ML (UNSPMF)
COMPs Programming
Model (BSC)
Query Partitioning
Infrastructure layer: Private cloud; Commodity cluster; GPUs
Pre-defined
Queries
SQL-like
interface
Domain
Language
Programming
API
User Interface
Resource management and orchestration (ATOS)
Advanced
Visualis.
Advanced IT services for
Big Data processing tasks;
Open source pool of ML
algorithms
Programming
Interface /
Sequential
Programming
(AEGIS+SAG)
(AEGIS)
COMPs Runtime
(BSC)
Distributed
large scale
layer
Application layer
UniversalMessaging(SAG)
DataFabrication
Platform(IBM)
Meta-
data;
Data
descri-
ption
Hecuba tools
(BSC)
Short term decisions
real time alerts
Model structure improvements
Learned patterns correlations
WP3:
Batch analytics
Technologies:
• BSC COMPSs
• BSC Hecuba
• BSC Qbeast
• Advanced ML (UNSPMF)
13
http://ibidaas.eu/tools
14
Medium to long term business decisions
Data
Fabrication
Platform
(IBM)
Refined
specifications
for data
fabrication
GPU-accelerated Analytics
(FORTH)
Apama Complex Event
Processing (SAG)
Streaming Analytics
Batch Processing
Advanced ML (UNSPMF)
COMPs Programming
Model (BSC)
Query Partitioning
Infrastructure layer: Private cloud; Commodity cluster; GPUs
Pre-defined
Queries
SQL-like
interface
Domain
Language
Programming
API
User Interface
Resource management and orchestration (ATOS)
Advanced
Visualis.
Advanced IT services for
Big Data processing tasks;
Open source pool of ML
algorithms
Programming
Interface /
Sequential
Programming
(AEGIS+SAG)
(AEGIS)
COMPs Runtime
(BSC)
Distributed
large scale
layer
Application layer
UniversalMessaging(SAG)
DataFabrication
Platform(IBM)
Meta-
data;
Data
descri-
ption
Hecuba tools
(BSC)
Short term decisions
real time alerts
Model structure improvements
Learned patterns correlations
WP4:
Streaming analytics
Technologies:
• SAG Apama CEP
• FORTH GPU-accel. analytics
14
http://ibidaas.eu/tools
15
Medium to long term business decisions
Data
Fabrication
Platform
(IBM)
Refined
specifications
for data
fabrication
GPU-accelerated Analytics
(FORTH)
Apama Complex Event
Processing (SAG)
Streaming Analytics
Batch Processing
Advanced ML (UNSPMF)
COMPs Programming
Model (BSC)
Query Partitioning
Infrastructure layer: Private cloud; Commodity cluster; GPUs
Pre-defined
Queries
SQL-like
interface
Domain
Language
Programming
API
User Interface
Resource management and orchestration (ATOS)
Advanced
Visualis.
Advanced IT services for
Big Data processing tasks;
Open source pool of ML
algorithms
Programming
Interface /
Sequential
Programming
(AEGIS+SAG)
(AEGIS)
COMPs Runtime
(BSC)
Distributed
large scale
layer
Application layer
UniversalMessaging(SAG)
DataFabrication
Platform(IBM)
Meta-
data;
Data
descri-
ption
Hecuba tools
(BSC)
Short term decisions
real time alerts
Model structure improvements
Learned patterns correlations
WP5:
Resource mgmt & integration
Technologies:
• ATOS Resource mgmt
• ITML integration services
15
http://ibidaas.eu/tools
16
BDVA Reference model
BDV SRIA: European Big Data Value Strategic Research and Innovation Agenda
17
BDVA reference model horizontal concerns
& I-BiDaaS
BDV reference model horizontal concern I-BiDaaS module or platform as a whole
Data visualization and user interaction
Advanced visualization module (AEGIS+SAG);
User interface (AEGIS)
Data analytics
Batch processing module (UNSPMF+BSC);
Streaming analytics module (SAG+FORTH)
Data processing architectures expected
advances according to BDVA SRIA
I-BiDaaS platform
Data protection
FORTH commodity cluster privacy preservation through
commodity hardware (Intel SGX); TDF (IBM) for generation of
realistic synthetic data when real data cannot be uploaded to
cloud or similar systems
Data management
COMPSs runtime (BSC); ATOS resource management and
orchestration module
The Cloud and HPC
(efficient usage of Cloud) ATOS resource management and
orchestration module
Brief introduction to I-BiDaaS
I-BiDaaS pipeline, architecture & technologies
I-BiDaaS & BDVA reference model
Benchmarking landscape and opportunities @ I-BiDaaS
Outline
18
19
Benchmarking: Technology level
I-BiDaaS partner Technology name Big Data pipeline element Current benchmarks
FORTH GPU accelerator technology Data pre-processing, Streaming
Analytics
Custom benchmark (throughput, latency)
BSC COMPSs Sequential programming model for
distributed architectures
Applications (Own use cases)
BSC Hecuba Data management framework with
easy interface
Applications (Own use cases)
BSC Qbeast Multidimensional indexing and
storage
TCP-H
IBM Test Data Fabrication Synthetic test data fabrication Several open source + commercial products (e.g., Grid
tools of CA) / No known benchmarks yet
SAG Apama Streaming Analytics Platform Streaming Analytics Custom benchmark (throughput)
SAG Universal Messaging Message Broker Custom benchmark (throughput)
SAG WebMethods Integration Platform Integration N/A
SAG MashZone Visualization N/A
AEGIS Advanced visualization and monitoring Visualization and interface N/A
UNSPMF Pool of ML algorithms in
COMPSs/Python
Batch analytics Respective MPI implementation; Sklearn
ATOS Resource management and orchestration
module
Resource management N/A
Business Objectives Data Sets Data Size Processing Type Type of Analysis
Telecoms
⁻ improve and optimize
current operations
⁻ Anonymized mobility data
(structured)
⁻ Anonymized call center data
(unstructured)
TB ⁻ batch & streaming ⁻ predictive
⁻ descriptive /
diagnostic
Finance
⁻ improve decision
making
⁻ improve efficiency of Big
Data solutions
⁻ Tokenized online banking
control data (structured)
⁻ Tokenized bank transfer data
(structured)
⁻ Tokenized IP address data
(structured)
PB ⁻ batch
⁻ batch & streaming
⁻ descriptive /
diagnostic
Manufacturing
⁻ improve and optimise
current operations
⁻ improve the quality of
the process and product
⁻ Anonymized SCADA/MES data
(structured)
⁻ Anonymized Aluminum Die-
casting (structured)
GB ⁻ batch
⁻ batch & streaming
⁻ predictive
⁻ diagnostic
Benchmarking: Business, data & analytics level
20
I-BiDaaS
Partner
Use Case Most relevant business KPIs
TID Accurate location prediction with high traffic and visibility - Acquisition of insights on the dynamics of
cellular sectors
- Processing costs (cost reduction)
- Customer satisfaction
TID Optimization of placement of telecommunication equipment
TID Quality of service in Call Centers
CAIXA Enhanced control on online banking - Cost reduction
- Data accessibility
- Time efficiency
- End-to-end execution time (from data request
to data provision)
CAIXA Advanced analysis of bank transfer payment in financial terminal
CAIXA Analysis of relationships through IP addresses
CRF Production process of aluminium die-casting - 3 Product quality levels (High. Medium, Low)
- Overall Equipment Effectiveness (OEE),
- Maintenance cost
- Cost reduction
CRF Maintenance and monitoring of production assets
Benchmarking: Business level
21

More Related Content

What's hot

Imaging Data Commons (IDC) - Introduction and intital approach
Imaging Data Commons (IDC) - Introduction and intital approachImaging Data Commons (IDC) - Introduction and intital approach
Imaging Data Commons (IDC) - Introduction and intital approachimgcommcall
 
NCI Cancer Research Data Commons - Overview
NCI Cancer Research Data Commons - OverviewNCI Cancer Research Data Commons - Overview
NCI Cancer Research Data Commons - Overviewimgcommcall
 
Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...
Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...
Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...DataBench
 
Shared Digital Twins: Collaboration in Ecosystems
Shared Digital Twins: Collaboration in EcosystemsShared Digital Twins: Collaboration in Ecosystems
Shared Digital Twins: Collaboration in EcosystemsBoris Otto
 
Who changed my data? Need for data governance and provenance in a streaming w...
Who changed my data? Need for data governance and provenance in a streaming w...Who changed my data? Need for data governance and provenance in a streaming w...
Who changed my data? Need for data governance and provenance in a streaming w...DataWorks Summit
 
Big Data for Product Managers
Big Data for Product ManagersBig Data for Product Managers
Big Data for Product ManagersPentaho
 
Research Data Shared Service
Research Data Shared ServiceResearch Data Shared Service
Research Data Shared ServiceJisc
 
A Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data Flow
A Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data FlowA Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data Flow
A Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data Flowjagada7
 
San Antonio’s electric utility making big data analytics the business of the ...
San Antonio’s electric utility making big data analytics the business of the ...San Antonio’s electric utility making big data analytics the business of the ...
San Antonio’s electric utility making big data analytics the business of the ...DataWorks Summit
 
D3.4.2 data fusion tools
D3.4.2 data fusion toolsD3.4.2 data fusion tools
D3.4.2 data fusion toolsFOODIE_Project
 
D3.4.1 Data fusion tools
D3.4.1 Data fusion toolsD3.4.1 Data fusion tools
D3.4.1 Data fusion toolsFOODIE_Project
 
The case of vehicle networking financial services accomplished by China Mobile
The case of vehicle networking financial services accomplished by China MobileThe case of vehicle networking financial services accomplished by China Mobile
The case of vehicle networking financial services accomplished by China MobileDataWorks Summit
 
Data-as-a-Service: DataGraft
Data-as-a-Service: DataGraftData-as-a-Service: DataGraft
Data-as-a-Service: DataGraftdapaasproject
 
MLUC 2011 XQuery Enigma
MLUC 2011 XQuery EnigmaMLUC 2011 XQuery Enigma
MLUC 2011 XQuery EnigmaPeter O'Kelly
 
20141030 LinDA Workshop echallenges2014 - LinDA project overview
20141030 LinDA Workshop echallenges2014 - LinDA project overview20141030 LinDA Workshop echallenges2014 - LinDA project overview
20141030 LinDA Workshop echallenges2014 - LinDA project overviewLinDa_FP7
 
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...Mihai Criveti
 
Pentaho Analytics for MongoDB - presentation from MongoDB World 2014
Pentaho Analytics for MongoDB - presentation from MongoDB World 2014Pentaho Analytics for MongoDB - presentation from MongoDB World 2014
Pentaho Analytics for MongoDB - presentation from MongoDB World 2014Pentaho
 

What's hot (20)

Imaging Data Commons (IDC) - Introduction and intital approach
Imaging Data Commons (IDC) - Introduction and intital approachImaging Data Commons (IDC) - Introduction and intital approach
Imaging Data Commons (IDC) - Introduction and intital approach
 
NCI Cancer Research Data Commons - Overview
NCI Cancer Research Data Commons - OverviewNCI Cancer Research Data Commons - Overview
NCI Cancer Research Data Commons - Overview
 
Pentaho Suite Analysis
Pentaho Suite Analysis Pentaho Suite Analysis
Pentaho Suite Analysis
 
Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...
Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...
Benchmarking for Big Data Applications with the DataBench Framework, Arne Ber...
 
Shared Digital Twins: Collaboration in Ecosystems
Shared Digital Twins: Collaboration in EcosystemsShared Digital Twins: Collaboration in Ecosystems
Shared Digital Twins: Collaboration in Ecosystems
 
Who changed my data? Need for data governance and provenance in a streaming w...
Who changed my data? Need for data governance and provenance in a streaming w...Who changed my data? Need for data governance and provenance in a streaming w...
Who changed my data? Need for data governance and provenance in a streaming w...
 
Big Data for Product Managers
Big Data for Product ManagersBig Data for Product Managers
Big Data for Product Managers
 
Research Data Shared Service
Research Data Shared ServiceResearch Data Shared Service
Research Data Shared Service
 
A Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data Flow
A Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data FlowA Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data Flow
A Hybrid Cloud MultiCloud Approach to Streamline Supply Chain Data Flow
 
San Antonio’s electric utility making big data analytics the business of the ...
San Antonio’s electric utility making big data analytics the business of the ...San Antonio’s electric utility making big data analytics the business of the ...
San Antonio’s electric utility making big data analytics the business of the ...
 
D3.4.2 data fusion tools
D3.4.2 data fusion toolsD3.4.2 data fusion tools
D3.4.2 data fusion tools
 
D3.4.1 Data fusion tools
D3.4.1 Data fusion toolsD3.4.1 Data fusion tools
D3.4.1 Data fusion tools
 
The case of vehicle networking financial services accomplished by China Mobile
The case of vehicle networking financial services accomplished by China MobileThe case of vehicle networking financial services accomplished by China Mobile
The case of vehicle networking financial services accomplished by China Mobile
 
Data-as-a-Service: DataGraft
Data-as-a-Service: DataGraftData-as-a-Service: DataGraft
Data-as-a-Service: DataGraft
 
MLUC 2011 XQuery Enigma
MLUC 2011 XQuery EnigmaMLUC 2011 XQuery Enigma
MLUC 2011 XQuery Enigma
 
20141030 LinDA Workshop echallenges2014 - LinDA project overview
20141030 LinDA Workshop echallenges2014 - LinDA project overview20141030 LinDA Workshop echallenges2014 - LinDA project overview
20141030 LinDA Workshop echallenges2014 - LinDA project overview
 
HNSciCloud Overview
HNSciCloud Overview HNSciCloud Overview
HNSciCloud Overview
 
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
 
Ss eb29
Ss eb29Ss eb29
Ss eb29
 
Pentaho Analytics for MongoDB - presentation from MongoDB World 2014
Pentaho Analytics for MongoDB - presentation from MongoDB World 2014Pentaho Analytics for MongoDB - presentation from MongoDB World 2014
Pentaho Analytics for MongoDB - presentation from MongoDB World 2014
 

Similar to Virtual BenchLearning - I-BiDaaS - Industrial-Driven Big Data as a Self-Service Solution

Preventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive IndustryPreventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive IndustryDataWorks Summit/Hadoop Summit
 
DEVNET-1166 Open SDN Controller APIs
DEVNET-1166	Open SDN Controller APIsDEVNET-1166	Open SDN Controller APIs
DEVNET-1166 Open SDN Controller APIsCisco DevNet
 
Keith Prabhu - Big Data Cloud Computing
Keith Prabhu - Big Data Cloud ComputingKeith Prabhu - Big Data Cloud Computing
Keith Prabhu - Big Data Cloud Computingadministrator_confidis
 
Azure Overview Csco
Azure Overview CscoAzure Overview Csco
Azure Overview Cscorajramab
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshIanFurlong4
 
How to scale your PaaS with OVH infrastructure?
How to scale your PaaS with OVH infrastructure?How to scale your PaaS with OVH infrastructure?
How to scale your PaaS with OVH infrastructure?OVHcloud
 
Real Time Streaming Architecture at Ford
Real Time Streaming Architecture at FordReal Time Streaming Architecture at Ford
Real Time Streaming Architecture at FordDataWorks Summit
 
Data & Analytics - Session 1 - Big Data Analytics
Data & Analytics - Session 1 -  Big Data AnalyticsData & Analytics - Session 1 -  Big Data Analytics
Data & Analytics - Session 1 - Big Data AnalyticsAmazon Web Services
 
Big Data: It’s all about the Use Cases
Big Data: It’s all about the Use CasesBig Data: It’s all about the Use Cases
Big Data: It’s all about the Use CasesJames Serra
 
A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)Denodo
 
Architecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsArchitecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsYahoo Developer Network
 
Time to Talk about Data Mesh
Time to Talk about Data MeshTime to Talk about Data Mesh
Time to Talk about Data MeshLibbySchulze
 
Digital Reinvention by NRB
Digital Reinvention by NRBDigital Reinvention by NRB
Digital Reinvention by NRBWilliam Poos
 
Schnellere Digitalisierung mit einer cloudbasierten Datenstrategie
Schnellere Digitalisierung mit einer cloudbasierten DatenstrategieSchnellere Digitalisierung mit einer cloudbasierten Datenstrategie
Schnellere Digitalisierung mit einer cloudbasierten DatenstrategieMongoDB
 
Big Data: InterConnect 2016 Session on Getting Started with Big Data Analytics
Big Data:  InterConnect 2016 Session on Getting Started with Big Data AnalyticsBig Data:  InterConnect 2016 Session on Getting Started with Big Data Analytics
Big Data: InterConnect 2016 Session on Getting Started with Big Data AnalyticsCynthia Saracco
 
AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...
AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...
AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...Stavros Papadopoulos
 
InfoSphere BigInsights - Analytics power for Hadoop - field experience
InfoSphere BigInsights - Analytics power for Hadoop - field experienceInfoSphere BigInsights - Analytics power for Hadoop - field experience
InfoSphere BigInsights - Analytics power for Hadoop - field experienceWilfried Hoge
 
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...Denodo
 

Similar to Virtual BenchLearning - I-BiDaaS - Industrial-Driven Big Data as a Self-Service Solution (20)

Preventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive IndustryPreventative Maintenance of Robots in Automotive Industry
Preventative Maintenance of Robots in Automotive Industry
 
DEVNET-1166 Open SDN Controller APIs
DEVNET-1166	Open SDN Controller APIsDEVNET-1166	Open SDN Controller APIs
DEVNET-1166 Open SDN Controller APIs
 
Keith Prabhu - Big Data Cloud Computing
Keith Prabhu - Big Data Cloud ComputingKeith Prabhu - Big Data Cloud Computing
Keith Prabhu - Big Data Cloud Computing
 
Azure Overview Csco
Azure Overview CscoAzure Overview Csco
Azure Overview Csco
 
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMeshThe Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
The Enterprise Guide to Building a Data Mesh - Introducing SpecMesh
 
How to scale your PaaS with OVH infrastructure?
How to scale your PaaS with OVH infrastructure?How to scale your PaaS with OVH infrastructure?
How to scale your PaaS with OVH infrastructure?
 
Real Time Streaming Architecture at Ford
Real Time Streaming Architecture at FordReal Time Streaming Architecture at Ford
Real Time Streaming Architecture at Ford
 
Data & Analytics - Session 1 - Big Data Analytics
Data & Analytics - Session 1 -  Big Data AnalyticsData & Analytics - Session 1 -  Big Data Analytics
Data & Analytics - Session 1 - Big Data Analytics
 
Big Data: It’s all about the Use Cases
Big Data: It’s all about the Use CasesBig Data: It’s all about the Use Cases
Big Data: It’s all about the Use Cases
 
A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)
 
Cloud Customer Architecture for Big Data and Analytics
Cloud Customer Architecture for Big Data and AnalyticsCloud Customer Architecture for Big Data and Analytics
Cloud Customer Architecture for Big Data and Analytics
 
Architecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI ApplicationsArchitecting Petabyte Scale AI Applications
Architecting Petabyte Scale AI Applications
 
Time to Talk about Data Mesh
Time to Talk about Data MeshTime to Talk about Data Mesh
Time to Talk about Data Mesh
 
Analytics&IoT
Analytics&IoTAnalytics&IoT
Analytics&IoT
 
Digital Reinvention by NRB
Digital Reinvention by NRBDigital Reinvention by NRB
Digital Reinvention by NRB
 
Schnellere Digitalisierung mit einer cloudbasierten Datenstrategie
Schnellere Digitalisierung mit einer cloudbasierten DatenstrategieSchnellere Digitalisierung mit einer cloudbasierten Datenstrategie
Schnellere Digitalisierung mit einer cloudbasierten Datenstrategie
 
Big Data: InterConnect 2016 Session on Getting Started with Big Data Analytics
Big Data:  InterConnect 2016 Session on Getting Started with Big Data AnalyticsBig Data:  InterConnect 2016 Session on Getting Started with Big Data Analytics
Big Data: InterConnect 2016 Session on Getting Started with Big Data Analytics
 
AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...
AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...
AIS data management and time series analytics on TileDB Cloud (Webinar, Feb 3...
 
InfoSphere BigInsights - Analytics power for Hadoop - field experience
InfoSphere BigInsights - Analytics power for Hadoop - field experienceInfoSphere BigInsights - Analytics power for Hadoop - field experience
InfoSphere BigInsights - Analytics power for Hadoop - field experience
 
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
Building a Single Logical Data Lake: For Advanced Analytics, Data Science, an...
 

More from Big Data Value Association

Data Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharingData Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharingBig Data Value Association
 
Key Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplaceKey Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplaceBig Data Value Association
 
GDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharingGDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharingBig Data Value Association
 
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...Big Data Value Association
 
Three pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and PrivacyThree pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and PrivacyBig Data Value Association
 
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...Big Data Value Association
 
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...Big Data Value Association
 
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna Big Data Value Association
 
BDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionalsBDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionalsBig Data Value Association
 
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...Big Data Value Association
 
BDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshopBDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshopBig Data Value Association
 
BDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshopBDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshopBig Data Value Association
 
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...Big Data Value Association
 
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector WebinarBigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector WebinarBig Data Value Association
 
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector WebinarBigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector WebinarBig Data Value Association
 
Policy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical OverviewPolicy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical OverviewBig Data Value Association
 
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...Big Data Value Association
 
Policy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against RadicalisationPolicy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against RadicalisationBig Data Value Association
 
BDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborationsBDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborationsBig Data Value Association
 

More from Big Data Value Association (20)

Data Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharingData Privacy, Security in personal data sharing
Data Privacy, Security in personal data sharing
 
Key Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplaceKey Modules for a trsuted and privacy preserving personal data marketplace
Key Modules for a trsuted and privacy preserving personal data marketplace
 
GDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharingGDPR and Data Ethics considerations in personal data sharing
GDPR and Data Ethics considerations in personal data sharing
 
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
Intro - Three pillars for building a Smart Data Ecosystem: Trust, Security an...
 
Three pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and PrivacyThree pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
Three pillars for building a Smart Data Ecosystem: Trust, Security and Privacy
 
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
Market into context - Three pillars for building a Smart Data Ecosystem: Trus...
 
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
BDV Skills Accreditation - Future of digital skills in Europe reskilling and ...
 
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
BDV Skills Accreditation - Big Data skilling in Emilia-Romagna
 
BDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionalsBDV Skills Accreditation - EIT labels for professionals
BDV Skills Accreditation - EIT labels for professionals
 
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
BDV Skills Accreditation - Recognizing Data Science Skills with BDV Data Scie...
 
BDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshopBDV Skills Accreditation - Objectives of the workshop
BDV Skills Accreditation - Objectives of the workshop
 
BDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshopBDV Skills Accreditation - Welcome introduction to the workshop
BDV Skills Accreditation - Welcome introduction to the workshop
 
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
BDV Skills Accreditation - Definition and ensuring of digital roles and compe...
 
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector WebinarBigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
BigDataPilotDemoDays - I BiDaaS Application to the Manufacturing Sector Webinar
 
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector WebinarBigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
BigDataPilotDemoDays - I-BiDaaS Application to the Financial Sector Webinar
 
Policy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical OverviewPolicy Cloud Data Driven Policies against Radicalisation - Technical Overview
Policy Cloud Data Driven Policies against Radicalisation - Technical Overview
 
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
Policy Cloud Data Driven Policies against Radicalisation - Participatory poli...
 
Policy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against RadicalisationPolicy Cloud Data Driven Policies against Radicalisation
Policy Cloud Data Driven Policies against Radicalisation
 
BDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborationsBDVA i Spaces - What they are, how to become one, value and collaborations
BDVA i Spaces - What they are, how to become one, value and collaborations
 
BDVA i Spaces - ITA Aragón
BDVA i Spaces - ITA AragónBDVA i Spaces - ITA Aragón
BDVA i Spaces - ITA Aragón
 

Recently uploaded

ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxDwiAyuSitiHartinah
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityAggregage
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionajayrajaganeshkayala
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introductionsanjaymuralee1
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?sonikadigital1
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)Data & Analytics Magazin
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 

Recently uploaded (17)

ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptxTINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
TINJUAN PEMROSESAN TRANSAKSI DAN ERP.pptx
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for ClarityStrategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
Strategic CX: A Deep Dive into Voice of the Customer Insights for Clarity
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
CI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual interventionCI, CD -Tools to integrate without manual intervention
CI, CD -Tools to integrate without manual intervention
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
Virtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product IntroductionVirtuosoft SmartSync Product Introduction
Virtuosoft SmartSync Product Introduction
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 
How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?How is Real-Time Analytics Different from Traditional OLAP?
How is Real-Time Analytics Different from Traditional OLAP?
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)AI for Sustainable Development Goals (SDGs)
AI for Sustainable Development Goals (SDGs)
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 

Virtual BenchLearning - I-BiDaaS - Industrial-Driven Big Data as a Self-Service Solution

  • 1. Dusan Jakovetic University of Novi Sad, Faculty of Sciences, Serbia Virtual BenchLearning Webinar July 8, 2020 This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 780787 Industrial-Driven Big Data as a Self-Service Solution
  • 2. Brief introduction to I-BiDaaS I-BiDaaS pipeline, architecture & technologies I-BiDaaS & BDVA reference model Benchmarking landscape and opportunities @ I-BiDaaS Outline 2
  • 3. Identity card http://www.ibidaas.eu/ @Ibidaas https://www.linkedin.com/in/i-bidaas/ 3
  • 4. Consortium 1. FOUNDATION FOR RESEARCH AND TECHNOLOGY HELLAS (FORTH) 2. BARCELONA SUPERCOMPUTING CENTER - CENTRO NACIONAL DE SUPERCOMPUTACION (BSC) 3. IBM ISRAEL - SCIENCE AND TECHNOLOGY LTD (IBM) 4. CENTRO RICERCHE FIAT SCPA (CRF) 5. SOFTWARE AG (SAG) 6. CAIXABANK, S.A (CAIXA) 7. THE UNIVERSITY OF MANCHESTER (UNIMAN) 8. ECOLE NATIONALE DES PONTS ET CHAUSSEES (ENPC) 9. ATOS SPAIN SA (ATOS) 10. AEGIS IT RESEARCH LTD (AEGIS) 11. INFORMATION TECHNOLOGY FOR MARKET LEADERSHIP (ITML) 12. UNIVERSITY OF NOVI SAD FACULTY OF SCIENCES SERBIA (UNSPMF) 13. TELEFONICA INVESTIGACION Y DESARROLLO SA (TID) 4
  • 5. A complete and safe environment for methodological big data experimentation Tool and services to increase the quality of data analytics A Big Data as a Self-Service solution that helps in breaking silos and boosts EU's data-driven economy Tools and services for fast ingestion and consolidation of both realistic and fabricated data Tools and services for the management of heterogeneous infrastructures Increases impact in research community and contributes to industrial innovation capacity 5 Key messages
  • 6. • Expert mode Analyze your DataUsers • Import your data • Self-service mode Data • Fabricate Data • Stream & Batch Analytics • Expert: Upload your code • Self-service: Select an algorithm from the pool Results • Visualize the results • Share models Do it yourself In a flexible manner Break data silos Safe environment Interact with Big Data technologies Increase speed of data analysis Cope with the rate of data asset growth Intra- and inter- domain data-flow Benefits of using I-BiDaaS • Co-develop mode I-BiDaaS pipeline • Co-develop: custom end-to- end application • Tokenize data 6
  • 7. • Expert mode Analyze your DataUsers • Import your data • Self-service mode Data • Fabricate Data • Stream & Batch Analytics • Expert: Upload your code • Self-service: Select an algorithm from the pool Results • Visualize the results • Share models Do it yourself In a flexible manner Break data silos Safe environment Interact with Big Data technologies Increase speed of data analysis Cope with the rate of data asset growth Intra- and inter- domain data-flow Benefits of using I-BiDaaS • Co-develop mode • Co-develop: custom end-to- end application • Tokenize data 7 Flexible solution I-BiDaaS pipeline
  • 8. • Expert mode Analyze your DataUsers • Import your data • Self-service mode Data • Fabricate Data • Stream & Batch Analytics • Expert: Upload your code • Self-service: Select an algorithm from the pool Results • Visualize the results • Share models Do it yourself In a flexible manner Break data silos Safe environment Interact with Big Data technologies Increase speed of data analysis Cope with the rate of data asset growth Intra- and inter- domain data-flow Benefits of using I-BiDaaS • Co-develop mode • Co-develop: custom end-to- end application • Tokenize data Data sharing & breaking silos 8 I-BiDaaS pipeline
  • 9. • Expert mode Analyze your DataUsers • Import your data • Self-service mode Data • Fabricate Data • Stream & Batch Analytics • Expert: Upload your code • Self-service: Select an algorithm from the pool Results • Visualize the results • Share models Do it yourself In a flexible manner Break data silos Safe environment Interact with Big Data technologies Increase speed of data analysis Cope with the rate of data asset growth Intra- and inter- domain data-flow Benefits of using I-BiDaaS • Co-develop mode • Co-develop: custom end-to- end application • Tokenize data 9 I-BiDaaS pipeline
  • 10. • Expert mode Analyze your DataUsers • Import your data • Self-service mode Data • Fabricate Data • Stream & Batch Analytics • Expert: Upload your code • Self-service: Select an algorithm from the pool Results • Visualize the results • Share models Do it yourself In a flexible manner Break data silos Safe environment Interact with Big Data technologies Increase speed of data analysis Cope with the rate of data asset growth Intra- and inter- domain data-flow Benefits of using I-BiDaaS • Co-develop mode • Co-develop: custom end-to- end application • Tokenize data 10 I-BiDaaS pipeline
  • 11. The I-BiDaaS solution: Architecture & technologies Medium to long term business decisions Data Fabrication Platform (IBM) Refined specifications for data fabrication GPU-accelerated Analytics (FORTH) Apama Complex Event Processing (SAG) Streaming Analytics Batch Processing Advanced ML (UNSPMF) COMPsProgramming Model(BSC) Query Partitioning Infrastructurelayer: Private cloud; Commodity cluster; GPUs Pre-defined Queries SQL-like interface Domain Language Programming API User Interface Resource managementand orchestration (ATOS) Advanced Visualis. Advanced IT services for Big Data processing tasks; Open source pool of ML algorithms Data ingestion Programming Interface / Sequential Programming (AEGIS+SAG) (AEGIS) COMPsRuntime (BSC) Distributed large scale layer Application layer UniversalMessaging(SAG) TestData Fabrication(IBM) Meta- data; Data descri- ption Hecuba tools (BSC) Short term decisions real time alerts Model structure improvements Learnedpatterns correlations 11
  • 12. WP2: Data, user interface, visualization Technologies: • IBM TDF • SAG UM • AEGIS AVT Medium to long term business decisions Data Fabrication Platform (IBM) Refined specifications for data fabrication GPU-accelerated Analytics (FORTH) Apama Complex Event Processing (SAG) Streaming Analytics Batch Processing Advanced ML (UNSPMF) COMPs Programming Model (BSC) Query Partitioning Infrastructure layer: Private cloud; Commodity cluster; GPUs Pre-defined Queries SQL-like interface Domain Language Programming API User Interface Resource management and orchestration (ATOS) Advanced Visualis. Advanced IT services for Big Data processing tasks; Open source pool of ML algorithms Programming Interface / Sequential Programming (AEGIS+SAG) (AEGIS) COMPs Runtime (BSC) Distributed large scale layer Application layer UniversalMessaging(SAG) DataFabrication Platform(IBM) Meta- data; Data descri- ption Hecuba tools (BSC) Short term decisions real time alerts Model structure improvements Learned patterns correlations 12 http://ibidaas.eu/tools
  • 13. 13 Medium to long term business decisions Data Fabrication Platform (IBM) Refined specifications for data fabrication GPU-accelerated Analytics (FORTH) Apama Complex Event Processing (SAG) Streaming Analytics Batch Processing Advanced ML (UNSPMF) COMPs Programming Model (BSC) Query Partitioning Infrastructure layer: Private cloud; Commodity cluster; GPUs Pre-defined Queries SQL-like interface Domain Language Programming API User Interface Resource management and orchestration (ATOS) Advanced Visualis. Advanced IT services for Big Data processing tasks; Open source pool of ML algorithms Programming Interface / Sequential Programming (AEGIS+SAG) (AEGIS) COMPs Runtime (BSC) Distributed large scale layer Application layer UniversalMessaging(SAG) DataFabrication Platform(IBM) Meta- data; Data descri- ption Hecuba tools (BSC) Short term decisions real time alerts Model structure improvements Learned patterns correlations WP3: Batch analytics Technologies: • BSC COMPSs • BSC Hecuba • BSC Qbeast • Advanced ML (UNSPMF) 13 http://ibidaas.eu/tools
  • 14. 14 Medium to long term business decisions Data Fabrication Platform (IBM) Refined specifications for data fabrication GPU-accelerated Analytics (FORTH) Apama Complex Event Processing (SAG) Streaming Analytics Batch Processing Advanced ML (UNSPMF) COMPs Programming Model (BSC) Query Partitioning Infrastructure layer: Private cloud; Commodity cluster; GPUs Pre-defined Queries SQL-like interface Domain Language Programming API User Interface Resource management and orchestration (ATOS) Advanced Visualis. Advanced IT services for Big Data processing tasks; Open source pool of ML algorithms Programming Interface / Sequential Programming (AEGIS+SAG) (AEGIS) COMPs Runtime (BSC) Distributed large scale layer Application layer UniversalMessaging(SAG) DataFabrication Platform(IBM) Meta- data; Data descri- ption Hecuba tools (BSC) Short term decisions real time alerts Model structure improvements Learned patterns correlations WP4: Streaming analytics Technologies: • SAG Apama CEP • FORTH GPU-accel. analytics 14 http://ibidaas.eu/tools
  • 15. 15 Medium to long term business decisions Data Fabrication Platform (IBM) Refined specifications for data fabrication GPU-accelerated Analytics (FORTH) Apama Complex Event Processing (SAG) Streaming Analytics Batch Processing Advanced ML (UNSPMF) COMPs Programming Model (BSC) Query Partitioning Infrastructure layer: Private cloud; Commodity cluster; GPUs Pre-defined Queries SQL-like interface Domain Language Programming API User Interface Resource management and orchestration (ATOS) Advanced Visualis. Advanced IT services for Big Data processing tasks; Open source pool of ML algorithms Programming Interface / Sequential Programming (AEGIS+SAG) (AEGIS) COMPs Runtime (BSC) Distributed large scale layer Application layer UniversalMessaging(SAG) DataFabrication Platform(IBM) Meta- data; Data descri- ption Hecuba tools (BSC) Short term decisions real time alerts Model structure improvements Learned patterns correlations WP5: Resource mgmt & integration Technologies: • ATOS Resource mgmt • ITML integration services 15 http://ibidaas.eu/tools
  • 16. 16 BDVA Reference model BDV SRIA: European Big Data Value Strategic Research and Innovation Agenda
  • 17. 17 BDVA reference model horizontal concerns & I-BiDaaS BDV reference model horizontal concern I-BiDaaS module or platform as a whole Data visualization and user interaction Advanced visualization module (AEGIS+SAG); User interface (AEGIS) Data analytics Batch processing module (UNSPMF+BSC); Streaming analytics module (SAG+FORTH) Data processing architectures expected advances according to BDVA SRIA I-BiDaaS platform Data protection FORTH commodity cluster privacy preservation through commodity hardware (Intel SGX); TDF (IBM) for generation of realistic synthetic data when real data cannot be uploaded to cloud or similar systems Data management COMPSs runtime (BSC); ATOS resource management and orchestration module The Cloud and HPC (efficient usage of Cloud) ATOS resource management and orchestration module
  • 18. Brief introduction to I-BiDaaS I-BiDaaS pipeline, architecture & technologies I-BiDaaS & BDVA reference model Benchmarking landscape and opportunities @ I-BiDaaS Outline 18
  • 19. 19 Benchmarking: Technology level I-BiDaaS partner Technology name Big Data pipeline element Current benchmarks FORTH GPU accelerator technology Data pre-processing, Streaming Analytics Custom benchmark (throughput, latency) BSC COMPSs Sequential programming model for distributed architectures Applications (Own use cases) BSC Hecuba Data management framework with easy interface Applications (Own use cases) BSC Qbeast Multidimensional indexing and storage TCP-H IBM Test Data Fabrication Synthetic test data fabrication Several open source + commercial products (e.g., Grid tools of CA) / No known benchmarks yet SAG Apama Streaming Analytics Platform Streaming Analytics Custom benchmark (throughput) SAG Universal Messaging Message Broker Custom benchmark (throughput) SAG WebMethods Integration Platform Integration N/A SAG MashZone Visualization N/A AEGIS Advanced visualization and monitoring Visualization and interface N/A UNSPMF Pool of ML algorithms in COMPSs/Python Batch analytics Respective MPI implementation; Sklearn ATOS Resource management and orchestration module Resource management N/A
  • 20. Business Objectives Data Sets Data Size Processing Type Type of Analysis Telecoms ⁻ improve and optimize current operations ⁻ Anonymized mobility data (structured) ⁻ Anonymized call center data (unstructured) TB ⁻ batch & streaming ⁻ predictive ⁻ descriptive / diagnostic Finance ⁻ improve decision making ⁻ improve efficiency of Big Data solutions ⁻ Tokenized online banking control data (structured) ⁻ Tokenized bank transfer data (structured) ⁻ Tokenized IP address data (structured) PB ⁻ batch ⁻ batch & streaming ⁻ descriptive / diagnostic Manufacturing ⁻ improve and optimise current operations ⁻ improve the quality of the process and product ⁻ Anonymized SCADA/MES data (structured) ⁻ Anonymized Aluminum Die- casting (structured) GB ⁻ batch ⁻ batch & streaming ⁻ predictive ⁻ diagnostic Benchmarking: Business, data & analytics level 20
  • 21. I-BiDaaS Partner Use Case Most relevant business KPIs TID Accurate location prediction with high traffic and visibility - Acquisition of insights on the dynamics of cellular sectors - Processing costs (cost reduction) - Customer satisfaction TID Optimization of placement of telecommunication equipment TID Quality of service in Call Centers CAIXA Enhanced control on online banking - Cost reduction - Data accessibility - Time efficiency - End-to-end execution time (from data request to data provision) CAIXA Advanced analysis of bank transfer payment in financial terminal CAIXA Analysis of relationships through IP addresses CRF Production process of aluminium die-casting - 3 Product quality levels (High. Medium, Low) - Overall Equipment Effectiveness (OEE), - Maintenance cost - Cost reduction CRF Maintenance and monitoring of production assets Benchmarking: Business level 21

Editor's Notes

  1. The full name of the I-BiDaaS project is Industrial-driven big data as a self service solution. I-BiDaaS is a European Project, RIA (Research and Innovation Action) that means focused on research but as applied as possible. The duration is 36 months. We started in the beginning of 2018 and we have just completed the 1st year. The I-BiDaaS consortium has 13 partners. A mixture of Universities, Research Centers, SMEs, Industry.
  2. The I-BiDaaS consortium was constructed in such a way as to put together a group of organizations with high complementarity in terms of technical competence, organizational, business and market experience. All the partner share a track record of proven leadership, technical expertise, extensive experience and critical skills in all the key areas required for the project to achieve its objectives. With respect to the ability to carry out the proposed work, all partners in I-BiDaaS have participated in successful EU projects in the past.