1. www.datamarket.at
Wirtschaftsagentur Wien Business Treff:
Was steckt drinnen, im Data Market Austria?
13. Juni 2017, 16.30 - 19.00 Uhr, Wirtschaftsagentur Wien
Martin Kaltenböck, Semantic Web Company (SWC)
2. INTRODUCING
SEMANTIC
WEB COMPANY
(SWC) AND
POOLPARTY
Semantic Web Company
▸ Founded in 2004
▸ Based in Vienna
▸ Privately held
▸ ~40 employees, experts in text
mining & linked data
▸ ~20% revenue growth / year
▸ 2.5 Mio Euro funding for R&D
▸ KMWorld’s 2016 & 2017 "100
Companies That Matter in
Knowledge Management"
▸ Organising SEMANTiCS
conference series since 2005
(12-13.9.2017 in Amsterdam)
PoolParty Semantic Suite
▸ First release in 2009
▸ Current version 6.0
▸ W3C standards compliant
▸ Over 200 installations worldwide
▸ 50% of SWC’s revenue is
reinvested into development
of PoolParty
▸ PoolParty on-premises or used
as a cloud service
▸ KMWorld listed PoolParty as
Trend-Setting Product 2015,
2016 and 2017
2
4. SELECTED
CUSTOMER
REFERENCES
AND PARTNERS
SWC head-
quarters
4
Customer References
● Credit Suisse
● Boehringer Ingelheim
● Roche
● adidas
● The Pokémon Company
● Canadian Broadcasting Corporation
● Harvard Business School
● Wolters Kluwer
● Talend
● HealthStream
● TC Media
● Techtarget
● Seek
● CafePress
● Pearson - Always Learning
● Education Services Australia
● American Physical Society
● Healthdirect Australia
● World Bank Group
● Inter-American Development Bank
● Renewable Energy Partnership
● Wood MacKenzie
● Oxford University Press
● International Atomic Energy Agency
● Norwegian Directorate of Immigration
● Ministry of Finance (AT)
● Council of the E.U.
● Australian National Data Service
Partners
● Accenture
● EPAM Systems
● Enterprise Knowledge
● Mekon Intelligent Content Solutions
● B-S-S Business Software Solutions
● MarkLogic
● Wolters Kluwer
● Digirati
● Quark
US
East
US
West
AUS/
NZL
UK
5. www.datamarket.at
Motivation:
Data Market Austria (DMA)
Die heute verfügbare Anzahl an Daten bzw. die täglich produzierten Datenmengen haben eine bis dato ungeahnte
Größe angenommen – Daten sind zu einem Rohstoff geworden, welcher weltweit in beinahe jedem
Industriesektor eine entscheidende Rolle spielt.
Daher ist ein florierender Datenmarkt bzw. ein funktionierendes Daten-Services Ökosystem für Österreich ein
entscheidender Faktor für Beschäftigung und Wachstum sowie für nachhaltige gesellschaftliche Stabilität und
Wohlstand.
Das Data Market Austria Projekt etabliert ein Daten-Services Ökosystem in Österreich durch die Schaffung einer
deutlich verbesserten Technologiebasis für sichere Datenmärkte und Cloud-Interoperabilität und die Etablierung
eines Daten-Innovationsumfeldes. Pilotsysteme sowie innovative Anwendungen u.a. in den Bereichen
Erdbeobachtung und Mobilität werden die Verwendung des neuen Daten-Services Ökosystem sowie die
Wertschöpfung daraus demonstrieren.
6. www.datamarket.at
Motivation:
Data Market Austria (DMA)
Every day, we create 2.5 quintillion bytes of data — so much that 90% of the data in the
world today has been created in the last two years alone.
This data comes from everywhere: sensors used to gather climate information, posts to
social media sites, digital pictures and videos, purchase transaction records, and cell phone
GPS signals to name a few.
This data is big data.
Quelle: IBM
12. www.datamarket.at
Community driven
Requirements Evaluation
The target groups of the Data-Services Ecosystem Austria are all
organisations and activities that are working in the area of data-driven
businesses in the five core domains of ‘IKT der Zukunft’ with a focus on
the two selected Pilot domains.
Conversations with these groups will be documented as requirements
and use cases and grouped according to the domains (and to their roles in
the Data-Services Ecosystem as e.g. Data Providers or Service Providers,
etc.). Thus, the requirements of the Data-Services Ecosystem Austria will be
derived.
More specific and detailed requirements for the mobility and earth
observation pilots will be collected during the second iteration respectively.
1. Industry 4.0
2. Mobility
3. Earth Observation and
Space
4. Active Assisted Living
5. Energy
13. www.datamarket.at
Community driven
Requirements Evaluation
Methods & Tools
• Question Matrix as a Basis
• 5 x Stakeholder Workshops
• 2 x Pilot Workshops
• Event Participation
• Consortium Knowledge & Experience
• Similar international initiatives (e.g. IDS)
• Alignment with activities in Business
Models & Legal
Requirements Specification
• Overall Requirements
• Technical Requirements
• Map these to technical Building Blocks and
Architecture Design
• Basis for DMA Integration & Development
• Hand over for 2 Pilots (Mobility & EO)
• Continuous Requirements Management
14. www.datamarket.at
6 Treffen: bmvit & Netzwerke zu den 5 Kernthemen plus Innovative Beschaffung (~20 Personen):
● “Hot topics” im Themenbereich
● Status in Bezug auf Datenmanagement (data driven business) in der Domäne
● Wer sind die ‘Main Players’ und Multiplikatoren im Themenbereich (opinion leaders)
● Events und Meetings mit diesen Stakeholdern
● Support in der Kommunikation / Promotion des DMA in der jeweiligen Community
5 Stakeholder Workshops (277 Einladungen; 56 TeilnehmerInnen) im Februar / März 2017:
● Session 1: Data Ecosystem, Geschäftsmodelle, Szenarios (Use Cases & Data Stories)
● Session 2: Daten und Data Services
● Session 3: Technische Anforderungen & DMA Funktionen
● Session 4: Rahmenbedingungen für einen erfolgreichen DMA
Die Einladungspolitik berücksichtigte: Zielgruppen, Rolle in der Organisation, Region, Geschlecht
PLUS: laufende bilaterale Gespräche und 17 Partner Interviews (Business Modelle, Daten & Services)
PLUS: Intensiver Wissensaustausch mit dem Industrial Data Space Deutschland (IDS)
Anforderungserhebung & -analyse
Data Market Austria (DMA)
15. www.datamarket.at
Struktur der DMA Requirements
● Basic Infrastructure
● Basic Services
● Developer Assistance for distributed clouds
● Service provision
● Data Acquisition and Data Ingestion
● Data Analytics & Big Data
● Security, Provenance and Data Citation
● Data Quality
● Semantic Enrichment
Anforderungserhebung & -analyse
Data Market Austria (DMA)
16. www.datamarket.at
Requirements Elicitation
Data Market Austria (DMA)
URI Requirement Description
Industry
4.0
AAL EO Mobility Energy
1.1
Federated interoperable
Cloud Systems
Possibility to dock n cloud
environments onto DMA (if such cloud
follows the given requirements /
guidelines)
✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭✭
1.2 DMA Public Portal
Providing infos on DMA, how tos,
search & browse directories (data,
services, data stories), news &
events, .....and registration to make
use of the DMA
✭✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
1.3 User admin authentication and management ✭✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
1.4 Internationalisation
Languages (at least DE and EN); but
also localisation and data localisation
(where is data stored)
✭✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭✭
Basic Infrastructure
17. www.datamarket.at
Requirements Elicitation
Data Market Austria (DMA)
Basic Services
URI Requirement Description Industry 4.0 AAL EO Mobility Energy
2.1 Usage tracking & Monitoring
track usage of data and services. incl. basic
security and access control; monitoring of
infrastructure and services
✭✭✭ ✭✭✭ ✭✭✭
2.2 Billing basics
billing for data, service and infrastructure use;
own currency
✭✭ ✭✭ ✭✭✭✭ ✭ ✭✭✭✭
2.3 Billing models
Billing models have to be flexible to be adapted
by provider but clear for consumer
✭✭ ✭✭ ✭✭✭✭ ✭ ✭✭✭✭
2.4 Brokerage
assisting systems for broker(s); demand and
supply matchmaking
✭✭✭✭ ✭✭✭ ✭✭✭✭ ✭✭✭✭
2.5 Contracting
Smart contracts for running a simple
standardised case
✭✭✭ ✭✭✭ ✭✭✭ ✭✭✭ ✭✭✭
2.6 Aggregation
Generic anonymisation and anonymisation
services for data (or to be used for services)
✭✭✭✭ ✭✭✭✭
2.7 Licensing of data services
Which licenses and / or conditions are in place
to make use of a service BUT also to create /
deploy a service
✭✭✭ ✭✭✭ ✭✭✭ ✭✭✭ ✭✭✭
18. www.datamarket.at
Requirements Elicitation
Data Market Austria (DMA)
Developer Assistance
URI Requirement Description
Industry
4.0
AAL EO Mobility Energy
3.1 developers tool to write code Code shell / interface (Jupyter e.g.) ✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭
3.2 Guiding
Comprehensive how-tos and
guidelines, documentation
✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭
3.3
Buy / rent storage and/or
computational capacity
Clear requirement as organisation
et al do not have cloud capacity for
e.g. experiments this should be part
of DMA (was requested to be part)
✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭✭
19. www.datamarket.at
Requirements Elicitation
Data Market Austria (DMA)
Service Provision
URI Requirement Description
Industry
4.0
AAL EO Mobility Energy
4.1 Robust data services
robust services (generic services
that can be used cross domain & can
be combined)
✭✭✭✭ ✭✭ ✭✭ ✭✭✭ ✭✭✭✭
4.2 B2B
Data and services are meant for
trading between companies
✭✭ ✭✭✭ ✭✭ ✭✭✭✭
4.3 B2C
Data and services are sold to the end
customer
✭✭✭ ✭✭ ✭✭
4.4
metadata scheme for
services
Services should have a clear defined
metadata scheme to allow search and
recommendation and add.
information about a DMA service
✭✭✭✭ ✭✭ ✭✭ ✭✭✭ ✭✭✭✭
4.5
Provide experimentation
spaces
Provision of secure areas for
experiments for 2 or more parties to
for instance party A to analyse data
of Party B; for data sharing; for
service creation, etc
✭✭✭✭ ✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
20. www.datamarket.at
Requirements Elicitation
Data Market Austria (DMA)
Data Acquisition & Ingestion
URI Requirement Description Industry 4.0 AAL EO Mobility Energy
5.1 Open Data A basic stock of Open Data for free reuse ✭✭ ✭✭✭ ✭
5.5 Taxonomies & Ontologies Base taxonomies and vocabularies for different domains should be provided ✭✭✭ ✭✭ ✭✭✭ ✭✭ ✭✭✭✭
5.6 Metadata
Provision of rich metadata; connectivity to other domains by making use
of standards
✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
5.7 Metadata quality assessment (+ reports) - where possible improvements of metadata ✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
5.8 Interoperability & Standards Make use of existing standards where possible to foster interoperability ✭✭✭✭ ✭ ✭✭✭✭ ✭✭ ✭✭
5.9 Classification Categorisation of data regarding quality, completeness, etc ✭✭✭ ✭✭✭ ✭✭✭ ✭✭✭✭ ✭✭✭✭
5.10
Sample data and service
demos
For testing and pioneering sample data (compareable sample data) should be
provided per dataset; for data services demos and/or test scenarios should be
available that demonstrate the service
✭✭✭✭ ✭✭ ✭✭✭ ✭✭✭ ✭✭✭
5.11 Data Quality
Including assessment and improvement mechanisms of data and
metadata
✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭✭
5.12 Security & Trust
mechanisms to ensure secure data transfer and e.g. versioning
(blockchain et al).
✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
5.14 profiling
Profiling of at least users, organisations, data and data services as to facilitate
the matchmaking capability
✭✭✭ ✭ ✭✭✭✭ ✭✭✭✭
5.16 Validation of ownership
Validation of the ownership of (i) a user / an organisation (ii) a dataset and
(iii) a data service
✭✭✭ ✭✭✭✭ ✭ ✭✭✭ ✭✭✭
21. www.datamarket.at
Requirements Elicitation
Data Market Austria (DMA)
Analytics & Big Data
URI Requirement Description Industry 4.0 AAL EO Mobility Energy
9.1 Data mining
Stakeholders are interested to receive patterns and analysis on
big data resources they have in place for understanding of the
data and receiving insights
✭✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
9.2 Machine learning
Stakeholders are interested in the use of machine learning tools
and/or libraries on DMA as services to be used.
✭✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
9.3 Data consulting
Services as e.g. data monitoring, data consultancy, quality
assessment, etc were requested to get via DMA (if not directly
provided than DMA should provide infos where to get such
(professional) Services)
✭✭✭✭ ✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
9.4 Volume Process, analyse, store etc big volume of data ✭✭✭✭ ✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭✭
9.5 Velocity allow / enable real time processing of data ✭✭✭✭ ✭ ✭ ✭✭✭ ✭✭✭✭
9.6 Variety
Allow to work with heterogeneous data (different sources,
formats) and integrate such data etc
✭✭✭✭ ✭✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭
9.7 Veracity Truth in the data is important; also: trusted data ✭ ✭✭✭✭ ✭✭ ✭✭ ✭✭✭✭
22. www.datamarket.at
Requirements Elicitation
Data Market Austria (DMA)
Matchmaking & Brokerage
URI Requirement Description
Industry
4.0
AAL EO Mobility Energy
12.1 Brokerage
assisting systems for broker(s);
demand and supply matchmaking
✭✭✭✭ ✭✭✭ ✭✭✭✭ ✭✭✭✭
12.2 Data Stewardship
Trusted and secure environment
provided by DMA to share and
exchange data (make use of data)
✭✭✭ ✭✭✭✭ ✭✭✭ ✭✭✭ ✭✭✭✭
12.3 Matchmaking
Demand & Supply of services, data,
data services, ...
✭✭✭✭ ✭✭✭ ✭✭✭ ✭✭✭✭ ✭✭✭✭
12.4 SLAs
Provision of SLAs for mainly
services but also data access.
✭✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭ ✭✭✭✭
23. www.datamarket.at
1. Öffentliches DMA Portal: Information zu Datenwirtschaft & -management, Daten & Services (!!!)
2. Der DMA soll Success Stories zu Datenmanagement und der Datenwirtschaft anbieten (Best Practise)
3. DMA soll als zentraler Marktplatz für Daten und Services agieren (‘Einkaufszentrum Analogie’)
4. DMA als Single-Point-of-Access / Information für ‘data related demand and supply’
5. Einfach zu verwendende und transparente Mechanismen für Contracting und Billing!
6. Grundvoraussetzung für die DMA Nutzung: Trust und Security
7. Einfache und hochqualitative Suchmöglichkeiten für Daten und Services = Erfolgsfaktor!
8. Datenintegration & Anwendungsentwicklung zwischen Domänen ermöglichen (cross industry)
9. Experimentierräume anbieten, um Innovation zu fördern
10. Datenaustausch in einer sicheren Umgebung anbieten (Point 2 Point)!
11. DMA muss die folgenden Eigenschaften von Daten unterstützen: Volume, Velocity und v.a. Variety!
12. DMA soll Mechanismen für die Überprüfung & Verbesserung von Datenqualität beinhalten.
13. Interoperabilität und Standards der / zwischen Industrien und Themenbereichen sind wichtig!
Top Requirements
Data Market Austria (DMA)
24. www.datamarket.at
● Implementing basic infrastructure services: billing, contracting, authentication, VM administration, etc
● Developer Assistance for Distributed Clouds: tools & guidelines to write code & port between clouds
● Service Provision: toolkit to provide Software as a Service in DMA
● Data Acquisition and Provision: data harvester and integration of all data related building blocks
● Infrastructure Integration: single interface for distributed clouds & 3rd party data
● Data Market Austria Portal: single point of access to Data Market Austria (as web portal)
Technical Building Blocks I
Data Market Austria (DMA)
25. www.datamarket.at
● Data API and profile creation framework: data ingestion, metadata creation, data profile management
● Block Chains for security and provenance: enable dataset ownership, authenticity and trust
● Long-term Preservation of Data and Data Citation: persistent unique identifier (PID) & long-term preservation
● Improving Data Quality: assessment of metadata and data quality and automatic improvements
● Service API and Profile Creation Framework: service profile creation & management; API provision service
Technical Building Blocks II
Data Market Austria (DMA)
26. www.datamarket.at
● Service API and Profile Creation Framework: service profile creation & management; API provision service
● Large Scale Data Analysis: toolset for data mining, machine learning & online analytical processing
● Semantic Enrichment and Linking of Data: analysis of data & metadata and semantic enrichment & linking
● Analysing and Fusing Distributed Data with Differing Access Levels: data fusion across the ecosystem
● Matchmaking framework: matching making between data and services (and vice versa)
● User and corporate profiles and brokerage: matching making between users and data & services
● Tools for service assessment: guidelines & recommender for DMA services
Technical Building Blocks III
Data Market Austria (DMA)
27. www.datamarket.at
Data Market Austria (DMA)
… deutlich mehr als Technologie...
• Intensive Community Arbeit: Vernetzung relevanter Stakeholder
• Schaffung eines Innovationsumfeldes für Datenmanagement & -
wirtschaft in Österreich
• DMA Inkubator Programm startet Q2/2018
Funding
Coaching
DMA Use
• Data driven Business: Best Practises und Trends (Data Stories)
• Internationale Vernetzung mit ähnlichen Initiativen
Gesamter DMA Requirements Elicitation Report
29. www.datamarket.at
Einladung zur Mitarbeit
▪ Ihre Ideen
▪ Ihr Feedback
▪ Kooperationen mit bestehenden Netzwerken,
Communities und Organisationen
▪ Weitere Anwendungsgebiete & Piloten
29
http://www.datamarket.at @DataMarketAT | #DataMarketAT
30. www.datamarket.at
Martin Kaltenböck, CMC
Semantic Web Company
Neubaugasse 1
1070 Wien
E-Mail: martin.kaltenboeck@semantic-web.com
https://www.linkedin.com/in/martinkaltenboeck
http://www.semantic-web.com
http://www.poolparty.biz
Ihre Fragen ….