An overview of the workshop as presented at the 1st International Workshop on Benchmarking Linked Data (BLINK). (HOBBIT project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 688227.)

1. Benchmarking Linked Data
Introductory Remarks
Axel Ngonga
Irini Fundulaki
Anastasia Krithara
Horizon 2020
GA No 688227
01/12/2016–30/11/2018
ISWC 2016
Kobe, Japan
November 10, 2016
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 1 / 9

2. A Lot of Data
1
1http://www.ibmbigdatahub.com/infographic/four-vs-big-data
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 2 / 9

3. A Lot of Tools
2
2https://cdn.datafloq.com/cms/os_big_data_open_source_tools-v2.png
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 3 / 9

4. Core Questions
Developers: How good is my tool?
Vendors: Who is my tool good for?
Users: Which tool(s) should I use for
my application?
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 4 / 9

5. Many Questions
Where are the current bottlenecks?
Which steps of the data lifecycle are
critical?
Which solutions are available?
Which key performance indicators
are relevant?
How well do or should tools
perform?
How do existing solutions perform
w.r.t. relevant indicators?
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 5 / 9

6. Many Questions
Goal of BLINK
Create a forum where these questions can be discussed and addressed.
Where are the current bottlenecks?
Which steps of the data lifecycle are
critical?
Which solutions are available?
Which key performance indicators
are relevant?
How well do or should tools
perform?
How do existing solutions perform
w.r.t. relevant indicators?
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 5 / 9

7. HOBBIT
Rationale
A community-driven benchmarking framework for the community
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 6 / 9

8. HOBBIT
Rationale
A community-driven benchmarking framework for the community
Focus on Big Linked Data
Build upon 12+K experiments performed
with GERBIL
Cover all steps of the Linked Data lifecycle
Used by a growing number of companies
Mature and maturing technologies
Open benchmarks based on industrial data
and use cases
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 6 / 9

9. Program
14:00 – 14:05 Welcome
14:05 – 14:45 Keynote (Stasinos Konstantopoulos): BigDataEurope –
Platform Concept and Architecture and its Application to
Data-Intensive Science
14:45 – 15:05 Kotsev et al.: Benchmarking RDF Query Engines: The case
of Semantic Publishing Benchmark
15:05 – 15:25 Spasić et al.: An RDF Dataset Generator for the Social Net-
work Benchmark with Real-World Coherence
15:25 – 15:45 Saveta et al.: How well does your instance matching system
perform? Experimental evaluation with LANCE.
15:45 – 16:05 Coffee Break
16:05 – 16:25 Troumpoukis et al.: Developing a Benchmark Suite for Se-
mantic Web Data from Existing Workflows
16:25 – 16:45 Papakonstantinou et al.: Versioning for Linked Data:
Archiving Systems and Benchmarks
16:45 – 17:05 Lanti et al.: Fast and Simple Data Scaling for OBDA Bench-
marks
17:05 – 17:30 Discussion & Closing
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 7 / 9

10. Thank You
http://project-hobbit.eu/get-involved/
http://goo.gl/forms/1iRIoG4Xpb
https://twitter.com/hobbit_project
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 8 / 9

11. Acknowledgment
This work was supported by grants from the EU H2020 Framework Programme
provided for the project HOBBIT (GA no. 688227).
Ngonga Ngomo et al. (InfAI) BLINK November 10, 2016 9 / 9