BF
Uploaded byBesnik Fetahu
PDF, PPTX3,022 views

A Scalable Approach for Efficiently Generating Structured Dataset Topic Profiles

The document discusses a scalable approach for efficiently generating structured dataset topic profiles in the context of increasing web data. It outlines the challenges faced, such as data heterogeneity, sparsely connected datasets, and lack of descriptive metadata, while presenting methods for resource instance and type extraction, topic ranking, and evaluating profiling efficiency and scalability. The study evaluates various sampling approaches and algorithmic techniques through experiments, highlighting the effectiveness of the developed methods.

Embed presentation

Download as PDF, PPTX
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions A Scalable Approach for Efficiently Generating Structured Dataset Topic Profiles Besnik Fetahu1 , Stefan Dietze1 , Bernardo Pereira Nunes2 , Marco Antonio Casanova2 , Davide Taibi3 , Wolfgang Nejdl1 1L3S Research Center, Leibniz Universit¨at Hannover 2Department of Informatics - PUC-Rio 3Institute for Educational Technologies, CNR May 29, 2014
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets • Exhaustive techniques for data analysis
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets • Exhaustive techniques for data analysis • Efficiency heavily dependent on information need
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets • Exhaustive techniques for data analysis • Efficiency heavily dependent on information need • Ease of access and representation of datasets
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? • Growing number of datasets: 227 datasets • Data represented as triples: 31 billion triples • Multi-lingual content: 18 languages • Broad set of topics covered • Inter-dataset links Domain # Data. Triples Media 25 1,841,852,061 Geographic 31 6,145,532,484 Government 49 13,315,009,400 Publications 87 2,950,720,693 Cross-domain 41 4,184,635,715 Life sciences 41 3,036,336,004 User-generated 20 134,127,413
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? Find datasets covering the domain of “Renewable Energy”? • Sparsity: Datasets that cover the topic? • 38 out of 228 datasets contain topic coverage information.
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? Find datasets covering the domain of “Renewable Energy”? • Sparsity: Datasets that cover the topic? • 38 out of 228 datasets contain topic coverage information. • Scalability: Use SPARQL filter clause? • regex(*) filter clause needs to check all triples that contain a specific keyword.
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? Find datasets covering the domain of “Renewable Energy”? • Sparsity: Datasets that cover the topic? • 38 out of 228 datasets contain topic coverage information. • Scalability: Use SPARQL filter clause? • regex(*) filter clause needs to check all triples that contain a specific keyword. • Disambiguity: What are all the possible forms of renewable energy? • solar energy, wind energy, geothermal. . .
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling 3 Entity/topic extraction
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling 3 Entity/topic extraction 4 Profile graphs
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling 3 Entity/topic extraction 4 Profile graphs 5 Profiles representation
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Instance and Type Extraction • Simple SPARQL SELECT queries • Avg. indexing time 10% (7min) vs. 100% (4hrs). • Approximately ∼300 million resource instances 10 100 1000 10000 100000 uriburner bluk-bnb bio2rdf-kegg-pathway nom enclator-asturias b3katlobid-resources twc-ieeevis educationalprogram ssisvu farm bio-chem bl world-bank-linked-data event-m edia eea eunishungarian-national-library-catalog bio2rdf-pubm ed linked-user-feedback oecd-linked-data bio2rdf-goa pscs-catalogue bio2rdf-genbank linkedm db bfs-linked-data bio2rdf-reactom e british-m useum -collection bio2rdf-ncbigene datos-bcn-cl l3s-dblp bio2rdf-sgd hellenic-fire-brigade Log-scaleindexingtime 100% 10%
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Sampling Approaches Entity and Topic Extraction Resource Sampling • random: randomly select a resource instance for analysis 1 DBpedia Spotlight
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Sampling Approaches Entity and Topic Extraction Resource Sampling • random: randomly select a resource instance for analysis • weighted: weigh a resource by the number of datatype properties used to describe it wk = |f (rk)|/max{|f (rj )|} 1 DBpedia Spotlight
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Sampling Approaches Entity and Topic Extraction Resource Sampling • random: randomly select a resource instance for analysis • weighted: weigh a resource by the number of datatype properties used to describe it wk = |f (rk)|/max{|f (rj )|} • centrality: weigh a resource by the number of types used to describe it ck = |Ck|/|C| Topic Extraction • Resources as documents by combining all textual literals • Perform NED1 and extract corresponding DBpedia entities • Extract topics as DBpedia categories from entities via dcterms:subject 1 DBpedia Spotlight
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Constructing profiles: Dataset-topic graph 1 Profile graph nodes: datasets, resources, topics 2 Weighted graph edges: ∆ D, t 3 Edge weights: ∆ Di , t = ∆ Dj , t 4 Compute ∆ Di , t by assessing the importance of t given the resources of Di as prior knowledge 5 The given prior knowledge biases the importance of t in the profile graph towards Di 2 6 Incrementally add datasets in the profile graph, by simply computing the weights ∆ Dk , t 2 Scott White and Padhraic Smyth. 2003. Algorithms for estimating relative importance in networks. In 9th ACM SIGKDD (KDD ’03).
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Topic Ranking Approaches Topic filtering Topic pre-filtering: NTR(t, D) = Φ(·, D) Φ(t, D) + Φ(·, ·) Φ(t, ·) • Filter noisy topics • φ(·, ·) - number of entities associated with topic t • Closely related to the tf-idf weighting scheme Topic Ranking • PageRank with Priors (PRankP) • HITS with Priors (HITSP) • K-Step Markov (KStepM)
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Experimental Setup Datasets and Ground-truth • 129 dataset from lod-cloud3 • 6 ground-truth datasets with manually assigned topic indicators for their resources Dataset Properties #Resources yovisto skos:subject, dbp:{subject, class, discipline, kategorie, tagline} 62879 oxpoints dcterms:subject,dc:subject 37258 socialsemweb-thesaurus skos:subject, tag:associatedTag, dcterms:subject 2243 semantic-web-dog-food dcterms:subject, dc:subject 20145 lak-dataset dcterms:subject, dc:subject 1691 Evaluation Metrics • NDCG@k (k=1, . . . , 1000) • Compare the induced ranking by the graphical models against the ideal ranking 3 At the time of experimentation only 129 dataset endpoints were responsive.
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Baselines • tf-idf: Consider resources as documents. Extract for each dataset the top {50, 100, 150, 200} terms. • LDA: Consider dataset as documents4. Extract top weighted topic terms. For every dataset extract top {50, 100, 150, 200} with a number of topics {10, 20, 30, 40, 50}. 4 In this case it does not matter if datasets are considered at the resource level or aggregated.
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Efficiency of Dataset Profiling 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 1 100 200 300 400 500 600 700 800 900 1000 NDCGrankingscore NDCG rank Profiling accuracy for all topic ranking approaches K-Step Markov + NTR PageRank with priors + NTR HITS with priors + NTR LDA tf-idf 0.16 0.18 0.2 0.22 0.24 0.26 0.28 0.3 0.32 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 Sample Size K-Step Markov profiling accuracy (Centrality Sampling) KStepM + NTR KStepM
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Scalability of Dataset Profiling 100 1000 10000 0 20 40 60 80 100 0 0.05 0.1 0.15 0.2 0.25 0.3 Log-scaletimeperformance NDCGrankingscore Sample Size Time Performance vs. Profiling Accuracy HITS with priors time HITS with priors ranking K-Step Markov time K-Step Markov ranking PageRank with priors time PageRank with priors ranking • 5% and 10% already provide stable profiling accuracy • Avg. 7mins for indexing 10% of resources per dataset vs. 4hrs per dataset • 2mins for ranking dataset profiles with 10% of resources vs. 45mins for 100% • NED runtime 10% vs. 100%?
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Motivation Example Revisited!
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Conclusions and Future Work • Structured dataset profiles • Scalable approach through sampling • Efficient profiling through topic filtering and ranking • Incremental generation of dataset profiles • Dataset profiles as a set of links (entity and topic links) • Provenance information of links (e.g. resources from which an entity is extracted) • Profiles for dataset recommendation, search, etc. Resources • Profiles Endpoint: http://data-observatory.org/lod-profiles/sparql • Profiles Webpage: http://data-observatory.org/lod-profiles/
Introduction Problem and Motivation Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Thank you! Questions? #eswc2014Fetahu

More Related Content

PDF
LAK13 linkedup tutorial_evaluation_framework
byHendrik Drachsler
 
PDF
LinkedUp kickoff meeting session 4
byHendrik Drachsler
 
PPT
LinkedUp - Linked Data & Education
byStefan Dietze
 
PDF
Evaluation framework linkedup_amsterdam
byHendrik Drachsler
 
PDF
IRJET- Multi Label Document Classification Approach using Machine Learning Te...
byIRJET Journal
 
PDF
Mining Users Rare Sequential Topic Patterns from Tweets based on Topic Extrac...
byIRJET Journal
 
PPT
kantorNSF-NIJ-ISI-03-06-04.ppt
bybutest
 
PDF
Recommender System with Distributed Representation
byRakuten Group, Inc.
 
LAK13 linkedup tutorial_evaluation_framework
byHendrik Drachsler
 
LinkedUp kickoff meeting session 4
byHendrik Drachsler
 
LinkedUp - Linked Data & Education
byStefan Dietze
 
Evaluation framework linkedup_amsterdam
byHendrik Drachsler
 
IRJET- Multi Label Document Classification Approach using Machine Learning Te...
byIRJET Journal
 
Mining Users Rare Sequential Topic Patterns from Tweets based on Topic Extrac...
byIRJET Journal
 
kantorNSF-NIJ-ISI-03-06-04.ppt
bybutest
 
Recommender System with Distributed Representation
byRakuten Group, Inc.
 

What's hot

PDF
Slides: Concurrent Inference of Topic Models and Distributed Vector Represent...
byParang Saraf
 
PPTX
Minimal viable-datareuse-czi
byPaul Groth
 
PPTX
Language Models for Information Retrieval
byDustin Smith
 
PDF
Mapping Keywords to
byIsabelle Augenstein
 
PPTX
Semantic Similarity and Selection of Resources Published According to Linked ...
byRiccardo Albertoni
 
PDF
Hybrid Solution of the Cold-Start Problem in Context-Aware Recommender Systems
byMatthias Braunhofer
 
PDF
Test PDF
byAlgnuD
 
PDF
Semantic Annotation of Documents
bysubash chandra
 
PPTX
Thoughts on Knowledge Graphs & Deeper Provenance
byPaul Groth
 
PDF
Learnometrics: Metrics for Learning Objects
byXavier Ochoa
 
PDF
Bi4101343346
byIJERA Editor
 
PDF
Profile-based Dataset Recommendation for RDF Data Linking
byMohamed BEN ELLEFI
 
PDF
Co-Clustering For Cross-Domain Text Classification
bypaperpublications3
 
DOC
DATA MINING.doc
bybutest
 
PPTX
Machine learning with graph
byDing Li
 
PDF
Concurrent Inference of Topic Models and Distributed Vector Representations
byParang Saraf
 
PDF
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
byIJDKP
 
PDF
Incremental learning from unbalanced data with concept class, concept drift a...
byIJDKP
 
PPTX
From Text to Data to the World: The Future of Knowledge Graphs
byPaul Groth
 
PDF
Instance Matching Benchmarks for Linked Data - ESWC 2016 Tutorial
byHolistic Benchmarking of Big Linked Data
 
Slides: Concurrent Inference of Topic Models and Distributed Vector Represent...
byParang Saraf
 
Minimal viable-datareuse-czi
byPaul Groth
 
Language Models for Information Retrieval
byDustin Smith
 
Mapping Keywords to
byIsabelle Augenstein
 
Semantic Similarity and Selection of Resources Published According to Linked ...
byRiccardo Albertoni
 
Hybrid Solution of the Cold-Start Problem in Context-Aware Recommender Systems
byMatthias Braunhofer
 
Test PDF
byAlgnuD
 
Semantic Annotation of Documents
bysubash chandra
 
Thoughts on Knowledge Graphs & Deeper Provenance
byPaul Groth
 
Learnometrics: Metrics for Learning Objects
byXavier Ochoa
 
Bi4101343346
byIJERA Editor
 
Profile-based Dataset Recommendation for RDF Data Linking
byMohamed BEN ELLEFI
 
Co-Clustering For Cross-Domain Text Classification
bypaperpublications3
 
DATA MINING.doc
bybutest
 
Machine learning with graph
byDing Li
 
Concurrent Inference of Topic Models and Distributed Vector Representations
byParang Saraf
 
USING ONTOLOGIES TO IMPROVE DOCUMENT CLASSIFICATION WITH TRANSDUCTIVE SUPPORT...
byIJDKP
 
Incremental learning from unbalanced data with concept class, concept drift a...
byIJDKP
 
From Text to Data to the World: The Future of Knowledge Graphs
byPaul Groth
 
Instance Matching Benchmarks for Linked Data - ESWC 2016 Tutorial
byHolistic Benchmarking of Big Linked Data
 

Viewers also liked

PDF
Towards preservation of semantically enriched architectural knowledge
byStefan Dietze
 
PPTX
Presentation nokobit
bynetsoxx
 
PDF
What's all the data about? - Linking and Profiling of Linked Datasets
byStefan Dietze
 
PDF
Quality criteria for architectural 3D data in usage and preservation processes
bylindlar
 
PDF
KnowEscape workshop, OKCon 2013
byStefan Dietze
 
PPT
DURAARK at AUdS 2015
bypanitzm
 
PDF
Grapp2014 presentation
bynetsoxx
 
PDF
Turning Data into Knowledge (KESW2014 Keynote)
byStefan Dietze
 
PDF
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...
bylindlar
 
PPT
DURAARK at IGeLU 2014
bypanitzm
 
PDF
A Domain-driven Approach to Digital Curation and Preservation of 3D Architect...
bylindlar
 
PDF
Presentation of the DURAARK project at Ex Libris conference, Berlin, Germany.
byLena Lindbäck
 
PPT
DURAARK at Bibliotheksymposium Wildau
bypanitzm
 
PPTX
DURAARK presentation CIB W78 "Applications of IT in AEC" conference Beijing 2...
byJakob Beetz
 
PPT
Preservation of 3 d objects of buildings
bynetsoxx
 
Towards preservation of semantically enriched architectural knowledge
byStefan Dietze
 
Presentation nokobit
bynetsoxx
 
What's all the data about? - Linking and Profiling of Linked Datasets
byStefan Dietze
 
Quality criteria for architectural 3D data in usage and preservation processes
bylindlar
 
KnowEscape workshop, OKCon 2013
byStefan Dietze
 
DURAARK at AUdS 2015
bypanitzm
 
Grapp2014 presentation
bynetsoxx
 
Turning Data into Knowledge (KESW2014 Keynote)
byStefan Dietze
 
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...
bylindlar
 
DURAARK at IGeLU 2014
bypanitzm
 
A Domain-driven Approach to Digital Curation and Preservation of 3D Architect...
bylindlar
 
Presentation of the DURAARK project at Ex Libris conference, Berlin, Germany.
byLena Lindbäck
 
DURAARK at Bibliotheksymposium Wildau
bypanitzm
 
DURAARK presentation CIB W78 "Applications of IT in AEC" conference Beijing 2...
byJakob Beetz
 
Preservation of 3 d objects of buildings
bynetsoxx
 

Similar to A Scalable Approach for Efficiently Generating Structured Dataset Topic Profiles

PPT
euclid_linkedup WWW tutorial (Besnik Fetahu)
byBesnik Fetahu
 
PDF
Slides
byCatarina Moreira
 
PPTX
data science module-3 power point presentation
byvinuthak18
 
PDF
Projection Multi Scale Hashing Keyword Search in Multidimensional Datasets
byIRJET Journal
 
PDF
Measuring System Performance in Cultural Heritage Systems
byToine Bogers
 
PDF
IRJET- Big Data Processes and Analysis using Hadoop Framework
byIRJET Journal
 
PPTX
Towards Automatic Classification of LOD Datasets
byBlerina Spahiu
 
PDF
Towards research data knowledge graphs
byStefan Dietze
 
PDF
Building a Dataset Search Engine with Spark and Elasticsearch: Spark Summit E...
bySpark Summit
 
PDF
Data Science Provenance: From Drug Discovery to Fake Fans
byJameel Syed
 
PPTX
Profiling Linked Open Data
byBlerina Spahiu
 
PPTX
Personalizing Information Exploration with an Open User Model
byBehnam Rahdari
 
PPTX
Tools and Methods for Big Data Analytics by Dahl Winters
byMelinda Thielbar
 
PPTX
Tools and Methods for Big Data Analytics by Dahl Winters
byMelinda Thielbar
 
PPTX
Big Data Challenges and Solutions
byNew York City College of Technology Computer Systems Technology Colloquium
 
PPT
Revisiting the Multi-Criteria Recommender System of a Learning Portal
byNikos Manouselis
 
PDF
M045067275
byIJERA Editor
 
PDF
Selection of Articles using Data Analytics for Behavioral Dissertation Resear...
byPhD Assistance
 
PPTX
Ordering the chaos: Creating websites with imperfect data
byAndy Stretton
 
PDF
Survey on Software Data Reduction Techniques Accomplishing Bug Triage
byIRJET Journal
 
euclid_linkedup WWW tutorial (Besnik Fetahu)
byBesnik Fetahu
 
Slides
byCatarina Moreira
 
data science module-3 power point presentation
byvinuthak18
 
Projection Multi Scale Hashing Keyword Search in Multidimensional Datasets
byIRJET Journal
 
Measuring System Performance in Cultural Heritage Systems
byToine Bogers
 
IRJET- Big Data Processes and Analysis using Hadoop Framework
byIRJET Journal
 
Towards Automatic Classification of LOD Datasets
byBlerina Spahiu
 
Towards research data knowledge graphs
byStefan Dietze
 
Building a Dataset Search Engine with Spark and Elasticsearch: Spark Summit E...
bySpark Summit
 
Data Science Provenance: From Drug Discovery to Fake Fans
byJameel Syed
 
Profiling Linked Open Data
byBlerina Spahiu
 
Personalizing Information Exploration with an Open User Model
byBehnam Rahdari
 
Tools and Methods for Big Data Analytics by Dahl Winters
byMelinda Thielbar
 
Tools and Methods for Big Data Analytics by Dahl Winters
byMelinda Thielbar
 
Big Data Challenges and Solutions
byNew York City College of Technology Computer Systems Technology Colloquium
 
Revisiting the Multi-Criteria Recommender System of a Learning Portal
byNikos Manouselis
 
M045067275
byIJERA Editor
 
Selection of Articles using Data Analytics for Behavioral Dissertation Resear...
byPhD Assistance
 
Ordering the chaos: Creating websites with imperfect data
byAndy Stretton
 
Survey on Software Data Reduction Techniques Accomplishing Bug Triage
byIRJET Journal
 

More from Besnik Fetahu

PDF
Approaches for Improving and Enriching Textual Knowledge Bases
byBesnik Fetahu
 
PDF
Fine Grained Citation Span for References in WIkipedia
byBesnik Fetahu
 
PDF
Finding News Citations For Wikipedia
byBesnik Fetahu
 
PDF
Improving Entity Retrieval on Structured Data
byBesnik Fetahu
 
PDF
Automated News Suggestions for Populating Wikipedia Entity Pages
byBesnik Fetahu
 
PDF
How much is Wikipedia lagging behind News?
byBesnik Fetahu
 
PPT
Complex Matching of RDF Datatype Properties
byBesnik Fetahu
 
PPT
Summaries on the fly: Query-based Extraction of Structured Knowledge from Web...
byBesnik Fetahu
 
PPT
Towards Integration of Web Data into a coherent Educational Data Graph
byBesnik Fetahu
 
PPT
Combining a co-occurrence-based and a semantic measure for entity linking
byBesnik Fetahu
 
Approaches for Improving and Enriching Textual Knowledge Bases
byBesnik Fetahu
 
Fine Grained Citation Span for References in WIkipedia
byBesnik Fetahu
 
Finding News Citations For Wikipedia
byBesnik Fetahu
 
Improving Entity Retrieval on Structured Data
byBesnik Fetahu
 
Automated News Suggestions for Populating Wikipedia Entity Pages
byBesnik Fetahu
 
How much is Wikipedia lagging behind News?
byBesnik Fetahu
 
Complex Matching of RDF Datatype Properties
byBesnik Fetahu
 
Summaries on the fly: Query-based Extraction of Structured Knowledge from Web...
byBesnik Fetahu
 
Towards Integration of Web Data into a coherent Educational Data Graph
byBesnik Fetahu
 
Combining a co-occurrence-based and a semantic measure for entity linking
byBesnik Fetahu
 

Recently uploaded

PDF
Generative AI for Synthetic Tabular Data: Deep Dive into Methods, Evaluation,...
byanuradhasrivastav1
 
PDF
Composting Process, types and application methods.pdf
byAlisha Shaikh
 
PPTX
Inquiry-Approach-in-Biological-Science-ppt
bycvamaya9
 
PDF
Population Estimation and Behavioral Study of the Spotted Owl (Athene brama) ...
byMuhammad Khalid Afzal
 
PDF
Types of Nanomaterials (Dendrimers, Polymeric, Nano-Composites and QD).pdf
byAlisha Shaikh
 
DOCX
Siwes technical report done at hospital2025
bykm9056517
 
PPTX
Applications of Organometallic compounds
bysidraurooj2108
 
PPTX
VEDA ACADEMY CLASS VIII-ICSE CHEMISTRY CHAPTER 7- HYDROGEN.pptx
bynextgenhealthtech202
 
PPTX
Metabolism-Electron Transport Chain and Oxidative Phosphorylation.pptx
byDepartment of Biochemistry, Dr.N.G.P Arts and Science College, Coimbatore
 
PDF
Amino acid cost and supply chain analysis for cultivated meat
byThe Good Food Institute
 
PPTX
Measures-of-Central-Tendency- ( Biology)
bymanjimajr1
 
PPTX
Synthesis of Titanium complexes and characterisation.pdf
bygoykar167
 
PPTX
_VEDA ACADEMY CLASS VIII ICSE- CHEMISTRY CHAPTER 4- Atoms and Molecules.pptx
bynextgenhealthtech202
 
PPTX
Sustainable Landscaping with Native Ornamental Plants.pptx
bylalaghasahak4149
 
PPTX
Understanding Quorum Sensing: The Chemical Language of Bacterial Communities....
byms35791121
 
PDF
Agency phenomenon. Complexity Explorers Krakow #8
byMarcin Stepien
 
PDF
Characterization of NPs(Optical, Microscopy, XRD, DLS,NTA).pdf
byAlisha Shaikh
 
PPTX
Reproductive Hormones.pptx, Science 10 Week 3
byjhononecra
 
PPTX
Paper chromatography separation technique.pptx
byBBAU Central University, Lucknow
 
PDF
Chapter 4 Retrosynthesis_ GUIDELINES.pdf
byjennyzamora1200
 
Generative AI for Synthetic Tabular Data: Deep Dive into Methods, Evaluation,...
byanuradhasrivastav1
 
Composting Process, types and application methods.pdf
byAlisha Shaikh
 
Inquiry-Approach-in-Biological-Science-ppt
bycvamaya9
 
Population Estimation and Behavioral Study of the Spotted Owl (Athene brama) ...
byMuhammad Khalid Afzal
 
Types of Nanomaterials (Dendrimers, Polymeric, Nano-Composites and QD).pdf
byAlisha Shaikh
 
Siwes technical report done at hospital2025
bykm9056517
 
Applications of Organometallic compounds
bysidraurooj2108
 
VEDA ACADEMY CLASS VIII-ICSE CHEMISTRY CHAPTER 7- HYDROGEN.pptx
bynextgenhealthtech202
 
Metabolism-Electron Transport Chain and Oxidative Phosphorylation.pptx
byDepartment of Biochemistry, Dr.N.G.P Arts and Science College, Coimbatore
 
Amino acid cost and supply chain analysis for cultivated meat
byThe Good Food Institute
 
Measures-of-Central-Tendency- ( Biology)
bymanjimajr1
 
Synthesis of Titanium complexes and characterisation.pdf
bygoykar167
 
_VEDA ACADEMY CLASS VIII ICSE- CHEMISTRY CHAPTER 4- Atoms and Molecules.pptx
bynextgenhealthtech202
 
Sustainable Landscaping with Native Ornamental Plants.pptx
bylalaghasahak4149
 
Understanding Quorum Sensing: The Chemical Language of Bacterial Communities....
byms35791121
 
Agency phenomenon. Complexity Explorers Krakow #8
byMarcin Stepien
 
Characterization of NPs(Optical, Microscopy, XRD, DLS,NTA).pdf
byAlisha Shaikh
 
Reproductive Hormones.pptx, Science 10 Week 3
byjhononecra
 
Paper chromatography separation technique.pptx
byBBAU Central University, Lucknow
 
Chapter 4 Retrosynthesis_ GUIDELINES.pdf
byjennyzamora1200
 

A Scalable Approach for Efficiently Generating Structured Dataset Topic Profiles

  • 1.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions A Scalable Approach for Efficiently Generating Structured Dataset Topic Profiles Besnik Fetahu1 , Stefan Dietze1 , Bernardo Pereira Nunes2 , Marco Antonio Casanova2 , Davide Taibi3 , Wolfgang Nejdl1 1L3S Research Center, Leibniz Universit¨at Hannover 2Department of Informatics - PUC-Rio 3Institute for Educational Technologies, CNR May 29, 2014
  • 2.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
  • 3.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
  • 4.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data
  • 5.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains
  • 6.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets
  • 7.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets
  • 8.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets • Exhaustive techniques for data analysis
  • 9.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets • Exhaustive techniques for data analysis • Efficiency heavily dependent on information need
  • 10.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Introduction • Increasing amount of Web Data • Data heterogeneity: representation, language, quality and domains • Sparsely connected datasets • Lack of descriptive metadata about datasets • Exhaustive techniques for data analysis • Efficiency heavily dependent on information need • Ease of access and representation of datasets
  • 11.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
  • 12.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? • Growing number of datasets: 227 datasets • Data represented as triples: 31 billion triples • Multi-lingual content: 18 languages • Broad set of topics covered • Inter-dataset links Domain # Data. Triples Media 25 1,841,852,061 Geographic 31 6,145,532,484 Government 49 13,315,009,400 Publications 87 2,950,720,693 Cross-domain 41 4,184,635,715 Life sciences 41 3,036,336,004 User-generated 20 134,127,413
  • 13.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? Find datasets covering the domain of “Renewable Energy”? • Sparsity: Datasets that cover the topic? • 38 out of 228 datasets contain topic coverage information.
  • 14.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? Find datasets covering the domain of “Renewable Energy”? • Sparsity: Datasets that cover the topic? • 38 out of 228 datasets contain topic coverage information. • Scalability: Use SPARQL filter clause? • regex(*) filter clause needs to check all triples that contain a specific keyword.
  • 15.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Why dataset profiling? Find datasets covering the domain of “Renewable Energy”? • Sparsity: Datasets that cover the topic? • 38 out of 228 datasets contain topic coverage information. • Scalability: Use SPARQL filter clause? • regex(*) filter clause needs to check all triples that contain a specific keyword. • Disambiguity: What are all the possible forms of renewable energy? • solar energy, wind energy, geothermal. . .
  • 16.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
  • 17.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction
  • 18.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling
  • 19.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling 3 Entity/topic extraction
  • 20.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling 3 Entity/topic extraction 4 Profile graphs
  • 21.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Profiling Overview 1 Metadata extraction 2 Resource sampling 3 Entity/topic extraction 4 Profile graphs 5 Profiles representation
  • 22.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
  • 23.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
  • 24.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
  • 25.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Dataset Profiling Example
  • 26.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Instance and Type Extraction • Simple SPARQL SELECT queries • Avg. indexing time 10% (7min) vs. 100% (4hrs). • Approximately ∼300 million resource instances 10 100 1000 10000 100000 uriburner bluk-bnb bio2rdf-kegg-pathway nom enclator-asturias b3katlobid-resources twc-ieeevis educationalprogram ssisvu farm bio-chem bl world-bank-linked-data event-m edia eea eunishungarian-national-library-catalog bio2rdf-pubm ed linked-user-feedback oecd-linked-data bio2rdf-goa pscs-catalogue bio2rdf-genbank linkedm db bfs-linked-data bio2rdf-reactom e british-m useum -collection bio2rdf-ncbigene datos-bcn-cl l3s-dblp bio2rdf-sgd hellenic-fire-brigade Log-scaleindexingtime 100% 10%
  • 27.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Sampling Approaches Entity and Topic Extraction Resource Sampling • random: randomly select a resource instance for analysis 1 DBpedia Spotlight
  • 28.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Sampling Approaches Entity and Topic Extraction Resource Sampling • random: randomly select a resource instance for analysis • weighted: weigh a resource by the number of datatype properties used to describe it wk = |f (rk)|/max{|f (rj )|} 1 DBpedia Spotlight
  • 29.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Resource Sampling Approaches Entity and Topic Extraction Resource Sampling • random: randomly select a resource instance for analysis • weighted: weigh a resource by the number of datatype properties used to describe it wk = |f (rk)|/max{|f (rj )|} • centrality: weigh a resource by the number of types used to describe it ck = |Ck|/|C| Topic Extraction • Resources as documents by combining all textual literals • Perform NED1 and extract corresponding DBpedia entities • Extract topics as DBpedia categories from entities via dcterms:subject 1 DBpedia Spotlight
  • 30.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Constructing profiles: Dataset-topic graph 1 Profile graph nodes: datasets, resources, topics 2 Weighted graph edges: ∆ D, t 3 Edge weights: ∆ Di , t = ∆ Dj , t 4 Compute ∆ Di , t by assessing the importance of t given the resources of Di as prior knowledge 5 The given prior knowledge biases the importance of t in the profile graph towards Di 2 6 Incrementally add datasets in the profile graph, by simply computing the weights ∆ Dk , t 2 Scott White and Padhraic Smyth. 2003. Algorithms for estimating relative importance in networks. In 9th ACM SIGKDD (KDD ’03).
  • 31.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Topic Ranking Approaches Topic filtering Topic pre-filtering: NTR(t, D) = Φ(·, D) Φ(t, D) + Φ(·, ·) Φ(t, ·) • Filter noisy topics • φ(·, ·) - number of entities associated with topic t • Closely related to the tf-idf weighting scheme Topic Ranking • PageRank with Priors (PRankP) • HITS with Priors (HITSP) • K-Step Markov (KStepM)
  • 32.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
  • 33.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Experimental Setup Datasets and Ground-truth • 129 dataset from lod-cloud3 • 6 ground-truth datasets with manually assigned topic indicators for their resources Dataset Properties #Resources yovisto skos:subject, dbp:{subject, class, discipline, kategorie, tagline} 62879 oxpoints dcterms:subject,dc:subject 37258 socialsemweb-thesaurus skos:subject, tag:associatedTag, dcterms:subject 2243 semantic-web-dog-food dcterms:subject, dc:subject 20145 lak-dataset dcterms:subject, dc:subject 1691 Evaluation Metrics • NDCG@k (k=1, . . . , 1000) • Compare the induced ranking by the graphical models against the ideal ranking 3 At the time of experimentation only 129 dataset endpoints were responsive.
  • 34.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Baselines • tf-idf: Consider resources as documents. Extract for each dataset the top {50, 100, 150, 200} terms. • LDA: Consider dataset as documents4. Extract top weighted topic terms. For every dataset extract top {50, 100, 150, 200} with a number of topics {10, 20, 30, 40, 50}. 4 In this case it does not matter if datasets are considered at the resource level or aggregated.
  • 35.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions 1 Introduction 2 Problem and Motivation 3 Approach Resource Instance and Type Extraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches 4 Experimental Setup Baselines 5 Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling 6 Conclusions
  • 36.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Efficiency of Dataset Profiling 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 0.4 1 100 200 300 400 500 600 700 800 900 1000 NDCGrankingscore NDCG rank Profiling accuracy for all topic ranking approaches K-Step Markov + NTR PageRank with priors + NTR HITS with priors + NTR LDA tf-idf 0.16 0.18 0.2 0.22 0.24 0.26 0.28 0.3 0.32 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 Sample Size K-Step Markov profiling accuracy (Centrality Sampling) KStepM + NTR KStepM
  • 37.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Scalability of Dataset Profiling 100 1000 10000 0 20 40 60 80 100 0 0.05 0.1 0.15 0.2 0.25 0.3 Log-scaletimeperformance NDCGrankingscore Sample Size Time Performance vs. Profiling Accuracy HITS with priors time HITS with priors ranking K-Step Markov time K-Step Markov ranking PageRank with priors time PageRank with priors ranking • 5% and 10% already provide stable profiling accuracy • Avg. 7mins for indexing 10% of resources per dataset vs. 4hrs per dataset • 2mins for ranking dataset profiles with 10% of resources vs. 45mins for 100% • NED runtime 10% vs. 100%?
  • 38.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Motivation Example Revisited!
  • 39.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Conclusions and Future Work • Structured dataset profiles • Scalable approach through sampling • Efficient profiling through topic filtering and ranking • Incremental generation of dataset profiles • Dataset profiles as a set of links (entity and topic links) • Provenance information of links (e.g. resources from which an entity is extracted) • Profiles for dataset recommendation, search, etc. Resources • Profiles Endpoint: http://data-observatory.org/lod-profiles/sparql • Profiles Webpage: http://data-observatory.org/lod-profiles/
  • 40.
    Introduction Problem and Motivation Approach Resource Instance and TypeExtraction Resource Sampling Approaches Constructing profiles: Dataset-topic graph Topic Ranking Approaches Experimental Setup Baselines Evaluation Results Efficiency of Dataset Profiling Scalability of Dataset Profiling Conclusions Thank you! Questions? #eswc2014Fetahu