Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Topic-based Federated Query Engine: A LDA-based Approach for Distributed Query Processing
Similar to Topic-based Federated Query Engine: A LDA-based Approach for Distributed Query Processing (20)
Recently uploaded
Recently uploaded (20)
Topic-based Federated Query Engine: A LDA-based Approach for Distributed Query Processing
- 2. CONTEXT AND PROBLEM STATEMENT
- 3. CONTEXT AND PROBLEM STATEMENT
- 4. RELATED WORK Federated Service Endpoint Query Engine - Code Avalable FedX SPLENDID DARQ CostFed LHD ANAPSID ADERIS Code Avalability YES (java- jar) YES (java, scala) YES (java) YES (python) YES (java) YES (python) YES (java) LAST UPDATE 2016 2011 2006 2018 2013 2013 N.D. SERVICE Sparql Clause support yes NO yes No yes No SOURCE SELECTION query (ASK) query (ASK), index, Sparql service descriptor, VoID index (sparql service descriptor) index, query cost estimation based on selectivity query (ASK), index, Sparql service descriptor, VoID query (ASK), index index JOIN TYPE nested loop, bind hash, bind nested loop, bind bound, symmetric hash join hash, bind adaptive Index based nested loop CACHE YES (ASK history) YES NO NO NO NO NO
- 6. TOPIC FEDERATED QUERY ENGINE
- 10. LDA BASED INDEX DTD1 DTD2 DTD3 DTD4 IRIs IRIs IRIs
- 11. SOURCE SELECTION STRATEGIES …. …. DTDDi …. …. DTDDi …. …. DTDDi …. …. DTDDi * QTD Tx Ty Tz …. …. QTD …. …. QTD …. …. QTD BEST STRATEGY ALL STRATEGY ALL FILTERED STRATEGY K-MEANS STRATEGY K=2 threshold threshold Centroid 1 Centroid 2 For some pattern Tx Ty Tz Tx Ty Tz Tx Ty Tz Tx Ty Tz Tx Ty Tz Dm Dn Do Dp Di Cluster delimitation
- 12. THE BEST STRATEGY SELECT *WHERE { } BEST ALL ALL-FILT. K-MEANS Triple-pattern1 Ty Triple-pattern2 Ty Triple-pattern3 Ty Triple-pattern4 Ty …. …. DTDDi Tx Ty Tz …. …. QTD BEST STRATEGY Tx Ty Tz
- 13. THE ALL STRATEGY SELECT *WHERE { } BEST ALL ALL-FILT. K-MEANS Triple-pattern1 Ty Ty Tz Triple-pattern2 Ty Ty Tz Triple-pattern3 Ty Ty Tz Triple-pattern4 Ty Ty Tz …. …. …. DTDDi …. …. QTD ALL STRATEGY threshold Tx Ty Tz Tx Ty Tz
- 14. THE ALL-FILTERED STRATEGY SELECT *WHERE { } BEST ALL ALL-FILT. K-MEANS Triple-pattern1 Ty Ty Tz Ty Tz Triple-pattern2 Ty Ty Tz Ty Tz Triple-pattern3 Ty Ty Tz Ty Triple-pattern4 Ty Ty Tz Ty …. …. DTDDi …. …. QTD ALL FILTERED STRATEGY threshold For some pattern Tx Ty Tz Tx Ty Tz
- 15. THE K-MEANS STRATEGY SELECT *WHERE { } BEST ALL ALL-FILT. K-MEANS Triple-pattern1 Ty Ty Tz Ty Tz Dn Dp Triple-pattern2 Ty Ty Tz Ty Tz Dn Dp Triple-pattern3 Ty Ty Tz Ty Dn Dp Triple-pattern4 Ty Ty Tz Ty Dn Dp …. …. DTDDi * QTD K-MEANS STRATEGY K=2 Centroid 1 Centroid 2 Dm Dn Do Dp Di Cluster delimitation
- 16. DATASET-QUERY TOPIC MATCHING SELECT *WHERE { } BEST ALL ALL-FIL. K-MEANS Triple-pattern1 Dn Ty Tz Ty Tz Dn Dp Triple-pattern2 Dn Ty Tz Ty Tz Dn Dp Triple-pattern3 Dn Ty Tz Ty Dn Dp Triple-pattern4 Dn Ty Tz Ty Dn Dp BEST STRATEGY
- 17. DATASET-QUERY TOPIC MATCHING (2) SELECT *WHERE { } BEST ALL ALL-FIL. K-MEANS Triple-pattern1 Dn Dn Do Dp Ty Tz Dn Dp Triple-pattern2 Dn Dn Do Dp Ty Tz Dn Dp Triple-pattern3 Dn Dn Do Dp Ty Dn Dp Triple-pattern4 Dn Dn Do Dp Ty Dn Dp ALL STRATEGY
- 18. DATASET-QUERY TOPIC MATCHING (3) SELECT *WHERE { } BEST ALL ALL-FIL. K-MEANS Triple-pattern1 Dn Dn Do Dp Dn Do Dp Dn Dp Triple-pattern2 Dn Dn Do Dp Dn Do Dp Dn Dp Triple-pattern3 Dn Dn Do Dp Dn Dn Dp Triple-pattern4 Dn Dn Do Dp Dn Dn Dp ALL FILTERED STRATEGY
- 19. SELECT * WHERE { } BEST ALL ALL-FILTERED K-MEANS Triple-pattern1 Sn Sn So Sp Sn So Sp Sn Sp Triple-pattern2 Sn So Sp Sn So Sp Sn Sp Triple-pattern3 Sn So Sp Sn Sn Sp Triple-pattern4 Sn So Sp Sn Sp SERVICE SUBSTITUTION - AGGREGATION
- 20. QUERY EXAMPLE
- 21. THE BENCHMARK
- 22. RESULTS
- 23. RESULTS (2)
- 24. RESULTS (3)
- 25. CONCLUSION
- 26. THANK YOU FOR YOUR ATTENTION! ANY QUESTION? Topic-based Federated Query Engine