Rewrapping your data – Providing a tech savvy interface to your data

•Download as KEY, PDF•

0 likes•228 views

Markus Sköld

Presentation for ELAG 2010

Technology Education

Rewrapping your data –
Providing a tech savvy interface
to your catalogue
Helsinki June 11 2010
Markus Sköld
Senior Developer, Dept. of Audiovisual Media
National Library of Sweden
markus.skold@kb.se

Audiovisual
Media
• National Archive for Audiovisual
Material
• 1.5 TB ingested daily
• ~3 million hours digitally
available
• ~5 million hours available via
on-demand digitization

Starting point
• Functional, but not intuitive
• No searchengine indexing
• Difficult to find
• Proprietary code
• Mountains of update requests

What did we want?
• Clean and simple
• Like Google….
• Open Source
• Tiered architecture
• Ability to link directly to records

Rebuilding

Web application

Proprietary
code

Rebuilding
EW
N Web application

XML
SMDB-BUS

Socket

Why XML?
• Reformat data
• Complex structure
• Easy to handle
• Keep all nuances

photo: http://www.flickr.com/photos/intvgene/370973576/

Query Translator

BRS Query: ”Inglourious Basterds”.TIT.

Query Translator

”Google-Like”: title:”Inglourious Basterds”

BRS Query: ”Inglourious Basterds”.TIT.

Query Translator
CQL: dc.title = ”Inglourious Basterds”

”Google-Like”: title:”Inglourious Basterds”

BRS Query: ”Inglourious Basterds”.TIT.

Sorting Filter results

Statistics on your search

Tips
Discovery.

Scrollable results

Cool URIs don’t change
–Tim Berners-Lee

http://smdb.kb.se/resource/id/<number>

One unique URI for every record

> 55% traffic from Google
> 20% from referral (e.g.Wikipedia)

Open APIs
•SOAP
•REST
‣ XML
‣ JSON/JSONP
•SRU
http://www.ﬂickr.com/photos/loﬁnk/4344960203/

Content Negotiation
http://smdb.kb.se/resource/id/002573900
=>HTTP 303

http://smdb.kb.se/catalog/id/002573900.rdf

Simplicity is the ultimate
sophistication
— Leonardo da Vinci

Similar to Rewrapping your data – Providing a tech savvy interface to your data

A Semantic Web of Things (SWoT) brings together the Semantic Web and the Web of Things (WoT), associating semantically annotated information to web-enabled physical devices, services and their data, towards seamless data integration and better understanding of real-world information. A missing element in order to realize SWoT is a standardized, scalable and flexible way to globally discover in (near) real time web-connected embedded devices, as well as their semantic data. To address this gap, we propose WOT Semantic Search Engine (WOTS2E), which is a search engine for the SWoT, based on web crawling, being able to discover Linked Data endpoints and, through them, WoT-enabled devices and their services. In this presentation, we describe the design, development and implementation of WOTS2E, as well as an evaluation procedure showing its operation and performance across the web.

WOTS2E: A Search Engine for a Semantic Web of Things

Andreas Kamilaris

Skb web2.0

animove

The promise of Linked Data is not that it is another way of aggregating data. For too long have library data been trapped within data-silos only accessible through obscure protocols. Why is access to library data still an issue? Letting everyone access and link to library data lets anyone build the next killer app. LIBRIS, the Swedish Union Catalogue is, since the beginning of this year, available as Linked Data. We discuss how and why. -- Martin Malmsten & Anders Söderbäck, National Library of Sweden

Why libraries should embrace Linked Data

eby

Devoxx 2010 | LAB : ReST in Java

NGDATA

全てのエンジニアのためのWeb標準技術とのつきあい方 OSC福岡 2011版

Rikkyo University

Webofdata

Bill Roberts

History and Background of the USEWOD Data Challenge

Knud Möller

MongoDB NoSQL DBMS

Vlad Vega

IBM Cloud Day January 2021 Data Lake Deep Dive

Torsten Steinbach

Ambry : Linkedin's Scalable Geo-Distributed Object Store

Sivabalan Narayanan

Contextual Computing - Knowledge Graphs & Web of Entities

Richard Wallis

Introduction to Apache Solr

Andy Jackson

Bibliographic metadata forms have evolved over centuries, the last 50 years in machine readable formats. The library community appears to be evolving from records, towards describing real-world entities using an agreed form of linked data. Is that step a step far enough to satisfy the ever-present need to aid discovery? Discovery in the environment of the approaching twenty first century’s 3rd decade. Or do we need to include a move into the landscape of globally understood structured data and knowledge graphs? The millennial environment of answer engines, mobile/local search and voice assistants. #cilipconf19

CILIP Conference - x metadata evolution the final mile - Richard Wallis

CILIP

ESWC SS 2012 - Wednesday Tutorial Barry Norton: Building (Production) Semanti...

eswcsummerschool

Metadata - Linked Data

Richard Wallis

オープンソースカンファレンス2011 Tokyo/ Fall 講演資料「Web技術の現状と将来」

Rikkyo University

Publishing Linked Data from RDB

Boris Villazón-Terrazas

Contextual Computing: Laying a Global Data Foundation

Richard Wallis

Butler - Security Lessons Learned from an Ezproxy Admin

National Information Standards Organization (NISO)

The web is now firmly established as the primary communication and publication platform for sharing and accessing social and cultural materials. This networked world has created both opportunities and pitfalls for libraries and archives in their mission to preserve and provide ongoing access to knowledge. How can the affordances of the web be leveraged to drastically extend the plurality of representation in the archive? What challenges are imposed by the intrinsic ephemerality and mutability of online information? What methodological reorientations are demanded by the scale and dynamism of machine-generated cultural artifacts? This talk will explore the interplay of the web, contemporary historical records, and the programs, technologies, and approaches by which libraries and archives are working to extend their mission to preserve and provide access to the evidence of human activity in a world distinguished by the ubiquity of born-digital materials. Information Science Brown Bag talks, hosted by the Program on Information Science, consists of regular discussions and brainstorming sessions on all aspects of information science and uses of information science and technology to assess and solve institutional, social and research problems. These are informal talks. Discussions are often inspired by real-world problems being faced by the lead discussant.

SAFETY NETS: RESCUE AND REVIVAL FOR ENDANGERED BORN-DIGITAL RECORDS- Program ...

Micah Altman

Similar to Rewrapping your data – Providing a tech savvy interface to your data (20)

WOTS2E: A Search Engine for a Semantic Web of Things

Skb web2.0

Why libraries should embrace Linked Data

Devoxx 2010 | LAB : ReST in Java

全てのエンジニアのためのWeb標準技術とのつきあい方 OSC福岡 2011版

Webofdata

History and Background of the USEWOD Data Challenge

MongoDB NoSQL DBMS

IBM Cloud Day January 2021 Data Lake Deep Dive

Ambry : Linkedin's Scalable Geo-Distributed Object Store

Contextual Computing - Knowledge Graphs & Web of Entities

Introduction to Apache Solr

CILIP Conference - x metadata evolution the final mile - Richard Wallis

ESWC SS 2012 - Wednesday Tutorial Barry Norton: Building (Production) Semanti...

Metadata - Linked Data

オープンソースカンファレンス2011 Tokyo/ Fall 講演資料「Web技術の現状と将来」

Publishing Linked Data from RDB

Contextual Computing: Laying a Global Data Foundation

Butler - Security Lessons Learned from an Ezproxy Admin

SAFETY NETS: RESCUE AND REVIVAL FOR ENDANGERED BORN-DIGITAL RECORDS- Program ...

Recently uploaded

MINDCTI Revenue Release Quarter One 2024

MIND CTI

In the thrilling conclusion to 2023, ransomware groups had a banner year, really outdoing themselves in the "make everyone's life miserable" department. LockBit 3.0 took gold in the hacking olympics, followed by the plucky upstarts Clop and ALPHV/BlackCat. Apparently, 48% of organizations were feeling left out and decided to get in on the cyber attack action. Business services won the "most likely to get digitally mugged" award, with education and retail nipping at their heels. Hackers expanded their repertoire beyond boring old encryption to the much more exciting world of extortion. The US, UK and Canada took top honors in the "countries most likely to pay up" category. Bitcoins were the currency of choice for discerning hackers, because who doesn't love untraceable money?

Ransomware_Q4_2023. The report. [EN].pdf

Overkill Security

ICT role in 21st century education and its challenges

rafiqahmad00786416

The Good, the Bad and the Governed - Why is governance a dirty word? David O'Neill, Chief Operating Officer - APIContext Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

apidays

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Exploring Multimodal Embeddings with Milvus

Zilliz

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Keynote 2: APIs in 2030: The Risk of Technological Sleepwalk Paolo Malinverno, Growth Advisor - The Business of Technology Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

apidays

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

The action of the next cyber saga takes place in the mystical lands of the Asia-Pacific region, where the main characters began their digital activities in the middle of 2021 and qualitatively strengthened it in 2022. Corporate espionage, document theft, audio recordings, and data leaks from messaging platforms were all a matter of one day for Dark Pink. Their geographical focus may have started in the Asia-Pacific region, but their ambitions knew no bounds, targeting a European government ministry in a bold move to expand their portfolio. Their victim profile was as diverse as a UN meeting, targeting military organizations, government agencies, and even a religious organization. Because discrimination is not a fashionable agenda. In the world of cybercrime, they serve as a reminder that sometimes the most serious threats come in the most unassuming packages with a pink bow.

Cyberprint. Dark Pink Apt Group [EN].pdf

Overkill Security

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

[BuildWithAI] Introduction to Gemini.pdf

Sandro Moreira

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Zilliz

Recently uploaded (20)

MINDCTI Revenue Release Quarter One 2024

Ransomware_Q4_2023. The report. [EN].pdf

ICT role in 21st century education and its challenges

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

FWD Group - Insurer Innovation Award 2024

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Exploring Multimodal Embeddings with Milvus

presentation ICT roal in 21st century education

Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...

Boost Fertility New Invention Ups Success Rates.pdf

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Cyberprint. Dark Pink Apt Group [EN].pdf

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

[BuildWithAI] Introduction to Gemini.pdf

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Artificial Intelligence Chap.5 : Uncertainty

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Rewrapping your data – Providing a tech savvy interface to your data

1. Rewrapping your data – Providing a tech savvy interface to your catalogue Helsinki June 11 2010 Markus Sköld Senior Developer, Dept. of Audiovisual Media National Library of Sweden markus.skold@kb.se

2. Audiovisual Media • National Archive for Audiovisual Material • 1.5 TB ingested daily • ~3 million hours digitally available • ~5 million hours available via on-demand digitization

3. Starting point • Functional, but not intuitive • No searchengine indexing • Difficult to find • Proprietary code • Mountains of update requests

4. What did we want? • Clean and simple • Like Google…. • Open Source • Tiered architecture • Ability to link directly to records

5. Rebuilding Web application Proprietary code

6. Rebuilding Web application

7. Rebuilding Web application SMDB-BUS

8. Rebuilding EW N Web application XML SMDB-BUS Socket

9. Why XML? • Reformat data • Complex structure • Easy to handle • Keep all nuances photo: http://www.flickr.com/photos/intvgene/370973576/

10. Query Translator BRS Query: ”Inglourious Basterds”.TIT.

11. Query Translator ”Google-Like”: title:”Inglourious Basterds” BRS Query: ”Inglourious Basterds”.TIT.

12. Query Translator CQL: dc.title = ”Inglourious Basterds” ”Google-Like”: title:”Inglourious Basterds” BRS Query: ”Inglourious Basterds”.TIT.

13. One response XML

14. One response XML +XSLT

15. One response XML +XSLT =whatever

16.

17. Sorting Filter results Statistics on your search Tips Discovery. Scrollable results

18. Cool URIs don’t change –Tim Berners-Lee http://smdb.kb.se/resource/id/<number> One unique URI for every record

19.

20. > 55% traffic from Google > 20% from referral (e.g.Wikipedia)

21. Open APIs •SOAP •REST ‣ XML ‣ JSON/JSONP •SRU http://www.ﬂickr.com/photos/loﬁnk/4344960203/

22. Linked Open Data

23. Harvesting links through open APIs

24. Harvesting links through open APIs

25.

26. Content Negotiation http://smdb.kb.se/resource/id/002573900 =>HTTP 303

27. http://smdb.kb.se/catalog/id/002573900

28. http://smdb.kb.se/catalog/id/002573900.rdf

29. Simplicity is the ultimate sophistication — Leonardo da Vinci

Rewrapping your data – Providing a tech savvy interface to your data

Recommended

Recommended

More Related Content

Similar to Rewrapping your data – Providing a tech savvy interface to your data

Similar to Rewrapping your data – Providing a tech savvy interface to your data (20)

Recently uploaded

Recently uploaded (20)

Rewrapping your data – Providing a tech savvy interface to your data

Editor's Notes