TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker

•

0 likes•1,052 views

TwoRavens is a gesture-based web application that allows users to easily explore, analyze, and conduct interactive statistical modeling on tabular data files stored in Harvard's Dataverse, which contains nearly 25,000 datasets. It provides easy access to descriptive statistics and uses a directed graph interface for statistical modeling. The application is browser-based, device independent, and does not require any statistical expertise. Future directions include automated statistical model selection, accumulating user results, and an interface for curator privacy models.

TwoRavens
A Graphical, Browser-Based Statistical Interface
for Data Repositories
Vito D’Orazio and James Honaker
Data Science
Institute for Quantitative Social Science
Harvard University
June 11, 2015

TwoRavens
• Gesture-based web application
• Explore and analyze tabular data ﬁles
Nearly 25,000 on Harvard’s Dataverse

TwoRavens
• Gesture-based web application
• Explore and analyze tabular data ﬁles
Nearly 25,000 on Harvard’s Dataverse
• Easy access to descriptive statistics
• Interactive statistical modeling using the language of
directed graphs

Design Principles
• Browser-based, thin client
Data are never local
Metadata are pulled client-side
Dataverse’s DDI metadata
TwoRavens’ generated metadata
Data are pulled server-side
• Device independent and broadly accessible
Only requires an internet connection
Does not presuppose expert statistical knowledge or
experience with statistical software

http://datascience.iq.harvard.edu/about-tworavens

Future Directions
1. Automated Statistical Model Selection

Future Directions
1. Automated Statistical Model Selection
2. Accumulation of User Results

Future Directions
1. Automated Statistical Model Selection
2. Accumulation of User Results
3. Interface for Curator Privacy Model

Private
Data
Curator
PUser
PUser
PUser
q1
p1
q2
p2
p3
q3
Figure: The curator architecture for data privacy.

TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker

This document summarizes an OpenAIRE stakeholder workshop that took place in Athens on May 21-22, 2018. OpenAIRE supports open science by monitoring research outputs, accelerating interoperability and exchange, and supporting researchers and infrastructure providers through services like an open science helpdesk and research data management support. The workshop discussed OpenAIRE's network of National Open Access Desks, services to support open policies, infrastructure, open research data and open access publications, and efforts to build an open scholarly communication graph and research information system. OpenAIRE also presented services for content providers like the PROVIDE Dashboard for validation, enrichment and usage statistics of metadata.

RDAP 16 Lightning: Quantifying Needs for a University Research Repository Sys...

ASIS&T

2014-02-27 Wikidata talk Cambridge

Magnus Manske

Wikidata is a free knowledge base launched in 2012 by Wikimedia Deutschland to centralize key data about items and serve as an interlinked database representing the sum of human knowledge. It contains over 14 million items with 30 million statements in multiple languages and data types. Wikidata is currently in Phase 2 where statements about items are being added and can be accessed through its API and tools like WikiData Query and Reasonator to visualize and explore the data.

S4: The Self-Service Semantic Suite

Marin Dimitrov

The document discusses Ontotext's Self-Service Semantic Suite (S4), which aims to address challenges customers face around unlocking insights from text and data, creating dynamic content, and integrating data sources. S4 provides semantic technology as a self-service set of pay-per-use services for text analytics, content enrichment, and metadata management using RDF graphs and ontologies. This approach aims to make semantic technology easier to adopt with lower costs and risks than traditional options.

Anila Angjeli. "ISNI & VIAF" Presentation at the Workshop on Persistent Ident...

AnilaAngjeli

Enabling Low-cost Open Data Publishing and Reuse

Marin Dimitrov

In the space of just a few years we’ve seen the transformational power of open data; both for transparency and accountability in public data, and efficiency and innovation with businesses in private data. In its first year, institutions and individuals throughout Europe have supported public sector bodies in releasing data and numerous start-ups, developers and SMEs in reusing this data for economic benefit. However, we are still at the beginning of the open data movement, and there is still more that can be done to make open data simpler to use and to make it available to a wider audience. The core goal of the DaPaaS project is to provide a Data- and Platform-as-a-Service environment, where 3rd parties (such as governmental organisations, SMEs, developers and larger companies) can publish and host both data sets and data-intensive applications, which can then be accessed by end-user applications in a cross-platform manner. You can find out more about DaPaaS on the detailed about page. Essentially, DaPaaS aims to make publishing, consumption, and reuse of open data, as well as deploying open data applications, easier and cheaper for SMEs and small public bodies which otherwise may not have sufficient technical expertise, infrastructure and resources required to do so. see also http://www.slideshare.net/eswcsummerschool/wed-roman-tutopendatapub-38742186

Deployment of rd_fa_microdata_microformats_on_the_web

STIinnsbruck

This document summarizes the results of a study analyzing the adoption of RDFa, Microdata, and Microformats on over 3 billion web pages: - RDFa was found on 369 million pages within 2.29 million domains, Microdata on 298 million pages within 1.44 million domains, and Microformats on 35 million pages within 623,000 domains. - Popular domains using each format included IMDB, BBC and Microsoft for RDFa, eBay, Microsoft and Apple for Microdata, and Wikipedia, Adobe and Taobao for Microformats. - Most websites only used one format, with people, organizations, blog metadata, navigation and products being popular topics represented across formats, and

Adoption and Integration of Persistent Identifiers in European Research Infor...

LIBER Europe

This document discusses tools and methods for data curation developed by the ALIGNED project. It aims to improve productivity, agility, and quality in curating datasets. The ALIGNED tools support various stages of the data lifecycle including validation, integration, curation, publishing linked data, and ensuring data quality. The document presents the Dacura data curation process and several ALIGNED tools, and highlights their use in real-world data systems including a global history databank. It invites businesses working with data-intensive applications to utilize the ALIGNED consultancy program.

The GND initiative 2017-2021: Developing a Backbone for the Web of Cultural a...

LIBER Europe

Wikidata & dbpedia

Gerard Meijssen

Wikidata and DBpedia have potential for collaboration. Wikidata is a structured data project used in Wikimedia projects, intended to be practical and populate info boxes and interwiki links. It is community developed and supports all languages. Reasonator visualizes and formats Wikidata content using its API. While Wikidata and DBpedia currently link to each other's data, there is opportunity for DBpedia to research Wikidata data and help validate and curate it, now that Wikidata handles more data storage and curation. Both projects would benefit from sharing research results to improve and use each other's data.

Barcelona 2014: CrossRef CrossCheck by Rachael Lammey

Crossref

This document summarizes CrossRef's plagiarism checking service CrossCheck. It notes that CrossCheck was launched in 2008 as a pilot with seven publishers. CrossCheck indexes over 38.9 million articles from 555 publishers to check submissions against for plagiarism using iThenticate software. CrossCheck receives over 100,000 manuscripts per month to check and engages publishers through user groups, conferences, webinars and a mailing list for participation and feedback. Pricing includes an annual administrative fee and per-document checking fees.

3rd DBpedia Community Meeting - ALIGNED

odhrangavin

This document summarizes a presentation about the ALIGNED project, which received funding from the European Union's Horizon 2020 program. The project aims to develop new methods for parallel software and data engineering of web-scale information systems using Linked Data. It will support the evolution of software that depends on heterogeneous data with an independent lifecycle. The project involves partners from universities and companies and will last from 2015 to 2018.

Challenges in Managing Online Business Communities

Thomas Gottron

- Online business communities are a valuable asset for companies like SAP and IBM, but require appropriate metrics to manage their large scale and high volumes of activity. - Effective metrics track content, structure, behavior, and dynamics of the communities over time to understand risk and inform management strategies. - A framework is needed that embeds various metrics into a comprehensive approach for monitoring community risks and developing treatment plans.

Linked Data: from Library Entities to the Web of Data

Richard Wallis

Using your Data to Drive Revenue – Laura Cox at London Book Fair 2018

Ringgold Inc

Laura Cox, Ringgold Chief Financial and Operating Officer, chaired this session at London Book Fair 2018 on 10 April. The session featured expert speakers across several types of publishing data and gave practical advice including: How to utilise the information held about customers How to use taxonomies to help improve search and discovery How to evaluate technologies that will help organisations make the most of their content through effective storage and semantic exploitation More details: https://www.londonbookfair.co.uk/en/Sessions/58553/Use-your-Data-to-Drive-Revenue

Knowledge Management in Acquisitions

Xan Arch

Spending the time to create a central organized resource for Acquisitions information greatly improves the ability of users to find information efficiently. This translates into more time for staff to do their work and greater satisfaction overall. So how can we create a better platform for Acquisitions information? After looking at the landscape of knowledge management tools in the Stanford Libraries Acquisitions department, I identified structure, linking, multimedia, and personality as qualities that were needed in a new resource. Focusing on these four methods of presenting information allowed us to create a resource that is efficient and pleasing to use. As the resource evolved, we found three major categories of information to manage: staff, management, and outreach from Acquisitions to other groups.

Linked open data, its realization

Seonho Kim

British Library Linked Open Data Presentation for ALA June 2014

nw13

The document summarizes the British Library's experience in providing linked open data. It describes why the library offers linked data, what data is offered, and lessons learned. Key points include: the library offers metadata in various formats including RDF/XML and CSV to promote innovation, migration to standards, and collaboration; their linked data program has over 1,000 user organizations and 2 million transactions monthly; and lessons learned include understanding diverse user needs, continually improving data quality, and maintaining funding through measurable impact.

Project MILDRED: Charting Ground for Research Data Management Services at Uni...

Mari Elisa Kuusniemi

NIH BD2K bioCADDIE DataMed: Data Discovery Index

Susanna-Assunta Sansone

This document summarizes the work of developing a Data Discovery Index prototype that helps users find and access shared biomedical data from various repositories. It ingests metadata from different standards and sources using ElasticSearch. It was presented at the Alan Turing Institute Symposium in April 2016. The project aims to organize data through an aggregator framework and portal. It involves mapping various metadata standards to have maximum coverage of use cases with minimal data elements. More information can be found at the listed websites.

Lju Lazarevic

Connected Data World

Graph databases are based on graph theory and use nodes and relationships to store data. They are a type of property graph database that can scale easily. Graph databases are well-suited for applications that rely on relationships between data, need to find patterns in behavioral data, or require linking disparate data sources. Specifically, they are effective for fraud detection by identifying patterns across entities, providing a 360-degree view of customers by linking their various profiles and activities, and making recommendations by leveraging connections in user data.

Ag Data Commons: Adding Value to open agricultural research data

Cyndy Parr

SGCI and Globus: Partners for Acceleration of Science

Globus

2013 CrossRef Workshops Boot Camp CrossCheck Susan Collins

Crossref

CrossCheck is a plagiarism detection service launched in 2008 by CrossRef that uses iThenticate software to compare submitted texts against a database of published content from over 500 participating publishers. The service indexes publisher content to check for plagiarism, producing similarity reports that show matching text and its source to help determine if plagiarism occurred. It aims to help publishers identify plagiarized material in submitted works rather than serving as a general plagiarism detection tool.

COUNTER Standards for Open Access: The Value of Measuring/The Measuring of Va...

LIBER Europe

Congress text-mining-event

Ian Milligan

Applying and Extending Semantic Wikis for Semantic Web Courses

Open University in the Netherlands

This work describes the application of semantic wikis in distant learning for Semantic Web courses. The resulting system focuses its application of existing and new wiki technology in making a wiki-based interface that demonstrates Semantic Web features. A new layer of wiki technology, called “OWL Wiki Forms” is introduced for this Semantic Web functionality in the wiki interface. This new functionality includes a form-based interface for editing Semantic Web ontologies. The wiki then includes appropriate data from these ontologies to extend existing wiki RDF export. It also includes ontology-driven creation of data entry and browsing interfaces for the wiki itself. As a wiki, the system provides the student an educational tool that students can use anywhere while still sharing access with the instructor and, optionally, other students. Lloyd Rutledge and Rineke Oostenrijk. Applying and Extending Semantic Wikis for Semantic Web Courses, In: Proceedings of the 1st International Workshop on eLearning Approaches for the Linked Data Age (Linked Learning 2011) at the 8th Extended Semantic Web Conference (ESWC 2011), Heraklion, Greece, May 29th, 2011. http://sunsite.informatik.rwth-aachen.de/Publications/CEUR-WS/Vol-717/paper9.pdf

Broadband Network Presentation

Muhammad Faisal

Banking awareness 2014

sanu

What's hot

ALIGNED Data Curation Methods and Tools

AlignedProject

The GND initiative 2017-2021: Developing a Backbone for the Web of Cultural a...

LIBER Europe

Wikidata & dbpedia

Gerard Meijssen

Barcelona 2014: CrossRef CrossCheck by Rachael Lammey

Crossref

3rd DBpedia Community Meeting - ALIGNED

odhrangavin

Challenges in Managing Online Business Communities

Thomas Gottron

Linked Data: from Library Entities to the Web of Data

Richard Wallis

Using your Data to Drive Revenue – Laura Cox at London Book Fair 2018

Ringgold Inc

Knowledge Management in Acquisitions

Xan Arch

Linked open data, its realization

Seonho Kim

British Library Linked Open Data Presentation for ALA June 2014

nw13

Project MILDRED: Charting Ground for Research Data Management Services at Uni...

Mari Elisa Kuusniemi

NIH BD2K bioCADDIE DataMed: Data Discovery Index

Susanna-Assunta Sansone

Lju Lazarevic

Connected Data World

Ag Data Commons: Adding Value to open agricultural research data

Cyndy Parr

SGCI and Globus: Partners for Acceleration of Science

Globus

2013 CrossRef Workshops Boot Camp CrossCheck Susan Collins

Crossref

COUNTER Standards for Open Access: The Value of Measuring/The Measuring of Va...

LIBER Europe

Congress text-mining-event

Ian Milligan

Applying and Extending Semantic Wikis for Semantic Web Courses

Open University in the Netherlands

What's hot (20)

ALIGNED Data Curation Methods and Tools

The GND initiative 2017-2021: Developing a Backbone for the Web of Cultural a...

Wikidata & dbpedia

Barcelona 2014: CrossRef CrossCheck by Rachael Lammey

3rd DBpedia Community Meeting - ALIGNED

Challenges in Managing Online Business Communities

Linked Data: from Library Entities to the Web of Data

Using your Data to Drive Revenue – Laura Cox at London Book Fair 2018

Knowledge Management in Acquisitions

Linked open data, its realization

British Library Linked Open Data Presentation for ALA June 2014

Project MILDRED: Charting Ground for Research Data Management Services at Uni...

NIH BD2K bioCADDIE DataMed: Data Discovery Index

Lju Lazarevic

Ag Data Commons: Adding Value to open agricultural research data

SGCI and Globus: Partners for Acceleration of Science

2013 CrossRef Workshops Boot Camp CrossCheck Susan Collins

COUNTER Standards for Open Access: The Value of Measuring/The Measuring of Va...

Congress text-mining-event

Applying and Extending Semantic Wikis for Semantic Web Courses

Viewers also liked

Broadband Network Presentation

Muhammad Faisal

Banking awareness 2014

sanu

Process assessment sample

Dynamic Systems

This document provides a process flow assessment and recommendations for implementing a bar code system at ABC Company. It analyzes the company's current material and data flows, identifies areas for improvement, and outlines a phased implementation plan. Recommendations include better utilizing existing manufacturing software, implementing process changes to facilitate bar code use, investing in new data collection hardware, and integrating bar codes across receiving, quality control, production, shipping and other functions to gain accuracy, productivity and cost savings.

Karlovy Vary Part I

Dmitriy Stepanov

3.бг draft contractPazardzik, Pazardzhik, Bulgaria

Neoliberalismoyeducacin 120104164359 phpapp01

geraldine rachely guerrero martinez

Este documento discute el impacto del neoliberalismo en la educación en América Latina. El neoliberalismo promueve una educación centrada en la eficiencia, eficacia y rentabilidad para satisfacer las necesidades del mercado laboral. Esto ha llevado a recortes presupuestarios en educación pública, una visión economicista de la educación como inversión, y una priorización de carreras técnicas sobre las humanidades y ciencias sociales. Críticos argumentan que esta visión reduce la educación a una mercancía y promueve

Tag You’re it! Creating Cross Curricular Teams from Scratch

ccpc

Laurie Hayes Biomedicine Science Teacher Center for Advanced Research and Technology (CART) Clovis, CA Josh Olson Biomedicine Science Teacher Center for Advanced Research and Technology (CART) Clovis, CA Courtney Somers Law Government Teacher Center for Advanced Research and Technology (CART) Clovis, CA You have been chosen to be a part of a cross curricular team. Now what! This presentation gives participants the tools they can use to begin creating their cross curricular teams. Discover new ways of using technology that make cross curricular planning easier and more effective.

Gimnazjum Szesciokoloweguest86d246

eagles group

pavan9

This document discusses wikis, including what they are, how they work, and their benefits. Some key points: - A wiki is a type of website that allows users to easily add, edit, and modify content collaboratively using just a web browser. It aims to be the simplest online database possible. - Wikis allow for quick and easy collaboration on content. They are useful for knowledge sharing and building on ideas. Wikis also make it easy to view and revert changes. - Popular wikis include Wikipedia, Simple Wikipedia, and Wikiversity. Wikis differ from blogs in that they are collaboratively edited while blogs grow through individual posts. - Benefits of wikis include their ability

Pres generale strutturaKawashiyma

Happy Independence Day (Vande Matram)

HashPro Technologies

3 Must-Know Details About Automation Testing

QASource

The document discusses three key details about automation testing: 1) Automation helps shorten release cycles and streamline UI updates by automating repetitive tests. 2) Automation is common thanks to open source tools and skilled engineers in the QA industry. 3) The document answers the top three questions about automation testing: what are best practices for creating an automation framework, what factors to consider when choosing an automation tool, and what the best tools are for different types of automation.

Tecnologias y sus multiples relaciones

CRISTIAN FELIPE BOTINA AZA

El documento trata sobre la relación entre la tecnología y la humanidad. Explica que la tecnología es necesaria para resolver problemas y satisfacer necesidades, y que ha llevado al desarrollo de procesos cognitivos, creativos y de pensamiento crítico. También discute que la ética de la tecnología implica un acceso equitativo a sus beneficios. Luego, proporciona ejemplos históricos de importantes inventos tecnológicos como el teléfono, la rueda, la televisión, la imprenta

Diapositiva 3

Aarón Carballo

Osallistuva budjetointi - Kontula 25.10.2012avantoinsight

Métodos anticonceptivos

Erika Barajas Leyva

Lingkaran

Silvia Andriani

Symposion 2016 - Il gusto della responsabilità

AskesisSrl

SYMPOSION È UN PROGETTO INTERAZIENDALE DEDICATO A TUTTI COLORO CHE DESIDERANO APPROFONDIRE, ATTRAVERSO UNA MODALITÀ ANTICA E NUOVA INCENTRATA SUL PIACERE DEL CONFRONTO E DELLA CONVIVIALITÀ, LE PROPRIE CONOSCENZE I IN MERITO AD ALCUNI DEI PRINCIPALI AMBITI DEL NOSTRO AGIRE QUOTIDIANO. QUEST’ANNO SI TERRÀ IL 20 OTTOBRE 2016 E ABBIAMO DECISO DI PORRE L’ACCENTO SUL TEMA DELLA RESPONSABILITÀ, CRUCIALE E TRASVERSALE PER OGNUNO DI NOI IN QUALSIASI FASE O CAMPO DELLA NOSTRA VITA E/O ATTIVITÀ.

Paul Massen

ActiveCitizen

The document discusses an Open Government Partnership meetup in Ireland on open data. It provides an overview of the OGP, including its origins and focus on empowering civil society. It also outlines Ireland's current status with the OGP as eligible but not yet a member, and reviews the expectations and eligibility criteria for OGP membership. The meetup aimed to discuss these topics and Ireland's potential involvement in the OGP.

Viewers also liked (19)

Broadband Network Presentation

Banking awareness 2014

Process assessment sample

Karlovy Vary Part I

3.бг draft contract

Neoliberalismoyeducacin 120104164359 phpapp01

Tag You’re it! Creating Cross Curricular Teams from Scratch

Gimnazjum Szesciokolowe

eagles group

Pres generale struttura

Happy Independence Day (Vande Matram)

3 Must-Know Details About Automation Testing

Tecnologias y sus multiples relaciones

Diapositiva 3

Osallistuva budjetointi - Kontula 25.10.2012

Métodos anticonceptivos

Lingkaran

Symposion 2016 - Il gusto della responsabilità

Paul Massen

Similar to TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker

Smart Data Applications powered by the Wikidata Knowledge Graph

Peter Haase

This document discusses Wikidata and how it can power smart data applications. Wikidata is a large, structured, collaborative knowledge graph containing over 15 million entities. It collects data in a structured form from Wikipedia pages and can be queried like a database using the Wikidata Query Service. The document promotes metaphacts, an enterprise knowledge graph platform that can be used to build applications using Wikidata, enrich Wikidata with private data, and enable companies to build and leverage their own knowledge graphs for various domains such as cultural heritage and pharma.

Developing a library-based data visualization service

Douglas Joubert

The NIH Library is developing a data visualization service including tools, training, and support. Their DataViz Team consists of experts in graphic design, network visualization, R, GIS mapping, and data analysis. They offer various training classes on tools like R, ggplot2, Excel, and Gephi. They also evaluate their services through surveys of users and tracking consultations to help develop additional trainings and support data visualization needs at NIH and HHS.

Linked Services for the Web of Data

Carlos Pedrinaci

This document discusses linking services and data on the web. It notes that while semantic web service ontologies were proposed, they failed to gain adoption. Web APIs have become more widely used as they are public, reusable, and have business models. However, their semantics and data formats are often unclear. The document proposes "linked services" - services described as linked data to provide reusable functionality for linked data applications. It presents tools and infrastructure to support finding, composing, and invoking linked services. Linked services could help make traditional services more accessible and applicable by expressing them using existing web vocabularies.

Contextual Computing - Knowledge Graphs & Web of Entities

Richard Wallis

Richard Wallis gave a presentation on contextual computing and knowledge graphs at the SmartData 2017 conference. He discussed how knowledge graphs powered by structured data on the web are providing global context that enables new applications of cognitive and contextual computing. Schema.org plays a key role by defining a common vocabulary and enabling a web of related entities laid out as a global graph. This graph of entities delivers context on a global scale and lays the foundation for the next revolution in computing.

SCA2013 Presentation: A Web-Based Content Analysis Tool

Xin Chen

Linked Data Overview - structured data on the web for US EPA 20140203

3 Round Stones

The document provides an overview of linked open data and the EPA's efforts to publish its environmental data as linked open data. It discusses the need for improved data platforms to share integrated environmental data. Linked open data uses international standards to publish and connect data on the web, providing context and allowing for improved access and reuse of data. The EPA publishes a large amount of data in CSV files and is now moving to a cloud-based linked open data system to publish facility, chemical, and pollution reports, making the data more reusable and helping more types of audiences use the data.

Integer8 - Visual Integration on Hadoop

Ahmet Yavuz Barutcu

At the end of 2+ year-hardwork, we designed Integer8-Visual Integration Software for companies to be more productive while processing big data. We combine Spark, Yarn, Hive and HDFS together and we create a web-based enterprise level data integration platform on which developers can easily create ETL and integration flows by drag&drop. By the help of this infrastructure, developers do not need to know all details about Hadoop/map-reduce and other Hadoop tools. We desing Integer8 to be used by SQL which is the most popular language on data processing and we provide a connection over JDBC/ODBC for other BI tools to query directly from HDFS.

Alamw15 VIVO

Kristi Holmes

VIVO is an open-source semantic web application and information model that enables discovery of research across disciplines at institutions. It harvests data from verified sources to create detailed profiles of faculty and researchers. The structured linked data in VIVO allows for relationships and connections between researchers, publications, grants, and more to be visualized. Libraries can play important roles in implementing and supporting VIVO through activities like outreach, training, ontology development, and technical support.

From Ambition to Go Live SWIB.pdf

RichardWallis3

From Ambition to Go Live

Richard Wallis

The National Library Board of Singapore embarked on a journey to create an operational Linked Data Management and Discovery System. Their goals were to enable discovery of entities from different sources in a combined interface, bring together physical and digital resources, and provide a staff interface to manage entities and relationships. They selected a cloud-based system from metaphactory to ingest and link data from their integrated library system, content management system, national archives system, and authority files. Various scripts were used to transform the data and represent it using Schema.org for the public interface and BIBFRAME internally. This new system aimed to provide unified discovery and management of the Library Board's vast resources.

ESWC 2017 Tutorial Knowledge Graphs

Peter Haase

Dataverse opportunities

vty

DANS is a institute of KNAW and NWO that provides open data repository and analysis services through its DataverseNL platform. DataverseNL allows researchers to share, archive, and analyze research data. It provides features such as persistent identifiers, metadata harvesting, and tools for visualization, statistics, and linking datasets. DataverseNL aims to make data Findable, Accessible, Interoperable and Re-usable in accordance with FAIR data principles. It can also integrate with other data archives and repositories to preserve and provide access to research data.

Developing a library based data visualization service

Douglas Joubert

The NIH Library is developing a data visualization service including tools, training, and support. They have formed a DataViz Team with expertise in areas like graphic design, R, and GIS. They offer various training classes on tools like R, ggplot2, Excel, and Gephi. They also evaluate their services through surveys of users and tracking consultations to help improve training and support for data visualization at NIH and HHS.

Schema.org: Where did that come from!

Richard Wallis

This document summarizes the origins and development of Schema.org. It began as an effort by Tim Berners-Lee in 1989 to conceive of the World Wide Web. Later developments included the semantic web in 2001 and linked open data in 2009. Schema.org was introduced in 2011 as a joint effort between Google, Bing, Yahoo, and Yandex to create a common set of schemas for structured data on web pages. It has since grown significantly, with over 12 million websites now using Schema.org markup and over 500 types and 800 properties defined. Various communities like libraries have also influenced Schema.org through extensions and standards like LRMI.

FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...

Carole Goble

Building an electronic repository and archives on Dataverse in the European O...

vty

Deepak semantic web_iitd

Deepak Shevani

This document discusses the evolution of the web from Web 1.0 to Semantic Web or Web 3.0. It explains how the current web contains mostly documents instead of structured data, leading to poorly solved information needs. The solution is the Semantic Web, which involves publishing structured data on the web in a common format and linking it to allow for reasoning and solving of human problems by machines. Examples mentioned include DBPedia, which extracts structured data from Wikipedia, and the Linked Data cloud, which interconnects public datasets.

Open Data and APIs - DataWeave

DataWeave

This document discusses how open data is being made available through APIs to make it more accessible and usable for data consumers and applications. It notes that huge amounts of data are now being produced through open data initiatives and datasets. APIs act as interfaces that allow data to be accessed programmatically and in a machine-readable format, enabling the data to be queried, combined with other data sources, and analyzed. The document considers some design issues around APIs like understanding users and use cases, load management, and whether the data publisher can support the necessary infrastructure. It concludes that APIs allow for experimentation with frequently updated data and help reveal relationships within the data.

Introduction to BIG DATA

Zeeshan Khan

This presentation contains a broad introduction to big data and its technologies. Big data is a term that describes the large volume of data – both structured and unstructured – that inundates a business on a day-to-day basis. Big Data is a phrase used to mean a massive volume of both structured and unstructured data that is so large it is difficult to process using traditional database and software techniques. In most enterprise scenarios the volume of data is too big or it moves too fast or it exceeds current processing capacity.

Contextual Computing: Laying a Global Data Foundation

Richard Wallis

Richard Wallis presented on laying a global data foundation for contextual computing. He discussed how knowledge graphs and structured data on the web are building global context by connecting related entities. This will enable cognitive computing to evolve from local to global contexts, having access to data on flexible models and a de facto vocabulary from millions of websites. Schema.org plays a key role by delivering on the current structured data revolution and laying foundations for cognitive computing through a contextual web of entities.

Similar to TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker (20)

Smart Data Applications powered by the Wikidata Knowledge Graph

Developing a library-based data visualization service

Linked Services for the Web of Data

Contextual Computing - Knowledge Graphs & Web of Entities

SCA2013 Presentation: A Web-Based Content Analysis Tool

Linked Data Overview - structured data on the web for US EPA 20140203

Integer8 - Visual Integration on Hadoop

Alamw15 VIVO

From Ambition to Go Live SWIB.pdf

From Ambition to Go Live

ESWC 2017 Tutorial Knowledge Graphs

Dataverse opportunities

Developing a library based data visualization service

Schema.org: Where did that come from!

FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...

Building an electronic repository and archives on Dataverse in the European O...

Deepak semantic web_iitd

Open Data and APIs - DataWeave

Introduction to BIG DATA

Contextual Computing: Laying a Global Data Foundation

More from datascienceiqss

Citing Data in Journal Articles using JATS by Deborah A. Lapeyre

datascienceiqss

This document discusses how to cite data sources in journal articles using the Journal Article Tag Suite (JATS). It recommends using the <mixed-citation> element to cite data in references and outlines elements like <data-title>, <version>, and <pub-id> that can be used to represent different components of data citations. It also proposes new attributes and values for existing JATS elements to better support citing datasets, databases, and other research materials.

Big Data Repository for Structural Biology: Challenges and Opportunities by P...

datascienceiqss

SBGrid (Morin et al., 2013, eLIFE and www.sbgrid.org) is a Harvard based structural biology global computing consortium with a primary focus on the curation of research software. Dr. Sliz will discuss a recent SBGrid project that aims to establish a repository for experimental datasets from SBGrid laboratories. Issues of handling large data volumes, data validation and repository sustainability will be addressed in this talk.

iRODS/Dataverse Project by Jonathan Crabtree

datascienceiqss

This document outlines a project between the Odum Institute and IQSS Dataverse team to integrate the Dataverse data repository system with iRODS, an open source data management system. The goals are to expand storage options for Dataverse, integrate curation workflows, and connect Dataverse to national research data infrastructure. A prototype will be developed to enable automated ingest of data from Dataverse to iRODS using rules and APIs. Challenges include migrating both systems to newer versions while maintaining authentication between them. An initial prototype is expected in August 2015.

DataTags: Sharing Privacy Sensitive Data by Michael Bar-sinai

datascienceiqss

The DataTags framework makes it easy for data producers to deposit, data publishers to store and distribute, and data users to access and use datasets containing confidential information, in a standardized and responsible way. The talk will first introduce the concepts and tools behind DataTags, and then focus on the user-facing component of the system - Tagging Server (available today at datatags.org). We will conclude by describing how future versions of Dataverse will use DataTags to automatically handle sensitive datasets, that can only be shared under some restrictions.

DataTags: Sharing Privacy Sensitive Data by Latanya Sweeney

datascienceiqss

Center for Open Science and the Open Science Framework: Dataverse Add-on by S...

datascienceiqss

The Open Science Framework (OSF: http://osf.io; supported and maintained by the Center for Open Science - COS: http://centerforopenscience.org/) is a free, open source workflow management service and repository designed for scientists to manage and connect everything across their research process. One of the first add-on connections was Dataverse, which provides value to users through an easy connection as a repository service. This talk will introduce the Dataverse add-on connection and provide a technical view of how it was built and how it connects the OSF and Dataverse.

Data Analysis in Dataverse & Visualization of Datasets on Historical Maps by ...

datascienceiqss

The CLIO INFRA project (http://www.clio-infra.eu) hosted at the International Institute of Social History (IISH, http://www.socialhistory.org) integrates a number of data(hubs) on global social, economic and institutional indicators over the past five centuries. Considering a switch to Dataverse, the IISH is currently developing visualization tools that fit on top of Dataverse, especially historical maps with temporally accurate borders, such as provided in the NLGIS (http://nlgis.nl), Labour conflicts (http://laborconflicts.socialhistory.org) projects. This talk will introduce the Dataverse widget developed to extract, transform and load data from datasets storage to platform independent internal data warehouses with possibilities to validate and check the quality of research datasets.

Geospatial Data Visualization: WorldMap Integration by Raman Prasad

datascienceiqss

The Boston Area Research Initiative (BARI) has started work to integrate the Dataverse and Harvard WorldMap systems. This will give Dataverse users the opportunity to map shapefiles as well as tabular files. The maps will be saved in the WorldMap system, allow users to take advantage of the WorldMap’s rich feature set as well as share the maps through Dataverse. This effort involved building APIs on both systems and connecting them via a small web application.

Sharing Data Through Plots with Plotly by Alex Johnson

datascienceiqss

MIT Libraries Dataverse by Katherine McNeill

datascienceiqss

The MIT Libraries hosts a Dataverse instance to house and disseminate datasets purchased by the Libraries for use by MIT affiliates in their research. Access is restricted to MIT IP ranges and eventually Shibboleth authentication to comply with licensing terms that limit dissemination to university affiliates. Future plans include deeper integration with the Libraries' digital systems, expanding subject coverage, involving more librarians, and potentially centralizing some management functions.

The Project TIER Dataverse: Archiving and Sharing Replicable Student Research...

datascienceiqss

The document discusses Project TIER, which aims to teach students protocols for documenting their research in a way that allows for easy and exact replication of statistical results. It develops standards for student papers, theses, and independent projects. Project TIER also seeks to disseminate these methods of transparent and replicable research to other institutions. The document provides an example of the directory structure used to archive a senior thesis according to Project TIER's documentation protocol.

Dataverse in China: Internationalization, Curation and Promotion by Yin Shenqin

datascienceiqss

Preservation of Research Data: Dataverse / Archivematica Integration by Allan...

datascienceiqss

Scholars Portal, a program of the Ontario Council of University Libraries (OCUL), provides the technical infrastructure to store, preserve, and provide access to shared digital library collections in Ontario - including hosting a local instance of Dataverse since 2011. As part of a national project known as Portage (a project of the Canadian Association of Research Libraries), Scholars Portal is partnering with Artefactual Systems, Dataverse, the University of British Columbia, the University of Alberta, and others, to integrate Dataverse with preservation software Archivematica. When completed, this project will facilitate the long-term preservation of research data according to the Open Archival Information System (OAIS) Reference Model.

Metadata & Data Curation Services by Thu-Mai Christian

datascienceiqss

The Odum Institute was an early adopter of the Dataverse Network™ (DVN) virtual archive platform, transferring all of its holdings to the Virtual Data Center (VDC), the DVN’s precursor, in 2005. This presentation will illustrate the Odum Institute Data Archive’s integration of the Dataverse Network™ into its current data curation pipeline process and discuss the Dataverse Network’s role in the Institute’s tiered levels of data curation services.

American Journal of Political Science & The Odum Institute: Promoting Researc...

datascienceiqss

The document discusses the American Journal of Political Science's (AJPS) new policy requiring authors to submit replication files to reproduce study results. It notes that the Odum Institute verifies these replication files and has so far verified 18 out of 25 total submissions, with most requiring 1-2 resubmissions. It outlines next steps to improve the verification workflow and more directly connect articles and datasets.

Political Analysis Dataverse by Jonathan N. Katz

datascienceiqss

Political Analysis is the official journal of the Society for Political Methodology. It publishes quantitative and qualitative political methodology articles. Until 2012, data sharing policies were voluntary or lacked verification. Now, authors must upload data and code to the journal's Dataverse before publication. There has been 100% compliance, with over 15,000 downloads of the 241 replication datasets. Issues include occasional missing files or personal information in initial submissions, and the replication review occurring outside the journal management system. The publisher is working to integrate Dataverse access directly into the system.

Data in Brief and Dataverse: Incentivizing Authors to Share Data by Paige Sha...

datascienceiqss

Data in Brief, an Open Access journal published by Elsevier, exclusively publishes data articles wherein researchers describe their datasets. Data in Brief requires that all data be made publicly available either directly with the article as supplementary files or in a public repository. Data in Brief has teamed up with Dataverse to provide a venue for authors to archive and openly share their data.

Dataverse in the Universe of Data by Christine L. Borgman

datascienceiqss

Data FAIRport Skunkworks: Common Repository Access Via Meta-Metadata Descript...

datascienceiqss

It would be useful to be able to discover what kinds of data are contained in the myriad general-purpose public data repositories. It would be even better if it were possible to query that data and/or have that data conform to a particular context-dependent data format. This was the ambition of the Data FAIRport project. I will be demonstrating the "strawman" demonstration of a fully-functional Data FAIRport, where the meta/data in a public repository can be "projected" into one of a number of different context-dependent formats, such that it can be cross-queried in combination with the (potentially "projected") data from other repositories.

Data Publishing Models by Sünje Dallmeier-Tiessen

datascienceiqss

Data Publishing is becoming an integral part of scholarly communication today. Thus, it is indispensable to understand how data publishing works across disciplines. Are there best practices others can learn from or even data publishing standards? How do they impact interoperability in the Open Science landscape? The presentation will look at a range of examples, and the main building blocks of data publishing today. The work has been conducted as part of the RDA Data Publishing Workflows group.

More from datascienceiqss (20)

Citing Data in Journal Articles using JATS by Deborah A. Lapeyre

Big Data Repository for Structural Biology: Challenges and Opportunities by P...

iRODS/Dataverse Project by Jonathan Crabtree

DataTags: Sharing Privacy Sensitive Data by Michael Bar-sinai

DataTags: Sharing Privacy Sensitive Data by Latanya Sweeney

Center for Open Science and the Open Science Framework: Dataverse Add-on by S...

Data Analysis in Dataverse & Visualization of Datasets on Historical Maps by ...

Geospatial Data Visualization: WorldMap Integration by Raman Prasad

Sharing Data Through Plots with Plotly by Alex Johnson

MIT Libraries Dataverse by Katherine McNeill

The Project TIER Dataverse: Archiving and Sharing Replicable Student Research...

Dataverse in China: Internationalization, Curation and Promotion by Yin Shenqin

Preservation of Research Data: Dataverse / Archivematica Integration by Allan...

Metadata & Data Curation Services by Thu-Mai Christian

American Journal of Political Science & The Odum Institute: Promoting Researc...

Political Analysis Dataverse by Jonathan N. Katz

Data in Brief and Dataverse: Incentivizing Authors to Share Data by Paige Sha...

Dataverse in the Universe of Data by Christine L. Borgman

Data FAIRport Skunkworks: Common Repository Access Via Meta-Metadata Descript...

Data Publishing Models by Sünje Dallmeier-Tiessen

Recently uploaded

UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem

Peter Muessig

Mobile App Development Company In Noida | Drona Infotech

Drona Infotech

Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf

VALiNTRY360

Salesforce Healthcare CRM, implemented by VALiNTRY360, revolutionizes patient management by enhancing patient engagement, streamlining administrative processes, and improving care coordination. Its advanced analytics, robust security, and seamless integration with telehealth services ensure that healthcare providers can deliver personalized, efficient, and secure patient care. By automating routine tasks and providing actionable insights, Salesforce Healthcare CRM enables healthcare providers to focus on delivering high-quality care, leading to better patient outcomes and higher satisfaction. VALiNTRY360's expertise ensures a tailored solution that meets the unique needs of any healthcare practice, from small clinics to large hospital systems. For more info visit us https://valintry360.com/solutions/health-life-sciences

Hand Rolled Applicative User ValidationCode Kata

Philip Schwarz

Could you use a simple piece of Scala validation code (granted, a very simplistic one too!) that you can rewrite, now and again, to refresh your basic understanding of Applicative operators <*>, <*, *>? The goal is not to write perfect code showcasing validation, but rather, to provide a small, rough-and ready exercise to reinforce your muscle-memory. Despite its grandiose-sounding title, this deck consists of just three slides showing the Scala 3 code to be rewritten whenever the details of the operators begin to fade away. The code is my rough and ready translation of a Haskell user-validation program found in a book called Finding Success (and Failure) in Haskell - Fall in love with applicative functors.

Enums On Steroids - let's look at sealed classes !

Marcin Chrost

Requirement Traceability in Xen Functional Safety

Ayan Halder

Lecture 2 - software testing SE 412.pptx

TaghreedAltamimi

Unveiling the Advantages of Agile Software Development.pdf

brainerhub1

Microservice Teams - How the cloud changes the way we work

Sven Peters

A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams? Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.

J-Spring 2024 - Going serverless with Quarkus, GraalVM native images and AWS ...

Bert Jan Schrijver

socradar-q1-2024-aviation-industry-report.pdf

SOCRadar

SOCRadar's Aviation Industry Q1 Incident Report is out now! The aviation industry has always been a prime target for cybercriminals due to its critical infrastructure and high stakes. In the first quarter of 2024, the sector faced an alarming surge in cybersecurity threats, revealing its vulnerabilities and the relentless sophistication of cyber attackers. SOCRadar’s Aviation Industry, Quarterly Incident Report, provides an in-depth analysis of these threats, detected and examined through our extensive monitoring of hacker forums, Telegram channels, and dark web platforms.

Top 9 Trends in Cybersecurity for 2024.pptx

devvsandy

UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions

Peter Muessig

The UI5 tooling is the development and build tooling of UI5. It is built in a modular and extensible way so that it can be easily extended by your needs. This session will showcase various tooling extensions which can boost your development experience by far so that you can really work offline, transpile your code in your project to use even newer versions of EcmaScript (than 2022 which is supported right now by the UI5 tooling), consume any npm package of your choice in your project, using different kind of proxies, and even stitching UI5 projects during development together to mimic your target environment.

Artificia Intellicence and XPath Extension Functions

Octavian Nadolu

Fundamentals of Programming and Language Processors

Rakesh Kumar R

ALGIT - Assembly Line for Green IT - Numbers, Data, Facts

Green Software Development

8 Best Automated Android App Testing Tool and Framework in 2024.pdf

kalichargn70th171

WWDC 2024 Keynote Review: For CocoaCoders Austin

Patrick Weigel

Using Query Store in Azure PostgreSQL to Understand Query Performance

Grant Fritchey

Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...

XfilesPro

Recently uploaded (20)

UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem

Mobile App Development Company In Noida | Drona Infotech

Top Benefits of Using Salesforce Healthcare CRM for Patient Management.pdf

Hand Rolled Applicative User ValidationCode Kata

Enums On Steroids - let's look at sealed classes !

Requirement Traceability in Xen Functional Safety

Lecture 2 - software testing SE 412.pptx

Unveiling the Advantages of Agile Software Development.pdf

Microservice Teams - How the cloud changes the way we work

J-Spring 2024 - Going serverless with Quarkus, GraalVM native images and AWS ...

socradar-q1-2024-aviation-industry-report.pdf

Top 9 Trends in Cybersecurity for 2024.pptx

UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions

Artificia Intellicence and XPath Extension Functions

Fundamentals of Programming and Language Processors

ALGIT - Assembly Line for Green IT - Numbers, Data, Facts

8 Best Automated Android App Testing Tool and Framework in 2024.pdf

WWDC 2024 Keynote Review: For CocoaCoders Austin

Using Query Store in Azure PostgreSQL to Understand Query Performance

Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...

TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker

1. TwoRavens A Graphical, Browser-Based Statistical Interface for Data Repositories Vito D’Orazio and James Honaker Data Science Institute for Quantitative Social Science Harvard University June 11, 2015

3. TwoRavens • Gesture-based web application • Explore and analyze tabular data ﬁles Nearly 25,000 on Harvard’s Dataverse

4. TwoRavens • Gesture-based web application • Explore and analyze tabular data ﬁles Nearly 25,000 on Harvard’s Dataverse • Easy access to descriptive statistics • Interactive statistical modeling using the language of directed graphs

5. TwoRavens • Gesture-based web application • Explore and analyze tabular data ﬁles Nearly 25,000 on Harvard’s Dataverse • Easy access to descriptive statistics • Interactive statistical modeling using the language of directed graphs

6. TwoRavens • Gesture-based web application • Explore and analyze tabular data ﬁles Nearly 25,000 on Harvard’s Dataverse • Easy access to descriptive statistics • Interactive statistical modeling using the language of directed graphs

7. Design Principles • Browser-based, thin client Data are never local Metadata are pulled client-side Dataverse’s DDI metadata TwoRavens’ generated metadata Data are pulled server-side • Device independent and broadly accessible Only requires an internet connection Does not presuppose expert statistical knowledge or experience with statistical software

8. Architecture

9. http://datascience.iq.harvard.edu/about-tworavens

10. Future Directions

11. Future Directions 1. Automated Statistical Model Selection

12. Future Directions 1. Automated Statistical Model Selection 2. Accumulation of User Results

13. Future Directions 1. Automated Statistical Model Selection 2. Accumulation of User Results 3. Interface for Curator Privacy Model

14. Private Data Curator PUser PUser PUser q1 p1 q2 p2 p3 q3 Figure: The curator architecture for data privacy.

TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (19)

Similar to TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker

Similar to TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker (20)

More from datascienceiqss

More from datascienceiqss (20)

Recently uploaded

Recently uploaded (20)

TwoRavens: A Graphical, Browser-Based Statistical Interface for Data Repositories by Vito D’Orazio and James Honaker