The Role of Community-Driven Data Curation for Enterprises

The Role of Community-Driven Data Curation for Enterprises,[object Object],Edward Curry, Andre Freitas, Seán O'Riain ,[object Object],ed.curry@deri.org,[object Object],http://www.deri.org/,[object Object],http://www.EdwardCurry.org/,[object Object]

Speaker Profile,[object Object],Research Scientist at the Digital Enterprise Research Institute (DERI),[object Object],Leading international web science research organization,[object Object],Researching how web of data is changing way business work and interact with information,[object Object],Projects include studies of enterprise linked data, community-based data curation, semantic data analytics, and semantic search,[object Object],Investigate utilization within the pharmaceutical, oil & gas, financial, advertising, media, manufacturing, health care, ICT, and automotive industries,[object Object],Invited speaker at the 2010 MIT Sloan CIO Symposium to an audience of more than 600 CIOs,[object Object]

Acknowledgements,[object Object],Collaborators Andre Freitas & SeánO'Riain,[object Object],Insight from Thought Leaders,[object Object],Evan Sandhaus (Semantic Technologist), Rob Larson (Vice President Product Development and Management), and Gregg Fenton (Director Emerging Platforms) from the New York Times,[object Object],Krista Thomas (Vice President, Marketing & Communications), Tom Tague (OpenCalais initiative Lead) from Thomson Reuters,[object Object],Antony Williams (VP of Strategic Development ) from ChemSpider,[object Object],Helen Berman (Director), John Westbrook (Product Development) from the Protein Data Bank ,[object Object],Nick Lynch (Architect with AstraZeneca) from the Pistoia Alliance. ,[object Object],The work presented has been funded by Science Foundation Ireland under Grant No. SFI/08/CE/I1380 (Lion-2).,[object Object]

Further Information,[object Object], The Role of Community-Driven,[object Object], Data Curation for Enterprises,[object Object],Edward Curry, Andre Freitas, & Seán O'Riain,[object Object],In David Wood (ed.), ,[object Object],Linking Enterprise Data Springer, 2010.,[object Object],Available Free at: ,[object Object],http://3roundstones.com/led_book/led-curry-et-al.html,[object Object]

Overview,[object Object],Curation Background,[object Object],The Business Need for Curated Data,[object Object],What is Data Curation?,[object Object],Data Quality and Curation,[object Object],How to Curate Data,[object Object],Curation Communities and Enterprise Data,[object Object],Case Studies,[object Object],Wikipedia, The New York Times, Thomson Reuters, ChemSpider, Protein Data Bank,[object Object],Best Practices from Case Study Learning ,[object Object]

The Business Need,[object Object],[object Object]

Access to the right information

Confidence in that informationWorking incomplete inaccurate, or wrong information can have disastrous consequences ,[object Object]

The Problems with Data,[object Object],Flawed Data,[object Object],Effects 25% of critical data in world’s top companies (Gartner),[object Object],Data Quality,[object Object],Recent banking crisis (Economist Dec’09),[object Object],Inaccurate figures made it difficult to manage operations (investments exposure and risk),[object Object],“asset are defined differently in different programs”,[object Object],“numbers did not always add up”,[object Object],“departments do not trust each other’s figures”,[object Object],“figures … not worth the pixels they were made of”,[object Object]

What is Data Curation?,[object Object],DigitalCuration ,[object Object],Selection, preservation, maintenance, collection, and archiving of digital assets,[object Object],DataCuration,[object Object],Active management of data over its life-cycle,[object Object],Data Curators,[object Object],Ensure data is trustworthy, discoverable, accessible, reusable, and fit for use,[object Object],Museum cataloguers of the Internet age,[object Object]

What is Data Curation?,[object Object],Data Governance,[object Object],Convergence of data quality, data management, business process management, and risk management,[object Object],Data Curation is a complimentary activity,[object Object],Part of overall data governance strategy for organization ,[object Object],Data Curator = Data Steward ??,[object Object],Overlapping terms between communities,[object Object]

Data Quality and Curation,[object Object],What is Data Quality?,[object Object],Desirable characteristics for information resource ,[object Object],Described as a series of quality dimensions,[object Object],Discoverability, Accessibility, Timeliness, Completeness, Interpretation, Accuracy, Consistency, Provenance & Reputation,[object Object],Data curation can be used to improve these quality dimensions,[object Object]

Data Quality and Curation,[object Object],Discoverability & Accessibility,[object Object],Curate to streamline search by storing and classifying in appropriate and consistent manner,[object Object],Accuracy,[object Object],Curate to ensure data correctly represents the “real-world” values it models,[object Object],Consistency,[object Object],Curate to ensure datacreated and maintained using standardized definitions, calculations, terms, and identifiers,[object Object]

Data Quality and Curation,[object Object],Provenance & Reputation,[object Object],Curate to track source of data and determine reputation,[object Object],Curate to include the objectivity of the source/producer,[object Object],Is the information unbiased, unprejudiced, and impartial?,[object Object],Or does it come from a reputable but partisan source?,[object Object],Other dimensions discussed in chapter,[object Object]

How to Curate Data,[object Object],Data Curation is a large field with sophisticated techniques and processes,[object Object],Sectionprovides high-leveloverview on:,[object Object],Should you curate data?,[object Object],Types of Curation,[object Object],Setting up a curation process,[object Object],Additional detail and references available in book chapter,[object Object]

Should You Curate Data?,[object Object],Curation can have multiple motivations,[object Object],Improving accessibility, quality, consistency,…,[object Object],Will the data benefit from curation?,[object Object],Identify business case,[object Object],Determine if potential return support investment,[object Object],Not all enterprise data should be curated,[object Object],Suits knowledge-centric data rather than transactional operations data,[object Object]

Types of Data Curation,[object Object],Multiple approaches to curate data, no single correct way,[object Object],Who?,[object Object],Individual Curators,[object Object],Curation Departments,[object Object],Community-based Curation,[object Object],How?,[object Object],Manual Curation,[object Object],(Semi-)Automated,[object Object],Sheer Curation,[object Object]

Types of Data Curation – Who?,[object Object],Individual Data Curators,[object Object],Suitable for infrequently changing small quantity of data,[object Object], (<1,000 records),[object Object],Minimal curation effort (minutes per record),[object Object]

Types of Data Curation – Who?,[object Object],Curation Departments,[object Object],Curation experts working with subject matter experts to curate data within formal process,[object Object],Can deal with large curation effort (000’s of records),[object Object],Limitations,[object Object],Scalability: Can struggle with large quantities of dynamic data (>million records) ,[object Object],Availability: Post-hoc nature creates delay incurated data availability,[object Object]

Types of Data Curation - Who?,[object Object],Community-Based Data Curation,[object Object],Decentralized approach to data curation,[object Object],Crowd-sourcing the curation process,[object Object],Leverages community of users to curate data ,[object Object],Wisdom of the community (crowd),[object Object],Can scale to millions of records,[object Object]

Types of Data Curation – How?,[object Object],Manual Curation,[object Object],Curators directly manipulate data,[object Object],Can tie users up with low-value add activities,[object Object],(Sem-)Automated Curation,[object Object],Algorithms can (semi-)automate curation activities such as data cleansing, record duplication and classification,[object Object],Can be supervised or approved by human curators,[object Object]

Types of Data Curation – How?,[object Object],Sheer curation, or Curation at Source,[object Object],Curation activities integrated in normal workflow of those creating and managing data,[object Object],Can be as simple as vetting or “rating” the results of a curation algorithm,[object Object],Results can be available immediately,[object Object],Blended Approaches: Best of Both ,[object Object],Sheer curation +post hoc curation department,[object Object],Allows immediate access to curated data ,[object Object],Ensures quality control with expert curation,[object Object]

Setting up a Curation Process,[object Object],5 Steps to setup a curation process:,[object Object],1 - Identify what data you need to curate,[object Object],2 - Identify who will curate the data,[object Object],3 - Define the curation workflow,[object Object],4 - Identity appropriate data-in & data-out formats,[object Object],5 - Identify the artifacts, tools, and processes needed to support the curation process,[object Object]

Setting up a Curation Process,[object Object],Step 1: Identify what data you need to curate,[object Object],Newly created data and/or legacy data? ,[object Object],How is new data created? ,[object Object],Do users create the data, or is it imported from an external source? ,[object Object],How frequently is new data created/updated? ,[object Object],What quantity of data is created?,[object Object],How much legacy data exists?,[object Object],Is it stored within a single source, or scattered across multiple sources?,[object Object]

Setting up a Curation Process ,[object Object],Step 2: Identify who will curate the data,[object Object],Individuals, depts, groups, institutions,community,[object Object],Step 3: Define the curation workflow,[object Object],What curation activities are required?,[object Object],How will curation activities be carried out?,[object Object],Step 4: Identity suitable data-in & -out formats,[object Object],What is the best format for the data?,[object Object],Right format for receiving and publishing data is critical,[object Object],Support multiple formats to maximum participation,[object Object]

Setting up a Curation Process,[object Object],Step 5: Identify the artifacts, tools, and processes needed to support curation,[object Object],Workflow support/Community collaboration platforms,[object Object],Algorithms can (semi-)automate curation activities,[object Object],Major factors that influence approach:,[object Object],Quantity of data to be curated (new and legacy data),[object Object],Amount of effort required to curate the data,[object Object],Frequency of data change / data dynamics,[object Object],Availability of experts,[object Object]

Community–based Curation,[object Object],Two community approaches:,[object Object],Internal corporate communities,[object Object],External pre-competitive communities,[object Object],To determine the right model consider:,[object Object],What the purpose of the community is? ,[object Object],Will resulting curateddataset be publicly available? Or restricted?,[object Object]

Community–based Curation,[object Object],Internal Communities,[object Object],Taps potential of workforce to assist data curation,[object Object],Curate competitive enterprise data that will remain internal to the company,[object Object],May not always be the case e.g. product technical support and marketing data ,[object Object],Can work in conjunction with curation dept.,[object Object],Community governance typically follows the organization’s internal governance model,[object Object]

Pre-competitive Communities,[object Object],Pre-competitive collaboration,[object Object],Well-established technique for open innovation ,[object Object],Notable examples,[object Object]

What is Pre-Competitive Data?,[object Object],Two Types of Enterprise Data,[object Object],Propriety data for competitive advantage,[object Object],Common data with no competitive advantage,[object Object],What is pre-competitive data?,[object Object],Has little potential for differentiation,[object Object],Can be shared without conferring commercial advantage to competitor,[object Object],Common non-competitive data,[object Object],Needs to be maintaining and curated,[object Object],Companies duplicate effort in-house incurring full-cost,[object Object]

Pre-competitive Communities,[object Object],External pre-competitive communities,[object Object],Share costs, risks, and technical challenges,[object Object],Common curation tasks carried out once inpublic domain rather than multiple timesin each company,[object Object],Reduces cost required to provide and maintain data,[object Object],Can increase the quantity, quality, and access,[object Object],Focus turns to value-add competitive activity,[object Object],Move “competitive onus” from novel data to novel algorithms, shifting emphasis from “proprietary data” to a “proprietary understanding of data”,[object Object],e.g. Protein Data Bank and Pistoia Alliance in Pharma,[object Object]

External Pre-competitive Communities,[object Object],Two popular community models are,[object Object],Organization consortium,[object Object],Open community,[object Object],Organization consortium,[object Object],Operates like a private democratic club,[object Object],Usually closed community, members invited based on skill-set to contribute,[object Object],Output data - public or limited tomembers,[object Object],Consortiums follow a democratic process,[object Object],Member voting rights may reflect level of investment,[object Object],Larger players may be leaders of the consortium,[object Object]

External Pre-competitive Communities,[object Object],Open community,[object Object],Everyone can participate,[object Object],“Founder(s)” defines desired curation activity,[object Object],Seek public support to contribute to curation activates,[object Object],Wikipedia, Linux, and Apache are good examples of large open communities,[object Object]

Wikipedia,[object Object],The World Largest Open Digital Curation Community,[object Object]

Wikipedia,[object Object],Open-source encyclopedia,[object Object],Collaboratively built by large community,[object Object],Challenges existing models of content creation,[object Object],More than 19,000,000 articles,[object Object],270+ languages, 3,200,000+ articles in English,[object Object],More than 157,000 active contributors,[object Object],Studies show accuracy and stylistic formality are equivalent to resources developed in expert-based closed communities,[object Object],i.e. Columbia and Britannica encyclopedias ,[object Object]

Wikipedia,[object Object],MediaWiki ,[object Object],Wiki platform behind Wikipedia,[object Object],Widespread and popular technology,[object Object],Wikis can also support data curation,[object Object],Lowers entry barriers for collaborative data curation,[object Object],Widely used inside organizations,[object Object],Intellipedia covering 16 U.S. Intelligence agencies,[object Object],Wiki Proteins,curatedProtein data for knowledge discovery and annotation,[object Object]

Wikipedia,[object Object],Decentralized environment supports creation of high quality information with:,[object Object],Social organization,[object Object],Artifacts, tools & processes for cooperative work coordination,[object Object],Wikipedia collaboration dynamics highlightgood practices,[object Object]

Wikipedia – Social Organization,[object Object],Any usercan edit its contents,[object Object],Without prior registration,[object Object],Does not lead to a chaotic scenario,[object Object],In practice highly scalable approach for high quality content creation on the Web,[object Object],Relies on simple but highly effective way to coordinate its curation process,[object Object],Curation is activity of Wikipedia admins,[object Object],Responsibility for information quality standards,[object Object]

Wikipedia – Social Organization,[object Object],Four main types of accounts:,[object Object],Anonymous users,[object Object],Identified by their associated IP address,[object Object],Registered users,[object Object],Users with an account in the Wikipedia website,[object Object],Administrators/Editors,[object Object],Registered users with additional permissions in the system,[object Object],Access to curation tools,[object Object],Bots ,[object Object],Programs that perform repetitive tasks,[object Object]

Wikipedia – Social Organization,[object Object]

Wikipedia – Social Organization,[object Object],Incentives,[object Object],Improvement of one’s reputation,[object Object],Sense of efficacy,[object Object],Contributing effectively to a meaningful project ,[object Object],Over time focus of editors typically change,[object Object],From curators of a few articles in specific topics ,[object Object],To more global curation perspective,[object Object],Enforcing quality assessment of Wikipedia as a whole,[object Object]

Wikipedia – Artifacts, Tools & Processes ,[object Object],Wiki Article Editor (Tool),[object Object],WYSIWYG or markup text editor,[object Object],Talk Pages (Tool),[object Object],Public arena for discussions around Wikipedia resources,[object Object],Watchlists (Tool),[object Object],Helps curators to actively monitor the integrity and quality of resources they contribute,[object Object],Permission Mechanisms (Tool),[object Object],Users with administrator status can perform critical actions such as remove pages and grant administrative permissions to new users,[object Object]

Wikipedia – Artifacts, Tools & Processes ,[object Object],Automated Edition (Tool),[object Object],Bots are automated or semi-automated tools that perform repetitive tasks over content,[object Object],Page History and Restore (Tool),[object Object],Historical trail of changes to a Wikipedia Resource,[object Object],Guidelines, Policies & Templates (Artifact),[object Object],Defines curation guidelines for editors to assess article quality ,[object Object],Dispute Resolution (Process),[object Object],Dispute mechanism between editors over the article contents,[object Object],Article Edition, Deletion, Merging, Redirection, Transwiking, Archival (Process),[object Object],Describe the curation actions over Wikipedia resources,[object Object]

Wikipedia - DBPedia,[object Object],DBPedia Knowledge base,[object Object],Inherits massive volume of curated Wikipedia data,[object Object],Built using information info box properties,[object Object],Indirectly uses wiki as data curation platform,[object Object],DBPediaprovides direct access to data,[object Object],3.4 million entities and 1 billion RDF triples,[object Object],Comprehensive data infrastructure,[object Object], Concept URIs, definitions, and basic types,[object Object]

The Role of Community-Driven Data Curation for Enterprises

Wikipedia - DBPedia,[object Object]

The New York Times,[object Object],100 Years of Expert Data Curation,[object Object]

The New York Times,[object Object],Largest metropolitan and third largest newspaper in the United States,[object Object],[object Object]

Most popular newspaper website in US

100 year old curated repository defining its participation in the emerging Web of Data,[object Object]

The New York Times,[object Object], Index Department was created in 1913,[object Object],Curation and cataloguingofNYT resources ,[object Object],Since 1851 NYT had low quality index for internal use,[object Object],Developed a comprehensive catalog using a controlled vocabulary,[object Object],Covering subjects, personal names, organizations, geographic locations and titles of creative works (books, movies, etc), linked to articles and their summaries,[object Object],Current Index Dept. has~15 people,[object Object]

The New York Times,[object Object],Challenges with consistently and accurately classifying news articles over time,[object Object],Keywords expressing subjects may show some variance due to cultural or legal constraints,[object Object],Identities of some entities, such as organizations and places, changed over time,[object Object],Controlled vocabulary grew to hundreds of thousands of categories,[object Object],Adding complexity to classification process,[object Object]

The New York Times,[object Object],Increased importance of Web drove need to improve categorization of online content,[object Object],Curation carried out by Index Department,[object Object],Library-time (days to weeks),[object Object],Print edition can handle next-day index ,[object Object],Not suitable for real-time online publishing ,[object Object],nytimes.com needed a same-day index,[object Object]

The New York Times,[object Object],Introduced two stage curation process,[object Object],Editorial staff performed best-effort semi-automated sheer curation at point of online pub.,[object Object],Several hundreds journalists,[object Object],Index Department follow up with long-term accurate classification and archiving,[object Object],Benefits:,[object Object],Non-expert journalist curators provide instant accessibility to online users,[object Object],Index Department provides long-term high-quality curation in a “trust but verify” approach,[object Object]

NYT Curation Workflow ,[object Object],Curation starts with article getting out of the newsroom,[object Object]

NYT Curation Workflow ,[object Object],Member of editorial staff submits article to web-based rule based information extraction system (SAS Teragram) ,[object Object]

NYT Curation Workflow ,[object Object],Teragram uses linguistic extraction rules based on subset of Index Dept’s controlled vocab.,[object Object]

NYT Curation Workflow ,[object Object],Teragram suggests tags based on the Index vocabulary that can potentially describe the content of article,[object Object]

NYT Curation Workflow ,[object Object],Editorial staff member selects terms that best describe the contents and inserts new tags if necessary ,[object Object]

NYT Curation Workflow ,[object Object],Reviewed by the taxonomy managers with feedback to editorial staff on classification process,[object Object]

NYT Curation Workflow ,[object Object],Article is published online at nytimes.com,[object Object]

NYT Curation Workflow ,[object Object],At later stage article receives second level curation by Index Dept. additional Index tags and a summary,[object Object]

NYT Curation Workflow ,[object Object],Article is submitted to NYT Index,[object Object]

The New York Times,[object Object],Early adopter of Linked Open Data (June ‘09),[object Object]

The New York Times,[object Object],Linked Open Data @ data.nytimes.com,[object Object],Subset of 10,000 tagsfrom index vocabulary,[object Object],Dataset of people, organizations & locations,[object Object],Complemented by search services to consume data about articles, movies, best sellers, Congress votes, real estate,…,[object Object],Benefits,[object Object],Improves traffic by third party data usage,[object Object],Lowers development cost of new applications for different verticals inside the website,[object Object],E.g. movies, travel, sports, books,[object Object]

Thomson Reuters,[object Object],Data Curation: A Core Business Competency,[object Object]

Thomson Reuters,[object Object],Thomson Reuters is an information provider,[object Object],Created by acquisition of Reuters by Thomson,[object Object],Over 50,000 employees,[object Object],Commercial presence in 100+ countries,[object Object],Provides specialist curated information and information-based services,[object Object],Selects most relevant information for customers,[object Object],Classifying, enriching and distributing it in a way that can be readily consumed,[object Object]

Thomson Reuters,[object Object],Curation process,[object Object],Working over approximately 1000 data sources,[object Object],Automatic tools provide first level triage and classification,[object Object],Refined by intervention of human curators,[object Object],Curator is a domain specialist,[object Object],Employs thousands of curators,[object Object]

Thomson Reuters,[object Object],OneCalais platform,[object Object],Reduces workload for classification ofcontent,[object Object],Natural Language Processingonunstructured text,[object Object],Automatically derives tags for analyzed content,[object Object],Enrichment with machine readable structured data,[object Object],Provides description of specific entities (places, people, events, facts) present in the text,[object Object],Open Calais (free version of OneCalais) ,[object Object],20.000+ users,>4 million trans per day,[object Object],CNET, CBS Interactive, The Huffington Post, The Powerhouse Museum of Science and Design,…,[object Object]

ChemSpider,[object Object],Structure centric chemical community ,[object Object],Over 300 data sources with 25 million records,[object Object],Provided by chemical vendors, government databases, private laboratories and individual,[object Object],Pharmarealizing benefits of open data,[object Object],Heavily leveraged by pharmaceutical companies as pre-competitive resources for experimental and clinical trial investigation ,[object Object],Glaxo Smith Kline made its proprietary malaria dataset of 13,500 compounds available,[object Object]

Protein Data Bank,[object Object],Dedicated to improving understanding of biological systems functions with 3-D structure of macromolecules ,[object Object],Started in 1971 with 3 core members,[object Object],Originally offered 7 crystal structures ,[object Object],Grown to 63,000 structures,[object Object],Over 300 million dataset downloads,[object Object],Expanded beyond curated data download service to include complex molecular visualized, search, and analysis capabilities,[object Object]

Best Practices from Case Study Learning,[object Object],Social Best Practices,[object Object],Participation,[object Object],Engagement,[object Object],Incentives,[object Object],Community Governance Models,[object Object],Technical Best Practices,[object Object],Data Representation,[object Object],Human- andAutomatedCuration,[object Object],Track Provenance,[object Object]

Social Best Practices,[object Object],Participation,[object Object],Stakeholders involvement fordata producers and consumers must occur early in project,[object Object],Provides insight into basic questions of what they want to do, for whom, and what it will provide,[object Object],White papers are effective means to present these ideas, and solicit opinion from community,[object Object],Can be used to establish informal ‘social contract’ for community,[object Object]

Social Best Practices,[object Object],Engagement,[object Object],Outreach activities essential for promotion and feedback,[object Object],Typical consumers-to-contributors ratios of less than 5%,[object Object],Social communication and networking forums are useful,[object Object],Majority of community may not communicate using these media,[object Object],Communication by email still remains important,[object Object]

Social Best Practices,[object Object],Incentives,[object Object],Sheer curationneedsline of sight from data curating activity, to tangible exploitation benefits,[object Object],Lack of awareness of value proposition will slow emergence ofcollaborative contributions,[object Object],Recognizing contributing curators through a formal feedback mechanism,[object Object],Reinforces contribution culture,[object Object],Directly increases output quality,[object Object]

Social Best Practices,[object Object],Community Governance Models,[object Object],Effective governance structure is vital to ensure success of community ,[object Object],Internal communities and consortium perform well when they leverage traditional corporate and democratic governance models ,[object Object],Open communities need to engage the community within the governance process,[object Object],Follow less orthodox approaches using meritocratic and autocratic principles,[object Object]

The Role of Community-Driven Data Curation for Enterprises

The Role of Community-Driven Data Curation for Enterprises

Recommended

More Related Content

What's hot

What's hot(20)

Viewers also liked

Viewers also liked(20)

Similar to The Role of Community-Driven Data Curation for Enterprises

Similar to The Role of Community-Driven Data Curation for Enterprises(20)

Recently uploaded

Recently uploaded(20)

The Role of Community-Driven Data Curation for Enterprises