SlideShare a Scribd company logo
1 of 29
Download to read offline
Data Science and What It
Means to Library and
Information Science
Jian Qin
School of Information Studies
Syracuse University
iSpeaker Series at Sungkyunkwan University
Seoul, Korea, December 8, 2015
Agenda
• What is data science?
• What is a data scientist?
• What areas of library work can benefit from data
science?
212/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
3
•
What is data science?
“An emerging area of work
concerned with the collection,
presentation, analysis,
visualization, management, and
preservation of large collections
of information.”
Stanton, J. (2012). Introduction to Data Science.
http://ischool.syr.edu/media/documents/2012/3/DataScienc
eBook1_1.pdf
The whole lifecycle of data from collection to analysis
to preservation
LCAS DM workshop, Beijing, 201512/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
“We’re increasingly
finding data in the wild,
and data scientists are
involved with gathering
data, massaging it into a
tractable form, making it
tell its story, and
presenting that story to
others.”
Loukides, M. (2011). What is data science? Sebastopol, CA:
O’Reilly.
What is data science?
4
Gathering and massaging data to tell its story
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
5
A systematic enterprise that builds and
organizes knowledge in the form of
testable explanations and predictions.
The study of the generalizable extraction of knowledge
from data, which involves data and statistics or the
systematic study of the organization, properties, and
analysis of data and its role in inference, including our
confidence in the inference.
Dhar, V. (2013). Data science and prediction. Communications of the ACM, 56(12): 64-73.
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Why is data science different from
statistics and other existing disciplines?
• Raw material, the “data” part of data science, is
increasingly heterogeneous and unstructured and often
emanating from networks with complex relationships
between the entities.
• Analysis of data requires integration, interpretation, and
sense making that is increasingly derived through tools
from computer science, linguistics, econometrics,
sociology, and other disciplines.
• Data are increasingly generated by computer and for
computer consumption, that is, computers increasingly
do background work for each other and make decisions
automatically
612/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
7
Dhar, V. (2013). Data science and prediction. Communications of the ACM,
56(12): 64-73, p. 64.
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
8
Main fields in data science
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
What is a data scientist?
• Math skills: Statistics and linear algebra
• Computing skills: programming and infrastructure design
• Able to communicate: ability to create narratives around
their work
• Ask the right questions: involves domain knowledge and
expertise, coupled with a keen ability to see the problem,
see the available data, and match up the two.
912/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Analysis of data problems: Story 1
• Domain: Global migration studies
• What’s involved: migrants, refuges, detention centers, refuge
camps, Asylums, …
• Data types: interview audio recordings, photos, articles, clippings,
written notes, …
• Analysis software: Atlas.ti, SPSS
• Bottleneck problem:
• difficulty in finding the data by person, interview, and related artifacts and in
transforming the data into analysis software
1012/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
We’ve got
a problem
Researcher:
How to use
Atlas.ti?
Data scientist:
What data do
you have?
Data scientist:
How do you
collect them?
Data scientist:
What do you do
with the data?
Analysis of data problems: story 2
• Domain: Thermochronology and tectonics
• Data types: Excel data files (lots of them), spectrum and microscopic images,
annotations
• Analysis: modeling by combining data from multiple data files with specialized
software
• Bottleneck problem:
• manually matching/merging/filtering data is extremely cumbersome and the problem is
compounded by the difficulty finding the right data files
1112/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
What is involved: workflows in a
research lifecycle
Analysis of data problem: story 3
• Domain: collaboration networks in a data repository
• What’s involved: metadata describing DNA sequences
• Data types: semi-structured data in plain text format
• Analysis: identify entities and relationships, build the
data into a database for querying and extraction
• Bottleneck problems:
• Extremely large data sets with multiple entities, which makes
manual processing impossible
• Disambiguation of author names and correctly linking between
entities
1212/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Analysis of data problems
Analysis of
domain data
Requirement analysis
Workflow analysis
Data modeling
Data transformation
needs analysis
Data provenance
needs analysis
Analysis of data problems is an
analysis of domain data,
requirements, and workflows
that will lead to the
development of solutions.
1312/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Skills required to perform
analysis of domain data problems
Requirement
analysis
Workflow
analysis
Data modeling
Data
transformation
needs analysis
Data
provenance
needs analysis
Interview skills,
analysis and
generalization skills
Ability to capture
components and
sequences in workflows
Ability to translate
domain analysis into
data models
Ability to envision the data
model within the larger
system architecture
1412/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Example 1: modeling research data for
gravitational wave research
15
1. Understand research lifecycle
2. Workflows: steps and relationships
3. Data flows: what goes in and out at
which step
4. Entities and attributes, relationships
5. Researcher’s practice and habits in
documenting and managing data
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Example 2: asking the right question in
mining metadata
16
Metadata describing
datasets is big data that can
used to study:
• Collaboration networks
• Scholarly
communication patterns
• Research frontiers and
trends
• Knowledge transfer
• Research impact
assessment
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
What areas of library work can
benefit from data science?
1712/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data services and data-driven services
18
Library
Data services that
support research,
learning, and policy
making (external)
Data-driven services
that support library
planning, management,
and evaluation
(internal)
Data literacy
training
Data
discovery
Data
consulting
Data
mining
Data
collection Data
integration
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data-drive organization
• Consumer internet companies
• Google, Amazon, Facebook, LinkedIn
• Brick-mortar companies:
• Walmart, UPS, FedEx, GE
• “A data-driven organization
acquires, processes, and
leverage data in a timely fashion
to create efficiencies, iterate on
and develop new products, and
navigate the competitive
landscape...”
19
Is your library
(company, research
center, etc.) a data-
driven organization?
Patil, D.J. & Mason, H. (2015). Data Driven: Creating a Data
Culture. Sebastopol, CA: O’Reilly Media, p. 6.
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data curation
20
“the active and ongoing management of
data through its life cycle of interest and
usefulness to scholarship, science, and
education. Data curation activities enable
data discovery and retrieval, maintain its
quality, add value, and provide for reuse
over time, and this new field includes
authentication, archiving, management,
preservation, retrieval, and representation.”
–UIUC GSLIS
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data collection
• Build data collections through
• Institutional repositories
• Community repositories
• Developing tools for researchers to submit,
manage, preserve, and discover data
• Develop data collections
• Specialized
• Analysis-ready
• Reusable
• Actionable
21
• For library service planning, decision
making, and evaluation
• To support policy making, research, and
learning
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data discovery
• Complex data landscape:
• International, national, regional
• Disciplinary, community
• Open access vs. closed access
• Data sources for various purposes:
• Utility data sources: open, reusable
• Census data: open, but need additional
processing/meshing to reach the analysis-
ready state
• Government data: open, reusable, but require
additional processing
• Disciplinary research data: access varies,
require special knowledge to access and use
22
Data involving human
subjects are under
strict control by law
and often follow
additional compliance
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data consulting
• Search, locate, and verify data for
particular research purposes
• Plan, design, and implement data
curation and/or data analysis
projects
• Provide training and consulting for
statistical methods and tools
2312/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data mining
• Using internal data:
• Users, uses, expenses, collections, staff
• Goal: improve efficiencies and service
quality
• Using external data:
• Trends and indicators in scholarly
communication, technology, economy, and
culture
• Goal: adjust current services and plan for
new services
2412/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Data integration
Data integration is the combination of technical
and business processes used to combine data
from disparate sources into meaningful and
valuable information.
--IBM, http://www.ibm.com/analytics/us/en/technology/data-
integration/
25
A process of understanding, cleansing,
monitoring, transforming, and delivering data,
which offers opportunities to develop data
products as an infrastructure for research,
learning, policymaking, and decision making.
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
A home buyer’s information integration
26
What houses for sale under $250K have at least 2 bathrooms, 2
bedrooms, a nearby school ranking in the upper third, in a
neighborhood with below-average crime rate and diverse population?
Information
integration
Realtor School rankings Crime rate Demographics
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Research data
integration
Diabetes data and
trends—Country
level estimates:
http://apps.nccd.cdc.gov/D
DT_STRS2/NationalDiabet
esPrevalenceEstimates.aspx
?mode=PHY ;
Diabetes Data &
Trends home page:
http://apps.nccd.cdc.gov/dd
tstrs/default.aspx
12/8/2015 27iSpeaker Series at Sungkyunkwan University, Seoul, Korea
Summary
• Data science is not a new discipline, but rather, a new way of
utilizing data, methods, and tools to ask the right questions in
solving problems.
• Practicing data science requires strong skills in math,
computing, interpersonal communication, and asking the right
questions
• Libraries are at a strategic position in practicing data science.
How to leverage this position relies on the
• vision
• courage of risk taking
• knowledge of data science and related topics
• careful planning
• collaboration
2812/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea 29
Thank you!
Questions?

More Related Content

What's hot

Indexing languages (2)
Indexing languages (2)Indexing languages (2)
Indexing languages (2)
yhen06
 
Internet Search Methods
Internet Search MethodsInternet Search Methods
Internet Search Methods
wmassie
 
Information policy sunil sir
Information policy sunil sirInformation policy sunil sir
Information policy sunil sir
bgshalini
 
COUNTER Usage Statistics
COUNTER Usage StatisticsCOUNTER Usage Statistics
COUNTER Usage Statistics
sotrue
 

What's hot (20)

Electronic Resource Management in the library
Electronic Resource Management in the libraryElectronic Resource Management in the library
Electronic Resource Management in the library
 
WEB BASED INFORMATION RETRIEVAL SYSTEM
WEB BASED INFORMATION RETRIEVAL SYSTEMWEB BASED INFORMATION RETRIEVAL SYSTEM
WEB BASED INFORMATION RETRIEVAL SYSTEM
 
Indexing languages (2)
Indexing languages (2)Indexing languages (2)
Indexing languages (2)
 
AI for Libraries
AI for LibrariesAI for Libraries
AI for Libraries
 
Internet Search Methods
Internet Search MethodsInternet Search Methods
Internet Search Methods
 
Intro to Data Management Plans
Intro to Data Management PlansIntro to Data Management Plans
Intro to Data Management Plans
 
Presentation on web of science m.vi.library
Presentation on  web of science m.vi.libraryPresentation on  web of science m.vi.library
Presentation on web of science m.vi.library
 
DIGITAL LIBRARY
DIGITAL LIBRARYDIGITAL LIBRARY
DIGITAL LIBRARY
 
Indexing
IndexingIndexing
Indexing
 
Design and development of information product by geeta gadhavi
Design and development of information product by geeta gadhaviDesign and development of information product by geeta gadhavi
Design and development of information product by geeta gadhavi
 
ELECTRONIC THESES AND DISSERTATIONS IN SHODHGANGA REPOSITORY: A COMPARATIVE ...
ELECTRONIC THESES AND DISSERTATIONS IN SHODHGANGA REPOSITORY:  A COMPARATIVE ...ELECTRONIC THESES AND DISSERTATIONS IN SHODHGANGA REPOSITORY:  A COMPARATIVE ...
ELECTRONIC THESES AND DISSERTATIONS IN SHODHGANGA REPOSITORY: A COMPARATIVE ...
 
Cloud computing and its application in libraries
Cloud computing and its application in librariesCloud computing and its application in libraries
Cloud computing and its application in libraries
 
User education and information literacy - Innovative strategies and practices
User education and information literacy - Innovative strategies and practicesUser education and information literacy - Innovative strategies and practices
User education and information literacy - Innovative strategies and practices
 
Library Automation An Overview
Library Automation An OverviewLibrary Automation An Overview
Library Automation An Overview
 
Knowledge Codification121.pdf
Knowledge Codification121.pdfKnowledge Codification121.pdf
Knowledge Codification121.pdf
 
Scientometrics
Scientometrics Scientometrics
Scientometrics
 
Dspace software
Dspace softwareDspace software
Dspace software
 
Information policy sunil sir
Information policy sunil sirInformation policy sunil sir
Information policy sunil sir
 
COUNTER Usage Statistics
COUNTER Usage StatisticsCOUNTER Usage Statistics
COUNTER Usage Statistics
 
Library consortia
Library consortiaLibrary consortia
Library consortia
 

Viewers also liked

Share: Science Information Life Cycle
Share: Science Information Life CycleShare: Science Information Life Cycle
Share: Science Information Life Cycle
kauberry
 
Sharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem DataSharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem Data
TERN Australia
 
Semiotics and Information Science
Semiotics and Information ScienceSemiotics and Information Science
Semiotics and Information Science
Florence Paisey
 
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Perficient, Inc.
 
Big data ecosystem
Big data ecosystemBig data ecosystem
Big data ecosystem
magda3695
 

Viewers also liked (20)

J.M. Díaz Nafría: Science of Information: Emergence and evolution of meaning
J.M. Díaz Nafría: Science of Information: Emergence and evolution of meaningJ.M. Díaz Nafría: Science of Information: Emergence and evolution of meaning
J.M. Díaz Nafría: Science of Information: Emergence and evolution of meaning
 
Conceptions of information science
Conceptions of information scienceConceptions of information science
Conceptions of information science
 
Share: Science Information Life Cycle
Share: Science Information Life CycleShare: Science Information Life Cycle
Share: Science Information Life Cycle
 
Information, Science, and Society
Information, Science, and SocietyInformation, Science, and Society
Information, Science, and Society
 
INFORMATION SCIENCE
INFORMATION SCIENCEINFORMATION SCIENCE
INFORMATION SCIENCE
 
Towards Neuro–Information Science
Towards Neuro–Information ScienceTowards Neuro–Information Science
Towards Neuro–Information Science
 
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY-  SCOPE,THEORIES AND...KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY-  SCOPE,THEORIES AND...
KNOWLEDGE SCIENCE; NOT INFORMATION SCIENCE OR TECHNOLOGY- SCOPE,THEORIES AND...
 
Big Data and Hadoop - key drivers, ecosystem and use cases
Big Data and Hadoop - key drivers, ecosystem and use casesBig Data and Hadoop - key drivers, ecosystem and use cases
Big Data and Hadoop - key drivers, ecosystem and use cases
 
Big data + data science startup focus points
Big data + data science startup focus pointsBig data + data science startup focus points
Big data + data science startup focus points
 
Sharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem DataSharing & Sustaining Ecosystem Data
Sharing & Sustaining Ecosystem Data
 
Semiotics and Information Science
Semiotics and Information ScienceSemiotics and Information Science
Semiotics and Information Science
 
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
Big Data Open Source Tools and Trends: Enable Real-Time Business Intelligence...
 
Big data ecosystem
Big data ecosystemBig data ecosystem
Big data ecosystem
 
Real time data services
Real time data servicesReal time data services
Real time data services
 
Real Time Big Data
Real Time Big DataReal Time Big Data
Real Time Big Data
 
Big data ecosystem
Big data ecosystemBig data ecosystem
Big data ecosystem
 
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendIntroducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
 
Big Data Ecosystem
Big Data EcosystemBig Data Ecosystem
Big Data Ecosystem
 
Earley Executive Roundtable - Building a Digital Transformation Roadmap
Earley Executive Roundtable - Building a Digital Transformation RoadmapEarley Executive Roundtable - Building a Digital Transformation Roadmap
Earley Executive Roundtable - Building a Digital Transformation Roadmap
 
Building New Data Ecosystem for Customer Analytics, Strata + Hadoop World, 2016
Building New Data Ecosystem for Customer Analytics, Strata + Hadoop World, 2016Building New Data Ecosystem for Customer Analytics, Strata + Hadoop World, 2016
Building New Data Ecosystem for Customer Analytics, Strata + Hadoop World, 2016
 

Similar to Data Science and What It Means to Library and Information Science

Organizational Implications of Data Science Environments in Education, Resear...
Organizational Implications of Data Science Environments in Education, Resear...Organizational Implications of Data Science Environments in Education, Resear...
Organizational Implications of Data Science Environments in Education, Resear...
Victoria Steeves
 

Similar to Data Science and What It Means to Library and Information Science (20)

Slides | Research data literacy and the library
Slides | Research data literacy and the librarySlides | Research data literacy and the library
Slides | Research data literacy and the library
 
Slides | Research data literacy and the library
Slides | Research data literacy and the librarySlides | Research data literacy and the library
Slides | Research data literacy and the library
 
2-6-14 ESI Supplemental Webinar: The Data Information Literacy Project
2-6-14 ESI Supplemental Webinar: The Data Information  Literacy Project2-6-14 ESI Supplemental Webinar: The Data Information  Literacy Project
2-6-14 ESI Supplemental Webinar: The Data Information Literacy Project
 
Realizing the Potential of Research Data by Carole L. Palmer
Realizing the Potential of Research Data by Carole L. Palmer Realizing the Potential of Research Data by Carole L. Palmer
Realizing the Potential of Research Data by Carole L. Palmer
 
Research Data Management in Academic Libraries: Meeting the Challenge
Research Data Management in Academic Libraries: Meeting the ChallengeResearch Data Management in Academic Libraries: Meeting the Challenge
Research Data Management in Academic Libraries: Meeting the Challenge
 
Managing 'Big Data' in the social sciences: the contribution of an analytico-...
Managing 'Big Data' in the social sciences: the contribution of an analytico-...Managing 'Big Data' in the social sciences: the contribution of an analytico-...
Managing 'Big Data' in the social sciences: the contribution of an analytico-...
 
Immersive informatics - research data management at Pitt iSchool and Carnegie...
Immersive informatics - research data management at Pitt iSchool and Carnegie...Immersive informatics - research data management at Pitt iSchool and Carnegie...
Immersive informatics - research data management at Pitt iSchool and Carnegie...
 
Data Services at a Liberal Arts College Library
Data Services at a Liberal Arts College LibraryData Services at a Liberal Arts College Library
Data Services at a Liberal Arts College Library
 
Services, policy, guidance and training: Improving research data management a...
Services, policy, guidance and training: Improving research data management a...Services, policy, guidance and training: Improving research data management a...
Services, policy, guidance and training: Improving research data management a...
 
Organizational Implications of Data Science Environments in Education, Resear...
Organizational Implications of Data Science Environments in Education, Resear...Organizational Implications of Data Science Environments in Education, Resear...
Organizational Implications of Data Science Environments in Education, Resear...
 
2015 03 19 (EDUCON2015) eMadrid UPM Towards a Learning Analytics Approach for...
2015 03 19 (EDUCON2015) eMadrid UPM Towards a Learning Analytics Approach for...2015 03 19 (EDUCON2015) eMadrid UPM Towards a Learning Analytics Approach for...
2015 03 19 (EDUCON2015) eMadrid UPM Towards a Learning Analytics Approach for...
 
User engagement in research data curation
User engagement in research data curationUser engagement in research data curation
User engagement in research data curation
 
Research data support: a growth area for academic libraries?
Research data support: a growth area for academic libraries?Research data support: a growth area for academic libraries?
Research data support: a growth area for academic libraries?
 
Sept 18 NISO Webinar: Research Data Curation, Part 2: Libraries and Big Data ...
Sept 18 NISO Webinar: Research Data Curation, Part 2: Libraries and Big Data ...Sept 18 NISO Webinar: Research Data Curation, Part 2: Libraries and Big Data ...
Sept 18 NISO Webinar: Research Data Curation, Part 2: Libraries and Big Data ...
 
Sediment Experimentalist Network (SEN): Sharing and reusing methods and data ...
Sediment Experimentalist Network (SEN): Sharing and reusing methods and data ...Sediment Experimentalist Network (SEN): Sharing and reusing methods and data ...
Sediment Experimentalist Network (SEN): Sharing and reusing methods and data ...
 
IFLA ARL Webinar Series: Research Ethics in an Open Research Environment
IFLA ARL Webinar Series: Research Ethics in an Open Research EnvironmentIFLA ARL Webinar Series: Research Ethics in an Open Research Environment
IFLA ARL Webinar Series: Research Ethics in an Open Research Environment
 
Services, policy, guidance and training: Improving research data management a...
Services, policy, guidance and training: Improving research data management a...Services, policy, guidance and training: Improving research data management a...
Services, policy, guidance and training: Improving research data management a...
 
Next generation data services at the Marriott Library
Next generation data services at the Marriott LibraryNext generation data services at the Marriott Library
Next generation data services at the Marriott Library
 
New Data, Same Skills: Applying Core Principles to New Needs in Data Curation
New Data, Same Skills: Applying Core Principles to New Needs in Data CurationNew Data, Same Skills: Applying Core Principles to New Needs in Data Curation
New Data, Same Skills: Applying Core Principles to New Needs in Data Curation
 
New Data, Same Skills: Applying Core Principles to New Needs in Data Curation
New Data, Same Skills: Applying Core Principles to New Needs in Data CurationNew Data, Same Skills: Applying Core Principles to New Needs in Data Curation
New Data, Same Skills: Applying Core Principles to New Needs in Data Curation
 

More from Jian Qin

Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08
Jian Qin
 
Developing Data Services to Support eScience/eResearch
Developing Data Services to Support eScience/eResearchDeveloping Data Services to Support eScience/eResearch
Developing Data Services to Support eScience/eResearch
Jian Qin
 
Scientific Data Management
Scientific Data ManagementScientific Data Management
Scientific Data Management
Jian Qin
 
Research literature review
Research literature reviewResearch literature review
Research literature review
Jian Qin
 

More from Jian Qin (12)

How Portable Are the Metadata Standards for Scientific Data?
How Portable Are the Metadata Standards for Scientific Data?How Portable Are the Metadata Standards for Scientific Data?
How Portable Are the Metadata Standards for Scientific Data?
 
Functional and Architectural Requirements for Metadata: Supporting Discovery...
Functional and Architectural Requirements for Metadata: Supporting Discovery...Functional and Architectural Requirements for Metadata: Supporting Discovery...
Functional and Architectural Requirements for Metadata: Supporting Discovery...
 
Survey research
Survey research Survey research
Survey research
 
Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08Data repositories -- Xiamen University 2012 06-08
Data repositories -- Xiamen University 2012 06-08
 
Developing Data Services to Support Scientific Data Management (v3)
Developing Data Services to Support Scientific Data Management (v3)Developing Data Services to Support Scientific Data Management (v3)
Developing Data Services to Support Scientific Data Management (v3)
 
Preparing eScience librarians -- RDAP 2012
Preparing eScience librarians -- RDAP 2012 Preparing eScience librarians -- RDAP 2012
Preparing eScience librarians -- RDAP 2012
 
Developing Data Services to Support eScience/eResearch
Developing Data Services to Support eScience/eResearchDeveloping Data Services to Support eScience/eResearch
Developing Data Services to Support eScience/eResearch
 
Scientific data management (v2)
Scientific data management (v2)Scientific data management (v2)
Scientific data management (v2)
 
Scientific Data Management
Scientific Data ManagementScientific Data Management
Scientific Data Management
 
Research literature review
Research literature reviewResearch literature review
Research literature review
 
Scholarly communication
Scholarly communicationScholarly communication
Scholarly communication
 
Linking Scientific Metadata (presented at DC2010)
Linking Scientific Metadata (presented at DC2010)Linking Scientific Metadata (presented at DC2010)
Linking Scientific Metadata (presented at DC2010)
 

Recently uploaded

Recently uploaded (20)

Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 

Data Science and What It Means to Library and Information Science

  • 1. Data Science and What It Means to Library and Information Science Jian Qin School of Information Studies Syracuse University iSpeaker Series at Sungkyunkwan University Seoul, Korea, December 8, 2015
  • 2. Agenda • What is data science? • What is a data scientist? • What areas of library work can benefit from data science? 212/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 3. 3 • What is data science? “An emerging area of work concerned with the collection, presentation, analysis, visualization, management, and preservation of large collections of information.” Stanton, J. (2012). Introduction to Data Science. http://ischool.syr.edu/media/documents/2012/3/DataScienc eBook1_1.pdf The whole lifecycle of data from collection to analysis to preservation LCAS DM workshop, Beijing, 201512/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 4. “We’re increasingly finding data in the wild, and data scientists are involved with gathering data, massaging it into a tractable form, making it tell its story, and presenting that story to others.” Loukides, M. (2011). What is data science? Sebastopol, CA: O’Reilly. What is data science? 4 Gathering and massaging data to tell its story 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 5. 5 A systematic enterprise that builds and organizes knowledge in the form of testable explanations and predictions. The study of the generalizable extraction of knowledge from data, which involves data and statistics or the systematic study of the organization, properties, and analysis of data and its role in inference, including our confidence in the inference. Dhar, V. (2013). Data science and prediction. Communications of the ACM, 56(12): 64-73. 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 6. Why is data science different from statistics and other existing disciplines? • Raw material, the “data” part of data science, is increasingly heterogeneous and unstructured and often emanating from networks with complex relationships between the entities. • Analysis of data requires integration, interpretation, and sense making that is increasingly derived through tools from computer science, linguistics, econometrics, sociology, and other disciplines. • Data are increasingly generated by computer and for computer consumption, that is, computers increasingly do background work for each other and make decisions automatically 612/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 7. 7 Dhar, V. (2013). Data science and prediction. Communications of the ACM, 56(12): 64-73, p. 64. 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 8. 8 Main fields in data science 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 9. What is a data scientist? • Math skills: Statistics and linear algebra • Computing skills: programming and infrastructure design • Able to communicate: ability to create narratives around their work • Ask the right questions: involves domain knowledge and expertise, coupled with a keen ability to see the problem, see the available data, and match up the two. 912/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 10. Analysis of data problems: Story 1 • Domain: Global migration studies • What’s involved: migrants, refuges, detention centers, refuge camps, Asylums, … • Data types: interview audio recordings, photos, articles, clippings, written notes, … • Analysis software: Atlas.ti, SPSS • Bottleneck problem: • difficulty in finding the data by person, interview, and related artifacts and in transforming the data into analysis software 1012/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea We’ve got a problem Researcher: How to use Atlas.ti? Data scientist: What data do you have? Data scientist: How do you collect them? Data scientist: What do you do with the data?
  • 11. Analysis of data problems: story 2 • Domain: Thermochronology and tectonics • Data types: Excel data files (lots of them), spectrum and microscopic images, annotations • Analysis: modeling by combining data from multiple data files with specialized software • Bottleneck problem: • manually matching/merging/filtering data is extremely cumbersome and the problem is compounded by the difficulty finding the right data files 1112/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea What is involved: workflows in a research lifecycle
  • 12. Analysis of data problem: story 3 • Domain: collaboration networks in a data repository • What’s involved: metadata describing DNA sequences • Data types: semi-structured data in plain text format • Analysis: identify entities and relationships, build the data into a database for querying and extraction • Bottleneck problems: • Extremely large data sets with multiple entities, which makes manual processing impossible • Disambiguation of author names and correctly linking between entities 1212/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 13. Analysis of data problems Analysis of domain data Requirement analysis Workflow analysis Data modeling Data transformation needs analysis Data provenance needs analysis Analysis of data problems is an analysis of domain data, requirements, and workflows that will lead to the development of solutions. 1312/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 14. Skills required to perform analysis of domain data problems Requirement analysis Workflow analysis Data modeling Data transformation needs analysis Data provenance needs analysis Interview skills, analysis and generalization skills Ability to capture components and sequences in workflows Ability to translate domain analysis into data models Ability to envision the data model within the larger system architecture 1412/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 15. Example 1: modeling research data for gravitational wave research 15 1. Understand research lifecycle 2. Workflows: steps and relationships 3. Data flows: what goes in and out at which step 4. Entities and attributes, relationships 5. Researcher’s practice and habits in documenting and managing data 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 16. Example 2: asking the right question in mining metadata 16 Metadata describing datasets is big data that can used to study: • Collaboration networks • Scholarly communication patterns • Research frontiers and trends • Knowledge transfer • Research impact assessment 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 17. What areas of library work can benefit from data science? 1712/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 18. Data services and data-driven services 18 Library Data services that support research, learning, and policy making (external) Data-driven services that support library planning, management, and evaluation (internal) Data literacy training Data discovery Data consulting Data mining Data collection Data integration 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 19. Data-drive organization • Consumer internet companies • Google, Amazon, Facebook, LinkedIn • Brick-mortar companies: • Walmart, UPS, FedEx, GE • “A data-driven organization acquires, processes, and leverage data in a timely fashion to create efficiencies, iterate on and develop new products, and navigate the competitive landscape...” 19 Is your library (company, research center, etc.) a data- driven organization? Patil, D.J. & Mason, H. (2015). Data Driven: Creating a Data Culture. Sebastopol, CA: O’Reilly Media, p. 6. 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 20. Data curation 20 “the active and ongoing management of data through its life cycle of interest and usefulness to scholarship, science, and education. Data curation activities enable data discovery and retrieval, maintain its quality, add value, and provide for reuse over time, and this new field includes authentication, archiving, management, preservation, retrieval, and representation.” –UIUC GSLIS 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 21. Data collection • Build data collections through • Institutional repositories • Community repositories • Developing tools for researchers to submit, manage, preserve, and discover data • Develop data collections • Specialized • Analysis-ready • Reusable • Actionable 21 • For library service planning, decision making, and evaluation • To support policy making, research, and learning 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 22. Data discovery • Complex data landscape: • International, national, regional • Disciplinary, community • Open access vs. closed access • Data sources for various purposes: • Utility data sources: open, reusable • Census data: open, but need additional processing/meshing to reach the analysis- ready state • Government data: open, reusable, but require additional processing • Disciplinary research data: access varies, require special knowledge to access and use 22 Data involving human subjects are under strict control by law and often follow additional compliance 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 23. Data consulting • Search, locate, and verify data for particular research purposes • Plan, design, and implement data curation and/or data analysis projects • Provide training and consulting for statistical methods and tools 2312/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 24. Data mining • Using internal data: • Users, uses, expenses, collections, staff • Goal: improve efficiencies and service quality • Using external data: • Trends and indicators in scholarly communication, technology, economy, and culture • Goal: adjust current services and plan for new services 2412/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 25. Data integration Data integration is the combination of technical and business processes used to combine data from disparate sources into meaningful and valuable information. --IBM, http://www.ibm.com/analytics/us/en/technology/data- integration/ 25 A process of understanding, cleansing, monitoring, transforming, and delivering data, which offers opportunities to develop data products as an infrastructure for research, learning, policymaking, and decision making. 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 26. A home buyer’s information integration 26 What houses for sale under $250K have at least 2 bathrooms, 2 bedrooms, a nearby school ranking in the upper third, in a neighborhood with below-average crime rate and diverse population? Information integration Realtor School rankings Crime rate Demographics 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 27. Research data integration Diabetes data and trends—Country level estimates: http://apps.nccd.cdc.gov/D DT_STRS2/NationalDiabet esPrevalenceEstimates.aspx ?mode=PHY ; Diabetes Data & Trends home page: http://apps.nccd.cdc.gov/dd tstrs/default.aspx 12/8/2015 27iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 28. Summary • Data science is not a new discipline, but rather, a new way of utilizing data, methods, and tools to ask the right questions in solving problems. • Practicing data science requires strong skills in math, computing, interpersonal communication, and asking the right questions • Libraries are at a strategic position in practicing data science. How to leverage this position relies on the • vision • courage of risk taking • knowledge of data science and related topics • careful planning • collaboration 2812/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea
  • 29. 12/8/2015 iSpeaker Series at Sungkyunkwan University, Seoul, Korea 29 Thank you! Questions?