Admin Data
Two-headed Dragon
Anatomy
• Two heads:
• increasing admin burden
• decreasing capacity to measure
• One body:
• no information (data) flows
Research
proposal
Research
activity
Person
Research
results
Financial
reporting
Funder
policies
Institutional
policies
Data
management
plans & infra
Impacts –
social, economic
& cultural
Substantive
reporting
Metrics
Research
services data
Budget
Research
classification
HQP
training
Data
ID
Person
ID
Outcomes
(e.g. Knowledge
advancement)
Regulatory
requirements
Ethics approval
& monitoring
Peer
review
Organization
ID
Contributor
roles
Collaborative
types
Outputs
Some elements of a complex ecosystem that we track
RESEARCH ADMINISTRATION DATA
All Funding
Agencies are…
All Institutions
are…
All Governments
are…
All Industry
Partners are…
...but each
in a silo
•Substantive
reporting
•Metrics
•Impacts –
social, economic
& cultural
•Outcomes
(e.g. Knowledge
advancement)
•Data ID
•Person ID
•Outputs
•Research
classification
•Funder
policies
•Financial
reporting
RESEARCH ADMINISTRATION DATA
The players and how they use research admin data
ID-ing, Defining,
Classifying,
Grouping:
People, Orgs,
Projects,
Equipment,
Investments,
Outputs, Impacts
•Budget
•Data
Management
plans & infra
•Regulatory
requirements
•Ethics approval
& monitoring
•Collaborative
types
•Peer
review
•Contributor
roles
•HQP
training
•Research
services
data
All Funding
Agencies are…
All Institutions
are…
All Governments
are…
All Industry
Partners are…
ID-ing, Defining,
Classifying,
Grouping:
People, Orgs,
Projects,
Equipment,
Investments,
Outputs, Impacts
•Budget
•Data
Management
plans & infra
•Regulatory
requirements
•Ethics approval
& monitoring
•Collaborative
types
•Peer
review
•Contributor
roles
•HQP
training
•Research
services
data
•Substantive
reporting
•Metrics
•Impacts –
social, economic
& cultural
•Outcomes
(e.g. Knowledge
advancement)
•Data ID
•Person ID
•Outputs
•Research
classification
•Funder
policies
•Financial
reporting
RESEARCH ADMINISTRATION DATA
Benefits of a practical, standards-based view
HOW DOES THE PROBLEM IMPACT KEY STAKEHOLDERS?
IMPLICATIONS
• RESEARCH TEAMS - time-
consuming to adhere to largely
common administrative requirements;
retype the same data repeatedly when
applying or reporting; 42% overhead
• ORGANIZATIONAL MANAGERS -
lack robust data to track their
operations and have evidence of the
difference their interventions make.
• POLICYMAKERS/EVALUATORS -
consistently frustrated by an inability to
draw meaningful conclusions from a
growing mountain of disconnected
data
• TOOL SUPPLIERS - must build
customized tools for each stakeholder
based on ‘silos’; harder to scale and
launch in new markets; more
expensive for each funder or
institutional client.
A USEFUL
ANALOGY
with thanks to:
Multiplicityof
Goods
Multipilicityof
methodsfor
transporting/st
oring
DoIworry
abouthow
goodsinteract
(e.g.coffee
beansnextto
spices)
CanItransport
quicklyand
smoothly
(e.g.fromboat
totraintotruck)
Cargo Transport Pre-1960
? ? ? ? ? ? ?
? ? ? ? ? ? ?
? ? ? ? ? ? ?
? ? ? ? ? ? ?
? ? ? ? ? ? ?
? ? ? ? ? ? ?
Also an NxN Matrix
Multiplicityof
Goods
Multiplicityof
methodsfor
transporting/stori
ng
DoIworryabout
howgoods
interact(e.g.
coffeebeans
nexttospices)
CanItransportquicklyand
smoothly
(e.g.fromboattotrainto
truck)
Solution: Intermodal Shipping Container
…in between, can be loaded and
unloaded, stacked, transported
efficiently over long distances, and
transferred from one mode of
transport to another
A standard container that is
loaded with virtually any goods,
and stays sealed until it reaches
final delivery.
This eliminated the NXN problem…
and spawned an Intermodal Shipping Container Ecosystem
• 90% of all cargo now shipped in a standard container
• Order of magnitude reduction in cost and time to load
and unload ships
• Massive reduction in losses due to theft or damage
• Huge reduction in freight cost as percent of final goods
(from >25% to <3%)
massive globalizations
• 5000 ships deliver 200M containers per year
INSTITUTIO
N
? ? ? ? ?
INSTITUTIO
N
? ? ? ? ?
INSTITUTIO
N
? ? ? ? ?
FUNDER ? ? ? ? ?
FUNDER ? ? ? ? ?
FUNDER ? ? ? ? ?
INDUSTRY ? ? ? ? ?
INDUSTRY ? ? ? ? ?
INSTITUTIO INSTITUTIO
RESEARCH ADMINISTRATION INTEROPERABILITY NXN PROBLEM
Open standards are a
shipping container system
for research administration
INSTITUTIO
N
INSTITUTIO
N
INSTITUTIO
N
FUNDER
FUNDER
FUNDER
INDUSTRY
INDUSTRY
INSTITUTI INSTITUTI
CASRAI VIEW OF RESEARCH ADMINISTRATION
• Neutral body convening/facilitating the table
• Known community leaders (chairs) as champions coordinators (volition)
• Representative subject experts (working groups) focus on the content
• Scope containment - small projects that fit into a larger whole
• Unambiguous agreements for IT/software experts
• Standardize the policy agreements - a common reporting format
• Least imperfect solution to a hard problem
WHERE OPEN STANDARDS FIT

Dragon slides_David Baker

  • 1.
  • 2.
    Anatomy • Two heads: •increasing admin burden • decreasing capacity to measure • One body: • no information (data) flows
  • 3.
    Research proposal Research activity Person Research results Financial reporting Funder policies Institutional policies Data management plans & infra Impacts– social, economic & cultural Substantive reporting Metrics Research services data Budget Research classification HQP training Data ID Person ID Outcomes (e.g. Knowledge advancement) Regulatory requirements Ethics approval & monitoring Peer review Organization ID Contributor roles Collaborative types Outputs Some elements of a complex ecosystem that we track RESEARCH ADMINISTRATION DATA
  • 4.
    All Funding Agencies are… AllInstitutions are… All Governments are… All Industry Partners are… ...but each in a silo •Substantive reporting •Metrics •Impacts – social, economic & cultural •Outcomes (e.g. Knowledge advancement) •Data ID •Person ID •Outputs •Research classification •Funder policies •Financial reporting RESEARCH ADMINISTRATION DATA The players and how they use research admin data ID-ing, Defining, Classifying, Grouping: People, Orgs, Projects, Equipment, Investments, Outputs, Impacts •Budget •Data Management plans & infra •Regulatory requirements •Ethics approval & monitoring •Collaborative types •Peer review •Contributor roles •HQP training •Research services data
  • 5.
    All Funding Agencies are… AllInstitutions are… All Governments are… All Industry Partners are… ID-ing, Defining, Classifying, Grouping: People, Orgs, Projects, Equipment, Investments, Outputs, Impacts •Budget •Data Management plans & infra •Regulatory requirements •Ethics approval & monitoring •Collaborative types •Peer review •Contributor roles •HQP training •Research services data •Substantive reporting •Metrics •Impacts – social, economic & cultural •Outcomes (e.g. Knowledge advancement) •Data ID •Person ID •Outputs •Research classification •Funder policies •Financial reporting RESEARCH ADMINISTRATION DATA Benefits of a practical, standards-based view
  • 6.
    HOW DOES THEPROBLEM IMPACT KEY STAKEHOLDERS? IMPLICATIONS • RESEARCH TEAMS - time- consuming to adhere to largely common administrative requirements; retype the same data repeatedly when applying or reporting; 42% overhead • ORGANIZATIONAL MANAGERS - lack robust data to track their operations and have evidence of the difference their interventions make. • POLICYMAKERS/EVALUATORS - consistently frustrated by an inability to draw meaningful conclusions from a growing mountain of disconnected data • TOOL SUPPLIERS - must build customized tools for each stakeholder based on ‘silos’; harder to scale and launch in new markets; more expensive for each funder or institutional client.
  • 7.
  • 8.
  • 9.
    ? ? ?? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? Also an NxN Matrix
  • 10.
    Multiplicityof Goods Multiplicityof methodsfor transporting/stori ng DoIworryabout howgoods interact(e.g. coffeebeans nexttospices) CanItransportquicklyand smoothly (e.g.fromboattotrainto truck) Solution: Intermodal ShippingContainer …in between, can be loaded and unloaded, stacked, transported efficiently over long distances, and transferred from one mode of transport to another A standard container that is loaded with virtually any goods, and stays sealed until it reaches final delivery.
  • 11.
    This eliminated theNXN problem…
  • 12.
    and spawned anIntermodal Shipping Container Ecosystem • 90% of all cargo now shipped in a standard container • Order of magnitude reduction in cost and time to load and unload ships • Massive reduction in losses due to theft or damage • Huge reduction in freight cost as percent of final goods (from >25% to <3%) massive globalizations • 5000 ships deliver 200M containers per year
  • 13.
    INSTITUTIO N ? ? ?? ? INSTITUTIO N ? ? ? ? ? INSTITUTIO N ? ? ? ? ? FUNDER ? ? ? ? ? FUNDER ? ? ? ? ? FUNDER ? ? ? ? ? INDUSTRY ? ? ? ? ? INDUSTRY ? ? ? ? ? INSTITUTIO INSTITUTIO RESEARCH ADMINISTRATION INTEROPERABILITY NXN PROBLEM
  • 14.
    Open standards area shipping container system for research administration
  • 15.
  • 16.
    • Neutral bodyconvening/facilitating the table • Known community leaders (chairs) as champions coordinators (volition) • Representative subject experts (working groups) focus on the content • Scope containment - small projects that fit into a larger whole • Unambiguous agreements for IT/software experts • Standardize the policy agreements - a common reporting format • Least imperfect solution to a hard problem WHERE OPEN STANDARDS FIT