The document discusses research data services in Australia including Research Data Services (RDS), the Australian National Data Service (ANDS), National eResearch Collaboration Tools and Resources (NeCTAR), the Australian Access Federation (AAF), and Australia's Academic Research Network (AARNET). It outlines the research data lifecycle and proposes components for a national research data system, including provisioning, storage, processing, and archiving capabilities. Examples are provided for how different types of research projects could interact with such a system.

1. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
RDS
/
AAF
/
ANDS
/
NeCTAR /
AARNET
Data
Lifecycle
Project

2. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
RDS
– Research
Data
Services
*
ANDS
– Australian
National
Data
Service
*
NeCTAR – National
eResearch Collaboration
Tools
and
Resources
*
AAF
– The
Australian
Access
Federation
AARNET
– Australia’s
Academic
Research
Network
*
funded
by
the
National
Collaborative
Research
Infrastructure
Strategy
(NCRIS)
Data
Lifecycle
Project

3. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
What
is
the
research
data
lifecycle?
Creation
/
Discovery
Description
/
Provenance
Integration/
Storage
Analysis
/
Manipulation
Preserve
/
Archive
/
Discard

4. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
Another
way
of
looking
at
it
http://www.lib.ua.edu/wiki/sura/index.php/Data_Life_Cycle_M odels

5. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
And
another
http://www.lib.ua.edu/wiki/sura/index.php/Data_Life_Cycle_M odels

6. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
ingest share
dropbox-­‐like
process
inc NCI,
Pawsey,
local
HPC,
etc
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
Research Data Australia
Data Lifecycle Project –
Existing components / Services
process
Various
Storage
Resources
Existing Components/Services

7. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
Provisioning /
Access /
Provenancemetadata db
ingest share
dropbox-­‐like
process
inc NCI,
Pawsey,
local
HPC,
etc
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
Research Data Australia
Data Lifecycle Project –
Proposed new components:
process
National
Storage
Resources
Proposed New/Enhanced Components

8. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
PAP portal
metadata db
ingest share
dropbox-­‐like
process
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
6
1
3
4
5
6
2
Researchers access grants database which indicates which grants they ‘own’ or have
access to. This “surrounding” metadata is registered with the metadata db.
Space marked with this metadata is provisioned on dropbox-­like storage which is visible
to the NeCTAR cloud – this space should belong to a project, not a person.
Automated and manual ingest processes feed data to this store, harvesting additional
metadata where possible and relevant
Provisioned space should be as dropbox like as possible.
Storage is immediately visible to NeCTAR cloud and processes developed to ship data
to local HPC or peak facilities using existing high-­speed networks and tools
Once project is complete, the data is packaged and shipped to and indexed by the
relevant domain repository as well as registered with the RDA index. Research Data Australia
Data Lifecycle Project –
All components
process 5
National
Storage
Resources
2
Possible Project Components

9. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
metadata db
ingest share
dropbox-­‐like
processing
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
6
1
3
4
5
6
2
“What can I access?”
“How can I feed my data into it?”
“How can I share and use it with my group and my collaborators?”
“Can I process it on the Cloud?” “And here at Uni of X?” “I need a bigger machine..”
”I’ve finished my project and I think this data could be useful to someone in the future, please
pack it away and make it available somehow”
“I don’t want to share it just yet, please hold on to it and let me know if someone wants access”Research Data Australia
Provisioning
(phase
1)
Use
(phase
2)
archive/publish/share/reuse/discard
(phase
3)
Data Lifecycle Project
Outline – phases/workflows
processing 5
“Where is it?”
National
Storage
Resources
2
Phases / Workflows
PAP portal

10. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
metadata db
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
Research Data Australia
RDS
NeCTAR
ANDS
Data Lifecycle Project
Potential Areas of Responsibility
AAF
AARNet
ingest share
dropbox-­‐like
process
inc NCI,
Pawsey,
local
HPC,
etc
process
Trove, VL’s, A1’s etc
cloudstor?
High speed
data shipping
Mediaflux/aspera?
Medici? GPFS?
neutron?
manta?ORCiD?
mediaflux?
Dublin core?
figshare?
In house, hybrid, 3rd
party cloud?
Do we need to pick one? Can we interface with many?
Local stores, AWS, DropBox, Box, Others?
National
Storage
Resources
Others
(eg unis,
NCRIS
projects,
etc)
Possible Project Areas of Responsibility
PAP portal
Identity
/
Authorisation /
Access
Identity
/
Authorisation /
Access

11. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
metadata db
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
Research Data Australia
Doesn’t
exist
Exists
fully
Exists
Partially
Data Lifecycle Project
Existing components or
parts of components
ingest share
dropbox-­‐like
process
inc NCI,
Pawsey,
local
HPC,
etc
process
National
Storage
Resources
PAP portal
Identity
/
Authorisation /
Access
Identity
/
Authorisation /
Access

12. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
NeCTAR/RDSI
Storage
metadata db
ingest share
dropbox-­‐like
processing
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 Domain / VL portal
repo
1 repo
2
Domain
/
VL
repo
2
Research Data Australia
Example:
RDS A1 Projects &
NeCTAR Virtual Labs
Do not have a need for dropbox like sharing
or peak compute
processing 5
6
Examples: Virtual Lab
PAP portal

13. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
National
grants db
Local
Storage
metadata db
ingest share
dropbox-­‐like
processing
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 Uni Research Data portal
repo
1 repo
2
Local
repo
2
Research Data Australia
Example:
University Workflow
Do not have a need for dropbox like sharing
or peak compute
processing 5
6
Examples: University
PAP portal
Local
grants db Ethics db

14. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
Local
HPC
File
System
metadata db
ingest share
dropbox-­‐like
processing
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
2
Research Data Australia
Example:
HPC Workflow
Does not have a need for dropbox like sharing
or shoulder compute
processing 5
6
Examples: High Performance Computing
PAP portal

15. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
metadata db
ingest share
dropbox-­‐like
processing
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
2
Research Data Australia
Example:
National Cloudstor
/ OwnCloud
Focusses on the ‘long tail’ and does have
a need for dropbox like sharing and easy access
to cloud processing platforms
processing 5
6
Examples: AARNet Cloudstor
PAP portal

16. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
ingestprovisioning
researchers
projects
grants db
metadata db
share
dropbox-­‐like
processing
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 portal 3
repo
1 repo
2 repo
3
2
Research Data Australia
Example:
OwnCloud
Federation
processing 5
6
Uni A Uni B
(uses the national
provisioning portal)
Uni C
Uni A
provisioning
portal
Uni C
provisioning
portal
Examples: OwnCloud Federation
PAP portal
2 2 2

17. Research
Data
Services
Icons
made
by Freepik from www.flaticon.com
provisioning
researchers
projects
grants db
Amazon
S3
metadata db
ingest share
dropbox-­‐like
processing
inc NCI,
Pawsey,
local
HPC,
etc
1 3 4 5
portal 1 portal 2 portal 3
repo
1 repo
2
Glacier
2
Research Data Australia
Example:
Amazon
Also focusses on the ‘long tail’ and has a need
for dropbox like sharing and easy access
to highly-­elastic and integrated infrastructure
EC
2 5
6
Examples: Amazon
PAP portal