MANAGING DATA IN A UNIQUE
ENVIRONMENT?
CONNECT: SMART SEMINAR SERIES
Data 101
SMART data environment
IT systems and demonstration
data 101
data 101
What is data?
data 101
What is data?
A result of measurements whereby the
material, regardless of format, is
intended to be analysed, such as the
basis of graphs, images, or observations
of a set of variables. It refers to the
qualitative or quantitative attributes of a
variable or a set of variables.
UOW Research Data Management Policy
data 101
What is data?
A result of measurements whereby the
material, regardless of format, is
intended to be analysed, such as the
basis of graphs, images, or observations
of a set of variables. It refers to the
qualitative or quantitative attributes of a
variable or a set of variables.
UOW Research Data Management Policy
data 101
What is metadata?
data 101
What is metadata? data
data 101
What is metadata? data about data
data 101
What is metadata? data about data
Effective dates
Train Line
Format
data 101
What is metadata? data about data
Coordinate system
Resolution
Bounding box
Effective dates
Train Line
Format
data 101
What is metadata? data about data
Description
Nodes
Owner
Updates
Effective dates
Train Line
Format
Coordinate system
Resolution
Bounding box
data 101
What is metadata? data about data
Geo-Location
Volume
Date sent
Effective dates
Train Line
Format
Coordinate system
Resolution
Bounding box
Description
Nodes
Owner
Updates
data 101
What is metadata? data about data
Sample size
Methodology
Technique
Effective dates
Train Line
Format
Description
Nodes
Owner
Updates
Coordinate system
Resolution
Bounding box
Geo-Location
Volume
Date sent
data 101
What is metadata?
Anything that can
be used to
describe data and
facilitate the
discovery of data
data 101
Licencing
data 101
Licencing
• A data licence is usually between organisations
data 101
Licencing
• A data licence is usually between organisations
data 101
Licencing
• A data licence is usually between organisations
• Researchers sign a Data Access
Agreement to use the Data
data 101
Licencing
• A data licence will address any conditions around the
use of the data
data 101
Licencing
• Projects
Commercial
Consultancy
Non Commercial
• Research and Teaching
• Storage
• Retention
• A data licence will address any conditions around the
use of the data
data 101
Licencing
• Projects
Commercial
Consultancy
Non Commercial
• Research and Teaching
• Storage
• Retention
• A data licence will address any conditions around the
use of the data
• People
• Publications
• Privacy
• Confidentiality
• Updates
• Other!
data 101
Questions
Data
Metadata
Data Licences
SMART data environment
3 Labs
The Infrastructure
Economics and
Governance Laboratory.
The Infrastructure Data
and Simulation
Laboratory.
The SMART Rail Logistics
Laboratory
SMART data environment
3 Labs
The Infrastructure
Economics and
Governance Laboratory.
The Infrastructure Data
and Simulation
Laboratory.
The SMART Rail Logistics
Laboratory
5 Research Groups
Advanced Geomatics for Regional and Urban
Planning
Computer Intelligence for Optimal Decisions and
Operations
Computer Simulation for Sustainable Transport
Systems
Geo-social Intelligence for Urban Resilience and
Liveability
Social Simulation for Demographic Dynamics
and Transitions
SMART data environment
3 Labs
The Infrastructure
Economics and
Governance Laboratory.
The Infrastructure Data
and Simulation
Laboratory.
The SMART Rail Logistics
Laboratory
5 Research Groups
Advanced Geomatics for Regional and Urban
Planning
Computer Intelligence for Optimal Decisions and
Operations
Computer Simulation for Sustainable Transport
Systems
Geo-social Intelligence for Urban Resilience and
Liveability
Social Simulation for Demographic Dynamics
and Transitions
SMART data environment
5 Research Groups
Advanced Geomatics for Regional and Urban
Planning
Computer Intelligence for Optimal Decisions and
Operations
Computer Simulation for Sustainable Transport
Systems
Geo-social Intelligence for Urban Resilience and
Liveability
Social Simulation for Demographic Dynamics
and Transitions
SMART data environment
5 Research Groups
Advanced Geomatics for Regional and Urban
Planning
Computer Intelligence for Optimal Decisions and
Operations
Computer Simulation for Sustainable Transport
Systems
Geo-social Intelligence for Urban Resilience and
Liveability
Social Simulation for Demographic Dynamics
and Transitions
SMART data environment
SMART data environment
SMART data environment
SMART data environment
SMART data environment
SMART data environment
SMART data environment
Shaping the Sydney of Tomorrow
SMART Infrastructure Dashboard
Petajakarta.org
UOW Traffic Modelling
Vision Illawarra
Illawarra Data Hub
Railway Constraint Modelling - PKPC
Value of Health Interventions for Heroin Use
Cancer Radiotherapy Modelling Project
Infrastructure Cost Drivers
Vehicle Routing with Time Windows
SMART data environment
Shaping the Sydney of Tomorrow
SMART Infrastructure Dashboard
Petajakarta.org
UOW Traffic Modelling
Vision Illawarra
Illawarra Data Hub
Railway Constraint Modelling - PKPC
Value of Health Interventions for Heroin Use
Cancer Radiotherapy Modelling Project
Infrastructure Cost Drivers
Vehicle Routing with Time Windows
SMART data environment
Shaping the Sydney of Tomorrow
SMART Infrastructure Dashboard
Petajakarta.org
UOW Traffic Modelling
Vision Illawarra
Illawarra Data Hub
Railway Constraint Modelling - PKPC
Value of Health Interventions for Heroin Use
Cancer Radiotherapy Modelling Project
Infrastructure Cost Drivers
Vehicle Routing with Time Windows
SMART data environment
SMART data environment
SMART data environment
SMART data environment
• Join SMART
• Join one or more research groups
• Those groups are working on one or more projects
• Each project has its own data requirements
• Each dataset has licencing restrictions
• Sign a Data Access Agreement
• Given access to data
SMART data environment
SMART data environment
SMART data environment
• Join SMART
• Join one or more research groups
• Those groups are working on one or more projects
• Each project has its own data requirements
• Each dataset has licencing restrictions
• Sign a Data Access Agreement
• Given access to data
SMART data environment
SMART data environment
SMART data environment
• Join SMART
• Join one or more research groups
• Those groups are working on one or more projects
• Each project has its own data requirements
• Each dataset has licencing restrictions
• Sign a Data Access Agreement
• Given access to data
SMART data environment
SMART data environment
The mission is to meet all the
conditions of our data licences
and at the same time give
visibility to all researchers over
all our data
SMART data environment
SMART data environment
IT systems
Shared Drive
Metadata System
Geospatial Crawler
SharePoint
Dashboard
Shared Drive
Shared Drive
• One shared drive for all data – 1.1 TB (yesterday)
• All SMART researchers get access to this drive
• ITS created a PowerShell script that then allows
the data manager to create folders within the drive
• Researchers are then added to the folders
• Access to data as per data Licence
Shared Drive
• One shared drive for all data – 1.1 TB (yesterday)
• All SMART researchers get access to this drive
• ITS created a PowerShell script that then allows
the data manager to create folders within the drive
• Researchers are then added to the folders
• Access to data as per data Licence
IT systems
Metadata System
• GeoNetwork 2.10 – Geospatial Metadata Catalogue
• Immediate search access to local and distributed
geospatial catalogues
• Up - and downloading of data, graphics, documents,
pdf files and any other content type
• An interactive Web Map Viewer to combine Web
Map Services from distributed servers around the
world
• Online editing of metadata with a powerful
template system
• Scheduled harvesting and synchronization of
metadata between distributed catalogs
• Support for OGC-CSW 2.0.2 ISO Profile
(19115/19119), OAI-PMH, Z39.50 protocols
• Fine-grained access control with group and user
management
• Multi-lingual user interface
• With the UOW Library’s help we can assign DOIs to
records
Quick plug for the Library
The Library is able to help with
information about publishing,
sharing, and re-use of data;
advice about metadata; as well
as issues around copyright and
licensing. Please contact the
Library for more info.
IT systems
Metadata System
• GeoNetwork 2.10 – Geospatial Metadata Catalogue
• Immediate search access to local and distributed
geospatial catalogues
• Up - and downloading of data, graphics, documents,
pdf files and any other content type
• An interactive Web Map Viewer to combine Web
Map Services from distributed servers around the
world
• Online editing of metadata with a powerful
template system
• Scheduled harvesting and synchronization of
metadata between distributed catalogs
• Support for OGC-CSW 2.0.2 ISO Profile
(19115/19119), OAI-PMH, Z39.50 protocols
• Fine-grained access control with group and user
management
• Multi-lingual user interface
• With the UOW Library’s help we can attached DOIs
to records
IT systems
Shared Drive
Metadata System
Geospatial Crawler
SharePoint
Dashboard
Questions

SMART Seminar Series: SMART Data Management

  • 1.
    MANAGING DATA INA UNIQUE ENVIRONMENT? CONNECT: SMART SEMINAR SERIES
  • 2.
    Data 101 SMART dataenvironment IT systems and demonstration
  • 3.
  • 4.
  • 5.
    data 101 What isdata? A result of measurements whereby the material, regardless of format, is intended to be analysed, such as the basis of graphs, images, or observations of a set of variables. It refers to the qualitative or quantitative attributes of a variable or a set of variables. UOW Research Data Management Policy
  • 6.
    data 101 What isdata? A result of measurements whereby the material, regardless of format, is intended to be analysed, such as the basis of graphs, images, or observations of a set of variables. It refers to the qualitative or quantitative attributes of a variable or a set of variables. UOW Research Data Management Policy
  • 7.
  • 8.
    data 101 What ismetadata? data
  • 9.
    data 101 What ismetadata? data about data
  • 10.
    data 101 What ismetadata? data about data Effective dates Train Line Format
  • 11.
    data 101 What ismetadata? data about data Coordinate system Resolution Bounding box Effective dates Train Line Format
  • 12.
    data 101 What ismetadata? data about data Description Nodes Owner Updates Effective dates Train Line Format Coordinate system Resolution Bounding box
  • 13.
    data 101 What ismetadata? data about data Geo-Location Volume Date sent Effective dates Train Line Format Coordinate system Resolution Bounding box Description Nodes Owner Updates
  • 14.
    data 101 What ismetadata? data about data Sample size Methodology Technique Effective dates Train Line Format Description Nodes Owner Updates Coordinate system Resolution Bounding box Geo-Location Volume Date sent
  • 15.
    data 101 What ismetadata? Anything that can be used to describe data and facilitate the discovery of data
  • 16.
  • 17.
    data 101 Licencing • Adata licence is usually between organisations
  • 18.
    data 101 Licencing • Adata licence is usually between organisations
  • 19.
    data 101 Licencing • Adata licence is usually between organisations • Researchers sign a Data Access Agreement to use the Data
  • 20.
    data 101 Licencing • Adata licence will address any conditions around the use of the data
  • 21.
    data 101 Licencing • Projects Commercial Consultancy NonCommercial • Research and Teaching • Storage • Retention • A data licence will address any conditions around the use of the data
  • 22.
    data 101 Licencing • Projects Commercial Consultancy NonCommercial • Research and Teaching • Storage • Retention • A data licence will address any conditions around the use of the data • People • Publications • Privacy • Confidentiality • Updates • Other!
  • 23.
  • 24.
  • 25.
    3 Labs The Infrastructure Economicsand Governance Laboratory. The Infrastructure Data and Simulation Laboratory. The SMART Rail Logistics Laboratory SMART data environment
  • 26.
    3 Labs The Infrastructure Economicsand Governance Laboratory. The Infrastructure Data and Simulation Laboratory. The SMART Rail Logistics Laboratory 5 Research Groups Advanced Geomatics for Regional and Urban Planning Computer Intelligence for Optimal Decisions and Operations Computer Simulation for Sustainable Transport Systems Geo-social Intelligence for Urban Resilience and Liveability Social Simulation for Demographic Dynamics and Transitions SMART data environment
  • 27.
    3 Labs The Infrastructure Economicsand Governance Laboratory. The Infrastructure Data and Simulation Laboratory. The SMART Rail Logistics Laboratory 5 Research Groups Advanced Geomatics for Regional and Urban Planning Computer Intelligence for Optimal Decisions and Operations Computer Simulation for Sustainable Transport Systems Geo-social Intelligence for Urban Resilience and Liveability Social Simulation for Demographic Dynamics and Transitions SMART data environment
  • 28.
    5 Research Groups AdvancedGeomatics for Regional and Urban Planning Computer Intelligence for Optimal Decisions and Operations Computer Simulation for Sustainable Transport Systems Geo-social Intelligence for Urban Resilience and Liveability Social Simulation for Demographic Dynamics and Transitions SMART data environment
  • 29.
    5 Research Groups AdvancedGeomatics for Regional and Urban Planning Computer Intelligence for Optimal Decisions and Operations Computer Simulation for Sustainable Transport Systems Geo-social Intelligence for Urban Resilience and Liveability Social Simulation for Demographic Dynamics and Transitions SMART data environment
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
    Shaping the Sydneyof Tomorrow SMART Infrastructure Dashboard Petajakarta.org UOW Traffic Modelling Vision Illawarra Illawarra Data Hub Railway Constraint Modelling - PKPC Value of Health Interventions for Heroin Use Cancer Radiotherapy Modelling Project Infrastructure Cost Drivers Vehicle Routing with Time Windows SMART data environment
  • 37.
    Shaping the Sydneyof Tomorrow SMART Infrastructure Dashboard Petajakarta.org UOW Traffic Modelling Vision Illawarra Illawarra Data Hub Railway Constraint Modelling - PKPC Value of Health Interventions for Heroin Use Cancer Radiotherapy Modelling Project Infrastructure Cost Drivers Vehicle Routing with Time Windows SMART data environment
  • 38.
    Shaping the Sydneyof Tomorrow SMART Infrastructure Dashboard Petajakarta.org UOW Traffic Modelling Vision Illawarra Illawarra Data Hub Railway Constraint Modelling - PKPC Value of Health Interventions for Heroin Use Cancer Radiotherapy Modelling Project Infrastructure Cost Drivers Vehicle Routing with Time Windows SMART data environment
  • 39.
  • 40.
  • 41.
    SMART data environment •Join SMART • Join one or more research groups • Those groups are working on one or more projects • Each project has its own data requirements • Each dataset has licencing restrictions • Sign a Data Access Agreement • Given access to data
  • 42.
  • 43.
  • 44.
    SMART data environment •Join SMART • Join one or more research groups • Those groups are working on one or more projects • Each project has its own data requirements • Each dataset has licencing restrictions • Sign a Data Access Agreement • Given access to data
  • 45.
  • 46.
  • 47.
    SMART data environment •Join SMART • Join one or more research groups • Those groups are working on one or more projects • Each project has its own data requirements • Each dataset has licencing restrictions • Sign a Data Access Agreement • Given access to data
  • 48.
  • 49.
    SMART data environment Themission is to meet all the conditions of our data licences and at the same time give visibility to all researchers over all our data
  • 50.
  • 51.
  • 53.
    IT systems Shared Drive MetadataSystem Geospatial Crawler SharePoint Dashboard
  • 54.
  • 55.
    Shared Drive • Oneshared drive for all data – 1.1 TB (yesterday) • All SMART researchers get access to this drive • ITS created a PowerShell script that then allows the data manager to create folders within the drive • Researchers are then added to the folders • Access to data as per data Licence
  • 56.
    Shared Drive • Oneshared drive for all data – 1.1 TB (yesterday) • All SMART researchers get access to this drive • ITS created a PowerShell script that then allows the data manager to create folders within the drive • Researchers are then added to the folders • Access to data as per data Licence
  • 57.
    IT systems Metadata System •GeoNetwork 2.10 – Geospatial Metadata Catalogue • Immediate search access to local and distributed geospatial catalogues • Up - and downloading of data, graphics, documents, pdf files and any other content type • An interactive Web Map Viewer to combine Web Map Services from distributed servers around the world • Online editing of metadata with a powerful template system • Scheduled harvesting and synchronization of metadata between distributed catalogs • Support for OGC-CSW 2.0.2 ISO Profile (19115/19119), OAI-PMH, Z39.50 protocols • Fine-grained access control with group and user management • Multi-lingual user interface • With the UOW Library’s help we can assign DOIs to records
  • 58.
    Quick plug forthe Library The Library is able to help with information about publishing, sharing, and re-use of data; advice about metadata; as well as issues around copyright and licensing. Please contact the Library for more info.
  • 59.
    IT systems Metadata System •GeoNetwork 2.10 – Geospatial Metadata Catalogue • Immediate search access to local and distributed geospatial catalogues • Up - and downloading of data, graphics, documents, pdf files and any other content type • An interactive Web Map Viewer to combine Web Map Services from distributed servers around the world • Online editing of metadata with a powerful template system • Scheduled harvesting and synchronization of metadata between distributed catalogs • Support for OGC-CSW 2.0.2 ISO Profile (19115/19119), OAI-PMH, Z39.50 protocols • Fine-grained access control with group and user management • Multi-lingual user interface • With the UOW Library’s help we can attached DOIs to records
  • 60.
    IT systems Shared Drive MetadataSystem Geospatial Crawler SharePoint Dashboard
  • 61.