SlideShare a Scribd company logo
1 of 38
Many Kinds of Infrastructure:
Resolving and Advancing Ecosystem Data
Collection and Analysis Methods Within and
Between Disciplines
 By:
 Stuart Phinn, Alex Held, Andrew Lowe, Nikki Thurgate, Tim
 Clancy, Mike Grundy, Helen Cleugh Mike Liddell, and Eva van
 Gorsel
Presentation Aim

To demonstrate how shared national research
infrastructure, such as TERN, enables the development
of a consensus on methods and products.
Contents
1. The realities of funding and supporting ecosystem science

2. Whose science is it anyway?

3. A framework for cooperation and collaboration

4. Examples of coordinated ecosystem science
1. The realities of funding and supporting
                ecosystem science

•     The Scope of Ecosystem Science

•     Ecosystem Science Infrastructure

•     Funding Ecosystem Science Infrastructure
•   The Scope of Ecosystem Science ?

•   Multi-disciplinary and multiple agencies

•   Ecological to bio-geophysical




                                               Source: www.fas.org
•   Data collection, storage , analysis,
    modelling and visualisation

•   Science to policy, management
    and industry
•     Ecosystem science research infrastructure




          Collection                 Data                      Data                                        Policy +
           Methods                  Storage                   Sharing               Modelling             Management




Instruments            Processing             Data Curation               Data                   Analysis
  + Sensors            + Analysis              + Publishing             Searching               + Synthesis
•     Funding Ecosystem Science Infrastructure – Funding Sources

                  • Australian Government – NCRIS and EIF
                  • Australian Research Council - Linkage Infrastructure

          Collection                 Data                      Data                                        Policy +
           Methods                  Storage                   Sharing               Modelling             Management




Instruments            Processing             Data Curation               Data                   Analysis
  + Sensors            + Analysis              + Publishing             Searching               + Synthesis

   •   State Governments
   •   Agency/Organisation                                              • Australian Research Council
   •   Professional Societies                                           • Australian Government
   •   Private Industry Partnerships
   •   Philanthropic Donations
•     Funding Ecosystem Science Infrastructure – Funding Sources
 •     Current competitive funding levels and process for ecosystem
       research in Australia are inefficient and un-sustainable for
       engaging the ecosystem science communities.
                                Development of ideas

                              Compile funding Proposal


                Project funded                           Project not funded

             20-30 %
          Data processing and analysis
                                                           80-70 %
                                                            ???????
Interpretation of results, specification of findings]
        applications                                     applications
Publishing of papers        Publishing data


                                   Body of knowledge for
                    UNDERSTANDING + MANAGING AUSTRALIAN ECOSYSTEMS?
2. Whose science is it anyway?

•   Science and Research

•   Data to Research to Publication

•   Licences – Why and How?
•   Science and Research Domains
•   Data to Research to Publication

                         Development of ideas


                                 Funding


             Design of project and data collection-analysis


                             Data collection


                      Data processing and analysis


           Interpretation of results, specification of findings]


           Writing, revision and publishing of paper and data
•   Licences – Why ?

•   To make sure that:
        - Data are use for purpose(s) intended
        - Data provider is not liable
        - Data are cited correctly




                                        0   2500
•   Licences – How?

•   TERN licensing implementation process



•    TERN data providers Deed
 “ensures that both the data provider and
subsequent users have a clear understanding of
the basis upon which data has been provided, and
upon which TERN and its Facilities can hold, use
and disseminate data.”
•    Every scientist should be publishing their data?


    • What I do is no one else’s business

    • I couldn’t be bothered; it’s too much work

    • No one reads it anyway
3. A Framework for
         cooperation and collaboration
•   Ecosystem Science Research Cycle

•   Ecosystem Science Activities
    (collection, processing, analysis and storage)

•   Types and Levels of Cooperation and Collaboration
•     Ecosystem Science Research Data Cycle

                           Ecosystem Science

                           Enhanced ability to
Research output:          revise, question and         Knowledge gap:
 new data and              expand knowledge               research
  publications                                           questions

                                                   r

 Data analysis,
                                                         Proposal and
integration and
                                                           planning
    synthesis



    Storage,                                                   Data
preservation and                                       collection, verifica
                        Enables large scale and
 discoverability                                           tion, quality
                            coordinated data
     of data                                            assurance and
                         collection, sharing and
                             multiple re-uses                 control


                          Data + meta-data,
                              licensing
•   Types and Levels of Cooperation and Collaboration
    A circle indicates a researcher engaged in the research cycle




                                              TERN –
                                              A collaborative approach to ecosystem establishing
      Pre-TERN
                                              networks through shared infrastructure and
      Different colours indicated different
                                              data, and new opportunities for collaboration and
      fields/specialities.                    synthesis
•   Types and Levels of Cooperation and Collaboration

•   Methods

•   Share data

•   Data collection together

•   Analysis together

•   Meta- analysis

•   Workshops
4. Examples of coordinated
                ecosystem science
•   From TERN 2013 Symposium Abstracts and “TERN Delivers”

     •   Data Collection
     •   Data Processing
     •   Data Storage
     •   Modelling
     •   Integration, Analysis and Synthesis
•   Data Collection

•   Selection of appropriate measurements

•   Standard protocols for measurement

•   Development + assessment of data collection tools

•   Apps, open data forms and processing

•   Quality assurance and checking

•   Crowd sourcing /citizen science
•   Data Collection
•   Data Collection
•   Data Sets

•   Database of long term survey sites

•   Continental vegetation structure and physiology

•   Continental soils and topography

•   Continental gas/energy/water fluxes

•   Regional vegetation structure and physiology
•   Data Sets
•   Data Processing

•   Standardised data correction techniques

•   Improved interpolation techniques - continental

•   Improved data integration techniques – regional

•   Collaborative approaches (collection +processing)
    to continental products

•   Improved uncertainty and error analyses
•   Data Processing




                         max




                         min
                      Non-per
                        mask
•   Data Storage, Discovery and Sharing



•   Data submission systems

•   Meta-data generation

•   Data license selection

•   Enabling data submission across multiple disciplines

•   Enabling mode effective data search and retrieval

•   Whole of portal system development
•   Data Storage, Discovery and Sharing
•   Data Storage, Discovery and Sharing
SHaRED
Submission, Harmonisation and Retrieval of Ecological Data
       An intuitive, online tool for ecological data submission
      Controlled, consistent metadata to describe submitted data
      Builds on the existing ÆKOS data framework
      Integrates with ÆKOS repository and portal
      Enables citation and encourages collaboration
      Modelled on the TERN Multi-Scale Plots Network (MSPN)
       research community
•   Monitoring
•   Importance of networks for covering spatial and temporal variability

•   Identification of trends and changes in desert, forest and grassland
    ecosystems

•   Improved continental water, and energy flux budgets

•   Accurate and extensive continental scale phenology

•   Identifying human induced changes

•   Evaluation of monitoring programs
•   Monitoring - Multi-scale Plot Network Book

Title TBA –
…long term ecological monitoring/research and its value

• Section 1 - Introductory Chapters
Ch 2 - Value of Long-term Research & How to Design Effective Ecological Monitoring
Ch 3 – Our Capacity To Tell An Australian Ecological Story
Ch 4 - The Cultural Imperative

• Section 2 – 9 x Ecosystem Data Chapters
Ch’s 5- 13 - Tropical Rainforest to Desert Complex

• Section 3 - Closing Chapter
Ch 14 - The Synopsis
•   Science – Knowledge Generation

•   New understanding of spatial and temporal variability of
    desert, forest and savannah ecosystems

•   Separation of natural and human induced changes in specific
    ecosystems

•   How to link long term survey data sets across multiple scales
    and observations

•   64 papers for 2011-12
•   Science – to Management :
    Australian Centre for Ecological Analysis and Synthesis
•   20 working groups, 13 workshops

•   Extinctions + Population Dynamics

•   Fire management

•   Production landscape management

•   Aboriginal bio-cultural knowledge for science
    and management

•   Linking field to remote and modelled data sets for policy support.
•    TERN’s impact on ecosystem science and management?

TERN infrastructure use for 2011-2012:

Members of the community                             > 5000
Newsletters Subscribers                               1500
International collaborations                               53
Universities involved                                      17
State and Federal agencies                                 25
Commercial engagement                                       3
International Partners                                      3
Peer reviewed publications - journal articles              64
Conference papers/presentations                           112
•   Examples of increasing efficiency and effectiveness
International Partners




                TERN is supported by the Australian Government through
                the National Collaborative Research Infrastructure Strategy
                and the Super Science Initiative
Questions?
Professor Stuart Phinn
 s.phinn@uq.edu.au

  Professor Andy Lowe
a.lowe@adelaide.edu.au

   www.tern.org.au

More Related Content

What's hot

Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...SEAD
 
Research data management for masters and ph d students
Research data management for masters and ph d studentsResearch data management for masters and ph d students
Research data management for masters and ph d studentsDebs Martindale
 
Going Full Circle: Research Data Management @ University of Pretoria
Going Full Circle: Research Data Management @ University of PretoriaGoing Full Circle: Research Data Management @ University of Pretoria
Going Full Circle: Research Data Management @ University of PretoriaJohann van Wyk
 
Research Data Management and Librarians
Research Data Management and LibrariansResearch Data Management and Librarians
Research Data Management and LibrariansJohann van Wyk
 
Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)
Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)
Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)SEAD
 
ESA14 Workshop on SEAD's Data Services and Tools
ESA14 Workshop on SEAD's Data Services and ToolsESA14 Workshop on SEAD's Data Services and Tools
ESA14 Workshop on SEAD's Data Services and ToolsSEAD
 
Meeting the NSF DMP Requirement June 13, 2012
Meeting the NSF DMP Requirement June 13, 2012Meeting the NSF DMP Requirement June 13, 2012
Meeting the NSF DMP Requirement June 13, 2012IUPUI
 
Meeting the NSF DMP Requirement: March 7, 2012
Meeting the NSF DMP Requirement: March 7, 2012Meeting the NSF DMP Requirement: March 7, 2012
Meeting the NSF DMP Requirement: March 7, 2012IUPUI
 
Graham Pryor
Graham PryorGraham Pryor
Graham PryorEduserv
 
'Data Management Planning: the role of institutions and researchers' eResearc...
'Data Management Planning: the role of institutions and researchers' eResearc...'Data Management Planning: the role of institutions and researchers' eResearc...
'Data Management Planning: the role of institutions and researchers' eResearc...Marta Ribeiro
 
How Portable Are the Metadata Standards for Scientific Data?
How Portable Are the Metadata Standards for Scientific Data?How Portable Are the Metadata Standards for Scientific Data?
How Portable Are the Metadata Standards for Scientific Data?Jian Qin
 
SEAD Virtual Archive: Building a Federation of Institutional Repositories fo...
 SEAD Virtual Archive: Building a Federation of Institutional Repositories fo... SEAD Virtual Archive: Building a Federation of Institutional Repositories fo...
SEAD Virtual Archive: Building a Federation of Institutional Repositories fo...skonkiel
 
SEAD Datanet and Sustainability Science
SEAD Datanet and Sustainability Science SEAD Datanet and Sustainability Science
SEAD Datanet and Sustainability Science Robert H. McDonald
 
Needs for Data Management & Citation Throughout the Information Lifecycle
Needs for Data Management & Citation Throughout  the Information LifecycleNeeds for Data Management & Citation Throughout  the Information Lifecycle
Needs for Data Management & Citation Throughout the Information LifecycleMicah Altman
 
Monica Omodei RDAP11 Policy-based Data Management;
Monica Omodei RDAP11 Policy-based Data Management; Monica Omodei RDAP11 Policy-based Data Management;
Monica Omodei RDAP11 Policy-based Data Management; ASIS&T
 
Planning for Research Data Management
Planning for Research Data ManagementPlanning for Research Data Management
Planning for Research Data Managementdancrane_open
 
Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...
Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...
Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...TSoholt
 
University of Bath Research Data Management training for researchers
University of Bath Research Data Management training for researchersUniversity of Bath Research Data Management training for researchers
University of Bath Research Data Management training for researchersJez Cope
 
SEAD: Lightweight Data Services for Sustainability Research
SEAD: Lightweight Data Services for Sustainability ResearchSEAD: Lightweight Data Services for Sustainability Research
SEAD: Lightweight Data Services for Sustainability ResearchSEAD
 

What's hot (20)

Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...Data Sets, Ensemble Cloud Computing, and the University Library:Getting the ...
Data Sets, Ensemble Cloud Computing, and the University Library: Getting the ...
 
Rdm slides march 2014
Rdm slides march 2014Rdm slides march 2014
Rdm slides march 2014
 
Research data management for masters and ph d students
Research data management for masters and ph d studentsResearch data management for masters and ph d students
Research data management for masters and ph d students
 
Going Full Circle: Research Data Management @ University of Pretoria
Going Full Circle: Research Data Management @ University of PretoriaGoing Full Circle: Research Data Management @ University of Pretoria
Going Full Circle: Research Data Management @ University of Pretoria
 
Research Data Management and Librarians
Research Data Management and LibrariansResearch Data Management and Librarians
Research Data Management and Librarians
 
Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)
Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)
Digital Library Federation - DataNets Panel presentation (Nov. 1st, 2011)
 
ESA14 Workshop on SEAD's Data Services and Tools
ESA14 Workshop on SEAD's Data Services and ToolsESA14 Workshop on SEAD's Data Services and Tools
ESA14 Workshop on SEAD's Data Services and Tools
 
Meeting the NSF DMP Requirement June 13, 2012
Meeting the NSF DMP Requirement June 13, 2012Meeting the NSF DMP Requirement June 13, 2012
Meeting the NSF DMP Requirement June 13, 2012
 
Meeting the NSF DMP Requirement: March 7, 2012
Meeting the NSF DMP Requirement: March 7, 2012Meeting the NSF DMP Requirement: March 7, 2012
Meeting the NSF DMP Requirement: March 7, 2012
 
Graham Pryor
Graham PryorGraham Pryor
Graham Pryor
 
'Data Management Planning: the role of institutions and researchers' eResearc...
'Data Management Planning: the role of institutions and researchers' eResearc...'Data Management Planning: the role of institutions and researchers' eResearc...
'Data Management Planning: the role of institutions and researchers' eResearc...
 
How Portable Are the Metadata Standards for Scientific Data?
How Portable Are the Metadata Standards for Scientific Data?How Portable Are the Metadata Standards for Scientific Data?
How Portable Are the Metadata Standards for Scientific Data?
 
SEAD Virtual Archive: Building a Federation of Institutional Repositories fo...
 SEAD Virtual Archive: Building a Federation of Institutional Repositories fo... SEAD Virtual Archive: Building a Federation of Institutional Repositories fo...
SEAD Virtual Archive: Building a Federation of Institutional Repositories fo...
 
SEAD Datanet and Sustainability Science
SEAD Datanet and Sustainability Science SEAD Datanet and Sustainability Science
SEAD Datanet and Sustainability Science
 
Needs for Data Management & Citation Throughout the Information Lifecycle
Needs for Data Management & Citation Throughout  the Information LifecycleNeeds for Data Management & Citation Throughout  the Information Lifecycle
Needs for Data Management & Citation Throughout the Information Lifecycle
 
Monica Omodei RDAP11 Policy-based Data Management;
Monica Omodei RDAP11 Policy-based Data Management; Monica Omodei RDAP11 Policy-based Data Management;
Monica Omodei RDAP11 Policy-based Data Management;
 
Planning for Research Data Management
Planning for Research Data ManagementPlanning for Research Data Management
Planning for Research Data Management
 
Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...
Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...
Found in Space: Creating and Visualizing IEEE Abstract Space for Publication ...
 
University of Bath Research Data Management training for researchers
University of Bath Research Data Management training for researchersUniversity of Bath Research Data Management training for researchers
University of Bath Research Data Management training for researchers
 
SEAD: Lightweight Data Services for Sustainability Research
SEAD: Lightweight Data Services for Sustainability ResearchSEAD: Lightweight Data Services for Sustainability Research
SEAD: Lightweight Data Services for Sustainability Research
 

Viewers also liked

How to: Mapping Research to Objectives
How to: Mapping Research to ObjectivesHow to: Mapping Research to Objectives
How to: Mapping Research to ObjectivesClearworks
 
Objectives, methodology, flowchart, and delivarable
Objectives, methodology, flowchart, and delivarableObjectives, methodology, flowchart, and delivarable
Objectives, methodology, flowchart, and delivarableFatini Fatini
 
Mapping Research Infrastructures with the ENVRI Reference Model
Mapping Research Infrastructures with the ENVRI Reference ModelMapping Research Infrastructures with the ENVRI Reference Model
Mapping Research Infrastructures with the ENVRI Reference ModelAlex Hardisty
 
Summary Flowchart: Introduction to Research Methodology
Summary Flowchart: Introduction to Research MethodologySummary Flowchart: Introduction to Research Methodology
Summary Flowchart: Introduction to Research MethodologyDr Nur Suhaili Ramli
 
Business research methods 01 a12
Business research methods 01 a12Business research methods 01 a12
Business research methods 01 a12smithsterfied
 

Viewers also liked (6)

How to: Mapping Research to Objectives
How to: Mapping Research to ObjectivesHow to: Mapping Research to Objectives
How to: Mapping Research to Objectives
 
Objectives, methodology, flowchart, and delivarable
Objectives, methodology, flowchart, and delivarableObjectives, methodology, flowchart, and delivarable
Objectives, methodology, flowchart, and delivarable
 
Mapping Research Infrastructures with the ENVRI Reference Model
Mapping Research Infrastructures with the ENVRI Reference ModelMapping Research Infrastructures with the ENVRI Reference Model
Mapping Research Infrastructures with the ENVRI Reference Model
 
Business research methods 1
Business research methods 1Business research methods 1
Business research methods 1
 
Summary Flowchart: Introduction to Research Methodology
Summary Flowchart: Introduction to Research MethodologySummary Flowchart: Introduction to Research Methodology
Summary Flowchart: Introduction to Research Methodology
 
Business research methods 01 a12
Business research methods 01 a12Business research methods 01 a12
Business research methods 01 a12
 

Similar to Stuart Phinn_Many kinds of infrastructure: resolving and advancing ecosystem data collection and analysis methods within and between disciplines

Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...
Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...
Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...TERN Australia
 
Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014
Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014
Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014TERN Australia
 
Engaging with students and researchers: the case of the social sciences
Engaging with students and researchers: the case of the social sciencesEngaging with students and researchers: the case of the social sciences
Engaging with students and researchers: the case of the social sciencesLouise Corti
 
Research data lifecycle diagram
Research data lifecycle diagramResearch data lifecycle diagram
Research data lifecycle diagramSteven Cracknell
 
Supporting Libraries in Leading the Way in Research Data Management
Supporting Libraries in Leading the Way in Research Data ManagementSupporting Libraries in Leading the Way in Research Data Management
Supporting Libraries in Leading the Way in Research Data ManagementMarieke Guy
 
Supporting Research Data Management at the University of Stirling
Supporting Research Data Management at the University of StirlingSupporting Research Data Management at the University of Stirling
Supporting Research Data Management at the University of StirlingLisa Haddow
 
Ausplots Training - Session 1
Ausplots Training - Session 1Ausplots Training - Session 1
Ausplots Training - Session 1bensparrowau
 
CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...
CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...
CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...SEAD
 
dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...
dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...
dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...dkNET
 
Report from RDAPlenary 3 to DataCitation Community in Australia
Report from RDAPlenary 3 to DataCitation Community in AustraliaReport from RDAPlenary 3 to DataCitation Community in Australia
Report from RDAPlenary 3 to DataCitation Community in Australiaamiraryani
 
EMBL Australian Bioinformatics Resource AHM - Data Commons
EMBL Australian Bioinformatics Resource AHM   - Data CommonsEMBL Australian Bioinformatics Resource AHM   - Data Commons
EMBL Australian Bioinformatics Resource AHM - Data CommonsVivien Bonazzi
 
Introduction to research data management
Introduction to research data managementIntroduction to research data management
Introduction to research data managementopl10
 
Workshop 4: Open Science & Open Data for Librarians/Ina Smith
Workshop 4: Open Science & Open Data for Librarians/Ina SmithWorkshop 4: Open Science & Open Data for Librarians/Ina Smith
Workshop 4: Open Science & Open Data for Librarians/Ina SmithAfrican Open Science Platform
 
A Data Scientist Perspective on Data Curation in the Digital Era
A Data Scientist Perspective on Data Curation in the Digital EraA Data Scientist Perspective on Data Curation in the Digital Era
A Data Scientist Perspective on Data Curation in the Digital EraVicki Ferrini
 
Data publishing at the UQ Library
Data publishing at the UQ LibraryData publishing at the UQ Library
Data publishing at the UQ LibraryARDC
 
Data Management for Postgraduate students by Lynn Woolfrey
Data Management for Postgraduate students by Lynn WoolfreyData Management for Postgraduate students by Lynn Woolfrey
Data Management for Postgraduate students by Lynn Woolfreypvhead123
 

Similar to Stuart Phinn_Many kinds of infrastructure: resolving and advancing ecosystem data collection and analysis methods within and between disciplines (20)

Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...
Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...
Stuart Phinn and Andy Lowe_TERN's national ecosystem data infrastructure is d...
 
Researh data management
Researh data managementResearh data management
Researh data management
 
Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014
Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014
Ecosystem data and TERN: Genes to geosciences workshop 19 May 2014
 
Engaging with students and researchers: the case of the social sciences
Engaging with students and researchers: the case of the social sciencesEngaging with students and researchers: the case of the social sciences
Engaging with students and researchers: the case of the social sciences
 
Research data lifecycle diagram
Research data lifecycle diagramResearch data lifecycle diagram
Research data lifecycle diagram
 
Supporting Libraries in Leading the Way in Research Data Management
Supporting Libraries in Leading the Way in Research Data ManagementSupporting Libraries in Leading the Way in Research Data Management
Supporting Libraries in Leading the Way in Research Data Management
 
Supporting Research Data Management at the University of Stirling
Supporting Research Data Management at the University of StirlingSupporting Research Data Management at the University of Stirling
Supporting Research Data Management at the University of Stirling
 
Ausplots Training - Session 1
Ausplots Training - Session 1Ausplots Training - Session 1
Ausplots Training - Session 1
 
CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...
CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...
CNI Fall 2011 Meeting Presentation Margaret Hedstrom & Robert McDonald (Dec. ...
 
dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...
dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...
dkNET Office Hours - "Are You Ready for 2023: New NIH Data Management and Sha...
 
Michener Plenary PPSR2012
Michener Plenary PPSR2012Michener Plenary PPSR2012
Michener Plenary PPSR2012
 
Report from RDAPlenary 3 to DataCitation Community in Australia
Report from RDAPlenary 3 to DataCitation Community in AustraliaReport from RDAPlenary 3 to DataCitation Community in Australia
Report from RDAPlenary 3 to DataCitation Community in Australia
 
Engaging the Researcher in RDM
Engaging the Researcher in RDMEngaging the Researcher in RDM
Engaging the Researcher in RDM
 
EMBL Australian Bioinformatics Resource AHM - Data Commons
EMBL Australian Bioinformatics Resource AHM   - Data CommonsEMBL Australian Bioinformatics Resource AHM   - Data Commons
EMBL Australian Bioinformatics Resource AHM - Data Commons
 
Introduction to Research Data Management
Introduction to Research Data ManagementIntroduction to Research Data Management
Introduction to Research Data Management
 
Introduction to research data management
Introduction to research data managementIntroduction to research data management
Introduction to research data management
 
Workshop 4: Open Science & Open Data for Librarians/Ina Smith
Workshop 4: Open Science & Open Data for Librarians/Ina SmithWorkshop 4: Open Science & Open Data for Librarians/Ina Smith
Workshop 4: Open Science & Open Data for Librarians/Ina Smith
 
A Data Scientist Perspective on Data Curation in the Digital Era
A Data Scientist Perspective on Data Curation in the Digital EraA Data Scientist Perspective on Data Curation in the Digital Era
A Data Scientist Perspective on Data Curation in the Digital Era
 
Data publishing at the UQ Library
Data publishing at the UQ LibraryData publishing at the UQ Library
Data publishing at the UQ Library
 
Data Management for Postgraduate students by Lynn Woolfrey
Data Management for Postgraduate students by Lynn WoolfreyData Management for Postgraduate students by Lynn Woolfrey
Data Management for Postgraduate students by Lynn Woolfrey
 

More from TERN Australia

Careers Grounded in Soils
Careers Grounded in SoilsCareers Grounded in Soils
Careers Grounded in SoilsTERN Australia
 
TERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia
 
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021TERN Australia
 
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021TERN Australia
 
MER Pilot Network flyer 2020
MER Pilot Network flyer 2020MER Pilot Network flyer 2020
MER Pilot Network flyer 2020TERN Australia
 
Australia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityAustralia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityTERN Australia
 
Biodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsBiodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsTERN Australia
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityTERN Australia
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityTERN Australia
 
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018TERN Australia
 
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...TERN Australia
 
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...TERN Australia
 
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...TERN Australia
 
Yuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyYuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyTERN Australia
 
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyQiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyTERN Australia
 
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsHa Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsTERN Australia
 
Paul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenPaul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenTERN Australia
 
GEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaGEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaTERN Australia
 
TERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Australia
 
TERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Australia
 

More from TERN Australia (20)

Careers Grounded in Soils
Careers Grounded in SoilsCareers Grounded in Soils
Careers Grounded in Soils
 
TERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection Brochure
 
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
 
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
 
MER Pilot Network flyer 2020
MER Pilot Network flyer 2020MER Pilot Network flyer 2020
MER Pilot Network flyer 2020
 
Australia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityAustralia's Environmental Predictive Capability
Australia's Environmental Predictive Capability
 
Biodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsBiodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native Forests
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for Sustainability
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for Sustainability
 
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
 
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
 
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
 
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
 
Yuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyYuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenology
 
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyQiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
 
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsHa Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
 
Paul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenPaul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollen
 
GEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaGEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for Australia
 
TERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill Station
 
TERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National Park
 

Stuart Phinn_Many kinds of infrastructure: resolving and advancing ecosystem data collection and analysis methods within and between disciplines

  • 1. Many Kinds of Infrastructure: Resolving and Advancing Ecosystem Data Collection and Analysis Methods Within and Between Disciplines By: Stuart Phinn, Alex Held, Andrew Lowe, Nikki Thurgate, Tim Clancy, Mike Grundy, Helen Cleugh Mike Liddell, and Eva van Gorsel
  • 2. Presentation Aim To demonstrate how shared national research infrastructure, such as TERN, enables the development of a consensus on methods and products.
  • 3. Contents 1. The realities of funding and supporting ecosystem science 2. Whose science is it anyway? 3. A framework for cooperation and collaboration 4. Examples of coordinated ecosystem science
  • 4. 1. The realities of funding and supporting ecosystem science • The Scope of Ecosystem Science • Ecosystem Science Infrastructure • Funding Ecosystem Science Infrastructure
  • 5. The Scope of Ecosystem Science ? • Multi-disciplinary and multiple agencies • Ecological to bio-geophysical Source: www.fas.org • Data collection, storage , analysis, modelling and visualisation • Science to policy, management and industry
  • 6. Ecosystem science research infrastructure Collection Data Data Policy + Methods Storage Sharing Modelling Management Instruments Processing Data Curation Data Analysis + Sensors + Analysis + Publishing Searching + Synthesis
  • 7. Funding Ecosystem Science Infrastructure – Funding Sources • Australian Government – NCRIS and EIF • Australian Research Council - Linkage Infrastructure Collection Data Data Policy + Methods Storage Sharing Modelling Management Instruments Processing Data Curation Data Analysis + Sensors + Analysis + Publishing Searching + Synthesis • State Governments • Agency/Organisation • Australian Research Council • Professional Societies • Australian Government • Private Industry Partnerships • Philanthropic Donations
  • 8. Funding Ecosystem Science Infrastructure – Funding Sources • Current competitive funding levels and process for ecosystem research in Australia are inefficient and un-sustainable for engaging the ecosystem science communities. Development of ideas Compile funding Proposal Project funded Project not funded 20-30 % Data processing and analysis 80-70 % ??????? Interpretation of results, specification of findings] applications applications Publishing of papers Publishing data Body of knowledge for UNDERSTANDING + MANAGING AUSTRALIAN ECOSYSTEMS?
  • 9. 2. Whose science is it anyway? • Science and Research • Data to Research to Publication • Licences – Why and How?
  • 10. Science and Research Domains
  • 11. Data to Research to Publication Development of ideas Funding Design of project and data collection-analysis Data collection Data processing and analysis Interpretation of results, specification of findings] Writing, revision and publishing of paper and data
  • 12. Licences – Why ? • To make sure that: - Data are use for purpose(s) intended - Data provider is not liable - Data are cited correctly 0 2500
  • 13. Licences – How? • TERN licensing implementation process • TERN data providers Deed “ensures that both the data provider and subsequent users have a clear understanding of the basis upon which data has been provided, and upon which TERN and its Facilities can hold, use and disseminate data.”
  • 14. Every scientist should be publishing their data? • What I do is no one else’s business • I couldn’t be bothered; it’s too much work • No one reads it anyway
  • 15. 3. A Framework for cooperation and collaboration • Ecosystem Science Research Cycle • Ecosystem Science Activities (collection, processing, analysis and storage) • Types and Levels of Cooperation and Collaboration
  • 16. Ecosystem Science Research Data Cycle Ecosystem Science Enhanced ability to Research output: revise, question and Knowledge gap: new data and expand knowledge research publications questions r Data analysis, Proposal and integration and planning synthesis Storage, Data preservation and collection, verifica Enables large scale and discoverability tion, quality coordinated data of data assurance and collection, sharing and multiple re-uses control Data + meta-data, licensing
  • 17. Types and Levels of Cooperation and Collaboration A circle indicates a researcher engaged in the research cycle TERN – A collaborative approach to ecosystem establishing Pre-TERN networks through shared infrastructure and Different colours indicated different data, and new opportunities for collaboration and fields/specialities. synthesis
  • 18. Types and Levels of Cooperation and Collaboration • Methods • Share data • Data collection together • Analysis together • Meta- analysis • Workshops
  • 19. 4. Examples of coordinated ecosystem science • From TERN 2013 Symposium Abstracts and “TERN Delivers” • Data Collection • Data Processing • Data Storage • Modelling • Integration, Analysis and Synthesis
  • 20. Data Collection • Selection of appropriate measurements • Standard protocols for measurement • Development + assessment of data collection tools • Apps, open data forms and processing • Quality assurance and checking • Crowd sourcing /citizen science
  • 21. Data Collection
  • 22. Data Collection
  • 23. Data Sets • Database of long term survey sites • Continental vegetation structure and physiology • Continental soils and topography • Continental gas/energy/water fluxes • Regional vegetation structure and physiology
  • 24. Data Sets
  • 25. Data Processing • Standardised data correction techniques • Improved interpolation techniques - continental • Improved data integration techniques – regional • Collaborative approaches (collection +processing) to continental products • Improved uncertainty and error analyses
  • 26. Data Processing max min Non-per mask
  • 27. Data Storage, Discovery and Sharing • Data submission systems • Meta-data generation • Data license selection • Enabling data submission across multiple disciplines • Enabling mode effective data search and retrieval • Whole of portal system development
  • 28. Data Storage, Discovery and Sharing
  • 29. Data Storage, Discovery and Sharing
  • 30. SHaRED Submission, Harmonisation and Retrieval of Ecological Data  An intuitive, online tool for ecological data submission  Controlled, consistent metadata to describe submitted data  Builds on the existing ÆKOS data framework  Integrates with ÆKOS repository and portal  Enables citation and encourages collaboration  Modelled on the TERN Multi-Scale Plots Network (MSPN) research community
  • 31. Monitoring • Importance of networks for covering spatial and temporal variability • Identification of trends and changes in desert, forest and grassland ecosystems • Improved continental water, and energy flux budgets • Accurate and extensive continental scale phenology • Identifying human induced changes • Evaluation of monitoring programs
  • 32. Monitoring - Multi-scale Plot Network Book Title TBA – …long term ecological monitoring/research and its value • Section 1 - Introductory Chapters Ch 2 - Value of Long-term Research & How to Design Effective Ecological Monitoring Ch 3 – Our Capacity To Tell An Australian Ecological Story Ch 4 - The Cultural Imperative • Section 2 – 9 x Ecosystem Data Chapters Ch’s 5- 13 - Tropical Rainforest to Desert Complex • Section 3 - Closing Chapter Ch 14 - The Synopsis
  • 33. Science – Knowledge Generation • New understanding of spatial and temporal variability of desert, forest and savannah ecosystems • Separation of natural and human induced changes in specific ecosystems • How to link long term survey data sets across multiple scales and observations • 64 papers for 2011-12
  • 34. Science – to Management : Australian Centre for Ecological Analysis and Synthesis • 20 working groups, 13 workshops • Extinctions + Population Dynamics • Fire management • Production landscape management • Aboriginal bio-cultural knowledge for science and management • Linking field to remote and modelled data sets for policy support.
  • 35. TERN’s impact on ecosystem science and management? TERN infrastructure use for 2011-2012: Members of the community > 5000 Newsletters Subscribers 1500 International collaborations 53 Universities involved 17 State and Federal agencies 25 Commercial engagement 3 International Partners 3 Peer reviewed publications - journal articles 64 Conference papers/presentations 112
  • 36. Examples of increasing efficiency and effectiveness
  • 37. International Partners TERN is supported by the Australian Government through the National Collaborative Research Infrastructure Strategy and the Super Science Initiative
  • 38. Questions? Professor Stuart Phinn s.phinn@uq.edu.au Professor Andy Lowe a.lowe@adelaide.edu.au www.tern.org.au

Editor's Notes

  1. Tues 1030 – 1050, 15 min A common challenge for many disciplines in ecosystem science is that a variety of collection and analysis approaches are used to produce similar output information. It is confusing for users of the outputs and funding agencies to determine which method or product is most accurate or suited to their needs. The objective of this paper is to demonstrate how shared national research infrastructure, such as TERN, enables development of consensus on methods and products. Multiple approaches to the same problem, results in duplication of effort, confusion around conclusions, uncertainty on precision and ultimately fragmentation of ecosystem science communities. Separate groups compete for the same funds and the nation has a diminished capacity to act collectively. A semi-independent collaborative framework is required, which is neutral, provides resources to collect and assess data, along with processing and analytical methods, to deliver a consistent approach to methods and validation. This presentation demonstrates how national research infrastructure facilities, such as TERN, provide the framework and solution to this problem. Such a framework is essential to enable a "level playing field" for resolving differences in data, methods and interpretation within disciplines or across jurisdictions. Examples are presented from several of TERN's data collection facilities, showing how competing approaches were assessed and then incorporated to derive consistent approaches which have then been adopted by the relevant communities. The solution has worked within scientific communities, and most importantly across the state - federal government nexus, where perceived duplication of activities can and has caused major problems.A common challenge for many disciplines in ecosystem science is that a variety of collection and analysis approaches are used to produce similar output information. It is confusing for users of the outputs and funding agencies to determine which method or product is most accurate or suited to their needs. The objective of this paper is to demonstrate how shared national research infrastructure, such as TERN, enables development of consensus on methods and products. Multiple approaches to the same problem, results in duplication of effort, confusion around conclusions, uncertainty on precision and ultimately fragmentation of ecosystem science communities. Separate groups compete for the same funds and the nation has a diminished capacity to act collectively. A semi-independent collaborative framework is required, which is neutral, provides resources to collect and assess data, along with processing and analytical methods, to deliver a consistent approach to methods and validation. This presentation demonstrates how national research infrastructure facilities, such as TERN, provide the framework and solution to this problem. Such a framework is essential to enable a "level playing field" for resolving differences in data, methods and interpretation within disciplines or across jurisdictions. Examples are presented from several of TERN's data collection facilities, showing how competing approaches were assessed and then incorporated to derive consistent approaches which have then been adopted by the relevant communities. The solution has worked within scientific communities, and most importantly across the state - federal government nexus, where perceived duplication of activities can and has caused major problems.  
  2. 5 MINUTES
  3. 5 MINUTES
  4. 5 MINUTES
  5. 5 MINUTES
  6. 5 MINUTES
  7. 5 MINUTES
  8. 5 MINUTES
  9. 5 MINUTES
  10. 5 MINUTES
  11. 5 MINUTES
  12. 5 MINUTES
  13. 5 MINUTES
  14. 5 MINUTES
  15. 5 MINUTES
  16. 5 MINUTES
  17. 5 MINUTES
  18. 5 MINUTES
  19. 5 MINUTES
  20. 5 MINUTES
  21. 5 MINUTES
  22. 5 MINUTES
  23. 5 MINUTES
  24. 5 MINUTES
  25. 5 MINUTES
  26. 5 MINUTES
  27. 5 MINUTES
  28. 5 MINUTES
  29. 5 MINUTES
  30. 5 MINUTES