The changing landscape of science

The changing landscape of science
Chelle L. Gentemann
Earth & Space Research
cgentemann@esr.org
Research supported by the Schmidt
Family Foundation, Saildrone, Inc., and
NASA Physical Oceanography
Image Credit: Saildrone, Inc.
1
Background: sharing data
• So… sharing is easy…. If you want too…
1990s: tape drives 2018: cheap local storage
Cloud storage options
2
Sharing data
Figure credit: Grandjean, Martin (2014). "La connaissance est un réseau". Les Cahiers du Numérique
10 (3): 37-54. DOI:10.3166/LCN.10.3.37-54 3
But people still don’t share data….
Legal reasons…
data includes confidential information
data collection funded by agency/institution with a closed policy
security (export control) issues
Career / funding:
I collected this data. It is mine.
I won’t advance if I don’t publish, I won’t get more funding on this topic.
Other concerns:
Other researchers will misuse or misinterpret the data
It takes too much effort to document the data
Other people helped produce the data, they will never agree to share it
I’m a scientists not a data provider, this isn’t my job
4
Sharing data
Figure credit: Grandjean, Martin (2014). "La connaissance est un réseau". Les Cahiers du Numérique
10 (3): 37-54. DOI:10.3166/LCN.10.3.37-54 5
7https://www.st.nmfs.noaa.gov/appstech/index
Digital Object Identifier (DOI)
Share data, but ensure credit.
If you are a civil servant, public
domain applies.
Otherwise license your data.
https://creativecommons.org/lic
enses/
Image credit: https://www.ands.org.au/__data/assets/pdf_file/0006/715155/Digital-Object-Identifiers.pdf 8
Image credit: Creative Commons Guide with as source How To Attribute Creative Commons Photos
Attitudes
Image credit: Open Data Report Elsevier 2017
9
Journal policies are changing
https://publications.agu.org/author-resource-center/publication-policies/data-policy/
AGU affirmed in its 2012 position statement that “Earth and space science data should
be widely accessible in multiple formats and long‐term preservation of data is an integral
responsibility of scientists and sponsoring institutions.” Following this statement and to
advance scientific exploration and discovery, and allow a full assessment of results
presented in AGU’s journals, all data necessary to understand, evaluate, replicate, and
build upon the reported research must be made available and accessible whenever
possible.
For the purposes of this policy, data include, but are not limited to, the following:
Data used to generate, or be displayed in, figures, graphs, plots, videos, animations, or
tables in a paper.
New protocols or methods used to generate the data in a paper.
New code/computer software used to generate results or analyses reported in the paper.
Derived data products reported or described in a paper.
10
Federal Policy
• 2013 OSTP memo, “Increasing Access to the Results of Federally Funded Scientific
Research”, aims to ensure “that, to the greatest extent and with the fewest
constraints possible … , the direct results of federally funded scientific research are
made available to and useful for the public, industry, and the scientific community.
Such results include peer-reviewed publications and digital data.”
• 2016 OMB memo, “Federal Source Code Policy: Achieving Efficiency, Transparency,
and Innovation through Reusable and Open Source Software” (M-16-21), requires
agencies to consider the value of publishing the code they develop as open-source
software and to establish requirements for releasing custom-developed source code.
11
NOAA open data
• In 2004, NOAA policy included “NOAA will
promote the open and unrestricted exchange of
environmental information worldwide”
• NOAA CIO Zach Goldstein describes, “It’s our job
to get that data out there. The data doesn’t
belong to us, it belongs to the American
people.”
• In 2017 NOAA created Chief Data Officer
position
http://odimpact.org/files/case-studies-noaa.pdf
Quote from GovLab interview with Zachary Goldstein, Chief Information Officer,
NOAA, September 3, 2015. 12
Digital Globe
• https://discover.digitalglobe.com/
• 2003 – present, some at .5m resolution
13
Open source software
• The next logical step after open data is open
software
– Reproducibility
– Advancing science
– Accelerating science
• Tools are now mature enough to make open
software relatively easy (GitHub, GitLab,
BitBucket)
14
Open source collaborations expanding
Come gather 'round people
Wherever you roam
And admit that the waters
Around you have grown
And accept it that soon
You'll be drenched to the bone.
If your time to you
Is worth savin'
Then you better start swimmin'
Or you'll sink like a stone
For the times they are a-changin'.
-Bob Dylan
15
Python Ecosystem
Image credit: Jake Vanderplas, UW
16
Resources
17
Expand
Openly sharing software creates a traceable
resource for your work. GitHub + Zenodo for DOI.
Putting figures on figshare with CC-BY allows
people to easily reuse and ensures credit
Putting data in dataverse or institutional archive,
with an assigned DOI and license ensures credit and
visibility
Make it easy to find your work
Make it easy to cite your work
Make it easy to collaborate with you
18
Using Saildrone autonomous in situ data for satellite validation
and research into upper ocean physics and ecology
Co-Investigators: S. Akella, I. Cetinić, Y. Chao, M. Chin, M. Daugharty,
K. Dohan, J. Dorman, M. Fewings, X. Flores-Vidal, B. Fox-Kemper, B.
Franz, M. García-Reyes, J. Gomez Valdes, E. Hazen, J. Høyer, J.
Largier, P. Mazzini, J. Scott, W. Sydeman, J. Vazquez, F. Veron, J.
Werdell, L. Yu, K. Zaba.
Institutions: Brown University, CODAR Ocean Sensors, Danish
Meteorological Institute, Earth and Space Research, Ensenada Center for
Scientific Research and Higher Education, Farallon Institute, NASA Jet
Propulsion Laboratory, NASA GMAO, NASA GSFC, Remote Sensing
Solutions, San Francisco State University, Science Systems and
Applications Inc., Scripps Institution of Oceanography, Universities Space
Research Association, University of Baja California, University of
California Davis, University of California Santa Cruz, University of
Connecticut, University of Miami, University of Rhode Island, University of
Delaware, Woods Hole Oceanographic Institution.
Project funded by:
Saildrone Inc. &
The Schmidt Family Foundation
Image credit: Saildrone, Inc.
C. Gentemann, ESR
P. Minnett, U. Miami
P. Cornillon, U. Rhode Island
19
Unmanned Surface Vehicle
Image credit: Saildrone, Inc.
20
Saildrones have collected data from 2015 on…
Image credit: Saildrone, Inc.
21
Sensors
22
Baja Cruise
11 April – 11 June 2018
60-day cruise
Along-wind and across wind
sampling of fronts
Data freely available (format
finalized soon) on google
drive (soon NASA.PODAAC)
CC-BY-NC license
Software repository for
project:
https://github.com/cgentemann
/Saildrone
23
April 11 - June 11, 2018
4 temperature loggers added by NASA
Physical Oceanography Program
295mm
500mm
985mm
1420mm
1785mm
24
Assistant ScientistsSaildrone Engineers
Baja Cruise: real time data
Data explorer : web interface provided by Saildrone to visualize
data while cruise is occurring. Data from instruments on
Saildrone as well as model analyses (SST, SSS, currents, etc.)
are shown 25
Direct and task USV
Data explorer : web interface for tasking USV. This allows for
control of the USV to sample fronts and adjust the track as they
move. Points are set, with a ‘width’ set that controls the distance
the USV is allowed to vary from the track. 26
VIIRS SST and USV track
Track designed to sample
different types of fronts, provide
data for validation of satellite
environmental products, and
areas with diurnal warming
events
27
Physics of observation
At 55 deg there is .96
emissivity
Changes with angle
of observation
In reality reflected
radiance is quasi-
specular
B(Tskin)
B(Tsky)
CT15 is measuring the skin temperature and
reflected sky temperature
28
Skin minus bulk difference
Noise
due to
reflected
sky
radiation
?
Diurnal
warming
of surface
skin layer
29
Bulk SST
Two measurements of ‘bulk’ SST at 0.6 m depth from the O2 sensor and a
CTD. Comparison between the two ‘bulk’ SSTs below. There is a *very*
small difference that is wind speed dependent, but they essentially are
independently measuring the same temperature to O(0.01)
Bulk SST is a high quality
observation, bias is NOT in
the bulk SST
30
Collocated Saildrone data with GOES 16 SST data
Cloudy day in SD
area
Clear sky in SD area, cloud
contamination in other areas
SD track for
day shown in
pink. 24 hour
average of
GOES SSTs
shown in
image.
Missing data
means that it
was cloudy.
Cold ‘speckle’
shows cloud
contamination
in SSTs.
Cloud mask
not perfect. 31
Time series of collocated GOES and SD data
Cloudy, no GOES matchups,
smaller skin SST bias
Clear Sky, GOES SST matchups, large
neg. bias
32
Cloudy, no GOES matchups, smaller
skin SST bias
Clear Sky, GOES SST matchups, large neg. bias
Time series of collocated GOES
and SD data: VERIFY, verify.
verify.
33
Upper ocean diurnal warming
Mixing in the upper ocean
This is how solar energy is transferred
into the ocean resulting in the seasonal
cycle of temperature
How does upper ocean stratification
change rates of mixing?
34
Buoy collocations
SST (K) Tair (K) u (ms-1) # obs
buoy ID Bias STD Bias STD Bias STD
46011 0.20 0.18 0.22 0.14 1.00 0.40 19
46028 -0.02 0.30 -0.15 0.13 5.32 1.85 25
46042 -0.01 0.05 0.00 0.05 0.92 0.57 13
46047 -0.20 0.08 0.02 0.11 0.65 0.81 13
46086 -0.08 0.09 0.02 0.11 0.65 0.81 19
35
Next steps
• Organize research / publications on topics:
• Quality of Saildrone observations, what looks good, what
needs to be flagged, share flagged values
• Prof. Gomez collocated drifters, circulation study
• Zaba collocated glider ADCP analysis
• Satellite – buoy – Saildrone collocation analysis,
validation of SST, ocean color, salinity
• HF Radar surface currents, OSCAR currents, and
Saildrone validation
• Coastal front analysis
• Offshore front analysis
• Across / Along winds front differences
• Circulation in frontal regions
• Baroclinic Instability waves along fronts
• Diurnal warming in surface layer 36
http://www.camilleseaman.com/Art
ist.asp?ArtistID=3258&Akey=WX
679BJN&ajx=1#!P118975_I2_154
3930
http://www.camilleseaman.com/Art
ist.asp?ArtistID=3258&Akey=WX
679BJN&ajx=1#!P118975_I2_154
3930
Sea Ice Remnant Svalbard July 17, 2008
Image credit: Camille Seaman
37
2019-2022: 5 Arctic Cruises
Image credit: NOAA PMEL
Image credit: Saildrone
NASA Physical
Oceanography
Program
38
Summary
39
Open data policy for data from 1st day of cruise.
Open source software repository on github.
Partners on the project have given talks, given out
Googledrive link.
Initially, data shared via googledrive to anyone who
requested access, CC-BY-NC license.
Will be formally shared via NASA Physical Oceanography
Data Active Archive (PO.DAAC) soon.
Format and metadata are finalized.
Working on documentation.
Expand
40image credit: https://www.expertsystem.com/open-source-intelligence-used/
You know your data best.
Reach out to your agency to share it.
41
1 of 40

Recommended

Building the Pacific Research Platform: Supernetworks for Big Data Science by
Building the Pacific Research Platform: Supernetworks for Big Data ScienceBuilding the Pacific Research Platform: Supernetworks for Big Data Science
Building the Pacific Research Platform: Supernetworks for Big Data ScienceLarry Smarr
57 views43 slides
Machine Learning in Healthcare Diagnostics by
Machine Learning in Healthcare DiagnosticsMachine Learning in Healthcare Diagnostics
Machine Learning in Healthcare DiagnosticsLarry Smarr
4.4K views22 slides
data about tech and data trends by
data about tech and data trendsdata about tech and data trends
data about tech and data trendsantarme
545 views147 slides
AI for tackling climate change by
AI for tackling climate changeAI for tackling climate change
AI for tackling climate changeDeakin University
2K views59 slides
Why data science matters and what we can do with it by
Why data science matters and what we can do with itWhy data science matters and what we can do with it
Why data science matters and what we can do with itXiaogang (Marshall) Ma
1.6K views42 slides
Bigdatacooltools by
BigdatacooltoolsBigdatacooltools
Bigdatacooltoolssuresh sood
1.1K views45 slides

More Related Content

Similar to The changing landscape of science

Open Science Data Cloud - CCA 11 by
Open Science Data Cloud - CCA 11Open Science Data Cloud - CCA 11
Open Science Data Cloud - CCA 11Robert Grossman
1.3K views33 slides
"Some Reflections on Data in the Public Sector" : Communia: The European Them... by
"Some Reflections on Data in the Public Sector" : Communia: The European Them..."Some Reflections on Data in the Public Sector" : Communia: The European Them...
"Some Reflections on Data in the Public Sector" : Communia: The European Them...Tom Moritz
389 views46 slides
Data science Innovations January 2018 by
Data science Innovations January 2018Data science Innovations January 2018
Data science Innovations January 2018suresh sood
229 views30 slides
Democratising biodiversity and genomics research: open and citizen science to... by
Democratising biodiversity and genomics research: open and citizen science to...Democratising biodiversity and genomics research: open and citizen science to...
Democratising biodiversity and genomics research: open and citizen science to...GigaScience, BGI Hong Kong
344 views84 slides
Data science innovations by
Data science innovations Data science innovations
Data science innovations suresh sood
208 views30 slides
GBIF and reuse of research data, Bergen (2016-12-14) by
GBIF and reuse of research data, Bergen (2016-12-14)GBIF and reuse of research data, Bergen (2016-12-14)
GBIF and reuse of research data, Bergen (2016-12-14)Dag Endresen
4.8K views46 slides

Similar to The changing landscape of science(20)

Open Science Data Cloud - CCA 11 by Robert Grossman
Open Science Data Cloud - CCA 11Open Science Data Cloud - CCA 11
Open Science Data Cloud - CCA 11
Robert Grossman1.3K views
"Some Reflections on Data in the Public Sector" : Communia: The European Them... by Tom Moritz
"Some Reflections on Data in the Public Sector" : Communia: The European Them..."Some Reflections on Data in the Public Sector" : Communia: The European Them...
"Some Reflections on Data in the Public Sector" : Communia: The European Them...
Tom Moritz389 views
Data science Innovations January 2018 by suresh sood
Data science Innovations January 2018Data science Innovations January 2018
Data science Innovations January 2018
suresh sood229 views
Democratising biodiversity and genomics research: open and citizen science to... by GigaScience, BGI Hong Kong
Democratising biodiversity and genomics research: open and citizen science to...Democratising biodiversity and genomics research: open and citizen science to...
Democratising biodiversity and genomics research: open and citizen science to...
Data science innovations by suresh sood
Data science innovations Data science innovations
Data science innovations
suresh sood208 views
GBIF and reuse of research data, Bergen (2016-12-14) by Dag Endresen
GBIF and reuse of research data, Bergen (2016-12-14)GBIF and reuse of research data, Bergen (2016-12-14)
GBIF and reuse of research data, Bergen (2016-12-14)
Dag Endresen4.8K views
NOAA Big Data Project Handout by Amy Gaskins
NOAA Big Data Project HandoutNOAA Big Data Project Handout
NOAA Big Data Project Handout
Amy Gaskins755 views
Open Data in a Big Data World: easy to say, but hard to do? by LEARN Project
Open Data in a Big Data World: easy to say, but hard to do?Open Data in a Big Data World: easy to say, but hard to do?
Open Data in a Big Data World: easy to say, but hard to do?
LEARN Project777 views
Data Science Innovations : Democratisation of Data and Data Science by suresh sood
Data Science Innovations : Democratisation of Data and Data Science  Data Science Innovations : Democratisation of Data and Data Science
Data Science Innovations : Democratisation of Data and Data Science
suresh sood811 views
Big Data in NATO and Your Role by Jay Gendron
Big Data in NATO and Your RoleBig Data in NATO and Your Role
Big Data in NATO and Your Role
Jay Gendron1.4K views
Research Data Sharing: A Basic Framework by Paul Groth
Research Data Sharing: A Basic FrameworkResearch Data Sharing: A Basic Framework
Research Data Sharing: A Basic Framework
Paul Groth1K views
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve... by Sky Bristol
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...
Big Data R&D Strategy - Ensure the long term sustainability, access, and deve...
Sky Bristol359 views

More from Chelle Gentemann

Butterfly Satellite Mission Overview by
Butterfly Satellite Mission OverviewButterfly Satellite Mission Overview
Butterfly Satellite Mission OverviewChelle Gentemann
121 views20 slides
Satellite passive microwave measurements of the climate crisis by
Satellite passive microwave measurements of the climate crisisSatellite passive microwave measurements of the climate crisis
Satellite passive microwave measurements of the climate crisisChelle Gentemann
127 views42 slides
FOSS4G 2021: Open source science by
FOSS4G 2021: Open source scienceFOSS4G 2021: Open source science
FOSS4G 2021: Open source scienceChelle Gentemann
121 views14 slides
Open ecosystems help science storm the cloud by
Open ecosystems help science storm the cloudOpen ecosystems help science storm the cloud
Open ecosystems help science storm the cloudChelle Gentemann
121 views20 slides
Empowering Transformational Science by
Empowering Transformational ScienceEmpowering Transformational Science
Empowering Transformational ScienceChelle Gentemann
28 views19 slides
Building a Community of Practice by
Building a Community of PracticeBuilding a Community of Practice
Building a Community of PracticeChelle Gentemann
20 views5 slides

More from Chelle Gentemann(9)

Butterfly Satellite Mission Overview by Chelle Gentemann
Butterfly Satellite Mission OverviewButterfly Satellite Mission Overview
Butterfly Satellite Mission Overview
Chelle Gentemann121 views
Satellite passive microwave measurements of the climate crisis by Chelle Gentemann
Satellite passive microwave measurements of the climate crisisSatellite passive microwave measurements of the climate crisis
Satellite passive microwave measurements of the climate crisis
Chelle Gentemann127 views
Open ecosystems help science storm the cloud by Chelle Gentemann
Open ecosystems help science storm the cloudOpen ecosystems help science storm the cloud
Open ecosystems help science storm the cloud
Chelle Gentemann121 views
Multi-sensor Improved Sea Surface Temperatures Project by Chelle Gentemann
Multi-sensor Improved Sea Surface Temperatures ProjectMulti-sensor Improved Sea Surface Temperatures Project
Multi-sensor Improved Sea Surface Temperatures Project
Chelle Gentemann206 views

Recently uploaded

Small ruminant keepers’ knowledge, attitudes and practices towards peste des ... by
Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...
Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...ILRI
9 views1 slide
NUTRITION IN BACTERIA.pdf by
NUTRITION IN BACTERIA.pdfNUTRITION IN BACTERIA.pdf
NUTRITION IN BACTERIA.pdfNandadulalSannigrahi
39 views14 slides
ELECTRON TRANSPORT CHAIN by
ELECTRON TRANSPORT CHAINELECTRON TRANSPORT CHAIN
ELECTRON TRANSPORT CHAINDEEKSHA RANI
16 views16 slides
Bacterial Reproduction.pdf by
Bacterial Reproduction.pdfBacterial Reproduction.pdf
Bacterial Reproduction.pdfNandadulalSannigrahi
35 views32 slides
Presentation on experimental laboratory animal- Hamster by
Presentation on experimental laboratory animal- HamsterPresentation on experimental laboratory animal- Hamster
Presentation on experimental laboratory animal- HamsterKanika13641
6 views8 slides

Recently uploaded(20)

Small ruminant keepers’ knowledge, attitudes and practices towards peste des ... by ILRI
Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...
Small ruminant keepers’ knowledge, attitudes and practices towards peste des ...
ILRI9 views
ELECTRON TRANSPORT CHAIN by DEEKSHA RANI
ELECTRON TRANSPORT CHAINELECTRON TRANSPORT CHAIN
ELECTRON TRANSPORT CHAIN
DEEKSHA RANI16 views
Presentation on experimental laboratory animal- Hamster by Kanika13641
Presentation on experimental laboratory animal- HamsterPresentation on experimental laboratory animal- Hamster
Presentation on experimental laboratory animal- Hamster
Kanika136416 views
A giant thin stellar stream in the Coma Galaxy Cluster by Sérgio Sacani
A giant thin stellar stream in the Coma Galaxy ClusterA giant thin stellar stream in the Coma Galaxy Cluster
A giant thin stellar stream in the Coma Galaxy Cluster
Sérgio Sacani20 views
Best Hybrid Event Platform.pptx by Harriet Davis
Best Hybrid Event Platform.pptxBest Hybrid Event Platform.pptx
Best Hybrid Event Platform.pptx
Harriet Davis10 views
Exploring the nature and synchronicity of early cluster formation in the Larg... by Sérgio Sacani
Exploring the nature and synchronicity of early cluster formation in the Larg...Exploring the nature and synchronicity of early cluster formation in the Larg...
Exploring the nature and synchronicity of early cluster formation in the Larg...
Sérgio Sacani1.5K views
Discovery of therapeutic agents targeting PKLR for NAFLD using drug repositio... by Trustlife
Discovery of therapeutic agents targeting PKLR for NAFLD using drug repositio...Discovery of therapeutic agents targeting PKLR for NAFLD using drug repositio...
Discovery of therapeutic agents targeting PKLR for NAFLD using drug repositio...
Trustlife207 views
Effect of Integrated Nutrient Management on Growth and Yield of Solanaceous F... by SwagatBehera9
Effect of Integrated Nutrient Management on Growth and Yield of Solanaceous F...Effect of Integrated Nutrient Management on Growth and Yield of Solanaceous F...
Effect of Integrated Nutrient Management on Growth and Yield of Solanaceous F...
SwagatBehera95 views
2. Natural Sciences and Technology Author Siyavula.pdf by ssuser821efa
2. Natural Sciences and Technology Author Siyavula.pdf2. Natural Sciences and Technology Author Siyavula.pdf
2. Natural Sciences and Technology Author Siyavula.pdf
ssuser821efa12 views
Note on the Riemann Hypothesis by vegafrank2
Note on the Riemann HypothesisNote on the Riemann Hypothesis
Note on the Riemann Hypothesis
vegafrank28 views
Applications of Large Language Models in Materials Discovery and Design by Anubhav Jain
Applications of Large Language Models in Materials Discovery and DesignApplications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and Design
Anubhav Jain14 views
Determination of color fastness to rubbing(wet and dry condition) by crockmeter. by ShadmanSakib63
Determination of color fastness to rubbing(wet and dry condition) by crockmeter.Determination of color fastness to rubbing(wet and dry condition) by crockmeter.
Determination of color fastness to rubbing(wet and dry condition) by crockmeter.
ShadmanSakib636 views
Ellagic Acid and Its Metabolites as Potent and Selective Allosteric Inhibitor... by Trustlife
Ellagic Acid and Its Metabolites as Potent and Selective Allosteric Inhibitor...Ellagic Acid and Its Metabolites as Potent and Selective Allosteric Inhibitor...
Ellagic Acid and Its Metabolites as Potent and Selective Allosteric Inhibitor...
Trustlife154 views

The changing landscape of science

  • 1. The changing landscape of science Chelle L. Gentemann Earth & Space Research cgentemann@esr.org Research supported by the Schmidt Family Foundation, Saildrone, Inc., and NASA Physical Oceanography Image Credit: Saildrone, Inc. 1
  • 2. Background: sharing data • So… sharing is easy…. If you want too… 1990s: tape drives 2018: cheap local storage Cloud storage options 2
  • 3. Sharing data Figure credit: Grandjean, Martin (2014). "La connaissance est un réseau". Les Cahiers du Numérique 10 (3): 37-54. DOI:10.3166/LCN.10.3.37-54 3
  • 4. But people still don’t share data…. Legal reasons… data includes confidential information data collection funded by agency/institution with a closed policy security (export control) issues Career / funding: I collected this data. It is mine. I won’t advance if I don’t publish, I won’t get more funding on this topic. Other concerns: Other researchers will misuse or misinterpret the data It takes too much effort to document the data Other people helped produce the data, they will never agree to share it I’m a scientists not a data provider, this isn’t my job 4
  • 5. Sharing data Figure credit: Grandjean, Martin (2014). "La connaissance est un réseau". Les Cahiers du Numérique 10 (3): 37-54. DOI:10.3166/LCN.10.3.37-54 5
  • 7. Digital Object Identifier (DOI) Share data, but ensure credit. If you are a civil servant, public domain applies. Otherwise license your data. https://creativecommons.org/lic enses/ Image credit: https://www.ands.org.au/__data/assets/pdf_file/0006/715155/Digital-Object-Identifiers.pdf 8 Image credit: Creative Commons Guide with as source How To Attribute Creative Commons Photos
  • 8. Attitudes Image credit: Open Data Report Elsevier 2017 9
  • 9. Journal policies are changing https://publications.agu.org/author-resource-center/publication-policies/data-policy/ AGU affirmed in its 2012 position statement that “Earth and space science data should be widely accessible in multiple formats and long‐term preservation of data is an integral responsibility of scientists and sponsoring institutions.” Following this statement and to advance scientific exploration and discovery, and allow a full assessment of results presented in AGU’s journals, all data necessary to understand, evaluate, replicate, and build upon the reported research must be made available and accessible whenever possible. For the purposes of this policy, data include, but are not limited to, the following: Data used to generate, or be displayed in, figures, graphs, plots, videos, animations, or tables in a paper. New protocols or methods used to generate the data in a paper. New code/computer software used to generate results or analyses reported in the paper. Derived data products reported or described in a paper. 10
  • 10. Federal Policy • 2013 OSTP memo, “Increasing Access to the Results of Federally Funded Scientific Research”, aims to ensure “that, to the greatest extent and with the fewest constraints possible … , the direct results of federally funded scientific research are made available to and useful for the public, industry, and the scientific community. Such results include peer-reviewed publications and digital data.” • 2016 OMB memo, “Federal Source Code Policy: Achieving Efficiency, Transparency, and Innovation through Reusable and Open Source Software” (M-16-21), requires agencies to consider the value of publishing the code they develop as open-source software and to establish requirements for releasing custom-developed source code. 11
  • 11. NOAA open data • In 2004, NOAA policy included “NOAA will promote the open and unrestricted exchange of environmental information worldwide” • NOAA CIO Zach Goldstein describes, “It’s our job to get that data out there. The data doesn’t belong to us, it belongs to the American people.” • In 2017 NOAA created Chief Data Officer position http://odimpact.org/files/case-studies-noaa.pdf Quote from GovLab interview with Zachary Goldstein, Chief Information Officer, NOAA, September 3, 2015. 12
  • 12. Digital Globe • https://discover.digitalglobe.com/ • 2003 – present, some at .5m resolution 13
  • 13. Open source software • The next logical step after open data is open software – Reproducibility – Advancing science – Accelerating science • Tools are now mature enough to make open software relatively easy (GitHub, GitLab, BitBucket) 14
  • 14. Open source collaborations expanding Come gather 'round people Wherever you roam And admit that the waters Around you have grown And accept it that soon You'll be drenched to the bone. If your time to you Is worth savin' Then you better start swimmin' Or you'll sink like a stone For the times they are a-changin'. -Bob Dylan 15
  • 15. Python Ecosystem Image credit: Jake Vanderplas, UW 16
  • 17. Expand Openly sharing software creates a traceable resource for your work. GitHub + Zenodo for DOI. Putting figures on figshare with CC-BY allows people to easily reuse and ensures credit Putting data in dataverse or institutional archive, with an assigned DOI and license ensures credit and visibility Make it easy to find your work Make it easy to cite your work Make it easy to collaborate with you 18
  • 18. Using Saildrone autonomous in situ data for satellite validation and research into upper ocean physics and ecology Co-Investigators: S. Akella, I. Cetinić, Y. Chao, M. Chin, M. Daugharty, K. Dohan, J. Dorman, M. Fewings, X. Flores-Vidal, B. Fox-Kemper, B. Franz, M. García-Reyes, J. Gomez Valdes, E. Hazen, J. Høyer, J. Largier, P. Mazzini, J. Scott, W. Sydeman, J. Vazquez, F. Veron, J. Werdell, L. Yu, K. Zaba. Institutions: Brown University, CODAR Ocean Sensors, Danish Meteorological Institute, Earth and Space Research, Ensenada Center for Scientific Research and Higher Education, Farallon Institute, NASA Jet Propulsion Laboratory, NASA GMAO, NASA GSFC, Remote Sensing Solutions, San Francisco State University, Science Systems and Applications Inc., Scripps Institution of Oceanography, Universities Space Research Association, University of Baja California, University of California Davis, University of California Santa Cruz, University of Connecticut, University of Miami, University of Rhode Island, University of Delaware, Woods Hole Oceanographic Institution. Project funded by: Saildrone Inc. & The Schmidt Family Foundation Image credit: Saildrone, Inc. C. Gentemann, ESR P. Minnett, U. Miami P. Cornillon, U. Rhode Island 19
  • 19. Unmanned Surface Vehicle Image credit: Saildrone, Inc. 20
  • 20. Saildrones have collected data from 2015 on… Image credit: Saildrone, Inc. 21
  • 22. Baja Cruise 11 April – 11 June 2018 60-day cruise Along-wind and across wind sampling of fronts Data freely available (format finalized soon) on google drive (soon NASA.PODAAC) CC-BY-NC license Software repository for project: https://github.com/cgentemann /Saildrone 23
  • 23. April 11 - June 11, 2018 4 temperature loggers added by NASA Physical Oceanography Program 295mm 500mm 985mm 1420mm 1785mm 24 Assistant ScientistsSaildrone Engineers
  • 24. Baja Cruise: real time data Data explorer : web interface provided by Saildrone to visualize data while cruise is occurring. Data from instruments on Saildrone as well as model analyses (SST, SSS, currents, etc.) are shown 25
  • 25. Direct and task USV Data explorer : web interface for tasking USV. This allows for control of the USV to sample fronts and adjust the track as they move. Points are set, with a ‘width’ set that controls the distance the USV is allowed to vary from the track. 26
  • 26. VIIRS SST and USV track Track designed to sample different types of fronts, provide data for validation of satellite environmental products, and areas with diurnal warming events 27
  • 27. Physics of observation At 55 deg there is .96 emissivity Changes with angle of observation In reality reflected radiance is quasi- specular B(Tskin) B(Tsky) CT15 is measuring the skin temperature and reflected sky temperature 28
  • 28. Skin minus bulk difference Noise due to reflected sky radiation ? Diurnal warming of surface skin layer 29
  • 29. Bulk SST Two measurements of ‘bulk’ SST at 0.6 m depth from the O2 sensor and a CTD. Comparison between the two ‘bulk’ SSTs below. There is a *very* small difference that is wind speed dependent, but they essentially are independently measuring the same temperature to O(0.01) Bulk SST is a high quality observation, bias is NOT in the bulk SST 30
  • 30. Collocated Saildrone data with GOES 16 SST data Cloudy day in SD area Clear sky in SD area, cloud contamination in other areas SD track for day shown in pink. 24 hour average of GOES SSTs shown in image. Missing data means that it was cloudy. Cold ‘speckle’ shows cloud contamination in SSTs. Cloud mask not perfect. 31
  • 31. Time series of collocated GOES and SD data Cloudy, no GOES matchups, smaller skin SST bias Clear Sky, GOES SST matchups, large neg. bias 32
  • 32. Cloudy, no GOES matchups, smaller skin SST bias Clear Sky, GOES SST matchups, large neg. bias Time series of collocated GOES and SD data: VERIFY, verify. verify. 33
  • 33. Upper ocean diurnal warming Mixing in the upper ocean This is how solar energy is transferred into the ocean resulting in the seasonal cycle of temperature How does upper ocean stratification change rates of mixing? 34
  • 34. Buoy collocations SST (K) Tair (K) u (ms-1) # obs buoy ID Bias STD Bias STD Bias STD 46011 0.20 0.18 0.22 0.14 1.00 0.40 19 46028 -0.02 0.30 -0.15 0.13 5.32 1.85 25 46042 -0.01 0.05 0.00 0.05 0.92 0.57 13 46047 -0.20 0.08 0.02 0.11 0.65 0.81 13 46086 -0.08 0.09 0.02 0.11 0.65 0.81 19 35
  • 35. Next steps • Organize research / publications on topics: • Quality of Saildrone observations, what looks good, what needs to be flagged, share flagged values • Prof. Gomez collocated drifters, circulation study • Zaba collocated glider ADCP analysis • Satellite – buoy – Saildrone collocation analysis, validation of SST, ocean color, salinity • HF Radar surface currents, OSCAR currents, and Saildrone validation • Coastal front analysis • Offshore front analysis • Across / Along winds front differences • Circulation in frontal regions • Baroclinic Instability waves along fronts • Diurnal warming in surface layer 36
  • 37. 2019-2022: 5 Arctic Cruises Image credit: NOAA PMEL Image credit: Saildrone NASA Physical Oceanography Program 38
  • 38. Summary 39 Open data policy for data from 1st day of cruise. Open source software repository on github. Partners on the project have given talks, given out Googledrive link. Initially, data shared via googledrive to anyone who requested access, CC-BY-NC license. Will be formally shared via NASA Physical Oceanography Data Active Archive (PO.DAAC) soon. Format and metadata are finalized. Working on documentation.
  • 39. Expand 40image credit: https://www.expertsystem.com/open-source-intelligence-used/ You know your data best. Reach out to your agency to share it.
  • 40. 41