SlideShare a Scribd company logo
1 of 7
The HDF Group

Conventions Overview
Joel Plutchak
The HDF Group

July 9-12, 2013

ESIP Summer Meeting

1

www.hdfgroup.org
Beginning a Conversation
My involvement with data and metadata
Use / Discovery / Preservation
• Eighties: SSEC, Brown University Planetary Group
• Monolithic systems, proprietary formats  use
• Nineties: U of I Atmospheric Sciences, NCSA / SDG
• Formats as standards + web  use, discovery
• Aughties: NCSA / Digital Library Technologies
• Metadata standards and semantics  discovery, preservation
• Today: The HDF Group
• Conventions + interoperability + web  enable knowledge
Emerging technologies enable evolving needs.
July 9 – 12, 2013

ESIP Summer Meeting

2

www.hdfgroup.org
Conventions: What’s in a Word?
The boundaries between concepts are fuzzy:
What is a format?
What is a convention?
What is a profile, or a standard; do they differ only in
formality of agreement or definition?
I like to think of the word conventions in a very
broad, general way, at least until I figure this all out.

July 9 – 12, 2013

ESIP Summer Meeting

3

www.hdfgroup.org
Why Conventions?

• Formats add metadata to data to yield Information
• Conventions allow combining information to yield
Knowledge
July 9 – 12, 2013

ESIP Summer Meeting

4

www.hdfgroup.org
A Few Conventions

• HDF-EOS2 / HDF-EOS5: HDF4/HDF5 format with
use metadata conventions
• Climate & Forecast (CF): metadata convention for
use of data (netCDF origin)

• Attributes for Data Discovery: metadata
convention for data discovery (Unidata, ESIP)
• Others: ISO 19115 (standard), DIF, ECHO, GeoTIFF

July 9 – 12, 2013

ESIP Summer Meeting

5

www.hdfgroup.org
Interoperability / Translation
Conventions enable interoperability & translation
• Services: OPeNDAP, taiga, OGC
• Middleware*: THREDDS, ArcGIS server, ENVI
services engine
• Libraries & tools: NCO, GDAL, aughdf5, OGC
GeoTools, h4mapwriter, ncISO, etc.

* Connecting services to data

July 9 – 12, 2013

ESIP Summer Meeting

6

www.hdfgroup.org
The HDF Group

Earth Science Group
Ted Habermann
Kent Yang
H. Joe Lee
Joel Plutchak

July 9-12, 2013

ESIP Summer Meeting

7

www.hdfgroup.org

More Related Content

What's hot

UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...
UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...
UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...L Molloy
 
Do & don't of supporting Open Science
Do & don't of supporting Open ScienceDo & don't of supporting Open Science
Do & don't of supporting Open ScienceSarah Jones
 
What I wish I’d known at the start!
What I wish I’d known at the start!What I wish I’d known at the start!
What I wish I’d known at the start!Jisc RDM
 
Raising your research profile with open access
Raising your research profile with open accessRaising your research profile with open access
Raising your research profile with open accessCurtin University Library
 
Performances, preservation and policy implications: digital curation and pres...
Performances, preservation and policy implications: digital curation and pres...Performances, preservation and policy implications: digital curation and pres...
Performances, preservation and policy implications: digital curation and pres...L Molloy
 
Ensuring the Integrity (& Continuity) of Our Record of Scholarship
Ensuring the Integrity (& Continuity) of Our Record of ScholarshipEnsuring the Integrity (& Continuity) of Our Record of Scholarship
Ensuring the Integrity (& Continuity) of Our Record of ScholarshipEDINA, University of Edinburgh
 
Digital Preservation Case Study: Community Action via UK LOCKSS Alliance
Digital Preservation Case Study: Community Action via UK LOCKSS AllianceDigital Preservation Case Study: Community Action via UK LOCKSS Alliance
Digital Preservation Case Study: Community Action via UK LOCKSS AllianceEDINA, University of Edinburgh
 
Pushing Open The Jorum: A national repository for learning materials
Pushing Open The Jorum: A national repository for learning materialsPushing Open The Jorum: A national repository for learning materials
Pushing Open The Jorum: A national repository for learning materialsEDINA, University of Edinburgh
 
Clipper - Enhancing Time-Based Media for Research
Clipper - Enhancing Time-Based Media for ResearchClipper - Enhancing Time-Based Media for Research
Clipper - Enhancing Time-Based Media for ResearchCollege Development Network
 
The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...
The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...
The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...Jisc
 
Supporting Good Practice in Research Data Management: Edinburgh’s Experience
Supporting Good Practice in Research Data Management: Edinburgh’s ExperienceSupporting Good Practice in Research Data Management: Edinburgh’s Experience
Supporting Good Practice in Research Data Management: Edinburgh’s ExperienceRobin Rice
 
The exchange between open access and open educational resources: What can we ...
The exchange between open access and open educational resources: What can we ...The exchange between open access and open educational resources: What can we ...
The exchange between open access and open educational resources: What can we ...Creative Commons
 
Research Data Mantra (Management Training) Online Course Launch
Research Data Mantra (Management Training) Online Course LaunchResearch Data Mantra (Management Training) Online Course Launch
Research Data Mantra (Management Training) Online Course LaunchEDINA, University of Edinburgh
 
Discovering the research data alliance
Discovering the research data allianceDiscovering the research data alliance
Discovering the research data allianceJisc RDM
 
Global Open Research Commons IG
Global Open Research Commons IGGlobal Open Research Commons IG
Global Open Research Commons IGSarah Jones
 
Closing plenary - John Wilkin and David Maguire
Closing plenary - John Wilkin and David MaguireClosing plenary - John Wilkin and David Maguire
Closing plenary - John Wilkin and David MaguireJisc
 
Natalie Harrower - DRI, RDA and Ireland
Natalie Harrower - DRI, RDA and IrelandNatalie Harrower - DRI, RDA and Ireland
Natalie Harrower - DRI, RDA and Irelanddri_ireland
 
Common ground: A view of the open education landscape in Scotland
Common ground: A view of the open education landscape in Scotland Common ground: A view of the open education landscape in Scotland
Common ground: A view of the open education landscape in Scotland Lorna Campbell
 

What's hot (20)

UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...
UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...
UK Research Data Management: overview to ADBU congress, 19 Sep 2013 by Laura ...
 
Do & don't of supporting Open Science
Do & don't of supporting Open ScienceDo & don't of supporting Open Science
Do & don't of supporting Open Science
 
What I wish I’d known at the start!
What I wish I’d known at the start!What I wish I’d known at the start!
What I wish I’d known at the start!
 
Raising your research profile with open access
Raising your research profile with open accessRaising your research profile with open access
Raising your research profile with open access
 
Performances, preservation and policy implications: digital curation and pres...
Performances, preservation and policy implications: digital curation and pres...Performances, preservation and policy implications: digital curation and pres...
Performances, preservation and policy implications: digital curation and pres...
 
Ensuring the Integrity (& Continuity) of Our Record of Scholarship
Ensuring the Integrity (& Continuity) of Our Record of ScholarshipEnsuring the Integrity (& Continuity) of Our Record of Scholarship
Ensuring the Integrity (& Continuity) of Our Record of Scholarship
 
Digital Preservation Case Study: Community Action via UK LOCKSS Alliance
Digital Preservation Case Study: Community Action via UK LOCKSS AllianceDigital Preservation Case Study: Community Action via UK LOCKSS Alliance
Digital Preservation Case Study: Community Action via UK LOCKSS Alliance
 
Pushing Open The Jorum: A national repository for learning materials
Pushing Open The Jorum: A national repository for learning materialsPushing Open The Jorum: A national repository for learning materials
Pushing Open The Jorum: A national repository for learning materials
 
Clipper - Enhancing Time-Based Media for Research
Clipper - Enhancing Time-Based Media for ResearchClipper - Enhancing Time-Based Media for Research
Clipper - Enhancing Time-Based Media for Research
 
Ppls mvm2
Ppls mvm2Ppls mvm2
Ppls mvm2
 
The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...
The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...
The future of research: are you ready? - Jeremy Frey - Jisc Digital Festival ...
 
Supporting Good Practice in Research Data Management: Edinburgh’s Experience
Supporting Good Practice in Research Data Management: Edinburgh’s ExperienceSupporting Good Practice in Research Data Management: Edinburgh’s Experience
Supporting Good Practice in Research Data Management: Edinburgh’s Experience
 
The exchange between open access and open educational resources: What can we ...
The exchange between open access and open educational resources: What can we ...The exchange between open access and open educational resources: What can we ...
The exchange between open access and open educational resources: What can we ...
 
Dipping a toe into the sea of scholarly publishing
Dipping a toe into the sea of  scholarly publishingDipping a toe into the sea of  scholarly publishing
Dipping a toe into the sea of scholarly publishing
 
Research Data Mantra (Management Training) Online Course Launch
Research Data Mantra (Management Training) Online Course LaunchResearch Data Mantra (Management Training) Online Course Launch
Research Data Mantra (Management Training) Online Course Launch
 
Discovering the research data alliance
Discovering the research data allianceDiscovering the research data alliance
Discovering the research data alliance
 
Global Open Research Commons IG
Global Open Research Commons IGGlobal Open Research Commons IG
Global Open Research Commons IG
 
Closing plenary - John Wilkin and David Maguire
Closing plenary - John Wilkin and David MaguireClosing plenary - John Wilkin and David Maguire
Closing plenary - John Wilkin and David Maguire
 
Natalie Harrower - DRI, RDA and Ireland
Natalie Harrower - DRI, RDA and IrelandNatalie Harrower - DRI, RDA and Ireland
Natalie Harrower - DRI, RDA and Ireland
 
Common ground: A view of the open education landscape in Scotland
Common ground: A view of the open education landscape in Scotland Common ground: A view of the open education landscape in Scotland
Common ground: A view of the open education landscape in Scotland
 

Viewers also liked

oli & fat Assignment no 5
 oli & fat Assignment no 5 oli & fat Assignment no 5
oli & fat Assignment no 5Abdul Moiz Dota
 
Exercício protocolos de redes julho 2013
Exercício protocolos de redes julho 2013Exercício protocolos de redes julho 2013
Exercício protocolos de redes julho 2013Kundan Narendra
 
Convención sobre los derechos del niño
Convención sobre los derechos del niñoConvención sobre los derechos del niño
Convención sobre los derechos del niñoPepe García Hernández
 
O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...
O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...
O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...A. Rui Teixeira Santos
 

Viewers also liked (6)

oli & fat Assignment no 5
 oli & fat Assignment no 5 oli & fat Assignment no 5
oli & fat Assignment no 5
 
dbt
dbtdbt
dbt
 
Exercício protocolos de redes julho 2013
Exercício protocolos de redes julho 2013Exercício protocolos de redes julho 2013
Exercício protocolos de redes julho 2013
 
Convención sobre los derechos del niño
Convención sobre los derechos del niñoConvención sobre los derechos del niño
Convención sobre los derechos del niño
 
O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...
O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...
O estado isonómico e o declínio das políticas públicas, Prof. Doutor Rui Teix...
 
201 pump condition evaluation
201 pump condition evaluation201 pump condition evaluation
201 pump condition evaluation
 

Similar to Conventions Overview

OSGIS: an introduction to the research data alliance
OSGIS: an introduction to the research data allianceOSGIS: an introduction to the research data alliance
OSGIS: an introduction to the research data allianceHerman Stehouwer
 
Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...
Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...
Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...Digitalmikkeli
 
Libraries and Research Data Management – What Works? Lessons Learned from the...
Libraries and Research Data Management – What Works? Lessons Learned from the...Libraries and Research Data Management – What Works? Lessons Learned from the...
Libraries and Research Data Management – What Works? Lessons Learned from the...LIBER Europe
 
Update on the Research Data Alliance 11 December 2014
Update on the Research Data Alliance 11 December 2014Update on the Research Data Alliance 11 December 2014
Update on the Research Data Alliance 11 December 2014Research Data Alliance
 
Research Data Management for Librarians at Oxford Brookes
Research Data Management for Librarians at Oxford BrookesResearch Data Management for Librarians at Oxford Brookes
Research Data Management for Librarians at Oxford BrookesMarieke Guy
 
NordForsk Open Access Reykjavik 14-15/8-2014:Rda
NordForsk Open Access Reykjavik 14-15/8-2014:RdaNordForsk Open Access Reykjavik 14-15/8-2014:Rda
NordForsk Open Access Reykjavik 14-15/8-2014:RdaNordForsk
 
Data Management Planning at the DCC
Data Management Planning at the DCCData Management Planning at the DCC
Data Management Planning at the DCCMartin Donnelly
 
RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...
RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...
RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...Pedro Príncipe
 
(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)
(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)
(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)OpenAIRE
 
Using technologies to promote projects
Using technologies to promote projectsUsing technologies to promote projects
Using technologies to promote projectsDART Project
 
Open Data - strategies for research data management & impact of best practices
Open Data - strategies for research data management & impact of best practicesOpen Data - strategies for research data management & impact of best practices
Open Data - strategies for research data management & impact of best practicesMartin Donnelly
 
Lines of Communication: Open Access Repositories & Scholarly Publication
Lines of Communication: Open Access Repositories & Scholarly PublicationLines of Communication: Open Access Repositories & Scholarly Publication
Lines of Communication: Open Access Repositories & Scholarly PublicationGaz Johnson
 
Research Data Alliance .. The Why, How, What ...
Research Data Alliance .. The Why, How, What ... Research Data Alliance .. The Why, How, What ...
Research Data Alliance .. The Why, How, What ... Research Data Alliance
 
Dimensions of open research: critical reflections on openness in the ROER4D p...
Dimensions of open research: critical reflections on openness in the ROER4D p...Dimensions of open research: critical reflections on openness in the ROER4D p...
Dimensions of open research: critical reflections on openness in the ROER4D p...ROER4D
 
Open science and research initiative in Finland: Persistency and infrastructu...
Open science and research initiative in Finland: Persistency and infrastructu...Open science and research initiative in Finland: Persistency and infrastructu...
Open science and research initiative in Finland: Persistency and infrastructu...Platforma Otwartej Nauki
 

Similar to Conventions Overview (20)

OSGIS: an introduction to the research data alliance
OSGIS: an introduction to the research data allianceOSGIS: an introduction to the research data alliance
OSGIS: an introduction to the research data alliance
 
Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...
Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...
Datajalostamo-seminaari 5.6.2014: Tutkimusdatan avoimuus – globaalit tutkimus...
 
Libraries and Research Data Management – What Works? Lessons Learned from the...
Libraries and Research Data Management – What Works? Lessons Learned from the...Libraries and Research Data Management – What Works? Lessons Learned from the...
Libraries and Research Data Management – What Works? Lessons Learned from the...
 
Update on the Research Data Alliance 11 December 2014
Update on the Research Data Alliance 11 December 2014Update on the Research Data Alliance 11 December 2014
Update on the Research Data Alliance 11 December 2014
 
Research Data Management for Librarians at Oxford Brookes
Research Data Management for Librarians at Oxford BrookesResearch Data Management for Librarians at Oxford Brookes
Research Data Management for Librarians at Oxford Brookes
 
NordForsk Open Access Reykjavik 14-15/8-2014:Rda
NordForsk Open Access Reykjavik 14-15/8-2014:RdaNordForsk Open Access Reykjavik 14-15/8-2014:Rda
NordForsk Open Access Reykjavik 14-15/8-2014:Rda
 
RDA Update
RDA UpdateRDA Update
RDA Update
 
Data Management Planning at the DCC
Data Management Planning at the DCCData Management Planning at the DCC
Data Management Planning at the DCC
 
RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...
RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...
RDM librarians Skills & Competencies: roles & training (SPARC & COAR Member W...
 
Setting up a data repository, what does it entail?
Setting up a data repository, what does it entail?Setting up a data repository, what does it entail?
Setting up a data repository, what does it entail?
 
(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)
(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)
(Open) Research Data Management in H2020 (ISERD – Tel Aviv, Oct 31, 2016)
 
Using technologies to promote projects
Using technologies to promote projectsUsing technologies to promote projects
Using technologies to promote projects
 
Open Data - strategies for research data management & impact of best practices
Open Data - strategies for research data management & impact of best practicesOpen Data - strategies for research data management & impact of best practices
Open Data - strategies for research data management & impact of best practices
 
Open Science - Global Perspectives/Simon Hodson
Open Science - Global Perspectives/Simon HodsonOpen Science - Global Perspectives/Simon Hodson
Open Science - Global Perspectives/Simon Hodson
 
RDA UK
RDA UKRDA UK
RDA UK
 
Lines of Communication: Open Access Repositories & Scholarly Publication
Lines of Communication: Open Access Repositories & Scholarly PublicationLines of Communication: Open Access Repositories & Scholarly Publication
Lines of Communication: Open Access Repositories & Scholarly Publication
 
Research Data Alliance .. The Why, How, What ...
Research Data Alliance .. The Why, How, What ... Research Data Alliance .. The Why, How, What ...
Research Data Alliance .. The Why, How, What ...
 
The NeDiMAH workgroup on Space and Time
The NeDiMAH workgroup on Space and TimeThe NeDiMAH workgroup on Space and Time
The NeDiMAH workgroup on Space and Time
 
Dimensions of open research: critical reflections on openness in the ROER4D p...
Dimensions of open research: critical reflections on openness in the ROER4D p...Dimensions of open research: critical reflections on openness in the ROER4D p...
Dimensions of open research: critical reflections on openness in the ROER4D p...
 
Open science and research initiative in Finland: Persistency and infrastructu...
Open science and research initiative in Finland: Persistency and infrastructu...Open science and research initiative in Finland: Persistency and infrastructu...
Open science and research initiative in Finland: Persistency and infrastructu...
 

More from The HDF-EOS Tools and Information Center

STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...The HDF-EOS Tools and Information Center
 

More from The HDF-EOS Tools and Information Center (20)

Cloud-Optimized HDF5 Files
Cloud-Optimized HDF5 FilesCloud-Optimized HDF5 Files
Cloud-Optimized HDF5 Files
 
Accessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDSAccessing HDF5 data in the cloud with HSDS
Accessing HDF5 data in the cloud with HSDS
 
The State of HDF
The State of HDFThe State of HDF
The State of HDF
 
Highly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance FeaturesHighly Scalable Data Service (HSDS) Performance Features
Highly Scalable Data Service (HSDS) Performance Features
 
Creating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 FilesCreating Cloud-Optimized HDF5 Files
Creating Cloud-Optimized HDF5 Files
 
HDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance DiscussionHDF5 OPeNDAP Handler Updates, and Performance Discussion
HDF5 OPeNDAP Handler Updates, and Performance Discussion
 
Hyrax: Serving Data from S3
Hyrax: Serving Data from S3Hyrax: Serving Data from S3
Hyrax: Serving Data from S3
 
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLABAccessing Cloud Data and Services Using EDL, Pydap, MATLAB
Accessing Cloud Data and Services Using EDL, Pydap, MATLAB
 
HDF - Current status and Future Directions
HDF - Current status and Future DirectionsHDF - Current status and Future Directions
HDF - Current status and Future Directions
 
HDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and FutureHDFEOS.org User Analsys, Updates, and Future
HDFEOS.org User Analsys, Updates, and Future
 
HDF - Current status and Future Directions
HDF - Current status and Future Directions HDF - Current status and Future Directions
HDF - Current status and Future Directions
 
H5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only LibraryH5Coro: The Cloud-Optimized Read-Only Library
H5Coro: The Cloud-Optimized Read-Only Library
 
MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10MATLAB Modernization on HDF5 1.10
MATLAB Modernization on HDF5 1.10
 
HDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDFHDF for the Cloud - Serverless HDF
HDF for the Cloud - Serverless HDF
 
HDF5 <-> Zarr
HDF5 <-> ZarrHDF5 <-> Zarr
HDF5 <-> Zarr
 
HDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server FeaturesHDF for the Cloud - New HDF Server Features
HDF for the Cloud - New HDF Server Features
 
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
Apache Drill and Unidata THREDDS Data Server for NASA HDF-EOS on S3
 
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
STARE-PODS: A Versatile Data Store Leveraging the HDF Virtual Object Layer fo...
 
HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?HDF5 and Ecosystem: What Is New?
HDF5 and Ecosystem: What Is New?
 
HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020HDF5 Roadmap 2019-2020
HDF5 Roadmap 2019-2020
 

Recently uploaded

Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 

Recently uploaded (20)

Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 

Conventions Overview

  • 1. The HDF Group Conventions Overview Joel Plutchak The HDF Group July 9-12, 2013 ESIP Summer Meeting 1 www.hdfgroup.org
  • 2. Beginning a Conversation My involvement with data and metadata Use / Discovery / Preservation • Eighties: SSEC, Brown University Planetary Group • Monolithic systems, proprietary formats  use • Nineties: U of I Atmospheric Sciences, NCSA / SDG • Formats as standards + web  use, discovery • Aughties: NCSA / Digital Library Technologies • Metadata standards and semantics  discovery, preservation • Today: The HDF Group • Conventions + interoperability + web  enable knowledge Emerging technologies enable evolving needs. July 9 – 12, 2013 ESIP Summer Meeting 2 www.hdfgroup.org
  • 3. Conventions: What’s in a Word? The boundaries between concepts are fuzzy: What is a format? What is a convention? What is a profile, or a standard; do they differ only in formality of agreement or definition? I like to think of the word conventions in a very broad, general way, at least until I figure this all out. July 9 – 12, 2013 ESIP Summer Meeting 3 www.hdfgroup.org
  • 4. Why Conventions? • Formats add metadata to data to yield Information • Conventions allow combining information to yield Knowledge July 9 – 12, 2013 ESIP Summer Meeting 4 www.hdfgroup.org
  • 5. A Few Conventions • HDF-EOS2 / HDF-EOS5: HDF4/HDF5 format with use metadata conventions • Climate & Forecast (CF): metadata convention for use of data (netCDF origin) • Attributes for Data Discovery: metadata convention for data discovery (Unidata, ESIP) • Others: ISO 19115 (standard), DIF, ECHO, GeoTIFF July 9 – 12, 2013 ESIP Summer Meeting 5 www.hdfgroup.org
  • 6. Interoperability / Translation Conventions enable interoperability & translation • Services: OPeNDAP, taiga, OGC • Middleware*: THREDDS, ArcGIS server, ENVI services engine • Libraries & tools: NCO, GDAL, aughdf5, OGC GeoTools, h4mapwriter, ncISO, etc. * Connecting services to data July 9 – 12, 2013 ESIP Summer Meeting 6 www.hdfgroup.org
  • 7. The HDF Group Earth Science Group Ted Habermann Kent Yang H. Joe Lee Joel Plutchak July 9-12, 2013 ESIP Summer Meeting 7 www.hdfgroup.org

Editor's Notes

  1. This overview is about beginning a conversation on conventions and where we are today in the Earth Sciences.A good place to begin a conversation is with an introduction… my journey to being here today(add formats, conventions, systems as pop-up terms?)McIDAS, VICAR | HTML/WWW, Z39.50 | Dublin core, semantic web, library/provenance | CF, et al.
  2. DIKW: Well-known part of the language of information scienceData: gathering of partsInformation: connection of partsKnowledge: formation of a wholeWisdom: joining of wholesShared conventions allow joining of the wholes
  3. Keeping in mind the line between formats, conventions, and standards can be fuzzy…HDF-EOS2: added specific attributes to HDF4HDF-EOS5: added specific attributes to HDF5CF: added attributes to netCDF specifically for USEA for D D: added attributes to netCDF specifically for DISCOVERY
  4. The HDF Group maintains hyrax handlers for HDF4 and HDF5GDAL: Geospatial Data Abstraction Library
  5. We’ve formed a subgroup within The HDF Group to concentrate on issues like these. We’re excited by the opportunity to join in the conversation and help form the emerging landscape in Earth Sciences data and metadata conventions and their uses in current ad upcoming missions.