SlideShare a Scribd company logo
ODIP II – Big Data & Model Workflows
September 2015
1. What do we mean by “Big Data”? (Adam)
2. Australian Infrastructure / ODIP-II focus points (Lesley)
3. Data streams and flows (Adam)
4. Model workflows @ CSIRO (Jonathan)
5. Addressing data variety / veracity with GeoLink (Cyndy & Bob)
<BREAK>
6. Discussion
Session overview
Big Data
Big Data Definitions
Big Data Definitions
Variety
Variability
VolumeVeracity
Velocity
Big Data Definitions
Variety
Variability
VolumeVeracity
Velocity
Big Data
“‘Big Data’ is really about having
more data today than I
had yesterday, such that I need to find and
apply different ways and means of
processing it to meet my funding
deadlines.”

More Related Content

More from Adam Leadbetter

United by a Common Language
United by a Common LanguageUnited by a Common Language
United by a Common Language
Adam Leadbetter
 
The Place of Schema.org in Linked Ocean Data
The Place of Schema.org in Linked Ocean DataThe Place of Schema.org in Linked Ocean Data
The Place of Schema.org in Linked Ocean Data
Adam Leadbetter
 
Using Erddap as a building block in Ireland's Integrated Digital Ocean
Using Erddap as a building block in Ireland's Integrated Digital OceanUsing Erddap as a building block in Ireland's Integrated Digital Ocean
Using Erddap as a building block in Ireland's Integrated Digital Ocean
Adam Leadbetter
 
Where Linked Data meets Big Data: Applying standard data models to environmen...
Where Linked Data meets Big Data: Applying standard data models to environmen...Where Linked Data meets Big Data: Applying standard data models to environmen...
Where Linked Data meets Big Data: Applying standard data models to environmen...
Adam Leadbetter
 
Managing data for marine sciences
Managing data for marine sciencesManaging data for marine sciences
Managing data for marine sciences
Adam Leadbetter
 
Linked Ocean Data - Exploring connections between marine datasets in a Big Da...
Linked Ocean Data - Exploring connections between marine datasets in a Big Da...Linked Ocean Data - Exploring connections between marine datasets in a Big Da...
Linked Ocean Data - Exploring connections between marine datasets in a Big Da...
Adam Leadbetter
 
Connected Ocean Data
Connected Ocean DataConnected Ocean Data
Connected Ocean Data
Adam Leadbetter
 
Linking Open Data in Ireland's Digital Ocean
Linking Open Data in Ireland's Digital OceanLinking Open Data in Ireland's Digital Ocean
Linking Open Data in Ireland's Digital Ocean
Adam Leadbetter
 
Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...
Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...
Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...
Adam Leadbetter
 
Ocean Data Interoperability Platform - Big Data: Velocity
Ocean Data Interoperability Platform - Big Data: VelocityOcean Data Interoperability Platform - Big Data: Velocity
Ocean Data Interoperability Platform - Big Data: Velocity
Adam Leadbetter
 
Research Vessel Data Management
Research Vessel Data ManagementResearch Vessel Data Management
Research Vessel Data Management
Adam Leadbetter
 
Practical solutions to implementing "Born Connected" data systems
Practical solutions to implementing "Born Connected" data systemsPractical solutions to implementing "Born Connected" data systems
Practical solutions to implementing "Born Connected" data systems
Adam Leadbetter
 
Linked Ocean Data
Linked Ocean DataLinked Ocean Data
Linked Ocean Data
Adam Leadbetter
 
Let's talk about data: Citation and publication
Let's talk about data: Citation and publicationLet's talk about data: Citation and publication
Let's talk about data: Citation and publication
Adam Leadbetter
 
Irish Integrated Digital Ocean
Irish Integrated Digital OceanIrish Integrated Digital Ocean
Irish Integrated Digital Ocean
Adam Leadbetter
 
Ocean Data Interoperability Platform - Big Data - Streams & Workflows
Ocean Data Interoperability Platform - Big Data - Streams & WorkflowsOcean Data Interoperability Platform - Big Data - Streams & Workflows
Ocean Data Interoperability Platform - Big Data - Streams & Workflows
Adam Leadbetter
 
Where did my layer come from? The semantics of data release
Where did my layer come from? The semantics of data releaseWhere did my layer come from? The semantics of data release
Where did my layer come from? The semantics of data release
Adam Leadbetter
 
Vocabulary Services in EMODNet and SeaDataNet
Vocabulary Services in EMODNet and SeaDataNetVocabulary Services in EMODNet and SeaDataNet
Vocabulary Services in EMODNet and SeaDataNet
Adam Leadbetter
 
Oceans of Linked Data
Oceans of Linked DataOceans of Linked Data
Oceans of Linked Data
Adam Leadbetter
 
Oceans of Data
Oceans of DataOceans of Data
Oceans of Data
Adam Leadbetter
 

More from Adam Leadbetter (20)

United by a Common Language
United by a Common LanguageUnited by a Common Language
United by a Common Language
 
The Place of Schema.org in Linked Ocean Data
The Place of Schema.org in Linked Ocean DataThe Place of Schema.org in Linked Ocean Data
The Place of Schema.org in Linked Ocean Data
 
Using Erddap as a building block in Ireland's Integrated Digital Ocean
Using Erddap as a building block in Ireland's Integrated Digital OceanUsing Erddap as a building block in Ireland's Integrated Digital Ocean
Using Erddap as a building block in Ireland's Integrated Digital Ocean
 
Where Linked Data meets Big Data: Applying standard data models to environmen...
Where Linked Data meets Big Data: Applying standard data models to environmen...Where Linked Data meets Big Data: Applying standard data models to environmen...
Where Linked Data meets Big Data: Applying standard data models to environmen...
 
Managing data for marine sciences
Managing data for marine sciencesManaging data for marine sciences
Managing data for marine sciences
 
Linked Ocean Data - Exploring connections between marine datasets in a Big Da...
Linked Ocean Data - Exploring connections between marine datasets in a Big Da...Linked Ocean Data - Exploring connections between marine datasets in a Big Da...
Linked Ocean Data - Exploring connections between marine datasets in a Big Da...
 
Connected Ocean Data
Connected Ocean DataConnected Ocean Data
Connected Ocean Data
 
Linking Open Data in Ireland's Digital Ocean
Linking Open Data in Ireland's Digital OceanLinking Open Data in Ireland's Digital Ocean
Linking Open Data in Ireland's Digital Ocean
 
Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...
Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...
Ocean Data Interoperability Platform - Vocabularies: DOIs for NVS Controlled ...
 
Ocean Data Interoperability Platform - Big Data: Velocity
Ocean Data Interoperability Platform - Big Data: VelocityOcean Data Interoperability Platform - Big Data: Velocity
Ocean Data Interoperability Platform - Big Data: Velocity
 
Research Vessel Data Management
Research Vessel Data ManagementResearch Vessel Data Management
Research Vessel Data Management
 
Practical solutions to implementing "Born Connected" data systems
Practical solutions to implementing "Born Connected" data systemsPractical solutions to implementing "Born Connected" data systems
Practical solutions to implementing "Born Connected" data systems
 
Linked Ocean Data
Linked Ocean DataLinked Ocean Data
Linked Ocean Data
 
Let's talk about data: Citation and publication
Let's talk about data: Citation and publicationLet's talk about data: Citation and publication
Let's talk about data: Citation and publication
 
Irish Integrated Digital Ocean
Irish Integrated Digital OceanIrish Integrated Digital Ocean
Irish Integrated Digital Ocean
 
Ocean Data Interoperability Platform - Big Data - Streams & Workflows
Ocean Data Interoperability Platform - Big Data - Streams & WorkflowsOcean Data Interoperability Platform - Big Data - Streams & Workflows
Ocean Data Interoperability Platform - Big Data - Streams & Workflows
 
Where did my layer come from? The semantics of data release
Where did my layer come from? The semantics of data releaseWhere did my layer come from? The semantics of data release
Where did my layer come from? The semantics of data release
 
Vocabulary Services in EMODNet and SeaDataNet
Vocabulary Services in EMODNet and SeaDataNetVocabulary Services in EMODNet and SeaDataNet
Vocabulary Services in EMODNet and SeaDataNet
 
Oceans of Linked Data
Oceans of Linked DataOceans of Linked Data
Oceans of Linked Data
 
Oceans of Data
Oceans of DataOceans of Data
Oceans of Data
 

Recently uploaded

Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Ana Luísa Pinho
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
RenuJangid3
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
tonzsalvador2222
 
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
frank0071
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
muralinath2
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
RitabrataSarkar3
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
PRIYANKA PATEL
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
Abdul Wali Khan University Mardan,kP,Pakistan
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
fafyfskhan251kmf
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
TinyAnderson
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
muralinath2
 
Lateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensiveLateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensive
silvermistyshot
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
HongcNguyn6
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
yqqaatn0
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
David Osipyan
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
SAMIR PANDA
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
zeex60
 
Red blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptxRed blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptx
muralinath2
 
Shallowest Oil Discovery of Turkiye.pptx
Shallowest Oil Discovery of Turkiye.pptxShallowest Oil Discovery of Turkiye.pptx
Shallowest Oil Discovery of Turkiye.pptx
Gokturk Mehmet Dilci
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
moosaasad1975
 

Recently uploaded (20)

Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...
 
Leaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdfLeaf Initiation, Growth and Differentiation.pdf
Leaf Initiation, Growth and Differentiation.pdf
 
Chapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisisChapter 12 - climate change and the energy crisis
Chapter 12 - climate change and the energy crisis
 
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
 
Oedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptxOedema_types_causes_pathophysiology.pptx
Oedema_types_causes_pathophysiology.pptx
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
 
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...THEMATIC  APPERCEPTION  TEST(TAT) cognitive abilities, creativity, and critic...
THEMATIC APPERCEPTION TEST(TAT) cognitive abilities, creativity, and critic...
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
 
Lateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensiveLateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensive
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
 
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
3D Hybrid PIC simulation of the plasma expansion (ISSS-14)
 
Seminar of U.V. Spectroscopy by SAMIR PANDA
 Seminar of U.V. Spectroscopy by SAMIR PANDA Seminar of U.V. Spectroscopy by SAMIR PANDA
Seminar of U.V. Spectroscopy by SAMIR PANDA
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
 
Red blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptxRed blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptx
 
Shallowest Oil Discovery of Turkiye.pptx
Shallowest Oil Discovery of Turkiye.pptxShallowest Oil Discovery of Turkiye.pptx
Shallowest Oil Discovery of Turkiye.pptx
 
What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.What is greenhouse gasses and how many gasses are there to affect the Earth.
What is greenhouse gasses and how many gasses are there to affect the Earth.
 

Ocean Data Interoperability Platform - Big Data

Editor's Notes

  1. Lesley has some focus points Cyndy will present the US slides
  2. Big Data is a relative term where the volume, velocity and variety of data exceed an organisations storage or compute capacity for accurate and timely decision making
  3. Stolen from Lesley