SlideShare a Scribd company logo
1 of 13
OPEN BACKSCATTER
TOOLCHAIN (OPENBST)
PROJECT
A COMMUNITY-VETTED WORKFLOW FOR
BACKSCATTER PROCESSING
M. Smith, G. Masetti, L. Mayer, M. Malik, J.-M. Augustin, C. Poncelet, I. Parnum
Seafloor Backscatter
Images from Marine Geophysical Research Volume 39 Issue 1-2 (2018)
Image Credit: T.C. Weber
2
Data Ch allen ges
Seafloor Backscatter
Images from Marine Geophysical Research Volume 39 Issue 1-2 (2018)
Hard to obtain quantitative and comparable
data sets..
• Calibration of multibeam
echosounder radiation pattern
• Results varies system to system
• Data is sensitive to changes in
parameters
• No standard for processing and
reporting the data
3
The Backscatter Inter-comparison
Project
https://bswg.github.io/bsip/
A GEOHAB project with the
aim of checking the
consistency of backscatter
processing results provided
by various software suites
4
The Backscatter Inter-comparison Project
5
Ope nBST – Transpare nt Algori t hms and
Communi ty Discussi on
How do we address the problem?
6
But Really, How?
Python, python, HydrOffice and more python
• Back End: Python Library and NetCDF
based project structure
• Front End: Jupyter Notebook and
public api
7
Backend – Python Library and NetCDF
NetCDF with Nodal Processing Structure
• Unique hash identifies each processing step and
‘remembers’ prior step
• Allows for reuse of prior workflows
8
Front End – Jupyter Notebooks
Beam-width limited area
correction
Pulse length limited area
correction
Combined area correction
9
Front End – Application
Programming Interface (API)
Processing methods are independent
methods:
• Inputs are clearly and explicitly named.
Should be self descriptive
• Algorithm is written clearly, simple to
follow
• Outputs packaged in a self-descriptive
dictionary
The coded algorithm should be simple to
implement and merge with other
computing environments
10
11
Where we are and where we are
going
• Version 0:
• To be realized on Github within the next 2 months
• Primarily the software architecture with limited functionality
• Works with Reson .s7k
• Version 1:
• Add more sonar data formats
• Add to the algorithm base
• Begin establishing trusted workflows for commonly used systems
• Add comparison tools to directly compare workflow results in a single notebook
12
What does OpenBST mean for you?
• Collaboratively discuss and develop processing algorithms
• Software algorithms implemented in commercial tools can be bench tested
• Identify why differences in key processing stages vary between software suites
• Increase the confidence and understanding of backscatter processing results
GITHUB
+
13

More Related Content

What's hot

The Use of WSR_88D radar data at NCEP_2015_AMS_20141222
The Use of WSR_88D radar data at NCEP_2015_AMS_20141222The Use of WSR_88D radar data at NCEP_2015_AMS_20141222
The Use of WSR_88D radar data at NCEP_2015_AMS_20141222
shun liu
 
K venkata reddy
K venkata reddyK venkata reddy
K venkata reddy
ClimDev15
 

What's hot (20)

DSD-INT 2015 - Foreshore wave attenuation modelling with Xbeach using EO data...
DSD-INT 2015 - Foreshore wave attenuation modelling with Xbeach using EO data...DSD-INT 2015 - Foreshore wave attenuation modelling with Xbeach using EO data...
DSD-INT 2015 - Foreshore wave attenuation modelling with Xbeach using EO data...
 
20 bethke hammer_timeseries_of_spectrally_resolved_solar_irradiance_data_from...
20 bethke hammer_timeseries_of_spectrally_resolved_solar_irradiance_data_from...20 bethke hammer_timeseries_of_spectrally_resolved_solar_irradiance_data_from...
20 bethke hammer_timeseries_of_spectrally_resolved_solar_irradiance_data_from...
 
Container orchestration in geo-distributed cloud computing platforms
Container orchestration in geo-distributed cloud computing platformsContainer orchestration in geo-distributed cloud computing platforms
Container orchestration in geo-distributed cloud computing platforms
 
DSD-INT 2015 -EU FP7 project “FAST” introduction - Mindert de Vries
DSD-INT 2015 -EU FP7 project “FAST” introduction - Mindert de VriesDSD-INT 2015 -EU FP7 project “FAST” introduction - Mindert de Vries
DSD-INT 2015 -EU FP7 project “FAST” introduction - Mindert de Vries
 
Report Out: Smart Eco-Districts DC
Report Out: Smart Eco-Districts DCReport Out: Smart Eco-Districts DC
Report Out: Smart Eco-Districts DC
 
Radiation Test -Raspberry PI Zero-
Radiation Test -Raspberry PI Zero-Radiation Test -Raspberry PI Zero-
Radiation Test -Raspberry PI Zero-
 
The Use of WSR_88D radar data at NCEP_2015_AMS_20141222
The Use of WSR_88D radar data at NCEP_2015_AMS_20141222The Use of WSR_88D radar data at NCEP_2015_AMS_20141222
The Use of WSR_88D radar data at NCEP_2015_AMS_20141222
 
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessor
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessorOptimizing purdue lin microphysics scheme for intel xeon phi coprocessor
Optimizing purdue lin microphysics scheme for intel xeon phi coprocessor
 
20181128 3 voskov efficient and efficient geothermal simulation
20181128 3 voskov   efficient and efficient geothermal simulation20181128 3 voskov   efficient and efficient geothermal simulation
20181128 3 voskov efficient and efficient geothermal simulation
 
Keeping a Sentinel Eye on the Volcanoes – from Space!
Keeping a Sentinel Eye on the Volcanoes – from Space!Keeping a Sentinel Eye on the Volcanoes – from Space!
Keeping a Sentinel Eye on the Volcanoes – from Space!
 
VIDEO STREAM ANALYSIS IN CLOUDS: AN OBJECT DETECTION AND CLASSIFICATION FRAME...
VIDEO STREAM ANALYSIS IN CLOUDS: AN OBJECT DETECTION AND CLASSIFICATION FRAME...VIDEO STREAM ANALYSIS IN CLOUDS: AN OBJECT DETECTION AND CLASSIFICATION FRAME...
VIDEO STREAM ANALYSIS IN CLOUDS: AN OBJECT DETECTION AND CLASSIFICATION FRAME...
 
FOSDEM 2015: Distributed Tile Processing with GeoTrellis and Spark
FOSDEM 2015: Distributed Tile Processing with GeoTrellis and SparkFOSDEM 2015: Distributed Tile Processing with GeoTrellis and Spark
FOSDEM 2015: Distributed Tile Processing with GeoTrellis and Spark
 
C-SAW: A Framework for Graph Sampling and Random Walk on GPUs
C-SAW: A Framework for Graph Sampling and Random Walk on GPUsC-SAW: A Framework for Graph Sampling and Random Walk on GPUs
C-SAW: A Framework for Graph Sampling and Random Walk on GPUs
 
KatRisk SpatialKat US Flood Model
KatRisk SpatialKat US Flood ModelKatRisk SpatialKat US Flood Model
KatRisk SpatialKat US Flood Model
 
DSD-INT 2017 High Performance Parallel Computing with iMODFLOW-MetaSWAP - Ver...
DSD-INT 2017 High Performance Parallel Computing with iMODFLOW-MetaSWAP - Ver...DSD-INT 2017 High Performance Parallel Computing with iMODFLOW-MetaSWAP - Ver...
DSD-INT 2017 High Performance Parallel Computing with iMODFLOW-MetaSWAP - Ver...
 
Focusing a Mineral Spirit LNAPL Investigation Towards Remedial Design Using U...
Focusing a Mineral Spirit LNAPL Investigation Towards Remedial Design Using U...Focusing a Mineral Spirit LNAPL Investigation Towards Remedial Design Using U...
Focusing a Mineral Spirit LNAPL Investigation Towards Remedial Design Using U...
 
K venkata reddy
K venkata reddyK venkata reddy
K venkata reddy
 
Q4 2016 GeoTrellis Presentation
Q4 2016 GeoTrellis PresentationQ4 2016 GeoTrellis Presentation
Q4 2016 GeoTrellis Presentation
 
Fast Depth Paper Review
Fast Depth Paper ReviewFast Depth Paper Review
Fast Depth Paper Review
 
DSD-INT 2015 - Fast Tool -Gerrit Hendriksen
DSD-INT 2015 - Fast Tool -Gerrit HendriksenDSD-INT 2015 - Fast Tool -Gerrit Hendriksen
DSD-INT 2015 - Fast Tool -Gerrit Hendriksen
 

Similar to Open Backscatter Toolchain (OpenBST) Project - A Community-vetted Workflow for Backscatter Processing

Telemetry Display and Archival on Linux Platform
Telemetry Display and Archival on Linux PlatformTelemetry Display and Archival on Linux Platform
Telemetry Display and Archival on Linux Platform
Cristi Onofrei
 
Arm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AI
Arm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AIArm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AI
Arm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AI
inside-BigData.com
 
Enabling Congestion Control Using Homogeneous Archetypes
Enabling Congestion Control Using Homogeneous ArchetypesEnabling Congestion Control Using Homogeneous Archetypes
Enabling Congestion Control Using Homogeneous Archetypes
James Johnson
 
Comparing Write-Ahead Logging and the Memory Bus Using
Comparing Write-Ahead Logging and the Memory Bus UsingComparing Write-Ahead Logging and the Memory Bus Using
Comparing Write-Ahead Logging and the Memory Bus Using
jorgerodriguessimao
 
Proceedings
ProceedingsProceedings
Proceedings
butest
 

Similar to Open Backscatter Toolchain (OpenBST) Project - A Community-vetted Workflow for Backscatter Processing (20)

05 Preparing for Extreme Geterogeneity in HPC
05 Preparing for Extreme Geterogeneity in HPC05 Preparing for Extreme Geterogeneity in HPC
05 Preparing for Extreme Geterogeneity in HPC
 
Telemetry Display and Archival on Linux Platform
Telemetry Display and Archival on Linux PlatformTelemetry Display and Archival on Linux Platform
Telemetry Display and Archival on Linux Platform
 
tip oopt pse-summit2017
tip oopt pse-summit2017tip oopt pse-summit2017
tip oopt pse-summit2017
 
09 The Extreme-scale Scientific Software Stack for Collaborative Open Source
09 The Extreme-scale Scientific Software Stack for Collaborative Open Source09 The Extreme-scale Scientific Software Stack for Collaborative Open Source
09 The Extreme-scale Scientific Software Stack for Collaborative Open Source
 
Arm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AI
Arm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AIArm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AI
Arm A64fx and Post-K: Game-Changing CPU & Supercomputer for HPC, Big Data, & AI
 
Evaluating Machine Learning Algorithms for Materials Science using the Matben...
Evaluating Machine Learning Algorithms for Materials Science using the Matben...Evaluating Machine Learning Algorithms for Materials Science using the Matben...
Evaluating Machine Learning Algorithms for Materials Science using the Matben...
 
Parallel Vector Tile-Optimized Library (PVTOL) Architecture-v3.pdf
Parallel Vector Tile-Optimized Library (PVTOL) Architecture-v3.pdfParallel Vector Tile-Optimized Library (PVTOL) Architecture-v3.pdf
Parallel Vector Tile-Optimized Library (PVTOL) Architecture-v3.pdf
 
Enabling Congestion Control Using Homogeneous Archetypes
Enabling Congestion Control Using Homogeneous ArchetypesEnabling Congestion Control Using Homogeneous Archetypes
Enabling Congestion Control Using Homogeneous Archetypes
 
Model checking
Model checkingModel checking
Model checking
 
Comparing Write-Ahead Logging and the Memory Bus Using
Comparing Write-Ahead Logging and the Memory Bus UsingComparing Write-Ahead Logging and the Memory Bus Using
Comparing Write-Ahead Logging and the Memory Bus Using
 
Enabling Application Integrated Proactive Fault Tolerance
Enabling Application Integrated Proactive Fault ToleranceEnabling Application Integrated Proactive Fault Tolerance
Enabling Application Integrated Proactive Fault Tolerance
 
OpenRepGrid – An Open Source Software for the Analysis of Repertory Grids
OpenRepGrid – An Open Source Software for the Analysis of Repertory GridsOpenRepGrid – An Open Source Software for the Analysis of Repertory Grids
OpenRepGrid – An Open Source Software for the Analysis of Repertory Grids
 
Proceedings
ProceedingsProceedings
Proceedings
 
Deepcoder to Self-Code with Machine Learning
Deepcoder to Self-Code with Machine LearningDeepcoder to Self-Code with Machine Learning
Deepcoder to Self-Code with Machine Learning
 
Overview of DuraMat software tool development
Overview of DuraMat software tool developmentOverview of DuraMat software tool development
Overview of DuraMat software tool development
 
Power Meter Presentation
Power Meter PresentationPower Meter Presentation
Power Meter Presentation
 
Scaling Application on High Performance Computing Clusters and Analysis of th...
Scaling Application on High Performance Computing Clusters and Analysis of th...Scaling Application on High Performance Computing Clusters and Analysis of th...
Scaling Application on High Performance Computing Clusters and Analysis of th...
 
Error Permissive Computing
Error Permissive ComputingError Permissive Computing
Error Permissive Computing
 
Vedic Calculator
Vedic CalculatorVedic Calculator
Vedic Calculator
 
Performance of Weighted Least Square Filter Based Pan Sharpening using Fuzzy ...
Performance of Weighted Least Square Filter Based Pan Sharpening using Fuzzy ...Performance of Weighted Least Square Filter Based Pan Sharpening using Fuzzy ...
Performance of Weighted Least Square Filter Based Pan Sharpening using Fuzzy ...
 

More from Giuseppe Masetti

Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...
Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...
Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...
Giuseppe Masetti
 
The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...
The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...
The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...
Giuseppe Masetti
 
Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...
Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...
Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...
Giuseppe Masetti
 

More from Giuseppe Masetti (19)

e-learning Python for Ocean Mapping - Empowering the next generation of ocean...
e-learning Python for Ocean Mapping - Empowering the next generation of ocean...e-learning Python for Ocean Mapping - Empowering the next generation of ocean...
e-learning Python for Ocean Mapping - Empowering the next generation of ocean...
 
Leveraging Predictions from NOAA’s Oceanographic Forecast Models to Increase ...
Leveraging Predictions from NOAA’s Oceanographic Forecast Models to Increase ...Leveraging Predictions from NOAA’s Oceanographic Forecast Models to Increase ...
Leveraging Predictions from NOAA’s Oceanographic Forecast Models to Increase ...
 
ePOM - Fundamentals of Research Software Development - Code Version Control
ePOM - Fundamentals of Research Software Development - Code Version ControlePOM - Fundamentals of Research Software Development - Code Version Control
ePOM - Fundamentals of Research Software Development - Code Version Control
 
ePOM - Fundamentals of Research Software Development - Integrated Development...
ePOM - Fundamentals of Research Software Development - Integrated Development...ePOM - Fundamentals of Research Software Development - Integrated Development...
ePOM - Fundamentals of Research Software Development - Integrated Development...
 
ePOM - Fundamentals of Research Software Development - Introduction
ePOM - Fundamentals of Research Software Development - IntroductionePOM - Fundamentals of Research Software Development - Introduction
ePOM - Fundamentals of Research Software Development - Introduction
 
ePOM - Intro to Ocean Data Science - Raster and Vector Data Formats
ePOM - Intro to Ocean Data Science - Raster and Vector Data FormatsePOM - Intro to Ocean Data Science - Raster and Vector Data Formats
ePOM - Intro to Ocean Data Science - Raster and Vector Data Formats
 
ePOM - Intro to Ocean Data Science - Scientific Computing
ePOM - Intro to Ocean Data Science - Scientific ComputingePOM - Intro to Ocean Data Science - Scientific Computing
ePOM - Intro to Ocean Data Science - Scientific Computing
 
ePOM - Intro to Ocean Data Science - Data Visualization
ePOM - Intro to Ocean Data Science - Data VisualizationePOM - Intro to Ocean Data Science - Data Visualization
ePOM - Intro to Ocean Data Science - Data Visualization
 
ePOM - Intro to Ocean Data Science - Object-Oriented Programming
ePOM - Intro to Ocean Data Science - Object-Oriented ProgrammingePOM - Intro to Ocean Data Science - Object-Oriented Programming
ePOM - Intro to Ocean Data Science - Object-Oriented Programming
 
AusSeabed workshop - Pydro and Hydroffice - Days 2 and 3
AusSeabed workshop - Pydro and Hydroffice - Days 2 and 3AusSeabed workshop - Pydro and Hydroffice - Days 2 and 3
AusSeabed workshop - Pydro and Hydroffice - Days 2 and 3
 
AusSeabed workshop - Pydro and Hydroffice - Day 1
AusSeabed workshop - Pydro and Hydroffice - Day 1AusSeabed workshop - Pydro and Hydroffice - Day 1
AusSeabed workshop - Pydro and Hydroffice - Day 1
 
Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...
Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...
Hydrographic Survey Validation and Chart Adequacy Assessment Using Automated ...
 
The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...
The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...
The Open Backscatter Toolchain (OpenBST) project: towards an open-source and ...
 
Pydro & HydrOffice: Open Tools for Ocean Mappers
Pydro & HydrOffice: Open Tools for Ocean MappersPydro & HydrOffice: Open Tools for Ocean Mappers
Pydro & HydrOffice: Open Tools for Ocean Mappers
 
INMARTECH 2018 - G.Masetti & P.Johnson - Sound Speed Management and Environme...
INMARTECH 2018 - G.Masetti & P.Johnson - Sound Speed Management and Environme...INMARTECH 2018 - G.Masetti & P.Johnson - Sound Speed Management and Environme...
INMARTECH 2018 - G.Masetti & P.Johnson - Sound Speed Management and Environme...
 
Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...
Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...
Shallow Survey 2018 - Applications of Sonar Detection Uncertainty for Survey ...
 
Bathymetric Attributed Grid (BAG) format
Bathymetric Attributed Grid (BAG) formatBathymetric Attributed Grid (BAG) format
Bathymetric Attributed Grid (BAG) format
 
Masetti et al. - Bathymetric and reflectivity-derived data fusion for Prelimi...
Masetti et al. - Bathymetric and reflectivity-derived data fusion for Prelimi...Masetti et al. - Bathymetric and reflectivity-derived data fusion for Prelimi...
Masetti et al. - Bathymetric and reflectivity-derived data fusion for Prelimi...
 
HydrOffice: past, present, and future.
HydrOffice: past, present, and future.HydrOffice: past, present, and future.
HydrOffice: past, present, and future.
 

Recently uploaded

Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...
Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...
Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 

Recently uploaded (20)

Technical english Technical english.pptx
Technical english Technical english.pptxTechnical english Technical english.pptx
Technical english Technical english.pptx
 
Fun for mover student's book- English book for teaching.pdf
Fun for mover student's book- English book for teaching.pdfFun for mover student's book- English book for teaching.pdf
Fun for mover student's book- English book for teaching.pdf
 
Precision Farming in Fruit Crops presentation
Precision Farming in Fruit Crops presentationPrecision Farming in Fruit Crops presentation
Precision Farming in Fruit Crops presentation
 
Taphonomy and Quality of the Fossil Record
Taphonomy and Quality of the  Fossil RecordTaphonomy and Quality of the  Fossil Record
Taphonomy and Quality of the Fossil Record
 
Introduction and significance of Symbiotic algae
Introduction and significance of  Symbiotic algaeIntroduction and significance of  Symbiotic algae
Introduction and significance of Symbiotic algae
 
FORENSIC CHEMISTRY ARSON INVESTIGATION.pdf
FORENSIC CHEMISTRY ARSON INVESTIGATION.pdfFORENSIC CHEMISTRY ARSON INVESTIGATION.pdf
FORENSIC CHEMISTRY ARSON INVESTIGATION.pdf
 
ANITINUTRITION FACTOR GYLCOSIDES SAPONINS CYANODENS
ANITINUTRITION FACTOR GYLCOSIDES SAPONINS CYANODENSANITINUTRITION FACTOR GYLCOSIDES SAPONINS CYANODENS
ANITINUTRITION FACTOR GYLCOSIDES SAPONINS CYANODENS
 
PARENTAL CARE IN FISHES.pptx for 5th sem
PARENTAL CARE IN FISHES.pptx for 5th semPARENTAL CARE IN FISHES.pptx for 5th sem
PARENTAL CARE IN FISHES.pptx for 5th sem
 
Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...
Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...
Chemistry Data Delivery from the US-EPA Center for Computational Toxicology a...
 
Manganese‐RichSandstonesasanIndicatorofAncientOxic LakeWaterConditionsinGale...
Manganese‐RichSandstonesasanIndicatorofAncientOxic  LakeWaterConditionsinGale...Manganese‐RichSandstonesasanIndicatorofAncientOxic  LakeWaterConditionsinGale...
Manganese‐RichSandstonesasanIndicatorofAncientOxic LakeWaterConditionsinGale...
 
SaffronCrocusGenomicsThessalonikiOnlineMay2024TalkOnline.pptx
SaffronCrocusGenomicsThessalonikiOnlineMay2024TalkOnline.pptxSaffronCrocusGenomicsThessalonikiOnlineMay2024TalkOnline.pptx
SaffronCrocusGenomicsThessalonikiOnlineMay2024TalkOnline.pptx
 
Heads-Up Multitasker: CHI 2024 Presentation.pdf
Heads-Up Multitasker: CHI 2024 Presentation.pdfHeads-Up Multitasker: CHI 2024 Presentation.pdf
Heads-Up Multitasker: CHI 2024 Presentation.pdf
 
Harry Coumnas Thinks That Human Teleportation is Possible in Quantum Mechanic...
Harry Coumnas Thinks That Human Teleportation is Possible in Quantum Mechanic...Harry Coumnas Thinks That Human Teleportation is Possible in Quantum Mechanic...
Harry Coumnas Thinks That Human Teleportation is Possible in Quantum Mechanic...
 
PHOTOSYNTHETIC BACTERIA (OXYGENIC AND ANOXYGENIC)
PHOTOSYNTHETIC BACTERIA  (OXYGENIC AND ANOXYGENIC)PHOTOSYNTHETIC BACTERIA  (OXYGENIC AND ANOXYGENIC)
PHOTOSYNTHETIC BACTERIA (OXYGENIC AND ANOXYGENIC)
 
An Overview of Active and Passive Targeting Strategies to Improve the Nano-Ca...
An Overview of Active and Passive Targeting Strategies to Improve the Nano-Ca...An Overview of Active and Passive Targeting Strategies to Improve the Nano-Ca...
An Overview of Active and Passive Targeting Strategies to Improve the Nano-Ca...
 
GBSN - Microbiology (Unit 4) Concept of Asepsis
GBSN - Microbiology (Unit 4) Concept of AsepsisGBSN - Microbiology (Unit 4) Concept of Asepsis
GBSN - Microbiology (Unit 4) Concept of Asepsis
 
Vital Signs of Animals Presentation By Aftab Ahmed Rahimoon
Vital Signs of Animals Presentation By Aftab Ahmed RahimoonVital Signs of Animals Presentation By Aftab Ahmed Rahimoon
Vital Signs of Animals Presentation By Aftab Ahmed Rahimoon
 
TEST BANK for Organic Chemistry 6th Edition.pdf
TEST BANK for Organic Chemistry 6th Edition.pdfTEST BANK for Organic Chemistry 6th Edition.pdf
TEST BANK for Organic Chemistry 6th Edition.pdf
 
THE FUNDAMENTAL UNIT OF LIFE CLASS IX.ppt
THE FUNDAMENTAL UNIT OF LIFE CLASS IX.pptTHE FUNDAMENTAL UNIT OF LIFE CLASS IX.ppt
THE FUNDAMENTAL UNIT OF LIFE CLASS IX.ppt
 
Classification of Kerogen, Perspective on palynofacies in depositional envi...
Classification of Kerogen,  Perspective on palynofacies in depositional  envi...Classification of Kerogen,  Perspective on palynofacies in depositional  envi...
Classification of Kerogen, Perspective on palynofacies in depositional envi...
 

Open Backscatter Toolchain (OpenBST) Project - A Community-vetted Workflow for Backscatter Processing

  • 1. OPEN BACKSCATTER TOOLCHAIN (OPENBST) PROJECT A COMMUNITY-VETTED WORKFLOW FOR BACKSCATTER PROCESSING M. Smith, G. Masetti, L. Mayer, M. Malik, J.-M. Augustin, C. Poncelet, I. Parnum
  • 2. Seafloor Backscatter Images from Marine Geophysical Research Volume 39 Issue 1-2 (2018) Image Credit: T.C. Weber 2
  • 3. Data Ch allen ges Seafloor Backscatter Images from Marine Geophysical Research Volume 39 Issue 1-2 (2018) Hard to obtain quantitative and comparable data sets.. • Calibration of multibeam echosounder radiation pattern • Results varies system to system • Data is sensitive to changes in parameters • No standard for processing and reporting the data 3
  • 4. The Backscatter Inter-comparison Project https://bswg.github.io/bsip/ A GEOHAB project with the aim of checking the consistency of backscatter processing results provided by various software suites 4
  • 6. Ope nBST – Transpare nt Algori t hms and Communi ty Discussi on How do we address the problem? 6
  • 7. But Really, How? Python, python, HydrOffice and more python • Back End: Python Library and NetCDF based project structure • Front End: Jupyter Notebook and public api 7
  • 8. Backend – Python Library and NetCDF NetCDF with Nodal Processing Structure • Unique hash identifies each processing step and ‘remembers’ prior step • Allows for reuse of prior workflows 8
  • 9. Front End – Jupyter Notebooks Beam-width limited area correction Pulse length limited area correction Combined area correction 9
  • 10. Front End – Application Programming Interface (API) Processing methods are independent methods: • Inputs are clearly and explicitly named. Should be self descriptive • Algorithm is written clearly, simple to follow • Outputs packaged in a self-descriptive dictionary The coded algorithm should be simple to implement and merge with other computing environments 10
  • 11. 11 Where we are and where we are going • Version 0: • To be realized on Github within the next 2 months • Primarily the software architecture with limited functionality • Works with Reson .s7k • Version 1: • Add more sonar data formats • Add to the algorithm base • Begin establishing trusted workflows for commonly used systems • Add comparison tools to directly compare workflow results in a single notebook
  • 12. 12 What does OpenBST mean for you? • Collaboratively discuss and develop processing algorithms • Software algorithms implemented in commercial tools can be bench tested • Identify why differences in key processing stages vary between software suites • Increase the confidence and understanding of backscatter processing results

Editor's Notes

  1. Thank you and I am excited to start off the session - Backscatter: The dark side of data. Seafloor backscatter data certainly has a dark-side, and how best to handle the collection and processing of backscatter data has become a topic of great interest in the hydrographic community. With that said, I am hoping that what I present today can serve as a small light in the dark, and offer a way to address some of the issue we face with this data. So, with that said, I would like to present our current work on the Open Backscatter Toolchain, a community-vetted workflow for backscatter processing.
  2. When I talk about backscatter, I am referring to the measured acoustic intensity related to the scattering of the sound wave, by the seafloor, back in the direction of the MBES. Backscatter has been shown to be a powerful tool in the characterization of the seafloor. Standard backscatter products such a: backscatter mosaics and Angular response curves allow for the identification and segmentation of an environment into distinct acoustic fancies, as well as give first order estimates of the sediment classes present. However, the dark side of backscatter is the data challenges we face in obtaining quantitative measurements. Further, a lack of standards in both data collection and processing hampers the inter-comparison of surveys
  3. However, the dark side of backscatter is the data challenges we face in obtaining quantitative and comparable measurements. As the image on the right shows, backscatter surveys can be notoriously difficult to compare. A quantitative dataset requires calibration of the MBES which is difficult at best Collected data varies from system to system, Changes in parameters have direct and observable effects, Even using the same system, the end product can vary based on how the data was reported and how it was processed
  4. Much of the effort spent on addressing the aforementioned issues has centered on the hardware. How we calibrate MBES for their complex radiation patterns How do we ensure clear and accurate reporting of backscatter measurements However, how backscatter is processed and handled by various software suites had received little attention. However, there was a recent project to address this. The BSIP was an international effort formed to check for consistency across backscatter products produced by various software suites.
  5. The results of the project can best be explained in the figure shown here. Common datasets were provided to various software manufacturers The vendors were tasked with processing the data and outputting results at various stages of the processing chain Show here is the results for: BL0 or the first step where the data is raw decoded BL3 after the data has been processed but before it have been made into an ara or mosaic We can see that the result of BS0, raw decoding and the first stage of processing, there are median values ranging by over 5dB. We can also see that by BL3 some results have moved in opposite directions at the end of the chain. This presents a real issue when trying to use the data quantitatively. Further, why these discrepancies occur is unclear and which has the most accurate result is impossible to know as we do not know what is done at each step.
  6. Our suggestion to help address and mitigate some of the highlighted discrepancies is OpenBT At it’s core, OpenBST is a set of open source algorithms centered around the processing of backscatter data The project is designed to be collaborative in nature and encourage vendors, researchers and end users to discuss the relative merits of different algorithms, as well as focus on the best processing methodologies/algorithms based on the current state-of-art The project does not aim to be a commercial competitor and aims to provide a frame work for testing and implementing new algorithms
  7. The project is being built as a python library within the HydrOffice framework and makes use of netcdf files for data storage, manipulation and metadata coupling On the front end, the project is using jupyter notebooks and a public api will be available so the algorithms can be independently tested and used.
  8. Expanding further on the backend: We are very excited to use NetCDFs as a data management and organization structure. The benefits: The CF convention is easily understood by computing environments and software Setup with georeferencing metadata -> easy drag and drop in GIS Data is stored on disk and not in memory: read only what you need, modify, store, done Extensive metadata coupling Additionally, we recognize that the backscatter processing workflow aligns nicely with trees from graph theory. We keep track of parent and child processes to minimize the amount of recalculation and allows the user to efficiently explore various algorithms and processing workflows.. What this ultimately means, is that OpenBST projects are easy to share and can be explored by the user in their preferred software/language
  9. In lieu of a GUI, we decided to leverage the Jupyter notebooks: Jupyter Notebooks are interactive computing environments Code can be directly written and executed within the notebook on the fly Makes adjusting parameters and running tests a simple matter Extensive annotation ability allows for notating as various methods are tested In line plotting makes it easy to visualize results and compare We envision providing a notebook for each system for which we have well constrained test data. Additionally, we want to provide an in-depth tutorial notebook and a simple template notebook for creating your own
  10. We have designed the project so algorithms have an explicit design Inputs are clearly named and follow convention Algorithms are easily interpretable Outputs are clearly labeled and packaged. Adding algorithms or using the algorithms in your own software should be simple.
  11. So currently we have been working on V0. V0 has primarily been focused on laying the groundwork of the project. We hope that in two months this version will be released. Our sights are then set on V1. This is where we hope to add more sonar formats and more processing algorithms into the mix. This is where I hope the conversation and collaboration can really grow.
  12. Speaking to collaboration, What ultimately is OpenBST trying to do for you? For the end-user, OpenBST is hoped to be: an environment well suited to testing and developing new algorithms A place to benchmark software algorithms A tool to identify where and why discrepancies arise And ultimately, a way to increase our confidence in backscatter processing results.
  13. So the code is available on GitHub at this link. Thank you for your time