SlideShare a Scribd company logo
1 of 1
Download to read offline
PDS Imaging Node’s Hosted Machine Learning Platform
https://pds-imaging.jpl.nasa.gov/updates
Kevin Grimes, Paul Ramirez, Rishi Verma, Kiri Wagstaff, Steven Lu
Jet Propulsion Laboratory, California Institute of Technology
Contact Email: kevin.m.grimes@jpl.nasa.gov
◦ Data products in excess of 1380 TB
◦ Dozens of celestial bodies captured
◦ Over 20 million photos from the surface of Mars
◦ Nearly 5 million photos taken of Mars’s surface from orbit
◦ Photos of Jupiter, Pluto, and beyond
◦ Rich image metadata
◦ Identifiable targets within image (“moon”, “star”, “rock”)
◦ Human-written captions (“Curiosity entering crater”)
◦ Spacecraft and instrument specifications (“InSight Lander”,
“MAHLI”)
◦ Image timestamp and SCLK
PDS Imaging Node’s
Planetary Imagery Archive
https://pds-imaging.jpl.nasa.gov/data
Running machine learning software in Python on
Imaging Node data is as simple as the following steps:
1. Request a workspace be created for your team
2. Create a new Jupyter Notebook from your existing
Python software (or start from scratch)
3. Point your notebook to the locally-mounted
Imaging Node data
4. Run your application
Run your algorithms on our data
The approach: an integrated machine learning platform
Entire platform hosted by
PDS Imaging Node in its
cloud
Imaging Node archive
mounted to your
environment
Collaborative environment
shared across your team
Share your results, opt for
integration(s)
The goal: to enable machine learning researchers with their existing
budgets to train and run their algorithms against Imaging Node’s vast
archives in an environment that encourages collaboration and
integration.
Share & integrate your results
The PDS Image Atlas, located at
https://pds-imaging.jpl.nasa.gov/search, makes over 30 million
images within the PDS Imaging Node archive searchable by their
metadata, including that which is generated by machine learning.
ML research teams
Environments within PDS Machine Learning Platform
Each machine learning team (blue, orange, gray) is given an
environment within the PDS Machine Learning Platform, including
space to run applications and a database to store their results.
2019 California Institute of Technology. Government sponsorship acknowledged.
The typical workflow of a machine learning researcher using
the PDS Machine Learning Platform, beginning with updates
to their Jupyter Notebook and ending with various forms of
publication.
Researcher updates
notebook
Researcher runs
notebook
Researcher verifies
results
Researcher makes
results public
Researcher
visualizes results
Researcher
expresses
dissatisfaction with
results
Researcher embeds
permalink in
publication
Researcher
downloads results
locally
Researcher posts
visualization to
LinkedIn
Researcher opts
results for Image
Atlas integration
• Could your machine learning project use a platform like this?
• Do you have a use case not covered in this poster?
• Want to know when the platform is available?
Sign up for updates, or contact the team directly!
Researchers leverage the PDS Imaging Node’s 1380 TB image archive
to train their machine learning algorithms and make
incredible discoveries.
The Imaging Node has worked with several machine learning researchers to integrate their
work into the Image Atlas: over 5 million images have been classified by their tools, and
their results have been integrated into the Image Atlas.
There are, however, several challenges that researchers external to the Imaging Node may
face should they decide to work with Imaging Node’s data:
◦ Hardware limitations: disk space, network speeds, lack of GPUs
◦ Disconnected software tooling: ML technologies can be difficult to connect to each other
◦ Sharing issues: fascinating results may sit unused, even if published
◦ Integration issues: even if published, discoveries may never be integrated into other tools

More Related Content

What's hot

AI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development LabAI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development LabGanesan Narayanasamy
 
PHIDIAS HPC – Building a prototype for Earth Science Data and HPC Services
PHIDIAS HPC – Building a prototype for Earth Science Data and HPC ServicesPHIDIAS HPC – Building a prototype for Earth Science Data and HPC Services
PHIDIAS HPC – Building a prototype for Earth Science Data and HPC ServicesPhidias
 
TIGER/line Data and Open Data in the Cloud
TIGER/line Data and Open Data in the CloudTIGER/line Data and Open Data in the Cloud
TIGER/line Data and Open Data in the Cloudtmcw
 
TIGER/Line Data in the Cloud - Tom MacWright
TIGER/Line Data in the Cloud - Tom MacWrightTIGER/Line Data in the Cloud - Tom MacWright
TIGER/Line Data in the Cloud - Tom MacWrightCrisisCommons
 
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...Rudolf Husar
 
Remote sensing with drones: The challenges of obtaining truly quantitative da...
Remote sensing with drones: The challenges of obtaining truly quantitative da...Remote sensing with drones: The challenges of obtaining truly quantitative da...
Remote sensing with drones: The challenges of obtaining truly quantitative da...ARDC
 
Creating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIOCreating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIOLarry Smarr
 
Godiva2 Overview
Godiva2 OverviewGodiva2 Overview
Godiva2 Overviewjonblower
 
Rear-World Robot Learning
Rear-World Robot LearningRear-World Robot Learning
Rear-World Robot LearningModulabs
 

What's hot (10)

AI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development LabAI Research and OpenPOWER at the NASA Frontier Development Lab
AI Research and OpenPOWER at the NASA Frontier Development Lab
 
PHIDIAS HPC – Building a prototype for Earth Science Data and HPC Services
PHIDIAS HPC – Building a prototype for Earth Science Data and HPC ServicesPHIDIAS HPC – Building a prototype for Earth Science Data and HPC Services
PHIDIAS HPC – Building a prototype for Earth Science Data and HPC Services
 
TIGER/line Data and Open Data in the Cloud
TIGER/line Data and Open Data in the CloudTIGER/line Data and Open Data in the Cloud
TIGER/line Data and Open Data in the Cloud
 
TIGER/Line Data in the Cloud - Tom MacWright
TIGER/Line Data in the Cloud - Tom MacWrightTIGER/Line Data in the Cloud - Tom MacWright
TIGER/Line Data in the Cloud - Tom MacWright
 
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
 
finalDraftPoster
finalDraftPosterfinalDraftPoster
finalDraftPoster
 
Remote sensing with drones: The challenges of obtaining truly quantitative da...
Remote sensing with drones: The challenges of obtaining truly quantitative da...Remote sensing with drones: The challenges of obtaining truly quantitative da...
Remote sensing with drones: The challenges of obtaining truly quantitative da...
 
Creating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIOCreating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIO
 
Godiva2 Overview
Godiva2 OverviewGodiva2 Overview
Godiva2 Overview
 
Rear-World Robot Learning
Rear-World Robot LearningRear-World Robot Learning
Rear-World Robot Learning
 

Similar to PDS Imaging Node's Hosted Machine Learning Platform

Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)Spark Summit
 
Digistar Cloud article
Digistar Cloud articleDigistar Cloud article
Digistar Cloud articleJoseph Kleiman
 
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsDatabricks
 
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...Raffaele Montella
 
10 06-03 uva boone-technical report
10 06-03 uva boone-technical report10 06-03 uva boone-technical report
10 06-03 uva boone-technical reportSean Casey, USRA
 
What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care? What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care? Robert Grossman
 
Sample CS Senior Capstone Projects
Sample CS Senior Capstone ProjectsSample CS Senior Capstone Projects
Sample CS Senior Capstone ProjectsFred Annexstein
 
So Long Computer Overlords
So Long Computer OverlordsSo Long Computer Overlords
So Long Computer OverlordsIan Foster
 
Vre ci presentation -ric workshop - july 26th
Vre ci presentation -ric workshop - july 26thVre ci presentation -ric workshop - july 26th
Vre ci presentation -ric workshop - july 26thdjmichael156
 
Object extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learningObject extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learningAly Abdelkareem
 
Integration for Planet Satellite Imagery
Integration for Planet Satellite ImageryIntegration for Planet Satellite Imagery
Integration for Planet Satellite ImagerySafe Software
 
IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...
IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...
IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...IRJET Journal
 
IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...J S
 
NASA WorldWind Open Source Summit
NASA WorldWind Open Source SummitNASA WorldWind Open Source Summit
NASA WorldWind Open Source SummitPatrick Hogan
 

Similar to PDS Imaging Node's Hosted Machine Learning Platform (20)

Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
Spark at NASA/JPL-(Chris Mattmann, NASA/JPL)
 
Digistar Cloud article
Digistar Cloud articleDigistar Cloud article
Digistar Cloud article
 
AI from Space using Azure
AI from Space using AzureAI from Space using Azure
AI from Space using Azure
 
2011 NASA Open Source Summit - Patrick Hogan
2011 NASA Open Source Summit - Patrick Hogan2011 NASA Open Source Summit - Patrick Hogan
2011 NASA Open Source Summit - Patrick Hogan
 
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science Workflows
 
TechReport
TechReportTechReport
TechReport
 
Cloud-Based Spatial Data Analytics with R/Shiny
Cloud-Based Spatial Data Analytics with R/ShinyCloud-Based Spatial Data Analytics with R/Shiny
Cloud-Based Spatial Data Analytics with R/Shiny
 
RESUME_RAVI
RESUME_RAVIRESUME_RAVI
RESUME_RAVI
 
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
How to expand the Galaxy from genes to Earth in six simple steps (and live sm...
 
10 06-03 uva boone-technical report
10 06-03 uva boone-technical report10 06-03 uva boone-technical report
10 06-03 uva boone-technical report
 
What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care? What is a Data Commons and Why Should You Care?
What is a Data Commons and Why Should You Care?
 
nature
naturenature
nature
 
Sample CS Senior Capstone Projects
Sample CS Senior Capstone ProjectsSample CS Senior Capstone Projects
Sample CS Senior Capstone Projects
 
So Long Computer Overlords
So Long Computer OverlordsSo Long Computer Overlords
So Long Computer Overlords
 
Vre ci presentation -ric workshop - july 26th
Vre ci presentation -ric workshop - july 26thVre ci presentation -ric workshop - july 26th
Vre ci presentation -ric workshop - july 26th
 
Object extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learningObject extraction from satellite imagery using deep learning
Object extraction from satellite imagery using deep learning
 
Integration for Planet Satellite Imagery
Integration for Planet Satellite ImageryIntegration for Planet Satellite Imagery
Integration for Planet Satellite Imagery
 
IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...
IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...
IRJET- Educatar: Dissemination of Conceptualized Information using Augmented ...
 
IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...IUI 2010: An Informal Summary of the International Conference on Intelligent ...
IUI 2010: An Informal Summary of the International Conference on Intelligent ...
 
NASA WorldWind Open Source Summit
NASA WorldWind Open Source SummitNASA WorldWind Open Source Summit
NASA WorldWind Open Source Summit
 

Recently uploaded

Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfjoe51371421
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfPower Karaoke
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about usDynamic Netsoft
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataBradBedford3
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number SystemsJheuzeDellosa
 
cybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningcybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningVitsRangannavar
 

Recently uploaded (20)

Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdf
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdf
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about us
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Naraina Delhi 💯Call Us 🔝8264348440🔝
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataAdobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer Data
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number Systems
 
cybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningcybersecurity notes for mca students for learning
cybersecurity notes for mca students for learning
 

PDS Imaging Node's Hosted Machine Learning Platform

  • 1. PDS Imaging Node’s Hosted Machine Learning Platform https://pds-imaging.jpl.nasa.gov/updates Kevin Grimes, Paul Ramirez, Rishi Verma, Kiri Wagstaff, Steven Lu Jet Propulsion Laboratory, California Institute of Technology Contact Email: kevin.m.grimes@jpl.nasa.gov ◦ Data products in excess of 1380 TB ◦ Dozens of celestial bodies captured ◦ Over 20 million photos from the surface of Mars ◦ Nearly 5 million photos taken of Mars’s surface from orbit ◦ Photos of Jupiter, Pluto, and beyond ◦ Rich image metadata ◦ Identifiable targets within image (“moon”, “star”, “rock”) ◦ Human-written captions (“Curiosity entering crater”) ◦ Spacecraft and instrument specifications (“InSight Lander”, “MAHLI”) ◦ Image timestamp and SCLK PDS Imaging Node’s Planetary Imagery Archive https://pds-imaging.jpl.nasa.gov/data Running machine learning software in Python on Imaging Node data is as simple as the following steps: 1. Request a workspace be created for your team 2. Create a new Jupyter Notebook from your existing Python software (or start from scratch) 3. Point your notebook to the locally-mounted Imaging Node data 4. Run your application Run your algorithms on our data The approach: an integrated machine learning platform Entire platform hosted by PDS Imaging Node in its cloud Imaging Node archive mounted to your environment Collaborative environment shared across your team Share your results, opt for integration(s) The goal: to enable machine learning researchers with their existing budgets to train and run their algorithms against Imaging Node’s vast archives in an environment that encourages collaboration and integration. Share & integrate your results The PDS Image Atlas, located at https://pds-imaging.jpl.nasa.gov/search, makes over 30 million images within the PDS Imaging Node archive searchable by their metadata, including that which is generated by machine learning. ML research teams Environments within PDS Machine Learning Platform Each machine learning team (blue, orange, gray) is given an environment within the PDS Machine Learning Platform, including space to run applications and a database to store their results. 2019 California Institute of Technology. Government sponsorship acknowledged. The typical workflow of a machine learning researcher using the PDS Machine Learning Platform, beginning with updates to their Jupyter Notebook and ending with various forms of publication. Researcher updates notebook Researcher runs notebook Researcher verifies results Researcher makes results public Researcher visualizes results Researcher expresses dissatisfaction with results Researcher embeds permalink in publication Researcher downloads results locally Researcher posts visualization to LinkedIn Researcher opts results for Image Atlas integration • Could your machine learning project use a platform like this? • Do you have a use case not covered in this poster? • Want to know when the platform is available? Sign up for updates, or contact the team directly! Researchers leverage the PDS Imaging Node’s 1380 TB image archive to train their machine learning algorithms and make incredible discoveries. The Imaging Node has worked with several machine learning researchers to integrate their work into the Image Atlas: over 5 million images have been classified by their tools, and their results have been integrated into the Image Atlas. There are, however, several challenges that researchers external to the Imaging Node may face should they decide to work with Imaging Node’s data: ◦ Hardware limitations: disk space, network speeds, lack of GPUs ◦ Disconnected software tooling: ML technologies can be difficult to connect to each other ◦ Sharing issues: fascinating results may sit unused, even if published ◦ Integration issues: even if published, discoveries may never be integrated into other tools