SlideShare a Scribd company logo
1 of 34
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
NaNa Yi
Engineer, Development Seed
Marc M Fagan
CEO, EOS Data Analytics
Machine Learning with Earth
Observation Imagery
Satellite Machine
Learning in the Cloud
Machine Learning with Earth Observation Imagery
Irrawaddy Delta, Burma(Myanmar)
Sentinel-2A, 07/2017
- ‘Fully automated’ machine
learning pipeline;
- Semi-automated machine
learning that will require our
professional mappers’ QA and
map objects.
Urchn
Tracking cities from space
‘Fully automated’ machine
learning pipelines backup
Urchn.
- Segmentation: for
detecting building
footprint and road
network.
- Object detection for
individual building
count.
http://cs224d.stanford.edu/index.html
Segmentation for detecting building
footprint and road network
Object detection for
building counts
Urchn
Tracking cities from space
Mapping high-voltage
grids in Pakistan,
Nigeria and Zambia
Semi-automated machine
learning that requires our
professional mappers’ QA
and mapping objects.
- Image classification
based supervised
machine learning
approaches.
Machine learning outputs Professional mapper tracing
The final output of high-voltage grids
- ‘Fully automated’ machine
learning pipeline;
- Semi-automated machine
learning that will require our
professional mappers’ QA and
mapping objects.
- ‘Fully automated’ machine
learning pipeline;
- Semi-automated machine
learning that will require our
professional mappers’ QA and
mapping objects.
How we did it
1. Label Maker
2. Spot Instance of AWS deep
learning AMI (don’t forgot to
turn on CloudWatch)
We open source our machine learning tools and
pipelines:
1. Satellite machine learning training data generation: Label Maker, Skynet-data;
2. Open source machine learning pipelines:
● Image classification:
High-voltage grids
AWS SageMaker case study
ResNet with AWS
● Image segmentation: Skynet
● Object detection: Tensorflow object detection
And we will open source have more tools and pipelines, stay tune!
Want to know more?
Email nana@developmentseed.org
Twitter @developmentseed
Website http://developmentseed.org
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
153 Employees
Data Scientists, AI Engineers
Data (EO Sensor) Agnostic
Serving All non-profit and profit
Use Case Presentations - Bloomberg,
LP.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“100% Convolutional Neural Network”
Disclaimer – lots of human “training or Indexing”
“100% Amazon”
Disclaimer – sometimes “fool around” with on-premise Gaming GPUs
All production - Storage, CPU, GPU, Products up on
AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenge:
Agricultural crop production monitoring at high accuracy and cadence
is hard.
Present methods:
 Methods - Statistical extrapolation based on self-reporting
 Timelines - Months after harvest
 Cloud cover - Issue with regard to satellite analyses
 Costs – Satellite imagery (of sufficient resolution and cadence) –
expensive
InSAR Weekly Ag Crop Production - United
States
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution:
InSAR (Synthetic Aperture Radar) utilizing AWS Sentinel-1 (ESA) SAR
 Product – Measurement of every crop zone, crop type, by climate,
by season
 Timelines – Every 7 days (nationwide)
 Cloud cover – SAR negates cloud issues
 Costs – ESA Sentinel 1a & !b – open source
Novel, new and very valuable solution to the marketplace
InSAR Weekly Ag Crop Production - United
States
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Bloomberg – first –of-its-kind financial industries data for
commodities, futures, derivatives, swaps trading
InSAR Weekly Ag Crop Production - United
States
• Producers– seed ,
manufactures,
logistics, storage,
food processors, etc.
• Governments and
non-profit
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenge:
Monitoring of millions of wildcat oil and gas upstream production
activities by lifecycle states as the earliest signals of actual oil
productive rates.
Present methods:
 Methods – human data gathering from public permit recorders
and statistical, periodic field statistical inspections
 Costs – expensive, low margin and value, by virtue of low
accuracy
Upstream Oil & Gas Production Monitoring
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution:
Convolutional Neural Net analyses of wellhead equipment,
configuration of wellheads indicating the lifecycle patterns indicating
type of production 2 months prior to inspection
 Product – instantaneous schedule of all wellheads within analyses
schedule
 Timelines – 1 per month ( possible sooner}
 Cloud cover – an open issue
 Costs – Fraction of costs due to revenue share and scale with
Partner (Airbus)
Upstream Oil & Gas Production Monitoring
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Bloomberg – first –of-its-kind financial industries data for
commodities, futures, derivatives, swaps trading
Upstream Oil & Gas Production Monitoring
Product
• Producers – field
operations,
downstream
operators, equipment
suppliers
• Governments and
non-profit entities
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Platform
EOS performs 100% of the use case operations on AWS including:
 Processing and storage of the entire United States (and UA and
UK)
 Earth on AWS Airbus Pléiades and SPOT access storage
and processing
 GPU and CPU processing of the Neural Net analyses
 Production environment of the final product
 Additional ancillary CCN object detecting e.g., preferable
road and tailing pond construction, etc.
Upstream Oil & Gas Production Monitoring
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenge
Technical methods to mask false night sky images anemology's e.g.
ice, cloud cover, water glare reflectance, etc. in sensor data at large
scale and cadence to create accurate night lights signals especial
with change
Present methods:
 Methods - small partial world area analyses
 Cloud cover – omitting regular (monthly) comprehensive regular
results coinciding with IMF published corollary results
 Inability therefore to back test results and modify CCH algorithms
 Costs – Utilization of open source NOAA NPP data
World Night Lights – Economic Analyses
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution:
Full monthly access to NOAA NPP data
 Product – Worldwide modeling of all countries highlighting relative
light intensities with change detection indices correlated to the
IMF rating Timelines – Monthly
 Cloud cover – None (masked)
 Costs – NOAA NPP imagery open source
World Night Lights – Economic Analyses
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Bloomberg – first-of-its-kind financial industries data for Macro-
trend correlation to bi-annual GDP reporting way before IMF
release as well as methods to discount inaccurate reporting by
certain environmental entities
World Night Lights – Economic Analyses
 Multiple additional
uses e.g. energy
markets, population
trends, etc.
 Governments and
non-profit uses
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Platform
EOS performs 100% of the use case operations on AWS including:
 Processing and storage of the entire world for NOAA NPP
 Largest data set to-date
 Completed making methodologies work within AWS with
EOS proprietary methods
 GPU and CPU processing of the Neural Net analyses
 Production environment of the final product
World Night Lights – Economic Analyses
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Speaker Contact
CEO
EOS Data Analytics
Menlo Park, CA
978 500 0344
Marc.Fagan@eosda.com
EOS.com
Marc Fagan
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!

More Related Content

What's hot

What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...
What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...
What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...
Simplilearn
 

What's hot (20)

And then there were ... Large Language Models
And then there were ... Large Language ModelsAnd then there were ... Large Language Models
And then there were ... Large Language Models
 
Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language...
Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language...Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language...
Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language...
 
Exploring Opportunities in the Generative AI Value Chain.pdf
Exploring Opportunities in the Generative AI Value Chain.pdfExploring Opportunities in the Generative AI Value Chain.pdf
Exploring Opportunities in the Generative AI Value Chain.pdf
 
What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...
What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...
What Is Artificial Intelligence? | Artificial Intelligence For Beginners | Wh...
 
What Is GPT-3 And Why Is It Revolutionizing Artificial Intelligence?
What Is GPT-3 And Why Is It Revolutionizing Artificial Intelligence?What Is GPT-3 And Why Is It Revolutionizing Artificial Intelligence?
What Is GPT-3 And Why Is It Revolutionizing Artificial Intelligence?
 
Generative AI: Past, Present, and Future – A Practitioner's Perspective
Generative AI: Past, Present, and Future – A Practitioner's PerspectiveGenerative AI: Past, Present, and Future – A Practitioner's Perspective
Generative AI: Past, Present, and Future – A Practitioner's Perspective
 
machine learning
machine learningmachine learning
machine learning
 
Intro to LLMs
Intro to LLMsIntro to LLMs
Intro to LLMs
 
An Introduction to Generative AI
An Introduction  to Generative AIAn Introduction  to Generative AI
An Introduction to Generative AI
 
Intro to Machine Learning & AI
Intro to Machine Learning & AIIntro to Machine Learning & AI
Intro to Machine Learning & AI
 
Blueprint ChatGPT Lunch & Learn
Blueprint ChatGPT Lunch & LearnBlueprint ChatGPT Lunch & Learn
Blueprint ChatGPT Lunch & Learn
 
Introduction to Transformer Model
Introduction to Transformer ModelIntroduction to Transformer Model
Introduction to Transformer Model
 
Deep Learning - Convolutional Neural Networks
Deep Learning - Convolutional Neural NetworksDeep Learning - Convolutional Neural Networks
Deep Learning - Convolutional Neural Networks
 
Chatbot
ChatbotChatbot
Chatbot
 
NVIDIA @ AI FEST
NVIDIA @ AI FESTNVIDIA @ AI FEST
NVIDIA @ AI FEST
 
Generative AI
Generative AIGenerative AI
Generative AI
 
Leveraging Generative AI & Best practices
Leveraging Generative AI & Best practicesLeveraging Generative AI & Best practices
Leveraging Generative AI & Best practices
 
Explainable AI (XAI) - A Perspective
Explainable AI (XAI) - A Perspective Explainable AI (XAI) - A Perspective
Explainable AI (XAI) - A Perspective
 
Using the power of Generative AI at scale
Using the power of Generative AI at scaleUsing the power of Generative AI at scale
Using the power of Generative AI at scale
 
10 Lessons Learned from Building Machine Learning Systems
10 Lessons Learned from Building Machine Learning Systems10 Lessons Learned from Building Machine Learning Systems
10 Lessons Learned from Building Machine Learning Systems
 

Similar to Machine Learning with Earth Observation Imagery

FME Stories From Around the World
FME Stories From Around the WorldFME Stories From Around the World
FME Stories From Around the World
Safe Software
 
Insights and Graph-based ML Anomaly Detection for eBay Edge Services
 Insights and Graph-based ML Anomaly Detection for eBay Edge Services Insights and Graph-based ML Anomaly Detection for eBay Edge Services
Insights and Graph-based ML Anomaly Detection for eBay Edge Services
Hanzhang Wang
 
Solar irradiance data sources & software
Solar irradiance data sources & softwareSolar irradiance data sources & software
Solar irradiance data sources & software
akhtar ali
 

Similar to Machine Learning with Earth Observation Imagery (20)

FME Around the World (FME Trek, Part 2): Ciaran Kirk - Safe Software FME Worl...
FME Around the World (FME Trek, Part 2): Ciaran Kirk - Safe Software FME Worl...FME Around the World (FME Trek, Part 2): Ciaran Kirk - Safe Software FME Worl...
FME Around the World (FME Trek, Part 2): Ciaran Kirk - Safe Software FME Worl...
 
Cloud Powered IoT: Connected Solutions Helping Communities
Cloud Powered IoT: Connected Solutions Helping CommunitiesCloud Powered IoT: Connected Solutions Helping Communities
Cloud Powered IoT: Connected Solutions Helping Communities
 
IRJET- R-Pi based Real-Time Weather Monitoring System
IRJET-  	  R-Pi based Real-Time Weather Monitoring SystemIRJET-  	  R-Pi based Real-Time Weather Monitoring System
IRJET- R-Pi based Real-Time Weather Monitoring System
 
Mineograph Mining Automation Software
Mineograph Mining Automation SoftwareMineograph Mining Automation Software
Mineograph Mining Automation Software
 
FME Stories From Around the World
FME Stories From Around the WorldFME Stories From Around the World
FME Stories From Around the World
 
AWS for Manufacturing: Digital Transformation throughout the Value Chain (MFG...
AWS for Manufacturing: Digital Transformation throughout the Value Chain (MFG...AWS for Manufacturing: Digital Transformation throughout the Value Chain (MFG...
AWS for Manufacturing: Digital Transformation throughout the Value Chain (MFG...
 
Gaining Better Observability of Your VMs with Amazon CloudWatch - AWS Online ...
Gaining Better Observability of Your VMs with Amazon CloudWatch - AWS Online ...Gaining Better Observability of Your VMs with Amazon CloudWatch - AWS Online ...
Gaining Better Observability of Your VMs with Amazon CloudWatch - AWS Online ...
 
Capacity Management for system z license charge reporting
Capacity Management for system z  license charge reportingCapacity Management for system z  license charge reporting
Capacity Management for system z license charge reporting
 
How can you prevent critical Machine failures, employing Machine Learning and...
How can you prevent critical Machine failures, employing Machine Learning and...How can you prevent critical Machine failures, employing Machine Learning and...
How can you prevent critical Machine failures, employing Machine Learning and...
 
System Architecture of Cloud-based Web GIS for Real-Time Macroeconomic Loss E...
System Architecture of Cloud-based Web GIS for Real-Time Macroeconomic Loss E...System Architecture of Cloud-based Web GIS for Real-Time Macroeconomic Loss E...
System Architecture of Cloud-based Web GIS for Real-Time Macroeconomic Loss E...
 
EDA-based IoT in Oil & Gas
EDA-based IoT in Oil & GasEDA-based IoT in Oil & Gas
EDA-based IoT in Oil & Gas
 
Anna Vergeles, Nataliia Manakova "Unsupervised Real-Time Stream-Based Novelty...
Anna Vergeles, Nataliia Manakova "Unsupervised Real-Time Stream-Based Novelty...Anna Vergeles, Nataliia Manakova "Unsupervised Real-Time Stream-Based Novelty...
Anna Vergeles, Nataliia Manakova "Unsupervised Real-Time Stream-Based Novelty...
 
Insights and Graph-based ML Anomaly Detection for eBay Edge Services
 Insights and Graph-based ML Anomaly Detection for eBay Edge Services Insights and Graph-based ML Anomaly Detection for eBay Edge Services
Insights and Graph-based ML Anomaly Detection for eBay Edge Services
 
Monitoring with container insights & anomaly detection - SVC308 - New York AW...
Monitoring with container insights & anomaly detection - SVC308 - New York AW...Monitoring with container insights & anomaly detection - SVC308 - New York AW...
Monitoring with container insights & anomaly detection - SVC308 - New York AW...
 
Solar irradiance data sources & software
Solar irradiance data sources & softwareSolar irradiance data sources & software
Solar irradiance data sources & software
 
Extracting Insights from Industrial Data Using AWS IoT Services (IOT368) - AW...
Extracting Insights from Industrial Data Using AWS IoT Services (IOT368) - AW...Extracting Insights from Industrial Data Using AWS IoT Services (IOT368) - AW...
Extracting Insights from Industrial Data Using AWS IoT Services (IOT368) - AW...
 
Deep-Dive-with-Cloud-Monitoring-with-Amazon-EKS-and-Prometheus
Deep-Dive-with-Cloud-Monitoring-with-Amazon-EKS-and-PrometheusDeep-Dive-with-Cloud-Monitoring-with-Amazon-EKS-and-Prometheus
Deep-Dive-with-Cloud-Monitoring-with-Amazon-EKS-and-Prometheus
 
深探如何使用-Amazon-EKS-與-Prometheus-進行雲端監控
深探如何使用-Amazon-EKS-與-Prometheus-進行雲端監控深探如何使用-Amazon-EKS-與-Prometheus-進行雲端監控
深探如何使用-Amazon-EKS-與-Prometheus-進行雲端監控
 
Data Boulders from Space: How DigitalGlobe Uses AWS to Manage Data
Data Boulders from Space: How DigitalGlobe Uses AWS to Manage DataData Boulders from Space: How DigitalGlobe Uses AWS to Manage Data
Data Boulders from Space: How DigitalGlobe Uses AWS to Manage Data
 
Using Data Integration to Deliver Intelligence to Anyone, Anywhere
Using Data Integration to Deliver Intelligence to Anyone, AnywhereUsing Data Integration to Deliver Intelligence to Anyone, Anywhere
Using Data Integration to Deliver Intelligence to Anyone, Anywhere
 

More from Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Machine Learning with Earth Observation Imagery

  • 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. NaNa Yi Engineer, Development Seed Marc M Fagan CEO, EOS Data Analytics Machine Learning with Earth Observation Imagery
  • 2. Satellite Machine Learning in the Cloud Machine Learning with Earth Observation Imagery
  • 4.
  • 5.
  • 6. - ‘Fully automated’ machine learning pipeline; - Semi-automated machine learning that will require our professional mappers’ QA and map objects.
  • 7. Urchn Tracking cities from space ‘Fully automated’ machine learning pipelines backup Urchn. - Segmentation: for detecting building footprint and road network. - Object detection for individual building count.
  • 9. Segmentation for detecting building footprint and road network Object detection for building counts
  • 11. Mapping high-voltage grids in Pakistan, Nigeria and Zambia Semi-automated machine learning that requires our professional mappers’ QA and mapping objects. - Image classification based supervised machine learning approaches.
  • 12. Machine learning outputs Professional mapper tracing The final output of high-voltage grids
  • 13. - ‘Fully automated’ machine learning pipeline; - Semi-automated machine learning that will require our professional mappers’ QA and mapping objects.
  • 14. - ‘Fully automated’ machine learning pipeline; - Semi-automated machine learning that will require our professional mappers’ QA and mapping objects. How we did it
  • 16. 2. Spot Instance of AWS deep learning AMI (don’t forgot to turn on CloudWatch)
  • 17. We open source our machine learning tools and pipelines: 1. Satellite machine learning training data generation: Label Maker, Skynet-data; 2. Open source machine learning pipelines: ● Image classification: High-voltage grids AWS SageMaker case study ResNet with AWS ● Image segmentation: Skynet ● Object detection: Tensorflow object detection And we will open source have more tools and pipelines, stay tune!
  • 18. Want to know more? Email nana@developmentseed.org Twitter @developmentseed Website http://developmentseed.org
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 153 Employees Data Scientists, AI Engineers Data (EO Sensor) Agnostic Serving All non-profit and profit Use Case Presentations - Bloomberg, LP.
  • 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. “100% Convolutional Neural Network” Disclaimer – lots of human “training or Indexing” “100% Amazon” Disclaimer – sometimes “fool around” with on-premise Gaming GPUs All production - Storage, CPU, GPU, Products up on AWS
  • 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Challenge: Agricultural crop production monitoring at high accuracy and cadence is hard. Present methods:  Methods - Statistical extrapolation based on self-reporting  Timelines - Months after harvest  Cloud cover - Issue with regard to satellite analyses  Costs – Satellite imagery (of sufficient resolution and cadence) – expensive InSAR Weekly Ag Crop Production - United States
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Solution: InSAR (Synthetic Aperture Radar) utilizing AWS Sentinel-1 (ESA) SAR  Product – Measurement of every crop zone, crop type, by climate, by season  Timelines – Every 7 days (nationwide)  Cloud cover – SAR negates cloud issues  Costs – ESA Sentinel 1a & !b – open source Novel, new and very valuable solution to the marketplace InSAR Weekly Ag Crop Production - United States
  • 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Bloomberg – first –of-its-kind financial industries data for commodities, futures, derivatives, swaps trading InSAR Weekly Ag Crop Production - United States • Producers– seed , manufactures, logistics, storage, food processors, etc. • Governments and non-profit
  • 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Challenge: Monitoring of millions of wildcat oil and gas upstream production activities by lifecycle states as the earliest signals of actual oil productive rates. Present methods:  Methods – human data gathering from public permit recorders and statistical, periodic field statistical inspections  Costs – expensive, low margin and value, by virtue of low accuracy Upstream Oil & Gas Production Monitoring
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Solution: Convolutional Neural Net analyses of wellhead equipment, configuration of wellheads indicating the lifecycle patterns indicating type of production 2 months prior to inspection  Product – instantaneous schedule of all wellheads within analyses schedule  Timelines – 1 per month ( possible sooner}  Cloud cover – an open issue  Costs – Fraction of costs due to revenue share and scale with Partner (Airbus) Upstream Oil & Gas Production Monitoring
  • 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Bloomberg – first –of-its-kind financial industries data for commodities, futures, derivatives, swaps trading Upstream Oil & Gas Production Monitoring Product • Producers – field operations, downstream operators, equipment suppliers • Governments and non-profit entities
  • 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Platform EOS performs 100% of the use case operations on AWS including:  Processing and storage of the entire United States (and UA and UK)  Earth on AWS Airbus Pléiades and SPOT access storage and processing  GPU and CPU processing of the Neural Net analyses  Production environment of the final product  Additional ancillary CCN object detecting e.g., preferable road and tailing pond construction, etc. Upstream Oil & Gas Production Monitoring
  • 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Challenge Technical methods to mask false night sky images anemology's e.g. ice, cloud cover, water glare reflectance, etc. in sensor data at large scale and cadence to create accurate night lights signals especial with change Present methods:  Methods - small partial world area analyses  Cloud cover – omitting regular (monthly) comprehensive regular results coinciding with IMF published corollary results  Inability therefore to back test results and modify CCH algorithms  Costs – Utilization of open source NOAA NPP data World Night Lights – Economic Analyses
  • 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Solution: Full monthly access to NOAA NPP data  Product – Worldwide modeling of all countries highlighting relative light intensities with change detection indices correlated to the IMF rating Timelines – Monthly  Cloud cover – None (masked)  Costs – NOAA NPP imagery open source World Night Lights – Economic Analyses
  • 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Bloomberg – first-of-its-kind financial industries data for Macro- trend correlation to bi-annual GDP reporting way before IMF release as well as methods to discount inaccurate reporting by certain environmental entities World Night Lights – Economic Analyses  Multiple additional uses e.g. energy markets, population trends, etc.  Governments and non-profit uses
  • 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Platform EOS performs 100% of the use case operations on AWS including:  Processing and storage of the entire world for NOAA NPP  Largest data set to-date  Completed making methodologies work within AWS with EOS proprietary methods  GPU and CPU processing of the Neural Net analyses  Production environment of the final product World Night Lights – Economic Analyses
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Speaker Contact CEO EOS Data Analytics Menlo Park, CA 978 500 0344 Marc.Fagan@eosda.com EOS.com Marc Fagan
  • 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you!