SlideShare a Scribd company logo
1 of 33
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Scott Herman, VP of Product Development, BlackSky
Robert Cahn, Director of Software Engineering, BlackSky
BlackSky: Advancing the Geospatial
Revolution with Cloud-First Approach
2
BlackSky Delivers Global Intelligence
A Global platform that delivers timely local insights
Tasking &
Collection
Monitoring &
Detection
Geospatial
Intelligence
Global Collection
Network
Global Activity
& Site Monitoring
Hyperlocal Insights
& Predictive Analytics
BlackSky
Constellation
Continuous
Insights
Into Global
Change
• 25 EO and Radar SATs
• >40K Global News Sources
• 100M Mobile Devices
• 70K Ships and Aircraft
• 8+ Social Media Networks
• 5K Environmental Sensors
• 24 - 60 1m EO Satellites
• 5x – 12x per day revisit
• Unique Daily Access Times
• On-Demand Tasking
• Global Ground Network
• Thematic Event Detection
• 100K Sites/Facilities
• Multi-Source Correlation
• Change Detection
• Event Data API’s
• Change Detection
• Anomaly Detection
• Anticipatory Collection
• Context
Observe
Detect
Understand
Enhance
3
BlackSky Global Monitoring Services
Tasking & Collection Services Global Monitoring Services Geospatial Intelligence
Location Based Intelligence that provides early warning and insights on risks,
threats, and opportunities that can impact to your business
On Demand access to a global
collection network of imaging, RF,
and terrestrial sensors
Situational Awareness – Indications & Warnings - Actionable Intelligence
Early warning on risks, threats,
and opportunities that can
impact your business
Insights and assessments for
informed decision making
7
BlackSky Global Monitoring
Architected for AWS
Public AWS and GovCloud and C2S
Global Reach – deployed in
multiple regions worldwide
Wide range of AWS services
Premier AWS Partner with AWS Big
Data Certification
BlackSky Global
Monitoring Analytics
9
BlackSky Monitoring Services
Delivering Timely and Relevant Insights about our Changing World
Monitor
Sites and Areas
of Interests
Detect Changes
& Anomalous
Events
Anticipatory
Tasking & Collection
Critical
Infrastructure
Industrial
Facilities
Natural
Resources
BlackSky Constellation
3rd Party Satellites
News & Social
Media
Transportation
Networks
Borders
3rd Party Sensor
Networks, IoT, &
Mobile
Continuously Monitor the World to Provide Insights on Events that Matter
Continuous
Insights Into
Global Change
• Supply Chain Events
• Conflict Events
• Humanitarian Events
• Security Events
• Etc.
Emerging
Crisis Areas
Report &
Alert
Enrich, Filter
& Extract
Geospatial Content
& Context
Analytics
Alerts
Global Database of High Value Sites
Monitoring Global Events
Thematic Channels – Conflict, Energy, Outbreak, Humanitarian, Military, Construction, Crime
Port and Commodity Monitoring – Western Australia Iron Ore
IoT Device Tracking from Mine to Ship to Port provides unique insights
Daily inflows &
outflows of Iron Ore
from Port Walcott
Satellite Imagery provides
volumetrics correlated to rail cars
BlackSky
Massive Federated Catalog for Commercial Imagery
Knowledge base of commercial imagery since mid-1990s to today (40M+ images) from 25+ remote sensing satellites
BlackSky Constellation
20
BlackSky Constellation - Enabling The Ability to Observe and Understand
the World in Real Time
BlackSky – Multiple orbit planes arranged to maximize revisit
21
 North Korea
Pathfinder Imagery
Spaceflight Ground
Stations
23
BlackSky Commercial Concept of Operations
Spaceflight Industries proprietary information 24
Ground Station Network
2017 2019
United States
Germany
Japan
New Zealand
Guam
Chile
Alaska
10 Spaceflight Ground Stations planned to deploy by 2019.
South Africa
Dubai
Australia
FAI: Fairbanks, AK, USA
IVC: Invercargill, NZ
25
Satellite Operations Architecture – High Level View
 Business Systems: Customer management tools and
business functions such as finance and customer reporting
capabilities
 Platform Operations: Customer interface for placing
tasking/archive orders and viewing fulfilled products
 Ground & Control Software: Responsible for interfacing with
ground stations and constellation satellites to fulfill orders
from the Platform
 Imaging Operations: Responsible for image data archive and
processing prior to delivery to the Platform
 Ground Station Hardware: Physical ground station hardware
for existing and future test and production ground stations
 Global – Hardware: Physical satellite hardware for a Global
spacecraft
 Global – Flight Software: Software running on the Global
spacecraft
26
• Designed for AWS
• Space Operations Services on AWS
• AWS For Multiple Environments
• AWS For Satellite & Groundstation simulation
• Automated provisioning of environments
• VPC Networks
• Hosted Services
• Consequences of Designing for AWS
• Future goals
BlackSky Satellite
Operations
Overview
27
• Designed and built for AWS from beginning for lights out operations
• Designed with security in mind
• Python on Linux running in Docker Containers distributed on managed clusters of EC2 instances
• GovCloud provides ITAR and EAR compliance
• Direct connect allows use of MOC to securely command satellite constellations
• Designed use of virtual and physical mock satellites for scalability testing of constellation management while also supporting
development of flight software that runs on the actual satellites.
BlackSky Satellite Operations –Designed for AWS
• Mission Planning
• Constellation Management
• Mission Script Builder
• Satellite Model
• Tasking Interface
• Ephemeris Service
• Image Collection Feasibility Service
• Telemetry and Monitoring
• Telemetry Packet Routing
• Pass Data Processor
• Radio Chain control and software radios
• Radio Emulators
• Image Processing
• Image Archiving
• TLE Updater
• Weather Service
Space Operations on AWS
Constellation Management Designed for AWS GovCloud from scratch
28
 AWS For Multiple Environments
• SFI Able to define and start new environments on demand
• Dev - Environments for testing development of ground &
control systems
• Stage - Staging area for testing updates to the system
• Ops-Test – Space Operations environment to test operator
interfaces
• Custom Projects - Technology reused by Launch Services with
custom environments deployed on demand.
BlackSky Satellite Operations – AWS For Multiple Environments And
Simulations
 AWS For Satellite & Ground-station simulation
• Designed system for multiple satellites and ground-stations from
beginning - Required use of PowerPC emulation environment
running on AWS Linux Instances running X64
• Allows test and verification of our proprietary mission planning
system at scale
• System works with arbitrary combinations of real and virtual
hardware
• Required custom emulation code of complex devices and support
in flight software
29
 Use of tools for automated provisioning
• SFI uses tools for automated provisioning of our systems using configuration files
• This allows us to easily deploy environments that are highly similar but which has operational differences.
• Automated processes
• Scripted provisioning of AWS resources with controlled configurations
• Cluster management and automatic redeployments
• Secrets control
• Configurations and DNS to groundstations
 Transit VPC Networks
• SFI uses Transit VPCs For Network Security and Visibility. This allows us to have visibility beyond VPN boundaries and to set up very complex firewall
rules on software firewalls.
 Hosted Services used by Space Operations
• RDS
• PostgreSQL database for the SFI Satellite Model value storage. Able to launch this service with virtually no setup effort on our part
• Elasticsearch
• Elasticsearch is used for viewing of all syslog information received from the satellite constellation, physical and virtual groundstations, and all
constellation management services.
• Elasticsearch is heavyweight and expensive but can be shared across our separate environments.
• Again, very easy to use because no real setup required.
• SQS
• SFI uses the simple queuing service to notify other services of events such as notifying the image processing system of a successful downlink
of an image.
BlackSky Satellite Operations – Automated provisioning of environments,
VPC Networks, and Hosted Services
30
•Since SFI has physical groundstations, we limit ourselves to technology
stacks that work both in AWS and on the VM servers that drive
groundstation orchestration. This allows us to develop for one platform,
not two. However, this limits some of the AWS services we are able to use.
•Emulation technologies like minio (S3) help mitigate somewhat.
•We have experienced network bandwidth and latency issues between
GovCloud, and corporate assets.
•AWS often fails to provide meaningful information during system outages.
•AWS gates features that could impact ITAR compliance which may delay
using newer AWS technologies. Often means that GovCloud is
technologically behind the other availability zones.
•TL:DR: GovCloud is not the same as fully featured AWS
Consequences of Designing for AWS
•Use AWS Support for Docker Containers
•Satellite ground & control systems are highly distributed and each service
runs in its own docker container on Nomad cluster
•Will look at using container service in the future
•AWS native replacements for third party provisioning tools.
•Lambda for our lower volume systems.
Future goals
Consequences of
Designing Satellite
Operations for
AWS & Future
Goals
31
Processing High Resolution Satellite Imagery
Normalization for Sensor to Sensor
Variations
Color Corrections & Contrast
Enhancements
Geolocation Refinement &
Topological Corrections
60 Satellites Produce Quite a
Lot of Imagery!
A World of Imaging Conditions Makes Auto
Processing Complex
Every Image Needs to Be Processed;
Processing Is Computationally Intensive
Image Processing Chain
Image Data
Image Products
32
Cloud computing is one of
the enabling technologies
fueling the “new-space
revolution”
•Cloud computing
•Low cost space launch
•COTS electronics
AWS enables BlackSky
to provide customers
with a unique
geospatial intelligence
solution
Large volumes of data
(satellite imagery and
open source data) can
be rapidly stored,
accessed, processed and
disseminated
Satellite and ground
station operations can
be rapidly scaled and
virtualized for end-to-
end testing and
checkout prior to launch
Conclusions
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!

More Related Content

What's hot

CYBERSECURITY | Why it is important?
CYBERSECURITY | Why it is important?CYBERSECURITY | Why it is important?
CYBERSECURITY | Why it is important?RONIKMEHRA
 
Siber Güvenlik ve Etik Hacking Sunu - 9
Siber Güvenlik ve Etik Hacking Sunu - 9Siber Güvenlik ve Etik Hacking Sunu - 9
Siber Güvenlik ve Etik Hacking Sunu - 9Murat KARA
 
ISA/IEC 62443: Intro and How To
ISA/IEC 62443: Intro and How ToISA/IEC 62443: Intro and How To
ISA/IEC 62443: Intro and How ToJim Gilsinn
 
MITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITRE
MITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITREMITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITRE
MITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITREMITRE - ATT&CKcon
 
Cyber Security and Cloud Computing
Cyber Security and Cloud ComputingCyber Security and Cloud Computing
Cyber Security and Cloud ComputingKeet Sugathadasa
 
Cloud Security Demystified
Cloud Security DemystifiedCloud Security Demystified
Cloud Security DemystifiedMichael Torres
 
Siber Güvenlik ve Etik Hacking Sunu - 1
Siber Güvenlik ve Etik Hacking Sunu - 1Siber Güvenlik ve Etik Hacking Sunu - 1
Siber Güvenlik ve Etik Hacking Sunu - 1Murat KARA
 
Siber Güvenlik ve Etik Hacking Sunu - 7
Siber Güvenlik ve Etik Hacking Sunu - 7Siber Güvenlik ve Etik Hacking Sunu - 7
Siber Güvenlik ve Etik Hacking Sunu - 7Murat KARA
 
PowerPoint Presentation On Ethical Hacking in Brief (Simple)
PowerPoint Presentation On Ethical Hacking in Brief (Simple)PowerPoint Presentation On Ethical Hacking in Brief (Simple)
PowerPoint Presentation On Ethical Hacking in Brief (Simple)Shivam Sahu
 
You can detect PowerShell attacks
You can detect PowerShell attacksYou can detect PowerShell attacks
You can detect PowerShell attacksMichael Gough
 
An introduction to Cyber Essentials
An introduction to Cyber EssentialsAn introduction to Cyber Essentials
An introduction to Cyber EssentialsJisc
 
A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020
A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020
A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020Jiunn-Jer Sun
 

What's hot (20)

CYBERSECURITY | Why it is important?
CYBERSECURITY | Why it is important?CYBERSECURITY | Why it is important?
CYBERSECURITY | Why it is important?
 
Siber Güvenlik ve Etik Hacking Sunu - 9
Siber Güvenlik ve Etik Hacking Sunu - 9Siber Güvenlik ve Etik Hacking Sunu - 9
Siber Güvenlik ve Etik Hacking Sunu - 9
 
ISA/IEC 62443: Intro and How To
ISA/IEC 62443: Intro and How ToISA/IEC 62443: Intro and How To
ISA/IEC 62443: Intro and How To
 
MITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITRE
MITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITREMITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITRE
MITRE ATT&CKcon 2.0: State of the ATT&CK; Blake Strom, MITRE
 
Information Security
Information SecurityInformation Security
Information Security
 
Module 3-cyber security
Module 3-cyber securityModule 3-cyber security
Module 3-cyber security
 
Threat Hunting on AWS using Azure Sentinel
Threat Hunting on AWS using Azure SentinelThreat Hunting on AWS using Azure Sentinel
Threat Hunting on AWS using Azure Sentinel
 
What is Tails OS ?
What is Tails OS ?What is Tails OS ?
What is Tails OS ?
 
Cyber Security and Cloud Computing
Cyber Security and Cloud ComputingCyber Security and Cloud Computing
Cyber Security and Cloud Computing
 
Cloud Security Demystified
Cloud Security DemystifiedCloud Security Demystified
Cloud Security Demystified
 
Ransomware protection
Ransomware protectionRansomware protection
Ransomware protection
 
Pentesting with Metasploit
Pentesting with MetasploitPentesting with Metasploit
Pentesting with Metasploit
 
Siber Güvenlik ve Etik Hacking Sunu - 1
Siber Güvenlik ve Etik Hacking Sunu - 1Siber Güvenlik ve Etik Hacking Sunu - 1
Siber Güvenlik ve Etik Hacking Sunu - 1
 
Siber Güvenlik ve Etik Hacking Sunu - 7
Siber Güvenlik ve Etik Hacking Sunu - 7Siber Güvenlik ve Etik Hacking Sunu - 7
Siber Güvenlik ve Etik Hacking Sunu - 7
 
PowerPoint Presentation On Ethical Hacking in Brief (Simple)
PowerPoint Presentation On Ethical Hacking in Brief (Simple)PowerPoint Presentation On Ethical Hacking in Brief (Simple)
PowerPoint Presentation On Ethical Hacking in Brief (Simple)
 
You can detect PowerShell attacks
You can detect PowerShell attacksYou can detect PowerShell attacks
You can detect PowerShell attacks
 
OWASP ZAP
OWASP ZAPOWASP ZAP
OWASP ZAP
 
An introduction to Cyber Essentials
An introduction to Cyber EssentialsAn introduction to Cyber Essentials
An introduction to Cyber Essentials
 
Attack lecture #2 ppt
Attack lecture #2 pptAttack lecture #2 ppt
Attack lecture #2 ppt
 
A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020
A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020
A Big Picture of IEC 62443 - Cybersecurity Webinar (2) 2020
 

Similar to Black Sky: Advancing the Geospatial Revolution with Cloud-First Approach

Experiments with Complex Scientific Applications on Hybrid Cloud Infrastructures
Experiments with Complex Scientific Applications on Hybrid Cloud InfrastructuresExperiments with Complex Scientific Applications on Hybrid Cloud Infrastructures
Experiments with Complex Scientific Applications on Hybrid Cloud InfrastructuresRafael Ferreira da Silva
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud ComputingDavid Wallom
 
DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...
DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...
DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...Docker, Inc.
 
Community Session: Strategic Private Cloud in SKY UK
Community Session: Strategic Private Cloud in SKY UKCommunity Session: Strategic Private Cloud in SKY UK
Community Session: Strategic Private Cloud in SKY UKVMUG IT
 
Cloud orchestration major tools comparision
Cloud orchestration major tools comparisionCloud orchestration major tools comparision
Cloud orchestration major tools comparisionRavi Kiran
 
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...RightScale
 
Amazon AWS vs Azure Cloud vs Kubernetes
Amazon AWS vs Azure Cloud vs KubernetesAmazon AWS vs Azure Cloud vs Kubernetes
Amazon AWS vs Azure Cloud vs KubernetesStridely Solutions
 
Distributed architecture in a cloud native microservices ecosystem
Distributed architecture in a cloud native microservices ecosystemDistributed architecture in a cloud native microservices ecosystem
Distributed architecture in a cloud native microservices ecosystemZhenzhong Xu
 
PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...
PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...
PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...Rohit Agarwalla
 
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...Amazon Web Services
 
AperiStorageResourceManager
AperiStorageResourceManagerAperiStorageResourceManager
AperiStorageResourceManagerRobert Wipfel
 
Cloud Computing - Challenges & Opportunities
Cloud Computing - Challenges & OpportunitiesCloud Computing - Challenges & Opportunities
Cloud Computing - Challenges & OpportunitiesOwen Cutajar
 
Wild Rides Takes off - The Dawn of a New Unicorn
Wild Rides Takes off - The Dawn of a New UnicornWild Rides Takes off - The Dawn of a New Unicorn
Wild Rides Takes off - The Dawn of a New UnicornAmazon Web Services
 
Netflix0SS Services on Docker
Netflix0SS Services on DockerNetflix0SS Services on Docker
Netflix0SS Services on DockerDocker, Inc.
 
Ibm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinalIbm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinalaspyker
 
OpenStack Introduction
OpenStack IntroductionOpenStack Introduction
OpenStack IntroductionJimi Chen
 

Similar to Black Sky: Advancing the Geospatial Revolution with Cloud-First Approach (20)

Self-Service Supercomputing
Self-Service SupercomputingSelf-Service Supercomputing
Self-Service Supercomputing
 
Experiments with Complex Scientific Applications on Hybrid Cloud Infrastructures
Experiments with Complex Scientific Applications on Hybrid Cloud InfrastructuresExperiments with Complex Scientific Applications on Hybrid Cloud Infrastructures
Experiments with Complex Scientific Applications on Hybrid Cloud Infrastructures
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
 
DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...
DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...
DockerCon SF 2015 : Reliably shipping containers in a resource rich world usi...
 
Community Session: Strategic Private Cloud in SKY UK
Community Session: Strategic Private Cloud in SKY UKCommunity Session: Strategic Private Cloud in SKY UK
Community Session: Strategic Private Cloud in SKY UK
 
REDSHIFT - Amazon
REDSHIFT - AmazonREDSHIFT - Amazon
REDSHIFT - Amazon
 
Cloud orchestration major tools comparision
Cloud orchestration major tools comparisionCloud orchestration major tools comparision
Cloud orchestration major tools comparision
 
Dice presents-feb2014
Dice presents-feb2014Dice presents-feb2014
Dice presents-feb2014
 
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...[RightScale Webinar] Architecting Databases in the cloud:  How RightScale Doe...
[RightScale Webinar] Architecting Databases in the cloud: How RightScale Doe...
 
Amazon AWS vs Azure Cloud vs Kubernetes
Amazon AWS vs Azure Cloud vs KubernetesAmazon AWS vs Azure Cloud vs Kubernetes
Amazon AWS vs Azure Cloud vs Kubernetes
 
Distributed architecture in a cloud native microservices ecosystem
Distributed architecture in a cloud native microservices ecosystemDistributed architecture in a cloud native microservices ecosystem
Distributed architecture in a cloud native microservices ecosystem
 
PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...
PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...
PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...
 
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
 
Kubernetes2
Kubernetes2Kubernetes2
Kubernetes2
 
AperiStorageResourceManager
AperiStorageResourceManagerAperiStorageResourceManager
AperiStorageResourceManager
 
Cloud Computing - Challenges & Opportunities
Cloud Computing - Challenges & OpportunitiesCloud Computing - Challenges & Opportunities
Cloud Computing - Challenges & Opportunities
 
Wild Rides Takes off - The Dawn of a New Unicorn
Wild Rides Takes off - The Dawn of a New UnicornWild Rides Takes off - The Dawn of a New Unicorn
Wild Rides Takes off - The Dawn of a New Unicorn
 
Netflix0SS Services on Docker
Netflix0SS Services on DockerNetflix0SS Services on Docker
Netflix0SS Services on Docker
 
Ibm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinalIbm cloud nativenetflixossfinal
Ibm cloud nativenetflixossfinal
 
OpenStack Introduction
OpenStack IntroductionOpenStack Introduction
OpenStack Introduction
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Black Sky: Advancing the Geospatial Revolution with Cloud-First Approach

  • 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Scott Herman, VP of Product Development, BlackSky Robert Cahn, Director of Software Engineering, BlackSky BlackSky: Advancing the Geospatial Revolution with Cloud-First Approach
  • 2. 2 BlackSky Delivers Global Intelligence A Global platform that delivers timely local insights Tasking & Collection Monitoring & Detection Geospatial Intelligence Global Collection Network Global Activity & Site Monitoring Hyperlocal Insights & Predictive Analytics BlackSky Constellation Continuous Insights Into Global Change • 25 EO and Radar SATs • >40K Global News Sources • 100M Mobile Devices • 70K Ships and Aircraft • 8+ Social Media Networks • 5K Environmental Sensors • 24 - 60 1m EO Satellites • 5x – 12x per day revisit • Unique Daily Access Times • On-Demand Tasking • Global Ground Network • Thematic Event Detection • 100K Sites/Facilities • Multi-Source Correlation • Change Detection • Event Data API’s • Change Detection • Anomaly Detection • Anticipatory Collection • Context Observe Detect Understand Enhance
  • 3. 3 BlackSky Global Monitoring Services Tasking & Collection Services Global Monitoring Services Geospatial Intelligence Location Based Intelligence that provides early warning and insights on risks, threats, and opportunities that can impact to your business On Demand access to a global collection network of imaging, RF, and terrestrial sensors Situational Awareness – Indications & Warnings - Actionable Intelligence Early warning on risks, threats, and opportunities that can impact your business Insights and assessments for informed decision making
  • 4.
  • 5.
  • 6.
  • 7. 7 BlackSky Global Monitoring Architected for AWS Public AWS and GovCloud and C2S Global Reach – deployed in multiple regions worldwide Wide range of AWS services Premier AWS Partner with AWS Big Data Certification
  • 9. 9 BlackSky Monitoring Services Delivering Timely and Relevant Insights about our Changing World Monitor Sites and Areas of Interests Detect Changes & Anomalous Events Anticipatory Tasking & Collection Critical Infrastructure Industrial Facilities Natural Resources BlackSky Constellation 3rd Party Satellites News & Social Media Transportation Networks Borders 3rd Party Sensor Networks, IoT, & Mobile Continuously Monitor the World to Provide Insights on Events that Matter Continuous Insights Into Global Change • Supply Chain Events • Conflict Events • Humanitarian Events • Security Events • Etc. Emerging Crisis Areas Report & Alert Enrich, Filter & Extract Geospatial Content & Context Analytics Alerts Global Database of High Value Sites
  • 10.
  • 11. Monitoring Global Events Thematic Channels – Conflict, Energy, Outbreak, Humanitarian, Military, Construction, Crime
  • 12.
  • 13.
  • 14. Port and Commodity Monitoring – Western Australia Iron Ore IoT Device Tracking from Mine to Ship to Port provides unique insights Daily inflows & outflows of Iron Ore from Port Walcott Satellite Imagery provides volumetrics correlated to rail cars
  • 15.
  • 17. Massive Federated Catalog for Commercial Imagery Knowledge base of commercial imagery since mid-1990s to today (40M+ images) from 25+ remote sensing satellites
  • 18.
  • 20. 20 BlackSky Constellation - Enabling The Ability to Observe and Understand the World in Real Time BlackSky – Multiple orbit planes arranged to maximize revisit
  • 24. Spaceflight Industries proprietary information 24 Ground Station Network 2017 2019 United States Germany Japan New Zealand Guam Chile Alaska 10 Spaceflight Ground Stations planned to deploy by 2019. South Africa Dubai Australia FAI: Fairbanks, AK, USA IVC: Invercargill, NZ
  • 25. 25 Satellite Operations Architecture – High Level View  Business Systems: Customer management tools and business functions such as finance and customer reporting capabilities  Platform Operations: Customer interface for placing tasking/archive orders and viewing fulfilled products  Ground & Control Software: Responsible for interfacing with ground stations and constellation satellites to fulfill orders from the Platform  Imaging Operations: Responsible for image data archive and processing prior to delivery to the Platform  Ground Station Hardware: Physical ground station hardware for existing and future test and production ground stations  Global – Hardware: Physical satellite hardware for a Global spacecraft  Global – Flight Software: Software running on the Global spacecraft
  • 26. 26 • Designed for AWS • Space Operations Services on AWS • AWS For Multiple Environments • AWS For Satellite & Groundstation simulation • Automated provisioning of environments • VPC Networks • Hosted Services • Consequences of Designing for AWS • Future goals BlackSky Satellite Operations Overview
  • 27. 27 • Designed and built for AWS from beginning for lights out operations • Designed with security in mind • Python on Linux running in Docker Containers distributed on managed clusters of EC2 instances • GovCloud provides ITAR and EAR compliance • Direct connect allows use of MOC to securely command satellite constellations • Designed use of virtual and physical mock satellites for scalability testing of constellation management while also supporting development of flight software that runs on the actual satellites. BlackSky Satellite Operations –Designed for AWS • Mission Planning • Constellation Management • Mission Script Builder • Satellite Model • Tasking Interface • Ephemeris Service • Image Collection Feasibility Service • Telemetry and Monitoring • Telemetry Packet Routing • Pass Data Processor • Radio Chain control and software radios • Radio Emulators • Image Processing • Image Archiving • TLE Updater • Weather Service Space Operations on AWS Constellation Management Designed for AWS GovCloud from scratch
  • 28. 28  AWS For Multiple Environments • SFI Able to define and start new environments on demand • Dev - Environments for testing development of ground & control systems • Stage - Staging area for testing updates to the system • Ops-Test – Space Operations environment to test operator interfaces • Custom Projects - Technology reused by Launch Services with custom environments deployed on demand. BlackSky Satellite Operations – AWS For Multiple Environments And Simulations  AWS For Satellite & Ground-station simulation • Designed system for multiple satellites and ground-stations from beginning - Required use of PowerPC emulation environment running on AWS Linux Instances running X64 • Allows test and verification of our proprietary mission planning system at scale • System works with arbitrary combinations of real and virtual hardware • Required custom emulation code of complex devices and support in flight software
  • 29. 29  Use of tools for automated provisioning • SFI uses tools for automated provisioning of our systems using configuration files • This allows us to easily deploy environments that are highly similar but which has operational differences. • Automated processes • Scripted provisioning of AWS resources with controlled configurations • Cluster management and automatic redeployments • Secrets control • Configurations and DNS to groundstations  Transit VPC Networks • SFI uses Transit VPCs For Network Security and Visibility. This allows us to have visibility beyond VPN boundaries and to set up very complex firewall rules on software firewalls.  Hosted Services used by Space Operations • RDS • PostgreSQL database for the SFI Satellite Model value storage. Able to launch this service with virtually no setup effort on our part • Elasticsearch • Elasticsearch is used for viewing of all syslog information received from the satellite constellation, physical and virtual groundstations, and all constellation management services. • Elasticsearch is heavyweight and expensive but can be shared across our separate environments. • Again, very easy to use because no real setup required. • SQS • SFI uses the simple queuing service to notify other services of events such as notifying the image processing system of a successful downlink of an image. BlackSky Satellite Operations – Automated provisioning of environments, VPC Networks, and Hosted Services
  • 30. 30 •Since SFI has physical groundstations, we limit ourselves to technology stacks that work both in AWS and on the VM servers that drive groundstation orchestration. This allows us to develop for one platform, not two. However, this limits some of the AWS services we are able to use. •Emulation technologies like minio (S3) help mitigate somewhat. •We have experienced network bandwidth and latency issues between GovCloud, and corporate assets. •AWS often fails to provide meaningful information during system outages. •AWS gates features that could impact ITAR compliance which may delay using newer AWS technologies. Often means that GovCloud is technologically behind the other availability zones. •TL:DR: GovCloud is not the same as fully featured AWS Consequences of Designing for AWS •Use AWS Support for Docker Containers •Satellite ground & control systems are highly distributed and each service runs in its own docker container on Nomad cluster •Will look at using container service in the future •AWS native replacements for third party provisioning tools. •Lambda for our lower volume systems. Future goals Consequences of Designing Satellite Operations for AWS & Future Goals
  • 31. 31 Processing High Resolution Satellite Imagery Normalization for Sensor to Sensor Variations Color Corrections & Contrast Enhancements Geolocation Refinement & Topological Corrections 60 Satellites Produce Quite a Lot of Imagery! A World of Imaging Conditions Makes Auto Processing Complex Every Image Needs to Be Processed; Processing Is Computationally Intensive Image Processing Chain Image Data Image Products
  • 32. 32 Cloud computing is one of the enabling technologies fueling the “new-space revolution” •Cloud computing •Low cost space launch •COTS electronics AWS enables BlackSky to provide customers with a unique geospatial intelligence solution Large volumes of data (satellite imagery and open source data) can be rapidly stored, accessed, processed and disseminated Satellite and ground station operations can be rapidly scaled and virtualized for end-to- end testing and checkout prior to launch Conclusions
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you!