This PowerPoint helps students to consider the concept of infinity.
Skynet Week 8 H4D Stanford 2016
1. Skynet
Sam Gussman (creative generalist), Alvin Goh (hacker), Olga Musayev (project development),
Kevin Mott (project manager)
Liaisons/Mentors: Steve Behmer, Ryan Blake, Wayne Chen
# Interviewed this week: 10
1 User,1 Experts, 2 Engineers, 6 Business Leaders
# interviewed total: 80
Developing autonomous drones for situational
awareness. Helping prevent battlefield fatalities by
pinpointing friendly and enemy positions.
2. Customer Discovery
Hypotheses Results Actions
MotionDSP, Kespry, and
OceanIT could be potential
partners
Interviews Partially validated. Each of these
companies solves some problems
that we have. They are all willing to
partner with us to a certain extent
(at least for the class). However, they
all have different business models
that make long-term partnership
questionable. Furthermore, we
would learn less if we rely on
partners.
Try to replicate what the companies do
before partnering to make sure we can’t
do it ourselves.
Possibly work with companies on the
demo for SOCOM, even if long-term
development remains in-house.
Computing power on a phone or
tablet is sufficient for high-level
computer vision.
Interviews, research Invalidated. Our ideas for reducing
the computing load, such as only
analyzing a frame every five
seconds, have significant downsides.
Investigate Movidius and other
companies that allow intensive
computing on drones.
DARPA is a potential partner for
geolocation, ATAK
Interview, research Partly Invalidated. Users don’t
seem to prioritize their “wish list.”
Their geolocation work is not fully
developed, and we’ve uncovered
other partners for getting it done.
Keep talking.
Keep sharing code on ATAK.
Promise less.
Experiments
6. Partners and Benefits Computer Vision Expert:
One of the following:
- Motion DSP
- Movidius
- Stanford Computer Vision Lab
- Independent Contractor
One of the following:
- JL (independent engineer)
- DARPA
Activities Resources
Partners
People Recognition
Geolocation of person
ATAK Integration
Easy UI/UX
Pre-plan Routes
Autonomous Flight
Web Servers / Dataset Tagging,
Training Data,
Algorithm / Model
Camera Metadata (DJI API),
Drone Location data
ATAK Source Code,
ATAK Testing
User Feedback
Litchi,
Open Source Navigation Code,
Drones
Trained Deep Learning Model,
Drones
ATAK Team
- R.K.
- M.F.
- DARPA
SOCOM Operators
Litchi (?)
Open source drone software community
Kespry,
DJI
7. Activities+Resources
Physical Resources: Drones-- COT or Partner
drones; ATAK setup
Financial resources: S&T Funding, SBIR Funding,
other contracts; Corporate partners
Human Resources: Hire, contract, or recruit
computer vision expert; Find mentors in Stanford CV
Lab
Intellectual Property: Trade secret on algorithms
and training data; copyright on software code; TM on
name. Potential patent depending on R-CNN tech
Technological Resources:
Computer Vision: Trained Algorithms, Data, Computing
Power
ATAK Integration: ATAK source code, ATAK setup
Drones: COT drones, human expertise to hack them,
IR sensors, OR partner drone company
Develop Software: Computer Vision to
recognize people, cars, animals
-Geolocation of person on a map
Integrate with Existing DoD Tech: Develop
plug-in for ATAK; run software on other DoD
sensors and feeds
Hack Drones: Either hack COT drones
ourselves or partner with a company that can
provide them
Sell to SOCOM: Use S&T or SBIR process
8. Mission Model Canvas
-Software development
computer vision on drone
feeds
-People recognition
-Geolocation of person
populated on map
-Integration with existing
DoD tech
-Autonomous drone
hacking-not manufacturing
- Hack COT drone like DJI
- Partner with drone maker
- Become sensor neutral
Funding from DoD
- SOCOM
- S&T and acquisition PMs
- Contracting PMs
- DARPA
Computer Vision
- Amazon--AWS
- Movidius
-MotionDSP, OceanIT
-Stanford CV Lab
-Independent computer
vision experts/contractors?
ATAK Integration
- ATAK Programmers
- DARPA
- “JL” for geolocation
Autonomous Drones
-DJI
-Kespry
- Programmable drone
manufacturers (eg: Solo)
- Increase situational
awareness through computer
vision, recognition of people
and objects
- Provide low-cost method of
reconnaissance
-Easy UI and use through
integration w/ ATAK
- New contracts and revenue
streams through the DoD
- New use cases for product
- Reputation and awareness
-Added value to current
program/technology
- Low-cost detection of
movement and people at
border
- Increase ability to respond
to sensors
- Fulfill S&T Topic of Interest requirements
- Establish and meet Key Performance Parameters (KPPs)
- Discover what’s possible under SBIR OSD-162-003X
- Achieve 80% accuracy rate on detecting people, with few false positives
- Find long-term customers in DoD
- Fulfill the DARPA wish list of technical features
- Fulfill BAA-16-31 requirements
- Improved identification and tracking of suspected illegal border crossers.
Get awareness w/ demo
days, technical experiment.
conferences, etc.
-S&T UAV Topic of Area--
submit white paper
-SBIR Phase 1 Grant
“How to” youtube videos,
customer support
-Commercial partnership
-Exchange expertise and
collaborate
Computer Vision
- Computer Vision expert: over $100 per hour
-MotionDSP- free
- Data- ??
ATAK- free
Drones- $1k and up
Other- costs of maintenance, updates, and training
-Demonstrate utility + low-
cost- gain support from
senior personnel
-Show opportunities for new
revenue streams
-Add utility to current program
of record to increase adoption
-Start a company or get
acquired by another company
Beneficiaries
Mission AchievementMission Budget/Costs
Buy-In/Support
Deployment
Value PropositionKey Activities
Key Resources
Key Partners
Funding/Money
Computer Vision
-Computing power
-Algorithms
-Training data: blimp or
drone footage
ATAK Integration
-ATAK source code
-DJI SDK or open-source
Autonomous Drone
__= New
SOCOM
- Tactical operators - SOF
(SF, Ranger, SEALS,
MARSOC/Recon, drone
operators)
- SOCOM PMs- Small UAV
S&T PM, Acquisition PM,
Kespry, OceanIT,
motionDSP, Stanford CV
lab, drone manufacturers
DARPA
Tactical Technology Office-
Persistent Air Support
Project
ATAK Program Manager
DHS
Border Patrol
Skynet
9. Potential Late-Stage Features
V2.0 V3.0
Encryption
Swarm
Auto-Docking
Classification
utilizing motion
tracking
Facial
Recognition
Weapon
Recognition
Inter-drone
Communication
Classification
utilizing age
heuristics
Size
classification
Augmented
Reality
Radio
Retrans
Operating
Range
Reduce
Bulk
Scale to other
platforms
Ruggedize
Drone
Battery Life
1hr
Thermal Crossover
Detection
Indoor
Navigation
Mil Reticle
Self determine
routes
Unplug from
ATAK
Force Protection
Mode
SAR Mode
Motion
Tracking
Laser Range
Finder
Reduced
noise
Computer
Vision
Machine
Learning
IR Computer
Vision
Operating
Mode
Networking
/ Comm.
Hardware /
Engineer
Systems
Integration
General
Programming
11. SkyNet: Value Proposition Canvas
- Image recognition software
applied on video feed
- Aerial perspective
- Hi-def camera
- Flexible deployment
Monitor the border
and respond to
emergencies, aliens
and complaints
Customer
Jobs
- border area is too large,
unable to ensure full coverage
- Impossible to look at the whole
border 24/7
- Limited aerial assets
Border Patrol
Gains
Pains
Gain
Creators
Pain
Relievers
- Survey more area without needing
more men
- Increased awareness when
entering situations
- utilize low-cost drone
swarm to increase border
coverage
- distributed autonomous
drones ensure high refresh
rate across the whole border
Products
& Services
Drone with visual
recognition
software
12. SkyNet: Value Proposition Canvas
- Knowing the locations of
friends/enemies/civilians
- Reduced ambiguity
- autonomous assessment of
aerial perspectives and video
feed Customer
Jobs
Shoot bad
guys without
getting shot
- Cognitive overload from
existing tools
-Manpower losses
- Hassle of systems not
communicating
SOF Elements (combat)
Gains
Pains
Gain
Creators
Pain
Relievers
-Increased situational awareness on
the battlefield
- Reconnaissance of
inaccessible places
- Integrate with current
systems that soldiers are
familiar with
- Frees up another soldier
Products
& Services
Situationally aware
drone with visual
interface
13. SkyNet: Value Proposition Canvas
- Automatic patrol
- Facial Recognition of people
identified in vicinity
- Automatic threat detection
to flag security threats
Customer
Jobs
Force protection
Day-to-day security patrols
are manpower intensive
Difficult to be always aware of
surroundings
SOF Elements (non-combat)
Gains
Pains
Gain
Creators
Pain
Relievers
- Reliable 24/7 Security Awareness
- Knowing who lives around you, and
who doesn’t
- Ability to respond quickly
to threats
- Swarms of drones can
replace patrol units
-24/7 situation awareness of
surroundings
Products
& Services
Situationally aware
autonomous
drones
14. SkyNet: Value Proposition Canvas
- Access into SOCOM
acquisitions
- building company’s
presence in military
Customer
Jobs
Make more money
Build customer
relationships
- Difficult to get large
contracts, technology still
maturing, only have limited
consumer market share
Commercial Partners
Gains
Pains
Gain
Creators
Pain
Relievers
-New revenue stream
-Potential long term partnership
- Contracts with military,
willing and eager to adopt
new technology (early
adopters) even if tech is not
fully matured
Products
& Services
Partnership /
contract
15. SkyNet: Value Proposition Canvas
- Integrating drone camera
feed enhanced with image
recognition
- augmenting ATAK interface
with image processing Customer
Jobs
Manage ATAK
System under
cost
- Proprietary technology
that does not talk to other
tech
- low adoption rate, ‘fancy new toy’
that’s not used much
ATAK Project Manager
Gains
Pains
Gain
Creators
Pain
Relievers
-Increased value to ATAK program
- Easy integration with ATAK
- Promote culture of open-
source
- improving receptiveness to
ATAK
Products
& Services
Autonomous drone
with live video feed
integrated with
ATAK
16. SkyNet: Value Proposition Canvas
-Image recognition software
first of its kind in the military
- tool could potentially be
applied across platforms (as
a software plugin) Customer
Jobs
Manage Programs
Fill gaps
- Tech is new and recognition
of potential enemy may trigger
blowback
- new technology always too expensive,
sometimes they don’t get used after
purchasing
SOCOM Small UAS PM
Gains
Pains
Gain
Creators
Pain
Relievers
- Provides new tool that existing
programs don’t provide
- Potential to scale
-Retain man-in-the-loop, test
software during training
stateside and slowly scale to
overseas.
- Maintain low costs by
utilizing COTS, consistently
engage user feedback at all
stages of development.
Products
& Services
COTS Drone with
visual recognition
software
21. Mission Achievement
Organization Beneficiary Mission Achievement
SOCOM Tactical operators Increase awareness of surroundings with minimal operator input.
PMs Get the right equipment to troops at a reasonable cost.
DARPA ATAK PM Get ATAK utilized in multiple military organizations, create a
plugin ecosystem to add value over time
TAK sUAS plugin team Fully implemented plugin features
DHS Border Patrol Improved identification and tracking of suspected illegal border
crossers.
Potential commercial
partners
Kespry/OceanIT/motionDSP Decreased R&D Costs, new revenue streams, relationships with
US Government customers. Improvements to existing technology
Skynet Team Skynet (Us) Awarded SBIR phase 1 & 2
OR
Transition to S&T acquisition process (via SOCOM) or corporate
partnership
23. Get / Keep / Grow – Border Patrol (SWAG)
Get
Strategy: Ethos, Excitement
Tactics: Utilize preexisting SOCOM contracts to build ethos, Demo / industry
day, quarterly exercises
Keep
Strategy: Become program of record, training and support
Tactics: Take steps to become program of record, maintenance program &
warranty, quality customer support, youtube training videos “How to do X in 5
mins”
Grow
Strategy: Get adopted by other agencies, upsell, develop dual use
Tactics: Unbundle from ATAK, develop new interfaces (AR), upgrade to
object classification, partner w/ traditional vendors and manufacturers, become
joint program of record, work with CTTO, RTTO and other agencies,
24. Get / Keep / Grow – SOCOM
Get
Strategy: Awareness, Excitement, Pressure on Management, Acquisition through S&T or
SBIR process
Tactics: Demo days, industry days, company nights, technical experimentation events,
yearly conference, quarterly exercises, cold calling, referrals by network, hackathons, focus
on Tier 1 Units (e.g. JSOC) and echelon 1 PMs
- Both operators and PMs
Keep
Strategy: training, support, iterate. Support phone number, support email, Field Service
Representative
Tactics: Maintenance program & warranty, quality customer support, youtube training
videos “How to do X in 5 mins”
Grow
Strategy: Get adopted by other agencies, upsell, develop dual use
Tactics: Unbundle from ATAK, develop new interfaces (AR), upgrade to object
classification, partner w/ traditional vendors and manufacturers, become joint program of
record, work with CTTO, RTTO and other agencies.