Coastal Airborne HyperSpectral Imaging (HSI) W. Paul Bissett, FERI/WeoGeo Richard Zimmerman, Victoria Hill, ODU

Why We Are Here New Emphasis in Geospatial Imaging Monterey Peninsula October 2005 MSI (DSS) OrthoPhoto 0.5 m HSI Kelp Density (10% intervals)

Why has HSI been ( and continues to be) a marginal success Sensor technology is expensive, noisy, and supplied by engineers, rather than demanded by imaging market. Market driver was DoD terrestrial ISR. Focus on bright targets and relative reflectance Workflow did not incorporate robust illumination and atmospheric correction This has led to scene dependent solutions with little time-dependent change use other than “anomaly” detection. Dark targets difficult to image SNR and dynamic range problems Bright targets and relative reflectance led to poor calibration standards

Sensor technology is expensive, noisy, and supplied by engineers, rather than demanded by imaging market.

Market driver was DoD terrestrial ISR.

Focus on bright targets and relative reflectance

Workflow did not incorporate robust illumination and atmospheric correction

This has led to scene dependent solutions with little time-dependent change use other than “anomaly” detection.

Dark targets difficult to image

SNR and dynamic range problems

Bright targets and relative reflectance led to poor calibration standards

Why has HSI been ( and continues to be) a marginal success Lack of robust, low cost sensors + lack of rapid, robust, low-cost workflow = no accessibility to information products and/or = no demand pull for sensors and services

Lack of robust, low cost sensors

+ lack of rapid, robust, low-cost workflow

= no accessibility to information products and/or

= no demand pull for sensors and services

Why So Difficult Dark Target Spectroscopy Water is an extremely dark target compared to land targets. In addition, water attenuates signal exponentially with depth, at different rates per wavelength.

Why So Difficult Spectral Resolution in Shallow Water Depth = 6.5 m IOP = Case 1 Bottom = soft coral Depth = 13 m IOP = Pure H 2 0 Bottom = sponge

SAMSON: Spectroscopic Aerial Mapping System with On-board Navigation SAMSON provides full HSI dataset 256 bands in the VNIR (3.5 nm resolution) at 75 lines per second (pushbroom imager), with a SNR, stability, dynamic range, and calibration sufficient for dark target spectroscopy. SAMSON includes an Trimble Applanix DSS/POS AV system for RGB digital aerial photography data (framing imager) with direct geo-positioning. The HSI/RGB system is mounted on a 3-axis stabilized mount (100 Hz adjustment), and the position error of the RGB system is less than 1 pixel (<15 cm at nominal operating altitudes).

SAMSON Highlights SAMSON represents a geospatial sensor suite for automated feature extraction. Our hardware and software enables the automated rendering of intelligence from remotely sensed radiance in near-real time. Production time of 1 TB of raw imagery data (6 hours of continuous collection) to ortho-rectified products is less than 8 hours.

Product Generation Step 1. – Calibration and Orthorectification Putting the photons in the right place Putting the pixel in the right place

Florida Environmental Research Institute Optical Calibration and Alignment Laboratory (FOCAL) Basic Philosophy an end-to-end solution for the construction, assembly, alignment, focus, characterization, and NIST-traceable calibration of optical instruments ranging from simple irradiance meters to hyperspectral radiometers.

Harrisonburg, VA DTM contours from Match-T (Match-T Option)

The light path of the water-leaving radiance. Shows the attenuation of the water-leaving radiance. Scattering of the water-leaving radiance out of the sensor's FOV. Sun glint (reflection from the water surface). Sky glint (scattered light reflecting from the surface). Scattering of reflected light out of the sensor's FOV. Reflected light is also attenuated towards the sensor. Scattered light from the sun which is directed toward the sensor. Light which has already been scattered by the atmosphere which is then scattered toward the sensor. Water-leaving radiance originating out of the sensor FOV, but scattered toward the sensor. Surface reflection out of the sensor FOV which is then scattered toward the sensor. Lw Total water-leaving radiance. Lr Radiance above the sea surface due to all surface reflection effects within the IFOV. Lp Atmospheric path radiance. Light Pathways in the Atmosphere

The light path of the water-leaving radiance.

Shows the attenuation of the water-leaving radiance.

Scattering of the water-leaving radiance out of the sensor's FOV.

Sun glint (reflection from the water surface).

Sky glint (scattered light reflecting from the surface).

Scattering of reflected light out of the sensor's FOV.

Reflected light is also attenuated towards the sensor.

Scattered light from the sun which is directed toward the sensor.

Light which has already been scattered by the atmosphere which is then scattered toward the sensor.

Water-leaving radiance originating out of the sensor FOV, but scattered toward the sensor.

Surface reflection out of the sensor FOV which is then scattered toward the sensor. Lw Total water-leaving radiance. Lr Radiance above the sea surface due to all surface reflection effects within the IFOV. Lp Atmospheric path radiance.

Product Generation Step 2. - Illumination and Atmosphere Correction Chosen Model (after ~59K runs) Water Vapor = 1.895 Ozone = 0.3792 Tau 550 = 0.050 Wind Speed = 2 Relative Humidity = 50 Aerosol Model = urban Range in which the GA was bounded Water Vapor = [.5, 2.0] Ozone = [.30, .38] Tau 550 = [.05, 1.2] Wind Speed = [2, 6, 10] Relative Humidity = [50, 70, 80, 90, 98] Aerosol Model = ['urban', 'maritime', 'coastal', 'coastal-a', ‘tropospheric'] 75,000,000 possible solutions!

Chosen Model (after ~59K runs)

Water Vapor = 1.895

Ozone = 0.3792

Tau 550 = 0.050

Wind Speed = 2

Relative Humidity = 50

Aerosol Model = urban

Product Generation Step 3. – Geospatial Intelligence LUT retrieval: Depth 2.75 m 80% sand, 20% grass IOP set #17 pixel R rs extraction database of R rs spectra database search spectrum match

May 2000 - Horseshoe Reef NRL-DC PHILLS image from ONR CoBOP program Courtesy C. Mobley, ONR collaborator, Spectral Matching Research Horseshoe Reef ooid sand mixed sediment, corals, turf algae, seagrass Lee Stocking Island, Bahamas dense seagrass

LUT Spectrum Matching Raw, Unconstrained Black: NRL acoustic survey for ONR CoBOP program Color: LUT unconstrained depth retrieval Acoustic bathymetry coverage is a few meters along track and ~10 m cross track resolution.

LUT Spectrum Matching Filtered, Unconstrained, kNN = 30 Using AI and optimization techniques to create to enhance fidelity of retrievals and create error statistics.

Error Statistics Filtered, Unconstrained, kNN = 30

NOAA COAST Harmful Algal Bloom (Red Tide) Monterey Bay, Sept. 2006 (SAMSON) High altitude Mission simulating HSI GOES Satellite. 6 hour mission, with 30 minute repeat cycle. ~1 TB raw data per mission. Ortho-rectified data products available after ~6 hours of processing.

High altitude Mission simulating HSI GOES Satellite.

6 hour mission, with 30 minute repeat cycle.

~1 TB raw data per mission.

Ortho-rectified data products available after ~6 hours of processing.

NOAA COAST Harmful Algal Bloom (Red Tide) Monterey Bay, Sept. 2006 (SAMSON) False color composite focusing on phytoplankton specific reflectance features.

False color composite focusing on phytoplankton specific reflectance features.

Spectral Identification of HAB Features Radiance at the sensor (W/m^2/nm/sr) x 1000

NOAA COAST Harmful Algal Bloom (Red Tide) Monterey Bay, Sept. 2006 (SAMSON)

Calibrated SAMSON Data Monterey Bay, CA Ratio: 710nm / 550nm Date: 2006/09/12 Time: 10:15 AM Zenith Angle: 45 5 km

Calibrated SAMSON Data Monterey Bay, CA Ratio: 710nm / 550nm Date: 2006/09/12 Time: 12:15 PM Zenith Angle: 35 Kilometers scale transport of HAB over this time window. Time resolution of spectral signal will provide immediate benefits for HAB tracking, and prediction of HAB landfall . 5 km

FDEP St. Joseph Bay, FL Sept. 2006 Courtesy R. Zimmerman, V. Hill, ODU

Why We Are Here New Emphasis in Geospatial Imaging Monterey Peninsula October 2005 MSI (DSS) OrthoPhoto 0.5 m HSI Kelp Density (10% intervals)

Spatial Resolution Studies MSI/HSI Fusion MSI (DSS RGB) HSI Fused MSI/HSI

Precision Agriculture Using Automated Feature Extraction NEWS RELEASE August 29, 2006 - Trimble Combines GPS Guidance and Rate Control to Automate Agricultural Spraying Operations SAMSON Ag Mapping SAMSON Ag AFEx Trimble Ag GPS 170 Precision application of fertilizer, pesticides, and herbicides for reducing agriculture impacts to the environment.

Geo-Content Management & Delivery Complete custom AJAX and Ruby implementation. Currently handles 10’s of TBs of mapping products and is designed to scale both front end (web) and backend (product delivery) for millions of users autonomously. WeoGeo Server for in-house management and delivery. WeoGeo Market for cloud-based management and monetization. http://www.WeoGeo.com http:// weogeo.coas.oregonstate.edu

Complete custom AJAX and Ruby implementation.

Currently handles 10’s of TBs of mapping products and is designed to scale both front end (web) and backend (product delivery) for millions of users autonomously.

WeoGeo Server for in-house management and delivery.

WeoGeo Market for cloud-based management and monetization.

Content Management WeoGeo Server A network appliance ( à la Google’s Search Appliance). Allows an enterprise to deliver customized maps. Directly link enterprise to WeoGeo Market. $50,000 for two year non-expiring license. Enterprise Library Customize Maps Access Control Revenue Generator End-toEnd Solution

A network appliance ( à la Google’s Search Appliance).

Allows an enterprise to deliver customized maps.

Directly link enterprise to WeoGeo Market.

$50,000 for two year non-expiring license.

WeoGeo Search and Discovery Intuitive Web 2.0 design 5 Step process to discovery (search, sort, review, customize, order)

Intuitive Web 2.0 design

5 Step process to discovery (search, sort, review, customize, order)

WeoGeo Search and Discovery Map Rank TM to return the best search result. Advanced Filter to optimize search.

Map Rank TM to return the best search result.

Advanced Filter to optimize search.

WeoGeo Search and Discovery Seller and Map Rating to provide community control of quality. Metadata to help facilitate selection.

Seller and Map Rating to provide community control of quality.

Metadata to help facilitate selection.

WeoGeo Customization Customize geo-selection via WYSIWG window. Additional customization options available.

Customize geo-selection via WYSIWG window.

Additional customization options available.

WeoGeo Customization Immediate cost calculation dependent on customization. Open KML support for listing and product support.

Immediate cost calculation dependent on customization.

Open KML support for listing and product support.

WeoGeo Network Distribution Open KML support for other geo-browsers.

Open KML support for other geo-browsers.

Summary HSI is hard, particularly for dark targets. Need standardized sensors. Need standardized workflow. Need regional to national programs. 5 PhDs are 5 people too many. Need precise ortho-recification. Need near real-time products (<8 hours). Need simple search, discovery, distribution.

HSI is hard, particularly for dark targets.

Need standardized sensors.

Need standardized workflow.

Need regional to national programs.

5 PhDs are 5 people too many.

Need precise ortho-recification.

Need near real-time products (<8 hours).

Need simple search, discovery, distribution.