SlideShare a Scribd company logo
1 of 75
Download to read offline
Machine Learning for Societal
Applications
2
Monday, August 11, 14
Satellite Observations Meteorological Analyses Population Density In-situ observationsSocial Media
Combined Using
Machine Learning
to Provide a
High-Resolution
Global Products
Combined with Electronic Health Records to provide:
1. Real time personal health alerts
2. Physician Decision Support Tools
3. Logistical Planning for Emergency Rooms
4. Improved Policy Decisions
Next Generation of High Speed Networks to Facilitate the
Next Generation of Proactive Smart Health Care Applications
Veteran’s Administration
Country’s Largest Health Care Provider
Requires ultra-low latency gigabit to the end user
Local cloud computing coupled with widely distributed national and global sensor networks
Multiple global high-resolution datasets
Prof. David Lary
Monday, August 11, 14
Next Generation of High Speed Low latency Networks to Facilitate the
Next Generation of Smart Fire Detection & Water Conservation Applications
Requires ultra-low latency wireless gigabit for very-high resolution hyperspectral video imagery for real time flight control of aerial vehicles
11 drought-ridden western and central states have just
been declared as primary natural disaster areas seriously
threatening US food security. Further, every year between
$1 and $2 billion dollars are spent on fire suppression
costs alone.
A fleet of low cost aerial vehicles working together
autonomously utilizing uncompressed very-high
resolution hyperspectral video imagery.The geo-tagged
imagery is streamed using high-speed low-latency wireless
networks to communicate to a powerful cloud computing
cluster running machine learning and image processing
algorithms for real time direction of the optimal flight
patterns, and the delivery of early warning for timely
interventions.
Fire: Appropriate preemptive fire prevention can lead to
massive savings in fire control costs, loss of life, and
property damage.
Agriculture: Appropriate and timely early warning of
crop infestations, infections and/or water stress can
prevent massive avoidable losses.
Prof. David Lary
20 lb Airborne 385 channel
hyperspectral imaging system
Monday, August 11, 14
Next Generation of High Speed Networks to Facilitate the
Next Generation of Smart Water Management Applications
With Drought Disaster Declarations in 11 western and central
states, smart water management is now more critical than ever
for sustainable water conservation and US Food Security.
Coupling high resolution remote sensing from satellites, with
machine learning, and the next generation of high speed low
latency networks is facilitating the next generation of smart
water management systems. These systems will benefit
individual home owners, farmers, corporate campuses, golf
courses, etc. and allow optimum monitoring and control of
irrigation using mobile devices.
Sports fields
blown valves lead to flooding
uneven irrigation
Prof. David Lary
Monday, August 11, 14
Monday, August 11, 14
Unprecedented levels of air pollution in Singapore and Malaysia in June led to respiratory illnesses, school closings, and
grounded aircraft.  This year it was so bad that in some affected areas there was a 100 percent rise in the number of asthma
cases, and the government of Malaysia distributed gas masks.
MODIS Aqua July 21, 2013.
David Lary
Monday, August 11, 14
Air pollution in Ulaanbaatar, Mongolia
Monday, August 11, 14
Monday, August 11, 14
This is a BigData Problem of
Great Societal Relevance
• Collecting data in real time from national and
global networks requires bandwidth.
• With the next generation of wearable sensors and
the internet of things this data volume will
rapidly increase.
• A variety of applications enabled by BigData,
higher bandwidth and cloud processing.
• Future finer granularity and two way
communication will dramatically increase the size
of the data bringing air quality to the micro scale,
just like weather data.
Time Taken
10 Mbps 20 Mbps 50 Mbps 1 Gbps
40 TB training data
4 Gb update
185 days 93 days 37 days 1 day 21 hours
54m 27m 11m 32s
Monday, August 11, 14
Think Big: Holistic & Comprehensive Informatics
Bio'Informa$cs
Medical'Informa$cs
Environmental'Informa$cs
THRIVE
Mul$ple'Big'Data'+'EMR'+'Social'Media'+'Machine'Learning'+'Causality
A'Cross=cu>ng'Pla@orm'for'Comprehensive'Informa$cs'for'Data*Driven*Decisions'in'Pa4ent*
Centered*Care'facilitated'by'High%Speed%Low-Latency%networks,'mul$ple'massive'datasets'from'
large'distributed'sensor'networks,'EMR,'and'local%cloud%compu:ng.
Monday, August 11, 14
PM2.5 Invisible Killer
Monday, August 11, 14
Using Multiple Big Datasets and Machine Learning
to Produce a New Global Particulate Dataset
A Technology Challenge Case Study
David Lary
Hanson Center for Space Science
University of Texas at Dallas
Monday, August 11, 14
What?
Monday, August 11, 14
TypesofbiologicalMaterialTypesofDustTypesofParticulatesGasMolecules 0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm
Pollen
Mold Spores
House Dust Mite Allergens
Bacteria
Cat Allergens
Viruses
Heavy Dust
Settling Dust
Suspended Atmospheric Dust
Cement Dust
Fly Ash
Oil Smoke
Smog
Tobacco Smoke
Soot
Gas Molecules
Decreased Lung Function < 10 μm
Skin & Eye Disease < 2.5 μm
Tumors < 1 μm
Cardiovascular Disease < 0.1 μm
Hair
Pin
Cell
0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm
PM10 particles
PM2.5 particles
PM0.1 ultra fine particles PM10-2.5 coarse fraction
0.1 mm 1 mm
Monday, August 11, 14
TypesofbiologicalMaterialTypesofDustTypesofParticulatesGasMolecules
0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm
Pollen
Mold Spores
House Dust Mite Allergens
Bacteria
Cat Allergens
Viruses
Heavy Dust
Settling Dust
Suspended Atmospheric Dust
Cement Dust
Fly Ash
Oil Smoke
Smog
Tobacco Smoke
Soot
Gas Molecules
Decreased Lung Function < 10 μm
Skin & Eye Disease < 2.5 μm
Tumors < 1 μm
Cardiovascular Disease < 0.1 μm
Hair
Pin
Cell
0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm
PM10 particles
PM2.5 particles
PM0.1 ultra fine particles PM10-2.5 coarse fraction
0.1 mm 1 mm
Table!1.!PM!and!health!outcomes!(modified!from!Ruckerl*et*al.!(2006)).!
!!
Health*Outcomes!
Short9term*Studies* Long9term*Studies*
PM10! PM2.5! UFP! PM10! PM2.5! UFP!
Mortality* !! !! !! !! !! !!
!!!!All!causes! xxx!! xxx!! x! xx! xx! x!
!!!!Cardiovascular! xxx! xxx! x!! xx! xx! x!
!!!!Pulmonary! xxx! xxx! x! xx! xx! x!
Pulmonary!effects! !! !! !! !! !! !!
!!!!Lung!function,!e.g.,!PEF! xxx! xxx! xx! xxx! xxx! !!
!!!!Lung!function!growth! !! !! !! xxx! xxx! !!
Asthma!and!COPD!exacerbation! !! !! !! !! !! !!
!!!!Acute!respiratory!symptoms! !! xx! x! xxx! xxx! !!
!!!!Medication!use! !! !! x! !! !! !!
!!!!Hospital!admission! xx! xxx! x! !! !! !!
Lung!cancer! !! !! !! !! !! !!
!!!!Cohort! !! !! !! xx! xx! x!
!!!!Hospital!admission! !! !! !! xx! xx! x!
Cardiovascular!effects! !! !! !! !! !! !!
!!!!Hospital!admission! xxx! xxx! !! x! x! !!
ECG@related!endpoints! !! !! !! !! !! !!
!!!!Autonomic!nervous!system! xxx! xxx! xx! !! !! !!
!!!!Myocardial!substrate!and!vulnerability! !! xx! x! !! !! !!
Vascular!function! !! !! !! !! !! !!
!!!!Blood!pressure! xx! xxx! x! !! !! !!
!!!!Endothelial!function! x! xx! x! !! !! !!
Blood!markers! !! !! !! !! !! !!
!!!!Pro!inflammatory!mediators! xx! xx! xx! !! !! !!
!!!!Coagulation!blood!markers! xx! xx! xx! !! !! !!
!!!!Diabetes! x! xx! x! !! !! !!
!!!!Endothelial!function! x! x! xx! !! !! !!
Reproduction! !! !! !! !! !! !!
!!!!Premature!birth! x! x! !! !! !! !!
!!!!Birth!weight! xx! x! !! !! !! !!
!!!!IUR/SGA! x! x! !! !! !! !!
Fetal!growth! !! !! !! !! !! !!
!!!!Birth!defects! x! !! !! !! !! !!
!!!!Infant!mortality! xx! x! !! !! !! !!
!!!!Sperm!quality! x! x! !! !! !! !!
Neurotoxic!effects! !! !! !! !! !! !!
!!!!Central!nervous!system!! !! x! xx! !! !! !!
x, few studies; xx, many studies; xxx, large number of studies.
Why?
Monday, August 11, 14
Why?
Monday, August 11, 14
How?
Used around 40 different BigData sets from satellites, meteorology,
demographics, scraped web-sites and social media to estimate PM2.5. Plot
below shows the average of 5,935 days from August 1, 1997 to the present.
Monday, August 11, 14
Which Platform?
Requirements:
1. Large persistent storage for multiple BigData sets, 100TB+ (otherwise
before have had time to process the massive datasets the scratch space
time limit has expired)
2. High Bandwidth connections
3. Ability to harvest social media (e.g. twitter) and scrape web sites for data
4. High level language with wide range of optimized toolboxes, matlab
5. Algorithms capable of dealing with massive non-linear, non-parametric,
non-Gaussian multivariate datasets (13,000+ variables)
6. Easy to make use of multiple GPUs and CPUs
7. Ability to schedule tasks at precise times and time intervals to automate
workflows (in this case tasks executed at intervals of 5 minutes, 15 minutes,
1 hour, 3 hours, 1 day)
Monday, August 11, 14
How?
Exis%ng(
• Social(Media(
• Socioeconomic,(Census(
• News(feeds(
• Environmental(
• Weather(
• Satellite(
• Sensors(
• Health(
• Economic(
New(
• UAVs(
• Smart(Dust(
• Autonomous(Cars(
• Sensors(
Simula%on(
• Global(Weather(Models(
• Economic(Models(
• Earthquake(Models(
Insight(
Machine(
Learning(
Data(
Same approach highly relevant for
the validation and optimal
exploitation of the next generation
of satellites, e.g. the upcoming
NASA Decadal Survey Missions.
Monday, August 11, 14
How?
California Children Example
Monday, August 11, 14
Terra DeepBlue
Rank Source Variable Type
1 Population Density Input
2 Satellite Product Tropospheric NO2 Column Input
3 Meteorological Analyses Surface Specific Humidity Input
4 Satellite Product Solar Azimuth Input
5 Meteorological Analyses Surface Wind Speed Input
6 Satellite Product White-sky Albedo at 2,130 nm Input
7 Satellite Product White-sky Albedo at 555 nm Input
8 Meteorological Analyses Surface Air Temperature Input
9 Meteorological Analyses Surface Layer Height Input
10 Meteorological Analyses Surface Ventilation Velocity Input
11 Meteorological Analyses Total Precipitation Input
12 Satellite Product Solar Zenith Input
13 Meteorological Analyses Air Density at Surface Input
14 Satellite Product Cloud Mask Qa Input
15 Satellite Product Deep Blue Aerosol Optical Depth 470 nm Input
16 Satellite Product Sensor Zenith Input
17 Satellite Product White-sky Albedo at 858 nm Input
18 Meteorological Analyses Surface Velocity Scale Input
19 Satellite Product White-sky Albedo at 470 nm Input
20 Satellite Product Deep Blue Angstrom Exponent Land Input
21 Satellite Product White-sky Albedo at 1,240 nm Input
22 Satellite Product Scattering Angle Input
23 Satellite Product Sensor Azimuth Input
24 Satellite Product Deep Blue Surface Reflectance 412 nm Input
25 Satellite Product White-sky Albedo at 1,640 nm Input
26 Satellite Product Deep Blue Aerosol Optical Depth 660 nm Input
27 Satellite Product White-sky Albedo at 648 nm Input
28 Satellite Product Deep Blue Surface Reflectance 660 nm Input
29 Satellite Product Cloud Fraction Land Input
30 Satellite Product Deep Blue Surface Reflectance 470 nm Input
31 Satellite Product Deep Blue Aerosol Optical Depth 550 nm Input
32 Satellite Product Deep Blue Aerosol Optical Depth 412 nm Input
In-situ Observation PM2.5 Target
Monday, August 11, 14
Monday, August 11, 14
Hourly Measurements from 55 countries and more
than 8,000 measurement sites from 1997-present
A lot of measurements,
but notice the large gaps!
Monday, August 11, 14
Gaps are inevitable because of the
infrastructure and cost associated with
making the measurements.
Hourly Measurements from 55 countries and more than
8,000 measurement sites from 1997-present
Monday, August 11, 14
Challenge 1: Obtaining the in-situ PM2.5 data
Real time data from:
1. EPA AirNow data for USA and Canada
2. EEA data for Europe
3. Tasmania and Australia
4. Israel
5. Russia
6. Asia and Latin America by scraping http://aqicn.org/map/
7. Harvesting social media (twitter feeds from US Embassies)
Relative low bandwidth from multiple sites every 5 minutes
Monday, August 11, 14
Challenge 2: (Easier)
Obtaining the Satellite & Meteorological Data
Real time data from:
1. Multiple satellites MODIS Terra, MODIS Aqua, SeaWIFS, VIIRS NPP etc
2. Global Meteorological Analyses
High bandwidth from few sites every 1 to 3 hours
Monday, August 11, 14
Challenge 3:
Combine multiple BigData Sets with Machine Learning
Large member machine learning ensemble using massively parallel computing
to produce PM2.5 data product
Algorithms capable of dealing with massive non-linear, non-parametric, non-
Gaussian multivariate datasets (13,000+ variables)
Drastically reduced development time by using a high level language (Matlab)
that can easily exploit parallel execution using both multiple CPUs and GPUs.
Massively parallel every 3 hours
High level language which can readily use CPUs and GPUs
Monday, August 11, 14
Challenge 4:
Continual Performance Improvement
Currently on around 400th version of system.
Have been making continuous improvements in:
1. Coverage of in-situ training data set
2. Inclusion of new satellite sensors
3. Additional BigData sets that help improve fidelity of the non-linear, non-
parametric, non-Gaussian multivariate machine learning fits
4. Using many alternative machine learning strategies
5. Estimate uncertainties.
6. This requires frequent reprocessing of the entire multi-year record from
1997-present
Persistent massive data storage, much more
than usual scratch space at HPC centers
Monday, August 11, 14
Fully Automated Workflow
Requires ability to schedule automated tasks
Monday, August 11, 14
Requires ability to disseminate results in multiple formats including
ftp and as web and map services
Monday, August 11, 14
Monday, August 11, 14
Monday, August 11, 14
Monday, August 11, 14
Monday, August 11, 14
Lake Eyre after a long dry period is a
region of high PM2.5 abundance.
Lake Eyre after heavy rains is a region of
lower PM2.5 abundance than usual
Monday, August 11, 14
04/04 04/09 04/14 04/19 04/24 04/29
0
10
20
30
40
50
60
70
80
90
100
April 2003
Monday, August 11, 14
04/04 04/09 04/14 04/19 04/24 04/29
0
10
20
30
40
50
60
70
80
90
100
April 2003
Monday, August 11, 14
Key System Requirements:
Not always available on current HPC systems
Requirements:
1. Large persistent storage for multiple BigData sets, 100TB+ (otherwise
before have had time to process the massive datasets the scratch space
time limit has expired)
2. High Bandwidth connections
3. Ability to harvest social media (e.g. twitter) and scrape web sites for data
4. High level language with wide range of optimized toolboxes, matlab
5. Algorithms capable of dealing with massive non-linear, non-parametric,
non-Gaussian multivariate datasets (13,000+ variables)
6. Easy to make use of multiple GPUs and CPUs
7. Ability to schedule tasks at precise times and time intervals to automate
workflows (in this case tasks executed at intervals of 5 minutes, 15 minutes,
1 hour, 3 hours, 1 day)
Monday, August 11, 14
THRIVETimely Health indicators using Remote sensing &
Innovation for the Vitality of the Environment
Prevention is better than cure
David.Lary@utdallas.edu
Address key societal issues
Monday, August 11, 14
41
VA Decision Support Tools
More Than 40 Data Products from In-situ Observations, NASA Earth Observations, Earth System
Models, Population Density & Emission Inventories
Personalized Alerts Dr. Watson
Staffing & Resource
Management
Machine Learning
Daily Global Air
Quality Estimates
NASA Earth
Observation Data
NASA Earth System
Model Products
Population Density and
Other Related Products
ER Admissions
All ICD Codes
All Prescriptions
Machine
Learning
Machine
Learning
THRIVE Medical
Environment Analytics
Engine
Monday, August 11, 14
Scenario Simulator
A US-Ignite Keystone Application
Monday, August 11, 14
Environmental Impact
Have the environmental conditions
for any day, anywhere on the planet
from 1997-present as a context and
simulate the likely health outcomes
Midday
Monday, August 11, 14
Environmental Impact
Have the environmental conditions
for any day, anywhere on the planet
from 1997-present as a context and
simulate the likely health outcomes
Midday
Monday, August 11, 14
June 27, 2012 July 21, 2012 September 14, 2012July 5, 2011
Set training in any time or place and retrieve the
actual environmental conditions, visibility, weather,
air borne particulates and simulate the health
outcomes. ALL driven by data.
Monday, August 11, 14
Water
The Motive
Do well with the Details by
embracing the Big Picture
Prof. David Lary
+1 (972) 489-2059
http://davidlary.info
david.lary@utdallas.edu
Monday, August 11, 14
Western U.S. Drought Prompts
Disaster Declarations In 11 States
By MICHELLE RINDELS 01/16/14 07:51 PM ET EST
LAS VEGAS (AP) — Federal officials have designated portions of 11 drought-
ridden western and central states as primary natural disaster areas,
highlighting the financial strain the lack of rain is likely to bring to farmers in
those regions.
The announcement by the U.S. Department of Agriculture on Wednesday
included counties in Colorado, New Mexico, Nevada, Kansas, Texas, Utah,
Arkansas, Hawaii, Idaho, Oklahoma and California.
Rancher Ralph Miller, 79, checks on one of many “stock tanks” of water that are
receding due to the severe drought. “I’d say it’s just about as bad as it can get.”
Barnhart, Texas
Monday, August 11, 14
“Water is the new oil”
Jim Rogers, chief executive of Duke Energy
... and many others
Water crisis in California, Texas threatens
US food security
Western water scarcity issues becoming more severe
Western Farm Press, Jun. 5, 2012
University of Texas at Austin
California and Texas produced agricultural products worth $56 billion
in 2007, accounting for much of the nation's food production. They
also account for half of all groundwater depletion in the U.S.,
mainly as a result of irrigating crops.
The nation’s food supply may be vulnerable to rapid groundwater
depletion from irrigated agriculture, according to a new study by
researchers at The University of Texas at Austin and elsewhere.
http://westernfarmpress.com/irrigation/water-crisis-california-texas-threatens-us-food-security
Monday, August 11, 14
Since 1980 the population
of Texas has more than
doubled, but the reservoir
capacity has remained
almost unchanged.
During 2011the reservoir
levels were the lowest
during Sep-Dec that they
have been since 1990.
In 2014 we are starting out
with lower levels than 2013.
Monday, August 11, 14
Smarter irrigation control is invaluable!
If we can use existing
infrastructure it is even better!
.... from farm, to corporate campus, to golf course, to your back yard.
Monday, August 11, 14
When great societal need meets
appropriate scalable solution
there is much societal and
economic benefit to be
gained
Monday, August 11, 14
How?
California Children Example
http://holistics3.com
Monday, August 11, 14
Monday, August 11, 14
DATE: 12-Feb-2010
DOC NO: 0115056
ISSUE: 02
DMC DATA PRODUCT MANUAL
STATUS: FINAL
Page 16 of 127
Figure 4: Detector and channel layout of the SLIM-6-22 imager
Imager Bank 0
Channel 6
Green
Channel 5
Red
Channel 4
NIR
Imager Bank 1
Channel 1
NIR
Channel 2
Red
Channel 3
Green
Pixel 1
Pixel 14436
Pixel 14436
Pixel 1
Monday, August 11, 14
20 lb Airborne hyperspectral imaging system
385 channels between 400-1,700 nm
Hyperspectral data cube
Monday, August 11, 14
Monday, August 11, 14
uneven irrigation
blown valves lead to flooding
Sports fields
agricultural test plots
22 m resolution
Monday, August 11, 14
On average, systems have water
losses of about 17 percent.
49
Monday, August 11, 14
Can you tell which grass has had more water?
Zooming in
Monday, August 11, 14
Neighborhood
Trees
‘green’
pond
golf
course
gated community
dry grass
Trees
Trees
Sports Field
Monday, August 11, 14
J S Famiglietti, and M Rodell Science 2013;340:1300-1301
an accuracy of 1.5 cm equivalent water height.
Because GRACE measures changes in
total water storage, it integrates the impacts
of natural climate fluctuations, global change,
and human water use, including groundwater
extraction, which in many parts of the world
is unmeasured and unmanaged. GRACE-
derived rates of groundwater losses in the
world’s major aquifer systems (4–6) under-
score the critical need to improve monitor-
ing and regulation of groundwater systems
before they run dry.
Regional flooding and drought are driven
by the surplus or deficit of water in a river
basin or an aquifer, yet few hydrologic
observing networks yield sufficient data for
comprehensive monitoring of changes in
the total amount of water stored in a region.
GRACE observations have helped to fill
this gap. They have been used to character-
ize regional flood potential (8) and to assess
water storage deficits in the U.S. Drought
Monitor (9) and are included in annual State
of the Climate reports (10). As an integrated
measure of all surface and groundwater stor-
age changes, GRACE data implicitly contain
a record of seasonal to interannual water stor-
age variations that can likely be exploited to
key tools for predicting future water avail-
ability, difficult to validate. Low-resolution
GRACE data, when combined with higher-
resolution model simulations, provide an
independent constraint on simulated water
balances, while also adding spatial detail to
GRACE’s low-resolution perspective (11).
They are widely used to evaluate land surface
models used by weather and climate forecast-
ing centers around the world (12).
Evapotranspiration is a key factor in
interbasin water allocations, yet because it
disperses into the atmosphere in the vapor
phase, it confounds standard measurement
techniques. The ability of GRACE to weigh
changes in water stored in an entire river
basin allows evapotranspiration to be esti-
mated in a water balance framework (13).
Transboundary water availability issues
require sharing hydrologic data across politi-
cal boundaries. However, national hydrolog-
ical records are often withheld for political,
socioeconomic, and defense purposes, com-
plicating regional water management discus-
sions. Several studies have used GRACE data
to circumvent international data denial prac-
tices, including in those involving lakes (14),
river basins (6), and aquifers (4, 6). Likewise,
higher spatial (<50,000 km ) and tempor
(weekly or biweekly) resolution, for exam
ple through novel orbital configurations, s
that smaller river basins and aquifers can b
observed directly.The availability of GRAC
data at these finer scales, at which most pla
ning decisions are made, would likely ensu
their broader use in water management.
The GRACE-FO mission is on sched
ule for a 2017 launch, but a next-generatio
improved GRACE mission is still und
design and as yet unconfirmed. Given i
demonstrated contributions to date and th
potential for much more, a future without
GRACE mission in orbit would be an unfo
tunate and unnecessarily risky backward ste
for regional water management.
References
1. P. J. Durack et al., Science 336, 455 (2012).
2. K. E. Trenberth, Clim. Res. 47, 123 (2011).
3. I. M. Held, B. J. Soden, J. Clim. 19, 5686 (2006).
4. V. M. Tiwari, J. Wahr, S. Swenson, Geophys. Res. Lett. 36,
L18401 (2009).
5. B. R. Scanlon et al., Proc. Natl. Acad. Sci. U.S.A. 109,
9320 (2012).
6. K. A. Voss et al., Water Resour. Res. 49, 904 (2013).
7. B. D. Tapley et al., Science 305, 503 (2004).
8. J. T. Reager, J. S. Famiglietti, Geophys. Res. Lett. 36,
L23402 (2009).
9. R. Houborg et al., Water Resour. Res. 48, W07525 (2012
10. J. Blunden, D. S. Arndt, Eds., Bull. Am. Meteorol. Soc. 9
S1 (2012).
11. B. F. Zaitchik et al., J. Hydrometeorol. 9, 535 (2008).
12. S. C. Swenson, P. C. D. Milly, Water Resour. Res. 42,
W03201 (2006).
13. G. Ramillien et al., Water Resour. Res. 42, W10403 (2006
14. S. Swenson, J. Wahr, J. Hydrol. 370, 163 (2009).
15. J. S. Famiglietti, Abstract GC31D-01, fall meeting, AGU
San Francisco, 3 to 7 December 2012.
Supplementary Materials
Mixed picture. Between 2003 and 2012, GRACE data show water losses in agricultural regions such as Cali-
fornia’s Central Valley (1) ( 1.5 ± 0.1 cm/year) and the Southern High Plains Aquifer (2) ( 2.5 ± 0.2 cm/
year), caused by overreliance on groundwater to supply irrigation water. Regions where groundwater is being
depleted as a result of prolonged drought include Houston (3) ( 2.3 ± 0.6 cm/year), Alabama (4) ( 2.1 ±
0.8 cm/year), and the Mid-Atlantic states (5) ( 1.8 ± 0.6 cm/year). Water storage is increasing in the flood-
prone Upper Missouri River basin (6) (2.5 ± 0.2 cm/year). See fig. S1 for monthly time series for all hot spots.
Data from (15) and from GRACE data release CSR RL05.
Monday, August 11, 14
Summary
• Vegetation Index is dependent on amount of
irrigation
• Regular (weekly) remote sensing inspection
could allow us to:
• Appropriate irrigation zones
• Help identify regions of over watering
• Help identify any burst pipes/valves
• Optimize irrigation patterns
• Automate sprinkler system controls
• Progressively more benefit as a specific
history of the plots/site is built up
Monday, August 11, 14
Stage 2
Monday, August 11, 14
FUTURE Water Management
Water Mgmt.
“Smart-GRID*”
Delivery
Models
Basin
Geodata
Water/Crop
Status & Forecast
Water Need
Status & Forecast
Water
Agric +Others Use
& Forecast
*Dept. of Energy 2013Alfonso Torres
Monday, August 11, 14
FUTURE Water Management
Why Agriculture? ~80% water use US (USDA 2013)
Challenges: Climate change, Drought, Population, non-ag water uses.
Water Use Efficiency: ~50% US (USDA 2004)
Water Mgmt.
“Smart-GRID*”
Delivery
Models
Basin
Geodata
Water/Crop
Status & Forecast
Water Need
Status & Forecast
Water
Agric +Others
Status & Forecast
Monday, August 11, 14
CURRENT Water Management
Current Water
Mgmt.
Delivery
Models
Basin
Geodata
Water/Crop
Status & Forecast
Water
Status & Forecast
Water
Agric +Others
Status & Forecast
Alfonso Torres
Monday, August 11, 14
Current Water
Mgmt.
Delivery
Models
Basin
Geodata
Water/Crop
Status & Forecast
Water
Status & Forecast
Water
Agric +Others
Status & Forecast
Water use based on:
Experience Limited estimations
No related info
CURRENT Water Management
Monday, August 11, 14
CWMIS Case Example: Water Use vs. Delivery
TOP: crop water use vs. water delivery (ac-ft).
BOTTOM: water use difference (ac-ft)
Typically save at least 10%
Can be done on a field by field, campus by campus, home by home,
or golf course by golf course basis or for an entire basin.
Alfonso Torres
Monday, August 11, 14
Culex tarsalis
West Nile Virus
The same data infrastructure can also
be used to help combat West Nile Virus
by identifying breeding sites.
Monday, August 11, 14
P. vivax is carried by the female Anopheles mosquito
Monday, August 11, 14
Plasmodium vivax is a protozoal parasite and a human
pathogen. The most frequent and widely distributed
cause of recurring (Benign tertian) malaria, P. vivax is
one of the six species of malaria parasites that
commonly infect humans.[1] It is less virulent than
Plasmodium falciparum, the deadliest of the six, but
vivax malaria can lead to severe disease and death.[2]
[3] P. vivax is carried by the female Anopheles mosquito,
since it is only the female of the species that bite.
Plasmodium vivax
Plasmodium falciparum http://www.worldmalariareport.org/
Monday, August 11, 14
Seasonal climatic suitability for malaria transmission (CSMT)
Climatic conditions are considered to be suitable for transmission when the monthly precipitation
accumulation is at least 80 mm, the monthly mean temperature is between 18°C and 32°C and the
monthly relative humidity is at least 60%. These thresholds are based on a consensus of the
literature. In practice, the optimal and limiting conditions for transmission are dependent on the
particular species of the parasite and vector.
Commentary: Web-based climate information resources for malaria control in Africa
Emily K Grover-Kopec, M Benno Blumenthal, Pietro Ceccato, Tufa Dinku, Judy A Omumbo and Stephen J Connor*
Malaria Journal 2006, 5:38 doi:10.1186/1475-2875-5-38
Monday, August 11, 14
Monday, August 11, 14
0 500 1,000 Km
Vectorial Capacity
In Zones with Malaria Epidemic Potential
05 August - 12 August 2013
VCAP Values
0
0 - 2
2 - 4
4 - 6
6 - 8
8 - 10
10 - 15
15 - 20
> 20
Country Boundaries
Monday, August 11, 14
Satellite imagery can be used to track mosquito habitats.
High-resolution (5 m) satellite images can identify
very small water bodies, wetlands and other
malaria-relevant land-cover types.
Of the 225 million annual reported
cases of the disease, 212 million of
these occur in Africa. Of the
800,000 Malaria-related deaths
each year, 90% of these fatalities
occur in sub-Saharan Africa.
http://www.itweb.co.za/index.php?option=com_content&view=article&id=52695
Monday, August 11, 14
US IgniteEnables
Innovative “Big Data” Application Development for an
Application Development Hub
!!
Don Hicks
Monday, August 11, 14

More Related Content

What's hot

Ecosystem science requirements for uas remote sensing
Ecosystem science requirements for uas remote sensing Ecosystem science requirements for uas remote sensing
Ecosystem science requirements for uas remote sensing bensparrowau
 
2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...
2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...
2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...Allen Day, PhD
 
Sensornets and Global Change
Sensornets and Global ChangeSensornets and Global Change
Sensornets and Global ChangeLarry Smarr
 
How can drone data be used in modelling?
How can drone data be used in modelling?How can drone data be used in modelling?
How can drone data be used in modelling?ARDC
 
Andy Hardy-Enfermedades transmitidas por vectores
Andy Hardy-Enfermedades transmitidas por vectoresAndy Hardy-Enfermedades transmitidas por vectores
Andy Hardy-Enfermedades transmitidas por vectoresFundación Ramón Areces
 
Pacific Research Platform Science Drivers
Pacific Research Platform Science DriversPacific Research Platform Science Drivers
Pacific Research Platform Science DriversLarry Smarr
 
The FiRe CTO Design Challenge: Wildfire Technology
The FiRe CTO Design Challenge: Wildfire TechnologyThe FiRe CTO Design Challenge: Wildfire Technology
The FiRe CTO Design Challenge: Wildfire TechnologyLarry Smarr
 
Pacific Wave and PRP Update Big News for Big Data
Pacific Wave and PRP Update Big News for Big DataPacific Wave and PRP Update Big News for Big Data
Pacific Wave and PRP Update Big News for Big DataLarry Smarr
 
Pacific Research Platform Supporting Earth Sciences
Pacific Research Platform Supporting Earth SciencesPacific Research Platform Supporting Earth Sciences
Pacific Research Platform Supporting Earth SciencesLarry Smarr
 
2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystems2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystemsTimeScience
 
GIS and GPS in plant pathology. vinay
GIS and GPS in plant pathology. vinayGIS and GPS in plant pathology. vinay
GIS and GPS in plant pathology. vinayvinay ju
 
 Gigapixel resolution imaging for near-remote sensing and phenomics
 Gigapixel resolution imaging for near-remote sensing and phenomics Gigapixel resolution imaging for near-remote sensing and phenomics
 Gigapixel resolution imaging for near-remote sensing and phenomicsTimeScience
 
Creating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIOCreating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIOLarry Smarr
 

What's hot (14)

Ecosystem science requirements for uas remote sensing
Ecosystem science requirements for uas remote sensing Ecosystem science requirements for uas remote sensing
Ecosystem science requirements for uas remote sensing
 
2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...
2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...
2014.06.30 - Renaissance in Medicine - Singapore Management University - Data...
 
Sensornets and Global Change
Sensornets and Global ChangeSensornets and Global Change
Sensornets and Global Change
 
How can drone data be used in modelling?
How can drone data be used in modelling?How can drone data be used in modelling?
How can drone data be used in modelling?
 
Andy Hardy-Enfermedades transmitidas por vectores
Andy Hardy-Enfermedades transmitidas por vectoresAndy Hardy-Enfermedades transmitidas por vectores
Andy Hardy-Enfermedades transmitidas por vectores
 
Pacific Research Platform Science Drivers
Pacific Research Platform Science DriversPacific Research Platform Science Drivers
Pacific Research Platform Science Drivers
 
The FiRe CTO Design Challenge: Wildfire Technology
The FiRe CTO Design Challenge: Wildfire TechnologyThe FiRe CTO Design Challenge: Wildfire Technology
The FiRe CTO Design Challenge: Wildfire Technology
 
Pacific Wave and PRP Update Big News for Big Data
Pacific Wave and PRP Update Big News for Big DataPacific Wave and PRP Update Big News for Big Data
Pacific Wave and PRP Update Big News for Big Data
 
Pacific Research Platform Supporting Earth Sciences
Pacific Research Platform Supporting Earth SciencesPacific Research Platform Supporting Earth Sciences
Pacific Research Platform Supporting Earth Sciences
 
2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystems2015 05 Scaling from seeds to ecosystems
2015 05 Scaling from seeds to ecosystems
 
GIS and GPS in plant pathology. vinay
GIS and GPS in plant pathology. vinayGIS and GPS in plant pathology. vinay
GIS and GPS in plant pathology. vinay
 
 Gigapixel resolution imaging for near-remote sensing and phenomics
 Gigapixel resolution imaging for near-remote sensing and phenomics Gigapixel resolution imaging for near-remote sensing and phenomics
 Gigapixel resolution imaging for near-remote sensing and phenomics
 
Creating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIOCreating a Science-Driven Big Data Superhighway for SIO
Creating a Science-Driven Big Data Superhighway for SIO
 
Space Weather Prediction - Next Steps: An industry and military perspective
Space Weather Prediction - Next Steps: An industry and military perspectiveSpace Weather Prediction - Next Steps: An industry and military perspective
Space Weather Prediction - Next Steps: An industry and military perspective
 

Similar to Machine Learning for Societal Applications

Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...
Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...
Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...US-Ignite
 
Deep learning for large scale biodiversity monitoring
Deep learning for large scale biodiversity monitoringDeep learning for large scale biodiversity monitoring
Deep learning for large scale biodiversity monitoringGreenapps&web
 
2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed Presentation2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed PresentationRudolf Husar
 
NextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National ArboretumNextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National ArboretumTimeScience
 
Improving access to geospatial Big Data in the hydrology domain
Improving access to geospatial Big Data in the hydrology domainImproving access to geospatial Big Data in the hydrology domain
Improving access to geospatial Big Data in the hydrology domainClaudia Vitolo
 
Article Detail 7 - Domestic Preparedness
Article Detail 7 - Domestic PreparednessArticle Detail 7 - Domestic Preparedness
Article Detail 7 - Domestic PreparednessDiana Hopkins
 
Sequencing Genomics: The New Big Data Driver
Sequencing Genomics:The New Big Data DriverSequencing Genomics:The New Big Data Driver
Sequencing Genomics: The New Big Data DriverLarry Smarr
 
Role of IT & Computer in Environment
Role of IT & Computer in EnvironmentRole of IT & Computer in Environment
Role of IT & Computer in EnvironmentNeil Mathew
 
Data accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphereData accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphereAlex Hardisty
 
Geoinformatics in agroecosystem research
Geoinformatics in agroecosystem researchGeoinformatics in agroecosystem research
Geoinformatics in agroecosystem researchFrancois Stepman
 
Promoting a Joint EU-BR Digital Future - High Performance Computing
Promoting a Joint EU-BR Digital Future - High Performance ComputingPromoting a Joint EU-BR Digital Future - High Performance Computing
Promoting a Joint EU-BR Digital Future - High Performance ComputingATMOSPHERE .
 
Estimating the Impact of Agriculture on the Environment of Catalunya by means...
Estimating the Impact of Agriculture on the Environment of Catalunya by means...Estimating the Impact of Agriculture on the Environment of Catalunya by means...
Estimating the Impact of Agriculture on the Environment of Catalunya by means...Andreas Kamilaris
 
Control on pollutation using Artifical intelligence
Control on pollutation using Artifical intelligence Control on pollutation using Artifical intelligence
Control on pollutation using Artifical intelligence Harshal Joshi
 
GOD SUPPORTS WIRELESS
GOD SUPPORTS WIRELESSGOD SUPPORTS WIRELESS
GOD SUPPORTS WIRELESSHAris-Aftab
 
The Physics Of Earth Atmospheric Co2 Concentration Essay
The Physics Of Earth Atmospheric Co2 Concentration EssayThe Physics Of Earth Atmospheric Co2 Concentration Essay
The Physics Of Earth Atmospheric Co2 Concentration EssayRochelle Schear
 
Building an Information Infrastructure to Support Microbial Metagenomic Sciences
Building an Information Infrastructure to Support Microbial Metagenomic SciencesBuilding an Information Infrastructure to Support Microbial Metagenomic Sciences
Building an Information Infrastructure to Support Microbial Metagenomic SciencesLarry Smarr
 

Similar to Machine Learning for Societal Applications (20)

Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...
Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...
Thrive:Timely Health Indicators Using Remote Sensing & innovation for the Vit...
 
Deep learning for large scale biodiversity monitoring
Deep learning for large scale biodiversity monitoringDeep learning for large scale biodiversity monitoring
Deep learning for large scale biodiversity monitoring
 
2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed Presentation2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed Presentation
 
1. GRID COMPUTING
1. GRID COMPUTING1. GRID COMPUTING
1. GRID COMPUTING
 
NextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National ArboretumNextGen environmental sensing at the National Arboretum
NextGen environmental sensing at the National Arboretum
 
Improving access to geospatial Big Data in the hydrology domain
Improving access to geospatial Big Data in the hydrology domainImproving access to geospatial Big Data in the hydrology domain
Improving access to geospatial Big Data in the hydrology domain
 
Article Detail 7 - Domestic Preparedness
Article Detail 7 - Domestic PreparednessArticle Detail 7 - Domestic Preparedness
Article Detail 7 - Domestic Preparedness
 
Research on Blue Waters
Research on Blue WatersResearch on Blue Waters
Research on Blue Waters
 
Sequencing Genomics: The New Big Data Driver
Sequencing Genomics:The New Big Data DriverSequencing Genomics:The New Big Data Driver
Sequencing Genomics: The New Big Data Driver
 
Role of IT & Computer in Environment
Role of IT & Computer in EnvironmentRole of IT & Computer in Environment
Role of IT & Computer in Environment
 
Data accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphereData accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphere
 
Geoinformatics in agroecosystem research
Geoinformatics in agroecosystem researchGeoinformatics in agroecosystem research
Geoinformatics in agroecosystem research
 
land health surveillance highlights
land health surveillance highlightsland health surveillance highlights
land health surveillance highlights
 
AgroweatherTools
AgroweatherToolsAgroweatherTools
AgroweatherTools
 
Promoting a Joint EU-BR Digital Future - High Performance Computing
Promoting a Joint EU-BR Digital Future - High Performance ComputingPromoting a Joint EU-BR Digital Future - High Performance Computing
Promoting a Joint EU-BR Digital Future - High Performance Computing
 
Estimating the Impact of Agriculture on the Environment of Catalunya by means...
Estimating the Impact of Agriculture on the Environment of Catalunya by means...Estimating the Impact of Agriculture on the Environment of Catalunya by means...
Estimating the Impact of Agriculture on the Environment of Catalunya by means...
 
Control on pollutation using Artifical intelligence
Control on pollutation using Artifical intelligence Control on pollutation using Artifical intelligence
Control on pollutation using Artifical intelligence
 
GOD SUPPORTS WIRELESS
GOD SUPPORTS WIRELESSGOD SUPPORTS WIRELESS
GOD SUPPORTS WIRELESS
 
The Physics Of Earth Atmospheric Co2 Concentration Essay
The Physics Of Earth Atmospheric Co2 Concentration EssayThe Physics Of Earth Atmospheric Co2 Concentration Essay
The Physics Of Earth Atmospheric Co2 Concentration Essay
 
Building an Information Infrastructure to Support Microbial Metagenomic Sciences
Building an Information Infrastructure to Support Microbial Metagenomic SciencesBuilding an Information Infrastructure to Support Microbial Metagenomic Sciences
Building an Information Infrastructure to Support Microbial Metagenomic Sciences
 

More from David Lary

The West Africa-America Chamber of Commerce & Industries presents: Big Data &...
The West Africa-America Chamber of Commerce & Industries presents: Big Data &...The West Africa-America Chamber of Commerce & Industries presents: Big Data &...
The West Africa-America Chamber of Commerce & Industries presents: Big Data &...David Lary
 
The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...
The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...
The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...David Lary
 
The West Africa-America Chamber of Commerce & Industries presents:
The West Africa-America Chamber of Commerce & Industries presents: The West Africa-America Chamber of Commerce & Industries presents:
The West Africa-America Chamber of Commerce & Industries presents: David Lary
 
West Africa-America Chamber of Commerce & Industries: E mist
West Africa-America Chamber of Commerce & Industries: E mistWest Africa-America Chamber of Commerce & Industries: E mist
West Africa-America Chamber of Commerce & Industries: E mistDavid Lary
 
Big Data & Machine Learning for Societal Benefit
Big Data & Machine Learning for Societal BenefitBig Data & Machine Learning for Societal Benefit
Big Data & Machine Learning for Societal BenefitDavid Lary
 

More from David Lary (6)

The West Africa-America Chamber of Commerce & Industries presents: Big Data &...
The West Africa-America Chamber of Commerce & Industries presents: Big Data &...The West Africa-America Chamber of Commerce & Industries presents: Big Data &...
The West Africa-America Chamber of Commerce & Industries presents: Big Data &...
 
The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...
The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...
The West Africa-America Chamber of Commerce & Industries presents: Sub sahara...
 
The West Africa-America Chamber of Commerce & Industries presents:
The West Africa-America Chamber of Commerce & Industries presents: The West Africa-America Chamber of Commerce & Industries presents:
The West Africa-America Chamber of Commerce & Industries presents:
 
West Africa-America Chamber of Commerce & Industries: E mist
West Africa-America Chamber of Commerce & Industries: E mistWest Africa-America Chamber of Commerce & Industries: E mist
West Africa-America Chamber of Commerce & Industries: E mist
 
Big Data & Machine Learning for Societal Benefit
Big Data & Machine Learning for Societal BenefitBig Data & Machine Learning for Societal Benefit
Big Data & Machine Learning for Societal Benefit
 
Why geni
Why geniWhy geni
Why geni
 

Recently uploaded

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 

Recently uploaded (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 

Machine Learning for Societal Applications

  • 1. Machine Learning for Societal Applications 2 Monday, August 11, 14
  • 2. Satellite Observations Meteorological Analyses Population Density In-situ observationsSocial Media Combined Using Machine Learning to Provide a High-Resolution Global Products Combined with Electronic Health Records to provide: 1. Real time personal health alerts 2. Physician Decision Support Tools 3. Logistical Planning for Emergency Rooms 4. Improved Policy Decisions Next Generation of High Speed Networks to Facilitate the Next Generation of Proactive Smart Health Care Applications Veteran’s Administration Country’s Largest Health Care Provider Requires ultra-low latency gigabit to the end user Local cloud computing coupled with widely distributed national and global sensor networks Multiple global high-resolution datasets Prof. David Lary Monday, August 11, 14
  • 3. Next Generation of High Speed Low latency Networks to Facilitate the Next Generation of Smart Fire Detection & Water Conservation Applications Requires ultra-low latency wireless gigabit for very-high resolution hyperspectral video imagery for real time flight control of aerial vehicles 11 drought-ridden western and central states have just been declared as primary natural disaster areas seriously threatening US food security. Further, every year between $1 and $2 billion dollars are spent on fire suppression costs alone. A fleet of low cost aerial vehicles working together autonomously utilizing uncompressed very-high resolution hyperspectral video imagery.The geo-tagged imagery is streamed using high-speed low-latency wireless networks to communicate to a powerful cloud computing cluster running machine learning and image processing algorithms for real time direction of the optimal flight patterns, and the delivery of early warning for timely interventions. Fire: Appropriate preemptive fire prevention can lead to massive savings in fire control costs, loss of life, and property damage. Agriculture: Appropriate and timely early warning of crop infestations, infections and/or water stress can prevent massive avoidable losses. Prof. David Lary 20 lb Airborne 385 channel hyperspectral imaging system Monday, August 11, 14
  • 4. Next Generation of High Speed Networks to Facilitate the Next Generation of Smart Water Management Applications With Drought Disaster Declarations in 11 western and central states, smart water management is now more critical than ever for sustainable water conservation and US Food Security. Coupling high resolution remote sensing from satellites, with machine learning, and the next generation of high speed low latency networks is facilitating the next generation of smart water management systems. These systems will benefit individual home owners, farmers, corporate campuses, golf courses, etc. and allow optimum monitoring and control of irrigation using mobile devices. Sports fields blown valves lead to flooding uneven irrigation Prof. David Lary Monday, August 11, 14
  • 6. Unprecedented levels of air pollution in Singapore and Malaysia in June led to respiratory illnesses, school closings, and grounded aircraft.  This year it was so bad that in some affected areas there was a 100 percent rise in the number of asthma cases, and the government of Malaysia distributed gas masks. MODIS Aqua July 21, 2013. David Lary Monday, August 11, 14
  • 7. Air pollution in Ulaanbaatar, Mongolia Monday, August 11, 14
  • 9. This is a BigData Problem of Great Societal Relevance • Collecting data in real time from national and global networks requires bandwidth. • With the next generation of wearable sensors and the internet of things this data volume will rapidly increase. • A variety of applications enabled by BigData, higher bandwidth and cloud processing. • Future finer granularity and two way communication will dramatically increase the size of the data bringing air quality to the micro scale, just like weather data. Time Taken 10 Mbps 20 Mbps 50 Mbps 1 Gbps 40 TB training data 4 Gb update 185 days 93 days 37 days 1 day 21 hours 54m 27m 11m 32s Monday, August 11, 14
  • 10. Think Big: Holistic & Comprehensive Informatics Bio'Informa$cs Medical'Informa$cs Environmental'Informa$cs THRIVE Mul$ple'Big'Data'+'EMR'+'Social'Media'+'Machine'Learning'+'Causality A'Cross=cu>ng'Pla@orm'for'Comprehensive'Informa$cs'for'Data*Driven*Decisions'in'Pa4ent* Centered*Care'facilitated'by'High%Speed%Low-Latency%networks,'mul$ple'massive'datasets'from' large'distributed'sensor'networks,'EMR,'and'local%cloud%compu:ng. Monday, August 11, 14
  • 12. Using Multiple Big Datasets and Machine Learning to Produce a New Global Particulate Dataset A Technology Challenge Case Study David Lary Hanson Center for Space Science University of Texas at Dallas Monday, August 11, 14
  • 14. TypesofbiologicalMaterialTypesofDustTypesofParticulatesGasMolecules 0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm Pollen Mold Spores House Dust Mite Allergens Bacteria Cat Allergens Viruses Heavy Dust Settling Dust Suspended Atmospheric Dust Cement Dust Fly Ash Oil Smoke Smog Tobacco Smoke Soot Gas Molecules Decreased Lung Function < 10 μm Skin & Eye Disease < 2.5 μm Tumors < 1 μm Cardiovascular Disease < 0.1 μm Hair Pin Cell 0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm PM10 particles PM2.5 particles PM0.1 ultra fine particles PM10-2.5 coarse fraction 0.1 mm 1 mm Monday, August 11, 14
  • 15. TypesofbiologicalMaterialTypesofDustTypesofParticulatesGasMolecules 0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm Pollen Mold Spores House Dust Mite Allergens Bacteria Cat Allergens Viruses Heavy Dust Settling Dust Suspended Atmospheric Dust Cement Dust Fly Ash Oil Smoke Smog Tobacco Smoke Soot Gas Molecules Decreased Lung Function < 10 μm Skin & Eye Disease < 2.5 μm Tumors < 1 μm Cardiovascular Disease < 0.1 μm Hair Pin Cell 0.0001 μm 0.001 μm 0.01 μm 0.1 μm 1 μm 10 μm 100 μm 1000 μm PM10 particles PM2.5 particles PM0.1 ultra fine particles PM10-2.5 coarse fraction 0.1 mm 1 mm Table!1.!PM!and!health!outcomes!(modified!from!Ruckerl*et*al.!(2006)).! !! Health*Outcomes! Short9term*Studies* Long9term*Studies* PM10! PM2.5! UFP! PM10! PM2.5! UFP! Mortality* !! !! !! !! !! !! !!!!All!causes! xxx!! xxx!! x! xx! xx! x! !!!!Cardiovascular! xxx! xxx! x!! xx! xx! x! !!!!Pulmonary! xxx! xxx! x! xx! xx! x! Pulmonary!effects! !! !! !! !! !! !! !!!!Lung!function,!e.g.,!PEF! xxx! xxx! xx! xxx! xxx! !! !!!!Lung!function!growth! !! !! !! xxx! xxx! !! Asthma!and!COPD!exacerbation! !! !! !! !! !! !! !!!!Acute!respiratory!symptoms! !! xx! x! xxx! xxx! !! !!!!Medication!use! !! !! x! !! !! !! !!!!Hospital!admission! xx! xxx! x! !! !! !! Lung!cancer! !! !! !! !! !! !! !!!!Cohort! !! !! !! xx! xx! x! !!!!Hospital!admission! !! !! !! xx! xx! x! Cardiovascular!effects! !! !! !! !! !! !! !!!!Hospital!admission! xxx! xxx! !! x! x! !! ECG@related!endpoints! !! !! !! !! !! !! !!!!Autonomic!nervous!system! xxx! xxx! xx! !! !! !! !!!!Myocardial!substrate!and!vulnerability! !! xx! x! !! !! !! Vascular!function! !! !! !! !! !! !! !!!!Blood!pressure! xx! xxx! x! !! !! !! !!!!Endothelial!function! x! xx! x! !! !! !! Blood!markers! !! !! !! !! !! !! !!!!Pro!inflammatory!mediators! xx! xx! xx! !! !! !! !!!!Coagulation!blood!markers! xx! xx! xx! !! !! !! !!!!Diabetes! x! xx! x! !! !! !! !!!!Endothelial!function! x! x! xx! !! !! !! Reproduction! !! !! !! !! !! !! !!!!Premature!birth! x! x! !! !! !! !! !!!!Birth!weight! xx! x! !! !! !! !! !!!!IUR/SGA! x! x! !! !! !! !! Fetal!growth! !! !! !! !! !! !! !!!!Birth!defects! x! !! !! !! !! !! !!!!Infant!mortality! xx! x! !! !! !! !! !!!!Sperm!quality! x! x! !! !! !! !! Neurotoxic!effects! !! !! !! !! !! !! !!!!Central!nervous!system!! !! x! xx! !! !! !! x, few studies; xx, many studies; xxx, large number of studies. Why? Monday, August 11, 14
  • 17. How? Used around 40 different BigData sets from satellites, meteorology, demographics, scraped web-sites and social media to estimate PM2.5. Plot below shows the average of 5,935 days from August 1, 1997 to the present. Monday, August 11, 14
  • 18. Which Platform? Requirements: 1. Large persistent storage for multiple BigData sets, 100TB+ (otherwise before have had time to process the massive datasets the scratch space time limit has expired) 2. High Bandwidth connections 3. Ability to harvest social media (e.g. twitter) and scrape web sites for data 4. High level language with wide range of optimized toolboxes, matlab 5. Algorithms capable of dealing with massive non-linear, non-parametric, non-Gaussian multivariate datasets (13,000+ variables) 6. Easy to make use of multiple GPUs and CPUs 7. Ability to schedule tasks at precise times and time intervals to automate workflows (in this case tasks executed at intervals of 5 minutes, 15 minutes, 1 hour, 3 hours, 1 day) Monday, August 11, 14
  • 21. Terra DeepBlue Rank Source Variable Type 1 Population Density Input 2 Satellite Product Tropospheric NO2 Column Input 3 Meteorological Analyses Surface Specific Humidity Input 4 Satellite Product Solar Azimuth Input 5 Meteorological Analyses Surface Wind Speed Input 6 Satellite Product White-sky Albedo at 2,130 nm Input 7 Satellite Product White-sky Albedo at 555 nm Input 8 Meteorological Analyses Surface Air Temperature Input 9 Meteorological Analyses Surface Layer Height Input 10 Meteorological Analyses Surface Ventilation Velocity Input 11 Meteorological Analyses Total Precipitation Input 12 Satellite Product Solar Zenith Input 13 Meteorological Analyses Air Density at Surface Input 14 Satellite Product Cloud Mask Qa Input 15 Satellite Product Deep Blue Aerosol Optical Depth 470 nm Input 16 Satellite Product Sensor Zenith Input 17 Satellite Product White-sky Albedo at 858 nm Input 18 Meteorological Analyses Surface Velocity Scale Input 19 Satellite Product White-sky Albedo at 470 nm Input 20 Satellite Product Deep Blue Angstrom Exponent Land Input 21 Satellite Product White-sky Albedo at 1,240 nm Input 22 Satellite Product Scattering Angle Input 23 Satellite Product Sensor Azimuth Input 24 Satellite Product Deep Blue Surface Reflectance 412 nm Input 25 Satellite Product White-sky Albedo at 1,640 nm Input 26 Satellite Product Deep Blue Aerosol Optical Depth 660 nm Input 27 Satellite Product White-sky Albedo at 648 nm Input 28 Satellite Product Deep Blue Surface Reflectance 660 nm Input 29 Satellite Product Cloud Fraction Land Input 30 Satellite Product Deep Blue Surface Reflectance 470 nm Input 31 Satellite Product Deep Blue Aerosol Optical Depth 550 nm Input 32 Satellite Product Deep Blue Aerosol Optical Depth 412 nm Input In-situ Observation PM2.5 Target Monday, August 11, 14
  • 23. Hourly Measurements from 55 countries and more than 8,000 measurement sites from 1997-present A lot of measurements, but notice the large gaps! Monday, August 11, 14
  • 24. Gaps are inevitable because of the infrastructure and cost associated with making the measurements. Hourly Measurements from 55 countries and more than 8,000 measurement sites from 1997-present Monday, August 11, 14
  • 25. Challenge 1: Obtaining the in-situ PM2.5 data Real time data from: 1. EPA AirNow data for USA and Canada 2. EEA data for Europe 3. Tasmania and Australia 4. Israel 5. Russia 6. Asia and Latin America by scraping http://aqicn.org/map/ 7. Harvesting social media (twitter feeds from US Embassies) Relative low bandwidth from multiple sites every 5 minutes Monday, August 11, 14
  • 26. Challenge 2: (Easier) Obtaining the Satellite & Meteorological Data Real time data from: 1. Multiple satellites MODIS Terra, MODIS Aqua, SeaWIFS, VIIRS NPP etc 2. Global Meteorological Analyses High bandwidth from few sites every 1 to 3 hours Monday, August 11, 14
  • 27. Challenge 3: Combine multiple BigData Sets with Machine Learning Large member machine learning ensemble using massively parallel computing to produce PM2.5 data product Algorithms capable of dealing with massive non-linear, non-parametric, non- Gaussian multivariate datasets (13,000+ variables) Drastically reduced development time by using a high level language (Matlab) that can easily exploit parallel execution using both multiple CPUs and GPUs. Massively parallel every 3 hours High level language which can readily use CPUs and GPUs Monday, August 11, 14
  • 28. Challenge 4: Continual Performance Improvement Currently on around 400th version of system. Have been making continuous improvements in: 1. Coverage of in-situ training data set 2. Inclusion of new satellite sensors 3. Additional BigData sets that help improve fidelity of the non-linear, non- parametric, non-Gaussian multivariate machine learning fits 4. Using many alternative machine learning strategies 5. Estimate uncertainties. 6. This requires frequent reprocessing of the entire multi-year record from 1997-present Persistent massive data storage, much more than usual scratch space at HPC centers Monday, August 11, 14
  • 29. Fully Automated Workflow Requires ability to schedule automated tasks Monday, August 11, 14
  • 30. Requires ability to disseminate results in multiple formats including ftp and as web and map services Monday, August 11, 14
  • 35. Lake Eyre after a long dry period is a region of high PM2.5 abundance. Lake Eyre after heavy rains is a region of lower PM2.5 abundance than usual Monday, August 11, 14
  • 36. 04/04 04/09 04/14 04/19 04/24 04/29 0 10 20 30 40 50 60 70 80 90 100 April 2003 Monday, August 11, 14
  • 37. 04/04 04/09 04/14 04/19 04/24 04/29 0 10 20 30 40 50 60 70 80 90 100 April 2003 Monday, August 11, 14
  • 38. Key System Requirements: Not always available on current HPC systems Requirements: 1. Large persistent storage for multiple BigData sets, 100TB+ (otherwise before have had time to process the massive datasets the scratch space time limit has expired) 2. High Bandwidth connections 3. Ability to harvest social media (e.g. twitter) and scrape web sites for data 4. High level language with wide range of optimized toolboxes, matlab 5. Algorithms capable of dealing with massive non-linear, non-parametric, non-Gaussian multivariate datasets (13,000+ variables) 6. Easy to make use of multiple GPUs and CPUs 7. Ability to schedule tasks at precise times and time intervals to automate workflows (in this case tasks executed at intervals of 5 minutes, 15 minutes, 1 hour, 3 hours, 1 day) Monday, August 11, 14
  • 39. THRIVETimely Health indicators using Remote sensing & Innovation for the Vitality of the Environment Prevention is better than cure David.Lary@utdallas.edu Address key societal issues Monday, August 11, 14
  • 40. 41 VA Decision Support Tools More Than 40 Data Products from In-situ Observations, NASA Earth Observations, Earth System Models, Population Density & Emission Inventories Personalized Alerts Dr. Watson Staffing & Resource Management Machine Learning Daily Global Air Quality Estimates NASA Earth Observation Data NASA Earth System Model Products Population Density and Other Related Products ER Admissions All ICD Codes All Prescriptions Machine Learning Machine Learning THRIVE Medical Environment Analytics Engine Monday, August 11, 14
  • 41. Scenario Simulator A US-Ignite Keystone Application Monday, August 11, 14
  • 42. Environmental Impact Have the environmental conditions for any day, anywhere on the planet from 1997-present as a context and simulate the likely health outcomes Midday Monday, August 11, 14
  • 43. Environmental Impact Have the environmental conditions for any day, anywhere on the planet from 1997-present as a context and simulate the likely health outcomes Midday Monday, August 11, 14
  • 44. June 27, 2012 July 21, 2012 September 14, 2012July 5, 2011 Set training in any time or place and retrieve the actual environmental conditions, visibility, weather, air borne particulates and simulate the health outcomes. ALL driven by data. Monday, August 11, 14
  • 45. Water The Motive Do well with the Details by embracing the Big Picture Prof. David Lary +1 (972) 489-2059 http://davidlary.info david.lary@utdallas.edu Monday, August 11, 14
  • 46. Western U.S. Drought Prompts Disaster Declarations In 11 States By MICHELLE RINDELS 01/16/14 07:51 PM ET EST LAS VEGAS (AP) — Federal officials have designated portions of 11 drought- ridden western and central states as primary natural disaster areas, highlighting the financial strain the lack of rain is likely to bring to farmers in those regions. The announcement by the U.S. Department of Agriculture on Wednesday included counties in Colorado, New Mexico, Nevada, Kansas, Texas, Utah, Arkansas, Hawaii, Idaho, Oklahoma and California. Rancher Ralph Miller, 79, checks on one of many “stock tanks” of water that are receding due to the severe drought. “I’d say it’s just about as bad as it can get.” Barnhart, Texas Monday, August 11, 14
  • 47. “Water is the new oil” Jim Rogers, chief executive of Duke Energy ... and many others Water crisis in California, Texas threatens US food security Western water scarcity issues becoming more severe Western Farm Press, Jun. 5, 2012 University of Texas at Austin California and Texas produced agricultural products worth $56 billion in 2007, accounting for much of the nation's food production. They also account for half of all groundwater depletion in the U.S., mainly as a result of irrigating crops. The nation’s food supply may be vulnerable to rapid groundwater depletion from irrigated agriculture, according to a new study by researchers at The University of Texas at Austin and elsewhere. http://westernfarmpress.com/irrigation/water-crisis-california-texas-threatens-us-food-security Monday, August 11, 14
  • 48. Since 1980 the population of Texas has more than doubled, but the reservoir capacity has remained almost unchanged. During 2011the reservoir levels were the lowest during Sep-Dec that they have been since 1990. In 2014 we are starting out with lower levels than 2013. Monday, August 11, 14
  • 49. Smarter irrigation control is invaluable! If we can use existing infrastructure it is even better! .... from farm, to corporate campus, to golf course, to your back yard. Monday, August 11, 14
  • 50. When great societal need meets appropriate scalable solution there is much societal and economic benefit to be gained Monday, August 11, 14
  • 53. DATE: 12-Feb-2010 DOC NO: 0115056 ISSUE: 02 DMC DATA PRODUCT MANUAL STATUS: FINAL Page 16 of 127 Figure 4: Detector and channel layout of the SLIM-6-22 imager Imager Bank 0 Channel 6 Green Channel 5 Red Channel 4 NIR Imager Bank 1 Channel 1 NIR Channel 2 Red Channel 3 Green Pixel 1 Pixel 14436 Pixel 14436 Pixel 1 Monday, August 11, 14
  • 54. 20 lb Airborne hyperspectral imaging system 385 channels between 400-1,700 nm Hyperspectral data cube Monday, August 11, 14
  • 56. uneven irrigation blown valves lead to flooding Sports fields agricultural test plots 22 m resolution Monday, August 11, 14
  • 57. On average, systems have water losses of about 17 percent. 49 Monday, August 11, 14
  • 58. Can you tell which grass has had more water? Zooming in Monday, August 11, 14
  • 60. J S Famiglietti, and M Rodell Science 2013;340:1300-1301 an accuracy of 1.5 cm equivalent water height. Because GRACE measures changes in total water storage, it integrates the impacts of natural climate fluctuations, global change, and human water use, including groundwater extraction, which in many parts of the world is unmeasured and unmanaged. GRACE- derived rates of groundwater losses in the world’s major aquifer systems (4–6) under- score the critical need to improve monitor- ing and regulation of groundwater systems before they run dry. Regional flooding and drought are driven by the surplus or deficit of water in a river basin or an aquifer, yet few hydrologic observing networks yield sufficient data for comprehensive monitoring of changes in the total amount of water stored in a region. GRACE observations have helped to fill this gap. They have been used to character- ize regional flood potential (8) and to assess water storage deficits in the U.S. Drought Monitor (9) and are included in annual State of the Climate reports (10). As an integrated measure of all surface and groundwater stor- age changes, GRACE data implicitly contain a record of seasonal to interannual water stor- age variations that can likely be exploited to key tools for predicting future water avail- ability, difficult to validate. Low-resolution GRACE data, when combined with higher- resolution model simulations, provide an independent constraint on simulated water balances, while also adding spatial detail to GRACE’s low-resolution perspective (11). They are widely used to evaluate land surface models used by weather and climate forecast- ing centers around the world (12). Evapotranspiration is a key factor in interbasin water allocations, yet because it disperses into the atmosphere in the vapor phase, it confounds standard measurement techniques. The ability of GRACE to weigh changes in water stored in an entire river basin allows evapotranspiration to be esti- mated in a water balance framework (13). Transboundary water availability issues require sharing hydrologic data across politi- cal boundaries. However, national hydrolog- ical records are often withheld for political, socioeconomic, and defense purposes, com- plicating regional water management discus- sions. Several studies have used GRACE data to circumvent international data denial prac- tices, including in those involving lakes (14), river basins (6), and aquifers (4, 6). Likewise, higher spatial (<50,000 km ) and tempor (weekly or biweekly) resolution, for exam ple through novel orbital configurations, s that smaller river basins and aquifers can b observed directly.The availability of GRAC data at these finer scales, at which most pla ning decisions are made, would likely ensu their broader use in water management. The GRACE-FO mission is on sched ule for a 2017 launch, but a next-generatio improved GRACE mission is still und design and as yet unconfirmed. Given i demonstrated contributions to date and th potential for much more, a future without GRACE mission in orbit would be an unfo tunate and unnecessarily risky backward ste for regional water management. References 1. P. J. Durack et al., Science 336, 455 (2012). 2. K. E. Trenberth, Clim. Res. 47, 123 (2011). 3. I. M. Held, B. J. Soden, J. Clim. 19, 5686 (2006). 4. V. M. Tiwari, J. Wahr, S. Swenson, Geophys. Res. Lett. 36, L18401 (2009). 5. B. R. Scanlon et al., Proc. Natl. Acad. Sci. U.S.A. 109, 9320 (2012). 6. K. A. Voss et al., Water Resour. Res. 49, 904 (2013). 7. B. D. Tapley et al., Science 305, 503 (2004). 8. J. T. Reager, J. S. Famiglietti, Geophys. Res. Lett. 36, L23402 (2009). 9. R. Houborg et al., Water Resour. Res. 48, W07525 (2012 10. J. Blunden, D. S. Arndt, Eds., Bull. Am. Meteorol. Soc. 9 S1 (2012). 11. B. F. Zaitchik et al., J. Hydrometeorol. 9, 535 (2008). 12. S. C. Swenson, P. C. D. Milly, Water Resour. Res. 42, W03201 (2006). 13. G. Ramillien et al., Water Resour. Res. 42, W10403 (2006 14. S. Swenson, J. Wahr, J. Hydrol. 370, 163 (2009). 15. J. S. Famiglietti, Abstract GC31D-01, fall meeting, AGU San Francisco, 3 to 7 December 2012. Supplementary Materials Mixed picture. Between 2003 and 2012, GRACE data show water losses in agricultural regions such as Cali- fornia’s Central Valley (1) ( 1.5 ± 0.1 cm/year) and the Southern High Plains Aquifer (2) ( 2.5 ± 0.2 cm/ year), caused by overreliance on groundwater to supply irrigation water. Regions where groundwater is being depleted as a result of prolonged drought include Houston (3) ( 2.3 ± 0.6 cm/year), Alabama (4) ( 2.1 ± 0.8 cm/year), and the Mid-Atlantic states (5) ( 1.8 ± 0.6 cm/year). Water storage is increasing in the flood- prone Upper Missouri River basin (6) (2.5 ± 0.2 cm/year). See fig. S1 for monthly time series for all hot spots. Data from (15) and from GRACE data release CSR RL05. Monday, August 11, 14
  • 61. Summary • Vegetation Index is dependent on amount of irrigation • Regular (weekly) remote sensing inspection could allow us to: • Appropriate irrigation zones • Help identify regions of over watering • Help identify any burst pipes/valves • Optimize irrigation patterns • Automate sprinkler system controls • Progressively more benefit as a specific history of the plots/site is built up Monday, August 11, 14
  • 63. FUTURE Water Management Water Mgmt. “Smart-GRID*” Delivery Models Basin Geodata Water/Crop Status & Forecast Water Need Status & Forecast Water Agric +Others Use & Forecast *Dept. of Energy 2013Alfonso Torres Monday, August 11, 14
  • 64. FUTURE Water Management Why Agriculture? ~80% water use US (USDA 2013) Challenges: Climate change, Drought, Population, non-ag water uses. Water Use Efficiency: ~50% US (USDA 2004) Water Mgmt. “Smart-GRID*” Delivery Models Basin Geodata Water/Crop Status & Forecast Water Need Status & Forecast Water Agric +Others Status & Forecast Monday, August 11, 14
  • 65. CURRENT Water Management Current Water Mgmt. Delivery Models Basin Geodata Water/Crop Status & Forecast Water Status & Forecast Water Agric +Others Status & Forecast Alfonso Torres Monday, August 11, 14
  • 66. Current Water Mgmt. Delivery Models Basin Geodata Water/Crop Status & Forecast Water Status & Forecast Water Agric +Others Status & Forecast Water use based on: Experience Limited estimations No related info CURRENT Water Management Monday, August 11, 14
  • 67. CWMIS Case Example: Water Use vs. Delivery TOP: crop water use vs. water delivery (ac-ft). BOTTOM: water use difference (ac-ft) Typically save at least 10% Can be done on a field by field, campus by campus, home by home, or golf course by golf course basis or for an entire basin. Alfonso Torres Monday, August 11, 14
  • 68. Culex tarsalis West Nile Virus The same data infrastructure can also be used to help combat West Nile Virus by identifying breeding sites. Monday, August 11, 14
  • 69. P. vivax is carried by the female Anopheles mosquito Monday, August 11, 14
  • 70. Plasmodium vivax is a protozoal parasite and a human pathogen. The most frequent and widely distributed cause of recurring (Benign tertian) malaria, P. vivax is one of the six species of malaria parasites that commonly infect humans.[1] It is less virulent than Plasmodium falciparum, the deadliest of the six, but vivax malaria can lead to severe disease and death.[2] [3] P. vivax is carried by the female Anopheles mosquito, since it is only the female of the species that bite. Plasmodium vivax Plasmodium falciparum http://www.worldmalariareport.org/ Monday, August 11, 14
  • 71. Seasonal climatic suitability for malaria transmission (CSMT) Climatic conditions are considered to be suitable for transmission when the monthly precipitation accumulation is at least 80 mm, the monthly mean temperature is between 18°C and 32°C and the monthly relative humidity is at least 60%. These thresholds are based on a consensus of the literature. In practice, the optimal and limiting conditions for transmission are dependent on the particular species of the parasite and vector. Commentary: Web-based climate information resources for malaria control in Africa Emily K Grover-Kopec, M Benno Blumenthal, Pietro Ceccato, Tufa Dinku, Judy A Omumbo and Stephen J Connor* Malaria Journal 2006, 5:38 doi:10.1186/1475-2875-5-38 Monday, August 11, 14
  • 73. 0 500 1,000 Km Vectorial Capacity In Zones with Malaria Epidemic Potential 05 August - 12 August 2013 VCAP Values 0 0 - 2 2 - 4 4 - 6 6 - 8 8 - 10 10 - 15 15 - 20 > 20 Country Boundaries Monday, August 11, 14
  • 74. Satellite imagery can be used to track mosquito habitats. High-resolution (5 m) satellite images can identify very small water bodies, wetlands and other malaria-relevant land-cover types. Of the 225 million annual reported cases of the disease, 212 million of these occur in Africa. Of the 800,000 Malaria-related deaths each year, 90% of these fatalities occur in sub-Saharan Africa. http://www.itweb.co.za/index.php?option=com_content&view=article&id=52695 Monday, August 11, 14
  • 75. US IgniteEnables Innovative “Big Data” Application Development for an Application Development Hub !! Don Hicks Monday, August 11, 14