SlideShare a Scribd company logo
1 of 50
More Than Dots on a Map:
Distributed Real-time Geoprocessing with GeoTrellis




 Robert Cheetham
 cheetham@azavea.com
     @azavea
     @rcheetham
Land

Water

People
Simulation

Modeling

Forecasting
A Story
Ian McHarg
+        +        +

x5           x1       x3       x2




     =




                       Overlays
Dana Tomlin
Idrisi
advanced
spatial analysis
  on the web
advanced
spatial analysis
  on the web
Web Mapping
Web Mapping
Desktop GIS
Performance

Scalability
+
Big Data – Cities




              Big Data – Digital City
Big Data - Science
Big Data – Social Media
Raster file I/O

Distributed Processing



                   Targets
R&D
R&D
GPUs
R&D
−   High performance
−   Simple concurrency / distribution
−   Near real-time response
−   Elastic
−   Resilient
−   Compose models (op chaining)
−   Play well with others



                      Objectives
− New raster file (ARG)
− Raster functions
    − Local
    − Neighborhood (simple)
    − Zonal
−   Integer and float support
−   Some vector
−   Tiling (large rasters)
−   Fast performance
−   Benchmarking suite

                   What’s done
Business Siting
Business Siting
Simulation Modeling
Stormwater Game
Digital Humanities
Crime Analysis and Forecasting
Counting Carbon
Regional/State:     84 ms

National:           84 ms

Large Country     115 ms

Continental       271 ms

Planet          1.2 – 2.0 s
− Extended neighborhoods
  − Euclidean distance
  − Cost distance
  − Viewshed
− More vector functions
− Routing and travelshed
− Integration libraries




            What’s not done
+
−   0.6 April 2012
−   0.7 Sept 2012
−   0.8 Feb 2013
−   0.9 Spring/Summer 2013
    −   Caching
    −   Interpolation
    −   Euclidean Distance
    −   Cost Distance
    −   Raster-to-Vector
    −   PostGIS integration
    −   GeoServer integration
    −   Javascript client
    −   More, better docs       Roadmap
    −   Pyramidding
IRC: #geotrellis on freenode

geotrellis-user@googlegroups.com

      GeoTrellis.github.com

                  Get Involved
I am very excited
advanced
spatial analysis
  on the web
advanced
spatial analysis
  on the web
[vote early and often]



        FOSS4G-NA 2013
Good Book
4:00 pm
[is hiring]
http://azavea.com/jobs

cheetham@azavea.com
  Twitter: @rcheetham

More Related Content

What's hot

Rahul Kumar- Building an Open Data Hub: An Ecosystem of Open Information
Rahul Kumar- Building an Open Data Hub: An Ecosystem of Open InformationRahul Kumar- Building an Open Data Hub: An Ecosystem of Open Information
Rahul Kumar- Building an Open Data Hub: An Ecosystem of Open Information
OuiShare
 

What's hot (20)

Pgrouting_foss4guk_ross_mcdonald
Pgrouting_foss4guk_ross_mcdonaldPgrouting_foss4guk_ross_mcdonald
Pgrouting_foss4guk_ross_mcdonald
 
Tb geo dev_presentation_nov_5
Tb geo dev_presentation_nov_5Tb geo dev_presentation_nov_5
Tb geo dev_presentation_nov_5
 
5200 Analysis-Airbnb data
5200 Analysis-Airbnb data5200 Analysis-Airbnb data
5200 Analysis-Airbnb data
 
Rahul Kumar- Building an Open Data Hub: An Ecosystem of Open Information
Rahul Kumar- Building an Open Data Hub: An Ecosystem of Open InformationRahul Kumar- Building an Open Data Hub: An Ecosystem of Open Information
Rahul Kumar- Building an Open Data Hub: An Ecosystem of Open Information
 
Piedmont heritage
Piedmont heritagePiedmont heritage
Piedmont heritage
 
QGIS and Altas: Automatic map generation
QGIS and Altas: Automatic map generationQGIS and Altas: Automatic map generation
QGIS and Altas: Automatic map generation
 
LIDAR-derived DTM for archaeology and landscape history research some recent ...
LIDAR-derived DTM for archaeology and landscape history research some recent ...LIDAR-derived DTM for archaeology and landscape history research some recent ...
LIDAR-derived DTM for archaeology and landscape history research some recent ...
 
Architecting the ArcGIS Platform - Technical - Esri UK Annual Conference 2017
Architecting the ArcGIS Platform - Technical - Esri UK Annual Conference 2017Architecting the ArcGIS Platform - Technical - Esri UK Annual Conference 2017
Architecting the ArcGIS Platform - Technical - Esri UK Annual Conference 2017
 
Analytics for Smarter Working in the Field - Smart Working - Esri UK Annual C...
Analytics for Smarter Working in the Field - Smart Working - Esri UK Annual C...Analytics for Smarter Working in the Field - Smart Working - Esri UK Annual C...
Analytics for Smarter Working in the Field - Smart Working - Esri UK Annual C...
 
Introduction to Apps for Smarter Working - Smart Working - Esri UK Annual Con...
Introduction to Apps for Smarter Working - Smart Working - Esri UK Annual Con...Introduction to Apps for Smarter Working - Smart Working - Esri UK Annual Con...
Introduction to Apps for Smarter Working - Smart Working - Esri UK Annual Con...
 
From Planning to Gaming - PlanningTech@DUSP
From Planning to Gaming - PlanningTech@DUSPFrom Planning to Gaming - PlanningTech@DUSP
From Planning to Gaming - PlanningTech@DUSP
 
An Intro to Analysis in ArcGIS Pro - Smart Analytics - Esri UK Annual Confere...
An Intro to Analysis in ArcGIS Pro - Smart Analytics - Esri UK Annual Confere...An Intro to Analysis in ArcGIS Pro - Smart Analytics - Esri UK Annual Confere...
An Intro to Analysis in ArcGIS Pro - Smart Analytics - Esri UK Annual Confere...
 
GeoTrellis, GIS on Scala
GeoTrellis, GIS on ScalaGeoTrellis, GIS on Scala
GeoTrellis, GIS on Scala
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
Microservice performance-b
Microservice performance-bMicroservice performance-b
Microservice performance-b
 
Analysing Web GIS apps
Analysing Web GIS appsAnalysing Web GIS apps
Analysing Web GIS apps
 
ArcGIS Open Data - Smart Data - Esri UK Annual Conference 2017
ArcGIS Open Data - Smart Data - Esri UK Annual Conference 2017ArcGIS Open Data - Smart Data - Esri UK Annual Conference 2017
ArcGIS Open Data - Smart Data - Esri UK Annual Conference 2017
 
GIS on the Web
GIS on the WebGIS on the Web
GIS on the Web
 
Map Integration PPT_f
Map Integration PPT_fMap Integration PPT_f
Map Integration PPT_f
 
Gathering information through web applications - Smart Collaboration - Esri U...
Gathering information through web applications - Smart Collaboration - Esri U...Gathering information through web applications - Smart Collaboration - Esri U...
Gathering information through web applications - Smart Collaboration - Esri U...
 

Viewers also liked

Viewers also liked (7)

Forecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
Forecasting Space-Time Events - Strata + Hadoop World 2015 San JoseForecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
Forecasting Space-Time Events - Strata + Hadoop World 2015 San Jose
 
HunchLab 2.0 Getting Started
HunchLab 2.0 Getting StartedHunchLab 2.0 Getting Started
HunchLab 2.0 Getting Started
 
Fed Geo Day 2013 - Azavea Intro
Fed Geo Day 2013 - Azavea Intro Fed Geo Day 2013 - Azavea Intro
Fed Geo Day 2013 - Azavea Intro
 
Five Technology Trends Every Nonprofit Needs to Know
Five Technology Trends Every Nonprofit Needs to KnowFive Technology Trends Every Nonprofit Needs to Know
Five Technology Trends Every Nonprofit Needs to Know
 
PhillyHistory.org - Tracking Metrics for a Digital Project
PhillyHistory.org - Tracking Metrics for a Digital ProjectPhillyHistory.org - Tracking Metrics for a Digital Project
PhillyHistory.org - Tracking Metrics for a Digital Project
 
Exploring Mobile Technology with OpenTreeMap Mobile
Exploring Mobile Technology with OpenTreeMap MobileExploring Mobile Technology with OpenTreeMap Mobile
Exploring Mobile Technology with OpenTreeMap Mobile
 
OpenTreeMap Overview
OpenTreeMap OverviewOpenTreeMap Overview
OpenTreeMap Overview
 

Similar to Fed Geo Day - GeoTrellis Intro

Geoprocessing in Web Time (Robert Cheetham)
Geoprocessing in Web Time (Robert Cheetham)Geoprocessing in Web Time (Robert Cheetham)
Geoprocessing in Web Time (Robert Cheetham)
geeknixta
 
Large Scale Data Analysis with Map/Reduce, part I
Large Scale Data Analysis with Map/Reduce, part ILarge Scale Data Analysis with Map/Reduce, part I
Large Scale Data Analysis with Map/Reduce, part I
Marin Dimitrov
 
Web enabling your survey business ppt version
Web enabling your survey business ppt versionWeb enabling your survey business ppt version
Web enabling your survey business ppt version
rudy_stricklan
 

Similar to Fed Geo Day - GeoTrellis Intro (20)

Low cost solutions for Lidar and GIS analysis
Low cost solutions for Lidar and GIS analysisLow cost solutions for Lidar and GIS analysis
Low cost solutions for Lidar and GIS analysis
 
Geographical Data Management for Web Applications
Geographical Data Management for Web ApplicationsGeographical Data Management for Web Applications
Geographical Data Management for Web Applications
 
ArcGIS and Multi-D: Tools & Roadmap
ArcGIS and Multi-D: Tools & RoadmapArcGIS and Multi-D: Tools & Roadmap
ArcGIS and Multi-D: Tools & Roadmap
 
Gis capabilities on Big Data Systems
Gis capabilities on Big Data SystemsGis capabilities on Big Data Systems
Gis capabilities on Big Data Systems
 
GPUs, Cloud and Grids: Distributed Geoprocessing for Speed, Scalability and B...
GPUs, Cloud and Grids: Distributed Geoprocessing for Speed, Scalability and B...GPUs, Cloud and Grids: Distributed Geoprocessing for Speed, Scalability and B...
GPUs, Cloud and Grids: Distributed Geoprocessing for Speed, Scalability and B...
 
Geoprocessing in Web Time (Robert Cheetham)
Geoprocessing in Web Time (Robert Cheetham)Geoprocessing in Web Time (Robert Cheetham)
Geoprocessing in Web Time (Robert Cheetham)
 
Large Scale Data Analysis with Map/Reduce, part I
Large Scale Data Analysis with Map/Reduce, part ILarge Scale Data Analysis with Map/Reduce, part I
Large Scale Data Analysis with Map/Reduce, part I
 
(Berkeley CS186 guest lecture) Big Data Analytics Systems: What Goes Around C...
(Berkeley CS186 guest lecture) Big Data Analytics Systems: What Goes Around C...(Berkeley CS186 guest lecture) Big Data Analytics Systems: What Goes Around C...
(Berkeley CS186 guest lecture) Big Data Analytics Systems: What Goes Around C...
 
Web enabling your survey business ppt version
Web enabling your survey business ppt versionWeb enabling your survey business ppt version
Web enabling your survey business ppt version
 
Freedom of Movement for redisconf19
Freedom of Movement for redisconf19Freedom of Movement for redisconf19
Freedom of Movement for redisconf19
 
Hawaii Pacific GIS Conference 2012: LiDAR for Intrastructure and Terrian Mapp...
Hawaii Pacific GIS Conference 2012: LiDAR for Intrastructure and Terrian Mapp...Hawaii Pacific GIS Conference 2012: LiDAR for Intrastructure and Terrian Mapp...
Hawaii Pacific GIS Conference 2012: LiDAR for Intrastructure and Terrian Mapp...
 
Brewing the Ultimate Data Fusion
Brewing the Ultimate Data FusionBrewing the Ultimate Data Fusion
Brewing the Ultimate Data Fusion
 
Arc gis desktop_and_geoprocessing
Arc gis desktop_and_geoprocessingArc gis desktop_and_geoprocessing
Arc gis desktop_and_geoprocessing
 
Esri South Africa ArcGIS 10.2 Rollout
Esri South Africa ArcGIS 10.2 Rollout Esri South Africa ArcGIS 10.2 Rollout
Esri South Africa ArcGIS 10.2 Rollout
 
Spark summit europe 2015 magellan
Spark summit europe 2015 magellanSpark summit europe 2015 magellan
Spark summit europe 2015 magellan
 
Synthetic Data and Graphics Techniques in Robotics
Synthetic Data and Graphics Techniques in RoboticsSynthetic Data and Graphics Techniques in Robotics
Synthetic Data and Graphics Techniques in Robotics
 
Geocart workshop
Geocart workshopGeocart workshop
Geocart workshop
 
DataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and AnalyticsDataStax and Esri: Geotemporal IoT Search and Analytics
DataStax and Esri: Geotemporal IoT Search and Analytics
 
CTOs Perspective on Adding Geospatial and Location-based Information
CTOs Perspective on Adding Geospatial and Location-based InformationCTOs Perspective on Adding Geospatial and Location-based Information
CTOs Perspective on Adding Geospatial and Location-based Information
 
Overview of stinger interactive query for hive
Overview of stinger   interactive query for hiveOverview of stinger   interactive query for hive
Overview of stinger interactive query for hive
 

More from Azavea

HunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the HoodHunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the Hood
Azavea
 
OpenTreeMap NCGIS
OpenTreeMap NCGISOpenTreeMap NCGIS
OpenTreeMap NCGIS
Azavea
 

More from Azavea (20)

Using New Tools to Analyze and Plan Your Urban Forest
Using New Tools to Analyze and Plan Your Urban Forest Using New Tools to Analyze and Plan Your Urban Forest
Using New Tools to Analyze and Plan Your Urban Forest
 
7 misconceptions about predictive policing webinar
7 misconceptions about predictive policing webinar7 misconceptions about predictive policing webinar
7 misconceptions about predictive policing webinar
 
Tracking Your Green Infrastructure
Tracking Your Green InfrastructureTracking Your Green Infrastructure
Tracking Your Green Infrastructure
 
Growing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
Growing Your Urban Forest: Using the OpenTreeMap Bulk UploaderGrowing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
Growing Your Urban Forest: Using the OpenTreeMap Bulk Uploader
 
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
November 12, 2014 Webinar: Hackers, Beer Geeks, and Arborly Love - Reaching o...
 
Mobile Citizen Science
Mobile Citizen Science Mobile Citizen Science
Mobile Citizen Science
 
Getting Started with OpenTreeMap Cloud
Getting Started with OpenTreeMap CloudGetting Started with OpenTreeMap Cloud
Getting Started with OpenTreeMap Cloud
 
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
Is it a Package or a Wrapper? Designing, Documenting, and Distributing a Pyth...
 
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
Your New Partners: Understanding Civic Hackathons, Why You Should be Involved...
 
HunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the HoodHunchLab 2.0 Predictive Missions: Under the Hood
HunchLab 2.0 Predictive Missions: Under the Hood
 
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
Using Open Data and Citizen Science to Promote Citizen Engagement with Green ...
 
HunchLab 2.0 Preview Webinar - Place
HunchLab 2.0 Preview Webinar - PlaceHunchLab 2.0 Preview Webinar - Place
HunchLab 2.0 Preview Webinar - Place
 
Data Philly Meetup - Big (Geo) Data
Data Philly Meetup - Big (Geo) DataData Philly Meetup - Big (Geo) Data
Data Philly Meetup - Big (Geo) Data
 
Fed Geo Day - Applying GeoTrellis at the US Army Corps
Fed Geo Day - Applying GeoTrellis at the US Army CorpsFed Geo Day - Applying GeoTrellis at the US Army Corps
Fed Geo Day - Applying GeoTrellis at the US Army Corps
 
Modeling Count-based Raster Data with ArcGIS and R
Modeling Count-based Raster Data with ArcGIS and RModeling Count-based Raster Data with ArcGIS and R
Modeling Count-based Raster Data with ArcGIS and R
 
OpenTreeMap NCGIS
OpenTreeMap NCGISOpenTreeMap NCGIS
OpenTreeMap NCGIS
 
How to Conquer your Post-Election Data Chaos with the Cicero API
How to Conquer your Post-Election Data Chaos with the Cicero APIHow to Conquer your Post-Election Data Chaos with the Cicero API
How to Conquer your Post-Election Data Chaos with the Cicero API
 
Exploring Data Preparation and Visualization Tools for Urban Forestry
Exploring Data Preparation and Visualization Tools for Urban ForestryExploring Data Preparation and Visualization Tools for Urban Forestry
Exploring Data Preparation and Visualization Tools for Urban Forestry
 
Exploring Urban Forestry Modeling and Prioritization Tools
Exploring Urban Forestry Modeling and Prioritization ToolsExploring Urban Forestry Modeling and Prioritization Tools
Exploring Urban Forestry Modeling and Prioritization Tools
 
NTEN Webinar - Data Cleaning and Visualization Tools for Nonprofits
NTEN Webinar - Data Cleaning and Visualization Tools for NonprofitsNTEN Webinar - Data Cleaning and Visualization Tools for Nonprofits
NTEN Webinar - Data Cleaning and Visualization Tools for Nonprofits
 

Recently uploaded

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Recently uploaded (20)

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, Ocado
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
Top 10 Symfony Development Companies 2024
Top 10 Symfony Development Companies 2024Top 10 Symfony Development Companies 2024
Top 10 Symfony Development Companies 2024
 

Fed Geo Day - GeoTrellis Intro