2014 ESIP Summer Meeting
July 8–11, 2014 | Frisco, Colorado
Advancing Scientific Data Support
in
ArcGIS
Nawajish Noman
• ArcGIS and Scientific Data
• Ingest and aggregation
• Visualization and Analysis
• Service, Ready-to-Use Maps, Web Appli...
ArcGIS
Online Content
and Services
Desktop Web Device
Server
ArcGIS Platform
Scientific Data
• Stored in netCDF, GRIB, and HDF formats
• Multidimensional
• Ocean data
Sea temperature, salinity, ocean...
ArcGIS
direct ingest
data
management
visualizationanalysis
share
Scientific Data in ArcGIS - Vision
• Directly reads netCDF file using
o Make NetCDF Raster Layer
o Make NetCDF Feature Layer
o Make NetCDF Table View
• Direc...
What about Aggregation?
• Create a seamless multi-dimensional cube from
o files representing different regions
o files rep...
• Supports netCDF, HDF and GRIB
o Spatial Aggregation
o Temporal Aggregation
o On-the-fly analysis
• Accessible as Map Ser...
Multidimensional Mosaic Datasets
• Raster Types for netCDF, HDF & GRIB
• Define variables when adding Rasters
• Each Row i...
Behaves the same as any layer or table
• Display
o Same display tools for raster and feature layers will work on multi-
di...
Multidimensional Mosaic Dataset - Visualization
• Visualize temporal change of a variable
• Visualize a variable at any ve...
• New Vector Field renderer for raster
o Supports U-V and Magnitude-direction
o Dynamic thinning
o On-the-fly vector calcu...
• Several hundreds analytical tools available for raster, features, and
table
• Temporal Modeling
o Looping and iteration ...
Modeling with Raster function template (RFT)
•
•
•
o
o
o
o
• Map Service (supports WMS)
o Makes maps available to the web.
• Image Service (supports WMS)
o Provides access to raster...
Publishing a WMS on ArcGIS Server
• Enable WMS capabilities on Service Editor or Manager
Multi-dimensional data support in WMS
• getCapabilities
o Supports time, elevation and other dimensions (e.g. depth)
• get...
Multi-dimensional WMS in ArcMap
• Supports WMS layer like any other layer
• Animates a time enabled WMS layer using time-s...
WMS in Dapple Earth Explorer
Multi-dimensional WMS in a Web Application
http://dtc-sci01.esri.com/MultiDimWMSViewer/
Depth
Time
ArcGIS Online
• Curated, authoritative content provided by Esri
o Ready To Use
o Highly scalable
o Global to National
• Au...
Ready-to-Use Maps
http://www.arcgis.com/features/maps/index.html
Ready-To-Use Analysis Services
• Esri hosted analysis on Esri hosted data
o Simplify job of GIS Professionals
o Can be use...
• GLDAS Noah Land Surface Model Outputs
o Evapotranspiration
o Soil Moisture
o Snow Pack
o Other
Ready-to-Use Scientific D...
Web Application
Web Application
• netCDF4-python and SciPy are included in 10.3/Pro
Supplemental tools
• OPeNDAP to NetCDF
• Make NetCDF Regular Point Lay...
Create Space-Time Cube & Emerging Hot Spot Analysis
Creating your own tool
OPeNDAP to NetCDF
• Ingest OPeNDAP Service
• Output dynamic multidimensional
raster
• Support Sub-setting
Next: Make OPeNDAP Layer
Tell the story of your scientific data – Create Story Maps
http://dtc-sci01.esri.com/DeadZoneStoryMap/
Advancing Scientific Data Support in ArcGIS
Upcoming SlideShare
Loading in …5
×

Advancing Scientific Data Support in ArcGIS

2,214 views

Published on

HDF and HDF-EOS Workshop XVII (2014)
Nawajish Noman

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,214
On SlideShare
0
From Embeds
0
Number of Embeds
19
Actions
Shares
0
Downloads
39
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Advancing Scientific Data Support in ArcGIS

  1. 1. 2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman
  2. 2. • ArcGIS and Scientific Data • Ingest and aggregation • Visualization and Analysis • Service, Ready-to-Use Maps, Web Applications • Extending Analytical Capabilities using Python • OPeNDAP and Future Direction Outline
  3. 3. ArcGIS Online Content and Services Desktop Web Device Server ArcGIS Platform
  4. 4. Scientific Data • Stored in netCDF, GRIB, and HDF formats • Multidimensional • Ocean data Sea temperature, salinity, ocean current • Weather data Temperature, humidity, wind • Land Soil moisture, NDVI, land cover
  5. 5. ArcGIS direct ingest data management visualizationanalysis share Scientific Data in ArcGIS - Vision
  6. 6. • Directly reads netCDF file using o Make NetCDF Raster Layer o Make NetCDF Feature Layer o Make NetCDF Table View • Directly reads HDF and GRIB data as raster Ingesting Scientific data in ArcGIS
  7. 7. What about Aggregation? • Create a seamless multi-dimensional cube from o files representing different regions o files representing different time steps/slices
  8. 8. • Supports netCDF, HDF and GRIB o Spatial Aggregation o Temporal Aggregation o On-the-fly analysis • Accessible as Map Service • Accessible as Image Service • Supports direct ingest • Eliminates data conversion • Eliminates data processing • Improves workflow performance • Integrates with service oriented architecture Scientific data support in Mosaic Dataset
  9. 9. Multidimensional Mosaic Datasets • Raster Types for netCDF, HDF & GRIB • Define variables when adding Rasters • Each Row is a 2D Raster with variables and dimension values • Define on-the-fly processing • Serve as Multidimensional o Image Service o Map Service o WMS Aggregate (mosaic) spatial, time, and vertical dimensions
  10. 10. Behaves the same as any layer or table • Display o Same display tools for raster and feature layers will work on multi- dimensional netCDF raster and netCDF feature layers. • Graphing o Driven by the table just like any other chart. • Animation o Multi-dimensional data can be animated through time dimension • Analysis Tools o Will work just like any other raster layer, feature layer, or table. (e.g. create buffers around netCDF points, reproject rasters, query tables, etc.) Using Scientific Data in ArcGIS
  11. 11. Multidimensional Mosaic Dataset - Visualization • Visualize temporal change of a variable • Visualize a variable at any vertical dimension • Visualize flow direction and magnitude variables
  12. 12. • New Vector Field renderer for raster o Supports U-V and Magnitude-direction o Dynamic thinning o On-the-fly vector calculation • Eliminates raster to feature conversion • Eliminates data processing • Improves workflow performance Visualization of Raster as Vectors
  13. 13. • Several hundreds analytical tools available for raster, features, and table • Temporal Modeling o Looping and iteration in ModelBuilder and Python Spatial and Temporal Analysis
  14. 14. Modeling with Raster function template (RFT) • • • o o o o
  15. 15. • Map Service (supports WMS) o Makes maps available to the web. • Image Service (supports WMS) o Provides access to raster data through a web service. • Geoprocessing Service o Exposes the analytic capability of ArcGIS to the web. • Map Package o To share complete map documents and the data referenced by the layer it contains. • Geoprocessing Package o To share your geoprocessing workflow. Sharing / WMS Support (for multi-dimensions)
  16. 16. Publishing a WMS on ArcGIS Server • Enable WMS capabilities on Service Editor or Manager
  17. 17. Multi-dimensional data support in WMS • getCapabilities o Supports time, elevation and other dimensions (e.g. depth) • getMap o Returns map for any dimension value &DIM_<dimensionName>=<value>& o Supports CURRENT for time dimension &TIME=CURRENT& • getFeatureInfo o Returns information about feature for any dimension value
  18. 18. Multi-dimensional WMS in ArcMap • Supports WMS layer like any other layer • Animates a time enabled WMS layer using time-slider • Slices for any dimension value are accessible with ArcObjects Public Sub UpdateWMSServiceLayerDimensionValue() 'UID for wms service layer type Dim pUid As New uid pUid = "{27ABB9EC-7A26-4cf8-8BD4-70EC1D274E17}" Dim pWMSMapLayer2 As IWMSMapLayer2 'calling a function to find the layer from active dataframe Set pWMSMapLayer2 = GetLayer(pUid, "myWMSLayer") 'setting values to dimensions Dim pDimNameValues As IPropertySet Set pDimNameValues = New PropertySet pDimNameValues.SetProperty "Depth", "500" 'dimension#1 pDimNameValues.SetProperty "T1", "500" 'dimension#2 Set pWMSMapLayer2.DimensionValues = pDimNameValues 'calling a function to redraw the layer RefreshActiveDataFrame End Sub
  19. 19. WMS in Dapple Earth Explorer
  20. 20. Multi-dimensional WMS in a Web Application http://dtc-sci01.esri.com/MultiDimWMSViewer/ Depth Time
  21. 21. ArcGIS Online • Curated, authoritative content provided by Esri o Ready To Use o Highly scalable o Global to National • Authoritative content provided by the community o Hosted in your ArcGIS Online Organization account o Hosted on your hardware and shared to ArcGIS Online > 100 Tb of data > 150 millions maps per day
  22. 22. Ready-to-Use Maps http://www.arcgis.com/features/maps/index.html
  23. 23. Ready-To-Use Analysis Services • Esri hosted analysis on Esri hosted data o Simplify job of GIS Professionals o Can be used in models and scripts just like any other tool o Extend spatial analysis to a much broader audience o Available in Desktop or as REST service Best practices published to the Resource Center
  24. 24. • GLDAS Noah Land Surface Model Outputs o Evapotranspiration o Soil Moisture o Snow Pack o Other Ready-to-Use Scientific Data Maps
  25. 25. Web Application
  26. 26. Web Application
  27. 27. • netCDF4-python and SciPy are included in 10.3/Pro Supplemental tools • OPeNDAP to NetCDF • Make NetCDF Regular Point Layer • Make NetCDF Station Point Layer • Make NetCDF Trajectory Point Layer • Describe Multidimensional Dataset • Get Variable Statistics • Get Variable Statistics Over Dimension • Multidimensional Zonal Statistics • Multidimensional Zonal Statistics As Table http://blogs.esri.com/esri/arcgis/2013/05/24/introducing-the-multidimension-supplemental-tools-2/ Python and Geoprocessing Tools
  28. 28. Create Space-Time Cube & Emerging Hot Spot Analysis
  29. 29. Creating your own tool
  30. 30. OPeNDAP to NetCDF
  31. 31. • Ingest OPeNDAP Service • Output dynamic multidimensional raster • Support Sub-setting Next: Make OPeNDAP Layer
  32. 32. Tell the story of your scientific data – Create Story Maps http://dtc-sci01.esri.com/DeadZoneStoryMap/

×