SlideShare a Scribd company logo
Catalog on the fly satellite images
Luiz.motta@ibama.gov.br
http://www.ibama.gov.br
Luiz Motta FOSS4G 2015 - Seul
MMA - Ministry of the Environment – Brazil
IBAMA - Brazilian Institute of Environment and
Renewable Natural Resources
DIPRO - Directorship of Environmental Protection
CGMAM – General Coordination of Monitoring
COTIG – Coordination of Geospatial Technology *
Luiz Motta:
● Academic education
● Forestry Engineer
● Msc. Forestry Science (Optimization with GIS) – 1995
● Profissional experience (using GIS):
EMBRAPA (Corn zoning), IEF-MG(monitoring of vegetation), …
IBAMA (since 2003 – first tender for career)
Amazon: SIPAM, Terra Legal Project, …
FOSS4G: since 2010(contribution for QGIS).
Example of goal: Deforestation of Amazon
Example of goal: Illegal mining
● Satellite images used by DIPRO.
● Change in the use of satellite images.
● Demand of images for shares of DIPRO.
● Catalog on the fly
● Server – Generation Geotif and TMS - Products ready
● Client – QGIS
● Planet Labs Catalog – Explorer Program.
Presentation plan
● Free images
● CBERS 2B (Brazil e China)
● 20m(CCD) e 2.7m(HRC)
● Until 2010
● Popularizing the use of images- INPE: Start 2004
“Experts”
● ALOS/Amazon Project (IBAMA, DPF and JICA)
● ALOS/PALSAR: 100m
● 2010 – 2011
● LANDSAT:
Ortho rectified (temporal series + Landsat 8 ~ 4.5K)
● Purchased:
● Rapideye: 3 covers of all Brazil (8,516,000 km2) ~57k
Satellite images used by DIPRO
Satellite images used by DIPRO
LANDSAT(2001- 2015)
LANDSAT
RAPIDEYE
Change in the use of satellite images
● High availability of higher spatial resolution
● Effect “Google”, “Bing”,...
● Reduced need for specialist.
● Image classification x visual interpretation
● IBAMA:
● Deforestation interpretation on each pass Landsat(16
days)
● Detect changes based on temporal series temporal
series.
● Support with images higher spatial resolution
Change in the use of satellite images
LANDSAT 8: 2015-08-28
1:10,500
BING
1:10,500
GOOGLE
1:10,500
1:50,000 1:10,500
2015-08-05
Change in the use of satellite images
RAPIDEYE 2014-06-19
Change in the use of satellite images
RAPIDEYE 2014-06-19 - R3G5B2
Landsat 8(2014-07-24) R6G5B4 Rapideye 5(2014-06-19) R3G5B2
Improvement for interpretation
Scale: 1:10,000
Demand of images for shares of DIPRO
Detect new deforestation fronts.
Temporal and spatial availabilityl:
Example: Sentinel-2(10m) + Landsat
2015-05-10 2015-06-11
CR = Clear-cut
Catalog on the fly
● Objective: Obtain images automatically from a target
● Need – Server/local:
● Organize images acquis (Landsat, RapidEye, ...)
● End Product (RGB composition)
Geotiff and TMS
● Footprint images (Catalog layer ) - Address of images
● Need – Client(QGIS):
● Plugin for identify the images in the map extension
● Recognize the type of source (local or server)
● Automatically add images(Layer Group)
● Order by date
Catalog on the fly
Use the original name + RGB
Processing:
● Create RGB: 2_rgb.sh LC82270632013140LGN01.tif 6 5 4
● Convert for 8bits:
16b_2_8b_convert.sh LC82270632013140LGN01_r6g5b4.tif
● Change original image.
● Scale: Minimum → 0 and Maximum → 255
Scripts: https://github.com/lmotta/scripts-for-gis
Catalog on the fly
Create TMS and GDAL_WMS files
mk_tiles.sh
LC82270632013140LGN01_r6g5b4.tif
2 15
/images/tms/landsat
/imagens/png/landsat
http://10.1.25.66/imagens/tms/landsat
* gdal_tiler.py (tilers-tools 3.2.0)
Create new TAG: TargetWindow
Use for “Zoom to Layer”
Catalog on the fly
Bash example:
nohup parallel mk_tiles.sh {} 2 17 ./png ./tms url < images.lst
Catalog on the fly
Creative example: Not could use this PC, it is of private
project. No problem, boot by portable HD (Xubuntu)
Catalog on the fly
Steps for footprint images (catalog layer)
● Create footprint for each image
● Smoothing for footprint
● Add all fooprint for shapefile
Catalog on the fly
Create footprint – footprint.sh [image]
● gdal_calc.py:
-A $in_img --A_band 1 --type Byte --calc "A>0" --outfile $zero_one_img
* 16 bits
● gdal_sieve.py
-q -st 100 -4 $zero_one_img -nomask $sieve_img
● gdal_edit.py:
-a_nodata 0 $sieve_img
● gdal_polygonize.py:
$sieve_img -q -b 1 -f "GeoJSON" $footprint_geojson
● Sed: add image and path names
ssed="s|{ "DN": 1 }|{ "path": "$dir_img", "image": "$basename_img" }|"
sed -i "$ssed" "$footprint_geojson"
Catalog on the fly
Smoothing for footprint
footprint_convexhull.py [geojson]
● Create convex hull of geometry
● Add suffix: _convexhull
Add all fooprint for shapefile
footprint_append_shp.sh [geojson] [shapefile]
● Add feature from geojson in shapefile
● ogr2ogr -update -append -t_srs EPSG:4674 $shapefile $footprint_geojson
Bash Example :
Catalog on the fly
Catalogs layers
● Created for all Rapideye images and put in database.
● Landsat 8: Added directly in database
● Fields:
● Path: network address(directory of Geotif)
● Image: name of image(RGB)
● TMS: Address of XML in HTTP server (GDAL_WMS)
● Quicklook: Address of PNG in HTTP server
● Date: create from name of image
● Plugin: Catalog on the fly [1]
● Search for catalog layer in current project
● Fields: Date(not mandatory)
and address of each image
*Address: local image or GDAL_WMS for Internet
● Geometry: Footprint of image (polygon layer)
● Get images where intersect with extent map
canvas. Use the features geometry of catalog layer
for query.
Catalog on the fly
[1] https://plugins.qgis.org/plugins/catalogotf_plugin/
Catalog on the fly
It is not mandatory.
The field is date type or
Text (yyyy-mm-dd)
Local file or Internet by address for GDAL_WMS, prefix = http and suffix = .xml
● Check the layer, to search
images where intersect with
map canvas.
● Create a “group” for add new
images (name layer - Catalog)
Reverse order by date or name image
Catalog on the fly
● Buttons for seach features in map canvas:
● Run for all.
● Run for selected.
● Cancel
● Waiting cancel
Catalog on the fly
● Create contex menu for each image in catalog group:
● Zoom to
● Highlight
WMS_GDAL need have the TAG <TargetWindow>, this TAG is not standard.
TargetWindow: Extent of image.
Catalog on the fly
Catalog on the fly
Using with “Auxiliary windows” Plugin
Catalog on the fly
Quickly catalog from local images
56 files
Image Boundary Plugin (Extent)
Catalog on the fly
Quickly catalog from local images
Expressions for virtual fields:
● Source of file
● Date from name image
Planet Labs Catalog
Presentation:
http://pt.slideshare.net/LuizMotta3/planetlabs-explorer-qgisplugin
Planet Labs Catalog
Planet Labs Catalog
Planet Labs Catalog
Date: 2015-08-29Date: 2015-08-29
Acknowledgements
I thank all the people who share their knowledge openly.
Special thanks to the committees of OSGEO and FOSS4G
2015.
Luiz.Motta@ibama.gov.br
IBAMA

More Related Content

What's hot

Using GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissionsUsing GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissions
niket_narang
 
Gazprom - How to Negotiate Online based on Agile Values
Gazprom - How to Negotiate Online based on Agile ValuesGazprom - How to Negotiate Online based on Agile Values
Gazprom - How to Negotiate Online based on Agile Values
Mirko Kleiner
 
Gal project - ASI Workshop for FP7 Galileo Projects
Gal project - ASI Workshop for FP7 Galileo ProjectsGal project - ASI Workshop for FP7 Galileo Projects
Gal project - ASI Workshop for FP7 Galileo ProjectsAngelo Amodio
 
Snow cover assessment tool using Python
Snow cover assessment tool using PythonSnow cover assessment tool using Python
Snow cover assessment tool using Python
Prasun Kumar Gupta
 
GAL Project at "Let's embrace space" conference
GAL Project at "Let's embrace space" conferenceGAL Project at "Let's embrace space" conference
GAL Project at "Let's embrace space" conference
Angelo Amodio
 
Truck truck is a rust cad kernel
Truck   truck is a rust cad kernelTruck   truck is a rust cad kernel
Truck truck is a rust cad kernel
YoshinoriTanimura
 
Sharing the Openness of the Maps via FOSS4G and the Web
Sharing the Openness of the Maps via FOSS4G and the WebSharing the Openness of the Maps via FOSS4G and the Web
Sharing the Openness of the Maps via FOSS4G and the Web
Hidenori Fujimura
 
RAW GNSS in Android Nugat
RAW GNSS in Android NugatRAW GNSS in Android Nugat
RAW GNSS in Android Nugat
Lukasz Kosma Bonenberg
 
Big data ET models & benchmarking with distributed OSGEO tools
Big data ET models & benchmarking with distributed OSGEO toolsBig data ET models & benchmarking with distributed OSGEO tools
Big data ET models & benchmarking with distributed OSGEO tools
Hirofumi Hayashi
 
以 Leaflet 濫用^H^H呈現開放街圖資料
以 Leaflet 濫用^H^H呈現開放街圖資料以 Leaflet 濫用^H^H呈現開放街圖資料
以 Leaflet 濫用^H^H呈現開放街圖資料
Rex Tsai
 
Wherecamp Berlin Introduction to RAW GNSS Measurements
Wherecamp Berlin Introduction to RAW GNSS MeasurementsWherecamp Berlin Introduction to RAW GNSS Measurements
Wherecamp Berlin Introduction to RAW GNSS Measurements
The European GNSS Agency (GSA)
 
Yet another population cartogram: Creating gridded cartograms using ArcGIS an...
Yet another population cartogram: Creating gridded cartograms using ArcGIS an...Yet another population cartogram: Creating gridded cartograms using ArcGIS an...
Yet another population cartogram: Creating gridded cartograms using ArcGIS an...
Benjamin Hennig
 
2nd Galileo Android Hackathon intro
2nd Galileo Android Hackathon intro2nd Galileo Android Hackathon intro
2nd Galileo Android Hackathon intro
Lukasz Kosma Bonenberg
 
SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...
SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...
SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...
South Tyrol Free Software Conference
 
Open Source Web Charts
Open Source Web ChartsOpen Source Web Charts
Open Source Web Charts
HaNJiN Lee
 

What's hot (15)

Using GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissionsUsing GIS to reassess urban plans based on changing industrial emissions
Using GIS to reassess urban plans based on changing industrial emissions
 
Gazprom - How to Negotiate Online based on Agile Values
Gazprom - How to Negotiate Online based on Agile ValuesGazprom - How to Negotiate Online based on Agile Values
Gazprom - How to Negotiate Online based on Agile Values
 
Gal project - ASI Workshop for FP7 Galileo Projects
Gal project - ASI Workshop for FP7 Galileo ProjectsGal project - ASI Workshop for FP7 Galileo Projects
Gal project - ASI Workshop for FP7 Galileo Projects
 
Snow cover assessment tool using Python
Snow cover assessment tool using PythonSnow cover assessment tool using Python
Snow cover assessment tool using Python
 
GAL Project at "Let's embrace space" conference
GAL Project at "Let's embrace space" conferenceGAL Project at "Let's embrace space" conference
GAL Project at "Let's embrace space" conference
 
Truck truck is a rust cad kernel
Truck   truck is a rust cad kernelTruck   truck is a rust cad kernel
Truck truck is a rust cad kernel
 
Sharing the Openness of the Maps via FOSS4G and the Web
Sharing the Openness of the Maps via FOSS4G and the WebSharing the Openness of the Maps via FOSS4G and the Web
Sharing the Openness of the Maps via FOSS4G and the Web
 
RAW GNSS in Android Nugat
RAW GNSS in Android NugatRAW GNSS in Android Nugat
RAW GNSS in Android Nugat
 
Big data ET models & benchmarking with distributed OSGEO tools
Big data ET models & benchmarking with distributed OSGEO toolsBig data ET models & benchmarking with distributed OSGEO tools
Big data ET models & benchmarking with distributed OSGEO tools
 
以 Leaflet 濫用^H^H呈現開放街圖資料
以 Leaflet 濫用^H^H呈現開放街圖資料以 Leaflet 濫用^H^H呈現開放街圖資料
以 Leaflet 濫用^H^H呈現開放街圖資料
 
Wherecamp Berlin Introduction to RAW GNSS Measurements
Wherecamp Berlin Introduction to RAW GNSS MeasurementsWherecamp Berlin Introduction to RAW GNSS Measurements
Wherecamp Berlin Introduction to RAW GNSS Measurements
 
Yet another population cartogram: Creating gridded cartograms using ArcGIS an...
Yet another population cartogram: Creating gridded cartograms using ArcGIS an...Yet another population cartogram: Creating gridded cartograms using ArcGIS an...
Yet another population cartogram: Creating gridded cartograms using ArcGIS an...
 
2nd Galileo Android Hackathon intro
2nd Galileo Android Hackathon intro2nd Galileo Android Hackathon intro
2nd Galileo Android Hackathon intro
 
SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...
SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...
SFScon 21 - Silvia Franceschi Andrea Antonello - Smash a customizable cross-p...
 
Open Source Web Charts
Open Source Web ChartsOpen Source Web Charts
Open Source Web Charts
 

Similar to Catalog on the fly satellite images

Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...
Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...
Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...
Shaun Lewis
 
Under the hood of the Altalis Platform
Under the hood of the Altalis PlatformUnder the hood of the Altalis Platform
Under the hood of the Altalis Platform
Safe Software
 
Adopting OGC Standards in São Paulo Flood Alert System - FOSS4G 2014 - PDX
Adopting OGC Standards in São Paulo Flood Alert System  - FOSS4G 2014 - PDXAdopting OGC Standards in São Paulo Flood Alert System  - FOSS4G 2014 - PDX
Adopting OGC Standards in São Paulo Flood Alert System - FOSS4G 2014 - PDX
Ivan Martinez
 
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place SolutionKaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Preferred Networks
 
A tale about 3rd place on "Agricultural crop cover classification challenge"
A tale about 3rd  place on  "Agricultural crop cover classification challenge"A tale about 3rd  place on  "Agricultural crop cover classification challenge"
A tale about 3rd place on "Agricultural crop cover classification challenge"
Vitaly Bondar
 
An implementation of the grammar of graphics: ggplot
An implementation of the grammar of graphics: ggplotAn implementation of the grammar of graphics: ggplot
An implementation of the grammar of graphics: ggplot
Hoffman Lab
 
Visualizing Large Greenhouse Gas Datasets in the Browser With deck.gl
Visualizing Large Greenhouse Gas Datasets in the Browser With deck.glVisualizing Large Greenhouse Gas Datasets in the Browser With deck.gl
Visualizing Large Greenhouse Gas Datasets in the Browser With deck.gl
All Things Open
 
Extended Property Graphs and Cypher on Gradoop
Extended Property Graphs and Cypher on GradoopExtended Property Graphs and Cypher on Gradoop
Extended Property Graphs and Cypher on Gradoop
openCypher
 
도시 설계와 GIS 기술의 관계
도시 설계와 GIS 기술의 관계도시 설계와 GIS 기술의 관계
도시 설계와 GIS 기술의 관계
Tae wook kang
 
도시건축설계와 오픈소스 기반 GIS
도시건축설계와 오픈소스 기반 GIS도시건축설계와 오픈소스 기반 GIS
도시건축설계와 오픈소스 기반 GIS
mac999
 
ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...
ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...
ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...
Spark Summit
 
Info gdal 20150915
Info gdal 20150915Info gdal 20150915
Info gdal 20150915
GeoMedeelel
 
R programming for data science
R programming for data scienceR programming for data science
R programming for data science
Sovello Hildebrand
 
Processing large point clouds
Processing large point cloudsProcessing large point clouds
Processing large point clouds
Mathieu Carette
 
Web Traffic Time Series Forecasting
Web Traffic  Time Series ForecastingWeb Traffic  Time Series Forecasting
Web Traffic Time Series Forecasting
BillTubbs
 
Click prediction: kaggle competitions vs real life
Click prediction: kaggle competitions vs real lifeClick prediction: kaggle competitions vs real life
Click prediction: kaggle competitions vs real life
Alexey Grigorev
 
Electrolux meetup
Electrolux meetupElectrolux meetup
Electrolux meetup
Kirill Zhdanovich
 
Automating Spatial Data Sharing
Automating Spatial Data SharingAutomating Spatial Data Sharing
Automating Spatial Data Sharing
GIM_nv
 
2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)
2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)
2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)
George Porto Ferreira
 
쉽게 설명하는 GAN (What is this? Gum? It's GAN.)
쉽게 설명하는 GAN (What is this? Gum? It's GAN.)쉽게 설명하는 GAN (What is this? Gum? It's GAN.)
쉽게 설명하는 GAN (What is this? Gum? It's GAN.)
Hansol Kang
 

Similar to Catalog on the fly satellite images (20)

Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...
Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...
Processing Landsat 8 Multi-Spectral Images with GRASS Tools & the potential o...
 
Under the hood of the Altalis Platform
Under the hood of the Altalis PlatformUnder the hood of the Altalis Platform
Under the hood of the Altalis Platform
 
Adopting OGC Standards in São Paulo Flood Alert System - FOSS4G 2014 - PDX
Adopting OGC Standards in São Paulo Flood Alert System  - FOSS4G 2014 - PDXAdopting OGC Standards in São Paulo Flood Alert System  - FOSS4G 2014 - PDX
Adopting OGC Standards in São Paulo Flood Alert System - FOSS4G 2014 - PDX
 
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place SolutionKaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
Kaggle Lyft Motion Prediction for Autonomous Vehicles 4th Place Solution
 
A tale about 3rd place on "Agricultural crop cover classification challenge"
A tale about 3rd  place on  "Agricultural crop cover classification challenge"A tale about 3rd  place on  "Agricultural crop cover classification challenge"
A tale about 3rd place on "Agricultural crop cover classification challenge"
 
An implementation of the grammar of graphics: ggplot
An implementation of the grammar of graphics: ggplotAn implementation of the grammar of graphics: ggplot
An implementation of the grammar of graphics: ggplot
 
Visualizing Large Greenhouse Gas Datasets in the Browser With deck.gl
Visualizing Large Greenhouse Gas Datasets in the Browser With deck.glVisualizing Large Greenhouse Gas Datasets in the Browser With deck.gl
Visualizing Large Greenhouse Gas Datasets in the Browser With deck.gl
 
Extended Property Graphs and Cypher on Gradoop
Extended Property Graphs and Cypher on GradoopExtended Property Graphs and Cypher on Gradoop
Extended Property Graphs and Cypher on Gradoop
 
도시 설계와 GIS 기술의 관계
도시 설계와 GIS 기술의 관계도시 설계와 GIS 기술의 관계
도시 설계와 GIS 기술의 관계
 
도시건축설계와 오픈소스 기반 GIS
도시건축설계와 오픈소스 기반 GIS도시건축설계와 오픈소스 기반 GIS
도시건축설계와 오픈소스 기반 GIS
 
ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...
ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...
ggplot2.SparkR: Rebooting ggplot2 for Scalable Big Data Visualization by Jong...
 
Info gdal 20150915
Info gdal 20150915Info gdal 20150915
Info gdal 20150915
 
R programming for data science
R programming for data scienceR programming for data science
R programming for data science
 
Processing large point clouds
Processing large point cloudsProcessing large point clouds
Processing large point clouds
 
Web Traffic Time Series Forecasting
Web Traffic  Time Series ForecastingWeb Traffic  Time Series Forecasting
Web Traffic Time Series Forecasting
 
Click prediction: kaggle competitions vs real life
Click prediction: kaggle competitions vs real lifeClick prediction: kaggle competitions vs real life
Click prediction: kaggle competitions vs real life
 
Electrolux meetup
Electrolux meetupElectrolux meetup
Electrolux meetup
 
Automating Spatial Data Sharing
Automating Spatial Data SharingAutomating Spatial Data Sharing
Automating Spatial Data Sharing
 
2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)
2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)
2018 - Grupo QGIS Brasil e o lançamento do QGIS 3.4 LTR (Versão de Longo Prazo)
 
쉽게 설명하는 GAN (What is this? Gum? It's GAN.)
쉽게 설명하는 GAN (What is this? Gum? It's GAN.)쉽게 설명하는 GAN (What is this? Gum? It's GAN.)
쉽게 설명하는 GAN (What is this? Gum? It's GAN.)
 

More from Luiz Motta

Análises Espaciais com a Extensão PostGis
Análises Espaciais com a Extensão PostGisAnálises Espaciais com a Extensão PostGis
Análises Espaciais com a Extensão PostGis
Luiz Motta
 
Catalog Planet Labs Plugin for QGIS - V1
Catalog Planet Labs Plugin for QGIS - V1Catalog Planet Labs Plugin for QGIS - V1
Catalog Planet Labs Plugin for QGIS - V1
Luiz Motta
 
Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...
Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...
Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...
Luiz Motta
 
Presentation 2016 sql_water-source_sql
Presentation 2016 sql_water-source_sqlPresentation 2016 sql_water-source_sql
Presentation 2016 sql_water-source_sql
Luiz Motta
 
Mapswipetool plugin
Mapswipetool pluginMapswipetool plugin
Mapswipetool plugin
Luiz Motta
 
QGIS with imagery satellite TMS format
QGIS with imagery satellite TMS formatQGIS with imagery satellite TMS format
QGIS with imagery satellite TMS formatLuiz Motta
 

More from Luiz Motta (6)

Análises Espaciais com a Extensão PostGis
Análises Espaciais com a Extensão PostGisAnálises Espaciais com a Extensão PostGis
Análises Espaciais com a Extensão PostGis
 
Catalog Planet Labs Plugin for QGIS - V1
Catalog Planet Labs Plugin for QGIS - V1Catalog Planet Labs Plugin for QGIS - V1
Catalog Planet Labs Plugin for QGIS - V1
 
Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...
Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...
Catalog on the fly: Solução aberta para utilização imediata de grande acervo ...
 
Presentation 2016 sql_water-source_sql
Presentation 2016 sql_water-source_sqlPresentation 2016 sql_water-source_sql
Presentation 2016 sql_water-source_sql
 
Mapswipetool plugin
Mapswipetool pluginMapswipetool plugin
Mapswipetool plugin
 
QGIS with imagery satellite TMS format
QGIS with imagery satellite TMS formatQGIS with imagery satellite TMS format
QGIS with imagery satellite TMS format
 

Recently uploaded

SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 

Recently uploaded (20)

SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 

Catalog on the fly satellite images

  • 1. Catalog on the fly satellite images Luiz.motta@ibama.gov.br http://www.ibama.gov.br Luiz Motta FOSS4G 2015 - Seul
  • 2. MMA - Ministry of the Environment – Brazil IBAMA - Brazilian Institute of Environment and Renewable Natural Resources DIPRO - Directorship of Environmental Protection CGMAM – General Coordination of Monitoring COTIG – Coordination of Geospatial Technology * Luiz Motta: ● Academic education ● Forestry Engineer ● Msc. Forestry Science (Optimization with GIS) – 1995 ● Profissional experience (using GIS): EMBRAPA (Corn zoning), IEF-MG(monitoring of vegetation), … IBAMA (since 2003 – first tender for career) Amazon: SIPAM, Terra Legal Project, … FOSS4G: since 2010(contribution for QGIS).
  • 3. Example of goal: Deforestation of Amazon
  • 4. Example of goal: Illegal mining
  • 5. ● Satellite images used by DIPRO. ● Change in the use of satellite images. ● Demand of images for shares of DIPRO. ● Catalog on the fly ● Server – Generation Geotif and TMS - Products ready ● Client – QGIS ● Planet Labs Catalog – Explorer Program. Presentation plan
  • 6. ● Free images ● CBERS 2B (Brazil e China) ● 20m(CCD) e 2.7m(HRC) ● Until 2010 ● Popularizing the use of images- INPE: Start 2004 “Experts” ● ALOS/Amazon Project (IBAMA, DPF and JICA) ● ALOS/PALSAR: 100m ● 2010 – 2011 ● LANDSAT: Ortho rectified (temporal series + Landsat 8 ~ 4.5K) ● Purchased: ● Rapideye: 3 covers of all Brazil (8,516,000 km2) ~57k Satellite images used by DIPRO
  • 7. Satellite images used by DIPRO LANDSAT(2001- 2015) LANDSAT RAPIDEYE
  • 8. Change in the use of satellite images ● High availability of higher spatial resolution ● Effect “Google”, “Bing”,... ● Reduced need for specialist. ● Image classification x visual interpretation ● IBAMA: ● Deforestation interpretation on each pass Landsat(16 days) ● Detect changes based on temporal series temporal series. ● Support with images higher spatial resolution
  • 9. Change in the use of satellite images LANDSAT 8: 2015-08-28 1:10,500 BING 1:10,500 GOOGLE 1:10,500 1:50,000 1:10,500 2015-08-05
  • 10. Change in the use of satellite images RAPIDEYE 2014-06-19
  • 11. Change in the use of satellite images RAPIDEYE 2014-06-19 - R3G5B2 Landsat 8(2014-07-24) R6G5B4 Rapideye 5(2014-06-19) R3G5B2 Improvement for interpretation Scale: 1:10,000
  • 12. Demand of images for shares of DIPRO Detect new deforestation fronts. Temporal and spatial availabilityl: Example: Sentinel-2(10m) + Landsat 2015-05-10 2015-06-11 CR = Clear-cut
  • 13. Catalog on the fly ● Objective: Obtain images automatically from a target ● Need – Server/local: ● Organize images acquis (Landsat, RapidEye, ...) ● End Product (RGB composition) Geotiff and TMS ● Footprint images (Catalog layer ) - Address of images ● Need – Client(QGIS): ● Plugin for identify the images in the map extension ● Recognize the type of source (local or server) ● Automatically add images(Layer Group) ● Order by date
  • 14. Catalog on the fly Use the original name + RGB Processing: ● Create RGB: 2_rgb.sh LC82270632013140LGN01.tif 6 5 4 ● Convert for 8bits: 16b_2_8b_convert.sh LC82270632013140LGN01_r6g5b4.tif ● Change original image. ● Scale: Minimum → 0 and Maximum → 255 Scripts: https://github.com/lmotta/scripts-for-gis
  • 15. Catalog on the fly Create TMS and GDAL_WMS files mk_tiles.sh LC82270632013140LGN01_r6g5b4.tif 2 15 /images/tms/landsat /imagens/png/landsat http://10.1.25.66/imagens/tms/landsat * gdal_tiler.py (tilers-tools 3.2.0) Create new TAG: TargetWindow Use for “Zoom to Layer”
  • 16. Catalog on the fly Bash example: nohup parallel mk_tiles.sh {} 2 17 ./png ./tms url < images.lst
  • 17. Catalog on the fly Creative example: Not could use this PC, it is of private project. No problem, boot by portable HD (Xubuntu)
  • 18. Catalog on the fly Steps for footprint images (catalog layer) ● Create footprint for each image ● Smoothing for footprint ● Add all fooprint for shapefile
  • 19. Catalog on the fly Create footprint – footprint.sh [image] ● gdal_calc.py: -A $in_img --A_band 1 --type Byte --calc "A>0" --outfile $zero_one_img * 16 bits ● gdal_sieve.py -q -st 100 -4 $zero_one_img -nomask $sieve_img ● gdal_edit.py: -a_nodata 0 $sieve_img ● gdal_polygonize.py: $sieve_img -q -b 1 -f "GeoJSON" $footprint_geojson ● Sed: add image and path names ssed="s|{ "DN": 1 }|{ "path": "$dir_img", "image": "$basename_img" }|" sed -i "$ssed" "$footprint_geojson"
  • 20. Catalog on the fly Smoothing for footprint footprint_convexhull.py [geojson] ● Create convex hull of geometry ● Add suffix: _convexhull Add all fooprint for shapefile footprint_append_shp.sh [geojson] [shapefile] ● Add feature from geojson in shapefile ● ogr2ogr -update -append -t_srs EPSG:4674 $shapefile $footprint_geojson Bash Example :
  • 21. Catalog on the fly Catalogs layers ● Created for all Rapideye images and put in database. ● Landsat 8: Added directly in database ● Fields: ● Path: network address(directory of Geotif) ● Image: name of image(RGB) ● TMS: Address of XML in HTTP server (GDAL_WMS) ● Quicklook: Address of PNG in HTTP server ● Date: create from name of image
  • 22. ● Plugin: Catalog on the fly [1] ● Search for catalog layer in current project ● Fields: Date(not mandatory) and address of each image *Address: local image or GDAL_WMS for Internet ● Geometry: Footprint of image (polygon layer) ● Get images where intersect with extent map canvas. Use the features geometry of catalog layer for query. Catalog on the fly [1] https://plugins.qgis.org/plugins/catalogotf_plugin/
  • 23. Catalog on the fly It is not mandatory. The field is date type or Text (yyyy-mm-dd) Local file or Internet by address for GDAL_WMS, prefix = http and suffix = .xml
  • 24. ● Check the layer, to search images where intersect with map canvas. ● Create a “group” for add new images (name layer - Catalog) Reverse order by date or name image Catalog on the fly
  • 25. ● Buttons for seach features in map canvas: ● Run for all. ● Run for selected. ● Cancel ● Waiting cancel Catalog on the fly
  • 26. ● Create contex menu for each image in catalog group: ● Zoom to ● Highlight WMS_GDAL need have the TAG <TargetWindow>, this TAG is not standard. TargetWindow: Extent of image. Catalog on the fly
  • 27. Catalog on the fly Using with “Auxiliary windows” Plugin
  • 28. Catalog on the fly Quickly catalog from local images 56 files Image Boundary Plugin (Extent)
  • 29. Catalog on the fly Quickly catalog from local images Expressions for virtual fields: ● Source of file ● Date from name image
  • 33. Planet Labs Catalog Date: 2015-08-29Date: 2015-08-29
  • 34. Acknowledgements I thank all the people who share their knowledge openly. Special thanks to the committees of OSGEO and FOSS4G 2015. Luiz.Motta@ibama.gov.br IBAMA