FMI Open Data Interface and Data ModelsRoope Tervo
Description of FMI Open Data Portal services and data models including some WFS basics. The presentation includes also a description of INSPIRE harmonised data models used in the portal.
The document discusses the Finnish Meteorological Institute's (FMI) approach to providing weather data in an INSPIRE compliant format. It describes how FMI opened all of its data in 2013 through a single data portal that serves as both an open data and INSPIRE portal. It then covers the various data models used to structure different types of weather data, including observations, forecasts, and radar images. Finally, it discusses experiences with implementing the different models and serving the wide range of weather data sets.
The Finnish Meteorological Institute opened its meteorological data in 2013, providing freely accessible machine-readable data through its open data portal. This includes weather observations, forecasts, radar images, and more. While the amount of data held by FMI is substantial, reaching over 1 terabyte for observations alone, it follows common standards to make the data broadly usable. The open data project has helped FMI improve its services and data sharing while generating interest from both commercial and independent users.
The document discusses the open meteorological data provided by the Finnish Meteorological Institute (FMI). FMI opened its data in 2013, making basically all of its data freely available in machine-readable formats. The data portal follows INSPIRE requirements and provides metadata, data, models, and services. Various types of observational and forecast data are available, including weather, marine, and radar data as well as lightning strikes and model outputs.
Finnish Meteorological Institute is opening its weather data. Slides kept in Aaltoes Insights event describes first insights about open data portal and what is going to be opened.
The Finnish Meteorological Institute opened its meteorological data in 2013, making everything it owns available in open, machine-readable formats through a single data portal. The portal follows INSPIRE requirements and provides metadata, data, models and services. A variety of weather and climate datasets are available, including observations, forecasts, radar images and more. Standards like OGC and INSPIRE are used to ensure interoperability.
FMI Open Data Interface and Data ModelsRoope Tervo
Description of FMI Open Data Portal services and data models including some WFS basics. The presentation includes also a description of INSPIRE harmonised data models used in the portal.
The document discusses the Finnish Meteorological Institute's (FMI) approach to providing weather data in an INSPIRE compliant format. It describes how FMI opened all of its data in 2013 through a single data portal that serves as both an open data and INSPIRE portal. It then covers the various data models used to structure different types of weather data, including observations, forecasts, and radar images. Finally, it discusses experiences with implementing the different models and serving the wide range of weather data sets.
The Finnish Meteorological Institute opened its meteorological data in 2013, providing freely accessible machine-readable data through its open data portal. This includes weather observations, forecasts, radar images, and more. While the amount of data held by FMI is substantial, reaching over 1 terabyte for observations alone, it follows common standards to make the data broadly usable. The open data project has helped FMI improve its services and data sharing while generating interest from both commercial and independent users.
The document discusses the open meteorological data provided by the Finnish Meteorological Institute (FMI). FMI opened its data in 2013, making basically all of its data freely available in machine-readable formats. The data portal follows INSPIRE requirements and provides metadata, data, models, and services. Various types of observational and forecast data are available, including weather, marine, and radar data as well as lightning strikes and model outputs.
Finnish Meteorological Institute is opening its weather data. Slides kept in Aaltoes Insights event describes first insights about open data portal and what is going to be opened.
The Finnish Meteorological Institute opened its meteorological data in 2013, making everything it owns available in open, machine-readable formats through a single data portal. The portal follows INSPIRE requirements and provides metadata, data, models and services. A variety of weather and climate datasets are available, including observations, forecasts, radar images and more. Standards like OGC and INSPIRE are used to ensure interoperability.
Finnish Meteorological Institute conducted the impact assesment of its open data. The survey was employed by Spatineo. FMI open data portal gets over 10 data requests each second and the open data have remarkable affect on Finnish society.
The document provides information about the Finnish Meteorological Institute (FMI) including:
- FMI has roughly 650 full-time employees split between research and operational services related to public safety, commercial, and other sectors.
- FMI's software development team consists of 40-50 developers working across several units, with all new development done as open source.
- In 2013, FMI began openly providing its data in machine-readable formats through an open data portal.
We predict train delays caused by bad weather using ML. The model is trained with weather observation and then employed to weather forecast output to predict upcoming delays. The prediction can be done 2 days ahead with 1 hour interval.
FMI Open Data on AWS Public dataset programRoope Tervo
The Finnish Meteorological Institute (FMI) has begun distributing some of its open data via Amazon Web Services (AWS) cloud platform. This includes weather data from the HIRLAM model covering Europe, as well as air quality data from the global SILAM model. FMI data on AWS is freely accessible through Amazon S3 buckets and includes near-real time and forecast data. Making FMI data available on AWS expands its potential audience and allows certain users like those needing full model datasets to more conveniently access and analyze the data.
Why we need open data and how should we provide it. FMI provides the same data in its own open data portal but also in AWS public dataset program. Different use cases require different services and channels. Presentation kept in AWS pop-up loft in Stockholm 2018.
Why we need open data? FMI Open Data on AWSRoope Tervo
Why we need open data and how should we provide it. FMI provides the same data in its own open data portal but also in AWS public dataset program. Different use cases require different services and channels.
The Finnish Meteorological Institute (FMI) opened its data in 2013, making basically all of its data with property rights publicly available in machine-readable formats. This includes near real-time and historical weather and climate data. The data is distributed through FMI's Open Data Portal, which follows INSPIRE requirements, as well as on Amazon Web Services (AWS) cloud platform through Amazon S3 buckets as part of a two-year pilot project to increase access and use of weather data. The AWS buckets contain HIRLAM surface and pressure level weather model data for Europe.
Possibilities of Open Source Code. FMI has a strong open source initiative and many open source software.
Presented at WMO Executive Council (EC-69) Side-Event.
The document summarizes performance tests conducted on a WMS backend for a new weather map client. Estimates suggested the backend may receive up to 5000 requests per second. Initial tests at 2000 and 4000 requests per second found the setup performed well with layers pre-tiled and the load balancer caching many requests. However, vulnerabilities were identified if untiled layers or many different layers were requested. Further optimization of the client was recommended to reduce load on the backend.
The document discusses the Finnish Meteorological Institute's (FMI) open data portal, which follows INSPIRE requirements and serves as both an open data and INSPIRE portal. It provides meteorological and environmental data in various formats, including GML, netCDF, GeoTIFF, and others. FMI uses different data models like MultiPointCoverage, MeasurementTimeseries, and simple features to encode observations, forecasts, and other data types for INSPIRE compliance.
The Finnish Meteorological Institute (FMI) opened its data in 2013, making everything it has property rights to freely available in machine-readable formats. FMI's open data portal follows INSPIRE requirements and works as both an open data and INSPIRE portal. FMI provides data using various INSPIRE data models like MultiPointCoverage, MeasurementTimeSeries, and simple features. Common data types include observations, point forecasts, radar images, and gridded forecasts in formats like Grib and NetCDF.
Finnish Meteorological Institute conducted the impact assesment of its open data. The survey was employed by Spatineo. FMI open data portal gets over 10 data requests each second and the open data have remarkable affect on Finnish society.
The document provides information about the Finnish Meteorological Institute (FMI) including:
- FMI has roughly 650 full-time employees split between research and operational services related to public safety, commercial, and other sectors.
- FMI's software development team consists of 40-50 developers working across several units, with all new development done as open source.
- In 2013, FMI began openly providing its data in machine-readable formats through an open data portal.
We predict train delays caused by bad weather using ML. The model is trained with weather observation and then employed to weather forecast output to predict upcoming delays. The prediction can be done 2 days ahead with 1 hour interval.
FMI Open Data on AWS Public dataset programRoope Tervo
The Finnish Meteorological Institute (FMI) has begun distributing some of its open data via Amazon Web Services (AWS) cloud platform. This includes weather data from the HIRLAM model covering Europe, as well as air quality data from the global SILAM model. FMI data on AWS is freely accessible through Amazon S3 buckets and includes near-real time and forecast data. Making FMI data available on AWS expands its potential audience and allows certain users like those needing full model datasets to more conveniently access and analyze the data.
Why we need open data and how should we provide it. FMI provides the same data in its own open data portal but also in AWS public dataset program. Different use cases require different services and channels. Presentation kept in AWS pop-up loft in Stockholm 2018.
Why we need open data? FMI Open Data on AWSRoope Tervo
Why we need open data and how should we provide it. FMI provides the same data in its own open data portal but also in AWS public dataset program. Different use cases require different services and channels.
The Finnish Meteorological Institute (FMI) opened its data in 2013, making basically all of its data with property rights publicly available in machine-readable formats. This includes near real-time and historical weather and climate data. The data is distributed through FMI's Open Data Portal, which follows INSPIRE requirements, as well as on Amazon Web Services (AWS) cloud platform through Amazon S3 buckets as part of a two-year pilot project to increase access and use of weather data. The AWS buckets contain HIRLAM surface and pressure level weather model data for Europe.
Possibilities of Open Source Code. FMI has a strong open source initiative and many open source software.
Presented at WMO Executive Council (EC-69) Side-Event.
The document summarizes performance tests conducted on a WMS backend for a new weather map client. Estimates suggested the backend may receive up to 5000 requests per second. Initial tests at 2000 and 4000 requests per second found the setup performed well with layers pre-tiled and the load balancer caching many requests. However, vulnerabilities were identified if untiled layers or many different layers were requested. Further optimization of the client was recommended to reduce load on the backend.
The document discusses the Finnish Meteorological Institute's (FMI) open data portal, which follows INSPIRE requirements and serves as both an open data and INSPIRE portal. It provides meteorological and environmental data in various formats, including GML, netCDF, GeoTIFF, and others. FMI uses different data models like MultiPointCoverage, MeasurementTimeseries, and simple features to encode observations, forecasts, and other data types for INSPIRE compliance.
The Finnish Meteorological Institute (FMI) opened its data in 2013, making everything it has property rights to freely available in machine-readable formats. FMI's open data portal follows INSPIRE requirements and works as both an open data and INSPIRE portal. FMI provides data using various INSPIRE data models like MultiPointCoverage, MeasurementTimeSeries, and simple features. Common data types include observations, point forecasts, radar images, and gridded forecasts in formats like Grib and NetCDF.
3. 1. Katalogi
9/3/13 3
Etsitään oleellinen aineisto
• Haun voi tehdä esimerkiksi kiinnostavan alueen
perusteella tai ilmiön perusteella
http://catalog.fmi.fi
4. 1. Katalogi
9/3/13 4
Etsitään oleellinen aineisto
• Haun voi tehdä esimerkiksi kiinnostavan alueen
perusteella tai ilmiön perusteella
http://catalog.fmi.fi
Tarjolla on hetkellisiä lämpötila-arvoja
vuodesta 2010 ja lämpötilan päivä- ja
kuukausikeskiarvoja vuodesta 1959
6. 3. Aineiston lataaminen Exceliin
9/3/13 6
Excel 2013 ymmärtää WFS-vastauksia
jollain tasolla
• Käytettävä osoite löytyy esimerkiksi
katalogista
• Lisäksi kyselyyn lisättävä vielä halutut
päivämäärät
http://data.fmi.fi/fmi-
apikey/.../wfs?request=getFeature&storedquery_id=fmi::observations
::weather::monthly::timevaluepair&crs=EPSG::3067&fmisid=100971
&starttime=1972-07-01T00:00:00Z&endtime=1972-08-01T00:00:00Z
7. 4. Aineiston tarkasteleminen PanoPly:llä
9/3/13 7
Kuukausinaineistoja löytyy myös hilaan
interpoloituna
• Kaikki ladattavissa olevat aineistot
löytyvät manuaalista
http://en.ilmatieteenlaitos.fi/open-data-manual-fmi-wfs-services
8. 4. Aineiston tarkasteleminen PanoPly:llä
9/3/13 8
Kuukausinaineistoja löytyy myös hilaan
interpoloituna
• Kaikki ladattavissa olevat aineistot
löytyvät manuaalista
Käytettävä tallennettu kysely on
fmi::observations::weather::monthly::grid
Käytettävä osoite on
http://data.fmi.fi/fmi-
apikey/.../wfs?request=GetFeature&storedquery
_id=fmi::observations::weather::monthly::grid
9. 4. Aineiston tarkasteleminen PanoPly:llä
9/3/13 9
• WFS-vastauksesta löytyy ladattavan aineiston
tietoja sekä linkki itse dataan
• http://data.fmi.fi/fmi-
apikey/.../download?producer=monthly¶m=MonthlyMeanTemperature,MonthlyPrecipit
ation&bbox=15.9689043139365,59.6117693413028,33.0613124198255,70.079878444138
9&origintime=1961-01-01T00:00:00Z&starttime=1972-07-01T00:00:00Z&endtime=1972-
08-01T00:00:00Z&format=grib2&projection=epsg:4326
• Lataamalla aineiston omalle koneelleen, voi sitä
tarkastella erilaisilla avoimen lähdekoodin
ohjelmilla
• PanoPly, IDV
• Huom! Koko aineisto on kokonaisuudessaan 3.2 G suuri.