Taming Our Case Management Database and GIS with FME
•Download as PPTX, PDF•
0 likes•252 views
With a strong economy and a rapidly growing urban area, Austin attracts considerable development interest. Some of the key indicators of future changes in the built environment include the applications for site plans, subdivisions, and zoning changes which are filed with the City of Austin for approval. Processing this information is vital in understanding changes in land use, and developing strategies to plan for the impacts of incoming development. This presentation will look at how the City of Austin leveraged FME to create a process to automate the creation and publication of geospatial and non-geospatial datasets for applications for site plans, subdivisions and zoning changes to disseminate information to the public as well as other city departments and organizations.
Report
Share
Report
Share
Recommended
Using FME to Support Asset Management
The City of Santa Rosa Utilities Department uses FME for key GIS data processing and integration tasks that support several city-wide asset management initiatives. For example, FME is used to convert data from/to CAD, Enterprise Geodatabase, SQL, Access, shapefile and other formats. FME proved to be a vital component in a recent project involving loading a new Enterprise Geodatabase from CAD and prepping that data for integration with a Hansen Maintenance Management System in SQL for Sewer and Water infrastructure. This presentation will highlight the role FME plays within these projects, as well as other Asset Management applications.
If you give a GIS Analyst FME License, then...
For many organizations, which initially adopted FME for basic format conversion, data extraction, and transformation tasks, its use has evolved to include systems integrations and even to creating ready-to-use solutions that include data, analytics, and web applications. We will show examples of FME Desktop and FME Server applications for systems integrations, including CAD to GIS conversion and integration between ESRI ArcGIS Online, ArcGIS Enterprise, and Microsoft SQL Spatial. We will also demonstrate self-serving apps on FME Server.
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
Converting between CAD and GIS is a common requirement for projects involving infrastructure, buildings, city plans, and more. Unfortunately, the workflow presents many challenges, like translating geometry, attributes, annotations, symbology, geolocation, and other elements.
So how do you allow data to flow freely between these disparate data types, without losing the precision offered by CAD and the spatial context offered by GIS?
This webinar will explore the power of automated data integration workflows for CAD and GIS.
First, we’ll discuss challenges and scenarios for CAD-to-GIS translations, and demo how to use FME to power a digital plan submission portal that validates CAD data and integrates it into the central GIS repository. Next, we’ll discuss challenges and scenarios for GIS-to-CAD conversions, and demo how to build an automated FME workflow for requesting CAD data from GIS.
At the end of the webinar, you'll know how to achieve harmony between CAD & GIS by automating its integration.
BIM-based Enterprise GIS Workflows for Facilities Management with QA/QC
Modern GIS for facilities management has an increasing trend for utilizing BIM. Each year GIS industry pushes towards 3D, yet most stable workflows leverage 2D where BIM data often needs to go through a set of complicated conversion procedures to be usable. This presentation will include the steps needed to include BIM in an enterprise facilities GIS including data conversion, QA/QC and enterprise integration procedures. The end goal is an increased number of functionalities, yet design for reduced complexity and deployment time.
Using FME to Validate CAD File Submittals for Utilities
In an effort to speed the process of entering proposed developer infrastructure into it's geospatial database, the City of Henderson Department of Utility Services recently began requiring civil engineering designs to be submitted electronically using CAD files following newly developed CAD standards. The City teamed with Consortech to create an FME Workbench to automate validation processing and generate a report to let users know how well the CAD file adheres to the City standards. This presentation will show the results of this FME automated CAD validation project.
Automated Bulk Conversion of 250,000+ CAD and Corresponding Raster Files to PDF
This document describes how an utility company with over 250,000 CAD files converted those files and their associated raster files to PDF format for improved accessibility and use in the field. FME was used to automate the bulk conversion process. Workspaces were created to copy files to a temp directory, merge files, and generate individual PDFs for each CAD file along with any borders or rasters. The process was run on an FME Server with 10 engines to improve performance. A long-term automated solution was also configured to run hourly and only process new or modified files.
FME: Not Just for ETL
FME is typically used to exchange data, but it can also be used as a powerful tool to automate the transformation of spatial data into technical CAD diagrams. In this presentation I will show how I embedded FME into an application process to create on-the-fly AutoCAD diagrams for communication manholes. This involves determining the local spatial reference, calculating the extents required, clipping the data, creating labels for the data, filtering the data to set line colors and styles, and then exporting the file using linked workspaces.
MicroStation DGN: How to Integrate CAD and GIS
This document discusses converting CAD data to GIS formats and some of the challenges involved. It describes problems with representing parcel/block boundaries and attributes when converting CAD data to GIS and shows the workflow and outputs. It also details issues with converting elevation points and lines from CAD formats where the elevation is stored as text not linked to the features. The document proposes solutions like representing the data as 3D points and lines in GIS and meeting specification requirements. Later sections discuss converting GIS data to CAD formats and blending MicroStation and lidar datasets to model 3D buildings.
Recommended
Using FME to Support Asset Management
The City of Santa Rosa Utilities Department uses FME for key GIS data processing and integration tasks that support several city-wide asset management initiatives. For example, FME is used to convert data from/to CAD, Enterprise Geodatabase, SQL, Access, shapefile and other formats. FME proved to be a vital component in a recent project involving loading a new Enterprise Geodatabase from CAD and prepping that data for integration with a Hansen Maintenance Management System in SQL for Sewer and Water infrastructure. This presentation will highlight the role FME plays within these projects, as well as other Asset Management applications.
If you give a GIS Analyst FME License, then...
For many organizations, which initially adopted FME for basic format conversion, data extraction, and transformation tasks, its use has evolved to include systems integrations and even to creating ready-to-use solutions that include data, analytics, and web applications. We will show examples of FME Desktop and FME Server applications for systems integrations, including CAD to GIS conversion and integration between ESRI ArcGIS Online, ArcGIS Enterprise, and Microsoft SQL Spatial. We will also demonstrate self-serving apps on FME Server.
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
Converting between CAD and GIS is a common requirement for projects involving infrastructure, buildings, city plans, and more. Unfortunately, the workflow presents many challenges, like translating geometry, attributes, annotations, symbology, geolocation, and other elements.
So how do you allow data to flow freely between these disparate data types, without losing the precision offered by CAD and the spatial context offered by GIS?
This webinar will explore the power of automated data integration workflows for CAD and GIS.
First, we’ll discuss challenges and scenarios for CAD-to-GIS translations, and demo how to use FME to power a digital plan submission portal that validates CAD data and integrates it into the central GIS repository. Next, we’ll discuss challenges and scenarios for GIS-to-CAD conversions, and demo how to build an automated FME workflow for requesting CAD data from GIS.
At the end of the webinar, you'll know how to achieve harmony between CAD & GIS by automating its integration.
BIM-based Enterprise GIS Workflows for Facilities Management with QA/QC
Modern GIS for facilities management has an increasing trend for utilizing BIM. Each year GIS industry pushes towards 3D, yet most stable workflows leverage 2D where BIM data often needs to go through a set of complicated conversion procedures to be usable. This presentation will include the steps needed to include BIM in an enterprise facilities GIS including data conversion, QA/QC and enterprise integration procedures. The end goal is an increased number of functionalities, yet design for reduced complexity and deployment time.
Using FME to Validate CAD File Submittals for Utilities
In an effort to speed the process of entering proposed developer infrastructure into it's geospatial database, the City of Henderson Department of Utility Services recently began requiring civil engineering designs to be submitted electronically using CAD files following newly developed CAD standards. The City teamed with Consortech to create an FME Workbench to automate validation processing and generate a report to let users know how well the CAD file adheres to the City standards. This presentation will show the results of this FME automated CAD validation project.
Automated Bulk Conversion of 250,000+ CAD and Corresponding Raster Files to PDF
This document describes how an utility company with over 250,000 CAD files converted those files and their associated raster files to PDF format for improved accessibility and use in the field. FME was used to automate the bulk conversion process. Workspaces were created to copy files to a temp directory, merge files, and generate individual PDFs for each CAD file along with any borders or rasters. The process was run on an FME Server with 10 engines to improve performance. A long-term automated solution was also configured to run hourly and only process new or modified files.
FME: Not Just for ETL
FME is typically used to exchange data, but it can also be used as a powerful tool to automate the transformation of spatial data into technical CAD diagrams. In this presentation I will show how I embedded FME into an application process to create on-the-fly AutoCAD diagrams for communication manholes. This involves determining the local spatial reference, calculating the extents required, clipping the data, creating labels for the data, filtering the data to set line colors and styles, and then exporting the file using linked workspaces.
MicroStation DGN: How to Integrate CAD and GIS
This document discusses converting CAD data to GIS formats and some of the challenges involved. It describes problems with representing parcel/block boundaries and attributes when converting CAD data to GIS and shows the workflow and outputs. It also details issues with converting elevation points and lines from CAD formats where the elevation is stored as text not linked to the features. The document proposes solutions like representing the data as 3D points and lines in GIS and meeting specification requirements. Later sections discuss converting GIS data to CAD formats and blending MicroStation and lidar datasets to model 3D buildings.
How to Automate CAD & GIS Integration
Converting between CAD and GIS is a common requirement for projects involving infrastructure, buildings, city plans, and more. Unfortunately, the workflow presents many challenges, like translating geometry, attributes, annotations, symbology, geolocation, and other elements. So how do you allow data to flow freely between these disparate data types, without losing the precision offered by CAD and the spatial context offered by GIS?
This webinar will explore the power of automated data integration workflows for CAD and GIS. First, we’ll discuss challenges and scenarios for CAD-to-GIS translations, and demo how to use FME to power a digital plan submission portal that validates CAD data and integrates it into the central GIS repository. Next, we’ll discuss challenges and scenarios for GIS-to-CAD conversions, and demo how to build an automated FME workflow for requesting CAD data from GIS.
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
Converting between CAD and GIS is a common requirement for projects involving infrastructure, buildings, city plans, and more. Unfortunately, the workflow presents many challenges, like translating geometry, attributes, annotations, symbology, geolocation, and other elements.
So how do you allow data to flow freely between these disparate data types, without losing the precision offered by CAD and the spatial context offered by GIS?
This webinar will explore the power of automated data integration workflows for CAD and GIS.
First, we’ll discuss challenges and scenarios for CAD-to-GIS translations, and demo how to use FME to power a digital plan submission portal that validates CAD data and integrates it into the central GIS repository. Next, we’ll discuss challenges and scenarios for GIS-to-CAD conversions, and demo how to build an automated FME workflow for requesting CAD data from GIS.
At the end of the webinar, you'll know how to achieve harmony between CAD & GIS by automating its integration.
Hydraulic Modelling with GIS Data
Presented by Ted Norcott, Harry Bhandal from FortisBC
FME is used to extract and prepare Smallworld GIS data for System Planning’s hydraulic modeling software (Winflow). We will explain how this requirement came about, how the information is extracted, manipulated, and used within Winflow.
Utilities Industry Success Stories with FME
Find out how different utilities around the world are using FME, including several case studies and guest presenters from Georgia Power.
MCE GeoProcessing Services for ADM(IE): Self Validation of Spatial Data Input...
The Department of National Defence (DND) is developing a central repository for land, building, and infrastructure data. This a joint project between the Assistant Deputy Minister Infrastructure and Environment (ADMIE) and the Mapping and Charting Establishment (MCE). This project involves managing DND real property and other spatial data provided by DND bases and wings across Canada through a unique, integrated and standardized Real Property Spatial Data Warehouse (RPSDW), hosted at MCE, containing a SQL Server database. Data provided by DND bases and wings must meet standards defined and documented by ADMIE, in terms of data formats accepted (GeoMedia MDB, ArcGIS FGDB, MapInfo MIF or AutoCAD SDF), geometry, schema and attribute data types, domains and accepted values for each feature class. An FME workspace and an equivalent tool contained within an ArcGIS Data Interoperability Toolbox were created to provide the geotechs from DND Bases using ArcGIS Data Interoperability or FME Desktop with a toolset, delivered together with a user’s guide, that allows them to perform a self-validation of the DND real property and other spatial data before these data is sent to MCE to be loaded into the RPSDW SQL Server database.
Using FME for the City of Palo Alto Topobase Implentation
As presented by Drew Burgasser of CAD Masters
Abstract: The City of Palo department of utilities (CPAU) implemented Autodesk Topobase as part of their Geospatial Design and Management Project. This presentation will demonstate how FME was used to convert data from AutoCAD to Oracle for CPAU.
Open Source GIS Workshop
This is a presentation I found in my archive from a long time back. Boy, Open Source GIS has come a LONG way.
FME & Governement
Presented by Todd Lewis, Sr. Applications Specialist with Consortech
Abstract: Open Data Initiates allow application developers to build customized mobile applications based upon data provided by local municipalities. Since 2005 Open Data Initiatives in Canada and the US have led to unprecedented sharing of data, and innovation in the mobile space, providing access to or information regarding city services. This topic will introduce users the enabling technologies behind Open Data services, and demonstrate how to: save time and resources in preparation and publishing of disparate data (tabular, GIS, and Real-Time); enable innovation within their local development community; and deliver better services to residents, businesses, and tourists.
Spatialware_2_Sql08
- Cumberland County NC has a population of approximately 320,000 and maintains E911 addressing for over 131,000 addresses within the county as well as for Ft. Bragg military base.
- The document compares features of Spatialware and SQL Server 2008 for working with spatial data and discusses challenges faced in converting from Spatialware to SQL Server 2008 such as changes to spatial function syntax and primary keys.
- Implementation examples provided include using stored procedures and triggers to implement business rules on spatial data as well as creating spatial views for mapping and reporting.
Linear Referencing (LRS): How FME Measures Up
Unleash FME's hidden potential for Linear Referencing System (LRS) workflows. Learn how to work with FME's LRS tools to support your measures, events and route geometries.
You'll also see how FME can switch between LRS datasets and a segmented LRS model, to allow others to view the data in more traditional GIS platforms. Plus, hear how Bo Guo of GISTEC is helping his customers use FME to solve their LRS problems.
How to Easily Read and Write CityGML Data (Without Coding)
3D geospatial and GeoBIM data can be notoriously difficult to share. They are both often massive, detailed, and when combined into a single dataset, anything but user-friendly.
Fortunately, for all those who work with these types of urban scale 3D datasets: CityGML is your interoperability solution. With CityGML, you can easily exchange 3D data at various levels of detail. It’s internationally embraced as a cost-effective solution for disaster management, facility management, navigation, environmental simulations, and city planning.
Join us to see how you can read and write data to CityGML, and how it fits into the whole picture of GeoBIM, so you can gain interoperability over your most difficult datasets. We’ll show you how you can:
- Move data between CityGML, Sketchup, MUDDI, CAD, Revit, etc., all without coding
- Change 2D data to 3D for use in CityGML
- Get your preferred level of detail by simplifying models or increasing detail
- Work with nested object-oriented CityGML and more
- Become inspired by customer use cases
By using FME to manage data for CityGML, you can freely exchange data and use it for visualizations and spatial analysis.
1Spatial: Cardiff FME World Tour: Time machines and attribute alchemy
1. Attribute transformation is a key part of ETL work like data migration and involves techniques for parsing, formatting, and extracting attribute values.
2. Date/time attributes require special handling using datetime transformers and functions to deal with inconsistent formats, time zones, and calculations. Regular expressions and string functions help match patterns and extract substrings from attributes.
3. The document provides examples of using regular expressions and string functions in FME to clean up attribute values by extracting parts of strings, validating addresses, and finding postal codes.
How to Easily Read and Write CityGML Data Using FME
CityGML has the potential to broaden the amount and quality of spatial data that is available for use in 3D modelling software. Across the globe, an increasing number of cities and companies are building virtual 3D city models for use in various areas including urban planning, disaster management, navigation and environmental simulations. Learn how FME can help you easily convert, restructure, integrate and distribute this CityGML data to use and share in more than 300 different formats.
Under the hood of the Altalis Platform
With the implementation of the new Altalis Platform, Altalis continues to distribute a variety of spatial data products in various formats that span Alberta and elsewhere. To fulfill translation requests, a number of factors determine the automated workflow, such as by a data update or delivery task, by product, by format, and more. We will showcase how we used FME Workbench and FME Server as a core component of the application platform to perform the translations and the optimizations we implemented.
5 Ways to Improve Your LiDAR Workflows
This document discusses 5 ways to improve LiDAR workflows using FME software. It begins with an overview of LiDAR and point clouds before addressing each of the 5 ways: 1) simplifying point cloud transformations with FME transformers, 2) preparing data, 3) automating surface model creation, 4) visualizing solutions through 3D city modeling, and 5) expanding tools with FME Hub and third party tools like LAStools. The presentation concludes by emphasizing how FME can help simplify and scale LiDAR workflows.
(ATS3-PLAT09) Advanced Reporting Customizations and Applications
The Reporting Collection offers many opportunities to provide rich and highly interactive reports, and “mini-web applications”. This session will cover a wide range of topics, illustrated with examples, including: Data Connector, Expression-readiness, Nested Reporting Elements, JavaScript examples, protocol linking, HTML Template, and Rich Tooltips.
Cgp lecture2 graphics_standard, opengl
This document discusses graphics standards and device independent graphics programming. It describes early graphics APIs like GKS and PHIGS that aimed for portability. OpenGL was successful due to its simple architecture and ability to access hardware acceleration. WebGL is based on OpenGL ES and provides 3D graphics in HTML5 canvas using JavaScript. Different APIs operate at different levels, with lower-level APIs like OpenGL dealing directly with rendering and higher-level APIs handling scene organization.
Real Property Management at DND using FME
This document discusses how the Department of National Defence (DND) uses FME software to manage its real property information. DND has distributed real property data from various sources that needs to be fused together to understand assets. FME is currently used for data translation and migrating legacy data to geodatabases. Future plans include using FME for CAD to GIS migration, building information modeling support, and enforcing data standards by transferring data between levels into a central warehouse. Examples demonstrated include converting CAD files to geodatabases and building information files to CSV and 3D PDF formats.
Planes, Trains and Automobiles – Handling Infrastructure Assets with FME
From airports to railways to roads, infrastructure asset handling is a complex task that inevitably involves a wide range of incompatible formats given the different applications and standards involved in design, management and data exchange. Using real cases, this webinar will demonstrate how FME can overcome data interoperability challenges commonly encountered in infrastructure asset handling and streamline processes.
Smallworld 5 Migration Experiences
Learn what to expect when migrating existing Smallworld applications to version 5 and how to prepare for the migration. The presentation was conducted at the International Software Summit 2016, held by GE Grid Solutions in Sorrento, Italy. Feel free to contact us for more details: contact@globema.com
Sandeep Grandhi (1)
Sandeep Grandhi has over 6 years of experience in data warehousing and ETL development. He currently works as a Technology Analyst at Infosys where he has led several projects involving extracting data from various sources such as Salesforce, Oracle, and flat files and loading it into data warehouses. Some of the key projects he has worked on include migrating a CRM platform from STARS to Salesforce and building a compliance data repository for a bank.
From Data to Maps to Docs: Turn Days into Minutes with Automated Integration
Report generation used to take the Valuations Office in Ireland 20 tedious, long hours per report. Now, it's down to just 3 minutes: saving roughly 42,000 hours annually.
In this first of two parts webinar series, join us and special guest Philip Jacob to learn how they made this possible, and how you can capture time savings like this too by converting data using the Mapnik Rasterizer and FME.
To follow Philips' story, Scenario Specialist Dmitri Bagh will walk you through the basics of understanding and getting started with the Mapnik Rasterizer. You'll learn how to generate beautiful raster imagery and save time with FME’s ability to integrate data from 500+ sources.
You’ll also see how to optimize data before it reaches Mapnik -- including the ability to perform a wide range of geometry transformations. And with the MapnikRasterizer transformer, all of this is done with scalable and automated workflows at your fingertips -- no Python, XML or CSS needed.
P.S. Stay tuned in the New Year for the announcement of a second Data Democratization webinar to complete this series: creating Microsoft Word documents with FME.
More Related Content
What's hot
How to Automate CAD & GIS Integration
Converting between CAD and GIS is a common requirement for projects involving infrastructure, buildings, city plans, and more. Unfortunately, the workflow presents many challenges, like translating geometry, attributes, annotations, symbology, geolocation, and other elements. So how do you allow data to flow freely between these disparate data types, without losing the precision offered by CAD and the spatial context offered by GIS?
This webinar will explore the power of automated data integration workflows for CAD and GIS. First, we’ll discuss challenges and scenarios for CAD-to-GIS translations, and demo how to use FME to power a digital plan submission portal that validates CAD data and integrates it into the central GIS repository. Next, we’ll discuss challenges and scenarios for GIS-to-CAD conversions, and demo how to build an automated FME workflow for requesting CAD data from GIS.
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
Converting between CAD and GIS is a common requirement for projects involving infrastructure, buildings, city plans, and more. Unfortunately, the workflow presents many challenges, like translating geometry, attributes, annotations, symbology, geolocation, and other elements.
So how do you allow data to flow freely between these disparate data types, without losing the precision offered by CAD and the spatial context offered by GIS?
This webinar will explore the power of automated data integration workflows for CAD and GIS.
First, we’ll discuss challenges and scenarios for CAD-to-GIS translations, and demo how to use FME to power a digital plan submission portal that validates CAD data and integrates it into the central GIS repository. Next, we’ll discuss challenges and scenarios for GIS-to-CAD conversions, and demo how to build an automated FME workflow for requesting CAD data from GIS.
At the end of the webinar, you'll know how to achieve harmony between CAD & GIS by automating its integration.
Hydraulic Modelling with GIS Data
Presented by Ted Norcott, Harry Bhandal from FortisBC
FME is used to extract and prepare Smallworld GIS data for System Planning’s hydraulic modeling software (Winflow). We will explain how this requirement came about, how the information is extracted, manipulated, and used within Winflow.
Utilities Industry Success Stories with FME
Find out how different utilities around the world are using FME, including several case studies and guest presenters from Georgia Power.
MCE GeoProcessing Services for ADM(IE): Self Validation of Spatial Data Input...
The Department of National Defence (DND) is developing a central repository for land, building, and infrastructure data. This a joint project between the Assistant Deputy Minister Infrastructure and Environment (ADMIE) and the Mapping and Charting Establishment (MCE). This project involves managing DND real property and other spatial data provided by DND bases and wings across Canada through a unique, integrated and standardized Real Property Spatial Data Warehouse (RPSDW), hosted at MCE, containing a SQL Server database. Data provided by DND bases and wings must meet standards defined and documented by ADMIE, in terms of data formats accepted (GeoMedia MDB, ArcGIS FGDB, MapInfo MIF or AutoCAD SDF), geometry, schema and attribute data types, domains and accepted values for each feature class. An FME workspace and an equivalent tool contained within an ArcGIS Data Interoperability Toolbox were created to provide the geotechs from DND Bases using ArcGIS Data Interoperability or FME Desktop with a toolset, delivered together with a user’s guide, that allows them to perform a self-validation of the DND real property and other spatial data before these data is sent to MCE to be loaded into the RPSDW SQL Server database.
Using FME for the City of Palo Alto Topobase Implentation
As presented by Drew Burgasser of CAD Masters
Abstract: The City of Palo department of utilities (CPAU) implemented Autodesk Topobase as part of their Geospatial Design and Management Project. This presentation will demonstate how FME was used to convert data from AutoCAD to Oracle for CPAU.
Open Source GIS Workshop
This is a presentation I found in my archive from a long time back. Boy, Open Source GIS has come a LONG way.
FME & Governement
Presented by Todd Lewis, Sr. Applications Specialist with Consortech
Abstract: Open Data Initiates allow application developers to build customized mobile applications based upon data provided by local municipalities. Since 2005 Open Data Initiatives in Canada and the US have led to unprecedented sharing of data, and innovation in the mobile space, providing access to or information regarding city services. This topic will introduce users the enabling technologies behind Open Data services, and demonstrate how to: save time and resources in preparation and publishing of disparate data (tabular, GIS, and Real-Time); enable innovation within their local development community; and deliver better services to residents, businesses, and tourists.
Spatialware_2_Sql08
- Cumberland County NC has a population of approximately 320,000 and maintains E911 addressing for over 131,000 addresses within the county as well as for Ft. Bragg military base.
- The document compares features of Spatialware and SQL Server 2008 for working with spatial data and discusses challenges faced in converting from Spatialware to SQL Server 2008 such as changes to spatial function syntax and primary keys.
- Implementation examples provided include using stored procedures and triggers to implement business rules on spatial data as well as creating spatial views for mapping and reporting.
Linear Referencing (LRS): How FME Measures Up
Unleash FME's hidden potential for Linear Referencing System (LRS) workflows. Learn how to work with FME's LRS tools to support your measures, events and route geometries.
You'll also see how FME can switch between LRS datasets and a segmented LRS model, to allow others to view the data in more traditional GIS platforms. Plus, hear how Bo Guo of GISTEC is helping his customers use FME to solve their LRS problems.
How to Easily Read and Write CityGML Data (Without Coding)
3D geospatial and GeoBIM data can be notoriously difficult to share. They are both often massive, detailed, and when combined into a single dataset, anything but user-friendly.
Fortunately, for all those who work with these types of urban scale 3D datasets: CityGML is your interoperability solution. With CityGML, you can easily exchange 3D data at various levels of detail. It’s internationally embraced as a cost-effective solution for disaster management, facility management, navigation, environmental simulations, and city planning.
Join us to see how you can read and write data to CityGML, and how it fits into the whole picture of GeoBIM, so you can gain interoperability over your most difficult datasets. We’ll show you how you can:
- Move data between CityGML, Sketchup, MUDDI, CAD, Revit, etc., all without coding
- Change 2D data to 3D for use in CityGML
- Get your preferred level of detail by simplifying models or increasing detail
- Work with nested object-oriented CityGML and more
- Become inspired by customer use cases
By using FME to manage data for CityGML, you can freely exchange data and use it for visualizations and spatial analysis.
1Spatial: Cardiff FME World Tour: Time machines and attribute alchemy
1. Attribute transformation is a key part of ETL work like data migration and involves techniques for parsing, formatting, and extracting attribute values.
2. Date/time attributes require special handling using datetime transformers and functions to deal with inconsistent formats, time zones, and calculations. Regular expressions and string functions help match patterns and extract substrings from attributes.
3. The document provides examples of using regular expressions and string functions in FME to clean up attribute values by extracting parts of strings, validating addresses, and finding postal codes.
How to Easily Read and Write CityGML Data Using FME
CityGML has the potential to broaden the amount and quality of spatial data that is available for use in 3D modelling software. Across the globe, an increasing number of cities and companies are building virtual 3D city models for use in various areas including urban planning, disaster management, navigation and environmental simulations. Learn how FME can help you easily convert, restructure, integrate and distribute this CityGML data to use and share in more than 300 different formats.
Under the hood of the Altalis Platform
With the implementation of the new Altalis Platform, Altalis continues to distribute a variety of spatial data products in various formats that span Alberta and elsewhere. To fulfill translation requests, a number of factors determine the automated workflow, such as by a data update or delivery task, by product, by format, and more. We will showcase how we used FME Workbench and FME Server as a core component of the application platform to perform the translations and the optimizations we implemented.
5 Ways to Improve Your LiDAR Workflows
This document discusses 5 ways to improve LiDAR workflows using FME software. It begins with an overview of LiDAR and point clouds before addressing each of the 5 ways: 1) simplifying point cloud transformations with FME transformers, 2) preparing data, 3) automating surface model creation, 4) visualizing solutions through 3D city modeling, and 5) expanding tools with FME Hub and third party tools like LAStools. The presentation concludes by emphasizing how FME can help simplify and scale LiDAR workflows.
(ATS3-PLAT09) Advanced Reporting Customizations and Applications
The Reporting Collection offers many opportunities to provide rich and highly interactive reports, and “mini-web applications”. This session will cover a wide range of topics, illustrated with examples, including: Data Connector, Expression-readiness, Nested Reporting Elements, JavaScript examples, protocol linking, HTML Template, and Rich Tooltips.
Cgp lecture2 graphics_standard, opengl
This document discusses graphics standards and device independent graphics programming. It describes early graphics APIs like GKS and PHIGS that aimed for portability. OpenGL was successful due to its simple architecture and ability to access hardware acceleration. WebGL is based on OpenGL ES and provides 3D graphics in HTML5 canvas using JavaScript. Different APIs operate at different levels, with lower-level APIs like OpenGL dealing directly with rendering and higher-level APIs handling scene organization.
Real Property Management at DND using FME
This document discusses how the Department of National Defence (DND) uses FME software to manage its real property information. DND has distributed real property data from various sources that needs to be fused together to understand assets. FME is currently used for data translation and migrating legacy data to geodatabases. Future plans include using FME for CAD to GIS migration, building information modeling support, and enforcing data standards by transferring data between levels into a central warehouse. Examples demonstrated include converting CAD files to geodatabases and building information files to CSV and 3D PDF formats.
Planes, Trains and Automobiles – Handling Infrastructure Assets with FME
From airports to railways to roads, infrastructure asset handling is a complex task that inevitably involves a wide range of incompatible formats given the different applications and standards involved in design, management and data exchange. Using real cases, this webinar will demonstrate how FME can overcome data interoperability challenges commonly encountered in infrastructure asset handling and streamline processes.
Smallworld 5 Migration Experiences
Learn what to expect when migrating existing Smallworld applications to version 5 and how to prepare for the migration. The presentation was conducted at the International Software Summit 2016, held by GE Grid Solutions in Sorrento, Italy. Feel free to contact us for more details: contact@globema.com
What's hot (20)
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
Bridging Between CAD & GIS: 8 Ways to Automate Data Integration
MCE GeoProcessing Services for ADM(IE): Self Validation of Spatial Data Input...
MCE GeoProcessing Services for ADM(IE): Self Validation of Spatial Data Input...
Using FME for the City of Palo Alto Topobase Implentation
Using FME for the City of Palo Alto Topobase Implentation
How to Easily Read and Write CityGML Data (Without Coding)
How to Easily Read and Write CityGML Data (Without Coding)
1Spatial: Cardiff FME World Tour: Time machines and attribute alchemy
1Spatial: Cardiff FME World Tour: Time machines and attribute alchemy
How to Easily Read and Write CityGML Data Using FME
How to Easily Read and Write CityGML Data Using FME
(ATS3-PLAT09) Advanced Reporting Customizations and Applications
(ATS3-PLAT09) Advanced Reporting Customizations and Applications
Planes, Trains and Automobiles – Handling Infrastructure Assets with FME
Planes, Trains and Automobiles – Handling Infrastructure Assets with FME
Similar to Taming Our Case Management Database and GIS with FME
Sandeep Grandhi (1)
Sandeep Grandhi has over 6 years of experience in data warehousing and ETL development. He currently works as a Technology Analyst at Infosys where he has led several projects involving extracting data from various sources such as Salesforce, Oracle, and flat files and loading it into data warehouses. Some of the key projects he has worked on include migrating a CRM platform from STARS to Salesforce and building a compliance data repository for a bank.
From Data to Maps to Docs: Turn Days into Minutes with Automated Integration
Report generation used to take the Valuations Office in Ireland 20 tedious, long hours per report. Now, it's down to just 3 minutes: saving roughly 42,000 hours annually.
In this first of two parts webinar series, join us and special guest Philip Jacob to learn how they made this possible, and how you can capture time savings like this too by converting data using the Mapnik Rasterizer and FME.
To follow Philips' story, Scenario Specialist Dmitri Bagh will walk you through the basics of understanding and getting started with the Mapnik Rasterizer. You'll learn how to generate beautiful raster imagery and save time with FME’s ability to integrate data from 500+ sources.
You’ll also see how to optimize data before it reaches Mapnik -- including the ability to perform a wide range of geometry transformations. And with the MapnikRasterizer transformer, all of this is done with scalable and automated workflows at your fingertips -- no Python, XML or CSS needed.
P.S. Stay tuned in the New Year for the announcement of a second Data Democratization webinar to complete this series: creating Microsoft Word documents with FME.
IoT Ingestion & Analytics using Apache Apex - A Native Hadoop Platform
Internet of Things (IoT) devices are becoming more ubiquitous in consumer, business and industrial landscapes. They are being widely used in applications ranging from home automation to the industrial internet. They pose a unique challenge in terms of the volume of data they produce, and the velocity with which they produce it, and the variety of sources they need to handle. The challenge is to ingest and process this data at the speed at which it is being produced in a real-time and fault tolerant fashion. Apache Apex is an industrial grade, scalable and fault tolerant big data processing platform that runs natively on Hadoop. In this deck, you will see how Apex is being used in IoT applications and also see how the enterprise features such as dimensional analytics, real-time dashboards and monitoring play a key role.
Presented by Pramod Immaneni, Principal Architect at DataTorrent and PPMC member Apache Apex, on BrightTALK webinar on Apr 6th, 2016
Sohail resume
An experienced SAP consultant with over 15 years of experience in ABAP development and configuration of SAP modules including SD, MM, WM, and PP. Experienced in designing interfaces between SAP and other systems, developing custom programs and reports, and performing system implementations, upgrades, and support for clients across various industries.
fmewt19 - Around the world stories master deck
The document contains summaries from various organizations describing how they use FME to solve geospatial data challenges. The summaries are:
1) Suncor Energy automated geospatial data integration to reduce time spent on data tasks from hours to minutes and remove human error.
2) Buccleuch Estates automated farm inspection reports by compiling photos and notes into standardized PDF reports faster than manual methods.
3) Valeron Enviro Consulting visualized windfield data models to create a marketable product for architects by analyzing and calculating the data in FME.
IMGeospatial: FME World Tour 2018 London: Integrating Council Systems and Ser...
This document discusses using FME to integrate council systems and services. It provides case studies from Harrow including an environment app, highways web form, and parking web form. The environment app takes third party reports and passes them to council systems. The highways form processes case files from an SFTP, emails customers, and updates databases. The parking form accesses parking data, pre-populates web forms, and confirms submissions. FME acts as a "data translator" between different systems and languages to enable data sharing and integration across various council services.
Evolving Gas Utility Mapping with FME
This document discusses New Mexico Gas Company's (NMGCO) use of FME to improve its gas utility mapping processes. NMGCO currently maps gas pipelines manually from hand drawings but is moving to a new process where pipeline location and attribute data will be digitally collected in the field using mobile devices and GPS. FME will play a key role by reformatting and transferring data between NMGCO's work order management, GIS, and compliance databases at two points: 1) before field work to populate mobile maps, and 2) after field work to load collected compliance data. The new process is expected to improve location accuracy, data reliability, and reduce errors and data entry time.
Finns Using FME Like Crazy
- 94 customers in Finland use FME, with 74 actively using it. 21 customers use FME Server.
- Examples provided of customers like Caruna using FME for automatic network data quality reporting with over 265 inspection rules, and the City of Vantaa using FME for various data processing, quality control, and map visualizations.
- Spatialworld Oy is an FME reseller and helpdesk that provides training and consultation to customers in Finland, Estonia, and Russia on using FME for tasks like data conversion, processing, analytics, and visualization.
Esri UC 2016 - Central San and the Local Government Information Model
The story of how Central San built a new integrated spatial asset management platform, and how the Esri Local Government Information Model (LGIM) provided the foundation.
IBM Big Data
IBM provides two types of accelerators for big data to speed the development and implementation of specific big data solutions: 1) Analytic accelerators that address specific data types or operations with advanced analytics like text, geospatial, time series, and data mining. 2) Application accelerators that address specific use cases like finance, machine data, social media, and telecommunications event data. The accelerators are packaged software components included with IBM Big Data Platform products at no additional cost to help eliminate complexity and reduce time-to-value for customers' big data deployments.
Ibm big data
IBM provides two types of accelerators for big data to speed the development and implementation of specific big data solutions: 1) Analytic accelerators that address specific data types or operations with advanced analytics; and 2) Application accelerators that address specific use cases and include both industry-specific and cross-industry features. The accelerators are packaged software components that provide business logic, data processing, and visualization capabilities and help eliminate the complexity of building big data applications. Examples of capabilities provided by various accelerators include text analytics, geospatial analysis, time series prediction, data mining, finance analytics, machine data analysis, social media insights, and telecommunications event data processing.
Automated Application Integration with FME & Cityworks Webinar
Cityworks & FME are utilized by cities for processes like asset and land management, natural disaster relief, community services, infrastructure challenges, and utilities to name a few. With the help of FME, data is made accessible wherever the city needs it, which is vital to quick decision-making in the field.
Whether you work for a city or support local government clients, this webinar will showcase the value of application integration and give you the tools to get started.
Join us and special guests David Horton, Rachel Manko & Bryan Chadwick from Cityworks. We’ll start off exploring how the FME Platform can validate, enrich and transform your Cityworks data to ensure that it is always available to those who need it, when they need it. You’ll see real-world customer workflows connecting Cityworks, FME, and Esri ArcGIS web apps. Along the way, discover tips & tricks for leveraging APIs and webhooks for simple and powerful integrations.
Allow your Cityworks data to flow freely from one application to another, enabling data-driven decisions across all departments. Tune in to learn how.
Tableau @ Spil Games
1. Spil Games uses a bottoms-up monthly forecasting process where ARIMA models in R are used to generate initial traffic forecasts for 500 markets/channels which are then loaded into Tableau for exploratory analysis and adjustment.
2. Key business users explore and modify the forecasts in Tableau before the adjusted forecast is loaded back into the data warehouse.
3. Forecasting considers factors like seasonality, known events, and regressors to predict metrics like traffic, gameplays, pageviews, and advertising across markets/channels on a monthly basis.
(Past), Present, and Future of Apache Flink
This document discusses the past, present, and future of Apache Flink. It describes how Flink enables stateful computations over data streams, as well as batch and stream processing. New features in Flink 1.5 include improved integration with resource managers, localized failure recovery, and a 50% rewritten network stack. Upcoming features in Flink 1.6 involve autoscaling, hot-standby replication for high availability, and zero-downtime upgrades. The document concludes that Flink is already the best open-source stream processing system and more exciting features are planned for the future.
Streaming Architecture including Rendezvous for Machine Learning
This was a talk I gave at CMU that talked about the rationale for streaming microservices using the rendezvous architecture as an example.
High Performance Spatial-Temporal Trajectory Analysis with Spark
This document discusses high performance spatial-temporal trajectory analysis using Spark. It covers the background of analyzing mobile signaling data to enable smarter urban planning. The solution architecture includes data sources, distributed file system, computation engine, and visualization. Technical designs address the big data platform, data governance, algorithm models, and Spark spatial computing. Example scenarios are presented for population heatmaps, commute routes, and office-residence imbalance analysis.
CEP - simplified streaming architecture - Strata Singapore 2016
We describe an application of CEP using a microservice-based streaming architecture. We use Drools business rule engine to apply rules in real time to an event stream from IoT traffic sensor data.
1Spatial: Leeds FME World Tour: Extracting value from our FME investment
1. Barnsley MBC has used FME since 2013 to migrate legacy GIS datasets to a SQL Server environment and interface with various software packages. FME is used for operational tasks like data processing, validation, and reporting as well as major projects involving data from over 10 sources.
2. Barnsley implemented SharePoint in 2016 to replace an legacy document management system. FME was used to migrate over 5 million items of content from other systems by extracting data, creating metadata and folders, and loading content into SharePoint via its web services.
3. Barnsley has continued finding new uses of FME with SharePoint for tasks like reporting project status from a SharePoint list, maintaining maps and metadata
SmartMet Server OSGeo
SmartMet Server is a high performance and high availability MetOcean data and product server. It is going to be published as Open Source in 2016.
Next Generation Tooling for building streaming analytics app
George Vetticaden presented on Streaming Analytics Manager (SAM), an open source tool from Hortonworks for building stream analytics applications without coding. SAM allows users to graphically create streaming apps that integrate with systems like Kafka, Storm and Spark Streaming. It also supports real-time predictive analytics through machine learning model scoring and alerting. The presentation demonstrated how SAM could simplify implementing streaming requirements for a use case of monitoring truck fleets, and featured its test mode for validating apps and capabilities for continuous integration.
Similar to Taming Our Case Management Database and GIS with FME (20)
From Data to Maps to Docs: Turn Days into Minutes with Automated Integration
From Data to Maps to Docs: Turn Days into Minutes with Automated Integration
IoT Ingestion & Analytics using Apache Apex - A Native Hadoop Platform
IoT Ingestion & Analytics using Apache Apex - A Native Hadoop Platform
IMGeospatial: FME World Tour 2018 London: Integrating Council Systems and Ser...
IMGeospatial: FME World Tour 2018 London: Integrating Council Systems and Ser...
Esri UC 2016 - Central San and the Local Government Information Model
Esri UC 2016 - Central San and the Local Government Information Model
Automated Application Integration with FME & Cityworks Webinar
Automated Application Integration with FME & Cityworks Webinar
Streaming Architecture including Rendezvous for Machine Learning
Streaming Architecture including Rendezvous for Machine Learning
High Performance Spatial-Temporal Trajectory Analysis with Spark
High Performance Spatial-Temporal Trajectory Analysis with Spark
CEP - simplified streaming architecture - Strata Singapore 2016
CEP - simplified streaming architecture - Strata Singapore 2016
1Spatial: Leeds FME World Tour: Extracting value from our FME investment
1Spatial: Leeds FME World Tour: Extracting value from our FME investment
Next Generation Tooling for building streaming analytics app
Next Generation Tooling for building streaming analytics app
More from Safe Software
Essentials of Automations: Exploring Attributes & Automation Parameters
Building automations in FME Flow can save time, money, and help businesses scale by eliminating data silos and providing data to stakeholders in real-time. One essential component to orchestrating complex automations is the use of attributes & automation parameters (both formerly known as “keys”). In fact, it’s unlikely you’ll ever build an Automation without using these components, but what exactly are they?
Attributes & automation parameters enable the automation author to pass data values from one automation component to the next. During this webinar, our FME Flow Specialists will cover leveraging the three types of these output attributes & parameters in FME Flow: Event, Custom, and Automation. As a bonus, they’ll also be making use of the Split-Merge Block functionality.
You’ll leave this webinar with a better understanding of how to maximize the potential of automations by making use of attributes & automation parameters, with the ultimate goal of setting your enterprise integration workflows up on autopilot.
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Essentials of Automations: Optimizing FME Workflows with Parameters
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
The Zero-ETL Approach: Enhancing Data Agility and Insight
In the ever-evolving landscape of data management, Zero-ETL is an approach that is reshaping how businesses handle and integrate their data. This webinar explores Zero-ETL, a paradigm shift from the traditional Extract, Transform, Load (ETL) process, offering a more streamlined, efficient, and real-time data integration method.
We will begin with an introduction to the concept of Zero-ETL, including how it allows direct access to data in its native environment and real-time data transformation, providing up-to-date information with significantly reduced data redundancy.
Next, we'll take you through several demonstrations showing how Zero-ETL can deliver real-time data and enable the free movement of data between systems. We will also discuss the various tools that support all aspects of Zero-ETL, providing attendees with an understanding of how they can adopt this innovative approach in their organizations.
Lastly, the session will conclude with an interactive Q&A segment, allowing participants to gain deeper insights into how Zero-ETL can be tailored to their specific business needs and how they can get started today.
Join us to discover how Zero-ETL can elevate your organization's data strategy.
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar.
In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR.
Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios.
Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects.
Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar.
In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR.
Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios.
Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects.
Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality.
Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore:
FME’s role in real-time event processing, from data intake and analysis to transformation and reporting
An overview of leveraging streams vs. automations
FME’s impact across various industries highlighted by real-life case studies
Live demonstrations on setting up FME workflows for real-time data
Practical advice on getting started, best practices, and tips for effective implementation
Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization's performance. The power of real-time data automation through FME can turn this vision into reality.
Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We'll explore:
FME's role in real-time event processing, from data intake and analysis to transformation and reporting
An overview of leveraging streams vs. automations
FME's impact across various industries highlighted by real-life case studies
Live demonstrations on setting up FME workflows for real-time data
Practical advice on getting started, best practices, and tips for effective implementation
Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Hiring and retaining software development talent is next to impossible for AEC firms and other industries alike.
Join us and guest speakers from HOK, a leader in the AEC industry, as they share their success in navigating the tight talent market through the use of no-code solutions and FME.
Discover how HOK approached the process of building a custom tool to automate the creation of projects and user management for Trimble Connect and ProjectSight.
Using a mix of traditional and no-code in FME, our guest speakers will reveal how the team bridged the resource gap and used the available talent pool, producing the mission-critical web app “Trajectory”.
They will also dive into details, illustrating first-hand how JSON data was used as a “glue” between two development groups.
Learn how embracing FME as a no-code solution can unlock potential within your teams, foster collaboration, and drive efficiency.
Powering Real-Time Decisions with Continuous Data Streams
In an era where making swift, data-driven decisions can set industry leaders apart, understanding the world of data streaming and stream processing is crucial. During this webinar, we'll explore:
Stream Processing Overview: Dive into what stream processing entails and the value it brings organizations.
Stream vs. Batch Processing: Learn the key differences and benefits of stream processing compared to traditional batch processing, highlighting the efficiency of real-time data handling.
Mastering Data Volumes: Discover strategies for effectively managing both high and low volume data streams, ensuring optimal performance.
Boosting Operational Excellence: Explore how adopting data streaming can enhance your organization's operational workflows and productivity.
Spatial Data's Role in Streams: Understand the importance of spatial data in stream processing for more informed decision-making.
Interactive Demos: Watch practical demos, from dynamic geofencing to group-based processing.
Plus, we’ll show you how you can do it without coding! Register now to take the first step towards more informed, timely, and precise decision-making for your organization.
The Critical Role of Spatial Data in Today's Data Ecosystem
In today's data-driven landscape, integrating spatial data is becoming increasingly crucial for organizations aiming to harness the full potential of their data. Spatial data offers unique insights based on location, making it a fundamental component for addressing various challenges across different sectors, including urban planning, environmental sustainability, public health, and logistics.
Our webinar delves into the indispensable role of spatial data in data management and analysis. We'll showcase how omitting spatial data from your data strategy not only weakens your data infrastructure, but also limits the depth of your insights. Through real-world case studies, we'll highlight the transformative impact of spatial data, demonstrating its ability to uncover complex patterns, trends, and relationships.
Join us for this introductory-level webinar as we explore the critical importance of spatial data integration in driving strategic decision-making processes. By the end of the webinar, you'll gain a renewed perspective on how spatial data is essential for confronting and overcoming challenges across various domains.
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Once in a while, there really is something new under the sun. The rise of cloud-hosted data has fueled innovation in spatial data storage, enabling a brand new serverless architectural approach to spatial data sharing. Join us in our upcoming webinar to learn all about these new ways to organize your data, and leverage data shared by others. Explore the potential of Cloud Native Geospatial Formats in your workflows with FME, as we introduce five new formats: COGs, COPC, FlatGeoBuf, GeoParquet, STAC and ZARR.
Learn from industry experts Michelle Roby from Radiant Earth and Chris Holmes from Planet about these cloud-native geospatial data formats and how they can make data easier to manage, share, and analyze. To get us started, they’ll explain the goals of the Cloud-Native Geospatial Foundation and provide overviews of cloud-native technologies including the Cloud-Optimized GeoTIFF (COG), SpatioTemporal Asset Catalogs (STAC), and GeoParquet.
Following this, our seasoned FME team will guide you through practical demonstrations, showcasing how to leverage each format to its fullest potential. Learn strategic approaches for seamless integration and transition, along with valuable tips to enhance performance using these formats in FME.
Discover how these formats are reshaping geospatial data handling and how you can seamlessly integrate them into your FME workflows and harness the explosion of cloud-hosted data.
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Learn where FME meets AI in this upcoming webinar to offer you incredible time savings. This webinar is tailored to ignite imaginations and offer solutions to your data integration challenges. As the new digital era sets sail on the winds of AI, the tangibility of its integration in our daily schema is unfolding.
Segment 1, titled “AI: The Good, the Bad and the FME” by Darren Fergus of Locus, navigates through the realms of AI, scrutinizing its pervasive impact while underscoring the symbiotic potential of FME and AI. Join in an engaging demonstration as FME and ChatGPT collaboratively orchestrate a PowerPoint narrative, epitomizing the alliance of AI with human ingenuity.
In Segment 2, “Integrating GeoAI Models in FME” by Dennis Wilhelm and Dr. Christopher Britsch of con terra GmbH, the spotlight veers towards operationalizing AI in our daily tasks through FME. A practical approach to embedding GeoAI Models into FME Workspaces is unveiled, showcasing the ease of incorporating AI-driven methodologies into your FME workflows, skyrocketing productivity levels.
To follow, Segment 3, "Unleash generative AI on your terms!" by Oliver Morris of Avineon-Tensing. While the prospects of Generative AI are thrilling, security and IT reservations, especially with 'phone home' tools, are genuine concerns. However, with open-source tools, you can locally harness large language models. In this demo, we'll unravel the magic of local AI deployment and its seamless integration into an FME workspace.
Bonus! Dmitri will join us for a fourth segment to tie us off, showcasing what he has been up to this week, including using OpenAI API for texturing in FME, amoung other projects.
Join us to explore the synergy of FME and AI: opening portals to a realm of revolutionized productivity and enriched user experiences.
The Zero-ETL Approach: Enhancing Data Agility and Insight
In the ever-evolving landscape of data management, Zero-ETL is an approach that is reshaping how businesses handle and integrate their data. This webinar explores Zero-ETL, a paradigm shift from the traditional Extract, Transform, Load (ETL) process, offering a more streamlined, efficient, and real-time data integration method.
We will begin with an introduction to the concept of Zero-ETL, including how it allows direct access to data in its native environment and real-time data transformation, providing up-to-date information with significantly reduced data redundancy.
Next, we'll take you through several demonstrations showing how Zero-ETL can deliver real-time data and enable the free movement of data between systems. We will also discuss the various tools that support all aspects of Zero-ETL, providing attendees with an understanding of how they can adopt this innovative approach in their organizations.
Lastly, the session will conclude with an interactive Q&A segment, allowing participants to gain deeper insights into how Zero-ETL can be tailored to their specific business needs and how they can get started today.
Join us to discover how Zero-ETL can elevate your organization's data strategy.
Mastering MicroStation DGN: How to Integrate CAD and GIS
Dive deep into the world of CAD-GIS integration with our expert-led webinar. Discover how to seamlessly transfer data between Bentley MicroStation and leading GIS platforms, such as Esri ArcGIS. This session goes beyond mere CAD/GIS conversion, showcasing techniques to precisely transform MicroStation elements including cells, text, lines, and symbology. We’ll walk you through tags versus item types, and understanding how to leverage both. You’ll also learn how to reproject to any coordinate system. Finally, explore cutting-edge automated methods for managing database links, and delve into innovative strategies for enabling self-serve data collection and validation services.
Join us to overcome the common hurdles in CAD and GIS integration and enhance the efficiency of your workflows. This session is perfect for professionals, both new to FME and seasoned users, seeking to streamline their processes and leverage the full potential of their CAD and GIS systems.
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Dive deep into the world of geospatial data management and transformation in our upcoming webinar focusing on the powerful integration of FME and Esri technologies. This insightful session comprises two compelling segments aimed at enhancing your geospatial workflows, while minimizing operational hurdles.
In the first segment, guest speaker Jan Roggisch from Locus unveils how Auckland Council triumphed over the challenges of handling large, frequent data updates on ArcGIS Online using FME. Discover the journey from manual data handling to an automated, streamlined process that reduced server downtime from minutes to seconds: setting a new standard for local government organizations.
The second segment, led by James Botterill from 1Spatial, unveils the magic of incorporating ArcPy into your FME workflows. Delve into real-world scenarios where ArcGIS geoprocessing is harmoniously orchestrated within FME using the PythonCaller. Gain insights into raster-vector data conversion, spatial analysis, and a host of practical tips and tricks that empower you to leverage the combined capabilities of FME and Esri for efficient data manipulation and conversion.
Join us to explore the remarkable possibilities that open up when FME and Esri technologies converge – enhancing your ability to manage and transform geospatial data with unprecedented efficiency.
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Join us at Safe Software as we unveil the exciting new FME Community platform.
Picture yourself entering a vibrant, interconnected world, where every click brings you closer to a fellow FME enthusiast, a new idea, or a solution that could revolutionize your workflow.
Since its inception, the FME Community has been a dynamic hub for knowledge sharing, where thousands of users converge to exchange insights, engage in stimulating discussions, and collaboratively solve challenges. Now, envision this community reimagined - retaining the features you know and love, but infused with new, cutting-edge functionalities designed to make your experience even more enriching and effortless. The Community is also planned to soon act as a central hub for all FME community acticity across the web.
This webinar is your personal tour through this enhanced FME Community landscape. Whether you're an experienced user familiar with every nook and cranny of the old platform, or you're setting foot in this community for the first time, our webinar will ensure you navigate the new terrain with ease and confidence. Discover how to maximize your engagement, tap into the wealth of resources available, and contribute to the growing tapestry of FME innovation.
Join us in celebrating the future of FME collaboration, where your next breakthrough idea, insightful article, or spirited discussion awaits. Don't miss this opportunity to be a part of the evolution of the FME Community!
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Explore how to best leverage the latest of AI technology in our upcoming webinar, where we delve into advancements and trends in the field since our previous AI webinars in 2023. Join us for a session filled with fresh insights and practical knowledge. We're stitching together the final threads of this presentation as we speak, keeping pace with AI's breakneck speed. Expect a session brimming with the freshest insights, releases and breakthroughs in AI – right up to the minute! A spotlight of this session is set to include Dmitri Bagh’s exploration of innovative AI integrations with FME, ranging from generating 3D features for augmented reality using Dall-E, to enhancing urban planning with orthoimagery completion, and showcasing the power of AI in workspace analysis and geoart creation.
Whether you're new to AI or an experienced practitioner, this webinar is tailored to keep you at the forefront of AI innovation. Get ready for a session that is as informative as it is inspiring, equipping you with the tools to excel in the dynamic world of artificial intelligence.
More from Safe Software (20)
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Recently uploaded
AWS Certified Solutions Architect Associate (SAA-C03)
AWS Certified Solutions Architect Associate (SAA-C03)
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation Functions to Prevent Interaction with Malicious QR Codes.
Aim of the Study: The goal of this research was to develop a robust hybrid approach for identifying malicious and insecure URLs derived from QR codes, ensuring safe interactions.
This is achieved through:
Machine Learning Model: Predicts the likelihood of a URL being malicious.
Security Validation Functions: Ensures the derived URL has a valid certificate and proper URL format.
This innovative blend of technology aims to enhance cybersecurity measures and protect users from potential threats hidden within QR codes 🖥 🔒
This study was my first introduction to using ML which has shown me the immense potential of ML in creating more secure digital environments!
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
"What does it really mean for your system to be available, or how to define w...
We will talk about system monitoring from a few different angles. We will start by covering the basics, then discuss SLOs, how to define them, and why understanding the business well is crucial for success in this exercise.
Discover the Unseen: Tailored Recommendation of Unwatched Content
The session shares how JioCinema approaches ""watch discounting."" This capability ensures that if a user watched a certain amount of a show/movie, the platform no longer recommends that particular content to the user. Flawless operation of this feature promotes the discover of new content, improving the overall user experience.
JioCinema is an Indian over-the-top media streaming service owned by Viacom18.
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
What began over 115 years ago as a supplier of precision gauges to the automotive industry has evolved into being an industry leader in the manufacture of product branding, automotive cockpit trim and decorative appliance trim. Value-added services include in-house Design, Engineering, Program Management, Test Lab and Tool Shops.
"Choosing proper type of scaling", Olena Syrota
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
Astute Business Solutions | Oracle Cloud Partner |
Your goto partner for Oracle Cloud, PeopleSoft, E-Business Suite, and Ellucian Banner. We are a firm specialized in managed services and consulting.
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
These are the slides for the presentation, "Component Testing: Bridging the gap between frontend applications" that was presented at QA or the Highway 2024 in Columbus, OH by Zachary Hamm.
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Gursev Pirge, PhD
Senior Data Scientist - JohnSnowLabs
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
ScyllaDB monitoring provides a lot of useful information. But sometimes it’s not easy to find the root of the problem if something is wrong or even estimate the remaining capacity by the load on the cluster. This talk shares our team's practical tips on: 1) How to find the root of the problem by metrics if ScyllaDB is slow 2) How to interpret the load and plan capacity for the future 3) Compaction strategies and how to choose the right one 4) Important metrics which aren’t available in the default monitoring setup.
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
Direct losses from downtime in 1 minute = $5-$10 thousand dollars. Reputation is priceless.
As part of the talk, we will consider the architectural strategies necessary for the development of highly loaded fintech solutions. We will focus on using queues and streaming to efficiently work and manage large amounts of data in real-time and to minimize latency.
We will focus special attention on the architectural patterns used in the design of the fintech system, microservices and event-driven architecture, which ensure scalability, fault tolerance, and consistency of the entire system.
Apps Break Data
How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Tomaz Bratanic
Graph ML and GenAI Expert - Neo4j
Demystifying Knowledge Management through Storytelling
The Department of Veteran Affairs (VA) invited Taylor Paschal, Knowledge & Information Management Consultant at Enterprise Knowledge, to speak at a Knowledge Management Lunch and Learn hosted on June 12, 2024. All Office of Administration staff were invited to attend and received professional development credit for participating in the voluntary event.
The objectives of the Lunch and Learn presentation were to:
- Review what KM ‘is’ and ‘isn’t’
- Understand the value of KM and the benefits of engaging
- Define and reflect on your “what’s in it for me?”
- Share actionable ways you can participate in Knowledge - - Capture & Transfer
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Dmitrii Kamaev, PhD
Senior Product Owner - QIAGEN
GNSS spoofing via SDR (Criptored Talks 2024)
In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security.
This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing.
The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.
Recently uploaded (20)
AWS Certified Solutions Architect Associate (SAA-C03)
AWS Certified Solutions Architect Associate (SAA-C03)
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
"What does it really mean for your system to be available, or how to define w...
"What does it really mean for your system to be available, or how to define w...
Discover the Unseen: Tailored Recommendation of Unwatched Content
Discover the Unseen: Tailored Recommendation of Unwatched Content
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
Getting the Most Out of ScyllaDB Monitoring: ShareChat's Tips
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Demystifying Knowledge Management through Storytelling
Demystifying Knowledge Management through Storytelling
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Taming Our Case Management Database and GIS with FME
- 1. Taming Our Case Management Database and GIS with FME Paul Frank and Surbhi Bakshi, City of Austin 1
- 2. 2
- 3. Developers plan, may request new zoning case Developer submits and City reviews and manages subdivision and site plans cases If plan meets regulations, issue permits and developer builds City does inspections Everyone wants to monitor these events in a variety of tools and platforms General Development Process 3
- 4. Application MANagement and Data Automation) 4
- 5. Case Management System, Oracle back-end Wealth of development data 16,000 Construction Permits Issued last year 1,100 Zoning, Subdivision, and Site Plan Cases per year 61,896 total cases in AMANDA Not a GIS-system or open data system 5
- 8. Run Report in AMANDA Export as Excel spreadsheet Convert to Geodatabase table Format Address field to optimize geocoding Geocode using ArcGIS Composite Address Locater (Point and Street) Look up unmatched addresses and geocode each record • Process run each quarter • Created a quarterly snapshot • End production was a compilation of many snapshots in time updated each quarter by appending to main dataset • Due to the snapshot in time nature of the dataset, did not always match AMANDA Earlier pre-FME process 8
- 9. Feature Class Table • Reader – CSV dataset from Data Warehouse, same as the Issued Permits dataset on the Open Data Portal, refreshed completely every day. • Writers – Feature class and table in File Geodatabase • Geocoding – The records in the table need to be geocoded separately and then the two feature classes are merged, using a Shutdown Python Script. Permits Workbench 9
- 10. Permits Workbench • Shut Down Python Script – geocodes the records, appends them to the main dataset, changes schema, imports metadata, and compacts geodatabase. • In FME 2016, had to identify the Python interpreter that the workbench could reference in FME Options under Tools. • Have to write a Python reference before starting the actual script in the Shutdown Script. 10
- 11. • Dataset updated weekly • Entire dataset refreshed • No manual geocoding of individual records • Matches AMANDA dataset • Replication to other datasets Benefits of current FME process 11
- 12. Data Visualizations New Non Residential Development in Austin New Residential Development Demolitions 12
- 14. 14
- 15. Cases Workbench AMANDA processing 15
- 16. Cases Workbench GIS processing 16
- 17. FME Tools-Options-Database Connections Connecting to AMANDA Oracle tsnnames.ora 17
- 19. FME Server • Server and desktop versions should be the same • Need correct permissions for server account to access network locations 19
- 20. ArcGIS Online 20
- 22. 22
- 23. 23
- 24. • Surprised to learn what you need to: SQL, transformers, FME server, etc • Spend time up front coordinating with other departments on policies and formats • Had to re-enter schema multiple times in writers for various reasons – try and wait til the end of the process • ArcGIS metadata was a challenge to replicate. We kept a separate feature class that had metadata and imported that into refreshed datasets • We could have concatenated more information to reduce fields. Don’t get field crazy • FME is well-documented and supported Lessons Learned 24
- 25. RESOURCES Here are some great places to find royalty free images ● Data.austintexas.gov ● http://www.austintexas.gov/department/maps-data 25