Download to read offline
Uploaded bySafe Software
Using FME to Transform and Integrate Optical Connection Data Between Systems
The document outlines the objectives and challenges faced by Paweł Wróblewski, a GIS specialist at Globema in Poland, in automating the processing of AutoCAD DWG files into various formats and integrating them with GE Smallworld. Solutions involve using tools like FME for data transformation and workflow automation, yielding multiple output files and streamlined processes. The benefits included reduced project implementation time and enhanced efficiency for telecommunications operators, highlighted by Wróblewski's praise for FME's user-friendly interface.
More Related Content
Similar to Using FME to Transform and Integrate Optical Connection Data Between Systems
Using FME to Transform and Integrate Optical Connection Data Between Systems
- 1. Globema Paweł Wróblewski, GISSpecialist Poland
- 2. Objectives Automatically process AutoCAD DWGsource files into various output formats. ● Transform and load data into GE Smallworld. ● Create reusable data transformation workflows.
- 3. Challenges ● Accurately analyzesource data. ● Simplify complex data translations and transformations.
- 4. Solution DWG files FME● GE Smallworld ● Multiple CSVs ● DWG files (rejected objects)
- 5.
- 6. Tips Use WorkspaceRunner to batchprocess data faster.
- 7. Tips StatisticsCalculator Study spatial relationsand perform statistical analysis of coordinates.
- 8. Tips Remove duplicate geometry usingCoordinateExtractor and DuplicateFilter.
- 9. Tips NeighborFinder Helps to findconnections between objects.
- 10. Results Multiple output filesare created in the required format.
- 11. Benefits ● Decreased timeand effort spent on project implementation. ● Allow telecommunications operators to work efficiently in their existing Smallworld environment. ● Create low maintenance workflows for repeatable processes.
- 12. “The biggest advantageof FME is the user-friendly interface that allows you to create very advanced transformations without having to program in a specific language.” - Paweł Wróblewski, Globema Poland
- 13.
Editor's Notes
- #2 Next, we’re sharing a story from Globema. Globema is a Silver authorized partner and they implement and deliver smart and innovative geospatial software solutions. Headquartered in Warsaw, Poland, the company specializes in Operations Support Systems & Network Inventory for telecoms, enterprise GIS, geomarketing, and SmartGrid and Workforce Management systems. This story comes to us from Paweł Wróblewski [PAH-velw vroo-BLEV-skee]. He’s a GIS Specialist and an FME certified professional. He has been with Globema for over 5 years and primarily focuses on complex data migration projects, bringing together and transforming data from many sources (DGN, DWG, XLSX files, etc).
- #3 One of the largest projects that Paweł [PAH-velw] worked on involved helping large telecommunication operators like UPC in the Central and Eastern Europe region (Poland, Czechia, Slovakia and Hungary) migrate telecommunication and civil networks. Companies used one application for network inventory management and a different application for analyzing and processing network drawing data. But they wanted data for each asset to be connected in the two systems. This is where Globema’s expertise came in. They wanted to help the companies use one application for network inventory management, and a different application for analyzing and processing network drawing data. But they wanted data for each asset to be connected in the two systems. Specifically for our presentation today, we’ll be highlighting a project that was focused on connectivity import implementation and automatically loading optical connection data between systems. They needed to automatically process CAD and DWG files into various output formats, transform and load data into GE Smallworld, and create repeatable workflows.
- #4 They needed to analyze and aggregate disparate data sources, transform them into the required formats, and load the data into the telecom network inventory system. Then, automate this process.
- #5 Paweł [PAH-velw] accomplished this by creating FME workflows that perform the required data integration tasks. The workflow accurately reads, analyzes, and translates the spatial relationships within the various layers of schema within the source DWG drawing -- for example, line thickness, line color, block attributes, object rotation, etc -- and map this to corresponding Smallworld objects.
- #6 Here’s an example of a source DWG drawing, where we can see that optical connections are graphically represented. FME analyzes this data, along with aggregating it with other source data, and maps it to the appropriate corresponding object in Smallworld (eg. optical splice, manhole, etc).
- #7 Paweł [PAH-velw] has many tips to share with the FME community, with the first being the WorkspaceRunner transformer to validate and batch process data faster in a translation workflow and to write to a Smallworld table.
- #8 He recommends using statistical transformers such as the StatisticsCalculator to study spatial attributes; he says while it may seem odd to use the StatisticsCalculator, this allows for an additional layer of QA/QC to confirm the accuracy of the spatial coordinates. Mention: the StatisticsCalculator got a total overhaul in 2020.0 and is incredibly fast (up to 100x faster!).
- #9 Use CoordinateExtrator and DuplicateFilter to remove duplicate geometry.
- #10 Use NeighbourFinder to help find connections between objects.
- #11 By performing a number of spatial analysis between attributes, Paweł [PAH-velw] obtained several output files at once (as you can see in the screenshot on the right). On the left, this is an example of one of the output files, “fiber_connection” with information about direct connections between optical fibers. Using WorkspaceRunner, FME analyzed the source batch files and processed it into the appropriate ports.
- #12 Paweł [PAH-velw] notes that the greatest benefit of using FME is the reduced time spent on project implementation. Additionally, by using FME in the background to analyze and validate data before it is mapped to Smallworld, this enables telecom operators to work more effectively within their existing Smallworld environment while freeing them from performing this effort manually. In addition, his colleague has highlighted: His repeatable and low maintenance workflows offers flexibility for other developers/specialists to easily modify the process when needed, even if they don’t have deep technical knowledge. Thanks to the clear structure of his work, they were able to reuses pieces of his FME workspace in other projects.