Using FME to Transform and Integrate Optical Connection Data Between Systems
•Download as PPTX, PDF•
0 likes•7,309 views
Learn how Globema used FME to automatically process AutoCAD DWG source files into various output formats, to transform and load data into GE Smallworld, and to create reusable data transformation workflows for telecom operators.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Using FME to Transform and Integrate Optical Connection Data Between Systems
Similar to Using FME to Transform and Integrate Optical Connection Data Between Systems (20)
More from Safe Software
More from Safe Software (20)
Recently uploaded
Recently uploaded (20)
Using FME to Transform and Integrate Optical Connection Data Between Systems
- 1. Globema Paweł Wróblewski, GIS Specialist Poland
- 2. Objectives Automatically process AutoCAD DWG source files into various output formats. ● Transform and load data into GE Smallworld. ● Create reusable data transformation workflows.
- 3. Challenges ● Accurately analyze source data. ● Simplify complex data translations and transformations.
- 4. Solution DWG files FME ● GE Smallworld ● Multiple CSVs ● DWG files (rejected objects)
- 6. Tips Use WorkspaceRunner to batch process data faster.
- 7. Tips StatisticsCalculator Study spatial relations and perform statistical analysis of coordinates.
- 8. Tips Remove duplicate geometry using CoordinateExtractor and DuplicateFilter.
- 9. Tips NeighborFinder Helps to find connections between objects.
- 10. Results Multiple output files are created in the required format.
- 11. Benefits ● Decreased time and effort spent on project implementation. ● Allow telecommunications operators to work efficiently in their existing Smallworld environment. ● Create low maintenance workflows for repeatable processes.
- 12. “The biggest advantage of FME is the user-friendly interface that allows you to create very advanced transformations without having to program in a specific language.” - Paweł Wróblewski, Globema Poland
- 13. Thank you!
Editor's Notes
- Next, we’re sharing a story from Globema. Globema is a Silver authorized partner and they implement and deliver smart and innovative geospatial software solutions. Headquartered in Warsaw, Poland, the company specializes in Operations Support Systems & Network Inventory for telecoms, enterprise GIS, geomarketing, and SmartGrid and Workforce Management systems. This story comes to us from Paweł Wróblewski [PAH-velw vroo-BLEV-skee]. He’s a GIS Specialist and an FME certified professional. He has been with Globema for over 5 years and primarily focuses on complex data migration projects, bringing together and transforming data from many sources (DGN, DWG, XLSX files, etc).
- One of the largest projects that Paweł [PAH-velw] worked on involved helping large telecommunication operators like UPC in the Central and Eastern Europe region (Poland, Czechia, Slovakia and Hungary) migrate telecommunication and civil networks. Companies used one application for network inventory management and a different application for analyzing and processing network drawing data. But they wanted data for each asset to be connected in the two systems. This is where Globema’s expertise came in. They wanted to help the companies use one application for network inventory management, and a different application for analyzing and processing network drawing data. But they wanted data for each asset to be connected in the two systems. Specifically for our presentation today, we’ll be highlighting a project that was focused on connectivity import implementation and automatically loading optical connection data between systems. They needed to automatically process CAD and DWG files into various output formats, transform and load data into GE Smallworld, and create repeatable workflows.
- They needed to analyze and aggregate disparate data sources, transform them into the required formats, and load the data into the telecom network inventory system. Then, automate this process.
- Paweł [PAH-velw] accomplished this by creating FME workflows that perform the required data integration tasks. The workflow accurately reads, analyzes, and translates the spatial relationships within the various layers of schema within the source DWG drawing -- for example, line thickness, line color, block attributes, object rotation, etc -- and map this to corresponding Smallworld objects.
- Here’s an example of a source DWG drawing, where we can see that optical connections are graphically represented. FME analyzes this data, along with aggregating it with other source data, and maps it to the appropriate corresponding object in Smallworld (eg. optical splice, manhole, etc).
- Paweł [PAH-velw] has many tips to share with the FME community, with the first being the WorkspaceRunner transformer to validate and batch process data faster in a translation workflow and to write to a Smallworld table.
- He recommends using statistical transformers such as the StatisticsCalculator to study spatial attributes; he says while it may seem odd to use the StatisticsCalculator, this allows for an additional layer of QA/QC to confirm the accuracy of the spatial coordinates. Mention: the StatisticsCalculator got a total overhaul in 2020.0 and is incredibly fast (up to 100x faster!).
- Use CoordinateExtrator and DuplicateFilter to remove duplicate geometry.
- Use NeighbourFinder to help find connections between objects.
- By performing a number of spatial analysis between attributes, Paweł [PAH-velw] obtained several output files at once (as you can see in the screenshot on the right). On the left, this is an example of one of the output files, “fiber_connection” with information about direct connections between optical fibers. Using WorkspaceRunner, FME analyzed the source batch files and processed it into the appropriate ports.
- Paweł [PAH-velw] notes that the greatest benefit of using FME is the reduced time spent on project implementation. Additionally, by using FME in the background to analyze and validate data before it is mapped to Smallworld, this enables telecom operators to work more effectively within their existing Smallworld environment while freeing them from performing this effort manually. In addition, his colleague has highlighted: His repeatable and low maintenance workflows offers flexibility for other developers/specialists to easily modify the process when needed, even if they don’t have deep technical knowledge. Thanks to the clear structure of his work, they were able to reuses pieces of his FME workspace in other projects.