Using FME for Data Integration
at a Municipal Electric Utility
FME World Tour, 10 Apr 2018
Scott Menhart, TCL&P
Brooks E. Kelley, InfoGeographics, Inc.
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
Traverse City Light & Power
About
• TCL&P is a local, community-owned, municipal electric distribution
company with over 100 years of service currently serving
approximately 12,700 customers
• TCL&P prides itself on being a safe, reliable, and community-friendly
utility with a level of programs and services that enhance the quality
of life and make Traverse City a better place to live
• TCL&P is committed to investing in a wide variety of community-
related projects that range from environmental programs to education
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
Traverse City Light & Power
Data, Data, Everywhere!
• As with many organizations, TCL&P’s IT environment grew
organically over time.
• This resulted in an assortment of highly specialized applications and
databases scattered throughout the enterprise:
– SQL Server-based GIS
– SQL Server-based Asset Management System
– AS/400-based CMS/Billing System
– Milsoft-based Engineering System
– SQL Server-based Work Order System
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
Traverse City Light & Power
Quality Applications
• TCL&P uses industry-leading technologies such as:
– ArcGIS Desktop and Server including
• ArcGIS Desktop
• ArcGIS for Server/Portal
• Collector For ArcGIS
– WindMil (Engineering)
– Novotx (Asset and Work Order Management)
– SEW (Energy Efficiency)
– HTE (CMS/Billing)
– DisSPatch (Power Outage Management)
– …and of course, FME
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
Traverse City Light & Power
Integration Challenges/Requirements
• Needed to support many data formats
• Needed to schedule certain data movement tasks (from once every
15 minutes to once a day)
• Standardize Business Logic
• Performance was important (sometimes)
• IBM Power7 (AS/400) (DB2)
• TCL&P and the City are on different domains and different subnets
TCL&P and the City have established domain trusts but
performance is still sub par as a result of County hardware that is
scheduled to be upgraded
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
Traverse City Light & Power
Integration Solution
1. Data Centralization
– Put as much data into SQL Server as possible
2. Business Logic
– Views were developed in SQL Server to consolidate business logic
3. Data Movement
– FME is TCL&P’s data movement tool. Its used to:
Centralize data in SQL Server
Translate to the output format
Schedule tasks
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA’
Traverse City Light & Power
Integration Solution
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
DB #1
DB #N
DB #2
SQL
Views
…
###
###
### ###
DB #N
###
###
Traverse City Light & Power
Questions? Thoughts? Ideas? Comments?
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
Using FME for Data Integration
at a Municipal Electric Utility
FME World Tour, 10 Apr 2018
Scott Menhart, TCL&P
Brooks E. Kelley, InfoGeographics, Inc.
www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA

Using FME for Data Integration at Municipal Electric Utility

  • 1.
    Using FME forData Integration at a Municipal Electric Utility FME World Tour, 10 Apr 2018 Scott Menhart, TCL&P Brooks E. Kelley, InfoGeographics, Inc. www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
  • 2.
    Traverse City Light& Power About • TCL&P is a local, community-owned, municipal electric distribution company with over 100 years of service currently serving approximately 12,700 customers • TCL&P prides itself on being a safe, reliable, and community-friendly utility with a level of programs and services that enhance the quality of life and make Traverse City a better place to live • TCL&P is committed to investing in a wide variety of community- related projects that range from environmental programs to education www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
  • 3.
    Traverse City Light& Power Data, Data, Everywhere! • As with many organizations, TCL&P’s IT environment grew organically over time. • This resulted in an assortment of highly specialized applications and databases scattered throughout the enterprise: – SQL Server-based GIS – SQL Server-based Asset Management System – AS/400-based CMS/Billing System – Milsoft-based Engineering System – SQL Server-based Work Order System www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
  • 4.
    Traverse City Light& Power Quality Applications • TCL&P uses industry-leading technologies such as: – ArcGIS Desktop and Server including • ArcGIS Desktop • ArcGIS for Server/Portal • Collector For ArcGIS – WindMil (Engineering) – Novotx (Asset and Work Order Management) – SEW (Energy Efficiency) – HTE (CMS/Billing) – DisSPatch (Power Outage Management) – …and of course, FME www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
  • 5.
    Traverse City Light& Power Integration Challenges/Requirements • Needed to support many data formats • Needed to schedule certain data movement tasks (from once every 15 minutes to once a day) • Standardize Business Logic • Performance was important (sometimes) • IBM Power7 (AS/400) (DB2) • TCL&P and the City are on different domains and different subnets TCL&P and the City have established domain trusts but performance is still sub par as a result of County hardware that is scheduled to be upgraded www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
  • 6.
    Traverse City Light& Power Integration Solution 1. Data Centralization – Put as much data into SQL Server as possible 2. Business Logic – Views were developed in SQL Server to consolidate business logic 3. Data Movement – FME is TCL&P’s data movement tool. Its used to: Centralize data in SQL Server Translate to the output format Schedule tasks www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA’
  • 7.
    Traverse City Light& Power Integration Solution www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA DB #1 DB #N DB #2 SQL Views … ### ### ### ### DB #N ### ###
  • 8.
    Traverse City Light& Power Questions? Thoughts? Ideas? Comments? www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA
  • 9.
    Using FME forData Integration at a Municipal Electric Utility FME World Tour, 10 Apr 2018 Scott Menhart, TCL&P Brooks E. Kelley, InfoGeographics, Inc. www.tclp.org | 231.922.4940 | 1131 Hasting Street | Traverse City MI 49686 USA