SlideShare a Scribd company logo
Improving Power Grid Reliability
Using IoT Analytics
Jim Brown
Director of Data Science at Neudesic
Minjie Yu
Senior Data Scientist at DTE
Agenda
§ Company introductions
§ Business challenges
§ Solution architecture
§ Demonstration
Help clients land on the winning side of digital transformation
OUR MISSION
20 Year old consulting and services firm
24x7 Delivery across the US & globe
14X Microsoft partner of the year award winner
10 years of utilities consulting experience
4 Utility modernization design centers
Help clients land on the winning side of digital transformation
OUR MISSION
OUR STRATEGIC AND TECHNICAL OFFERINGS
• Data & AI
• Cloud Infrastructure, Migration and Strategy
• Custom Application Development
• Hyper Automation
• Continuous Delivery and DevOps
• CRM and Modern Workplace
• Integration & API Management
• Business Transformation & Strategy
• Managed Services
DTE Energy Overview
• Headquartered in Detroit, MI
• DTE Electric
– Electric generation and distribution
– 31,000 miles of overhead and 16,400
miles of underground sub-transmission
and distribution lines
– 2.2 million customers
– 11,084 megawatt (MW) system capacity
• DTE Gas
– Natural gas transmission , storage and
distribution
– 19,000 miles of distribution
– 1.2 million customers
• Gas Storage & Pipelines
• Power & Industrial Projects
• Energy Trading
Service territory ~7,600 square miles
Leading the Way to a Cleaner, Safer and Smarter Energy Future
At DTE Energy our aspiration is to be the best-operated energy company in North
America and a force for growth and prosperity in the communities where we live and
serve.
Business Challenges
▪ Mostly based on long duration power outages, which do not
take into account momentary interruptions or voltage
exceptions
▪ Generally using averages of certain KPIs in past 3 to 5 years,
which overlooks time distribution of reliability problems
▪ Analyzed at high level of the system without specific areas or
sections of a circuit
▪ Lacking information of outage causes or affected assets due to
data quality issues or disparate IT systems
▪ Takes a holistic approach with advanced modeling method
and with inputs of relevant types of data
▪ Provides engineers with specific and meaningful information
such as sections of a circuit, severity of reliability problems,
affected assets, root causes of outages
▪ Reduces cycle time and cost on major reliability programs
through accurate information, visualization and specific
recommendations
▪ Enables the organization to become more agile and proactive
to address customer concerns about power quality
▪ Establishes a framework and foundation for future investment
strategy studies
Business values
Challenges in current strategies
Asset Health Management
Aging equipment is another main cause of service quality issues.
Reinforcing or upgrading assets that are critical to system reliability
significantly reduces outages.
Tree Maintenance
Fallen trees are responsible for nearly 70 percent of the time our customers spend
without power. That’s why we’re stepping up efforts to trim overgrown trees to keep you
safe, and the energy grid reliable. With tree trimming, customers experience 60 percent
fewer outages.
Advanced Metering Infrastructure (AMI)
• 2.6 million AMI electric meters
Report usage on 15-min/Hourly intervals
• Service Quality
Outage start and end information
§ Momentary outages when less than 5 minutes
§ Sustained outages are 5 minutes or longer
Outage and voltage alarms in real time
Voltage events when above or below thresholds
Voltage readings on 5-min intervals
Smart Meters are Internet of Things (IoT) devices that monitor usage and service quality
NetworkX Connectivity Graph
Equipment chain and hierarchy of distribution system (distance metric)
Insights are hidden beneath so much data...
Solution Architecture
Simplified diagram of the processes to identify hot spots and suspect devices
Demonstration
Example
Potential Cause
Model Run Date Hotspot ID Suspect Source Tree Equipment Other
4/22/2021 1 Overhead Circuit 19.9% 19.9% 0%
4/22/2021 1 Recloser 10.5% 0% 19.9%
4/22/2021 1 Overhead Switch 19.9% 0% 0%
Feedback
Your feedback is important to us.
Don’t forget to rate and review the sessions.

More Related Content

What's hot

mlflow: Accelerating the End-to-End ML lifecycle
mlflow: Accelerating the End-to-End ML lifecyclemlflow: Accelerating the End-to-End ML lifecycle
mlflow: Accelerating the End-to-End ML lifecycle
Databricks
 
Azure data platform overview
Azure data platform overviewAzure data platform overview
Azure data platform overview
James Serra
 
The Analytics and Data Science Landscape
The Analytics and Data Science LandscapeThe Analytics and Data Science Landscape
The Analytics and Data Science Landscape
Philip Bourne
 
Ist Daten-Liberalismus der richtige Weg?
Ist Daten-Liberalismus der richtige Weg?Ist Daten-Liberalismus der richtige Weg?
Ist Daten-Liberalismus der richtige Weg?
confluent
 
Introduction to MLflow
Introduction to MLflowIntroduction to MLflow
Introduction to MLflow
Databricks
 
Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...
Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...
Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...
Neo4j
 
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Databricks
 
Sopra Steria: Intelligent Network Analysis in a Telecommunications Environment
Sopra Steria: Intelligent Network Analysis in a Telecommunications EnvironmentSopra Steria: Intelligent Network Analysis in a Telecommunications Environment
Sopra Steria: Intelligent Network Analysis in a Telecommunications Environment
Neo4j
 
360Eyes Business Objects metadata: BI on BI
360Eyes Business Objects metadata: BI on BI 360Eyes Business Objects metadata: BI on BI
360Eyes Business Objects metadata: BI on BI
Sebastien Goiffon
 
Achieving Business Transformation with UiPath RPA
Achieving Business Transformation with UiPath RPAAchieving Business Transformation with UiPath RPA
Achieving Business Transformation with UiPath RPA
Celonis
 
Ml ops intro session
Ml ops   intro sessionMl ops   intro session
Ml ops intro session
Avinash Patil
 
Big Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureBig Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft Azure
Mark Kromer
 
Neo4j : Graphes de Connaissance, IA et LLMs
Neo4j : Graphes de Connaissance, IA et LLMsNeo4j : Graphes de Connaissance, IA et LLMs
Neo4j : Graphes de Connaissance, IA et LLMs
Neo4j
 
Azure Synapse 101 Webinar Presentation
Azure Synapse 101 Webinar PresentationAzure Synapse 101 Webinar Presentation
Azure Synapse 101 Webinar Presentation
Matthew W. Bowers
 
Cloud computing vs grid computing
Cloud computing vs grid computingCloud computing vs grid computing
Cloud computing vs grid computing8neutron8
 
Microsoft365-Copilot-Partner-Guide
Microsoft365-Copilot-Partner-GuideMicrosoft365-Copilot-Partner-Guide
Microsoft365-Copilot-Partner-Guide
Erol GIRAUDY
 
Using MLOps to Bring ML to Production/The Promise of MLOps
Using MLOps to Bring ML to Production/The Promise of MLOpsUsing MLOps to Bring ML to Production/The Promise of MLOps
Using MLOps to Bring ML to Production/The Promise of MLOps
Weaveworks
 
Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines
Replacing Tape Backup with Cloud-Enabled Solutions by Index EnginesReplacing Tape Backup with Cloud-Enabled Solutions by Index Engines
Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines
Amazon Web Services
 
Cloud Computing Introduction
Cloud Computing IntroductionCloud Computing Introduction
Cloud Computing Introduction
Vivek Shelke
 
Digital transformation with microsoft data and ai
Digital transformation with microsoft data and ai Digital transformation with microsoft data and ai
Digital transformation with microsoft data and ai
MichaelRoenker
 

What's hot (20)

mlflow: Accelerating the End-to-End ML lifecycle
mlflow: Accelerating the End-to-End ML lifecyclemlflow: Accelerating the End-to-End ML lifecycle
mlflow: Accelerating the End-to-End ML lifecycle
 
Azure data platform overview
Azure data platform overviewAzure data platform overview
Azure data platform overview
 
The Analytics and Data Science Landscape
The Analytics and Data Science LandscapeThe Analytics and Data Science Landscape
The Analytics and Data Science Landscape
 
Ist Daten-Liberalismus der richtige Weg?
Ist Daten-Liberalismus der richtige Weg?Ist Daten-Liberalismus der richtige Weg?
Ist Daten-Liberalismus der richtige Weg?
 
Introduction to MLflow
Introduction to MLflowIntroduction to MLflow
Introduction to MLflow
 
Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...
Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...
Knowledge Graphs & Graph Data Science, More Context, Better Predictions - Neo...
 
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
 
Sopra Steria: Intelligent Network Analysis in a Telecommunications Environment
Sopra Steria: Intelligent Network Analysis in a Telecommunications EnvironmentSopra Steria: Intelligent Network Analysis in a Telecommunications Environment
Sopra Steria: Intelligent Network Analysis in a Telecommunications Environment
 
360Eyes Business Objects metadata: BI on BI
360Eyes Business Objects metadata: BI on BI 360Eyes Business Objects metadata: BI on BI
360Eyes Business Objects metadata: BI on BI
 
Achieving Business Transformation with UiPath RPA
Achieving Business Transformation with UiPath RPAAchieving Business Transformation with UiPath RPA
Achieving Business Transformation with UiPath RPA
 
Ml ops intro session
Ml ops   intro sessionMl ops   intro session
Ml ops intro session
 
Big Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft AzureBig Data Analytics in the Cloud with Microsoft Azure
Big Data Analytics in the Cloud with Microsoft Azure
 
Neo4j : Graphes de Connaissance, IA et LLMs
Neo4j : Graphes de Connaissance, IA et LLMsNeo4j : Graphes de Connaissance, IA et LLMs
Neo4j : Graphes de Connaissance, IA et LLMs
 
Azure Synapse 101 Webinar Presentation
Azure Synapse 101 Webinar PresentationAzure Synapse 101 Webinar Presentation
Azure Synapse 101 Webinar Presentation
 
Cloud computing vs grid computing
Cloud computing vs grid computingCloud computing vs grid computing
Cloud computing vs grid computing
 
Microsoft365-Copilot-Partner-Guide
Microsoft365-Copilot-Partner-GuideMicrosoft365-Copilot-Partner-Guide
Microsoft365-Copilot-Partner-Guide
 
Using MLOps to Bring ML to Production/The Promise of MLOps
Using MLOps to Bring ML to Production/The Promise of MLOpsUsing MLOps to Bring ML to Production/The Promise of MLOps
Using MLOps to Bring ML to Production/The Promise of MLOps
 
Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines
Replacing Tape Backup with Cloud-Enabled Solutions by Index EnginesReplacing Tape Backup with Cloud-Enabled Solutions by Index Engines
Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines
 
Cloud Computing Introduction
Cloud Computing IntroductionCloud Computing Introduction
Cloud Computing Introduction
 
Digital transformation with microsoft data and ai
Digital transformation with microsoft data and ai Digital transformation with microsoft data and ai
Digital transformation with microsoft data and ai
 

Similar to Improving Power Grid Reliability Using IoT Analytics

calidad de energia
calidad de energiacalidad de energia
calidad de energia
Cesar Chilet
 
Field Services overview for Data Centers
Field Services overview for Data CentersField Services overview for Data Centers
Field Services overview for Data CentersAnton Svinenkov
 
Industrial asset optimization overview slideshare
Industrial asset optimization   overview slideshareIndustrial asset optimization   overview slideshare
Industrial asset optimization overview slideshare
Genpact Ltd
 
Enabling the intelligent energy future
Enabling the intelligent energy futureEnabling the intelligent energy future
Enabling the intelligent energy futurerobgirvan
 
Cisco Energy Management - Short
Cisco Energy Management - ShortCisco Energy Management - Short
Cisco Energy Management - ShortPaul Weight
 
High Scalability Network Performance Management for Enterprises
High Scalability Network Performance Management for EnterprisesHigh Scalability Network Performance Management for Enterprises
High Scalability Network Performance Management for Enterprises
CA Technologies
 
Predictive Maintenance
Predictive MaintenancePredictive Maintenance
Predictive Maintenance
BearingPoint
 
Intro to DR 151201
Intro to DR 151201Intro to DR 151201
Intro to DR 151201kitsell
 
2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum
2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum
2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum
GIS in the Rockies
 
TGS-BP-BusinessPresentation-en-r00
TGS-BP-BusinessPresentation-en-r00TGS-BP-BusinessPresentation-en-r00
TGS-BP-BusinessPresentation-en-r00
Itconic
 
WorkTric Business Overview (EN)
WorkTric Business Overview (EN)WorkTric Business Overview (EN)
WorkTric Business Overview (EN)
LeninMartinez32
 
Naya Corporate Primer
Naya Corporate PrimerNaya Corporate Primer
Naya Corporate PrimerKetan Patel
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
mattdenesuk
 
Unlocking the Full Potential of Your Telecom Data with Data Integrity
Unlocking the Full Potential of Your Telecom Data with Data IntegrityUnlocking the Full Potential of Your Telecom Data with Data Integrity
Unlocking the Full Potential of Your Telecom Data with Data Integrity
Precisely
 
The New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities LandscapeThe New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities Landscape
Denodo
 
Going Modular? Lessons learned from 500 modular data center implementations
Going Modular?  Lessons learned from 500 modular data center implementations Going Modular?  Lessons learned from 500 modular data center implementations
Going Modular? Lessons learned from 500 modular data center implementations
John M. Kundtz ☛ Associate Partner / Sales Mgr / BDE
 
EPR coverage-smart meter
EPR coverage-smart meterEPR coverage-smart meter
EPR coverage-smart meter
ethandoyle
 
Visibility and insight - Understand what is going on with your IT infrastructure
Visibility and insight - Understand what is going on with your IT infrastructureVisibility and insight - Understand what is going on with your IT infrastructure
Visibility and insight - Understand what is going on with your IT infrastructure
Marie Wilcox
 

Similar to Improving Power Grid Reliability Using IoT Analytics (20)

calidad de energia
calidad de energiacalidad de energia
calidad de energia
 
Field Services overview for Data Centers
Field Services overview for Data CentersField Services overview for Data Centers
Field Services overview for Data Centers
 
Industrial asset optimization overview slideshare
Industrial asset optimization   overview slideshareIndustrial asset optimization   overview slideshare
Industrial asset optimization overview slideshare
 
Intro to DR
Intro to DRIntro to DR
Intro to DR
 
Enabling the intelligent energy future
Enabling the intelligent energy futureEnabling the intelligent energy future
Enabling the intelligent energy future
 
Cisco Energy Management - Short
Cisco Energy Management - ShortCisco Energy Management - Short
Cisco Energy Management - Short
 
GE-GridIQ_Insight
GE-GridIQ_InsightGE-GridIQ_Insight
GE-GridIQ_Insight
 
High Scalability Network Performance Management for Enterprises
High Scalability Network Performance Management for EnterprisesHigh Scalability Network Performance Management for Enterprises
High Scalability Network Performance Management for Enterprises
 
Predictive Maintenance
Predictive MaintenancePredictive Maintenance
Predictive Maintenance
 
Intro to DR 151201
Intro to DR 151201Intro to DR 151201
Intro to DR 151201
 
2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum
2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum
2013 Vendor Track, GE Digital Energy Solutions Overview by John Chisum
 
TGS-BP-BusinessPresentation-en-r00
TGS-BP-BusinessPresentation-en-r00TGS-BP-BusinessPresentation-en-r00
TGS-BP-BusinessPresentation-en-r00
 
WorkTric Business Overview (EN)
WorkTric Business Overview (EN)WorkTric Business Overview (EN)
WorkTric Business Overview (EN)
 
Naya Corporate Primer
Naya Corporate PrimerNaya Corporate Primer
Naya Corporate Primer
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
 
Unlocking the Full Potential of Your Telecom Data with Data Integrity
Unlocking the Full Potential of Your Telecom Data with Data IntegrityUnlocking the Full Potential of Your Telecom Data with Data Integrity
Unlocking the Full Potential of Your Telecom Data with Data Integrity
 
The New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities LandscapeThe New Role of Data in the Changing Energy & Utilities Landscape
The New Role of Data in the Changing Energy & Utilities Landscape
 
Going Modular? Lessons learned from 500 modular data center implementations
Going Modular?  Lessons learned from 500 modular data center implementations Going Modular?  Lessons learned from 500 modular data center implementations
Going Modular? Lessons learned from 500 modular data center implementations
 
EPR coverage-smart meter
EPR coverage-smart meterEPR coverage-smart meter
EPR coverage-smart meter
 
Visibility and insight - Understand what is going on with your IT infrastructure
Visibility and insight - Understand what is going on with your IT infrastructureVisibility and insight - Understand what is going on with your IT infrastructure
Visibility and insight - Understand what is going on with your IT infrastructure
 

More from Databricks

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
Databricks
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1
Databricks
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2
Databricks
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2
Databricks
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
Databricks
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
Databricks
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized Platform
Databricks
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data Science
Databricks
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML Monitoring
Databricks
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
Databricks
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
Databricks
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Databricks
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on Kubernetes
Databricks
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Databricks
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature Aggregations
Databricks
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Databricks
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and Spark
Databricks
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction Queries
Databricks
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
Databricks
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta Lake
Databricks
 

More from Databricks (20)

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized Platform
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data Science
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML Monitoring
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorch
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on Kubernetes
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature Aggregations
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and Spark
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction Queries
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta Lake
 

Recently uploaded

Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
Subhajit Sahu
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
74nqk8xf
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
jerlynmaetalle
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
AbhimanyuSinha9
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
slg6lamcq
 
Adjusting OpenMP PageRank : SHORT REPORT / NOTES
Adjusting OpenMP PageRank : SHORT REPORT / NOTESAdjusting OpenMP PageRank : SHORT REPORT / NOTES
Adjusting OpenMP PageRank : SHORT REPORT / NOTES
Subhajit Sahu
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptxData_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
AnirbanRoy608946
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
TravisMalana
 
Machine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptxMachine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptx
balafet
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Subhajit Sahu
 
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
g4dpvqap0
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
javier ramirez
 
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
2023240532
 
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Subhajit Sahu
 
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
ahzuo
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
oz8q3jxlp
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
John Andrews
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
haila53
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
dwreak4tg
 

Recently uploaded (20)

Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
 
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
一比一原版(Coventry毕业证书)考文垂大学毕业证如何办理
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
 
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...Best best suvichar in gujarati english meaning of this sentence as Silk road ...
Best best suvichar in gujarati english meaning of this sentence as Silk road ...
 
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
一比一原版(Adelaide毕业证书)阿德莱德大学毕业证如何办理
 
Adjusting OpenMP PageRank : SHORT REPORT / NOTES
Adjusting OpenMP PageRank : SHORT REPORT / NOTESAdjusting OpenMP PageRank : SHORT REPORT / NOTES
Adjusting OpenMP PageRank : SHORT REPORT / NOTES
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptxData_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
Data_and_Analytics_Essentials_Architect_an_Analytics_Platform.pptx
 
Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)Malana- Gimlet Market Analysis (Portfolio 2)
Malana- Gimlet Market Analysis (Portfolio 2)
 
Machine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptxMachine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptx
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
 
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
 
The Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series DatabaseThe Building Blocks of QuestDB, a Time Series Database
The Building Blocks of QuestDB, a Time Series Database
 
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
Quantitative Data AnalysisReliability Analysis (Cronbach Alpha) Common Method...
 
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
Algorithmic optimizations for Dynamic Levelwise PageRank (from STICD) : SHORT...
 
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
一比一原版(CBU毕业证)卡普顿大学毕业证如何办理
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
 
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdfCh03-Managing the Object-Oriented Information Systems Project a.pdf
Ch03-Managing the Object-Oriented Information Systems Project a.pdf
 
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
一比一原版(BCU毕业证书)伯明翰城市大学毕业证如何办理
 

Improving Power Grid Reliability Using IoT Analytics

  • 1. Improving Power Grid Reliability Using IoT Analytics Jim Brown Director of Data Science at Neudesic Minjie Yu Senior Data Scientist at DTE
  • 2. Agenda § Company introductions § Business challenges § Solution architecture § Demonstration
  • 3. Help clients land on the winning side of digital transformation OUR MISSION 20 Year old consulting and services firm 24x7 Delivery across the US & globe 14X Microsoft partner of the year award winner 10 years of utilities consulting experience 4 Utility modernization design centers
  • 4. Help clients land on the winning side of digital transformation OUR MISSION OUR STRATEGIC AND TECHNICAL OFFERINGS • Data & AI • Cloud Infrastructure, Migration and Strategy • Custom Application Development • Hyper Automation • Continuous Delivery and DevOps • CRM and Modern Workplace • Integration & API Management • Business Transformation & Strategy • Managed Services
  • 5. DTE Energy Overview • Headquartered in Detroit, MI • DTE Electric – Electric generation and distribution – 31,000 miles of overhead and 16,400 miles of underground sub-transmission and distribution lines – 2.2 million customers – 11,084 megawatt (MW) system capacity • DTE Gas – Natural gas transmission , storage and distribution – 19,000 miles of distribution – 1.2 million customers • Gas Storage & Pipelines • Power & Industrial Projects • Energy Trading Service territory ~7,600 square miles
  • 6. Leading the Way to a Cleaner, Safer and Smarter Energy Future At DTE Energy our aspiration is to be the best-operated energy company in North America and a force for growth and prosperity in the communities where we live and serve.
  • 7. Business Challenges ▪ Mostly based on long duration power outages, which do not take into account momentary interruptions or voltage exceptions ▪ Generally using averages of certain KPIs in past 3 to 5 years, which overlooks time distribution of reliability problems ▪ Analyzed at high level of the system without specific areas or sections of a circuit ▪ Lacking information of outage causes or affected assets due to data quality issues or disparate IT systems ▪ Takes a holistic approach with advanced modeling method and with inputs of relevant types of data ▪ Provides engineers with specific and meaningful information such as sections of a circuit, severity of reliability problems, affected assets, root causes of outages ▪ Reduces cycle time and cost on major reliability programs through accurate information, visualization and specific recommendations ▪ Enables the organization to become more agile and proactive to address customer concerns about power quality ▪ Establishes a framework and foundation for future investment strategy studies Business values Challenges in current strategies
  • 8. Asset Health Management Aging equipment is another main cause of service quality issues. Reinforcing or upgrading assets that are critical to system reliability significantly reduces outages. Tree Maintenance Fallen trees are responsible for nearly 70 percent of the time our customers spend without power. That’s why we’re stepping up efforts to trim overgrown trees to keep you safe, and the energy grid reliable. With tree trimming, customers experience 60 percent fewer outages.
  • 9. Advanced Metering Infrastructure (AMI) • 2.6 million AMI electric meters Report usage on 15-min/Hourly intervals • Service Quality Outage start and end information § Momentary outages when less than 5 minutes § Sustained outages are 5 minutes or longer Outage and voltage alarms in real time Voltage events when above or below thresholds Voltage readings on 5-min intervals Smart Meters are Internet of Things (IoT) devices that monitor usage and service quality
  • 10. NetworkX Connectivity Graph Equipment chain and hierarchy of distribution system (distance metric)
  • 11. Insights are hidden beneath so much data...
  • 12. Solution Architecture Simplified diagram of the processes to identify hot spots and suspect devices
  • 14. Example Potential Cause Model Run Date Hotspot ID Suspect Source Tree Equipment Other 4/22/2021 1 Overhead Circuit 19.9% 19.9% 0% 4/22/2021 1 Recloser 10.5% 0% 19.9% 4/22/2021 1 Overhead Switch 19.9% 0% 0%
  • 15. Feedback Your feedback is important to us. Don’t forget to rate and review the sessions.