SlideShare a Scribd company logo
1 of 13
Power BI
Streaming Datasets
Greg McMurray
San Diego BI Users Group, April 2018
Greg McMurray
 Senior Software Engineer at WECC
 Founder of Aritus Computer Services - 19 years
 Experience in Aerospace, Branding & Marketing, Software, Healthcare, Energy
 Active in many user groups and communities
 Find me online
 @goyuix
 https://www.linkedin.com/in/goyuix
 https://stackoverflow.com/cv/goyuix - top 3% of users
Western Electricity Coordinating Council (WECC)
 Non-profit to ensure the reliability of the western interconnection
 Approved Regional Entity by Federal Energy Regulatory Commission
 Create, monitor & enforce reliability standards
 Publish various models and independent perspective
 Covers 14 western states, 2 Canadian provinces and Baja Mexico
 We work with SDGE: San Diego Gas & Electric
What We Will Cover
 Streaming datasets in Power BI
 Associated visualizations for streaming datasets
 PowerShell scripts to push data to the service
 Issues to watch out for
 Discussion around potential uses
Power BI Real-time Streaming Datasets
Power BI Streaming Datasets
 Preview announced in August 2016
https://powerbi.microsoft.com/en-us/blog/real-time-in-no-time-with-power-bi/
 Released to general availability in January 2017
https://powerbi.microsoft.com/en-us/blog/announcing-general-availability-of-power-bi-
real-time-streaming-datasets/
 Datasets available through REST API or via PubNub
 Example: Azure Stream Analytics pushes to REST API
 Optionally store historic values – 1GB limit Pro / 10GB Premium
 Important Note: Dashboards auto-refresh / Reports require refresh
Example: Current Load on Western Interconnection
Create a Streaming Dataset
 Login to powerbi.com portal
 Under your workspace create a new Streaming Dataset
 This is different than a regular dataset, and isn’t an option there
 We will create a sample for holding random numbers with the following schema
 Value : Number
 Min : Number
 Max : Number
 Stamp : DateTime
 Enable Historical Analysis
REST API: Adding Data via PowerShell
 Each Streaming Dataset has a unique Push URL
 Looks like https://api.powerbi.com/beta/<guid>/datasets/<guid>/rows
 Has an encoded access key parameter as well
 Base64 encoded, 64 bytes long
 Doesn’t appear to be a string representation of anything special – just bytes
 POST to this URL with a JSON string
 Needs to be an array of objects that represent each row
 Example: [ { “Value”:50 } ]
Demo: Sending Random Numbers
Some Gotchas
 Can’t open / use with Power BI Desktop
 Dashboards auto-refresh to show latest data but…
 Reports need to be manually refreshed
 You can do this through the API as well
 https://powerbi.microsoft.com/en-us/blog/announcing-data-refresh-apis-in-the-power-bi-
service/
 Streaming charts are touchy – you will break them
Discussion: What are good examples?
 Some common examples:
 Bulk Electric System (of course!)
 Temperature
 San Diego: Traffic, Water, Tides, Fires, Park Attendance, Gas Prices, ???
 What do these all have in common?
 Similar values
 Steady values / changes
 They also can trigger actions: Change in generation, HVAC, traffic signals
Wrap Up
 Do you have any questions?
 Does this spark any ideas for use for you?

More Related Content

What's hot

SplunkLive! San Francisco Dec 2012 - Socialize
SplunkLive! San Francisco Dec 2012 - SocializeSplunkLive! San Francisco Dec 2012 - Socialize
SplunkLive! San Francisco Dec 2012 - SocializeSplunk
 
Hasura 2.0 Webinar
Hasura 2.0   WebinarHasura 2.0   Webinar
Hasura 2.0 WebinarHasura
 
Amazon Neptune - visually more options
Amazon Neptune - visually more optionsAmazon Neptune - visually more options
Amazon Neptune - visually more optionsLCloud
 
Hadoop training in Bangalore
Hadoop training in BangaloreHadoop training in Bangalore
Hadoop training in Bangaloreappaji intelhunt
 
Satwik mishra resume
Satwik mishra resumeSatwik mishra resume
Satwik mishra resumeSatwik Mishra
 
Using Snowplow for A/B testing and user journey analysis at CustomMade
Using Snowplow for A/B testing and user journey analysis at CustomMadeUsing Snowplow for A/B testing and user journey analysis at CustomMade
Using Snowplow for A/B testing and user journey analysis at CustomMadeyalisassoon
 
Rohan kumar keshri
Rohan kumar keshriRohan kumar keshri
Rohan kumar keshrirohanrkrohan
 
PivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi Data
PivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi DataPivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi Data
PivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi DataMichael Nam
 
Leveraging big data to maximize value from rail and power infrastructure assets.
Leveraging big data to maximize value from rail and power infrastructure assets.Leveraging big data to maximize value from rail and power infrastructure assets.
Leveraging big data to maximize value from rail and power infrastructure assets.Chijioke “CJ” Ejimuda
 
Gospel - High-performance heterogeneous architectures for graph analytics
 Gospel - High-performance heterogeneous architectures for graph analytics Gospel - High-performance heterogeneous architectures for graph analytics
Gospel - High-performance heterogeneous architectures for graph analyticsNECST Lab @ Politecnico di Milano
 
On-the-fly Integration of Static and Dynamic Linked Data
On-the-fly Integration of Static and Dynamic Linked DataOn-the-fly Integration of Static and Dynamic Linked Data
On-the-fly Integration of Static and Dynamic Linked Dataaharth
 
Satwik mishra resume
Satwik mishra resumeSatwik mishra resume
Satwik mishra resumeSatwik Mishra
 
Railroad Modeling at Hadoop Scale
Railroad Modeling at Hadoop ScaleRailroad Modeling at Hadoop Scale
Railroad Modeling at Hadoop ScaleDataWorks Summit
 
Modelling Event Data As A Graph
Modelling Event Data As A GraphModelling Event Data As A Graph
Modelling Event Data As A GraphDilyan Damyanov
 
Aws community day pune 2020 v3
Aws community day pune 2020 v3Aws community day pune 2020 v3
Aws community day pune 2020 v3Sridevi Murugayen
 

What's hot (20)

SplunkLive! San Francisco Dec 2012 - Socialize
SplunkLive! San Francisco Dec 2012 - SocializeSplunkLive! San Francisco Dec 2012 - Socialize
SplunkLive! San Francisco Dec 2012 - Socialize
 
Hasura 2.0 Webinar
Hasura 2.0   WebinarHasura 2.0   Webinar
Hasura 2.0 Webinar
 
Amazon Neptune - visually more options
Amazon Neptune - visually more optionsAmazon Neptune - visually more options
Amazon Neptune - visually more options
 
Hadoop training in Bangalore
Hadoop training in BangaloreHadoop training in Bangalore
Hadoop training in Bangalore
 
Introduction to OpenDataCommunities | Linda O'Halloran
Introduction to OpenDataCommunities | Linda O'HalloranIntroduction to OpenDataCommunities | Linda O'Halloran
Introduction to OpenDataCommunities | Linda O'Halloran
 
Satwik mishra resume
Satwik mishra resumeSatwik mishra resume
Satwik mishra resume
 
Using Snowplow for A/B testing and user journey analysis at CustomMade
Using Snowplow for A/B testing and user journey analysis at CustomMadeUsing Snowplow for A/B testing and user journey analysis at CustomMade
Using Snowplow for A/B testing and user journey analysis at CustomMade
 
Rohan kumar keshri
Rohan kumar keshriRohan kumar keshri
Rohan kumar keshri
 
PivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi Data
PivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi DataPivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi Data
PivotBillions: Analyzing 1.5 Billion Rows of NYC Taxi Data
 
Assembly
AssemblyAssembly
Assembly
 
Leveraging big data to maximize value from rail and power infrastructure assets.
Leveraging big data to maximize value from rail and power infrastructure assets.Leveraging big data to maximize value from rail and power infrastructure assets.
Leveraging big data to maximize value from rail and power infrastructure assets.
 
Gospel - High-performance heterogeneous architectures for graph analytics
 Gospel - High-performance heterogeneous architectures for graph analytics Gospel - High-performance heterogeneous architectures for graph analytics
Gospel - High-performance heterogeneous architectures for graph analytics
 
On-the-fly Integration of Static and Dynamic Linked Data
On-the-fly Integration of Static and Dynamic Linked DataOn-the-fly Integration of Static and Dynamic Linked Data
On-the-fly Integration of Static and Dynamic Linked Data
 
Satwik mishra resume
Satwik mishra resumeSatwik mishra resume
Satwik mishra resume
 
Railroad Modeling at Hadoop Scale
Railroad Modeling at Hadoop ScaleRailroad Modeling at Hadoop Scale
Railroad Modeling at Hadoop Scale
 
Resume_Vignesh_ThulasiDass
Resume_Vignesh_ThulasiDass Resume_Vignesh_ThulasiDass
Resume_Vignesh_ThulasiDass
 
Modelling Event Data As A Graph
Modelling Event Data As A GraphModelling Event Data As A Graph
Modelling Event Data As A Graph
 
Aws community day pune 2020 v3
Aws community day pune 2020 v3Aws community day pune 2020 v3
Aws community day pune 2020 v3
 
Web Analytics
Web AnalyticsWeb Analytics
Web Analytics
 
Data lake
Data lakeData lake
Data lake
 

Similar to Power BI Streaming Datasets - San Diego BI Users Group

Power BI Streaming Datasets
Power BI Streaming DatasetsPower BI Streaming Datasets
Power BI Streaming DatasetsGreg McMurray
 
Data-Driven Transformation: Leveraging Big Data at Showtime with Apache Spark
Data-Driven Transformation: Leveraging Big Data at Showtime with Apache SparkData-Driven Transformation: Leveraging Big Data at Showtime with Apache Spark
Data-Driven Transformation: Leveraging Big Data at Showtime with Apache SparkDatabricks
 
APIs: the Glue of Cloud Computing
APIs: the Glue of Cloud ComputingAPIs: the Glue of Cloud Computing
APIs: the Glue of Cloud Computing3scale
 
INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...
INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...
INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...apidays
 
Streaming Visualization
Streaming VisualizationStreaming Visualization
Streaming VisualizationGuido Schmutz
 
Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BI
 Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BI Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BI
Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BIChourouk HJAIEJ
 
BDE SC6-hang out - technology part-SWC - Martin
BDE SC6-hang out - technology part-SWC - MartinBDE SC6-hang out - technology part-SWC - Martin
BDE SC6-hang out - technology part-SWC - MartinBigData_Europe
 
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...WSO2
 
Designing the Call of Cthulhu app with Google App Engine
Designing the Call of Cthulhu app with Google App EngineDesigning the Call of Cthulhu app with Google App Engine
Designing the Call of Cthulhu app with Google App EngineChris Bunch
 
DataOps - Production ML
DataOps - Production MLDataOps - Production ML
DataOps - Production MLAl Zindiq
 
Quo vadis Power BI?
Quo vadis Power BI?Quo vadis Power BI?
Quo vadis Power BI?Trivadis
 
Software as Service
Software as ServiceSoftware as Service
Software as Serviceabhigad
 
Streaming Visualization
Streaming VisualizationStreaming Visualization
Streaming VisualizationGuido Schmutz
 
Empowering you - Power BI, Power Platform & AI Builder
Empowering you  -  Power BI, Power Platform & AI BuilderEmpowering you  -  Power BI, Power Platform & AI Builder
Empowering you - Power BI, Power Platform & AI BuilderRui Quintino
 
apidays LIVE Australia - From micro to macro-coordination through domain-cent...
apidays LIVE Australia - From micro to macro-coordination through domain-cent...apidays LIVE Australia - From micro to macro-coordination through domain-cent...
apidays LIVE Australia - From micro to macro-coordination through domain-cent...apidays
 
Skills Portfolio
Skills PortfolioSkills Portfolio
Skills Portfoliorolee23
 
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...Serge Huber
 

Similar to Power BI Streaming Datasets - San Diego BI Users Group (20)

Power BI Streaming Datasets
Power BI Streaming DatasetsPower BI Streaming Datasets
Power BI Streaming Datasets
 
Data-Driven Transformation: Leveraging Big Data at Showtime with Apache Spark
Data-Driven Transformation: Leveraging Big Data at Showtime with Apache SparkData-Driven Transformation: Leveraging Big Data at Showtime with Apache Spark
Data-Driven Transformation: Leveraging Big Data at Showtime with Apache Spark
 
APIs: the Glue of Cloud Computing
APIs: the Glue of Cloud ComputingAPIs: the Glue of Cloud Computing
APIs: the Glue of Cloud Computing
 
presentation slides
presentation slidespresentation slides
presentation slides
 
Power bi
Power biPower bi
Power bi
 
INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...
INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...
INTERFACE by apidays 2023 - APIs with bounded contexts, Jose Haro Peralta, mi...
 
Streaming Visualization
Streaming VisualizationStreaming Visualization
Streaming Visualization
 
Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BI
 Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BI Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BI
Azure IOT: EVENT HUB & STREAM ANALYTICS & POWER BI
 
BDE SC6-hang out - technology part-SWC - Martin
BDE SC6-hang out - technology part-SWC - MartinBDE SC6-hang out - technology part-SWC - Martin
BDE SC6-hang out - technology part-SWC - Martin
 
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
WSO2 Guest Webinar: Building Enterprise Awareness with API Analytics in the A...
 
Designing the Call of Cthulhu app with Google App Engine
Designing the Call of Cthulhu app with Google App EngineDesigning the Call of Cthulhu app with Google App Engine
Designing the Call of Cthulhu app with Google App Engine
 
DataOps - Production ML
DataOps - Production MLDataOps - Production ML
DataOps - Production ML
 
Quo vadis Power BI?
Quo vadis Power BI?Quo vadis Power BI?
Quo vadis Power BI?
 
Software as Service
Software as ServiceSoftware as Service
Software as Service
 
Streaming Visualization
Streaming VisualizationStreaming Visualization
Streaming Visualization
 
Empowering you - Power BI, Power Platform & AI Builder
Empowering you  -  Power BI, Power Platform & AI BuilderEmpowering you  -  Power BI, Power Platform & AI Builder
Empowering you - Power BI, Power Platform & AI Builder
 
apidays LIVE Australia - From micro to macro-coordination through domain-cent...
apidays LIVE Australia - From micro to macro-coordination through domain-cent...apidays LIVE Australia - From micro to macro-coordination through domain-cent...
apidays LIVE Australia - From micro to macro-coordination through domain-cent...
 
Power bi and azure ml
Power bi and azure mlPower bi and azure ml
Power bi and azure ml
 
Skills Portfolio
Skills PortfolioSkills Portfolio
Skills Portfolio
 
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
ApacheCon NA 2018 : Apache Unomi, an Open Source Customer Data Platformapache...
 

More from Greg McMurray

Power Platform Introduction - Utah PowerApps and Flow User Group
Power Platform Introduction - Utah PowerApps and Flow User GroupPower Platform Introduction - Utah PowerApps and Flow User Group
Power Platform Introduction - Utah PowerApps and Flow User GroupGreg McMurray
 
SharePoint Search - August 2019 at Utah SharePoint User Group
SharePoint Search - August 2019 at Utah SharePoint User GroupSharePoint Search - August 2019 at Utah SharePoint User Group
SharePoint Search - August 2019 at Utah SharePoint User GroupGreg McMurray
 
PowerShell Basics for Office Apps and Servers
PowerShell Basics for Office Apps and ServersPowerShell Basics for Office Apps and Servers
PowerShell Basics for Office Apps and ServersGreg McMurray
 
Introduction to SQL Server Graph DB
Introduction to SQL Server Graph DBIntroduction to SQL Server Graph DB
Introduction to SQL Server Graph DBGreg McMurray
 
Dynamics 365 Web API - CRMUG April 2018
Dynamics 365 Web API - CRMUG April 2018Dynamics 365 Web API - CRMUG April 2018
Dynamics 365 Web API - CRMUG April 2018Greg McMurray
 
SQL Server Temporal Tables
SQL Server Temporal TablesSQL Server Temporal Tables
SQL Server Temporal TablesGreg McMurray
 
Sql Server 2016 and JSON
Sql Server 2016 and JSONSql Server 2016 and JSON
Sql Server 2016 and JSONGreg McMurray
 
Introduction to Microsoft Teams
Introduction to Microsoft TeamsIntroduction to Microsoft Teams
Introduction to Microsoft TeamsGreg McMurray
 
CRMUG Presentation on Dynamics CRM integration with SharePoint
CRMUG Presentation on Dynamics CRM integration with SharePointCRMUG Presentation on Dynamics CRM integration with SharePoint
CRMUG Presentation on Dynamics CRM integration with SharePointGreg McMurray
 
Real World Power Query for Excel and Power BI - SQL Saturday #576
Real World Power Query for Excel and Power BI - SQL Saturday #576Real World Power Query for Excel and Power BI - SQL Saturday #576
Real World Power Query for Excel and Power BI - SQL Saturday #576Greg McMurray
 

More from Greg McMurray (10)

Power Platform Introduction - Utah PowerApps and Flow User Group
Power Platform Introduction - Utah PowerApps and Flow User GroupPower Platform Introduction - Utah PowerApps and Flow User Group
Power Platform Introduction - Utah PowerApps and Flow User Group
 
SharePoint Search - August 2019 at Utah SharePoint User Group
SharePoint Search - August 2019 at Utah SharePoint User GroupSharePoint Search - August 2019 at Utah SharePoint User Group
SharePoint Search - August 2019 at Utah SharePoint User Group
 
PowerShell Basics for Office Apps and Servers
PowerShell Basics for Office Apps and ServersPowerShell Basics for Office Apps and Servers
PowerShell Basics for Office Apps and Servers
 
Introduction to SQL Server Graph DB
Introduction to SQL Server Graph DBIntroduction to SQL Server Graph DB
Introduction to SQL Server Graph DB
 
Dynamics 365 Web API - CRMUG April 2018
Dynamics 365 Web API - CRMUG April 2018Dynamics 365 Web API - CRMUG April 2018
Dynamics 365 Web API - CRMUG April 2018
 
SQL Server Temporal Tables
SQL Server Temporal TablesSQL Server Temporal Tables
SQL Server Temporal Tables
 
Sql Server 2016 and JSON
Sql Server 2016 and JSONSql Server 2016 and JSON
Sql Server 2016 and JSON
 
Introduction to Microsoft Teams
Introduction to Microsoft TeamsIntroduction to Microsoft Teams
Introduction to Microsoft Teams
 
CRMUG Presentation on Dynamics CRM integration with SharePoint
CRMUG Presentation on Dynamics CRM integration with SharePointCRMUG Presentation on Dynamics CRM integration with SharePoint
CRMUG Presentation on Dynamics CRM integration with SharePoint
 
Real World Power Query for Excel and Power BI - SQL Saturday #576
Real World Power Query for Excel and Power BI - SQL Saturday #576Real World Power Query for Excel and Power BI - SQL Saturday #576
Real World Power Query for Excel and Power BI - SQL Saturday #576
 

Recently uploaded

Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 

Recently uploaded (20)

Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 

Power BI Streaming Datasets - San Diego BI Users Group

  • 1. Power BI Streaming Datasets Greg McMurray San Diego BI Users Group, April 2018
  • 2. Greg McMurray  Senior Software Engineer at WECC  Founder of Aritus Computer Services - 19 years  Experience in Aerospace, Branding & Marketing, Software, Healthcare, Energy  Active in many user groups and communities  Find me online  @goyuix  https://www.linkedin.com/in/goyuix  https://stackoverflow.com/cv/goyuix - top 3% of users
  • 3. Western Electricity Coordinating Council (WECC)  Non-profit to ensure the reliability of the western interconnection  Approved Regional Entity by Federal Energy Regulatory Commission  Create, monitor & enforce reliability standards  Publish various models and independent perspective  Covers 14 western states, 2 Canadian provinces and Baja Mexico  We work with SDGE: San Diego Gas & Electric
  • 4. What We Will Cover  Streaming datasets in Power BI  Associated visualizations for streaming datasets  PowerShell scripts to push data to the service  Issues to watch out for  Discussion around potential uses
  • 5. Power BI Real-time Streaming Datasets
  • 6. Power BI Streaming Datasets  Preview announced in August 2016 https://powerbi.microsoft.com/en-us/blog/real-time-in-no-time-with-power-bi/  Released to general availability in January 2017 https://powerbi.microsoft.com/en-us/blog/announcing-general-availability-of-power-bi- real-time-streaming-datasets/  Datasets available through REST API or via PubNub  Example: Azure Stream Analytics pushes to REST API  Optionally store historic values – 1GB limit Pro / 10GB Premium  Important Note: Dashboards auto-refresh / Reports require refresh
  • 7. Example: Current Load on Western Interconnection
  • 8. Create a Streaming Dataset  Login to powerbi.com portal  Under your workspace create a new Streaming Dataset  This is different than a regular dataset, and isn’t an option there  We will create a sample for holding random numbers with the following schema  Value : Number  Min : Number  Max : Number  Stamp : DateTime  Enable Historical Analysis
  • 9. REST API: Adding Data via PowerShell  Each Streaming Dataset has a unique Push URL  Looks like https://api.powerbi.com/beta/<guid>/datasets/<guid>/rows  Has an encoded access key parameter as well  Base64 encoded, 64 bytes long  Doesn’t appear to be a string representation of anything special – just bytes  POST to this URL with a JSON string  Needs to be an array of objects that represent each row  Example: [ { “Value”:50 } ]
  • 11. Some Gotchas  Can’t open / use with Power BI Desktop  Dashboards auto-refresh to show latest data but…  Reports need to be manually refreshed  You can do this through the API as well  https://powerbi.microsoft.com/en-us/blog/announcing-data-refresh-apis-in-the-power-bi- service/  Streaming charts are touchy – you will break them
  • 12. Discussion: What are good examples?  Some common examples:  Bulk Electric System (of course!)  Temperature  San Diego: Traffic, Water, Tides, Fires, Park Attendance, Gas Prices, ???  What do these all have in common?  Similar values  Steady values / changes  They also can trigger actions: Change in generation, HVAC, traffic signals
  • 13. Wrap Up  Do you have any questions?  Does this spark any ideas for use for you?

Editor's Notes

  1. PubNub: Real-time publish / subscribe messaging platform founded in 2010. I first saw this in action with the Humble Indie Bundle about the same time. Azure Stream Analytics: Creates or overwrites a dataset automatically from Azure. Utilizes the API under the hood. API: This is what we will we be covering tonight.
  2. PeakRC.org publishes the current load on the western interconnection each minute. This was built using Azure Functions to run a PowerShell script each minute to grab that data and push it to a realtime streaming dataset in Power BI.