SlideShare a Scribd company logo
1 of 18
“Reliably Tracking Carbon & Losses”
(Data Reconciliation & Validating Measurements)
J.D. Kelly
May 31, 2017
1
2
• Depending on the carbon tax and your plant’s carbon intensity, the impact on
your margins can vary considerably as shown below for the oil-refining sector
• Therefore, accurately measuring, tracking and accounting for your CO2
emissions, etc. is obviously important to properly manage your plant’s
profitability – but how?
Cost of Carbon (CO2) on Margin ($ per Unit of Capacity)
J. Mertens, “Assessing Impact of Carbon Pricing on Refinery Profitability”, Petroleum Technology Quarterly, Q2, 2012.
Price of Carbon
(Tax)
Carbon Footprint
or Intensity
Cost of Carbon per
Unit of Throughput
“If you can’t measure it, you can’t
improve it” – Peter Drucker
“In God we trust, all others bring
data” – W. Edward Deming
3
• Corollary … “All measurements are inaccurate, some are consistent”
• Measurements are always corrupted by random errors (Normally distributed)
and systematic errors (e.g. zero and span biases)
• Data Reconciliation attempts to validate measurement *consistency* using
known conservation of matter laws for material, energy and momentum
– Uses optimization and statistics with engineering relationships (flowsheet) to
find a consistent set of measurements and can highlight bad measurements
– These relationships can be volume, mass, component balances, etc.
– Since carbon tracking involves liquid and gas streams, accounting will likely
be mass and component balances
– It is commercially available software
“All models are wrong, some models are useful” (G.E.P. Box)
* “Data Reconciliation is a technique to optimally adjust measured process data so that they are consistent with
known constraints.” Crowe, C.M., Data Reconciliation – Progress and Challenges, J. Proc. Contr., 6, 89-98, (1996).
4
• Assertion … Inaccurate accounting / tracking results in poor planning and
scheduling and ultimately poor business decisions
• Types of accounting / tracking in various industries:
– Production, Yield and Weight-Loss Accounting in Oil-Refining and Petrochemical Industries
– AMIRA P754 Metal Accounting and Reconciliation in Mining and Metallurgical Industries
– ISO 14051:2011 Material Flow Cost Accounting (MFCA) in other Process Industries such as
Food & Beverage, Bulk & Specialty Chemicals, Discrete-Parts Manufacturing, etc.
– Royalty Payments to technology licensors, governments, etc. as well as custody transfers
– Carbon (CO2) Footprint and Green House Gas (GHG) Emissions Tracking potentially required
in all Industries for carbon taxation - “Cap and Trade” based on these accounting
practices as well
• Five (5) Attributes of a Solid Data Foundation: accuracy, authenticity, integrity,
context and timeliness (ARC Report: Optimization: The Road Ahead for the Process Industries, May 2017).
Inconsistent measurements result in inaccurate accounting / tracking
5
• Assertion … If you are not using statistical data reconciliation and its gross-error
diagnostics, then bad measurements exist (period)
• The most common complaint of plant-wide production accounting is that “we
can’t close the daily material balance”
– This means that many individual material balances have significant and
unexplainable imbalances / inconsistencies - because there are too many
gross-errors!
• The most difficult data gathering requirement is logging time-varying flows such
as tank-to-tank transfers and other temporary line-ups / movements
• The most difficult modeling requirement is building and maintaining the large
plant-wide flowsheet (i.e., engineering relationships)
• The most difficult management requirement is to understand that failure to close
the material balance means failure to fully manage your business as
effectively as possible
Industry Observations and Issues over Past 20-Years
“If you don’t eat yer meat, you can’t have any pudding!” (Another Brick in the Wall, Pink Floyd, 1979)
6
• Showed that worst “(RAW–RECONCILED)/RAW” metric is only 30% accurate at
detecting gross-errors whereas gross-error statistics are 100% accurate!
Oil-Refinery Example (Volume Only)
FOB->FO
CDU -> FOB
7
• Detected bad density measurement for T300
• Shows importance of reconciling all three variables together
Oil-Refinery Example (Volume, Mass, Density)
Perimeters – Supply/Demand Points
or Sources/Sinks
Pools – Inventory or Holdup
Continuous-Processes – Blenders, Splitters,
Separators, Reactors , Fractionators & Black-
Boxes
Port-In – Flows into a Unit (similar to a nozzle).
Port-Out – Flows out of a Unit
Modeling Objects
8
• Reconciles material flows and simulates costs, tracks contaminants and largest
measurement uncertainties / gross-errors as well as inefficiencies and losses
– “MFCA is a management tool to better understand the potential environmental and financial consequences
of material and energy practices - it does so by assessing the physical material flows in a value-chain and
assigns adequate associated costs to these flows”
Material Flow and Cost Accounting (Mass, Cost)
Material Flow Material Cost Flow
MFCA is very well-known
in Europe (Germany) and
Asia (Japan) for tracking
waste streams
9
• Trace qualities in all running-gauge tanks with recycle on a sub-hour basis; useful
for composition and property tracking especially feeds / products before blending
Cascading Tank Example (Volume, Property)
10
• Reconcile cold and hot fluid (energy) flows and temperatures including estimating
heat transfer coefficients (U) to trend fouling factors (f) over time using
temperature, pressure and density corrected flows.
Heat Exchanger Network (Flow, Temperature)
11
• BP Texas City Raffinate Splitter (Isomerization Unit) Incident
• Page 78, Investigation Report: “Start up of a unit is a time when material balances should be
calculated.”
• Page 86 Final Report: “The Day Shift Board Operator stated that he was performing a mental
material balance every few minutes, but the actions taken are inconsistent with this.”
Material Balances during Startups / Shutdowns
Blowdown drum
overflowed at stack
releasing hydrocarbons
Investigation Report, “Refinery Explosion and Fire”, U.S. Chemical Safety and
Hazard Investigation Board, Report Number: 2005-04-I-TX, March, (2007).
Final Report, “Fatal Accident Investigation Report: Isomerization Unit
Explosion, Texas City, Texas, USA”, December, (2005).
12
• XOM Torrance FCCU Electrostatic Precipitator Incident
• Page 39, Investigation Report: “Tubes in a heat exchanger connected to the FCC unit developed
holes during extended operation, causing an increased main column pressure that contributed
to hydrocarbons flowing to the ESP.”
Material Balances during Standbys (“Safe-Park”)
Naphtha/slurry oil heat
exchanger tube leak
released hydrocarbons into
reactor, etc.
Investigation Report, “ExxonMobil Torrance Refinery Electrostatic
Precipitator Explosion”, U.S. Chemical Safety and Hazard Investigation
Board, Report Number: 2015-02-I-CA, May, (2017).
13
• Our unique on-line and automated approach (“The How”)
– Step 0: Build process unit-operation flowsheet model (In – Out = 0)
– Step 1: Monitor key process unit tags for steady-state i.e., flows, temperatures,
pressures, levels, concentrations, compositions, etc.
– Step 2: Include upstream and downstream process unit holdup / level tags and
automatically estimate fill and draw rates for these inventory vessels to increase
“software redundancy” (hardware redundancy is more physical measurements)
– Step 3: Perform steady-state data reconciliation when process unit is at steady-state;
this will minimize apparent gross-errors due to unaccounted accumulation
– Step 4: Report measurement adjustments and gross-errors as auxiliary diagnostic tags
when above critical value i.e., 95% and 99% confidence intervals
– Step 5: Plot measurement diagnostic tags over time to identify persistent measurement
defects or outliers (non-random +ve and –ve adjustments / deviations) to increase
“temporal redundancy”
Getting ready for carbon pricing and carbon footprint tracking …
14
• Step 1: Steady-State Detection (SSD) Step 2: Fill & Draw Rate Estimation
• Steps 4 & 5: Reporting and Monitoring
Highlighting some details …
First Sign of Non-
Stationarity /
Unsteady-State.
Tag Raw Reconciled Statistic
FC101 100.1 97.6 7.78 (Bad)
PT202 35.9 34.6 5.21 (Bad)
TI303 339.2 340.5 2.10 (Good)
AI404 6.45 6.67 1.93 (Good)
-0.06
-0.04
-0.02
0
0.02
0.04
0.06
1
6
11
16
21
26
31
36
41
46
51
56
61
66
71
76
81
86
91
96
FC101 (Raw – Reconciled) Looks Randomly
Distributed.
15
• Validating measurements for consistency is a requirement before using process
and production data for any purpose especially tracking carbon and losses 
• The most reliable and accurate technique to screen process and production data
for statistically significant gross-errors or defects is data reconciliation
– Not Machine Learning, not Extended Kalman Filtering, not Neural Networks
• On-line / real-time data reconciliation applied in an automated fashion is the
most effective and efficient way to deploy data reconciliation - results can then be
easily displayed in a dashboard, emailed as alerts, historized, etc.
• Off-line / daily data reconciliation using a plant-wide flowsheet deployed in
spreadsheets and other business intelligence software should be augmented
with on-line data reconciliation to pre-screen for sub-day measurement
defects and other process anomalies (leaks, mis-logging, losses)
Summary
16
• First data reconciliation engine installed at the PetroCanada Edmonton Refinery to
replace their “Volumetrics” inside Honeywell’s Production Balance (PB)
– Honeywell PB (now PAR) installed in over 300 sites world-wide in many different
process industries including mining, metals and minerals, chemicals,
petrochemicals, etc.
• Current data reconciliation engine installed in STAN2 software (www.stan2web.net)
from the Vienna University of Technology with over 9,000 registered users – also
being used for MFCA in Finland’s agricultural industries
– Requested help to solve their types of problems with an extreme number
unmeasured variables (non-observable flows) as most industries do not have a
lot of measurements i.e., waste-water treatment facilities
• Ready to be deployed on-line using simple API / SDK connected to any OPC server 
Implementations
17
• In anticipation of carbon pricing, companies need to start collecting and analyzing
their process and production data and confirming its accuracy, consistency and
reliability
• This will establish a baseline as well as identify where additional instrumentation
is required to increase both the hardware and software redundancy of the
system
• This will also identify existing measurements with systematic errors which can be
investigated further i.e., re-calibrate, repair, re-purpose, etc.
• In addition, consider a material flow cost accounting (MFCA) exercise to quantify
the economic value of each co-feed, co-product and by-product of your plant
including emissions, effluents and utilities
Conclusions
18
• Kelly, J.D., “On Finding the Matrix Projection in the Data Reconciliation Solution”, Computers & Chemical Engineering, 22, 1998.
• Kelly, J.D., “A Regularization Approach to the Reconciliation of Constrained Data Sets”, Computers & Chemical Engineering, 22, 1998.
• Kelly, J.D., “Reconciliation of Process Data using other Projection Matrices”, Computers & Chemical Engineering, 23, 1999.
• Kelly, J.D., “Practical Issues in the Mass Reconciliation of Large Plant-Wide Flowsheets”, AIChE Spring Meeting, Houston, March, 1999.
• Kelly, J.D., “The Necessity of Data Reconciliation: Some Practical Issues”, NPRA Computer Conference, Chicago, November, 2000.
• Kelly, J.D., “Formulating Large-Scale Quantity-Quality Bilinear Data Reconciliation Problems”, Computers & Chemical Engineering, 28, 2004.
• Kelly, J.D., “Techniques for Solving Industrial Nonlinear Data Reconciliation Problems”, Computers & Chemical Engineering, 28, 2004.
• Kelly, J.D., “Production Modeling for Multimodal Operations”, Chemical Engineering Progress, February, 2004.
• Poku, M.B., Biegler, L.T., Kelly, J.D., “Nonlinear Process Optimization with Many Degrees of Freedom in Process Engineering", Industrial &
Engineering Chemistry Research, 43, 2004.
• Kelly, J.D., Mann, J.L., “Improve Yield Accounting by including Density Measurements Explicitly”, Hydrocarbon Processing, February, 2005.
• Kelly, J.D., Mann, J.L., Schulz, F.G., “Improve the Accuracy of Tracing Production Qualities using Successive Reconciliation”, Hydrocarbon Processing,
April, 2005.
• Kelly, J.D., Zyngier, D., “A New and Improved MILP Formulation to Optimize Observability, Redundancy and Precision for Sensor Superstructure
Problems”, AIChE Journal, 54, 2008.
• Kelly, J.D., Zyngier, D., “Continuously Improve Planning and Scheduling Models with Parameter Feedback”, FOCAPO 2008, July, 2008.
• Zyngier, D., Kelly, J.D., “UOPSS: A New Paradigm for Modeling Production Planning & Scheduling Systems”, ESCAPE 22, June, 2012.
• Kelly, J.D., Hedengren, J.D., “A Steady-State Detection (SSD) Algorithm to Detect Non-Stationary Drifts in Processes”, Journal of Process Control, 23,
2013.
• Kelly, J.D., Zyngier, D., “Unit-Operation Nonlinear Modeling for Planning and Scheduling Applications”, Optimization and Engineering, February,
2016.
• Kelly, J.D., Menezes, B.C., Grossmann, I.E., Engineer, F., “Feedstock Storage Assignment in Process Industry Quality Problems”, FOCAPO 2017,
January, 2017.
References

More Related Content

What's hot

Sprint calendar
Sprint calendarSprint calendar
Sprint calendar
Son Tran
 
Best practices quality assurance
Best practices   quality assuranceBest practices   quality assurance
Best practices quality assurance
Shakal Shukla
 
DMM9 - Data Migration Testing
DMM9 - Data Migration TestingDMM9 - Data Migration Testing
DMM9 - Data Migration Testing
Nick van Beest
 
Manufacturing - User Manual v1
Manufacturing - User Manual v1Manufacturing - User Manual v1
Manufacturing - User Manual v1
Rohan Thushara
 

What's hot (20)

Agile Product Management: Getting from Backlog to Value
Agile Product Management: Getting from Backlog to ValueAgile Product Management: Getting from Backlog to Value
Agile Product Management: Getting from Backlog to Value
 
Value Stream Management: Is Your Organization Ready?
Value Stream Management: Is Your Organization Ready?Value Stream Management: Is Your Organization Ready?
Value Stream Management: Is Your Organization Ready?
 
Causal Tree Analysis (Root Cause)
Causal Tree Analysis (Root Cause)Causal Tree Analysis (Root Cause)
Causal Tree Analysis (Root Cause)
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
Scrumban Demystified
Scrumban DemystifiedScrumban Demystified
Scrumban Demystified
 
Basics_of_petroleum_Engineering_for_well.ppt
Basics_of_petroleum_Engineering_for_well.pptBasics_of_petroleum_Engineering_for_well.ppt
Basics_of_petroleum_Engineering_for_well.ppt
 
UAT Kickoff Presentation 10 29 09
UAT Kickoff Presentation 10 29 09UAT Kickoff Presentation 10 29 09
UAT Kickoff Presentation 10 29 09
 
Sprint calendar
Sprint calendarSprint calendar
Sprint calendar
 
Lean Agile Metrics And KPIs
Lean Agile Metrics And KPIsLean Agile Metrics And KPIs
Lean Agile Metrics And KPIs
 
Roadmap template
Roadmap templateRoadmap template
Roadmap template
 
Best practices quality assurance
Best practices   quality assuranceBest practices   quality assurance
Best practices quality assurance
 
Agile Software Development
Agile Software DevelopmentAgile Software Development
Agile Software Development
 
DMM9 - Data Migration Testing
DMM9 - Data Migration TestingDMM9 - Data Migration Testing
DMM9 - Data Migration Testing
 
Manufacturing - User Manual v1
Manufacturing - User Manual v1Manufacturing - User Manual v1
Manufacturing - User Manual v1
 
A Guide for Preparing and Facilitating Retrospectives
A Guide for Preparing and Facilitating RetrospectivesA Guide for Preparing and Facilitating Retrospectives
A Guide for Preparing and Facilitating Retrospectives
 
Unconventional Reservoir Characterization
Unconventional Reservoir CharacterizationUnconventional Reservoir Characterization
Unconventional Reservoir Characterization
 
Introduction to Enterprise Agile Frameworks
Introduction to Enterprise Agile FrameworksIntroduction to Enterprise Agile Frameworks
Introduction to Enterprise Agile Frameworks
 
Inspect and adapt
Inspect and adaptInspect and adapt
Inspect and adapt
 
QATAR GAS
QATAR GASQATAR GAS
QATAR GAS
 
Reservoir simulation (april 2017)
Reservoir simulation (april 2017)Reservoir simulation (april 2017)
Reservoir simulation (april 2017)
 

Similar to Data reconciliation, Validating Measurements

Enforcement Penalty ProcessUniversity of HartfordApril 16,.docx
Enforcement Penalty ProcessUniversity of HartfordApril 16,.docxEnforcement Penalty ProcessUniversity of HartfordApril 16,.docx
Enforcement Penalty ProcessUniversity of HartfordApril 16,.docx
gidmanmary
 
1 2 chem plantdesign-intro to plant design economics
1 2 chem plantdesign-intro to plant design  economics1 2 chem plantdesign-intro to plant design  economics
1 2 chem plantdesign-intro to plant design economics
ayimsevenfold
 
Assent webinar cm3_updates-aug19-2014-slideshare3
Assent webinar cm3_updates-aug19-2014-slideshare3Assent webinar cm3_updates-aug19-2014-slideshare3
Assent webinar cm3_updates-aug19-2014-slideshare3
brytani
 
Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)
Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)
Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)
glennmcgillivray
 
G04 Root Cause Relationships
G04 Root Cause RelationshipsG04 Root Cause Relationships
G04 Root Cause Relationships
Leanleaders.org
 
G04 Root Cause Relationships
G04 Root Cause RelationshipsG04 Root Cause Relationships
G04 Root Cause Relationships
Leanleaders.org
 
SUOKAS Kuwait s-2015 slides_FINAL
SUOKAS Kuwait s-2015 slides_FINALSUOKAS Kuwait s-2015 slides_FINAL
SUOKAS Kuwait s-2015 slides_FINAL
Jouko Suokas
 

Similar to Data reconciliation, Validating Measurements (20)

Mandatory Energy Audit for Designated Consumers (BEE)
Mandatory Energy Audit for Designated Consumers (BEE)Mandatory Energy Audit for Designated Consumers (BEE)
Mandatory Energy Audit for Designated Consumers (BEE)
 
Eva Lyubich
Eva LyubichEva Lyubich
Eva Lyubich
 
Reconciling Mass And Energy Balances In An Ethylene Complex
Reconciling Mass And Energy Balances In An Ethylene ComplexReconciling Mass And Energy Balances In An Ethylene Complex
Reconciling Mass And Energy Balances In An Ethylene Complex
 
Global flow measurement consistency
Global flow measurement consistencyGlobal flow measurement consistency
Global flow measurement consistency
 
Enforcement Penalty ProcessUniversity of HartfordApril 16,.docx
Enforcement Penalty ProcessUniversity of HartfordApril 16,.docxEnforcement Penalty ProcessUniversity of HartfordApril 16,.docx
Enforcement Penalty ProcessUniversity of HartfordApril 16,.docx
 
1 2 chem plantdesign-intro to plant design economics
1 2 chem plantdesign-intro to plant design  economics1 2 chem plantdesign-intro to plant design  economics
1 2 chem plantdesign-intro to plant design economics
 
Using a system cost analysis to quantify drilling fluids and
Using a system cost analysis to quantify drilling fluids andUsing a system cost analysis to quantify drilling fluids and
Using a system cost analysis to quantify drilling fluids and
 
The Carbon Nexus - Boilers, Power Plants, and Strategic Energy Management
The Carbon Nexus - Boilers, Power Plants, and Strategic Energy ManagementThe Carbon Nexus - Boilers, Power Plants, and Strategic Energy Management
The Carbon Nexus - Boilers, Power Plants, and Strategic Energy Management
 
Impacts of carbon tax.docx
Impacts of carbon tax.docxImpacts of carbon tax.docx
Impacts of carbon tax.docx
 
Assent webinar cm3_updates-aug19-2014-slideshare3
Assent webinar cm3_updates-aug19-2014-slideshare3Assent webinar cm3_updates-aug19-2014-slideshare3
Assent webinar cm3_updates-aug19-2014-slideshare3
 
Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)
Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)
Friday Forum: Updating Canada’s Fire Danger Rating System (August 7, 2020)
 
Morrison, Rob, Barr Engineering, Walsack, Phil, MPUA, Funny Things I Found in...
Morrison, Rob, Barr Engineering, Walsack, Phil, MPUA, Funny Things I Found in...Morrison, Rob, Barr Engineering, Walsack, Phil, MPUA, Funny Things I Found in...
Morrison, Rob, Barr Engineering, Walsack, Phil, MPUA, Funny Things I Found in...
 
Making Sense of Metering Data
Making Sense of Metering DataMaking Sense of Metering Data
Making Sense of Metering Data
 
Introduction to energy audit part 2
Introduction to energy audit part 2Introduction to energy audit part 2
Introduction to energy audit part 2
 
G04 Root Cause Relationships
G04 Root Cause RelationshipsG04 Root Cause Relationships
G04 Root Cause Relationships
 
G04 Root Cause Relationships
G04 Root Cause RelationshipsG04 Root Cause Relationships
G04 Root Cause Relationships
 
Kp bloch psm preparedness final rev
Kp bloch psm preparedness final revKp bloch psm preparedness final rev
Kp bloch psm preparedness final rev
 
SUOKAS Kuwait s-2015 slides_FINAL
SUOKAS Kuwait s-2015 slides_FINALSUOKAS Kuwait s-2015 slides_FINAL
SUOKAS Kuwait s-2015 slides_FINAL
 
Discussion on modern trend in measurement, Combustion control,optimization.pptx
Discussion on modern trend in measurement, Combustion control,optimization.pptxDiscussion on modern trend in measurement, Combustion control,optimization.pptx
Discussion on modern trend in measurement, Combustion control,optimization.pptx
 
Analysis of Foundry defects and Quality improvement of Sand casting
Analysis of Foundry defects and Quality improvement of Sand castingAnalysis of Foundry defects and Quality improvement of Sand casting
Analysis of Foundry defects and Quality improvement of Sand casting
 

Recently uploaded

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Recently uploaded (20)

A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 

Data reconciliation, Validating Measurements

  • 1. “Reliably Tracking Carbon & Losses” (Data Reconciliation & Validating Measurements) J.D. Kelly May 31, 2017 1
  • 2. 2 • Depending on the carbon tax and your plant’s carbon intensity, the impact on your margins can vary considerably as shown below for the oil-refining sector • Therefore, accurately measuring, tracking and accounting for your CO2 emissions, etc. is obviously important to properly manage your plant’s profitability – but how? Cost of Carbon (CO2) on Margin ($ per Unit of Capacity) J. Mertens, “Assessing Impact of Carbon Pricing on Refinery Profitability”, Petroleum Technology Quarterly, Q2, 2012. Price of Carbon (Tax) Carbon Footprint or Intensity Cost of Carbon per Unit of Throughput “If you can’t measure it, you can’t improve it” – Peter Drucker “In God we trust, all others bring data” – W. Edward Deming
  • 3. 3 • Corollary … “All measurements are inaccurate, some are consistent” • Measurements are always corrupted by random errors (Normally distributed) and systematic errors (e.g. zero and span biases) • Data Reconciliation attempts to validate measurement *consistency* using known conservation of matter laws for material, energy and momentum – Uses optimization and statistics with engineering relationships (flowsheet) to find a consistent set of measurements and can highlight bad measurements – These relationships can be volume, mass, component balances, etc. – Since carbon tracking involves liquid and gas streams, accounting will likely be mass and component balances – It is commercially available software “All models are wrong, some models are useful” (G.E.P. Box) * “Data Reconciliation is a technique to optimally adjust measured process data so that they are consistent with known constraints.” Crowe, C.M., Data Reconciliation – Progress and Challenges, J. Proc. Contr., 6, 89-98, (1996).
  • 4. 4 • Assertion … Inaccurate accounting / tracking results in poor planning and scheduling and ultimately poor business decisions • Types of accounting / tracking in various industries: – Production, Yield and Weight-Loss Accounting in Oil-Refining and Petrochemical Industries – AMIRA P754 Metal Accounting and Reconciliation in Mining and Metallurgical Industries – ISO 14051:2011 Material Flow Cost Accounting (MFCA) in other Process Industries such as Food & Beverage, Bulk & Specialty Chemicals, Discrete-Parts Manufacturing, etc. – Royalty Payments to technology licensors, governments, etc. as well as custody transfers – Carbon (CO2) Footprint and Green House Gas (GHG) Emissions Tracking potentially required in all Industries for carbon taxation - “Cap and Trade” based on these accounting practices as well • Five (5) Attributes of a Solid Data Foundation: accuracy, authenticity, integrity, context and timeliness (ARC Report: Optimization: The Road Ahead for the Process Industries, May 2017). Inconsistent measurements result in inaccurate accounting / tracking
  • 5. 5 • Assertion … If you are not using statistical data reconciliation and its gross-error diagnostics, then bad measurements exist (period) • The most common complaint of plant-wide production accounting is that “we can’t close the daily material balance” – This means that many individual material balances have significant and unexplainable imbalances / inconsistencies - because there are too many gross-errors! • The most difficult data gathering requirement is logging time-varying flows such as tank-to-tank transfers and other temporary line-ups / movements • The most difficult modeling requirement is building and maintaining the large plant-wide flowsheet (i.e., engineering relationships) • The most difficult management requirement is to understand that failure to close the material balance means failure to fully manage your business as effectively as possible Industry Observations and Issues over Past 20-Years “If you don’t eat yer meat, you can’t have any pudding!” (Another Brick in the Wall, Pink Floyd, 1979)
  • 6. 6 • Showed that worst “(RAW–RECONCILED)/RAW” metric is only 30% accurate at detecting gross-errors whereas gross-error statistics are 100% accurate! Oil-Refinery Example (Volume Only) FOB->FO CDU -> FOB
  • 7. 7 • Detected bad density measurement for T300 • Shows importance of reconciling all three variables together Oil-Refinery Example (Volume, Mass, Density) Perimeters – Supply/Demand Points or Sources/Sinks Pools – Inventory or Holdup Continuous-Processes – Blenders, Splitters, Separators, Reactors , Fractionators & Black- Boxes Port-In – Flows into a Unit (similar to a nozzle). Port-Out – Flows out of a Unit Modeling Objects
  • 8. 8 • Reconciles material flows and simulates costs, tracks contaminants and largest measurement uncertainties / gross-errors as well as inefficiencies and losses – “MFCA is a management tool to better understand the potential environmental and financial consequences of material and energy practices - it does so by assessing the physical material flows in a value-chain and assigns adequate associated costs to these flows” Material Flow and Cost Accounting (Mass, Cost) Material Flow Material Cost Flow MFCA is very well-known in Europe (Germany) and Asia (Japan) for tracking waste streams
  • 9. 9 • Trace qualities in all running-gauge tanks with recycle on a sub-hour basis; useful for composition and property tracking especially feeds / products before blending Cascading Tank Example (Volume, Property)
  • 10. 10 • Reconcile cold and hot fluid (energy) flows and temperatures including estimating heat transfer coefficients (U) to trend fouling factors (f) over time using temperature, pressure and density corrected flows. Heat Exchanger Network (Flow, Temperature)
  • 11. 11 • BP Texas City Raffinate Splitter (Isomerization Unit) Incident • Page 78, Investigation Report: “Start up of a unit is a time when material balances should be calculated.” • Page 86 Final Report: “The Day Shift Board Operator stated that he was performing a mental material balance every few minutes, but the actions taken are inconsistent with this.” Material Balances during Startups / Shutdowns Blowdown drum overflowed at stack releasing hydrocarbons Investigation Report, “Refinery Explosion and Fire”, U.S. Chemical Safety and Hazard Investigation Board, Report Number: 2005-04-I-TX, March, (2007). Final Report, “Fatal Accident Investigation Report: Isomerization Unit Explosion, Texas City, Texas, USA”, December, (2005).
  • 12. 12 • XOM Torrance FCCU Electrostatic Precipitator Incident • Page 39, Investigation Report: “Tubes in a heat exchanger connected to the FCC unit developed holes during extended operation, causing an increased main column pressure that contributed to hydrocarbons flowing to the ESP.” Material Balances during Standbys (“Safe-Park”) Naphtha/slurry oil heat exchanger tube leak released hydrocarbons into reactor, etc. Investigation Report, “ExxonMobil Torrance Refinery Electrostatic Precipitator Explosion”, U.S. Chemical Safety and Hazard Investigation Board, Report Number: 2015-02-I-CA, May, (2017).
  • 13. 13 • Our unique on-line and automated approach (“The How”) – Step 0: Build process unit-operation flowsheet model (In – Out = 0) – Step 1: Monitor key process unit tags for steady-state i.e., flows, temperatures, pressures, levels, concentrations, compositions, etc. – Step 2: Include upstream and downstream process unit holdup / level tags and automatically estimate fill and draw rates for these inventory vessels to increase “software redundancy” (hardware redundancy is more physical measurements) – Step 3: Perform steady-state data reconciliation when process unit is at steady-state; this will minimize apparent gross-errors due to unaccounted accumulation – Step 4: Report measurement adjustments and gross-errors as auxiliary diagnostic tags when above critical value i.e., 95% and 99% confidence intervals – Step 5: Plot measurement diagnostic tags over time to identify persistent measurement defects or outliers (non-random +ve and –ve adjustments / deviations) to increase “temporal redundancy” Getting ready for carbon pricing and carbon footprint tracking …
  • 14. 14 • Step 1: Steady-State Detection (SSD) Step 2: Fill & Draw Rate Estimation • Steps 4 & 5: Reporting and Monitoring Highlighting some details … First Sign of Non- Stationarity / Unsteady-State. Tag Raw Reconciled Statistic FC101 100.1 97.6 7.78 (Bad) PT202 35.9 34.6 5.21 (Bad) TI303 339.2 340.5 2.10 (Good) AI404 6.45 6.67 1.93 (Good) -0.06 -0.04 -0.02 0 0.02 0.04 0.06 1 6 11 16 21 26 31 36 41 46 51 56 61 66 71 76 81 86 91 96 FC101 (Raw – Reconciled) Looks Randomly Distributed.
  • 15. 15 • Validating measurements for consistency is a requirement before using process and production data for any purpose especially tracking carbon and losses  • The most reliable and accurate technique to screen process and production data for statistically significant gross-errors or defects is data reconciliation – Not Machine Learning, not Extended Kalman Filtering, not Neural Networks • On-line / real-time data reconciliation applied in an automated fashion is the most effective and efficient way to deploy data reconciliation - results can then be easily displayed in a dashboard, emailed as alerts, historized, etc. • Off-line / daily data reconciliation using a plant-wide flowsheet deployed in spreadsheets and other business intelligence software should be augmented with on-line data reconciliation to pre-screen for sub-day measurement defects and other process anomalies (leaks, mis-logging, losses) Summary
  • 16. 16 • First data reconciliation engine installed at the PetroCanada Edmonton Refinery to replace their “Volumetrics” inside Honeywell’s Production Balance (PB) – Honeywell PB (now PAR) installed in over 300 sites world-wide in many different process industries including mining, metals and minerals, chemicals, petrochemicals, etc. • Current data reconciliation engine installed in STAN2 software (www.stan2web.net) from the Vienna University of Technology with over 9,000 registered users – also being used for MFCA in Finland’s agricultural industries – Requested help to solve their types of problems with an extreme number unmeasured variables (non-observable flows) as most industries do not have a lot of measurements i.e., waste-water treatment facilities • Ready to be deployed on-line using simple API / SDK connected to any OPC server  Implementations
  • 17. 17 • In anticipation of carbon pricing, companies need to start collecting and analyzing their process and production data and confirming its accuracy, consistency and reliability • This will establish a baseline as well as identify where additional instrumentation is required to increase both the hardware and software redundancy of the system • This will also identify existing measurements with systematic errors which can be investigated further i.e., re-calibrate, repair, re-purpose, etc. • In addition, consider a material flow cost accounting (MFCA) exercise to quantify the economic value of each co-feed, co-product and by-product of your plant including emissions, effluents and utilities Conclusions
  • 18. 18 • Kelly, J.D., “On Finding the Matrix Projection in the Data Reconciliation Solution”, Computers & Chemical Engineering, 22, 1998. • Kelly, J.D., “A Regularization Approach to the Reconciliation of Constrained Data Sets”, Computers & Chemical Engineering, 22, 1998. • Kelly, J.D., “Reconciliation of Process Data using other Projection Matrices”, Computers & Chemical Engineering, 23, 1999. • Kelly, J.D., “Practical Issues in the Mass Reconciliation of Large Plant-Wide Flowsheets”, AIChE Spring Meeting, Houston, March, 1999. • Kelly, J.D., “The Necessity of Data Reconciliation: Some Practical Issues”, NPRA Computer Conference, Chicago, November, 2000. • Kelly, J.D., “Formulating Large-Scale Quantity-Quality Bilinear Data Reconciliation Problems”, Computers & Chemical Engineering, 28, 2004. • Kelly, J.D., “Techniques for Solving Industrial Nonlinear Data Reconciliation Problems”, Computers & Chemical Engineering, 28, 2004. • Kelly, J.D., “Production Modeling for Multimodal Operations”, Chemical Engineering Progress, February, 2004. • Poku, M.B., Biegler, L.T., Kelly, J.D., “Nonlinear Process Optimization with Many Degrees of Freedom in Process Engineering", Industrial & Engineering Chemistry Research, 43, 2004. • Kelly, J.D., Mann, J.L., “Improve Yield Accounting by including Density Measurements Explicitly”, Hydrocarbon Processing, February, 2005. • Kelly, J.D., Mann, J.L., Schulz, F.G., “Improve the Accuracy of Tracing Production Qualities using Successive Reconciliation”, Hydrocarbon Processing, April, 2005. • Kelly, J.D., Zyngier, D., “A New and Improved MILP Formulation to Optimize Observability, Redundancy and Precision for Sensor Superstructure Problems”, AIChE Journal, 54, 2008. • Kelly, J.D., Zyngier, D., “Continuously Improve Planning and Scheduling Models with Parameter Feedback”, FOCAPO 2008, July, 2008. • Zyngier, D., Kelly, J.D., “UOPSS: A New Paradigm for Modeling Production Planning & Scheduling Systems”, ESCAPE 22, June, 2012. • Kelly, J.D., Hedengren, J.D., “A Steady-State Detection (SSD) Algorithm to Detect Non-Stationary Drifts in Processes”, Journal of Process Control, 23, 2013. • Kelly, J.D., Zyngier, D., “Unit-Operation Nonlinear Modeling for Planning and Scheduling Applications”, Optimization and Engineering, February, 2016. • Kelly, J.D., Menezes, B.C., Grossmann, I.E., Engineer, F., “Feedstock Storage Assignment in Process Industry Quality Problems”, FOCAPO 2017, January, 2017. References