SlideShare a Scribd company logo
1 of 10
Predicting Controls Maturity
Based on Audit Results
Sohit Raina, Internal Auditor
Vikas Dutta, Principal Internal Auditor
Nov 7, 2014
2 © 2014 CA. ALL RIGHTS RESERVED.
What are Controls Maturity Indicators?
Enable quick health check/current state of controls maturity;
Identify desired state of control maturity;
Develop a plan for improvement.
Indicators that allow management to measure a trend in
control maturity over a period of time
Why Controls Maturity Indicators?
3 © 2014 CA. ALL RIGHTS RESERVED.
Analysing Controls Maturity Based on Audit Results
Factors such as number of findings, severity, and audit
cycle time can be indicators of controls maturity.
Number of Findings
Severity of Findings Controls Maturity
Audit cycle time
4 © 2014 CA. ALL RIGHTS RESERVED.
Number of Findings v/s Number of Days
y = 10.529x + 81.502
0
50
100
150
200
250
0 1 2 3 4 5 6 7 8 9
Avg # of Days in Year 1
Number of Findings v/s Average Number of Days:
Evaluation of controls maturity, by tracking number of findings per audit and associated audit
cycle time.
5 © 2014 CA. ALL RIGHTS RESERVED.
Number of Findings v/s Number of Days
y = 10.529x + 81.502
y = 10.329x + 54.473
0
50
100
150
200
250
0 1 2 3 4 5 6 7 8 9
Avg # of Days in Year 1
Avg # of Days in Year 2
Y = 75
6 © 2014 CA. ALL RIGHTS RESERVED.
Weighted Score of Findings v/s Average Number of Days:
In order to incorporate the impact of findings (high, medium ,low) and overall report rating, a
weighted score was assigned to the findings and plotted against number of days.
Weighted score assigned:
High = 5
Medium = 3
Low = 1
For Example:
Analysis of Audit Results using weighted score
Fiscal
Year
Project Name High Medium Low Total # of Findings
Weighted Score (5H + 3M +
1L)
Total No.of
Days
Year 1 Audit A 1 2 1 4 12 92
Year 1 Audit B 0 0 3 3 3 60
Year 1 Audit C 1 2 0 3 11 74
Year 1 Audit D 1 2 1 4 12 121
7 © 2014 CA. ALL RIGHTS RESERVED.
Analysis of Results Using Weighted Score
Weighted Score
Values
Weighted Score
Group
Number of
Audits in Year 1
Avg # of Days
in Year 1
Number of
Audits in Year 2
Avg # of Days
in Year 2
0 to 5 1 3 109.3 6 74
6 to 9 2 5 105.9 8 98
10 to 12 3 9 116.0 9 114
13 to 15 4 9 119.6 8 68.5
16 to 18 5 7 122.3 5 107.5
19 and above 6 7 151 4 123.7
8 © 2014 CA. ALL RIGHTS RESERVED.
Severity & Number of Findings
y = 7.4699x + 94.513
y = 6.6143x + 74.467
0
20
40
60
80
100
120
140
160
0 1 2 3 4 5 6 7
Weighted Score of Findings v/s Avg No. of Days
Avg # of Days in Year 1
Avg # of Days in Year 2
Y = 75
9 © 2014 CA. ALL RIGHTS RESERVED.
Lessons Learned
Decrease in cycle time and rise in controls maturity as a result of:
• Maturing business processes
• Readily available data (common ERP system across organization)
• Clearly defined and documented processes
• Implementation of automated/preventive controls
• Familiarity and established relationships with control owners
Other factors to be considered for future state:
• Experienced auditors
• Faster escalation process
• Shorter-less complex audits
• Improved report writing
• Timely response from management
10 © 2014 CA. ALL RIGHTS RESERVED.
Thank you!
Sohit Raina
 sohit.raina@ca.com
Vikas Dutta
 vikas.dutta@ca.com

More Related Content

What's hot

Program tracker dashboard v2 (example)
Program tracker dashboard v2 (example)Program tracker dashboard v2 (example)
Program tracker dashboard v2 (example)Paul Cooper IEng MIET
 
AABB - Improving Methods for Matching Single Donor Platelet Production -blue
AABB - Improving Methods for Matching Single Donor Platelet Production -blueAABB - Improving Methods for Matching Single Donor Platelet Production -blue
AABB - Improving Methods for Matching Single Donor Platelet Production -blueTracy Mallios
 
Rentabilidade acumulada fundos imobiliários fevereiro 2015
Rentabilidade acumulada fundos imobiliários fevereiro 2015Rentabilidade acumulada fundos imobiliários fevereiro 2015
Rentabilidade acumulada fundos imobiliários fevereiro 2015claudiusinhos
 
Rentabilidade acumulada fundos imobiliários novembro 2015
Rentabilidade acumulada fundos imobiliários novembro 2015Rentabilidade acumulada fundos imobiliários novembro 2015
Rentabilidade acumulada fundos imobiliários novembro 2015claudiusinhos
 
Gap Analysis & Improvement Tactics for Your EH&S Program
Gap Analysis & Improvement Tactics for Your EH&S ProgramGap Analysis & Improvement Tactics for Your EH&S Program
Gap Analysis & Improvement Tactics for Your EH&S ProgramTriumvirate Environmental
 
Key Performance Indicators
Key Performance IndicatorsKey Performance Indicators
Key Performance IndicatorsSteven Sunder
 
Rentabilidade acumulada fundos imobiliários agosto 2015
Rentabilidade acumulada fundos imobiliários agosto 2015Rentabilidade acumulada fundos imobiliários agosto 2015
Rentabilidade acumulada fundos imobiliários agosto 2015claudiusinhos
 
GBAF15 - Elective, Diagnostic and Outpatient Access to Services
GBAF15 - Elective, Diagnostic and Outpatient Access to Services GBAF15 - Elective, Diagnostic and Outpatient Access to Services
GBAF15 - Elective, Diagnostic and Outpatient Access to Services Matthew Cunningham
 
Data Driven Decision Making - Chapter 1. Team Performance
Data Driven Decision Making - Chapter 1. Team PerformanceData Driven Decision Making - Chapter 1. Team Performance
Data Driven Decision Making - Chapter 1. Team PerformanceRevengg
 
Maximize Compliance & Cost Savings with Environmental Preventative Maintenance
Maximize Compliance & Cost Savings with Environmental Preventative MaintenanceMaximize Compliance & Cost Savings with Environmental Preventative Maintenance
Maximize Compliance & Cost Savings with Environmental Preventative MaintenanceTriumvirate Environmental
 

What's hot (10)

Program tracker dashboard v2 (example)
Program tracker dashboard v2 (example)Program tracker dashboard v2 (example)
Program tracker dashboard v2 (example)
 
AABB - Improving Methods for Matching Single Donor Platelet Production -blue
AABB - Improving Methods for Matching Single Donor Platelet Production -blueAABB - Improving Methods for Matching Single Donor Platelet Production -blue
AABB - Improving Methods for Matching Single Donor Platelet Production -blue
 
Rentabilidade acumulada fundos imobiliários fevereiro 2015
Rentabilidade acumulada fundos imobiliários fevereiro 2015Rentabilidade acumulada fundos imobiliários fevereiro 2015
Rentabilidade acumulada fundos imobiliários fevereiro 2015
 
Rentabilidade acumulada fundos imobiliários novembro 2015
Rentabilidade acumulada fundos imobiliários novembro 2015Rentabilidade acumulada fundos imobiliários novembro 2015
Rentabilidade acumulada fundos imobiliários novembro 2015
 
Gap Analysis & Improvement Tactics for Your EH&S Program
Gap Analysis & Improvement Tactics for Your EH&S ProgramGap Analysis & Improvement Tactics for Your EH&S Program
Gap Analysis & Improvement Tactics for Your EH&S Program
 
Key Performance Indicators
Key Performance IndicatorsKey Performance Indicators
Key Performance Indicators
 
Rentabilidade acumulada fundos imobiliários agosto 2015
Rentabilidade acumulada fundos imobiliários agosto 2015Rentabilidade acumulada fundos imobiliários agosto 2015
Rentabilidade acumulada fundos imobiliários agosto 2015
 
GBAF15 - Elective, Diagnostic and Outpatient Access to Services
GBAF15 - Elective, Diagnostic and Outpatient Access to Services GBAF15 - Elective, Diagnostic and Outpatient Access to Services
GBAF15 - Elective, Diagnostic and Outpatient Access to Services
 
Data Driven Decision Making - Chapter 1. Team Performance
Data Driven Decision Making - Chapter 1. Team PerformanceData Driven Decision Making - Chapter 1. Team Performance
Data Driven Decision Making - Chapter 1. Team Performance
 
Maximize Compliance & Cost Savings with Environmental Preventative Maintenance
Maximize Compliance & Cost Savings with Environmental Preventative MaintenanceMaximize Compliance & Cost Savings with Environmental Preventative Maintenance
Maximize Compliance & Cost Savings with Environmental Preventative Maintenance
 

Similar to Controls Maturity Indicators RUTGERS 2014

Part 5 - Critical Control Measurement: Evaluating effectiveness to add value
Part 5 - Critical Control Measurement: Evaluating effectiveness to add valuePart 5 - Critical Control Measurement: Evaluating effectiveness to add value
Part 5 - Critical Control Measurement: Evaluating effectiveness to add valuemyosh team
 
Overview of U.S. Leadership's Consulting Services
Overview of U.S. Leadership's Consulting ServicesOverview of U.S. Leadership's Consulting Services
Overview of U.S. Leadership's Consulting Servicesrickj41
 
# 3 PPT - Expose Your Hidden Problems Using Visual Management
# 3 PPT - Expose Your Hidden Problems Using Visual Management# 3 PPT - Expose Your Hidden Problems Using Visual Management
# 3 PPT - Expose Your Hidden Problems Using Visual ManagementRhonda Kovera
 
Internal auditor training by Er. Manish Dwivedi
Internal auditor training by Er. Manish DwivediInternal auditor training by Er. Manish Dwivedi
Internal auditor training by Er. Manish DwivediEr. Manish Dwivedi
 
Melbourne streamlining earned value with hd published
Melbourne streamlining earned value with hd publishedMelbourne streamlining earned value with hd published
Melbourne streamlining earned value with hd publishedInSync Conference
 
Continuous Auditing
Continuous AuditingContinuous Auditing
Continuous Auditingmcoello
 
Managed Services Using SLAs and KPIs
Managed Services Using SLAs and KPIsManaged Services Using SLAs and KPIs
Managed Services Using SLAs and KPIsProlifics
 
Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)Roger H. Mandel
 
Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)Roger H. Mandel
 
Project Overview - Pfister Time & Motion Study 2017
Project Overview - Pfister Time & Motion Study 2017Project Overview - Pfister Time & Motion Study 2017
Project Overview - Pfister Time & Motion Study 2017Victor Javier Marranzini
 
Arens12e 09
Arens12e 09Arens12e 09
Arens12e 09John Sy
 
Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01
Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01
Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01Nandini Narayanan
 
Cas rpm 2015 claim liability estimation
Cas rpm 2015   claim liability estimationCas rpm 2015   claim liability estimation
Cas rpm 2015 claim liability estimationAlejandro Ortega
 
Topic 7 audit planning (1)
Topic 7 audit planning (1)Topic 7 audit planning (1)
Topic 7 audit planning (1)sakura rena
 
Continous auditing vs traditional slide share
Continous auditing vs traditional   slide shareContinous auditing vs traditional   slide share
Continous auditing vs traditional slide shareBob Sahm
 
Audit and Risk Management Software
Audit and Risk Management SoftwareAudit and Risk Management Software
Audit and Risk Management SoftwareQualityze Inc
 

Similar to Controls Maturity Indicators RUTGERS 2014 (20)

Part 5 - Critical Control Measurement: Evaluating effectiveness to add value
Part 5 - Critical Control Measurement: Evaluating effectiveness to add valuePart 5 - Critical Control Measurement: Evaluating effectiveness to add value
Part 5 - Critical Control Measurement: Evaluating effectiveness to add value
 
Overview of U.S. Leadership's Consulting Services
Overview of U.S. Leadership's Consulting ServicesOverview of U.S. Leadership's Consulting Services
Overview of U.S. Leadership's Consulting Services
 
# 3 PPT - Expose Your Hidden Problems Using Visual Management
# 3 PPT - Expose Your Hidden Problems Using Visual Management# 3 PPT - Expose Your Hidden Problems Using Visual Management
# 3 PPT - Expose Your Hidden Problems Using Visual Management
 
Lean midland presentation-161013
Lean midland presentation-161013Lean midland presentation-161013
Lean midland presentation-161013
 
Internal auditor training by Er. Manish Dwivedi
Internal auditor training by Er. Manish DwivediInternal auditor training by Er. Manish Dwivedi
Internal auditor training by Er. Manish Dwivedi
 
Presentation1
Presentation1Presentation1
Presentation1
 
Melbourne streamlining earned value with hd published
Melbourne streamlining earned value with hd publishedMelbourne streamlining earned value with hd published
Melbourne streamlining earned value with hd published
 
Continuous Auditing
Continuous AuditingContinuous Auditing
Continuous Auditing
 
Managed Services Using SLAs and KPIs
Managed Services Using SLAs and KPIsManaged Services Using SLAs and KPIs
Managed Services Using SLAs and KPIs
 
Auditing.pdf
Auditing.pdfAuditing.pdf
Auditing.pdf
 
Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)
 
Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)Evm power point 25 august 2015 prams co (2)
Evm power point 25 august 2015 prams co (2)
 
Performance Goal Seting
Performance Goal SetingPerformance Goal Seting
Performance Goal Seting
 
Project Overview - Pfister Time & Motion Study 2017
Project Overview - Pfister Time & Motion Study 2017Project Overview - Pfister Time & Motion Study 2017
Project Overview - Pfister Time & Motion Study 2017
 
Arens12e 09
Arens12e 09Arens12e 09
Arens12e 09
 
Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01
Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01
Qaanalytics customerstory-forpublishing-150412120638-conversion-gate01
 
Cas rpm 2015 claim liability estimation
Cas rpm 2015   claim liability estimationCas rpm 2015   claim liability estimation
Cas rpm 2015 claim liability estimation
 
Topic 7 audit planning (1)
Topic 7 audit planning (1)Topic 7 audit planning (1)
Topic 7 audit planning (1)
 
Continous auditing vs traditional slide share
Continous auditing vs traditional   slide shareContinous auditing vs traditional   slide share
Continous auditing vs traditional slide share
 
Audit and Risk Management Software
Audit and Risk Management SoftwareAudit and Risk Management Software
Audit and Risk Management Software
 

Controls Maturity Indicators RUTGERS 2014

  • 1. Predicting Controls Maturity Based on Audit Results Sohit Raina, Internal Auditor Vikas Dutta, Principal Internal Auditor Nov 7, 2014
  • 2. 2 © 2014 CA. ALL RIGHTS RESERVED. What are Controls Maturity Indicators? Enable quick health check/current state of controls maturity; Identify desired state of control maturity; Develop a plan for improvement. Indicators that allow management to measure a trend in control maturity over a period of time Why Controls Maturity Indicators?
  • 3. 3 © 2014 CA. ALL RIGHTS RESERVED. Analysing Controls Maturity Based on Audit Results Factors such as number of findings, severity, and audit cycle time can be indicators of controls maturity. Number of Findings Severity of Findings Controls Maturity Audit cycle time
  • 4. 4 © 2014 CA. ALL RIGHTS RESERVED. Number of Findings v/s Number of Days y = 10.529x + 81.502 0 50 100 150 200 250 0 1 2 3 4 5 6 7 8 9 Avg # of Days in Year 1 Number of Findings v/s Average Number of Days: Evaluation of controls maturity, by tracking number of findings per audit and associated audit cycle time.
  • 5. 5 © 2014 CA. ALL RIGHTS RESERVED. Number of Findings v/s Number of Days y = 10.529x + 81.502 y = 10.329x + 54.473 0 50 100 150 200 250 0 1 2 3 4 5 6 7 8 9 Avg # of Days in Year 1 Avg # of Days in Year 2 Y = 75
  • 6. 6 © 2014 CA. ALL RIGHTS RESERVED. Weighted Score of Findings v/s Average Number of Days: In order to incorporate the impact of findings (high, medium ,low) and overall report rating, a weighted score was assigned to the findings and plotted against number of days. Weighted score assigned: High = 5 Medium = 3 Low = 1 For Example: Analysis of Audit Results using weighted score Fiscal Year Project Name High Medium Low Total # of Findings Weighted Score (5H + 3M + 1L) Total No.of Days Year 1 Audit A 1 2 1 4 12 92 Year 1 Audit B 0 0 3 3 3 60 Year 1 Audit C 1 2 0 3 11 74 Year 1 Audit D 1 2 1 4 12 121
  • 7. 7 © 2014 CA. ALL RIGHTS RESERVED. Analysis of Results Using Weighted Score Weighted Score Values Weighted Score Group Number of Audits in Year 1 Avg # of Days in Year 1 Number of Audits in Year 2 Avg # of Days in Year 2 0 to 5 1 3 109.3 6 74 6 to 9 2 5 105.9 8 98 10 to 12 3 9 116.0 9 114 13 to 15 4 9 119.6 8 68.5 16 to 18 5 7 122.3 5 107.5 19 and above 6 7 151 4 123.7
  • 8. 8 © 2014 CA. ALL RIGHTS RESERVED. Severity & Number of Findings y = 7.4699x + 94.513 y = 6.6143x + 74.467 0 20 40 60 80 100 120 140 160 0 1 2 3 4 5 6 7 Weighted Score of Findings v/s Avg No. of Days Avg # of Days in Year 1 Avg # of Days in Year 2 Y = 75
  • 9. 9 © 2014 CA. ALL RIGHTS RESERVED. Lessons Learned Decrease in cycle time and rise in controls maturity as a result of: • Maturing business processes • Readily available data (common ERP system across organization) • Clearly defined and documented processes • Implementation of automated/preventive controls • Familiarity and established relationships with control owners Other factors to be considered for future state: • Experienced auditors • Faster escalation process • Shorter-less complex audits • Improved report writing • Timely response from management
  • 10. 10 © 2014 CA. ALL RIGHTS RESERVED. Thank you! Sohit Raina  sohit.raina@ca.com Vikas Dutta  vikas.dutta@ca.com