Selecting the right Computer Assisted Audit Tool may appear to be a huge undertaking; however, following a systematic approach eases the burden. The right approach minimizes the risk of selecting a product that might not fit into your organization, which could impair your function as it sits underutilized or on the shelf. While point and click visual style tools are settling into the market, many auditors rely on the legacy step-by-step software tools such as ACL, IDEA, Excel and “add-on” tools.
Many chief auditors pursue opportunities to increase the frequency and intensity of interactions with management and realize nothing gets attention faster than finding previously undetected anomalies in company data. Finding the right issues quickly and timely improves the value of audit and can assist audit in winning more work.
Attending this webinar you will learn:
· Identify analysis and financial constraints
· Scoping and defining audit strategic objectives
· Reviewing selection field based on Technical needs
· Building a short/long term on-boarding roadmap
· Realize the lost opportunity of not including all auditors (no auditor left behind)
Detecting Credit Card Fraud: A Machine Learning Approach
Are You a Smart CAAT or a Copy CAAT
1. 10/23/2017
1
Are You a Smart CAAT
or a Copy CAAT?
October 25, 2017
About Jim Kaplan, CIA, CFE
President and Founder of AuditNet®,
the global resource for auditors (now
available on iOS, Android and
Windows devices)
Auditor, Web Site Guru,
Internet for Auditors Pioneer
Recipient of the IIA’s 2007 Bradford
Cadmus Memorial Award.
Author of “The Auditor’s Guide to
Internet Resources” 2nd Edition
Page 2
2. 10/23/2017
2
About AuditNet® LLC
• AuditNet®, the global resource for auditors, serves the global audit
community as the primary resource for Web-based auditing content. As the first online
audit portal, AuditNet® has been at the forefront of websites dedicated to promoting the
use of audit technology.
• Available on the Web, iPad, iPhone, Windows and Android devices and
features:
• Over 2,700 Reusable Templates, Audit Programs, Questionnaires, and
Control Matrices
• Webinars focusing on fraud, data analytics, IT audit, and internal audit
with free CPE for subscribers and site license users.
• Audit guides, manuals, and books on audit basics and using audit
technology
• LinkedIn Networking Groups
• Monthly Newsletters with Expert Guest Columnists
• Surveys on timely topics for internal auditors
Introductions
Page 3
HOUSEKEEPING
This webinar and its material are the property of AuditNet® and its Webinar partners.
Unauthorized usage or recording of this webinar or any of its material is strictly forbidden.
• If you logged in with another individual’s confirmation email you will not receive CPE as the
confirmation login is linked to a specific individual
• This Webinar is not eligible for viewing in a group setting. You must be logged in with your
unique join link.
• We are recording the webinar and you will be provided access to that recording after the
webinar. Downloading or otherwise duplicating the webinar recording is expressly prohibited.
• If you have indicated you would like CPE you must answer the polling questions (all or minimum
required) to receive CPE per NASBA.
• If you meet the NASBA criteria for earning CPE you will receive a link via email to download your
certificate. The official email for CPE will be issued via NoReply@gensend.io and it is important
to white list this address. It is from this email that your CPE credit will be sent. There is a
processing fee to have your CPE credit regenerated post event.
• Submit questions via the chat box on your screen and we will answer them either during or at
the conclusion.
• Please complete the evaluation questionnaire to help us continuously improve our Webinars.
3. 10/23/2017
3
IMPORTANT INFORMATION
REGARDING CPE!
• SUBSCRIBERS/SITE LICENSE USERS - If you attend the Webinar and answer the polling questions (all or
minimum required) you will receive an email with the link to download your CPE certificate. The
official email for CPE will be issued via NoReply@gensend.io and it is important to white list this
address. It is from this email that your CPE credit will be sent. There is a processing fee to have your
CPE credit regenerated post event.
• NON-SUBSCRIBERS/NON-SITE LICENSE USERS - If you attend the Webinar and answer the polling
questions (all or minimum required) and requested CPE you must pay a fee to receive your CPE. No
exceptions!
• We cannot manually generate a CPE certificate as these are handled by our 3rd party provider. We
highly recommend that you work with your IT department to identify and correct any email delivery
issues prior to attending the Webinar. Issues would include blocks or spam filters in your email system
or a firewall that will redirect or not allow delivery of this email from Gensend.io
• Anyone may register, attend and view the Webinar without fees if they opted out of receiving CPE.
• We are not responsible for any connection, audio or other computer related issues. You must have
pop-ups enabled on you computer otherwise you will not be able to answer the polling questions
which occur approximately every 20 minutes. We suggest that if you have any pressing issues to see
to that you do so immediately after a polling question.
The views expressed by the presenters do not necessarily represent the views, positions, or
opinions of AuditNet® LLC. These materials, and the oral presentation accompanying them, are
for educational purposes only and do not constitute accounting or legal advice or create an
accountant-client relationship.
While AuditNet® makes every effort to ensure information is accurate and complete, AuditNet®
makes no representations, guarantees, or warranties as to the accuracy or completeness of the
information provided via this presentation. AuditNet® specifically disclaims all liability for any
claims or damages that may result from the information contained in this presentation,
including any websites maintained by third parties and linked to the AuditNet® website.
Any mention of commercial products is for information only; it does not imply
recommendation or endorsement by AuditNet® LLC
4. 10/23/2017
4
Are You a Smart CAAT or a Copy
CAAT?
Computer Assisted Auditing Tools
Donald E Sparks, CIA, CISA, ARM
Don@SmartCAATTs.com
407-756-0375
Selecting the right data analysis CAAT (Computer Assisted Audit Tool)
may appear to be a huge undertaking; however, following a systematic
approach eases the burden. The right approach minimizes the risk of
selecting a product that might not fit into your organization, which
could impair your function as it sits underutilized or on the shelf.
While point and click visual style tools are settling into the market,
many auditors rely on the legacy step-by-step software tools such as
ACL, IDEA, Excel and other “add-on” tools.
Many chief auditors pursue opportunities to increase the frequency
and intensity of interactions with management and realize nothing
gets attention faster than finding previously undetected anomalies in
company data. Finding the right issues quickly and timely improves
the value of audit and can assist audit in winning more work.
Marketing
5. 10/23/2017
5
Data Analytics Defined
Data Analytics (DA) is the science of examining
raw data. The purpose of examining raw data is
to determine if the data contains information.
The information may be an indicator of a good
trend or a bad trend.
If you are pulling data out of a corporate data
warehouse (store or lake) beware that the data
may have been changed by the data
administrator.
What Does a CAATT Look Like?
6. 10/23/2017
6
Successful data analytics integration
Tips
• Start with a high-priority, high-return project
• Focus on efficiency and effectiveness
• Communicate
• Be brief; be thorough; be gone!
• Exercise patience
• Use the software provider
POLLING QUESTION #1
7. 10/23/2017
7
Pit Falls
• Avoid Career Ending “Shelf-Ware”
• Select the tool that best meets your strategy
• Data Governance Policy Will Lead the Way
• Be Sure Data Management Is On Your Team
• Do You Need A “Champion”?
• CAAT’s are for only the IT audit staff
• Build and Follow Your Own Roadmap!
Barriers
Leaders do not like “Shelf-ware”
8. 10/23/2017
8
Systematic Selection &
Implementation – Work Plan
Do You Need
a Roadmap?
Common Analytic Strategic Goals
• Improve Audit Coverage, Efficiency and Effectiveness
• Intensify testing, targeted sampling and continuous
auditing
• Supply management with quantifiable issues
• Improve visibility of risk indicators
• Deliver on heightened expectations
• Improve Working Paper Documentation
• Improved Return on Investment (ROI)
• Improved early fraud indicators
* SOURCE: IIA Pulse and Protiviti
9. 10/23/2017
9
POLLING QUESTION #2
1. Needs Analysis – Data Analysis as
an Enabler
Many CAE’s need to increase the frequency and
intensity of interactions with management and
realize nothing gets management’s attention faster
than finding previously undetected anomalies in
company data. Finding the right issues quickly and
timely improves the value of audit and can lead to
audit consulting assignments. While there are
consultants that help auditing functions to evaluate
the availability, applicability and performance of
commercially available data analysis software many
audit leaders realize the importance of this decision
and directly oversee this analysis.
10. 10/23/2017
10
Step 1 Key Tasks
• Inventory staff skills and technology tools
• Improve your Data Analysis IQ
• Improve Your Knowledge of Information
Policies
Step 1 Key Tasks (cont)
• Involve Decision Makers – Understand the
approval process
• Integrate Business Knowledge into your
Strategic Planning Model
11. 10/23/2017
11
Needs Analysis
At the conclusion of this step, the chief needs to
articulate a priority level and an expected install
date. The new internal auditing standard
requires the CAE to include discussions on the
impact of resource limitations with senior
management and the board.
POLLING QUESTION #3
12. 10/23/2017
12
2. Financial Feasibility – What can
you afford
As the process of selecting data analysis software
progresses, you will need to keep track of what
everything is going to cost. Having a budget and a
time line readily available can maintain perspective
and can keep the project costs reasonable. The
budget should not dictate which software is
selected but it may impact the rate of distribution
i.e., moderate the pace of the roll-out across your
staff if finances are tight. Avoid the temptation to
“silo” the data analysis routines with just one
individual or the IT audit staff.
Step 2 Key Tasks
• Who’s Budget?
• Understand the Different licensing Provisions Available (Can save
money)
– Concurrent use license – One user, many machines installed. The
software can freely be installed on everyone’s machine.
– Per seat license (electric licensing) – One user, one seat. If the
software needs to be moved to another machine, it has to be
uninstalled from the old machine and installed on the new one.
– Leased Software – Not as common as it was in the mainframe days, but
some software is actually leased with the program “expiring” at the
anniversary. The software will not work until it is renewed.
– SAAS – soft.ware as a service cloud based support is coming
13. 10/23/2017
13
Budget Considerations
• Basically, the internal audit function is looking for
a turn key solution. It is wise to include in the
budget all of the components to get the function
started in the right direction quickly:
– Software Maintenance and Upgrades
– Consulting work for data access or custom analysis
– Conversion of scripts from prior tools uses
– Help Desk Support
– Training and Workbooks
– Ancillary Programs Ready to Run
POLLING QUESTION #4
14. 10/23/2017
14
3. Work with Providers – Start with
the right company
You will not be able to anticipate every obstacle
that your internal auditing function may encounter
and will need support. Many providers offer easy
getting started routines and programs, training at
varies locations, call in and email help-lines, and
contract consulting services. Therefore, some
consideration about the provider and the resources
available is important. You need to perform your
own due diligence as many providers exist with
varying degrees of capability:
Step 3 Key Tasks
• Market
• Years in Business
• Customers
• Global Presence
• Client Specialists
15. 10/23/2017
15
4. Technical Feasibility – Narrow the
field
This is where the rubber meets the road. Do not
be tempted to skip this phase and just copy
what another organization is doing or using.
Just because it works well in their organization is
not a good reason to believe that it work just as
well in other organizations. Besides, they may
not have conducted their own evaluation but
relied on someone else’s recommendation.
Step 4 Key Tasks
• Obtain evaluation copies of the final three
candidates
• Install the software
• Document any problems encountered
• Documentation of Tests Completed
• Determine the Functions You Need
16. 10/23/2017
16
POLLING QUESTION #5
5. Selection & Purchase– The best
solution
The contenders should be obvious by now so this step
should be the easy part. While it may have started with
the staff each using different tools, the selection process
has compiled enough knowledge about the choices to
select the one provider. You are ready to make the
decision.
During the selection phase, the software package that
best meets the needs of the internal audit function is
selected. Some organizations use a scoring system.
17. 10/23/2017
17
Step 5 Key Tasks
• Don’t Go It Alone, Use Client Specialists
• Consider a hybrid solution
• Demonstrate You Stand Behind the Selection
• Purchase and Delivery
The formula is very simple: Vendor
Support + Synch with Strategic Objectives +
Functions/Features + Price = the winning solution.
POLLING QUESTION #6
18. 10/23/2017
18
6. Implementation & Conversion –
Startup & Acceptance
The audit staff should confirm that what was purchased was delivered.
While this is usually a shrink wrap software, any other provisions of
the purchase should be confirmed as well such as books and training
classes. Repeating some of the earlier data analysis tests should also
be completed to provide the necessary precautions. Differences if any
should be reconciled and the appropriate sign-off for acceptance
should be internally provided.
The maintenance of the original CD’s will need to be established.
Some discussions with the IT staff may also be necessary to agree on
how future updates of the software will need to be tested and
accepted.
At this time, the plans previously established can start to roll.
Step 6 Key Tasks
• Follow the Roll-Out Plan – Conversion to
Production Use
• Follow the Training Plan
• Finalize the first audits where the solution
will be used
• Start a Library For Your Audit Staff
19. 10/23/2017
19
7. Monitor & Improve – Reach For the
Next Level
In meetings with audit leaders a common
discussion point is how are we doing with the
use of data analysis software. The common
response of almost 100% is we are on the right
path but we should be doing more. This is a
very realistic viewpoint. The fact of the matter
is nearly every audit function in the world could
make that statement and be valid. So what can
we do to remove that stigma?
Step 7 Key Tasks
• Strive for 100% Deployment
• Maintain Technical Proficiency
• Stay in contact with the Client Specialist
• Use the Help Desk Support
• Look for New Opportunities to Expand Usage
• Keep software license up to date
21. 10/23/2017
21
Questions?
• Any Questions?
Don’t be Shy!
Page 41
AuditNet® and cRisk Academy
• If you would like forever
access to this webinar
recording
• If you are watching the
recording, and would
like to obtain CPE credit
for this webinar
• Previous AuditNet®
webinars are also
available on-demand
for CPE credit
http://criskacademy.com
http://ondemand.criskacademy.com
Use coupon code: 50OFF for a
discount on this webinar for one week
22. 10/23/2017
22
Thank You!
Page 43
Jim Kaplan
AuditNet® LLC
1-800-385-1625
Email:info@auditnet.org
www.auditnet.org
Donald E Sparks
SmartCAATTs, LLC
don@smartcaatts.com
1-407-756-0375