Published on

Performance Auditing and Program Evaluation

Published in: Business, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide


  1. 1. Performance Auditing and Program Evaluation Washington, DC April 14-17, 2009 | Performance Auditing and Program Evaluation Analyzing and Improving Program Performance in Government Featuring Two Interactive Courses: Course 1: Performance Auditing Course 2: Program Evaluation • Create a comprehensive model for auditing • Receive the latest updates on the state of program performance information evaluation in the Obama Administration • Improve data quality systems with best practice • Understand the key steps to build an evaluation system performance auditing standards within your organization www.PerformanceWeb.org 1 www.PerformanceWeb.org 1
  2. 2. Performance Auditing and Program Evaluation Who Day 1: Tuesday, April 14, 2009 Should Attend: Course One Performance Auditing • Auditors 8:30 • Inspectors General Conference Registration and Continental Breakfast • Program Managers • Project Managers 9:00 Design Performance Measures That Management Can Actually Use • Program Analysts • Learn how to develop well written goals, objectives and measures • Strategic Planners • Understand the advantages and disadvantages of various data sources • Division Managers • Evaluate data collection costs • Program Planners • Executives Create Reliable, Timely and Useful Performance Measurement Systems • IT Managers in Government • Learn techniques for measuring hard to measure outcomes Top 5 • Develop a performance measurement system that accounts for goals, measures and key outputs • Communicate the essential steps necessary to ensure the quality of your data Reasons to Attend: Validity, Verification and Data Quality Standards • Understand how data reflects programmatic outcomes 1. Examine the different types of • Explore benefits of the development of data methodologies and auditing techniques to program evaluation and how to improve performance systems use them • Improve data quality systems consistent with best practice performance auditing standards 2. Understand the relationships 12:00 between performance auditing, Lunch Break performance measurement, program evaluation and organizational learning “The instructor was extremely knowledgeable 3. Gain a solid understanding of a 3-phased learning approach to and could relate to practical examples of audits program evaluation – he’s actually performed the tasks.” 4. Determine program relevancy to the agency’s mission Frank Filipkowski, Management and Program Analyst, Department of Homeland Security 5. Use evaluation methods to discover program strengths and weaknesses 2 www.PerformanceWeb.org 2
  3. 3. Performance Auditing and Program Evaluation Day 1: Continued 1:00 Establish Common Measures, Definitions and Reporting Standards • Standardize data across program managers “It’s my responsibility to • Audit and detect inconsistencies in performance information implement and develop • Adhere to reliability and relevancy standards of information the program evaluation Examine the Quality of Data Sources and Evaluate Costs and Benefits of Individual Measurements in my organization – • Define the measures used in management decisions this helped me greatly.” • Assess data collection and reporting and evaluation costs • Examine the quality of data sources Pratima Subbarao, Lead, HC Specialist, State Department Create a Comprehensive Maturity Model for Auditing Performance Information • Set a quality threshold for performance information • Streamline the number of performance measures • Use measures to drive a change in government 4:00 Day One Adjourns Create a Comprehensive Maturity Model for Auditing and Evaluating Performance Information 3 www.PerformanceWeb.org 3
  4. 4. Performance Auditing and Program Evaluation Day 2: Wednesday, April 15, 2009 Course One Performance Auditing Forge Manager-Auditor and Stakeholder 8:30 Continental Breakfast Relationships to Improve Performance Measurement Quality 9:00 • Establish beneficial auditor-manager relationships Assess the Strengths, Weaknesses and Changes • Learn to express the value of auditing to program managers Needed to Implement an Effective Performance • Define strategies for improving the quality of program partnerships Management Program • Identify best practices for institutionalizing your program initiatives Devise Performance Measures Consistent with Data • Learn to communicate a performance message to key stakeholders Quality and Audit Standards • Review the current performance reporting mandates and • Align performance goals and measures with agency data systems best practices • Address validity in the strategic design of your system • Incorporate data standards into the strategic architecture of your Develop Relevant Program Measures that Align with performance measurement system Agency Objectives • Learn the various criteria that can be used to determine 4:00 measure relevancy Adjourn • Identify measures that provide a complete picture of program activities • Explore updates on the latest OMB guidelines for data quality standards 12:00 Lunch Break 1:00 Performance Auditing as a Tool to Improve Government Accountability • Learn updates on performance auditing guidelines and standards • Explore various standards used in conducting performance audits • Learn how to develop audit findings 4 www.PerformanceWeb.org 4
  5. 5. Performance Auditing and Program Evaluation Day 3: Thursday, April 16, 2009 Course Two Program Evaluation 8:30 12:00 Conference Registration and Continental Breakfast Lunch Break 9:00 1:00 Set the Stage for the Program Evaluation Framework Phase One of Learning Approach to Evaluation: Focus the Inquiry (continued) • Examine the Obama Administration focus and mandates for data collection, reporting and use of findings • Clarify the purpose of the evaluation • Understand the relationship between evaluation and performance • Develop the evaluation’s key questions auditing, performance measurement, program evaluation and • Think explicitly about the use of findings organizational learning • Establish a common framework on basic evaluation terms Phase Two of Learning Approach to Evaluation: Carry out the Inquiry Phase One of Learning Approach to Evaluation: • Develop and implement the evaluation plan Focus the Inquiry • Review the impetus for evaluation 4:00 • Understand the organization’s context Day Three Adjourns • Develop the logic model Day 4: April 17, 2009 Course Two Program Evaluation 8:30 12:00 Continental Breakfast Lunch Break 9:00 1:00 Phase Three of Learning Approach to Evaluation: Build an Evaluation System Within Your Apply Learning Organization (Continued) • Interpret the data and develop communications and reports • Use theory of change and logic models to identify inquiry questions for informing organizational improvement and success • Support the action plan based on evaluation findings • Identify additional measures needed and complete plan for data • Monitor and provide feedback on actions taken collection, analysis, reporting and use • Implement and evaluate the evaluation system Build and Evaluation System Within Your Organization • Gather and review information about organization’s mission, 4:00 purpose, strategic plan, structure and staffing Conference Adjourns • Diagnose status of organization’s infrastructure critical to organizational learning and design of evaluation system • Reach shared understanding on the organization’s overall theory of change 5 www.PerformanceWeb.org 5
  6. 6. Performance Auditing and Program Evaluation Trainers’ Biographies “The instructor was a well-informed, polished Stuart Grifel presenter. She made Stuart S. Grifel is Managing Partner for Intellect Government Systems, L.L.C. Intellect the course active and Government Systems is focused on the development of software that enables governments to be more effective and to better manage scarce resources. Prior to made me think about that he was an Audit Supervisor for Broward County, Florida and Audit Supervisor the subject.” and Corporate Internal Auditor for the City of Austin, Texas, where one of his key responsibilities was certifying the reliability of departments’ performance measures. Matthew Cross, Associate Director for Mr. Grifel has over 25 years experience in government performance measurement, Education, Office of Government Ethics operations reviews, performance auditing, and productivity improvement. Mr. Grifel co-authored the book Auditor Roles in Government Performance Measurement: A Guide to Exemplary Practices at the Local, State, and Provincial Levels, The Institute of Internal Auditors (2004). He has co-authored the articles “Evolving Roles for Auditors in Government Performance Measurement,” in The Journal of Public Financial Management (2002); and “21st Century Community Focus: Better Results by Linking Citizens, Government and Performance Measurement,” in Public Management (1999). Rosalie Torres, Ph.D. Rosalie Torres is a recent past board member of the American Evaluation Association, serves on the editorial boards of major evaluation journals and served as the staff director for the 1994 revision of the Joint Committee’s Program Evaluation Standards. She has taught graduate level research and evaluation courses at several universities, and routinely conducts workshops on various topics related to evaluation practice. She has authored/co-authored numerous books and articles articulating practice- based theories of evaluation use; the relationship between evaluation and individual, team, and organizational learning; and effective strategies for communicating and reporting evaluation findings. Among them are: Evaluation Strategies for Communicating and Reporting: Enhancing Learning in Organizations, 2nd edition (Sage, 2005), and Evaluative Inquiry for Learning in Organizations (Sage, 1999). 6 www.PerformanceWeb.org 6
  7. 7. Performance Auditing and Program Evaluation In-house Training Become a Certified Government One of the more popular vehicles for accessing the Institute’s educational offerings is the delivery of on-site trainings and management facilitations. Bringing a training or facilitation Performance Manager in-house gives you the opportunity to customize a program that addresses your exact challenges and provides a more personal learning experience, while virtually eliminating travel expenses. Whether you require training for a small group or for an organizational- wide initiative, the advanced learning methods employed by The Performance Institute will create an intimate training atmosphere that maximizes knowledge transfer to enhance the To ensure professional success, you must talent within your organization. continually expand your skills and education. The bar has been raised in government Customization: agencies and organizations, and managers We realize that not all obstacles can be overcome by applying an “off-the-shelf solution”. want to hire, promote and work with the While many training providers will offer you some variation of their standard training, most skilled individuals possible. The Performance Institute’s subject matter experts will work with you and your team to To address this need, The Institute offers examine your programs and determine your exact areas of need. The identification of real a Certificate in Government Performance life examples will create a learning atmosphere that resonates with participants while at Management. Completing a certification the same time providing immediate return on your training investment. Using interactive program is easy. Just attend the three “core” exercises that employ actual projects or scenarios from your organization, instructors can courses and an additional three “elective” address specific challenges and align the curriculum of each session to your objectives. courses based on the topics that meet your While the majority of on-site trainings are focused on smaller groups, The Performance agency’s unique needs. The skills you acquire institute also has the ability to accommodate organizational-wide training initiatives. will then be used to complete a “capstone Utilizing multiple instructors, The Institute has the capacity to deliver courses to groups of project” on a particular issue that you and up to 300 participants per day. our department are facing, which will then Areas of expertise: be evaluated by an expert member of our staff. On-site delivery of single courses, certification programs and entire packages of Benefits of Certification: specialized courses are available in the following areas: Advance Your Career Strategic Planning Meet New Certification Requirements Performance Measurement Customize a Program to Fit Your Needs Project Management Lean Six Sigma For more information about certification, please contact Damian Wingate at Workforce Management 703-894-0481 or email him at Wingate@ Performance-Based Budgeting PerformanceWeb.org Performance-Based Contracting Performance Reporting Program Evaluation Administrative Management Leadership and Change For more information about in-house training options available to you, please contact Mark Bryan at 703-894-0481 x 225 or email him at Bryan@PerformanceWeb.org. 7 www.PerformanceWeb.org 7
  8. 8. Performance Auditing and Program Evaluation Logistics & Registration REGISTRATION Exhibiting & Sponsorship: 1. ONLINE at www.PerformanceWeb.org 2. VIA FAX to 703-894-0482 To learn more about exhibiting and sponsorships at 3. VIA PHONE to 703-894-0481 Performance Auditing and Program Evaluation please 4. VIA MAIL to 1515 N. Courthouse Road, Sixth Floor contact Jessica Ward at 703-894-0920 or email her at Arlington, VA 22201 Ward@PerformanceWeb.org Yes! Register me for Performance Auditing and Evaluation Please call me. I am interested in a special Group Discount for my team VENUE & HOTEL Delegate Information Performance Auditing and Program Evaluation will be held at The Performance Institute in Arlington, VA, just one block east of the Courthouse Metro stop on the Orange Line. A public parking garage is located just inside of the building. Name Title The Performance Institute 1515 North Courthouse Rd., Suite 600 Arlington, VA 22201 Office Organization 703-894-0481 A limited number of rooms have been reserved at the Arlington Rosslyn Courtyard by Marriott at the prevailing rate of $209 until March 17. This rate is based on the Address Government Per Diem and is subject to change. Please call the hotel directly and reference code “Program Auditing and Evaluation” when making reservations to get the discounted rate. The hotel is conveniently located three blocks from the Rosslyn Metro City State Zip station. Please ask the hotel about a complimentary shuttle that is also available for your convenience. Arlington Rosslyn Courtyard by Marriott Telephone Fax 1533 Clarendon Blvd. Arlington, VA 22209 Phone: 703-528-2222 Phone: 1-800-321-2211 Email www.CourtyardArlingtonRosslyn.com Payment Information Check (accepted by mail only) Training Form/Purchase Order TUITION & GROUP DISCOUNTS Credit Card The tuition rate for attending Performance Auditing and Program Evaluation as follows: Early Bird Rate Regular Rate Credit Card Number Expiration Date 699 Performance Auditing --- --- 699 Program Evaluation Name on Card 3 Digit Card verification # Attend Both and Save! --- 1099 For more information on group discounts for Performance Auditing and Program Evaluation, please contact Damian Wingate at 703-894-0481 or email him at Billing Zip Code Wingate@PerformanceWeb.org Priority Code: P742-WEB Please make checks payable to: The Performance Institute Cancellation Policy For live events: The Performance Institute will provide a registrations. Please note that the cancellation is not final to request a credit or refund, please submit it in writing no sibility for covering airfare, hotel or other costs incurred by full refund less $399 administration fee for cancellations until you receive a written confirmation. later than 10 business days after the end of the training to: registrants, including delegates, sponsors and guests. four weeks before the event. If cancellation occurs within The Performance Institute: Quality Assurance Payment must be secured prior to the conference. If payment two weeks prior to conference start date, no refund will be 1515 N. Courthouse Road, Suite 600 Discounts is not received by the conference start date, a method of issued. Registrants who fail to attend and do not cancel Arlington, VA 22201 • All ‘Early Bird’ Discounts must require payment at time of payment must be presented at the time of registration in order prior to the event will be charged the entire registration fee. registration and before the cut-off date in order to receive to guarantee your participation at the event. Note: As speakers are confirmed six months before the any discount. For webinars: The Performance Institute will provide a full event, some speaker changes or topic changes may occur • Any discounts offered whether by The Performance Insti- refund less $50 administrative fee for cancellations four in the program. The Performance Institute is not responsible Quality Assurance tute (including team discounts) must also require payment weeks before the event. If cancellation occurs within two for speaker changes, but will work to ensure a comparable at the time of registration. weeks prior to conference start date, no refund will be issued. The Performance Institute strives to provide you with the speaker is located to participate in the program. • All discount offers cannot be combined with any Registrants who fail to attend and do not cancel prior to the most productive and effective educational experience If for any reason The Performance Institute decides to cancel other offer. meeting will be charged the entire registration fee. possible. If after completing the course you feel there is this conference, The Performance Institute accepts no respon- • Discounts cannot be applied retroactively some way we can improve, please write your comments All the cancellation requests need to be made online Your on the evaluation form provided upon your arrival. Should 8 www.PerformanceWeb.org confirmation email contains links to modify or cancel you feel dissatisfied with your learning experience and wish 8