101 Townsend Street, Suite 282 San Francisco, CA 94107 www.excelmeetings.com
Results Based Meetings   Three Steps of Evaluation That Will  Clearly Demonstrate the Value of  Your Conference, Sales Mee...
Definition of Results Based Meetings <ul><li>Meetings are initiated, developed, and delivered  with the end in mind. </li>...
Paradigm Shift in Meetings and Events Results and expectations communicated to participants  No effort to prepare meeting ...
Paradigm Shift in Meetings and Events Reporting on meetings  is output focused  Reporting on meetings  is input focused  M...
Evaluation Levels   Level   Measurement Focus 1. Reaction & Measures participant reaction to the Perceived  meeting and ca...
Chain of Impact From Meetings & Events <ul><li>Participant has a positive reaction to the meeting </li></ul><ul><li>Partic...
Levels of Assessment   <ul><li>Relevance </li></ul><ul><li>Importance </li></ul><ul><li>Usefulness </li></ul><ul><li>New I...
<ul><li>Information </li></ul><ul><li>Knowledge </li></ul><ul><li>Understanding </li></ul><ul><li>Skills </li></ul>Levels ...
<ul><li>Use of Skills </li></ul><ul><li>Use of Knowledge </li></ul><ul><li>Completion of Actions </li></ul><ul><li>Success...
The ROI Methodology Develop  Evaluation Plans and Baseline Data Evaluation Planning Data Collection Via Questionnaire Coll...
Plan Meetings with Evaluation in Mind <ul><li>Developing Clearly Defined and Measurable  Reaction Objectives  for the Meet...
Plan Meetings with Evaluation in Mind <ul><li>Developing Clearly Defined And Measurable  Learning Objectives  For The Meet...
Project Example:  Development of Measurable  Learning Objectives and  Post Event Questionnaire for an Annual Scientific Me...
Overview: Excel Meetings & Events  was under contract with a San Francisco Bay Area Pharmaceutical Company to assist in th...
Overview: General desired outcomes for the meeting were stated as follows:  Energized participants - Key scientists and en...
Stated Measurable Learning Objectives After the annual scientific meeting, research scientist  will be able to:  •  Explai...
Stated Measurable Learning Objectives After the annual scientific meeting, research scientist  will be able to:  •  Explai...
<ul><ul><li>Questionnaire Development  </li></ul></ul><ul><li>Based on the stated learning objectives, Excel Meetings work...
Questionnaire Development  Sample questions included:  2) Identify two or three things you learned about future research i...
Questionnaire Development  Sample questions included:  5) Name three new colleagues you met at this year’s Research Summit...
“ Excel Meetings & Events worked with our internal meeting planning resources and provided guidance, tools, and ideas. The...
Alliance Partner Profile <ul><li>The ROI Institute, Inc. is the leading resource on research, training, and networking for...
<ul><li>“ The (Phillips) ROI process has become the cornerstone of organizational assessment, measurement, and evaluation ...
Upcoming SlideShare
Loading in …5
×

Approach To Results Based Conferences And Meetings

472 views
430 views

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
472
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Approach To Results Based Conferences And Meetings

  1. 1. 101 Townsend Street, Suite 282 San Francisco, CA 94107 www.excelmeetings.com
  2. 2. Results Based Meetings Three Steps of Evaluation That Will Clearly Demonstrate the Value of Your Conference, Sales Meeting or Annual Scientific Meeting Presentation by Jon Wollenhaupt, VP, Excel Meetings & Events www.excelmeetings.com Processes outlined in this presentation are based on the ROI Methodology developed by Jack Philips, PhD, Chairman, The ROI Institute
  3. 3. Definition of Results Based Meetings <ul><li>Meetings are initiated, developed, and delivered with the end in mind. </li></ul><ul><li>A measurement and evaluation system is in place for each meeting. </li></ul><ul><li>Perceived value, learning, application of learning evaluations are regularly developed. </li></ul><ul><li>Participants understand their responsibility to obtain results with meetings. </li></ul><ul><li>Support groups (management, sponsors, colleagues, etc.) help to achieve results from meeting. </li></ul>
  4. 4. Paradigm Shift in Meetings and Events Results and expectations communicated to participants No effort to prepare meeting participants to achieve results Specific objectives for behavior and business impact No specific measurable objectives Assessment of performance effectiveness No assessment of performance issues Program linked to specific business needs No clearly defined business need for the meeting Results Based Activity Based
  5. 5. Paradigm Shift in Meetings and Events Reporting on meetings is output focused Reporting on meetings is input focused Measurement of results and benefit-cost analysis (ROI) No measurement of results or benefit-cost analysis Partnerships established with key managers and clients No efforts to build partnerships with key managers Environment prepared to support meeting No effort to prepare the work environment to support meeting Results Based Activity Based
  6. 6. Evaluation Levels Level Measurement Focus 1. Reaction & Measures participant reaction to the Perceived meeting and captures perceived value. Value 2. Learning Measures changes in knowledge, information, skills, and attitudes gained in the meeting. 3. Application & Measures changes in on-the-job Implementation behavior and progress with planned actions.
  7. 7. Chain of Impact From Meetings & Events <ul><li>Participant has a positive reaction to the meeting </li></ul><ul><li>Participant acquires knowledge, develops skills or changes attitudes/perceptions </li></ul><ul><li>Participant uses new knowledge, skills and attitudes on the job </li></ul><ul><li>Use of new knowledge, skills and attitudes drives business performance </li></ul><ul><li>Monetary value of business performance exceeds cost of meeting </li></ul>
  8. 8. Levels of Assessment <ul><li>Relevance </li></ul><ul><li>Importance </li></ul><ul><li>Usefulness </li></ul><ul><li>New Information </li></ul><ul><li>Motivational </li></ul>Level 1 Reaction and Perceived Value <ul><li>Appropriate </li></ul><ul><li>Rewarding </li></ul><ul><li>Challenging </li></ul>
  9. 9. <ul><li>Information </li></ul><ul><li>Knowledge </li></ul><ul><li>Understanding </li></ul><ul><li>Skills </li></ul>Levels of Assessment Level 2 Learning <ul><li>Contacts </li></ul><ul><li>Capability </li></ul><ul><li>Expertise </li></ul><ul><li>Capacity </li></ul>
  10. 10. <ul><li>Use of Skills </li></ul><ul><li>Use of Knowledge </li></ul><ul><li>Completion of Actions </li></ul><ul><li>Success with Application </li></ul>Levels of Assessment Level 3 Application and Implementation <ul><li>Enablers </li></ul><ul><li>Tasks Completed </li></ul><ul><li>Steps </li></ul><ul><li>Procedures Followed </li></ul><ul><li>Barriers </li></ul>
  11. 11. The ROI Methodology Develop Evaluation Plans and Baseline Data Evaluation Planning Data Collection Via Questionnaire Collect Data During Meeting Level 1: REACTION AND PERCIEVED VALUE LEVEL 2: LEARNING Collect Data After Meeting LEVEL 3: APPLICATION AND IMPLEMENTATION OPTIONAL LEVEL 4: IMPACT AND CONSEQUENCES Develop Objectives of Meeting
  12. 12. Plan Meetings with Evaluation in Mind <ul><li>Developing Clearly Defined and Measurable Reaction Objectives for the Meeting </li></ul><ul><li>After attending the Executive Strategy meeting, participants will perceive the meetings to be: </li></ul><ul><li>Conducted by relevant and effective speakers </li></ul><ul><li>Valuable in terms of inspiration, and in enable participants to be more effective leaders </li></ul><ul><li>Full of new information </li></ul><ul><li>Valuable in terms of helping attendees attain short and long term goals </li></ul><ul><li>An excellent use of their time </li></ul>
  13. 13. Plan Meetings with Evaluation in Mind <ul><li>Developing Clearly Defined And Measurable Learning Objectives For The Meeting </li></ul><ul><li>Measuring Changes in Information, Knowledge, Skills, Perceptions, and Contacts </li></ul><ul><li>At the end of the meeting, participants will be able to: </li></ul><ul><li>Identify three new e-commerce strategies relevant to their department </li></ul><ul><li>Identify new ways to foster ideas sharing and collaboration with other departments </li></ul><ul><li>Explain two new ways to motivate creative thinking within their department </li></ul><ul><li>Explain 5 steps to innovation that were presented during the meeting </li></ul>
  14. 14. Project Example: Development of Measurable Learning Objectives and Post Event Questionnaire for an Annual Scientific Meeting
  15. 15. Overview: Excel Meetings & Events was under contract with a San Francisco Bay Area Pharmaceutical Company to assist in the development of measurable learning objectives for an annual scientific meeting and in the design of a post meeting questionnaire. This meeting brought together research scientist from three separate company facilities located in Silicon Valley, Alabama and India.
  16. 16. Overview: General desired outcomes for the meeting were stated as follows: Energized participants - Key scientists and engineers from all research sites will have an opportunity to interact, discuss science, think about the future, get to know each other and establish alliances that will enable success.
  17. 17. Stated Measurable Learning Objectives After the annual scientific meeting, research scientist will be able to: • Explain the process for implementing new research • Name three new colleagues you met with whom you can collaborate on your research • List three reasons you agree with the research funding for 2008 • List the three most significant things you learned in the poster session • Identify at least one science or technology the company should acquire or develop
  18. 18. Stated Measurable Learning Objectives After the annual scientific meeting, research scientist will be able to: • Explain the process for implementing new research • Name three new colleagues you met with whom you can collaborate on your research • List three reasons you agree with the research funding for 2008 • List the three most significant things you learned in the poster session • Identify at least one science or technology the company should acquire or develop
  19. 19. <ul><ul><li>Questionnaire Development </li></ul></ul><ul><li>Based on the stated learning objectives, Excel Meetings worked with client staff to develop a post meeting questionnaire that assessed participants learning and intentions to apply that learning upon return to work. </li></ul><ul><li>Sample questions included: </li></ul><ul><li>1) I feel confident that I can influence research within my role in the R&D organization. Please circle a number that best reflects your response. </li></ul><ul><li>5 = Strongly Agree, 4 = Agree, 3 = Neutral, 2 = Disagree, 1 = Strongly Disagree </li></ul>
  20. 20. Questionnaire Development Sample questions included: 2) Identify two or three things you learned about future research ideas in the poster session. (open-ended) 3) Identify three major accomplishments attained in 2008 that you learned about in the poster session. (open-ended) 4) List the three reasons why you agree with the research funding for this year as discussed. (open-ended)
  21. 21. Questionnaire Development Sample questions included: 5) Name three new colleagues you met at this year’s Research Summit , and list at least one way you will collaborate with each on your research in the coming year. (open-ended) 6) What I learned from the presentations I will be able to use in my work and with all colleagues when I return to work. Please circle a number that best reflects your response. 5 = Strongly Agree, 4 = Agree, 3 = Neutral, 2 = Disagree, 1 = Strongly Disagree
  22. 22. “ Excel Meetings & Events worked with our internal meeting planning resources and provided guidance, tools, and ideas. Their contributions enhanced the quality of our annual scientific meeting and set up the foundation for continuous improvement.” – CARLOS SCHULER SENIOR DIRECTOR OF SCIENCE & TECHNOLOGY
  23. 23. Alliance Partner Profile <ul><li>The ROI Institute, Inc. is the leading resource on research, training, and networking for practitioners of the Phillips ROI Methodology™. Founded in 2003, the ROI Institute represents over 25 years of experience in measurement and evaluation of training, human resources, technology and quality programs and initiatives. </li></ul>
  24. 24. <ul><li>“ The (Phillips) ROI process has become the cornerstone of organizational assessment, measurement, and evaluation strategies.” </li></ul><ul><li>- Debi Wallace, </li></ul><ul><li>Vice President, Advanced Analytics </li></ul><ul><li>Wachovia Corporation </li></ul>Alliance Partner Profile

×