SlideShare a Scribd company logo
1 of 64
Download to read offline
Preparation for  Outcome Monitoring
Presenters:  1. Jeff Wagers:  Tx DSHS Program/ Training Specialist 2. Ken Ripperger-Suhler, Ph D: University of Texas at Austin,  Researcher
Introductions ,[object Object],[object Object],[object Object],[object Object]
What is an Outcome? ,[object Object]
Brainstorm-Outcomes! ,[object Object],[object Object]
Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Objectives ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Evidence-Based Interventions (EBI) ,[object Object],[object Object],[object Object],[object Object]
Evidence-Based Interventions (EBI) ,[object Object],[object Object],[object Object]
Key Terms ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Behavioral Determinants; Factors Influencing Behavior (FIBs) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Program Evaluation ,[object Object],[object Object]
Program Evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What is Process?  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Process Questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What is an Outcome? ,[object Object]
Outcome Questions ,[object Object],[object Object],[object Object],[object Object],[object Object]
Outcomes measure: ,[object Object],[object Object],[object Object],[object Object],[object Object]
Logic Models
Problem Statement Risk Behaviors Influencing Factors Intervention/ Activities Outcomes Immediate  Intermediate ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Factors Influencing Behavior STD rates are  high among young Hispanic MSM Problem Statement Young Hispanic  MSM don’t use condoms Young Hispanic  MSM have multiple partners Risk Behaviors Young Hispanic MSM lack skills to properly use condoms Young Hispanic MSM don’t know how to negotiate  condom use with their partners Influencing Factors It’s the norm for young Hispanic MSM to have a lot of sex partners
Intervention Activities STD rates are  high among young Hispanic  MSM Problem Statement Young Hispanic  MSM don’t use condoms Risk Behaviors Young Hispanic  MSM lack skills to properly use condoms Young Hispanic MSM don’t  know how to negotiate condom use with their partners Safe-sex  negotiation scenarios & role plays Self-assertion skills training Intervention Activities Influencing  Factors Young Hispanic  MSM have multiple partners Condom skills demonstration and practice
Immediate and Intermediate Outcomes Young Hispanic MSM lack skills to properly use condoms Young Hispanic MSM don’t  know how to negotiate condom use with their partners Influencing Factors Safe-sex  negotiation scenarios & role plays Self-assertion skills training Intervention Activities Immediate Outcomes Young Hispanic  MSM know how to negotiate  condom use with their partners Young  Hispanic  MSM use  condoms Intermediate Outcomes Condom demo and practice Young Hispanic MSM know how to use condoms
Problem Statement Risk Behaviors Influencing Factors Intervention/ Activities Outcomes Immediate  Intermediate Impacts   Impacts Impacts:  Long-term results of one or more interventions over time, such as changes in HIV  infection, morbidity, and mortality -  Decreased HIV rates
Outcome Monitoring Data Collection And  Analysis
Steps to Outcome Monitoring ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Example of Process Objective ,[object Object],[object Object]
Example of Outcome Objective ,[object Object],[object Object]
Ways to Collect Outcomes
Collect Outcomes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Measuring Skills ,[object Object],[object Object]
Demonstrations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Role Plays   ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Types of Questions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Question Answer Options MC Multiple Choice OE Open Ended FI Frequency Indicators S Scale  FB Fill in the Blank Y/N Yes/No T/F True/False Answer Code Answer Option
Sample Questions ,[object Object],[object Object],[object Object],[object Object],[object Object]
Sample Questions ,[object Object],[object Object],[object Object],[object Object],[object Object]
Steps to Outcome Monitoring   ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Putting It All Together
Example-VOICES/VOCES ,[object Object],[object Object]
Logic Model Increased Condom  Use Increased Condom Use Knowledge Increased Condom Use Self-Efficacy Increased Condom Use Intention INTERMEDIATE OUTCOMES (BEHAVIOR) IMMEDIATE OUTCOMES ACTIVITIES INFLUENCING FACTORS Practice Condom Use;  Distribute  condoms View Videos; Condom Negotiation Role Plays  RISK BEHAVIORS Unprotected Sex Condom Use Knowledge Condom Use Self-Efficacy Condom Use Intention
[object Object],[object Object],[object Object],Objective (Knowledge of  Condom Use)
Survey Items (Knowledge of  Condom Use) 3 2 1 2. You should unroll a condom before putting it on a man’s penis. 3 2 1 1. Vaseline and lotion are good lubricants for condoms/rubbers. Don’t Know No Yes
Spreadsheet for storing data yes  yes  -  GAY  M  27  H  A03  yes  yes  -  BI  M  25  AA  A02    yes yes -  STR  M  30    AA A01 Pre ConKnow 2 Pre ConKnow 1 HIV Status Sexual Orient Gender Age at intake Race/  Ethnic Client ID
Frequencies P r e & Post 0 (0%) 20 (100%) 0 (0%) (POST) 0 (0%) 0 (0%) 20 (100%) (PRE) Don’t Know (%) No (%) Yes (%) Item  Vaseline and lotion are good lubricants for condoms/rubbers.
Vaseline and lotion are good lubricants for condoms/rubbers. 20 (0%) 0 20 0 Total 0 (0%) 0 0 0 Don’t Know 0 (0%) 0 0 0 No Responses 20 (100%) 0 20 0 Yes Pre Total Don’t Know No Yes Post Responses
Frequencies Pre & Post 0 (0%) 0 (0%) 20 (100%) (POST) 0 (0%) 0 (0%) 20 (100%) (PRE) Don’t Know (%) No (%) Yes (%) Item  You should unroll a condom before putting it on a man’s penis.
You should unroll a condom before putting it on a man’s penis. 20 (100%) 0 (0%) 0 (0%) 20 (100%) Total 0 (0%) 0 (0%) 0 (0%) 0 (0%) Don’t Know 0 (0%) 0 (0%) 0 (0%) 0 (0%) No Responses 20 (100%) 0 (0%) 0 (0%) 20 (100%) Yes Pre Total Don’t Know No Yes Post Responses
Table 1. Change in Knowledge Scores from Pre to Post 0 0 0 0 2. You should unroll a condom before putting it on a man’s penis. 100 0 100 100 1. Vaseline and lotion are good lubricants for condoms/rubbers. % change to correct answers % changed to incorrect % changed to correct % correct post Item
Outcome Monitoring:  VOICES/VOCES Report ,[object Object],[object Object],[object Object],[object Object]
Planning for Outcome   Monitoring
Planning for Outcome Monitoring   ,[object Object],[object Object],[object Object],[object Object],[object Object]
DSHS Parameters for Outcome Monitoring ,[object Object],[object Object],[object Object],[object Object],[object Object]
Some Differences in  Data Collection…. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Some Differences in  Data Collection…. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Some Differences in  Data Collection…. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Some Differences in  Data Collection…. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Outcome Monitoring Surveys ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Facilitated Group Activity 1 ,[object Object],[object Object],[object Object]
Guided Group Discussion ,[object Object],[object Object],[object Object],[object Object],[object Object]
Activity 2: Data Input and Analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Next Steps Per intervention, brainstorm challenges and solutions to Outcome Monitoring
[object Object],[object Object],[object Object],Thank You!
Contact information ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

Similar to Preparation For Outcome Monitoring 2010

I'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana BullI'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana BullYTH
 
Evaluating Social Marketing Campaigns
Evaluating Social Marketing CampaignsEvaluating Social Marketing Campaigns
Evaluating Social Marketing Campaignsguestc6f406
 
Evaluating Social Marketing Campaigns
Evaluating Social Marketing CampaignsEvaluating Social Marketing Campaigns
Evaluating Social Marketing CampaignsCDC NPIN
 
A Neat Sampling Strategy Based On Purposive Sampling Essay
A Neat Sampling Strategy Based On Purposive Sampling EssayA Neat Sampling Strategy Based On Purposive Sampling Essay
A Neat Sampling Strategy Based On Purposive Sampling EssayTammy Majors
 
Heartland CIT: Toward Comprehensive Evaluation
Heartland CIT: Toward Comprehensive EvaluationHeartland CIT: Toward Comprehensive Evaluation
Heartland CIT: Toward Comprehensive Evaluationcitinfo
 
HIV_Counseling_and_Testing.ppt
HIV_Counseling_and_Testing.pptHIV_Counseling_and_Testing.ppt
HIV_Counseling_and_Testing.pptDagneBodena1
 
Social Marketing Workshop - Part 2
Social Marketing Workshop - Part 2Social Marketing Workshop - Part 2
Social Marketing Workshop - Part 2Stephan Dahl
 
Presentation by Rachel Steinacher, on IPA and RCTs
Presentation by Rachel Steinacher, on IPA and RCTsPresentation by Rachel Steinacher, on IPA and RCTs
Presentation by Rachel Steinacher, on IPA and RCTsTwaweza
 
Case management
Case managementCase management
Case managementCADCP
 
Salsa Dancing In Social Science Summary
Salsa Dancing In Social Science SummarySalsa Dancing In Social Science Summary
Salsa Dancing In Social Science SummaryMichelle Johnson
 
Using nudge theory to achieve a competitive edge with your UX
Using nudge theory to achieve a competitive edge with your UXUsing nudge theory to achieve a competitive edge with your UX
Using nudge theory to achieve a competitive edge with your UXFresh Egg UK
 
Peer Ed Training
Peer Ed TrainingPeer Ed Training
Peer Ed Trainingelavolet
 
Tips Pre Test Post Test
Tips   Pre Test Post TestTips   Pre Test Post Test
Tips Pre Test Post Teststandura
 
PROGRAM DEVELOPMENT- nudrat mufti
PROGRAM DEVELOPMENT- nudrat muftiPROGRAM DEVELOPMENT- nudrat mufti
PROGRAM DEVELOPMENT- nudrat muftiNUDRAT MUFTI
 
Full Program Design
Full Program DesignFull Program Design
Full Program Designforeman
 

Similar to Preparation For Outcome Monitoring 2010 (20)

I'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana BullI'm a Public Health Technology Researcher - Sheana Bull
I'm a Public Health Technology Researcher - Sheana Bull
 
Evaluating Social Marketing Campaigns
Evaluating Social Marketing CampaignsEvaluating Social Marketing Campaigns
Evaluating Social Marketing Campaigns
 
Evaluating Social Marketing Campaigns
Evaluating Social Marketing CampaignsEvaluating Social Marketing Campaigns
Evaluating Social Marketing Campaigns
 
A Neat Sampling Strategy Based On Purposive Sampling Essay
A Neat Sampling Strategy Based On Purposive Sampling EssayA Neat Sampling Strategy Based On Purposive Sampling Essay
A Neat Sampling Strategy Based On Purposive Sampling Essay
 
Heartland CIT: Toward Comprehensive Evaluation
Heartland CIT: Toward Comprehensive EvaluationHeartland CIT: Toward Comprehensive Evaluation
Heartland CIT: Toward Comprehensive Evaluation
 
HIV_Counseling_and_Testing.ppt
HIV_Counseling_and_Testing.pptHIV_Counseling_and_Testing.ppt
HIV_Counseling_and_Testing.ppt
 
Social Marketing Workshop - Part 2
Social Marketing Workshop - Part 2Social Marketing Workshop - Part 2
Social Marketing Workshop - Part 2
 
Presentation by Rachel Steinacher, on IPA and RCTs
Presentation by Rachel Steinacher, on IPA and RCTsPresentation by Rachel Steinacher, on IPA and RCTs
Presentation by Rachel Steinacher, on IPA and RCTs
 
Chapter7
Chapter7Chapter7
Chapter7
 
Response Bias
Response BiasResponse Bias
Response Bias
 
Case management
Case managementCase management
Case management
 
Quality In Action #7: Going Beyond Background Check
Quality In Action #7: Going Beyond Background CheckQuality In Action #7: Going Beyond Background Check
Quality In Action #7: Going Beyond Background Check
 
Expert Witness Research Paper
Expert Witness Research PaperExpert Witness Research Paper
Expert Witness Research Paper
 
Salsa Dancing In Social Science Summary
Salsa Dancing In Social Science SummarySalsa Dancing In Social Science Summary
Salsa Dancing In Social Science Summary
 
Using nudge theory to achieve a competitive edge with your UX
Using nudge theory to achieve a competitive edge with your UXUsing nudge theory to achieve a competitive edge with your UX
Using nudge theory to achieve a competitive edge with your UX
 
Peer Ed Training
Peer Ed TrainingPeer Ed Training
Peer Ed Training
 
Argument Evaluation Essay
Argument Evaluation EssayArgument Evaluation Essay
Argument Evaluation Essay
 
Tips Pre Test Post Test
Tips   Pre Test Post TestTips   Pre Test Post Test
Tips Pre Test Post Test
 
PROGRAM DEVELOPMENT- nudrat mufti
PROGRAM DEVELOPMENT- nudrat muftiPROGRAM DEVELOPMENT- nudrat mufti
PROGRAM DEVELOPMENT- nudrat mufti
 
Full Program Design
Full Program DesignFull Program Design
Full Program Design
 

More from Jeffrey Wagers

09 classroom management
09 classroom management09 classroom management
09 classroom managementJeffrey Wagers
 
03 basics of presentation skills
03 basics of presentation skills03 basics of presentation skills
03 basics of presentation skillsJeffrey Wagers
 
09 classroom management
09 classroom management09 classroom management
09 classroom managementJeffrey Wagers
 
03 basics of presentation skills
03 basics of presentation skills03 basics of presentation skills
03 basics of presentation skillsJeffrey Wagers
 
Ebi key terms rev5.18.2010
Ebi key terms rev5.18.2010Ebi key terms rev5.18.2010
Ebi key terms rev5.18.2010Jeffrey Wagers
 

More from Jeffrey Wagers (9)

09 classroom management
09 classroom management09 classroom management
09 classroom management
 
08 guided group disc
08 guided group disc08 guided group disc
08 guided group disc
 
03 basics of presentation skills
03 basics of presentation skills03 basics of presentation skills
03 basics of presentation skills
 
010 presentations
010 presentations010 presentations
010 presentations
 
010 presentations
010 presentations010 presentations
010 presentations
 
09 classroom management
09 classroom management09 classroom management
09 classroom management
 
08 guided group disc
08 guided group disc08 guided group disc
08 guided group disc
 
03 basics of presentation skills
03 basics of presentation skills03 basics of presentation skills
03 basics of presentation skills
 
Ebi key terms rev5.18.2010
Ebi key terms rev5.18.2010Ebi key terms rev5.18.2010
Ebi key terms rev5.18.2010
 

Preparation For Outcome Monitoring 2010

  • 1. Preparation for Outcome Monitoring
  • 2. Presenters: 1. Jeff Wagers: Tx DSHS Program/ Training Specialist 2. Ken Ripperger-Suhler, Ph D: University of Texas at Austin, Researcher
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 20.
  • 21. Factors Influencing Behavior STD rates are high among young Hispanic MSM Problem Statement Young Hispanic MSM don’t use condoms Young Hispanic MSM have multiple partners Risk Behaviors Young Hispanic MSM lack skills to properly use condoms Young Hispanic MSM don’t know how to negotiate condom use with their partners Influencing Factors It’s the norm for young Hispanic MSM to have a lot of sex partners
  • 22. Intervention Activities STD rates are high among young Hispanic MSM Problem Statement Young Hispanic MSM don’t use condoms Risk Behaviors Young Hispanic MSM lack skills to properly use condoms Young Hispanic MSM don’t know how to negotiate condom use with their partners Safe-sex negotiation scenarios & role plays Self-assertion skills training Intervention Activities Influencing Factors Young Hispanic MSM have multiple partners Condom skills demonstration and practice
  • 23. Immediate and Intermediate Outcomes Young Hispanic MSM lack skills to properly use condoms Young Hispanic MSM don’t know how to negotiate condom use with their partners Influencing Factors Safe-sex negotiation scenarios & role plays Self-assertion skills training Intervention Activities Immediate Outcomes Young Hispanic MSM know how to negotiate condom use with their partners Young Hispanic MSM use condoms Intermediate Outcomes Condom demo and practice Young Hispanic MSM know how to use condoms
  • 24. Problem Statement Risk Behaviors Influencing Factors Intervention/ Activities Outcomes Immediate Intermediate Impacts Impacts Impacts: Long-term results of one or more interventions over time, such as changes in HIV infection, morbidity, and mortality - Decreased HIV rates
  • 25. Outcome Monitoring Data Collection And Analysis
  • 26.
  • 27.
  • 28.
  • 29. Ways to Collect Outcomes
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35. Question Answer Options MC Multiple Choice OE Open Ended FI Frequency Indicators S Scale FB Fill in the Blank Y/N Yes/No T/F True/False Answer Code Answer Option
  • 36.
  • 37.
  • 38.
  • 39. Putting It All Together
  • 40.
  • 41. Logic Model Increased Condom Use Increased Condom Use Knowledge Increased Condom Use Self-Efficacy Increased Condom Use Intention INTERMEDIATE OUTCOMES (BEHAVIOR) IMMEDIATE OUTCOMES ACTIVITIES INFLUENCING FACTORS Practice Condom Use; Distribute condoms View Videos; Condom Negotiation Role Plays RISK BEHAVIORS Unprotected Sex Condom Use Knowledge Condom Use Self-Efficacy Condom Use Intention
  • 42.
  • 43. Survey Items (Knowledge of Condom Use) 3 2 1 2. You should unroll a condom before putting it on a man’s penis. 3 2 1 1. Vaseline and lotion are good lubricants for condoms/rubbers. Don’t Know No Yes
  • 44. Spreadsheet for storing data yes  yes  -  GAY  M  27  H  A03  yes  yes  -  BI  M  25  AA  A02    yes yes -  STR  M  30    AA A01 Pre ConKnow 2 Pre ConKnow 1 HIV Status Sexual Orient Gender Age at intake Race/ Ethnic Client ID
  • 45. Frequencies P r e & Post 0 (0%) 20 (100%) 0 (0%) (POST) 0 (0%) 0 (0%) 20 (100%) (PRE) Don’t Know (%) No (%) Yes (%) Item Vaseline and lotion are good lubricants for condoms/rubbers.
  • 46. Vaseline and lotion are good lubricants for condoms/rubbers. 20 (0%) 0 20 0 Total 0 (0%) 0 0 0 Don’t Know 0 (0%) 0 0 0 No Responses 20 (100%) 0 20 0 Yes Pre Total Don’t Know No Yes Post Responses
  • 47. Frequencies Pre & Post 0 (0%) 0 (0%) 20 (100%) (POST) 0 (0%) 0 (0%) 20 (100%) (PRE) Don’t Know (%) No (%) Yes (%) Item You should unroll a condom before putting it on a man’s penis.
  • 48. You should unroll a condom before putting it on a man’s penis. 20 (100%) 0 (0%) 0 (0%) 20 (100%) Total 0 (0%) 0 (0%) 0 (0%) 0 (0%) Don’t Know 0 (0%) 0 (0%) 0 (0%) 0 (0%) No Responses 20 (100%) 0 (0%) 0 (0%) 20 (100%) Yes Pre Total Don’t Know No Yes Post Responses
  • 49. Table 1. Change in Knowledge Scores from Pre to Post 0 0 0 0 2. You should unroll a condom before putting it on a man’s penis. 100 0 100 100 1. Vaseline and lotion are good lubricants for condoms/rubbers. % change to correct answers % changed to incorrect % changed to correct % correct post Item
  • 50.
  • 51. Planning for Outcome Monitoring
  • 52.
  • 53.
  • 54.
  • 55.
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
  • 61.
  • 62. Next Steps Per intervention, brainstorm challenges and solutions to Outcome Monitoring
  • 63.
  • 64.

Editor's Notes

  1. Evaluation is: A systematic collection of data and information Why Evaluate? Assists in determining program effectiveness Must be done consistently Informs you for future program improvement 4. Helps make you accountable 5. Social justice
  2. Participants will be completing a logic model for their intervention. They have already begun this process throughout the last two days. Refer participants to the newsprint and activity “Linking FIBs to Interventions” that they completed the previous day. Participants will pick one risk behavior to address in their expanded logic model. Participants are encouraged to complete the six-column logic model sheet before transposing it to newsprint. Instructions for doing this activity are on the following two pages. Participants get back to the groups they began the training with. Refer to the participant handout #9 “Logic Model” (with six columns) and pass out newsprint. 45 minutes-1 hour to complete the logic model.
  3. Answer any final questions! Address final Parking Lot issues if not yet addressed. Mention that any tools we have used in this training can be located on the HIV/STD program website. Let them know that you will be available for technical assistance if they have any further questions about outcome monitoring. Jeff Wagers is also available for technical assistance (his name and phone number are listed in the manual). DSHS field operations and regional staff are also available for TA. Remind participants to complete the evaluation forms and leave them on the table before they leave. Thank participants for their attention and participation! Manual pg. 60 Trainers write their names and phone numbers/ email addresses on newsprint for Evaluations and TA, or can hand out business cards.