Participant experiences of an online intervention and randomised control trialDr Daniel TodkillProfessor John Powell
ContentsAimContextMethodsResultsSummary
AimTo understand participants’ experiences of and motivations for participating in an intervention and trial delivered solely online
ContextExplored motivations to enrol and persist in PSYWELLRCT3070 participants, self-recruited through NHS Choices websiteIntervention advertised to potentially increase ‘mental wellbeing’
PSYWELLRCTWaiting list control and intervention groupsHigh attrition rates...1529 (49.8%) completed final follow up, attrition 73% in intervention arm, 26% in control armPrimary outcome measured using WEMWBSDespite high attrition, results are promising
Qualitative Study - RecruitmentAt end of trial, participants in intervention arm were invited to participate.Those  who consented, were stratified by age and genderPurposive, not representative sampleResearchers blinded to participants’ trial results and characteristics, other than age group and gender
ProcedureAll interviews followed semi-structured interview guideOne interviewer conducted all interviews over telephone
ProcedureAll interviews audio-recorded & transcribedFramework Approach used to identify themes and subthemesIdentified, charted, indexed and interpreted themes and subthemes
Results80 participants in intervention arm consented to contact for qualitative interview60 participants contacted14 males indicated consent, all contacted2 males & 18 females provided consent and were able to be interviewed.  Ages varied from 20 to 64
KEY THEME 1;Motivations of Users
KEY THEME 1 –  MOTIVATION16 users were experiencing (n = 14) or had experienced (n = 2) periods of low mood & wanted MOODGYM to help them through or understand own emotions	Low mood had wide range of aetiology...bereavement, physical or mental illness, stressful periods at work or unemployment
KEY THEME 1 –  MOTIVATION“I think for me it was at a very vulnerable time and it seemed like something that could help me to pull me out of where I was, which it did do”				Interviewee 12 (female 45-49)
KEY THEME 1 –  MOTIVATIONTheme throughout interviews was that the PSYWELLtrial advert appeared at...“the right place at the right time 			really”			Interviewee 10 (female 40-44)
KEY THEME 2;BENEFITS OF INTERNET AS A MODE OF INTERVENTION
BENEFITS DESCRIBED:
BENEFITS & PROBLEMS DISCUSSED:
PRIVACY“.... the fact that you could do the whole thing without anybody knowing, basically, anybody knowing about me and where I was and what I was doing was actually quite reassuring”	Interviewee 18 Female 55-59
24 HOUR AVAILABILITY“It was great because I could do it whenever I wanted to.  If I got up at two o'clock in the morning, I could sit and do it.  I didn't have to make an appointment with anybody so it was really good from that point of view.”Interviewee 8 Female 20-24
SELF EFFICACY“I think it is that feeling that it was something I was doing rather than something that was being done to me, if that makes sense.  Rather than going back to the doctor’s surgery and asking for help I felt that I was taking part in something, that I had an element of participation in it, that I was doing something to help myself get better“Interviewee 5 Female 55-59
RATHER THAN FACE TO FACE....I wouldn’t have gone to my Doctor and said to him about how I was feeling, because I didn't think it was the right level of problem.  I wasn’t sure how I was feeling I suppose, so I think it was a good way for me to have a bit of a tinker and see how I was feeling and see what help was I guess.”Interviewee 13 Female 55-59
KEY THEME 3;BEHAVIOUR CHANGE AS A RESULT OF THE INTERVENTION
KEY THEME 3 –  BEHAVIOUR CHANGE17/20 were positive & provided examples of how thinking or behaviour changed1/20 found short term benefits lasting few days, then no further2 interviewees had negative opinion of intervention
KEY THEME 3 –  BEHAVIOUR CHANGE15 described changed reflections on own thoughts & patterns of thinking10 described positive changes in way participant relates to others9 described other examples of changed external behaviours
CHANGED PATTERNS OF THINKING“I think it helps people to look at the way they think and what effect that has on the way they feel and the way they act...”Interviewee 1 Female 50-54
POSITIVE CHANGES IN RELATIONSHIPS WITH OTHERS“...more likely to try and sort of... step back from a situation, and think well am I thinking about this is the right way”				Interviewee 5 Female 55-59
EXTERNAL BEHAVIOUR CHANGE – CASE STUDYPre intervention –anxiety caused her to take “two hours in the morning to feel ready to go outside” and “if I didn’t do that routine, I thought my day was going to go badly.” Post intervention - “I can leave the house within half an hour now which is as soon as I have had my breakfast”Interviewee 16 Female 25-29
EXTERNAL BEHAVIOUR CHANGE – CASE STUDY“It gave me the confidence and made me realise that I wasn’t the only person suffering from anxiety. Everyone suffers from it sometimes, and it taught me a way of dealing with it, that it doesn’t matter. That it is perfectly normal and I can deal with it, it’s not going to try and eat me up during the day. So I can just get on with life rather than letting the anxiety control me” Interviewee 16 Female 25-29
KEY THEME 4;BRANDING OF THE TOOL & TRIAL
KEY THEME 4 –  BRANDING OF THE TOOL & TRIALParticipants upload intimate details of their emotional states...Asked about reasons the felt secure in providing informationMost common response (n=8) was branding
KEY THEME 4 –  BRANDING OF THE TOOL & TRIAL“I mean obviously with it being from a University, that’s always useful, rather than, shall I call it a private organisation, you know, it didn’t feel as if anybody was trying to make any money out of it.”
KEY THEME 5;LANGUAGE OF THE INTERVENTION
KEY THEME 5 –  LANGUAGE OF THE INTERVENTION8 described how the intervention was aimed at younger people, even the youngest	participant described thisMultiple  negative comments on perceived ‘Americanisation’ of tool, thought not designed for a UK audience (n=7)
DESIGNED FOR A YOUNGER AGE GROUP“I felt I am at the upper age of the target group for the website.  It struck me as maybe being more suitable for teenagers and people in their very early 20s”Interviewee Female 20-24
DESIGNED FOR AN AMERICAN AUDIENCE“I just thought this is straight out of an American teenage magazine” Interviewee Female 50-55	“the Americanisations weren’t relevant.  It was almost as if... well can’t they bother to even make it  anglicised and think about it from a UK point of view?”Interviewee Female 20-24
LIMITATIONSSmall SampleDespite purposive sampling, mainly female, middle aged respondersLikely to be biased towards those who have had positive experiencesNeed to address converse...i.e...those that left trial
SUMMARYUsers of online interventions will have specific needs for intervention, but may not seek traditional forms of helpUsers perceive privacy, lack of transport and 24/7 availability as main benefits of internet as a mode of deliveryPossible to provide benefit & change behaviour with solely internet based intervention
SUMMARY4.   Branding by organisations perceived as trustworthy important for engagement5.   Important to tailor language to age and local population
ACKNOWLEDGEMENTS

6-005-1100-Todkill

  • 1.
    Participant experiences ofan online intervention and randomised control trialDr Daniel TodkillProfessor John Powell
  • 2.
  • 3.
    AimTo understand participants’experiences of and motivations for participating in an intervention and trial delivered solely online
  • 4.
    ContextExplored motivations toenrol and persist in PSYWELLRCT3070 participants, self-recruited through NHS Choices websiteIntervention advertised to potentially increase ‘mental wellbeing’
  • 8.
    PSYWELLRCTWaiting list controland intervention groupsHigh attrition rates...1529 (49.8%) completed final follow up, attrition 73% in intervention arm, 26% in control armPrimary outcome measured using WEMWBSDespite high attrition, results are promising
  • 9.
    Qualitative Study -RecruitmentAt end of trial, participants in intervention arm were invited to participate.Those who consented, were stratified by age and genderPurposive, not representative sampleResearchers blinded to participants’ trial results and characteristics, other than age group and gender
  • 10.
    ProcedureAll interviews followedsemi-structured interview guideOne interviewer conducted all interviews over telephone
  • 11.
    ProcedureAll interviews audio-recorded& transcribedFramework Approach used to identify themes and subthemesIdentified, charted, indexed and interpreted themes and subthemes
  • 12.
    Results80 participants inintervention arm consented to contact for qualitative interview60 participants contacted14 males indicated consent, all contacted2 males & 18 females provided consent and were able to be interviewed. Ages varied from 20 to 64
  • 14.
  • 15.
    KEY THEME 1– MOTIVATION16 users were experiencing (n = 14) or had experienced (n = 2) periods of low mood & wanted MOODGYM to help them through or understand own emotions Low mood had wide range of aetiology...bereavement, physical or mental illness, stressful periods at work or unemployment
  • 16.
    KEY THEME 1– MOTIVATION“I think for me it was at a very vulnerable time and it seemed like something that could help me to pull me out of where I was, which it did do” Interviewee 12 (female 45-49)
  • 17.
    KEY THEME 1– MOTIVATIONTheme throughout interviews was that the PSYWELLtrial advert appeared at...“the right place at the right time really” Interviewee 10 (female 40-44)
  • 18.
    KEY THEME 2;BENEFITSOF INTERNET AS A MODE OF INTERVENTION
  • 19.
  • 20.
  • 21.
    PRIVACY“.... the factthat you could do the whole thing without anybody knowing, basically, anybody knowing about me and where I was and what I was doing was actually quite reassuring” Interviewee 18 Female 55-59
  • 22.
    24 HOUR AVAILABILITY“Itwas great because I could do it whenever I wanted to. If I got up at two o'clock in the morning, I could sit and do it. I didn't have to make an appointment with anybody so it was really good from that point of view.”Interviewee 8 Female 20-24
  • 23.
    SELF EFFICACY“I thinkit is that feeling that it was something I was doing rather than something that was being done to me, if that makes sense. Rather than going back to the doctor’s surgery and asking for help I felt that I was taking part in something, that I had an element of participation in it, that I was doing something to help myself get better“Interviewee 5 Female 55-59
  • 24.
    RATHER THAN FACETO FACE....I wouldn’t have gone to my Doctor and said to him about how I was feeling, because I didn't think it was the right level of problem. I wasn’t sure how I was feeling I suppose, so I think it was a good way for me to have a bit of a tinker and see how I was feeling and see what help was I guess.”Interviewee 13 Female 55-59
  • 25.
    KEY THEME 3;BEHAVIOURCHANGE AS A RESULT OF THE INTERVENTION
  • 26.
    KEY THEME 3– BEHAVIOUR CHANGE17/20 were positive & provided examples of how thinking or behaviour changed1/20 found short term benefits lasting few days, then no further2 interviewees had negative opinion of intervention
  • 27.
    KEY THEME 3– BEHAVIOUR CHANGE15 described changed reflections on own thoughts & patterns of thinking10 described positive changes in way participant relates to others9 described other examples of changed external behaviours
  • 28.
    CHANGED PATTERNS OFTHINKING“I think it helps people to look at the way they think and what effect that has on the way they feel and the way they act...”Interviewee 1 Female 50-54
  • 29.
    POSITIVE CHANGES INRELATIONSHIPS WITH OTHERS“...more likely to try and sort of... step back from a situation, and think well am I thinking about this is the right way” Interviewee 5 Female 55-59
  • 30.
    EXTERNAL BEHAVIOUR CHANGE– CASE STUDYPre intervention –anxiety caused her to take “two hours in the morning to feel ready to go outside” and “if I didn’t do that routine, I thought my day was going to go badly.” Post intervention - “I can leave the house within half an hour now which is as soon as I have had my breakfast”Interviewee 16 Female 25-29
  • 31.
    EXTERNAL BEHAVIOUR CHANGE– CASE STUDY“It gave me the confidence and made me realise that I wasn’t the only person suffering from anxiety. Everyone suffers from it sometimes, and it taught me a way of dealing with it, that it doesn’t matter. That it is perfectly normal and I can deal with it, it’s not going to try and eat me up during the day. So I can just get on with life rather than letting the anxiety control me” Interviewee 16 Female 25-29
  • 32.
    KEY THEME 4;BRANDINGOF THE TOOL & TRIAL
  • 33.
    KEY THEME 4– BRANDING OF THE TOOL & TRIALParticipants upload intimate details of their emotional states...Asked about reasons the felt secure in providing informationMost common response (n=8) was branding
  • 35.
    KEY THEME 4– BRANDING OF THE TOOL & TRIAL“I mean obviously with it being from a University, that’s always useful, rather than, shall I call it a private organisation, you know, it didn’t feel as if anybody was trying to make any money out of it.”
  • 36.
    KEY THEME 5;LANGUAGEOF THE INTERVENTION
  • 37.
    KEY THEME 5– LANGUAGE OF THE INTERVENTION8 described how the intervention was aimed at younger people, even the youngest participant described thisMultiple negative comments on perceived ‘Americanisation’ of tool, thought not designed for a UK audience (n=7)
  • 38.
    DESIGNED FOR AYOUNGER AGE GROUP“I felt I am at the upper age of the target group for the website. It struck me as maybe being more suitable for teenagers and people in their very early 20s”Interviewee Female 20-24
  • 39.
    DESIGNED FOR ANAMERICAN AUDIENCE“I just thought this is straight out of an American teenage magazine” Interviewee Female 50-55 “the Americanisations weren’t relevant. It was almost as if... well can’t they bother to even make it anglicised and think about it from a UK point of view?”Interviewee Female 20-24
  • 40.
    LIMITATIONSSmall SampleDespite purposivesampling, mainly female, middle aged respondersLikely to be biased towards those who have had positive experiencesNeed to address converse...i.e...those that left trial
  • 41.
    SUMMARYUsers of onlineinterventions will have specific needs for intervention, but may not seek traditional forms of helpUsers perceive privacy, lack of transport and 24/7 availability as main benefits of internet as a mode of deliveryPossible to provide benefit & change behaviour with solely internet based intervention
  • 42.
    SUMMARY4. Branding by organisations perceived as trustworthy important for engagement5. Important to tailor language to age and local population
  • 43.

Editor's Notes

  • #6 NHS Choices is the UK’s biggest health website.Averages between 8-9million visitors per monthTrial was advertised on Live WellCo-author of this presentation and trial is medical director.
  • #7 Australian developed intervention - MoodGYM (www.moodgym.anu.edu.au) consists of five interactive modules over five weeks, and demonstrates CBT principles. Effective in depression, first time used to improve mental health wellbeing
  • #8 The concept of mental well being has recieved a lot of media coverage in the UK, with the government introducing and developing a ‘wellbeing index’.Although self-directed internet interventions are known to have low rates of adherence,17 this is less of a problem in wellbeing promotion for the general population than for the treatment of mental illness since it does not raise ethical questions of inadequacy of treatment for a diagnosed health problem. Moreover, as a mental health promotion tool, the intervention can be delivered at very low marginal cost using minimal personnel resources so that it can be made freely available to all who wish to use it, in contrast to a therapist contact approach which would be neither feasible nor affordable, for all.
  • #15 The first key theme that came through was what made them sign up to an online trial? It was clear that users will have specific needs of an intervention, but are different to the type who would access traditional forms of help