Sponsor and Provider
Perceptions on Managing
Clinical Development Risk
ICR	
  Event	
  
Enhancing	
  the	
  risk	
  based	...
2
The Avoca Group
The Avoca Group helps pharmaceutical and biotech companies and
service providers build, measure, and man...
3
2013 Avoca Research Overview
Introduction
●  Each year The Avoca Group surveys industry executives and managers to
under...
4
2013 Avoca Research Overview
Questions Explored
●  Risk-sharing models:  What types of models are used most often?  Unde...
5
Systematic Risk Assessment Contributors
Involvement in Conducting
Systematic Risk Assessment
Both Sponsor and Provider r...
6
Systematic Risk Assessment Components
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Patient enrollment risks
Vendor perfor...
7
Systematic Risk Assessment Results
In general, have your risk assessment and management approaches resulted in…
14%
23%
...
8
Risk-Based Monitoring Frequency
17% 13% 14% 18% 18%
30%
13%
36%
8%
21%
17%
13%
5%
15%
26%
19%
27%
26%
29%
9%
42%
23%
44%...
9
Risk-Based Monitoring by Phase
15%
37%
60%
50%
38%22%
43%
72% 70%
78%
Phase I Phase II Phase III Phase IIIb Phase IV
Spo...
10
Risk-Based Monitoring Implications
0% 10% 20% 30% 40% 50% 60% 70% 80% 90%
Frequency of site visits
Data elements for wh...
11
Conclusions and Takeaways
●  There appears to be a disconnect between Sponsors and Providers
regarding perceptions of t...
12
Conclusions and Takeaways
●  While respondents from Top 20 firms were more likely to report frequent use
of systematic ...
13
Conclusions and Takeaways
●  Risk management approaches appear to be yielding some benefits,
particularly with respect ...
Thank you
Contact Avoca at:
(609) 252-9020
www.theavocagroup.com
info@theavocagroup.com
179 Nassau Street
Suite 3A
Princet...
Upcoming SlideShare
Loading in...5
×

Institute of Clinical Research

93

Published on

Sponsor and Provider Perceptions on Managing Clinical Development Risk

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
93
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Institute of Clinical Research

  1. 1. Sponsor and Provider Perceptions on Managing Clinical Development Risk ICR  Event   Enhancing  the  risk  based  approach  to  clinical  trials  
  2. 2. 2 The Avoca Group The Avoca Group helps pharmaceutical and biotech companies and service providers build, measure, and manage critical business relationships. Why Avoca? ●  Avoca works exclusively in the pharmaceutical industry, focusing on clinical outsourcing, strategic alliances and alliance/relationship management. ●  Avoca has a deep understanding of sponsor preferences, leading practices and the health of relationships gained through nearly 15 years of collecting and analyzing quantitative and qualitative data on behalf of both sponsors and CROs. ●  Avoca’s Senior Consultants possess both process improvement and change management expertise as well as significant industry experience. ●  Avoca has unique perspectives of competing organizations’ practices and approaches for alliance management. We understand areas that competitors struggle with and can provide guidance to support effective differentiation.
  3. 3. 3 2013 Avoca Research Overview Introduction ●  Each year The Avoca Group surveys industry executives and managers to understand trends in clinical development, with a particular focus on outsourcing dynamics and relationships between research sponsors and providers. ●  Over the past several years we have participated in numerous conversations with biopharmaceutical companies and providers on the topic of risk reduction in the clinical development process. ●  According to various sources and published metrics, the industry remains challenged by relatively low success rates for compounds in clinical development, and this has prompted many organizations to explore ways of reducing the risk associated with the clinical development process. ●  With this in mind, Avoca chose to perform a comprehensive assessment of the methods used to evaluate and manage risk in outsourced clinical trials for our 2013 Industry Survey, with a focus on risk sharing models, risk assessment, risk management and risk-based monitoring. ●  This report serves as an Executive Summary of key findings from the research.
  4. 4. 4 2013 Avoca Research Overview Questions Explored ●  Risk-sharing models:  What types of models are used most often?  Under what circumstances? What is the magnitude of incentives/penalties?  Have the incentives/penalties been successful? Is success realized predominantly by improvements in time, cost, or quality?  What have been the downsides? ●  Risk assessment:  Is it formally done?  How is it done? To what extent are assessments qualitative vs. quantitative?  Have they been successful?  In what ways have they worked and in what ways have they not? ●  Risk-based management approaches:  To which tasks have such approaches been applied (e.g. monitoring, CRO management)? Have the approaches used formal quantitative modeling, or have they been qualitative? Have they been successful? Is success realized predominantly by improvements in time, cost, or quality?  What have been the downsides? Are there any issues related to regulatory acceptance?
  5. 5. 5 Systematic Risk Assessment Contributors Involvement in Conducting Systematic Risk Assessment Both Sponsor and Provider respondents often reported that risk assessment was performed jointly; however, those who felt that it was performed primarily by one party were much more likely to report their company was primarily conducting the assessment than the other party. A variety of functional groups were reported to be involved in the process. A joint CRO/Sponsor process Performed primarily by my company Conducted primarily by the other party It depends Functional Groups Involved in Risk Assessment Risk assessment is generally: 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% Project/Program Management Operational team members Functional Management Quality Assurance Outsourcing/Procurement Senior/Executive Management Business Development/Alliance Management Legal/Finance Sponsor (N=69) Provider (N=79) 32% 48% 47% 39% 16% 5% 5% 8% Sponsors Providers N=63 N=66 Q (Sponsor): For outsourced clinical trials, to what extent is the CRO generally involved in the systematic risk assessment? Q (CRO): To what extent is your company generally involved in the systematic risk assessment? Q; What functional groups and roles are generally involved in the risk assessment process?
  6. 6. 6 Systematic Risk Assessment Components 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Patient enrollment risks Vendor performance risks Data quality risks Other timeline risks Site compliance risks Cost risks Clinical trial subject safety risks Drug/device supply-related risks Risks to rights of clinical trial subjects/ethics Sponsor (N=70) Provider (N=75) Multiple risks are typically included in systematic assessments, with patient enrollment as the one most frequently cited by respondents. Regarding the features of each risk that are assessed, both groups reported evaluating risk probability, severity, ability to proactively reduce risk and ability to remediate risks as common elements. Types of Risks Assessed During Formal Reviews Q: When a systematic risk assessment is performed for projects conducted by your company, which of the following risks are typically formally assessed? Q: When a systematic risk assessment is performed, what features of each risk are generally assessed?
  7. 7. 7 Systematic Risk Assessment Results In general, have your risk assessment and management approaches resulted in… 14% 23% 32% 45% 38% 56% 34% 39% 23% 3% 6% 25% 18% 28% 15% N=65 Yes Sometimes No Don’t Know / Too Soon to Tell Risk management approaches appear to be yielding some benefits, particularly with respect to increased quality, but most respondents were not willing to provide a definitive “yes” to the questions, particularly those from Sponsor organizations. More efficient use of resources for your company and/or sponsor partner? Increased quality? Sponsors Providers Sponsors Providers N=66 N=65 N=66
  8. 8. 8 Risk-Based Monitoring Frequency 17% 13% 14% 18% 18% 30% 13% 36% 8% 21% 17% 13% 5% 15% 26% 19% 27% 26% 29% 9% 42% 23% 44% 18% Top 20 Non Top 20 Top 20 Non Top 20 CROs Usage Frequency of Risk Based Monitoring of Investigative Sites As a group, Sponsor respondents from Top 20 firms were more likely to report frequent use of risk-based monitoring of investigative sites than were those from Non-Top 20 firms, for both in-house and outsourced trials. The distribution of frequency of RBM use among CROs seems to be intermediate between the two sponsor groups. N 51-75% of trials >75% of trials 25-50% of trials 1-24% of trials Never SPONSORS CROs In-House Trials Outsourced Trials 23 31 22 39 34 Q: How often does your company use a risk-based approach to the monitoring of Investigative Sites for clinical trials managed and conducted by in-house teams? Q:How often do your project/program teams (including the CRO partners) use a risk-based approach to the monitoring of Investigative Sites for outsourced clinical trials? Q (CROs):How often does your company use a risk-based approach to the monitoring of Investigative Sites?
  9. 9. 9 Risk-Based Monitoring by Phase 15% 37% 60% 50% 38%22% 43% 72% 70% 78% Phase I Phase II Phase III Phase IIIb Phase IV Sponsors Providers Use of Risk-Based Monitoring by Clinical Study Phase % of Respondents that Have Used RBM A greater proportion of Provider respondents reported having used risk-based monitoring of sites for each phases of clinical development compared to Sponsor respondents. The difference is particularly pronounced in later phases of development. Sponsor N 39 46 48 46 37 Provider N 37 42 46 43 41 Q: For what phases of clinical studies have you used, or would you consider using, a risk-based approach to investigative site monitoring? (only “have used” shown)
  10. 10. 10 Risk-Based Monitoring Implications 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% Frequency of site visits Data elements for which Source Data Verification is performed Centralized monitoring of data Duration of site visits Visits to site by staff other than the CRA Seniority of CRA assigned to monitor site Sponsor (N=58) Provider (N=45) Across the samples, various adjustments were reported when using risk-based approaches to monitoring sites. The frequency of site visits and aggressiveness of data monitoring of data were adjusted by the greatest percentages of respondents. Trial Elements Adjusted According to Risk-Based Monitoring Approach Q: When you use a risk-based approach to monitoring, which of the following do you adjust depending on the level of assessed risk?
  11. 11. 11 Conclusions and Takeaways ●  There appears to be a disconnect between Sponsors and Providers regarding perceptions of the overall quality of service that is being delivered, as 87% of Provider respondents reported being “very satisfied” or “generally satisfied” vs. 53% of Sponsor respondents. ●  As a group, Sponsor respondents from Top 20 firms were more likely to report frequent use of systematic risk assessment processes for clinical trials than were those from Non-Top 20 firms, for both in-house and outsourced trials. ●  A majority of respondents from both Sponsor and Provider organizations reported that their companies had used at least one type of risk-sharing model. Respondents from both groups were much more likely to report having had positive experiences using guaranteed revenue streams in exchange for provider commitments than using penalties for failing to achieve milestones/targets. ●  Based on respondents’ answers to open-ended questions, investing time to ensure that both Sponsors and Providers have a clear understanding of expectations at the beginning of a risk-sharing relationship and establishing/ implementing effective Communication Plans appear to be critical elements of success in risk sharing.
  12. 12. 12 Conclusions and Takeaways ●  While respondents from Top 20 firms were more likely to report frequent use of systematic risk assessment processes by their companies, respondents from Non-Top 20 firms were more likely to report frequent utilization of the information to drive the level of CRO oversight. ●  Multiple risks are typically included in systematic assessments, with patient enrollment as the most frequently cited by respondents. Regarding the features of each risk that are assessed, both Sponsors and Providers reported evaluating risk probability, severity, ability to proactively reduce risk and ability to remediate risks as common elements ●  The vast majority of respondents reported at least sometimes changing aspects of clinical trial design, execution, or management based upon information gathered from risk assessments, but most of the possible changes addressed by the survey were made by most respondents for only a minority of clinical trials. ●  Sponsor respondents expressed higher levels of satisfaction with their in- house teams than with their CROs and other service providers on every risk assessment attribute evaluated. CRO respondents provided higher ratings of their own performance than Sponsors did, suggesting a perception gap with respect to CRO performance.
  13. 13. 13 Conclusions and Takeaways ●  Risk management approaches appear to be yielding some benefits, particularly with respect to quality, as one-third of Sponsor respondents confirmed that quality had increased and another one-third reported that quality had increased some of the time. ●  As a group, Sponsor respondents from Top 20 firms were more likely to report frequent use of risk-based monitoring of investigative sites than were those from Non-Top 20 firms, for both in-house and outsourced trials. The distribution of frequency of RBM use among CROs seems to be intermediate between the two sponsor groups. ●  Across the samples, various adjustments were reported when using risk- based approaches to monitoring sites. The frequency of site visits and aggressiveness of data monitoring of data were adjusted by the greatest percentages of respondents. ●  Satisfaction among Sponsor respondents with their CRO partners’ RBM expertise and ability to deliver quality studies using an RBM approach was below the satisfaction ratings CRO respondents awarded their own companies. This is consistent with other findings on overall quality and the ability to successfully perform risk assessments, suggesting that some CRO respondents may overestimate the extent to which they are meeting Sponsors’ needs.
  14. 14. Thank you Contact Avoca at: (609) 252-9020 www.theavocagroup.com info@theavocagroup.com 179 Nassau Street Suite 3A Princeton, NJ 08542
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×