Farrell et al. Trials 2010, 11:78 Page 2 of 6http://www.trialsjournal.com/content/11/1/78What makes a successful trial? • The ability to organise and motivate othersPrescott et al.  assembled and classified a comprehen- • Flair, enthusiasm, innovation and leadership whensive bibliography of factors limiting the quality, number faced with challengesand progress of RCTs. They identified barriers to clinician • The ability to manage the trial budget(s) and main-participation that included, for example, time constraints, tain the accountsconcern about the impact on doctor-patient relationships, • Having strategic, tactical and operational manage-concern for patients, lack of reward and recognition, and ment skills in the planning and execution of a projectan insufficiently interesting question. Barriers to patient Despite the complex responsibilities of this role, theparticipation included issues such as additional demands body of knowledge available to guide trial managers isof the trial, patient preferences, concern caused by uncer- very limited. In 1998, Farrell  described the need fortainty and concerns about information and consent. They trial management models and methodology to be estab-recommended that to overcome barriers to participation, a lished, recognised and published to provide a body of evi-trial should address an important research question and dence for those undertaking clinical trials, large or small;the protocol and data collection should be as straightfor- yet more than 10 years on very little recognised referenceward as possible, with demands on clinicians and partici- material, other than The Guide to Efficient Trial Manage-pants kept to a minimum. Dedicated research staff may be ment , is readily available. In addition to a trial man-required to support clinical staff and participants. The ager, an efficient, well-trained trial management teamrecruitment processes of an RCT should be carefully can be the deciding factor in the success or failure of aplanned and piloted regardless of size or complexity. trial. The trial team will be decided by the needs of the On the basis of experience in noncommercial aca- trial itself and, apart from the Chief Investigator, itdemic initiated trials, Farrell and Kenyon  in The should include a trial manager, a trial statistician, a trialGuide to Efficient Trial Management suggest that programmer, a data manager, data clerks, administrativeactively managing every aspect of the trial is key to suc- staff and other trial specific staff, e.g., health economists.cess. If clinicians are to recruit participants, they should Each of these has an important role to play, and clarityfeel comfortable and trained in trial processes and pro- about exactly what each of the roles involves is crucial ifcedures. This can be achieved using a variety of meth- every aspect of a trial is to be managed well; it requires aods: one-to-one training, group work, distance learning team effort. In the UK, the recent development ofmethods (videos via the web and teleconferences). research networks and the registration of Clinical TrialsNational and international presentations and discussions Units has seen the ‘portfolio trial manager’ emerge. Theto continually highlight the importance of the trial must portfolio manager has to deal with a variety of tasksbe organised by the trial team. Maintaining a personal across a range of trials which can present different chal-interface with a collaborative group of clinicians, lenges. The success or failure of this approach willwhether this is a group of 7 or 700, is probably the become apparent over the coming decade.biggest challenge for a trial manager and the trial teambut one that will result in a more cohesive trial. Project planning A clinical trial shares many features with any other type of business project as defined in the field of projectA trial manager management . These features include the following:The importance of a trial manager to the success of theproject is recognised by the NIHR HTA programme, and • A clear objective aimed to bring about changethey recommend that all primary research projects appoint • Requiring a teama dedicated project/trial manager. Ideally, trial managers • A set time scaleshould be involved early on in the trial design phase, but • Defined resources to achieve its objectivethis is rarely possible because of funding constraints. How- • Tasks which need to be completed (to a prespeci-ever, a good trial manager involved in the trial design and fied standard)funding application will make a valuable contribution tothe practicalities of conducting the trial, potentially saving All projects consist of a series of processes, a set ofmoney and avoiding unworkable systems. Generic job actions to bring about results. The five basic processdescriptions produced by the HTA  and the UK Trial stages are :Managers’ Network (UKTMN)  identify the key respon- 1. Initiatingsibilities of a trial manager as follows: 2. Planning • Having a leading role in planning, coordinating and 3. Executingcompleting a project 4. Monitoring and controlling • Excellent communication and presentation skills 5. Analysis and reporting
Farrell et al. Trials 2010, 11:78 Page 3 of 6http://www.trialsjournal.com/content/11/1/78 These five stages reflect the life cycle of a trial. There- presentations at relevant conferences, mailshots, news-fore, developing a management plan is key for effective letters from the professional colleges, journal articlestrial management. It is essential that a project manage- and general word of mouth. The success of a trial, parti-ment plan include details of the arrangements for devel- cularly recruitment, may require thinking ‘outside theoping and monitoring all aspects of a trial, including box’ and training, supporting and crediting other groupsservicing the steering committee and the independent who are not traditionally directly involved in thedata monitoring committee but, most important, how the research process but nevertheless are crucial to a trial:day-to-day running of the trial will be planned and mana- for example, nurses, records department staff, wardged. The development of a robust statistical analysis plan clerks, radiology staff. A trial is likely to be more suc-supported with sufficient resources and time to conclude cessful, and enjoyable, if members of the collaborativethe trial efficiently is a crucial element of this plan. The group feel they ‘own’ the project. This ownership will beproject plan should also describe who will be responsible fostered by involvement and consultation at every stage,for essential activities, such as staff recruitment, staff from protocol development to publication of the results.management, communication with the collaborative All trials need to be actively promoted or marketed.group, recruitment monitoring, data management, and Part of this strategy will be a memorable name and/orraising project awareness (promotion), through to safety identifiable logo and a thoroughly professional image. Itreporting, analysis, report writing and dissemination of is well established that interdisciplinary collaborationthe trial results. The project plan should describe what offers greater potential for success . For large trials,the trialists are trying to achieve, how resources will be this will be a diverse multidisciplinary group includingused and within what time frame. It should also include representatives from each participating site. For smallerhow the planned processes will be monitored to ensure and single-centre studies, the group will be less formalthat the project is being delivered as planned. The plan and may be just a handful of like-minded people. Bam-can then be reviewed and refined, if necessary, as the trial mer  identified that there is a growing body ofprogresses. Clear processes, both inside and outside the research on collaborations which include examinationsoffice, need to be established and documented. The abil- of the increase in collaborations and team sizes, patternsity to constantly review and adapt the project plan is cru- of collaborative networks, motives, choices and strate-cial as a trial can be hit side-on by events outside its gies for collaboration, the measurement of collaboration,control, e.g., emerging evidence, war leading to lack of how collaborations are organised and how successfulrecruitment and natural disasters. Sensible risk assess- collaborations are measured. However, how these con-ment, tailored quality assurance management systems cepts are applied to trial management is unclear, andand real-time monitoring are essential if a trial is to opti- further observation and evaluation are necessary but dif-mise its potential and provide reliable evidence. ficult to carry out. The only reliable way to obtain good The Clinical Trial Toolkit  was developed in 2003 evidence that business concepts work in a clinical trialto coincide with the implementation of the EU Clinical would be to conduct a randomised trial. One half of theTrials Directive  by the UK Medical Research Coun- trial would be managed according to a project plan andcil (MRC) and the UK Department of Health as a tool the other half left to run without a plan; we suspect thisto guide people embarking on a clinical trial through would be unacceptable to any funder and certainlythe regulatory and governance requirements. The toolkit unacceptable to a good trial team. Some elements ofis a good starting point for trialists and trial managers trial management may be easier to evaluate, such as theto ensure all legal obligations are met, but it does not best method of ensuring data are completed andspecify how to run a trial. returned, but once again this carries an element of risk (as does any trial) and will have resource implications.CollaborationGood evidence that the clinical question being evaluated Minimal work for investigators and participantsis in equipoise is important, but it is only part of the Minimal work for investigators and participants meansequation. The question also needs to be relevant to clin- ensuring recruitment procedures run alongside routineicians and nurses as they are likely to be the people practices. Site visits and talking to staff in the placerecruiting the participants. To be successful, most trials where recruitment happens will make sure recruitmentdepend on developing some sort of collaborative group. to the trial becomes part of the daily routine. TheThe aim of a collaborative group or network is to be recruitment procedure needs to be realistic and practi-inclusive rather than exclusive. Proactively raising the cal; for example, web randomisation may not be practi-profile of any developing project and creating a group of cal for a trial being conducted in an Intensive Care Unitinterested people takes time and commitment. This can or in a trial of an emergency intervention. Clinical staffbe done in many ways, through personal contact, are always busy and may be reluctant to carry out
Farrell et al. Trials 2010, 11:78 Page 4 of 6http://www.trialsjournal.com/content/11/1/78complex procedures to recruit participants. Complicated through the system. There needs to be a logical andprocedures and extra tests or visits may also deter the transparent structure, concise documentation (standardenthusiastic participant. The data that need to be col- operating procedures) and accountability of every processlected to answer the clinical question should be readily employed in the trial. If the trial is international, theseavailable to the recruiting staff. systems should take account of differing clinical prac- Development of the data collection forms should tices, working environments and governance regulations.begin early in the process of trial development. Ideally, Good quality data depend on effective trial manage-dummy tables that reflect the final analysis would be ment. Collecting data by the use of a case report formprepared as part of the statistical analysis plan to ensure and entering it into a database are quite simple tasks.that the data collection forms do not collect unnecessary However, ensuring that these data are sensible, reliabledata. This takes considerable discipline but will avoid and reflect the ‘true situation’ is a complicated andomissions in the data collection forms and minimise the detailed process. With the aid of computers, data valida-collection of data that will never be reported. Experience tion and quality control can be quick and efficient, buthas generated some simple tips for the design of data these systems also need to be flexible and adaptable soforms such as always collect the raw data; if necessary, that they can respond to the needs of the investigatorsit can be put into categories later. Questions should be and the changing needs of the trial. Using systems thatordered in a way that reflects clinical progression and reduce the number of steps required for data entry,makes sense to the person completing the form. Data such as the use electronic data capture, can minimisecollected as ‘free text’ is not advisable, as this can con- the workload for both investigators and the data man-siderably increase the data management workload and agement team. However, if trialists intend to use elec-increase the risk of misinterpretation of the data, but is tronic data capture, a good deal of preparatory worknevertheless sometimes unavoidable. A recent article by needs to go into form design and training to avoid add-Edwards  provides a theoretical guideline for ques- ing to the workload. Adherence to database design, test-tionnaire design and administration but acknowledges ing and validation standards is crucial during thethat further evaluation is required. computer system development process and required under clinical trials legislation .CommunicationInvestigators need to feel valued and part of an inclusive Efficient recruitment of trial participantsteam answering an important clinical question, so pro- A trial succeeds or fails on the basis of whether it man-viding regular feedback that ensures they feel involved ages to recruit the prespecified number of participantsmust be central to a trial’s communication strategy. to reliably answer the question, and yet there is very lit-Remembering the audience being addressed and tailor- tle research evidence to guide recruitment strategies.ing all communication appropriately will help busy clini- Mapstone et al.  identified 15 eligible trials aimed atcians identify his or her priorities and maintain trial recruiting participants for health care studies. Trials of‘buy-in’. Using an investigator’s preferred method of monetary incentives, an additional questionnaire at invi-communication (telephone, email, letter, web site and tation and treatment information on the consent formpersonal contact) will ensure he or she feels communi- demonstrated benefit. However, these specific interven-cation is personal. Projecting a positive image about trial tions from individual trials are not easily generalisable.progress generally as well as progress within any given The authors concluded that on the basis of this evi-site will encourage continued involvement. Listening to dence, it is not possible to predict the effect most inter-problems and resolving any issues quickly will increase ventions will have on recruitment. A Cochrane reviewconfidence in the trial and the trial team. Investigators on incentives and disincentives to participation by clini-should always be made to feel appreciated and not over cians in RCTs by Rendell et al.  found 11 relevantburdened by involvement in the trial. observational studies relating recruitment rates to a number of factors. In particular, these studies suggestedEfficient systems that there was more recruitment if the clinicianA trial, particularly a large trial, needs robust compu- • Was interested in evidence based practiceterised systems and procedures that monitor every aspect • Was participating in an academic groupof the day-to-day running of the trial. A reliable system • Had extra staff to help with recruitmentthat will monitor recruitment, randomisation procedures, • Thought patients might be interestedstock control, data management, data cleaning, and cen- • Felt comfortable about explaining trialstral data monitoring and that will produce useful reports Although these may provide some pointers for areasshould be developed. Every essential piece of paper that to address, the review authors concluded that therelates to a trial participant should be logged and tracked research evidence base for strategies for increasing
Farrell et al. Trials 2010, 11:78 Page 5 of 6http://www.trialsjournal.com/content/11/1/78recruitment was poor and that further research was the report. The CONSORT Guidelines [20,21] provide aneeded. Experienced trial managers, who have learnt standard for reporting clinical trials which aims tothrough apprenticeship, continually monitor, review and improve the quality and transparency of trial reporting.revise the recruitment strategies being used, and thisbody of experience has been published online as part of Education, training and experienceThe Guide to Efficient Trial Management. To main- The EU Clinical Trials Directive 2001  specifies thattain recruitment at the necessary level over a long per- every member of a trial team should have the appropriateiod of time, say, 3 to 5 years, requires stamina in education, training and experience to perform his or hereveryone involved in a trial. Strategies used to do this tasks. For a trial manager of any trial, it is difficult to com-might include visiting sites where the trial is working ply with this regulation as specialised training in trial man-well and seeing what lessons can be learnt and applying agement does not exist and there is no recognisedthem elsewhere. Using the experiences of individuals qualification that can prove that a trial manager has beenwithin the collaboration who are doing well to teach educated in the discipline. Much of the collective wisdomothers, either in newsletters or at meetings, is very valu- about doing trials has been passed on by apprenticeship,able and encourages internal collaboration and capacity very much a ‘suck it and see’ approach which can be tobuilding. Ensuring there is always clear, professional lit- the cost of the trial and the trial manager. For thoseerature regarding the trial at recruiting sites is a task wishing to pursue a career in trial management, the lackthat a good trial manager will incorporate into the pro- of good practice guidelines and standards can be extre-ject plan. If promotional material is not updated regu- mely challenging and at times very frustrating. A surveylarly with new eye-catching information, it quickly undertaken by the UKTMN in 2005 identified the needbecomes just part of a sea of other information and all for courses in practical management of clinical trials. Ofimpact is lost. Making sure the trial team go to meetings the 284 trial managers surveyed, 60% were not seekingprepared, i.e., knowing how sites are recruiting, the higher education qualifications but wanted flexible, acces-quality of the data collection and who are the most sible, specific training relevant to their jobs. For those whoimportant people to meet to discuss the trial’s progress, do want to study for a higher qualification, the distanceshould be a ‘given’, but this is not always the case. learning MSc/Post Graduate Diploma in Clinical Trials by Distance Learning  has been developed by the LondonPublication and dissemination School of Hygiene and Tropical Medicine and the Univer-How credit for the trial will be shared is also an impor- sity of London. The MSc includes project managementtant component of the project development and manage- principles as one of the fundamentals of trial conduct.ment plan. For collaborative trials, it is vital that Many other courses and workshops on clinical trials alsoappropriate credit is given where it is due and that every- include an element of project management skills training.one who has wholeheartedly contributed gains recogni- However, although intuitively trial managers are utilisingtion in one way or another. This will often mean these skills, more evidence is needed to support the appli-publication of the results as a collaborative group. Group cation of project management principles and practices toauthorship is a particular issue for trial managers as clinical trial management for future trialists.under the collaborative authorship policy rarely does thetrial manager get acknowledged for their individual con- Discussiontribution. This is a real concern for those working toward A recurring theme in this paper is the need for thosemaking trial management their career pathway and those planning and doing trials to have reliable and rapidworking to promote a career structure for trial managers. access to relevant expertise and for published standards The trial will mean nothing if the results are not dis- for trial management (conduct) that avoid trialists’ rein-seminated and taken account of in clinical practice. venting the wheel. Trial managers have, in recent years,Results of a trial can be made widely available using a begun to develop better ways of disseminating and shar-variety of media, such as articles in medical journals, ing experiences and expertise. Societies and associationsonline journals, trial registers, systematic reviews and of trial managers in North America and Europe areconference presentations. An advantage of a multicentre beginning to network and make their knowledge availabletrial is that each investigator, working within an agreed via the Internet and through journal publications. Thepolicy, can be responsible for local dissemination and acknowledgment by the UK Medical Research Council inpresentation. Trial results should be published whatever setting up the UK Trial Managers’ Network in 1998 high-the outcome of the trial, and it has been described as lighted the need to share expertise in this field and toscientific misconduct not to publish . Reporting the bring together trial managers who have no professionalresults must maintain confidentiality, and it must not be forum in which to network. Experienced trialists willpossible to identify individual participants or sites within have put together, either formally or informally, plans
Farrell et al. Trials 2010, 11:78 Page 6 of 6http://www.trialsjournal.com/content/11/1/78and checklists of essential steps in the development of a Authors’ contributions All authors contributed to the development and production of thetrial on the basis of their experience of what does or does manuscript. All authors read and approved the final manuscript.not work. Those planning their first trial often have tostart from scratch unless they are lucky enough to have Competing interests The authors declare that they have no competing interests.access to a clinical trials unit or someone with relevantexperience. Many trials struggle to finish, or even to get Received: 1 February 2010 Accepted: 13 July 2010underway, because the people running them have not Published: 13 July 2010been able to find information about the best processes Referencesfor establishing and delivering a trial. There is a need for 1. Yusuf S, Collins R, Peto R: Why do we need some large, simpleappropriate training which is easily accessible, but the randomized trials? Stat Med 1984, 3(4):409-422.real problem is the lack of a standard method which will 2. Francis D, Roberts I, Elbourne DR, Shakur H, Knight RC, Garcia J, Snowdon C, Entwistle VA, McDonald AM, Grant AM, Campbell MK: Marketing andensure high-quality trial management. Having such a clinical trials: a case study. Trials 2007, 8:37.standard would ensure that both funders and trial man- 3. Campbell MK, Snowdon C, Francis D, Elbourne D, McDonald AM, Knight R,agers maximise the trial investment and the chances of Entwistle V, Garcia J, Roberts I, Grant A, STEPS group: Recruitment to randomised trials: strategies for trial enrolment and participation study.success. Much of trial management is intuitive utilisation The STEPS study. Health Technol Assess 2007, 11(48):iii-ix- 105.of skills gained in other areas of work or on the basis of 4. Medical Research Council: Clinical trials for tomorrow. London: MRC 2003.experience and as such could not be the subject of robust 5. Prescott RJ, Counsell CE, Gillespie WJ, Grant AM, Russell IT, Kiauka S, Colthart IR, Ross S, Shepherd SM, Russell D: Factors that limit the quality,research methodologies. Robust, meaningful and enforce- number and progress of randomised controlled trials. Health Technolable standards for the management of trials would Assess 1999, 3(20):1-143.require effort on behalf of a collaborative group (using 6. Farrell B, Kenyon S, on behalf of the UK Trial Managers’ Network: A Guide to Efficient Trial Management. [http://www.tmn.ac.uk/guide.htm].trial management principles), including funders, investi- 7. Health Assessment Technology: Trial manager job description. [http://gators, trial managers and other interested groups and www.hta.ac.uk/investigators/governance.shtml].would take time but would do much to move the issue 8. UK Trial Managers’ Network: Generic Job Description. [http://www.tmn.ac. uk/career.htm].forward. If such a standard could be agreed on, this 9. Farrell B: Efficient management of randomised controlled trials: nature orwould more accurately identify training requirements nurture. BMJ 1998, 317:1236-1239.and open the door to more appropriate research into 10. Project Management Institute: A Guide to the Project Management Body of Knowledge 1996. [http://www.unipi.gr/akad_tmhm/biom_dioik_tech/what is undoubtedly a vital component in successfully files/pmbok.pdf].completing a clinical trial. 11. UK Medical Research Council and Department of Health: CT-Toolkit. [http:// www.ct-toolkit.ac.uk]. 12. European Commission: EU Clinical Trials Directive 2001. [http://ec.europa.Conclusion eu/health/files/eudralex/vol-1/dir_2001_20/dir_2001_20_en.pdf].The very important and internationally accepted CON- 13. Fry A, Mortimer K, Ramsay L: Clinical research and the culture ofSORT Guidelines were developed because there was a collaboration. Aust J Adv Nurs 1994, 11:18-25. 14. Bammer G: Enhancing research collaborations: three key managementwill to improve the way important research was pub- challenges. Research Policy 2008, 37:875-887.lished. There is the same will amongst trialists to 15. Edwards P: Questionnaires in clinical trials: guidelines for optimal designimprove trial management methods and provide sound and administration. Trials 2010, 11:2. 16. U.S. Department of Health and Human Services Food and Drugpublished evidence to be used to successfully evaluate Administration 2007: Computerised system standards. [http://www.fda.important health research. We urge that funders, trial- com/csv/index.html].ists, trial managers and all interested groups come 17. Mapstone J, Elbourne D, Roberts I: Strategies to improve recruitment to research studies. (Cochrane Methodology Review). The Cochrane Librarytogether, led by opinion leaders in the field, to discuss Chichester, UK: John Wiley & Sons Ltd 2004, 2.and debate trial management methods with the aim of 18. Rendell JM, Merritt RD, Geddes JR: A Cochrane review on incentives andproviding a standard for trial management and a guide- disincentives to participation by clinicians in trials. Cochrane Database Syst Rev 2007, 18(2):MR000021.line for those running clinical trials to work toward. We 19. Chalmers I: Underreporting research is scientific misconduct. JAMA 1990,also suggest that the editors of medical journals might 263(10):1405-1408.want to consider the importance of how good research 20. Schulz KF, Altman DG, Moher D, the CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomisedis actually carried out and require that trial management trials. BMJ 2010, 340:c332.methods be part of articles considered for publication. If 21. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ,trial management continues to be unrecognised through Elbourne D, Egger M, Altman DG, the CONSORT Group: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallela lack of standard methodology and training, it will be group randomised trials. BMJ 2010, 340:c869.to the detriment of future research and health care. 22. London School of Hygiene and Tropical Medicine: MSc in Clinical Trials. [http://www.lshtm.ac.uk/prospectus/masters/dmsct.html].Author details1 National Perinatal Epidemiology Unit CTU, University of Oxford, Oxford, UK. doi:10.1186/1745-6215-11-782 School of Health and Population Sciences, University of Birmingham, Cite this article as: Farrell et al.: Managing clinical trials. Trials 2010 11:78.Birmingham, UK. 3Clinical Trials Unit, London School of Hygiene and TropicalMedicine, London, UK.