SlideShare a Scribd company logo
1 of 8
Download to read offline
Commentary
Health economics and outcomes research fellowship
practices reviewed
Kangho Suh, Pharm.D., M.S.a
, Susan Gabriel, M.Sca
,
Michelle A. Adams, B.S.J., M.A.b
, Steve Arcona, PhD.a,*
a
Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA
b
Write All, Inc., Sonoma, CA, USA
Summary
The guidelines for health economics and outcomes research (HEOR) fellowship training programs devised
by the American College of Clinical Pharmacy (ACCP) and the International Society of Pharmacoeco-
nomics and Outcomes Research (ISPOR) suggest that continuous improvements are made to ensure that
postgraduate training through didactic and professional experiences prepare fellows for HEOR research
careers. The HEOR Fellowship Program at Novartis Pharmaceuticals Corporation was standardized to
enhance the fellows’ HEOR research understanding and align professional skill sets with the ACCP-ISPOR
Fellowship Program Guidelines. Based on feedback from an internal task force comprised of HEOR
employees and current and former fellows, the HEOR Fellowship Program was normatively and
qualitatively assessed to evaluate the current curricular program. Fellowship program activities were
instituted to ensure that the suggested minimum level requirements established by the guidelines were being
met. Research opportunities enabling fellows to work hand-in-hand with other fellows and HEOR
professionals were emphasized. Curricular enhancements in research methodology and professional training
and development, and materials for a structured journal club focusing on specific methodological and
HEOR research topics were developed. A seminar series (e.g., creating SMART Goals, StrengthsFinder 2.0)
and professional courses (e.g., ISPOR short courses, statistics.com) were included to enhance the fellows’
short- and long-term professional experience. Additional program attributes include an online reference li-
brary developed to enrich the current research facilities and a Statistical Analysis Software training program.
Continuously assessing and updating HEOR fellowship programs keeps programs up-to-date in the latest
HEOR concepts and approaches used to evaluate health care, both professionally and educationally.
Ó 2015 Elsevier Inc. All rights reserved.
Keywords: Pharmacoeconomics; Health economics; Outcomes research; Fellowship; Program curriculum; Guidelines;
Improvements
Previous content presentation: The content of this editorial was presented at the Academy of Managed Care
Pharmacy (AMCP) 26th Annual Meeting, April 1–4, 2014, Tampa, FL.
* Corresponding author. Outcomes Research Methods & Analytics, US Health Economics & Outcomes Research,
Novartis Pharmaceuticals Corporation, One Health Plaza, East Hanover, NJ 07936-1080, USA. Tel.: þ1 862 778 5716,
þ1 862 246 0615 (mobile); fax: þ1 973 781 8265.
E-mail address: steve.arcona@novartis.com (S. Arcona).
1551-7411/$ - see front matter Ó 2015 Elsevier Inc. All rights reserved.
http://dx.doi.org/10.1016/j.sapharm.2014.07.006
Research in Social and
Administrative Pharmacy 11 (2015) 280–287
The need for health economics professionals
In an era of cost-conscious health care, a vital
need exists for experts and professionals who are
skilled in the analysis of health economics data
and adept at interpreting and using data for
health care decision-making.1
Health economics
and outcomes research (HEOR) is utilized by a
diverse group of individuals (i.e., pharmacists,
physicians, economists, academicians, hospital
administrators) from numerous health care set-
tings, each playing an important role in opti-
mizing patient care.2
HEOR professionals use
evidence about the efficacy and effectiveness of
health care interventions to inform medical
decision-makers. This is accomplished through
the use of various methods including economic
modeling and comparative effectiveness research
(CER). The purpose of these efforts is to gain a
better understanding of the value of these inter-
ventions. Reflective of these health care trends
and needs, the demand for HEOR fellowship pro-
grams and expertise has increased significantly
over the past decade.1–3
Industry-sponsored HEOR fellowship programs
Growing from a program initiated at Glaxo
Wellcome, Inc. in 1989, HEOR fellowship
programs are now found in a diverse range of
fields, including pharmaceutical, academia, and
managed care organizations (MCOs), with phar-
maceutical companies as a prominent locale for
postgraduate HEOR education and training.2–5
HEOR fellowship programs provide training
and hands-on experience in a broad-range of
health economics, outcomes research, and CER.
These programs are structured to allow the fellow
to gain proficiency in the field of HEOR, and
CER as conducted in academic, MCOs, and hos-
pital, health policy, and pharmaceutical industry
settings. Common HEOR programs feature
organizational characteristics such as a salaried,
two-year program conducted in academic and
pharmaceutical site locations and educational
program features including professional and
research skills taught and experienced in economic
analysis and methodologies, research design and
methods, software application, data management,
project management work, and exposure to
HEOR design and analysis.1,6,7
To assist in the refinement and assessment of
HEOR fellowship programs, the American Col-
lege of Clinical Pharmacy (ACCP) developed its
first set of guidelines for HEOR fellowship
programs in 1999.2
In ensuing years, studies
were undertaken to examine the structure, educa-
tional objectives, and effectiveness of existing
HEOR fellowship programs from the perspective
of current and former fellows and preceptors.2
Among the findings, studies reported significant
variations in preceptor qualifications and the
amount of time devoted to HEOR experiential
activities and didactic coursework.1,2
One study
reported results from a Web-based survey of fel-
lows who had completed an HEOR fellowship be-
tween 1999 and 2001. Researchers reported on the
overall limitations found in HEOR fellowship
programs throughout the United States,1
and
their findings support the need for refinement
of these programs to include specific curricular
suggestions ensuring program effectiveness (i.e.,
didactic coursework, outcome assessment).1,2
ACCP-ISPOR recommended HEOR fellowship
guidelines
In 2008, ACCP collaborated with the Interna-
tional Society for Pharmacoeconomics and Out-
comes Research (ISPOR) to revise and refine its
guidelines for HEOR fellowship programs.2
Rec-
ommendations from ACCP and ISPOR members,
as well as a review of the existing ACCP guidelines
for clinical research training programs, formed the
basis for the revised guidelines. Overarching areas
of the ACCP Guidelines delineated in the 2008
published guidelines were related to the require-
ments of any HEOR fellowship program and
what the fellow should be experiencing profes-
sionally during a fellowship.
Per the ACCP-ISPOR recommendations,
HEOR fellowship programs should generally
include a minimum of 3000 hours of training
(R80% of fellow’s time) devoted to HEOR
research-related activities over at least 2 years, a
training plan with goals and objectives developed
and documented prior to initiation of fellowship,
formal instruction in HEOR-related topics,
assignment to a team of preceptors and/or a
primary advisor, exposure to ample resources for
conducting research, and a standardized plan for
the evaluation of fellows, preceptors, and pro-
grams upon fellowship program completion.2
Fellows should participate in at least one, but
preferably multiple scholarly projects (e.g., litera-
ture reviews, dossier development, prospective
and retrospective studies, economic modeling).
Through a combination of didactic and structured
supervised experiences, fellows should also
281Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
actively partake in all aspects of the research
process, learn multiple methods of measuring
clinical outcomes, and gain proficiency in various
methods of measuring economic outcomes and
patient-reported outcomes (PROs). Finally,
through the collection of experiences offered in a
fellowship program, fellows should develop an
understanding of the multifaceted aspects of the
health care delivery system, enhance their current
level of oral and written communication skills,
and regularly contribute and be a part of journal
clubs, research workshops, and/or seminars.2
The development of Novartis’ HEOR fellowship
program
Since 1994, the HEOR Fellowship Program at
Novartis Pharmaceuticals Corporation has had
relationships with many academic sites.c
During
their first year of study, fellows receive didactic
academic training in HEOR-related areas; in
the second year, fellows gain professional and
practical research experience from participation
in the HEOR Fellowship Program at Novartis
Pharmaceuticals Corporation located in East
Hanover, NJ.
Novartis’ HEOR fellowship program
characteristics
The HEOR Fellowship Program at Novartis is
operated by the US HEOR department and
coordinated by the Outcomes Research Methods
& Analytics (ORMA) group within US HEOR.
Training and hands-on experience are provided in
a broad range of HEOR and CER topics to better
prepare fellows for a career in the pharmaceutical
and biopharmaceutical industries. The program’s
structure enables fellows to apply competencies
gained in HEOR and simulate the responsibilities
and activities of full-time HEOR industry
employees.
Fellows are assigned to a therapeutic area (TA)
specifically chosen to foster and enhance their
professional skills and interests. Within a fellow’s
assigned TA, professional experience is cultivated
and developed in relation to HEOR knowledge
(e.g., types of research studies, economic
modeling), project management skills, and cross-
functional medical and business exposure.
Throughout their year, they gain experience
from the beginning stages of HEOR projects
(e.g., literature review, protocol writing) to the
publication processes, such as developing and
submitting abstracts and manuscripts. Fellows
work with an array of experts in addition to their
primary preceptor in order to enable a cross-
functional team experience.
The enhancement of Novartis’ HEOR fellowship
program
In an effort to align the HEOR Fellowship
Program at Novartis with the ACCP-ISPOR–
recommended fellowship guidelines, an internal
task force comprised of HEOR employees was
assembled to assess the existing HEOR Fellow-
ship Program in a normative and qualitative
manner.d
The primary objective of the task force
was to ensure that the fellowship program was
fully aligned with ACCP-ISPOR guidelines set
for HEOR fellowship programs. An additional
purpose for enhancing the HEOR Fellowship
Program at Novartis was to standardize the
second-year postgraduate professional experience.
Structural and curricular assessment and
advancements
Current and past fellows were interviewed and
surveyed to determine the differences in their
fellowship experiences. The HEOR Fellowship
Program was reviewed against the ACCP-
ISPOR guidelines to identify any potential op-
portunities to strengthen the program. The task
force identified areas for structural and curricular
enhancements, and developmental plans were
subsequently operationalized and applied. After
assessing the interviews given by previous fellows,
an inconsistency in fellows having different types
of project experience was noted. This was not due
to the HEOR Fellowship Program in general, but
mainly due to project experience being dependent
on which TA a fellow was placed into and where
medications in that TA were in the drug life cycle.
c
Currently, the following schools have affiliations primarily in the first-year postgraduate program: The Health Out-
comes and Pharmacy Practice Division, The University of Texas at Austin, Austin, TX, in conjunction with Scott &
White Health Plan, Temple, TX; The Department of Pharmaceutical Health Services Research, University of Maryland,
Baltimore, MD; Jefferson School of Population Health at Thomas Jefferson University, Philadelphia, PA; and The
School of Pharmacy, Rutgers University, New Brunswick, NJ.
d
The internal task force was comprised of a small group of full-time HEOR employees, a senior fellow, and an
external consultant.
282 Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
As shown in Table 1, basic professional experi-
ence and skills were enhanced and corresponded to
the suggested minimum level of research and
managerial project work established by the
ACCP-ISPOR joint guidelines.2
As indicated in
Table 1, certain professional seminars and pro-
gram features directly related to the daily activities
of the fellows are currently being implemented and
will be completely integrated into the HEOR
Fellowship Program by July 2015. For example,
the fellows are expected to write a research proto-
col and submit it for internal review by the end of
the HEOR Fellowship Program. Additionally, the
HEOR Fellowship Program directors and precep-
tors support continual improvements implemented
as needed and wherever possible. Descriptions for
each activity, developed materials, and/or con-
cepts mentioned will be summarized in the sections
that follow.
HEOR fellowship program advancements
Many of the overarching curricular aspects of
the formerly structured HEOR Fellowship Pro-
gram at Novartis were in place prior to the
program assessment step; however, formalizing
and adjusting certain activities and materials
established a more structured HEOR Fellowship
Program. This section details the types of activ-
ities and materials implemented and presents the
current status and structure of the HEOR Fellow-
ship Program at Novartis.
Orientation activities and materials
The HEOR Fellowship Program at Novartis
commences with an Orientation Meeting. Orien-
tation activities and materials are designed
to familiarize fellows with Novartis and its inter-
nal structure and are distributed during the
Orientation Meeting. At this time, fellows are
introduced to the HEOR departmental structures,
other new fellows, their HEOR counterparts,
and the specifics related to their HEOR-ORMA
experience.
A valuable tool for fellows that is distributed is
the HEOR Fellow User’s Manual that includes all
program materials to be used throughout the
program. A Fellowship Checklist is among the
important documents provided to fellows, serving
as a key roadmap for tasks and to assist in guiding
fellows through the upcoming year’s events (i.e.,
key professional milestones and monthly tasks to
complete). An administrative topic covered during
the Orientation Meeting is reimbursement
procedures related to each academic site as well
as those of Novartis.
Methods-based and HEOR TA department projects
Because the HEOR Fellowship Program at
Novartis is coordinated by ORMA, fellows have a
unique opportunity to work with professional
methods-focused researchers in the ORMA group
and HEOR professionals in the assigned TA
department. Within US HEOR, the ORMA
group serves as an internal data analytics consul-
ting team. Some of the fellowship work completed
by the fellows is supported and guided by ORMA.
This professional experience with ORMA helps to
bridge any methodological knowledge gaps and
serves to augment the fellows’ professional HEOR
experience.
Methods-based HEOR projects with ORMA
With the guidance and supervision of the
ORMA group, HEOR project assignments expose
fellows to a variety of methodologies, operational
documents, and other HEOR-related materials
(i.e., early products vs in-line projects, methods-
only projects and publications). Some of these
projects include the development of abstracts,
posters, and/or oral presentations to be presented
at annual congresses, the publication-planning
experience, anddmore specificallydmanuscript
development. If possible, ORMA-specific projects
assigned to fellows correspond with the fellow’s
designated TA and are tailored to the needs of the
TA and each fellow.
HEOR projects with assigned TA
Within the fellow’s assigned TA, professional
experience is fostered and enhanced in terms of
HEOR knowledge, project management skills,
and cross-functional medical and business expo-
sure. HEOR exposures gained during the
fellowship-assigned TA experience include, but
are not limited to: literature reviews, the publica-
tion process (e.g., the development of abstracts,
posters and/or oral presentations, and manu-
scripts), retrospective studies (e.g., claims data-
base analyzes and medical record reviews), and
various types of economic modeling. Actual
experiences may vary based on the product line
and/or TA. These capabilities correspond to the
suggested minimum level of research and mana-
gerial project work established by ACCP-ISPOR
Guidelines.2
283Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
Table 1
ACCP-ISPOR Fellowship requirements, established practices, and advancements in the HEOR fellowship program
ACCP-ISPOR fellowship requirements2
HEOR fellowship program
established practices
HEOR fellowship program
advancementsa
Professional seminars and program
features (2015)a,d
A minimum of 3000 h of training
devoted to HEOR research-related
activities over 2 years
Established second-year postgraduate
HEOR fellowship site since 1994 in
conjunction with 4 first-year academic
fellowship sitesb
A training plan with developed goals
and objectives, documented prior
to initiation of fellowship
Informal Meet-and-Greet 1) Formalized fellowship Orientation
Meeting
2) At the Orientation Meeting, distri-
bution and completion of fellowship
checklist, and writing SMART Goals
Seminare
1) Professional Goal Setting via
StrengthsFinder 2.0 Seminar
2) Overview of current HEOR job
market and search preparation
programd,e
Instruction in HEOR-related topics 1) Methods Journal Club led by
ORMAc
2) Lunch-n-Learns
3) Involvement in TA-HEOR-related
activities
Accomplished by revamping,
restructuring, or initiating the
following:
1) Methods Journal Club led by fellowsc
2) Fellowship Forum
3) HEOR-focused lunch-n-Learns
4) Involvement in TA and ORMA
HEOR-related activities
5) Short courses at ISPOR and other
applicable venues
6) Online training courses
7) In-house, hands-on SAS basic
training
8) Introduction to complex survey
analysis
1) Developing Great Research
Questions Seminard
2) Writing Research Protocols/
Informed Consent Forms Seminard
3) Writing Manuscripts & Working
with External Medical Writers
Seminard
4) AMCP Dossier Development
Seminard
5) Working under FDAMA Section 114
Seminar
6) Developing Slide Decks for Oral
Presentations & Scientific Posters
Seminard
7) Business Presentation Skills Seminard
A team of preceptors and/or a primary
advisor
TA preceptors ORMA mentors
Ample resources for conducting research Methods Journal Clubc
Fellow’s User Manual 1) SharePoint online library
2) Fellowship Forum
3) HEOR lunch-n-Learns
4) Involvement in TA-HEOR-related
activities
284Suhetal./ResearchinSocialandAdministrativePharmacy11(2015)280–287
Cross-departmental HEOR fellowship program
activities and seminars
Professional and HEOR training seminars and
recurring fellowship activities that reflect ACCP-
ISPOR recommendations have been designed to
provide fellows with relevant, real-world experi-
ence and learning (Table 2 and Table 3). One of
the key opportunities for fellows that accent their
HEOR knowledge is the Methods Journal Club.
Prior to the program advancements, ORMA facil-
itators prepared materials for the bi-weekly event;
however, currently, fellows are asked to opera-
tionalize and structure the meeting, and to facili-
tate the learning and sharing of important
HEOR topics. The key seminars and professional
learning activities build accountability into the
HEOR Fellowship Program at Novartis, ensuring
that fellows are given ample opportunity to
develop the necessary level of expertise in
HEOR (Tables 2 and 3).
Other professional enhancement opportunities
An annual stipend enables fellows to accom-
plish professional enhancement and training from
a comprehensive list of courses, which are avail-
able at universities and various annual confer-
ences. An internal training in Statistical Analysis
Software (SAS), led by ORMA analysts and
programmers, is provided to familiarize fellows
with claims data, the logic of using claims data,
how to use SAS to create analytic files for
analysis, as well as basic analyzes and outputs.
Fellows are also encouraged to attend a course at
one of the many SAS Institute locations during
their first-year academic studies.
The importance of ‘professionalizing’ HEOR
fellowship programs
Fellowship programs often serve as internal
“feeder systems” for new and vacant positions
within an organization by providing talent from
an existing pool that can contribute immediately
to the needs within a company, MCO, or aca-
demic, hospital or clinical setting.1–4,8
Melillo and
colleagues9
reported that 93.2% of fellowship
graduates (n ¼ 233) accepted employment within
the industry field upon completing their training,
with 84.8% (n ¼ 212) specifically mentioning
employment in the pharmaceutical or biopharma-
ceutical industry. In this descriptive analysis of
postgraduate pharmacy fellowship programs,
other job settings included retail pharmacy
Systemicplanforevaluationoffellows,
preceptors,andprogram
Recurring1:1meetingswithfellowship
directorandTApreceptortoassess
fellows
Post-programfellowsurveyRotatingHEORgrouptoassistwith
annualprograme
ACCP,AmericanCollegeofClinicalPharmacy;ISPOR,InternationalSocietyforPharmacoeconomicsandOutcomesResearch;HEOR,healtheconomicsandoutcomes
research;hrs,hours;SMART,specific,measurable,attainable,realistic,andtimely;ORMA,OutcomesResearchMethods&Analytics;TA,therapeuticarea;AMCP,Acad-
emyofManagedCarePharmacy;FDAMA,FoodandDrugAdministrationModernizationAct;ISPOR,InternationalSocietyforPharmacoeconomicsandOutcomes
Research.
a
Descriptionsforeachactivity,developedmaterials,and/orconceptsmentionedarefoundsummarizedinthefollowingsections.
b
First-yearfellowshipsitesareScott&WhiteHealthPlan,Temple,TXandTheUniversityofTexasatAustin,Austin,TX;DepartmentofPharmaceuticalHealthSer-
vicesResearch,UniversityofMaryland,Baltimore,MD;JeffersonSchoolofPopulationHealthatThomasJeffersonUniversity,Philadelphia,PA,andRutgersUniversity,
NewBrunswick,NJ.
c
TheMethodsJournalClubwasformerlyledbytheORMAteamandisnowoperationalizedandrunbythefellows.
d
Tobeimplementedby2015.
e
Tailoredtoeachfellowbasedontheirprofessionalgoalsandcareerobjectivesandhandledina1:1basis.
285Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
(0.8%, n ¼ 2), MCOs (1.2%, n ¼ 3), hospital or
clinical pharmacy (1.6%, n ¼ 4), and academia
(3.2%, n ¼ 8). Similar results have occurred
from the graduates of the Novartis HEOR pro-
gram. While most continue a career path in the
pharmaceutical industry, others have ventured
into managed care, private vendors, and academia
as students. Of fellows who stayed within the in-
dustry, 74.6% (n ¼ 153) continued to work within
the same general department and 56.2% (n ¼ 131)
stayed with the same company.9
In subsequent
years (years 1–5), 90.5% of former fellows re-
mained within the industry (n ¼ 238), and
81.0% specifically stayed in pharmaceutical or
biopharmaceutical companies (n ¼ 213). Of those
who had remained within the industry at the time
of the survey, 74.0% (n ¼ 151) still worked in the
same department and 46.8% (n ¼ 111) had re-
mained at the sponsor company in which they
conducted their fellowship.9
Table 3
Timeline of HEOR fellowship program training seminar series and course choices
Month Seminars and courses
August Writing SMART Goalsa
September Developing Great Research Questionsa
October Writing Research Protocols/Informed Consent Formsa
November Professional Goal Setting via StrengthsFinder 2.0
January Writing Manuscripts & Working with External Medical Writersa
February AMCP Dossier Developmenta
March Working Under FDAMA Section 114
April Developing Slide Decks for Oral Presentations & Scientific Postersa
May Business Presentation Skillsa
External course option: ISPOR short courses at ISPOR Annual International Meeting
(May/June)
July External course option: Epidemiology courses at the University of Michigan, School
of Public Health
Other recommended external
educational resources
Statistical/data analytics courses at www.statistics.com
Short courses offered at the annual meetings of Academy Health (May/June) or
The Society for Medical Decision Making (October)
SMART, specific, measurable, attainable, realistic, and timely; AMCP, Academy of Managed Care Pharmacy; FDA-
MA, Food and Drug Administration Modernization Act; ISPOR, International Society for Pharmacoeconomics and
Outcomes Research; SAS, Statistical Analysis Software.
a
To be implemented by 2015.
Table 2
Recurring HEOR fellowship program Activities
Activity Description Frequency
Methods Journal Club Venue to facilitate the review of specific
research topics and their applicability
to HEOR
Meets bi-weekly to discuss the implications
of the studies in a real-world setting
Fellowship Forum Meetings to share project experiences and
allow for peer-to-peer interactions while
serving as a venue for professional
development and networking
Meets monthly to have collaborative
projects share time (e.g., abstracts,
posters, oral presentations) and fellows
peer-to-peer meeting time
HEOR Lunch-and-Learns Aspects correspond with topics presented
in the Methods Journal Club and
intradepartmental meetings
Meets quarterly to discuss current topics
in health care
Seminar series Provides discussion and professional
training designed to reflect and augment
fellows’ short- and long-term
professional experiences in the
pharmaceutical industry
Meets monthly (Table 3)
HEOR, health economics and outcomes research.
286 Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
Conclusion
The importance of HEOR in health care
decision-making cannot be underestimated.1–
6,9,10
HEOR is a relatively new field of research,
appearing in the medical literature in the
1980s.10
In HEOR, research concepts and study
designs are continuously being modified and
adapted based on other scientific research disci-
plines. By gaining HEOR expertise in an industry
fellowship program, fellows may acquire a
competitive advantage in the job market, making
HEOR knowledge and training a compelling skill
set for postgraduates. Entry-level knowledge and
skill expectations are being set higher each year,
and will require fellows to have a broader and
deeper HEOR experience. ISPOR-ACCP fellow-
ship program recommendations suggest that im-
provements be continuously implemented in all
HEOR fellowship programs, not only to help fel-
lows become more proficient HEOR profes-
sionals, but also to be better prepared for the
ongoing changes within the medical and pharma-
ceutical industry. In light of this, HEOR fellow-
ship programs should be periodically evaluated
and adapted as needed to the changing health
industries.
The assessment of and enhancements made to
the Novartis HEOR Fellowship Program offer
fellows a professional HEOR experience that is
aligned with the ACCP-ISPOR fellowship pro-
gram recommendations. This article hopes to
have highlighted the changes made to the
HEOR Fellowship Program at Novartis, in order
to share this experience with other industry-
sponsored HEOR fellowship programs.
Acknowledgments
Kangho Suh is a Novartis HEOR Fellow at
Novartis Pharmaceuticals Corporation. Susan
Gabriel and Steve Arcona are employees of
Novartis Pharmaceuticals Corporation. Michelle
Adams is an employee of Write All, Inc., who
received funding for her contributions. The proj-
ect was funded by Novartis Pharmaceuticals
Corporation. The HEOR Fellowship Program
would like to thank the affiliated preceptors and
academic program sites for their support and role
in educating and preparing the fellows for the
HEOR Fellowship Program at Novartis Pharma-
ceuticals Corporation. The ideas expressed in this
work are those of the authors and in no way are
intended to represent the position of Novartis or
any other organization.
References
1. Maio V, Lofland JH, Doan Q, et al. Organizational
structure and educational components of pharma-
coeconomic fellowship programs: a fellows’ perspec-
tive. Am J Pharm Educ 2003;67:105.
2. Kane-Gill S, Reddy P, Gupta SR, Bakst AW. Guide-
lines for pharmacoeconomic and outcomes research
fellowship training programs: joint guidelines from
the American College of Clinical Pharmacy and the
International Society of Pharmacoeconomics and
Outcomes Research. Pharmacotherapy 2008;28:
1552. http://dx.doi.org/10.1592/phco.28.12.1552.
3. Maio V, Girts TK, Lofland JH, Nash DB. Pharma-
coeconomic fellowships: the need for outcome mea-
sures. Pharmacoeconomics 2001;19:795–802.
4. Lee J, Lawrence BJ, Sullivan SD, et al. Guidelines for
pharmacoeconomic research fellowships. Pharmaco-
therapy 1999;19:1105–1109.
5. American Society of Hospital Pharmacists. Defini-
tions of pharmacy residencies and fellowships. Am
J Hosp Pharm 1987;44:1142–1144.
6. International Society of Pharmacoeconomics and
Outcomes Research (ISPOR). ISPOR directory of
fellowships in pharmacoeconomics, health eco-
nomics, outcomes research or related field of study.
Available at: http://www.ispor.org/education/fellow
ships_directory.asp. Accessed 20.06.14.
7. Academy of Managed Care Pharmacy (AMCP). Fel-
lowships. Available at: http://www.amcp.org/fellow
ships/. Accessed 23.06.14.
8. Larochelle PA, Giang DK, Silva MA, et al. Post-
PharmD industry fellowship opportunities and pro-
posed guidelines for uniformity. Am J Pharm Educ
2009;73:20.
9. Melillo S, Gangadharan A, Johnson H, Schleck P,
Steinberg M, Alexander JG. Postdoctoral pharmacy
industry fellowships: a descriptive analysis of pro-
grams and postgraduate positions. Am J Health
Syst Pharm 2012;69:63–68.
10. Rascati KL. Essentials of Pharmacoeconomics. 2nd
ed. Baltimore, MD: Lippincott Williams & Wilkins;
2014.
287Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287

More Related Content

What's hot

Linda Chia- Curriculum Vitae
Linda Chia- Curriculum VitaeLinda Chia- Curriculum Vitae
Linda Chia- Curriculum VitaeLinda Chia
 
Workshop 2: Benchmarking solutions showcase
Workshop 2: Benchmarking solutions showcaseWorkshop 2: Benchmarking solutions showcase
Workshop 2: Benchmarking solutions showcaseaaltunalboro
 
Cirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSION
Cirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSIONCirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSION
Cirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSIONKen Smith
 
Clinical Trial Recruitment & Retention
Clinical Trial Recruitment & RetentionClinical Trial Recruitment & Retention
Clinical Trial Recruitment & RetentionAsijit Sen
 
Development and Evaluation of clinical practice guideline (CPG) in psychiatry
Development and Evaluation of clinical practice guideline (CPG) in psychiatryDevelopment and Evaluation of clinical practice guideline (CPG) in psychiatry
Development and Evaluation of clinical practice guideline (CPG) in psychiatryDiptadhi Mukherjee
 
Clinical practice guidelines
Clinical practice guidelinesClinical practice guidelines
Clinical practice guidelinesabenedicto
 
The best of clinical pathway redesign - practical examples of delivering bene...
The best of clinical pathway redesign - practical examples of delivering bene...The best of clinical pathway redesign - practical examples of delivering bene...
The best of clinical pathway redesign - practical examples of delivering bene...NHS Improvement
 
DoctorsOrdersStudyJune2016
DoctorsOrdersStudyJune2016DoctorsOrdersStudyJune2016
DoctorsOrdersStudyJune2016Bryan Peters
 
CLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINES
CLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINESCLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINES
CLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINESMary Ann Adiong
 
2016 indicator reference guide pre-service training
2016 indicator reference guide   pre-service training2016 indicator reference guide   pre-service training
2016 indicator reference guide pre-service training#GOMOJO, INC.
 
Steps and impact of pharmaceutical care and clinical pharmacy development on ...
Steps and impact of pharmaceutical care and clinical pharmacy development on ...Steps and impact of pharmaceutical care and clinical pharmacy development on ...
Steps and impact of pharmaceutical care and clinical pharmacy development on ...M. Luisetto Pharm.D.Spec. Pharmacology
 
Drug Information Centre
Drug Information CentreDrug Information Centre
Drug Information Centrevarshawadnere
 
Research article psycological and behavior skills for pharmaceutical care pra...
Research article psycological and behavior skills for pharmaceutical care pra...Research article psycological and behavior skills for pharmaceutical care pra...
Research article psycological and behavior skills for pharmaceutical care pra...M. Luisetto Pharm.D.Spec. Pharmacology
 

What's hot (20)

Linda Chia- Curriculum Vitae
Linda Chia- Curriculum VitaeLinda Chia- Curriculum Vitae
Linda Chia- Curriculum Vitae
 
James Ayles English
James Ayles   EnglishJames Ayles   English
James Ayles English
 
Picker report final
Picker report finalPicker report final
Picker report final
 
PFA Applicant Town Hall Improving Methods for Conducting Patient-Centered Out...
PFA Applicant Town Hall Improving Methods for Conducting Patient-Centered Out...PFA Applicant Town Hall Improving Methods for Conducting Patient-Centered Out...
PFA Applicant Town Hall Improving Methods for Conducting Patient-Centered Out...
 
Workshop 2: Benchmarking solutions showcase
Workshop 2: Benchmarking solutions showcaseWorkshop 2: Benchmarking solutions showcase
Workshop 2: Benchmarking solutions showcase
 
Prateesh Varughese CV July 2015
Prateesh Varughese CV July 2015Prateesh Varughese CV July 2015
Prateesh Varughese CV July 2015
 
Cirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSION
Cirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSIONCirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSION
Cirriculum Vitae - Kenneth Smith 2016_PUBLIC VERSION
 
Clinical Trial Recruitment & Retention
Clinical Trial Recruitment & RetentionClinical Trial Recruitment & Retention
Clinical Trial Recruitment & Retention
 
Development and Evaluation of clinical practice guideline (CPG) in psychiatry
Development and Evaluation of clinical practice guideline (CPG) in psychiatryDevelopment and Evaluation of clinical practice guideline (CPG) in psychiatry
Development and Evaluation of clinical practice guideline (CPG) in psychiatry
 
Clinical practice guidelines
Clinical practice guidelinesClinical practice guidelines
Clinical practice guidelines
 
The best of clinical pathway redesign - practical examples of delivering bene...
The best of clinical pathway redesign - practical examples of delivering bene...The best of clinical pathway redesign - practical examples of delivering bene...
The best of clinical pathway redesign - practical examples of delivering bene...
 
DoctorsOrdersStudyJune2016
DoctorsOrdersStudyJune2016DoctorsOrdersStudyJune2016
DoctorsOrdersStudyJune2016
 
CLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINES
CLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINESCLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINES
CLINICAL PATHWAY and CLINICAL PRACTICE GUIDELINES
 
2016 indicator reference guide pre-service training
2016 indicator reference guide   pre-service training2016 indicator reference guide   pre-service training
2016 indicator reference guide pre-service training
 
Outcomes research
Outcomes researchOutcomes research
Outcomes research
 
Steps and impact of pharmaceutical care and clinical pharmacy development on ...
Steps and impact of pharmaceutical care and clinical pharmacy development on ...Steps and impact of pharmaceutical care and clinical pharmacy development on ...
Steps and impact of pharmaceutical care and clinical pharmacy development on ...
 
Drug Information Centre
Drug Information CentreDrug Information Centre
Drug Information Centre
 
58541541-GCP-GMP
58541541-GCP-GMP58541541-GCP-GMP
58541541-GCP-GMP
 
Research article psycological and behavior skills for pharmaceutical care pra...
Research article psycological and behavior skills for pharmaceutical care pra...Research article psycological and behavior skills for pharmaceutical care pra...
Research article psycological and behavior skills for pharmaceutical care pra...
 
CV TRAN CHUNG THUY
CV TRAN CHUNG THUYCV TRAN CHUNG THUY
CV TRAN CHUNG THUY
 

Similar to HEOR Fellowship Practices Reviewed

The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...Effective Health Care Program
 
Non medical prescribing - Bridget Crofts
Non medical prescribing - Bridget CroftsNon medical prescribing - Bridget Crofts
Non medical prescribing - Bridget CroftsSHUAHP
 
ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the
ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the
ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the mariuse18nolet
 
Community Pharmacy Practice.pptx
Community Pharmacy Practice.pptxCommunity Pharmacy Practice.pptx
Community Pharmacy Practice.pptxAjitKumar428826
 
Master of Public Health (MPH) Orientation20161Welc.docx
Master of Public Health (MPH) Orientation20161Welc.docxMaster of Public Health (MPH) Orientation20161Welc.docx
Master of Public Health (MPH) Orientation20161Welc.docxwkyra78
 
Article critique assignment course drugs and health (hlth 3
Article critique assignment course drugs and health (hlth 3Article critique assignment course drugs and health (hlth 3
Article critique assignment course drugs and health (hlth 3honey690131
 
NONPF - 1NURSE PRACTITIONER CORE COMPETENCIES April 201.docx
NONPF - 1NURSE PRACTITIONER CORE COMPETENCIES  April 201.docxNONPF - 1NURSE PRACTITIONER CORE COMPETENCIES  April 201.docx
NONPF - 1NURSE PRACTITIONER CORE COMPETENCIES April 201.docxkendalfarrier
 
Assessment Policy Proposal Online Nursing Essays.docx
Assessment Policy Proposal Online Nursing Essays.docxAssessment Policy Proposal Online Nursing Essays.docx
Assessment Policy Proposal Online Nursing Essays.docxbkbk37
 
Monitoring National Health Programs-A New Approach.pdf
Monitoring National Health Programs-A New Approach.pdfMonitoring National Health Programs-A New Approach.pdf
Monitoring National Health Programs-A New Approach.pdfRPal5
 
The Nurse Leader as Knowledge WorkerHWalden Univer.docx
The Nurse Leader as Knowledge WorkerHWalden Univer.docxThe Nurse Leader as Knowledge WorkerHWalden Univer.docx
The Nurse Leader as Knowledge WorkerHWalden Univer.docxarnoldmeredith47041
 
Recommendations on Evidence Needed to Support Measurement Equivalence between...
Recommendations on Evidence Needed to Support Measurement Equivalence between...Recommendations on Evidence Needed to Support Measurement Equivalence between...
Recommendations on Evidence Needed to Support Measurement Equivalence between...CRF Health
 
Students are required to maintain weekly reflective narratives throu
Students are required to maintain weekly reflective narratives throuStudents are required to maintain weekly reflective narratives throu
Students are required to maintain weekly reflective narratives throublazelaj2
 

Similar to HEOR Fellowship Practices Reviewed (20)

GRIND_DrPHProgramStrategiProject_VFinal.docx
GRIND_DrPHProgramStrategiProject_VFinal.docxGRIND_DrPHProgramStrategiProject_VFinal.docx
GRIND_DrPHProgramStrategiProject_VFinal.docx
 
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
 
Non medical prescribing - Bridget Crofts
Non medical prescribing - Bridget CroftsNon medical prescribing - Bridget Crofts
Non medical prescribing - Bridget Crofts
 
ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the
ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the
ITS IMPORTANT TO MEET THE COMPETENCES (Thats how they evaluate the
 
Community Pharmacy Practice.pptx
Community Pharmacy Practice.pptxCommunity Pharmacy Practice.pptx
Community Pharmacy Practice.pptx
 
The Six-Month Internship Training Program for Medical Laboratory Science Ed...
The Six-Month Internship Training  Program for Medical Laboratory Science  Ed...The Six-Month Internship Training  Program for Medical Laboratory Science  Ed...
The Six-Month Internship Training Program for Medical Laboratory Science Ed...
 
Master of Public Health (MPH) Orientation20161Welc.docx
Master of Public Health (MPH) Orientation20161Welc.docxMaster of Public Health (MPH) Orientation20161Welc.docx
Master of Public Health (MPH) Orientation20161Welc.docx
 
Outcomes of Curricular Enhancement in a Health Program: LPU CAMP Experience
Outcomes of Curricular  Enhancement in a Health Program:   LPU CAMP Experience Outcomes of Curricular  Enhancement in a Health Program:   LPU CAMP Experience
Outcomes of Curricular Enhancement in a Health Program: LPU CAMP Experience
 
Article critique assignment course drugs and health (hlth 3
Article critique assignment course drugs and health (hlth 3Article critique assignment course drugs and health (hlth 3
Article critique assignment course drugs and health (hlth 3
 
NONPF - 1NURSE PRACTITIONER CORE COMPETENCIES April 201.docx
NONPF - 1NURSE PRACTITIONER CORE COMPETENCIES  April 201.docxNONPF - 1NURSE PRACTITIONER CORE COMPETENCIES  April 201.docx
NONPF - 1NURSE PRACTITIONER CORE COMPETENCIES April 201.docx
 
5944966.ppt
5944966.ppt5944966.ppt
5944966.ppt
 
Assessment Policy Proposal Online Nursing Essays.docx
Assessment Policy Proposal Online Nursing Essays.docxAssessment Policy Proposal Online Nursing Essays.docx
Assessment Policy Proposal Online Nursing Essays.docx
 
Monitoring National Health Programs-A New Approach.pdf
Monitoring National Health Programs-A New Approach.pdfMonitoring National Health Programs-A New Approach.pdf
Monitoring National Health Programs-A New Approach.pdf
 
OSCE Poster_Final
OSCE Poster_FinalOSCE Poster_Final
OSCE Poster_Final
 
Psz guidelines for pharmacy training programs accreditation process 1
Psz guidelines for pharmacy training programs accreditation process 1Psz guidelines for pharmacy training programs accreditation process 1
Psz guidelines for pharmacy training programs accreditation process 1
 
Psz guidelines for pharmacy training programs accreditation process 1
Psz guidelines for pharmacy training programs accreditation process 1Psz guidelines for pharmacy training programs accreditation process 1
Psz guidelines for pharmacy training programs accreditation process 1
 
2010 psz guidelines for pharmacy training programs accreditation process 1
2010   psz guidelines for pharmacy training programs accreditation process 12010   psz guidelines for pharmacy training programs accreditation process 1
2010 psz guidelines for pharmacy training programs accreditation process 1
 
The Nurse Leader as Knowledge WorkerHWalden Univer.docx
The Nurse Leader as Knowledge WorkerHWalden Univer.docxThe Nurse Leader as Knowledge WorkerHWalden Univer.docx
The Nurse Leader as Knowledge WorkerHWalden Univer.docx
 
Recommendations on Evidence Needed to Support Measurement Equivalence between...
Recommendations on Evidence Needed to Support Measurement Equivalence between...Recommendations on Evidence Needed to Support Measurement Equivalence between...
Recommendations on Evidence Needed to Support Measurement Equivalence between...
 
Students are required to maintain weekly reflective narratives throu
Students are required to maintain weekly reflective narratives throuStudents are required to maintain weekly reflective narratives throu
Students are required to maintain weekly reflective narratives throu
 

HEOR Fellowship Practices Reviewed

  • 1. Commentary Health economics and outcomes research fellowship practices reviewed Kangho Suh, Pharm.D., M.S.a , Susan Gabriel, M.Sca , Michelle A. Adams, B.S.J., M.A.b , Steve Arcona, PhD.a,* a Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA b Write All, Inc., Sonoma, CA, USA Summary The guidelines for health economics and outcomes research (HEOR) fellowship training programs devised by the American College of Clinical Pharmacy (ACCP) and the International Society of Pharmacoeco- nomics and Outcomes Research (ISPOR) suggest that continuous improvements are made to ensure that postgraduate training through didactic and professional experiences prepare fellows for HEOR research careers. The HEOR Fellowship Program at Novartis Pharmaceuticals Corporation was standardized to enhance the fellows’ HEOR research understanding and align professional skill sets with the ACCP-ISPOR Fellowship Program Guidelines. Based on feedback from an internal task force comprised of HEOR employees and current and former fellows, the HEOR Fellowship Program was normatively and qualitatively assessed to evaluate the current curricular program. Fellowship program activities were instituted to ensure that the suggested minimum level requirements established by the guidelines were being met. Research opportunities enabling fellows to work hand-in-hand with other fellows and HEOR professionals were emphasized. Curricular enhancements in research methodology and professional training and development, and materials for a structured journal club focusing on specific methodological and HEOR research topics were developed. A seminar series (e.g., creating SMART Goals, StrengthsFinder 2.0) and professional courses (e.g., ISPOR short courses, statistics.com) were included to enhance the fellows’ short- and long-term professional experience. Additional program attributes include an online reference li- brary developed to enrich the current research facilities and a Statistical Analysis Software training program. Continuously assessing and updating HEOR fellowship programs keeps programs up-to-date in the latest HEOR concepts and approaches used to evaluate health care, both professionally and educationally. Ó 2015 Elsevier Inc. All rights reserved. Keywords: Pharmacoeconomics; Health economics; Outcomes research; Fellowship; Program curriculum; Guidelines; Improvements Previous content presentation: The content of this editorial was presented at the Academy of Managed Care Pharmacy (AMCP) 26th Annual Meeting, April 1–4, 2014, Tampa, FL. * Corresponding author. Outcomes Research Methods & Analytics, US Health Economics & Outcomes Research, Novartis Pharmaceuticals Corporation, One Health Plaza, East Hanover, NJ 07936-1080, USA. Tel.: þ1 862 778 5716, þ1 862 246 0615 (mobile); fax: þ1 973 781 8265. E-mail address: steve.arcona@novartis.com (S. Arcona). 1551-7411/$ - see front matter Ó 2015 Elsevier Inc. All rights reserved. http://dx.doi.org/10.1016/j.sapharm.2014.07.006 Research in Social and Administrative Pharmacy 11 (2015) 280–287
  • 2. The need for health economics professionals In an era of cost-conscious health care, a vital need exists for experts and professionals who are skilled in the analysis of health economics data and adept at interpreting and using data for health care decision-making.1 Health economics and outcomes research (HEOR) is utilized by a diverse group of individuals (i.e., pharmacists, physicians, economists, academicians, hospital administrators) from numerous health care set- tings, each playing an important role in opti- mizing patient care.2 HEOR professionals use evidence about the efficacy and effectiveness of health care interventions to inform medical decision-makers. This is accomplished through the use of various methods including economic modeling and comparative effectiveness research (CER). The purpose of these efforts is to gain a better understanding of the value of these inter- ventions. Reflective of these health care trends and needs, the demand for HEOR fellowship pro- grams and expertise has increased significantly over the past decade.1–3 Industry-sponsored HEOR fellowship programs Growing from a program initiated at Glaxo Wellcome, Inc. in 1989, HEOR fellowship programs are now found in a diverse range of fields, including pharmaceutical, academia, and managed care organizations (MCOs), with phar- maceutical companies as a prominent locale for postgraduate HEOR education and training.2–5 HEOR fellowship programs provide training and hands-on experience in a broad-range of health economics, outcomes research, and CER. These programs are structured to allow the fellow to gain proficiency in the field of HEOR, and CER as conducted in academic, MCOs, and hos- pital, health policy, and pharmaceutical industry settings. Common HEOR programs feature organizational characteristics such as a salaried, two-year program conducted in academic and pharmaceutical site locations and educational program features including professional and research skills taught and experienced in economic analysis and methodologies, research design and methods, software application, data management, project management work, and exposure to HEOR design and analysis.1,6,7 To assist in the refinement and assessment of HEOR fellowship programs, the American Col- lege of Clinical Pharmacy (ACCP) developed its first set of guidelines for HEOR fellowship programs in 1999.2 In ensuing years, studies were undertaken to examine the structure, educa- tional objectives, and effectiveness of existing HEOR fellowship programs from the perspective of current and former fellows and preceptors.2 Among the findings, studies reported significant variations in preceptor qualifications and the amount of time devoted to HEOR experiential activities and didactic coursework.1,2 One study reported results from a Web-based survey of fel- lows who had completed an HEOR fellowship be- tween 1999 and 2001. Researchers reported on the overall limitations found in HEOR fellowship programs throughout the United States,1 and their findings support the need for refinement of these programs to include specific curricular suggestions ensuring program effectiveness (i.e., didactic coursework, outcome assessment).1,2 ACCP-ISPOR recommended HEOR fellowship guidelines In 2008, ACCP collaborated with the Interna- tional Society for Pharmacoeconomics and Out- comes Research (ISPOR) to revise and refine its guidelines for HEOR fellowship programs.2 Rec- ommendations from ACCP and ISPOR members, as well as a review of the existing ACCP guidelines for clinical research training programs, formed the basis for the revised guidelines. Overarching areas of the ACCP Guidelines delineated in the 2008 published guidelines were related to the require- ments of any HEOR fellowship program and what the fellow should be experiencing profes- sionally during a fellowship. Per the ACCP-ISPOR recommendations, HEOR fellowship programs should generally include a minimum of 3000 hours of training (R80% of fellow’s time) devoted to HEOR research-related activities over at least 2 years, a training plan with goals and objectives developed and documented prior to initiation of fellowship, formal instruction in HEOR-related topics, assignment to a team of preceptors and/or a primary advisor, exposure to ample resources for conducting research, and a standardized plan for the evaluation of fellows, preceptors, and pro- grams upon fellowship program completion.2 Fellows should participate in at least one, but preferably multiple scholarly projects (e.g., litera- ture reviews, dossier development, prospective and retrospective studies, economic modeling). Through a combination of didactic and structured supervised experiences, fellows should also 281Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
  • 3. actively partake in all aspects of the research process, learn multiple methods of measuring clinical outcomes, and gain proficiency in various methods of measuring economic outcomes and patient-reported outcomes (PROs). Finally, through the collection of experiences offered in a fellowship program, fellows should develop an understanding of the multifaceted aspects of the health care delivery system, enhance their current level of oral and written communication skills, and regularly contribute and be a part of journal clubs, research workshops, and/or seminars.2 The development of Novartis’ HEOR fellowship program Since 1994, the HEOR Fellowship Program at Novartis Pharmaceuticals Corporation has had relationships with many academic sites.c During their first year of study, fellows receive didactic academic training in HEOR-related areas; in the second year, fellows gain professional and practical research experience from participation in the HEOR Fellowship Program at Novartis Pharmaceuticals Corporation located in East Hanover, NJ. Novartis’ HEOR fellowship program characteristics The HEOR Fellowship Program at Novartis is operated by the US HEOR department and coordinated by the Outcomes Research Methods & Analytics (ORMA) group within US HEOR. Training and hands-on experience are provided in a broad range of HEOR and CER topics to better prepare fellows for a career in the pharmaceutical and biopharmaceutical industries. The program’s structure enables fellows to apply competencies gained in HEOR and simulate the responsibilities and activities of full-time HEOR industry employees. Fellows are assigned to a therapeutic area (TA) specifically chosen to foster and enhance their professional skills and interests. Within a fellow’s assigned TA, professional experience is cultivated and developed in relation to HEOR knowledge (e.g., types of research studies, economic modeling), project management skills, and cross- functional medical and business exposure. Throughout their year, they gain experience from the beginning stages of HEOR projects (e.g., literature review, protocol writing) to the publication processes, such as developing and submitting abstracts and manuscripts. Fellows work with an array of experts in addition to their primary preceptor in order to enable a cross- functional team experience. The enhancement of Novartis’ HEOR fellowship program In an effort to align the HEOR Fellowship Program at Novartis with the ACCP-ISPOR– recommended fellowship guidelines, an internal task force comprised of HEOR employees was assembled to assess the existing HEOR Fellow- ship Program in a normative and qualitative manner.d The primary objective of the task force was to ensure that the fellowship program was fully aligned with ACCP-ISPOR guidelines set for HEOR fellowship programs. An additional purpose for enhancing the HEOR Fellowship Program at Novartis was to standardize the second-year postgraduate professional experience. Structural and curricular assessment and advancements Current and past fellows were interviewed and surveyed to determine the differences in their fellowship experiences. The HEOR Fellowship Program was reviewed against the ACCP- ISPOR guidelines to identify any potential op- portunities to strengthen the program. The task force identified areas for structural and curricular enhancements, and developmental plans were subsequently operationalized and applied. After assessing the interviews given by previous fellows, an inconsistency in fellows having different types of project experience was noted. This was not due to the HEOR Fellowship Program in general, but mainly due to project experience being dependent on which TA a fellow was placed into and where medications in that TA were in the drug life cycle. c Currently, the following schools have affiliations primarily in the first-year postgraduate program: The Health Out- comes and Pharmacy Practice Division, The University of Texas at Austin, Austin, TX, in conjunction with Scott & White Health Plan, Temple, TX; The Department of Pharmaceutical Health Services Research, University of Maryland, Baltimore, MD; Jefferson School of Population Health at Thomas Jefferson University, Philadelphia, PA; and The School of Pharmacy, Rutgers University, New Brunswick, NJ. d The internal task force was comprised of a small group of full-time HEOR employees, a senior fellow, and an external consultant. 282 Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
  • 4. As shown in Table 1, basic professional experi- ence and skills were enhanced and corresponded to the suggested minimum level of research and managerial project work established by the ACCP-ISPOR joint guidelines.2 As indicated in Table 1, certain professional seminars and pro- gram features directly related to the daily activities of the fellows are currently being implemented and will be completely integrated into the HEOR Fellowship Program by July 2015. For example, the fellows are expected to write a research proto- col and submit it for internal review by the end of the HEOR Fellowship Program. Additionally, the HEOR Fellowship Program directors and precep- tors support continual improvements implemented as needed and wherever possible. Descriptions for each activity, developed materials, and/or con- cepts mentioned will be summarized in the sections that follow. HEOR fellowship program advancements Many of the overarching curricular aspects of the formerly structured HEOR Fellowship Pro- gram at Novartis were in place prior to the program assessment step; however, formalizing and adjusting certain activities and materials established a more structured HEOR Fellowship Program. This section details the types of activ- ities and materials implemented and presents the current status and structure of the HEOR Fellow- ship Program at Novartis. Orientation activities and materials The HEOR Fellowship Program at Novartis commences with an Orientation Meeting. Orien- tation activities and materials are designed to familiarize fellows with Novartis and its inter- nal structure and are distributed during the Orientation Meeting. At this time, fellows are introduced to the HEOR departmental structures, other new fellows, their HEOR counterparts, and the specifics related to their HEOR-ORMA experience. A valuable tool for fellows that is distributed is the HEOR Fellow User’s Manual that includes all program materials to be used throughout the program. A Fellowship Checklist is among the important documents provided to fellows, serving as a key roadmap for tasks and to assist in guiding fellows through the upcoming year’s events (i.e., key professional milestones and monthly tasks to complete). An administrative topic covered during the Orientation Meeting is reimbursement procedures related to each academic site as well as those of Novartis. Methods-based and HEOR TA department projects Because the HEOR Fellowship Program at Novartis is coordinated by ORMA, fellows have a unique opportunity to work with professional methods-focused researchers in the ORMA group and HEOR professionals in the assigned TA department. Within US HEOR, the ORMA group serves as an internal data analytics consul- ting team. Some of the fellowship work completed by the fellows is supported and guided by ORMA. This professional experience with ORMA helps to bridge any methodological knowledge gaps and serves to augment the fellows’ professional HEOR experience. Methods-based HEOR projects with ORMA With the guidance and supervision of the ORMA group, HEOR project assignments expose fellows to a variety of methodologies, operational documents, and other HEOR-related materials (i.e., early products vs in-line projects, methods- only projects and publications). Some of these projects include the development of abstracts, posters, and/or oral presentations to be presented at annual congresses, the publication-planning experience, anddmore specificallydmanuscript development. If possible, ORMA-specific projects assigned to fellows correspond with the fellow’s designated TA and are tailored to the needs of the TA and each fellow. HEOR projects with assigned TA Within the fellow’s assigned TA, professional experience is fostered and enhanced in terms of HEOR knowledge, project management skills, and cross-functional medical and business expo- sure. HEOR exposures gained during the fellowship-assigned TA experience include, but are not limited to: literature reviews, the publica- tion process (e.g., the development of abstracts, posters and/or oral presentations, and manu- scripts), retrospective studies (e.g., claims data- base analyzes and medical record reviews), and various types of economic modeling. Actual experiences may vary based on the product line and/or TA. These capabilities correspond to the suggested minimum level of research and mana- gerial project work established by ACCP-ISPOR Guidelines.2 283Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
  • 5. Table 1 ACCP-ISPOR Fellowship requirements, established practices, and advancements in the HEOR fellowship program ACCP-ISPOR fellowship requirements2 HEOR fellowship program established practices HEOR fellowship program advancementsa Professional seminars and program features (2015)a,d A minimum of 3000 h of training devoted to HEOR research-related activities over 2 years Established second-year postgraduate HEOR fellowship site since 1994 in conjunction with 4 first-year academic fellowship sitesb A training plan with developed goals and objectives, documented prior to initiation of fellowship Informal Meet-and-Greet 1) Formalized fellowship Orientation Meeting 2) At the Orientation Meeting, distri- bution and completion of fellowship checklist, and writing SMART Goals Seminare 1) Professional Goal Setting via StrengthsFinder 2.0 Seminar 2) Overview of current HEOR job market and search preparation programd,e Instruction in HEOR-related topics 1) Methods Journal Club led by ORMAc 2) Lunch-n-Learns 3) Involvement in TA-HEOR-related activities Accomplished by revamping, restructuring, or initiating the following: 1) Methods Journal Club led by fellowsc 2) Fellowship Forum 3) HEOR-focused lunch-n-Learns 4) Involvement in TA and ORMA HEOR-related activities 5) Short courses at ISPOR and other applicable venues 6) Online training courses 7) In-house, hands-on SAS basic training 8) Introduction to complex survey analysis 1) Developing Great Research Questions Seminard 2) Writing Research Protocols/ Informed Consent Forms Seminard 3) Writing Manuscripts & Working with External Medical Writers Seminard 4) AMCP Dossier Development Seminard 5) Working under FDAMA Section 114 Seminar 6) Developing Slide Decks for Oral Presentations & Scientific Posters Seminard 7) Business Presentation Skills Seminard A team of preceptors and/or a primary advisor TA preceptors ORMA mentors Ample resources for conducting research Methods Journal Clubc Fellow’s User Manual 1) SharePoint online library 2) Fellowship Forum 3) HEOR lunch-n-Learns 4) Involvement in TA-HEOR-related activities 284Suhetal./ResearchinSocialandAdministrativePharmacy11(2015)280–287
  • 6. Cross-departmental HEOR fellowship program activities and seminars Professional and HEOR training seminars and recurring fellowship activities that reflect ACCP- ISPOR recommendations have been designed to provide fellows with relevant, real-world experi- ence and learning (Table 2 and Table 3). One of the key opportunities for fellows that accent their HEOR knowledge is the Methods Journal Club. Prior to the program advancements, ORMA facil- itators prepared materials for the bi-weekly event; however, currently, fellows are asked to opera- tionalize and structure the meeting, and to facili- tate the learning and sharing of important HEOR topics. The key seminars and professional learning activities build accountability into the HEOR Fellowship Program at Novartis, ensuring that fellows are given ample opportunity to develop the necessary level of expertise in HEOR (Tables 2 and 3). Other professional enhancement opportunities An annual stipend enables fellows to accom- plish professional enhancement and training from a comprehensive list of courses, which are avail- able at universities and various annual confer- ences. An internal training in Statistical Analysis Software (SAS), led by ORMA analysts and programmers, is provided to familiarize fellows with claims data, the logic of using claims data, how to use SAS to create analytic files for analysis, as well as basic analyzes and outputs. Fellows are also encouraged to attend a course at one of the many SAS Institute locations during their first-year academic studies. The importance of ‘professionalizing’ HEOR fellowship programs Fellowship programs often serve as internal “feeder systems” for new and vacant positions within an organization by providing talent from an existing pool that can contribute immediately to the needs within a company, MCO, or aca- demic, hospital or clinical setting.1–4,8 Melillo and colleagues9 reported that 93.2% of fellowship graduates (n ¼ 233) accepted employment within the industry field upon completing their training, with 84.8% (n ¼ 212) specifically mentioning employment in the pharmaceutical or biopharma- ceutical industry. In this descriptive analysis of postgraduate pharmacy fellowship programs, other job settings included retail pharmacy Systemicplanforevaluationoffellows, preceptors,andprogram Recurring1:1meetingswithfellowship directorandTApreceptortoassess fellows Post-programfellowsurveyRotatingHEORgrouptoassistwith annualprograme ACCP,AmericanCollegeofClinicalPharmacy;ISPOR,InternationalSocietyforPharmacoeconomicsandOutcomesResearch;HEOR,healtheconomicsandoutcomes research;hrs,hours;SMART,specific,measurable,attainable,realistic,andtimely;ORMA,OutcomesResearchMethods&Analytics;TA,therapeuticarea;AMCP,Acad- emyofManagedCarePharmacy;FDAMA,FoodandDrugAdministrationModernizationAct;ISPOR,InternationalSocietyforPharmacoeconomicsandOutcomes Research. a Descriptionsforeachactivity,developedmaterials,and/orconceptsmentionedarefoundsummarizedinthefollowingsections. b First-yearfellowshipsitesareScott&WhiteHealthPlan,Temple,TXandTheUniversityofTexasatAustin,Austin,TX;DepartmentofPharmaceuticalHealthSer- vicesResearch,UniversityofMaryland,Baltimore,MD;JeffersonSchoolofPopulationHealthatThomasJeffersonUniversity,Philadelphia,PA,andRutgersUniversity, NewBrunswick,NJ. c TheMethodsJournalClubwasformerlyledbytheORMAteamandisnowoperationalizedandrunbythefellows. d Tobeimplementedby2015. e Tailoredtoeachfellowbasedontheirprofessionalgoalsandcareerobjectivesandhandledina1:1basis. 285Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
  • 7. (0.8%, n ¼ 2), MCOs (1.2%, n ¼ 3), hospital or clinical pharmacy (1.6%, n ¼ 4), and academia (3.2%, n ¼ 8). Similar results have occurred from the graduates of the Novartis HEOR pro- gram. While most continue a career path in the pharmaceutical industry, others have ventured into managed care, private vendors, and academia as students. Of fellows who stayed within the in- dustry, 74.6% (n ¼ 153) continued to work within the same general department and 56.2% (n ¼ 131) stayed with the same company.9 In subsequent years (years 1–5), 90.5% of former fellows re- mained within the industry (n ¼ 238), and 81.0% specifically stayed in pharmaceutical or biopharmaceutical companies (n ¼ 213). Of those who had remained within the industry at the time of the survey, 74.0% (n ¼ 151) still worked in the same department and 46.8% (n ¼ 111) had re- mained at the sponsor company in which they conducted their fellowship.9 Table 3 Timeline of HEOR fellowship program training seminar series and course choices Month Seminars and courses August Writing SMART Goalsa September Developing Great Research Questionsa October Writing Research Protocols/Informed Consent Formsa November Professional Goal Setting via StrengthsFinder 2.0 January Writing Manuscripts & Working with External Medical Writersa February AMCP Dossier Developmenta March Working Under FDAMA Section 114 April Developing Slide Decks for Oral Presentations & Scientific Postersa May Business Presentation Skillsa External course option: ISPOR short courses at ISPOR Annual International Meeting (May/June) July External course option: Epidemiology courses at the University of Michigan, School of Public Health Other recommended external educational resources Statistical/data analytics courses at www.statistics.com Short courses offered at the annual meetings of Academy Health (May/June) or The Society for Medical Decision Making (October) SMART, specific, measurable, attainable, realistic, and timely; AMCP, Academy of Managed Care Pharmacy; FDA- MA, Food and Drug Administration Modernization Act; ISPOR, International Society for Pharmacoeconomics and Outcomes Research; SAS, Statistical Analysis Software. a To be implemented by 2015. Table 2 Recurring HEOR fellowship program Activities Activity Description Frequency Methods Journal Club Venue to facilitate the review of specific research topics and their applicability to HEOR Meets bi-weekly to discuss the implications of the studies in a real-world setting Fellowship Forum Meetings to share project experiences and allow for peer-to-peer interactions while serving as a venue for professional development and networking Meets monthly to have collaborative projects share time (e.g., abstracts, posters, oral presentations) and fellows peer-to-peer meeting time HEOR Lunch-and-Learns Aspects correspond with topics presented in the Methods Journal Club and intradepartmental meetings Meets quarterly to discuss current topics in health care Seminar series Provides discussion and professional training designed to reflect and augment fellows’ short- and long-term professional experiences in the pharmaceutical industry Meets monthly (Table 3) HEOR, health economics and outcomes research. 286 Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287
  • 8. Conclusion The importance of HEOR in health care decision-making cannot be underestimated.1– 6,9,10 HEOR is a relatively new field of research, appearing in the medical literature in the 1980s.10 In HEOR, research concepts and study designs are continuously being modified and adapted based on other scientific research disci- plines. By gaining HEOR expertise in an industry fellowship program, fellows may acquire a competitive advantage in the job market, making HEOR knowledge and training a compelling skill set for postgraduates. Entry-level knowledge and skill expectations are being set higher each year, and will require fellows to have a broader and deeper HEOR experience. ISPOR-ACCP fellow- ship program recommendations suggest that im- provements be continuously implemented in all HEOR fellowship programs, not only to help fel- lows become more proficient HEOR profes- sionals, but also to be better prepared for the ongoing changes within the medical and pharma- ceutical industry. In light of this, HEOR fellow- ship programs should be periodically evaluated and adapted as needed to the changing health industries. The assessment of and enhancements made to the Novartis HEOR Fellowship Program offer fellows a professional HEOR experience that is aligned with the ACCP-ISPOR fellowship pro- gram recommendations. This article hopes to have highlighted the changes made to the HEOR Fellowship Program at Novartis, in order to share this experience with other industry- sponsored HEOR fellowship programs. Acknowledgments Kangho Suh is a Novartis HEOR Fellow at Novartis Pharmaceuticals Corporation. Susan Gabriel and Steve Arcona are employees of Novartis Pharmaceuticals Corporation. Michelle Adams is an employee of Write All, Inc., who received funding for her contributions. The proj- ect was funded by Novartis Pharmaceuticals Corporation. The HEOR Fellowship Program would like to thank the affiliated preceptors and academic program sites for their support and role in educating and preparing the fellows for the HEOR Fellowship Program at Novartis Pharma- ceuticals Corporation. The ideas expressed in this work are those of the authors and in no way are intended to represent the position of Novartis or any other organization. References 1. Maio V, Lofland JH, Doan Q, et al. Organizational structure and educational components of pharma- coeconomic fellowship programs: a fellows’ perspec- tive. Am J Pharm Educ 2003;67:105. 2. Kane-Gill S, Reddy P, Gupta SR, Bakst AW. Guide- lines for pharmacoeconomic and outcomes research fellowship training programs: joint guidelines from the American College of Clinical Pharmacy and the International Society of Pharmacoeconomics and Outcomes Research. Pharmacotherapy 2008;28: 1552. http://dx.doi.org/10.1592/phco.28.12.1552. 3. Maio V, Girts TK, Lofland JH, Nash DB. Pharma- coeconomic fellowships: the need for outcome mea- sures. Pharmacoeconomics 2001;19:795–802. 4. Lee J, Lawrence BJ, Sullivan SD, et al. Guidelines for pharmacoeconomic research fellowships. Pharmaco- therapy 1999;19:1105–1109. 5. American Society of Hospital Pharmacists. Defini- tions of pharmacy residencies and fellowships. Am J Hosp Pharm 1987;44:1142–1144. 6. International Society of Pharmacoeconomics and Outcomes Research (ISPOR). ISPOR directory of fellowships in pharmacoeconomics, health eco- nomics, outcomes research or related field of study. Available at: http://www.ispor.org/education/fellow ships_directory.asp. Accessed 20.06.14. 7. Academy of Managed Care Pharmacy (AMCP). Fel- lowships. Available at: http://www.amcp.org/fellow ships/. Accessed 23.06.14. 8. Larochelle PA, Giang DK, Silva MA, et al. Post- PharmD industry fellowship opportunities and pro- posed guidelines for uniformity. Am J Pharm Educ 2009;73:20. 9. Melillo S, Gangadharan A, Johnson H, Schleck P, Steinberg M, Alexander JG. Postdoctoral pharmacy industry fellowships: a descriptive analysis of pro- grams and postgraduate positions. Am J Health Syst Pharm 2012;69:63–68. 10. Rascati KL. Essentials of Pharmacoeconomics. 2nd ed. Baltimore, MD: Lippincott Williams & Wilkins; 2014. 287Suh et al. / Research in Social and Administrative Pharmacy 11 (2015) 280–287