Part VIII - Villa-Kaime presentation

262 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
262
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • $3 Billion managed to date
    $365 Million in FY04
  • Additional information about the Ovarian Cancer Research Program and other CDMRP Programs is available on our website. Program Announcements for upcoming CDMRP Programs will be available on the website when they are released.
    Abstracts of funded proposals are available on the website. This year’s ovarian cancer research abstracts will be posted there after contracts with the PI’s institutions have been finalized.
    A workbook on consumer participation in proposal review is also available.
  • Part VIII - Villa-Kaime presentation

    1. 1. 1 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Congressionally Directed Medical Research Programs (CDMRP) Presented to National Institutes of Health Peer Review Advisory Committee Presented by Janet Harris, Ph.D., RN Colonel, US Army Nurse Corps Director, CDMRP 27 August 2007 US Army Medical Research and Materiel Command (USAMRMC)
    2. 2. 2 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command CDMRP History 1992 Grassroots advocacy heightened political awareness of breast cancer 1993 Congress appropriated $210M to the Department of Defense budget for breast cancer research to be managed by the CDMRP after consultation with the Institute of Medicine (IOM) (re-reviewed the program in 1997) Additional research programs: 1996 Neurofibromatosis 1997 Prostate Cancer and Ovarian Cancer 1999 Peer Reviewed Medical Research Program 2002 Prion, Tuberous Sclerosis Complex, and Chronic Myelogenous Leukemia 2006 Gulf War Veterans' Illnesses 2007 Autism Spectrum Disorder and Post-Traumatic Stress Disorder/Traumatic Brain Injury
    3. 3. 3 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Funds added to the DOD budget by Congress [generally as DHP(RDT&E)]* Funds obligated for entire research project at time of award Respond to targeted guidance from Congress Two-tier review of proposals – IOM Model Consumer advocate participation throughout process Vision adapted yearly to facilitate rapid change and address research gaps Highly flexible management processes CDMRP Unique Features *Defense Health Program (Research Development, Test and Evaluation)
    4. 4. 4 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command CDMRP Funding History 0 100 200 300 400 500 600 700 FY92 FY95 FY97 FY99 FY01 FY03 FY05 FY07 PTSD/TBI Gulf War Illness Breast Cancer Prostate Cancer Neurofibromatosis Ovarian Cancer Peer Reviewed Medical Amyotrophic Lateral Sclerosis Autism Chronic Myelogenous Leukemia Tuberous Sclerosis Myeloproliferative Disorders Cooperative DOD/VA Medical National Prion Osteoporosis Defense Women's Health Institutionally Based Programs Millions($) Research Program
    5. 5. 5 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command CDMRP Program Process Congressional Appropriation Vision Setting Program Announcement Release Proposal Receipt PeerPeer ReviewReview Programmatic Review USAMRMC Director Approval Negotiation s Award Performance Integration PanelReceipt of Funds Science evaluation Budget evaluation Portfolio balance Programmatic relevance Budget evaluation
    6. 6. 6 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command CDMRP Program Process New Each Year, No Resubmissions Congressional Appropriation Vision Setting Program Announcement Release Proposal Receipt PeerPeer ReviewReview Programmatic Review USAMRMC Director Approval Negotiation s Award Performance Integration PanelReceipt of Funds Science evaluation Budget evaluation Portfolio balance Programmatic relevance Budget evaluation Each year advocate groups go to Congress to request funding for a specific program All programs develop a new investment strategy each year Resubmissions are not recognized - each application must stand on its own merit
    7. 7. 7 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Innovation at the CDMRP Developing innovative electronic systems Soliciting innovative research ideas Utilizing innovative proposal review processes  Pre-Application Submission  Peer Review  Programmatic Review
    8. 8. 8 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Developing Innovative Electronic Systems CDMRP eReceipt System Web-based pre-application submission system (2001) Program and Peer Review Management Information System™ (P²RMIS™) Proprietary web-based system owned and used by Constella Group (peer review contractor) Electronic Grants System (EGS) Custom-designed database and business system for paperless management of research proposals and grants (2001) Electronic Product Database Custom-designed database for management of research products (2006) Impact: Increased efficiency, enhanced communication, and reduced applicant and program cost
    9. 9. 9 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Soliciting Innovative Research Ideas Developing new award mechanisms to capture new ideas  Impact, Multidisciplinary Postdoctoral Offering innovation-focused award mechanisms  Innovator, Synergistic Idea, Era of Hope Scholar, Concept Providing clear definitions of “innovation,” “impact,” and “synergy” in Program Announcements  Video for applicants emphasizing the critical elements in the Program Announcements under construction
    10. 10. 10 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Pre-application Submission Types of pre-applications  Letter of Intent: “Default” pre-application for most award mechanisms  Nomination: For awards that focus on Principal Investigator  Preproposal: For large and/or complex awards Requirement to submit pre-application allows program office to capture contact information on PI and AOR* early in the process Submitted through eReceipt *Authorized Organizational Representative
    11. 11. 11 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Peer Review Panel Configuration Panel composition:  consumer advocates  scientists from academia and industry  clinicians from academia and private practice Stringent reviewer expertise standards Panel composition not made known to applicants No “standing panels” - Strive for 30% new reviewers No contact between applicants and panel members Review criteria definitions reviewed in pre-review video for peer reviewers
    12. 12. 12 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Peer Review Criteria Review criteria rank ordered to ensure focus on most important aspects of each unique award mechanism Synergistic Idea Award  Innovation  Synergy  Impact  Research Strategy Multidisciplinary Postdoctoral Award  Principal Investigator  Mentors  Multidisciplinary Training and Environment  Relevance and Impact Clinical Trial Award  Trial Design  Clinical Impact  Intervention, Drug, or Device  Feasibility
    13. 13. 13 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Online Electronic Peer Review Submission of initial review Scoring process  Scored by assigned reviewers only  Only adjectival scores used Virtual Panel discussion  Asynchronous online  Opportunity for reviewers to discuss differences of opinion  Moderated by Chairperson Award mechanisms  Concept  Predoctoral Traineeship
    14. 14. 14 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Peer Review - Online Discussions (example) Conducted for proposals with disparate scores 269 proposals (22%) had disparate scores that differed by two or more adjectival scores 243/269 (90%) were discussed online 221/243 (91%) received revised scores Disparately scored proposals were reduced from 22% to 6%
    15. 15. 15 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes In Person Peer Review Blinded Review  Science is focus  Used for smaller awards  Reviewers do not know PI or institution Expedited Review (Triage)  Expedited review cut-point based on pre-meeting scores  Developed algorithm based on peer review criteria, historical data  Proposals with low enthusiasm not discussed unless championed Specialty Review  Used for Innovator, EOH Scholar, EOH Postdoc Award mechanisms  Reviewers are nontraditional (e.g., innovators, science journalists)  Proposal are evaluated rather than scored  Reviewers address innovation, leadership, and creativity
    16. 16. 16 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Peer Review – Expedited Review Proposal Receipt Panel Assignment Critiques/Scores CR** SRSR* Initial Score Calculations Pre-Meeting Standard Summary Statement Modified Summary Statement Expedited Review Out In Champion Panel Discussion Yes No Summary Paragraph Panel Meeting Final Scores/ Chair Summary Post-Meeting *Scientific Reviewer **Consumer Reviewer
    17. 17. 17 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Peer Review Criteria - Specialty Reviews Innovator Award  “How the PI’s record of accomplishment demonstrates outstanding ability as an independent and visionary scholar/investigator.” Era of Hope Scholar Award  “What has the PI accomplished that demonstrates a history of innovation, productivity, and the potential for leadership in the breast cancer research community?” Era of Hope Postdoctoral Award  “Whether the PI shows exceptional potential for an independent career at the forefront of breast cancer research.”  “How the proposed training program and environment promotes the development of innovative breast cancer researchers.”
    18. 18. 18 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command Utilizing Innovative Review Processes Programmatic Review Score presentation  Innovation-focused awards presented to Integration Panel in order of decreasing innovation score, not overall global score Resubmissions are not recognized - each application must stand on its own merit Blinded  Science is focus  Used for smaller awards  Reviewers do not know who is conducting the proposed research or where it is being conducted Presentation of award mechanism successes  Program Evaluation  Product Database
    19. 19. 19 Department of Defense Congressionally Directed Medical Research Programs US Army Medical Research and Materiel Command CDMRP Web Site http://cdmrp.army.mil

    ×