Alert 2014-new-mallory

•Download as PPTX, PDF•

1 like•435 views

This presentation discusses using simulation for competency-based assessment of pediatric residents. More pediatric residency programs are developing simulation curricula to meet ACGME's Milestones Project for competency-based assessment. Simulation offers opportunities for structured assessment. The presentation proposes a study to identify gaps in existing assessment methods and opportunities for simulation-based assessment through a consensus-building exercise with pediatric simulation experts. It outlines plans to survey experts to prioritize Milestone subcompetencies for simulation-based assessment and review current assessment tools to define a research agenda.

Education Health & Medicine Technology

ALERT Presentation:
Using simulation for competency-based assessment of
pediatric residents within the Milestones Project
Leah Mallory, MD
The Barbara Bush Children’s Hospital
at Maine Medical Center
International Network for Simulation-based Pediatric Innovation, Research and Education

• More and more pediatric residency programs are developing
simulation curricula.
• ACGME has moved toward competency-based assessment with
the Milestones Project
• Educators are seeking objective ways to evaluate learners
within these milestones
• Simulation (manikin, standardized patient, skills trainer and
computer-based) offers rich opportunities for structured
assessment
International Network for Simulation-based Pediatric Innovation, Research and Education
Background

• P: Pediatric residency programs looking to use simulation as an
assessment tool
• I: Survey experts in pediatric residency training and simulation
based education to identify gaps in existing assessment methods
and opportunities for simulation-based assessment
• C:
• O: Generate a prioritized list of Milestones sub-competencies
ripe for simulation-based assessment as well as a review of the
literature of current simulation-based assessment tools
International Network for Simulation-based Pediatric Innovation, Research and Education
PICO Question

• Initial plan to use Delphi with group of pedi sim experts and program
directors to come to consensus regarding milestone-aligned priorities
for sim-based assessment
• Plan revised after INSPIRE meeting January 2014
– Survey to pedi program directors to identify gaps in current assessment methodologies
– Companion survey to pedi sim experts to identify areas best suited to sim-based
assessment
• Collaboration with Simulation Pediatric Education Group within APPD
– Presented idea and survey for feedback at April 2014 APPD meeting
– Concerns that asking PD’s to go through each milestone sub-competency would lead
to survey fatigue and weak data (lots of 2’s and 3’s on a likert scale)
– Better to return to consensus exercise with smaller, invested group of people who are
involved in pediatric resident education and simulation?
International Network for Simulation-based Pediatric Innovation, Research and Education
Approach / Design

1. Two main questions to answer:
1. Where are the gaps in existing assessment methodologies with regards to pediatric milestone sub-competencies?
2. Which sub-competencies are best suited to simulation-based assessment?
2. Identify group of experts in Pediatric resident education and pediatric simulation
1. Back to delphi or other consensus building technique
2. In person exercise (AAP meeting in San Diego in October?)
3. Results define a prioritized list of areas for simulation-based assessment opportunities tied to pediatric milestones
4. Evidence-based review of current validated simulation-based assessment tools
5. Gap between identified simulation-based assessment priorities and existing simulation-based assessment tools defines
research agenda for development of new simulation-based assessment tools
International Network for Simulation-based Pediatric Innovation, Research and Education
Approach / Design

• Spring/Summer 2014
• Identify “experts” and invite to Consensus building exercise at AAP
• Design process for consensus building- use pediatric milestone sub-competencies
to identify gaps in existing assessment methods and opportunities for simulation-
based assessment
• October 2014
• Consensus building exercise in San Diego around AAP meeting
• November 2014
• Analyze results
• January 2015
• Developing manuscript for publication
International Network for Simulation-based Pediatric Innovation, Research and Education
Timeline

1. Is this return to the “consensus building” study design (based
on APPD Sim PEG feedback) the right way to go?
2. If so, how do we define our experts?
3. If so, what does our consensus building exercise design look
like?
4. Should we also be more granular than the milestone sub-
competenies? (e.g. Patient Care #8 “Prescribe and perform all
medical procedures”- which procedures?)
International Network for Simulation-based Pediatric Innovation, Research and Education
3 Questions to improve study

Name Leah Mallory, MD
Institution The Barbara Bush Children’s Hospital at
Maine Medical Center
E-mail mallol@mmc.org, Phone 207-662-1504
Website / QR Code http://simulation.mmc.org/home
International Network for Simulation-based Pediatric Innovation, Research and Education
Contact Information

An off-the-shelf online information literacy assessment tool called Research Readiness Self-Assessment (RRSA) was used at Cardiff University and Swansea University to help research students evaluate their own information literacy skills. The RRSA was designed by librarians and psychologists to provide individualized feedback and training recommendations based on students' results. At both universities, participation was encouraged through various means. Analysis showed that students tended to overestimate or underestimate certain skills. Students who took the RRSA were nearly twice as likely to attend library training. While feedback was seen as helpful, some students felt it could be more specific. The RRSA was viewed as a useful tool but not necessarily needed by all students.

New ALERT - Team Leadership during Neonatal Resuscitation

INSPIRE_Network

This document describes a quality improvement project to improve team leadership during neonatal resuscitations at Children's Hospital Colorado NICU. The project aims to increase identification of team leaders during actual resuscitations from 51% to 80% through leadership training. The intervention includes structured debriefing of actual resuscitations to identify leadership gaps, and bimonthly simulations where neonatal fellows lead multidisciplinary teams. Team leadership is evaluated during debriefing and simulations using a modified Teamwork Assessment Scale. The project timeline runs from August 2015 to July 2016. Feedback is sought to improve study design and measurement outcomes.

John McInerney 2014 - Training assessors

ePortfolios Australia

One of the biggest hurdles we faced was the initiation of external users in the clinical centres in the use of our platform. This presentation will present the interaction needed from the clinical preceptors with the ePortfolio. Supervisor sign off, formal assessment, formative and summative feedback. This presentation will also discuss the training programme as we implemented it, what worked well and will provide some examples of the resources we provided to facilitate the process.

ABLE - UKAT - Using Learning Analytics to Boost Personal Tutoring

Ed Foster

Student Lifecycle Management - UBTech 2015

Gil Rogers

This document discusses how Chegg can help colleges and universities leverage online tools to improve student recruitment, retention, and career outcomes. Chegg serves over half of all current college students and can help institutions build their brand, capture student interest, support academic success through online tutoring and textbooks, and drive career outcomes using tools like internship matching and outcomes studies. Location-based mobile advertising, interest-based retargeting, and algorithms to match students are some of the techniques discussed to help recruit and retain students.

New ALERT - Biometric parameters of Critical Care Practitioners using Hexoskin

INSPIRE_Network

This study aims to measure biometric parameters such as heart rate, respiratory rate, and calorie expenditure of pediatric critical care physicians in simulated stressful environments using a wearable tracking device. Physicians will participate in simulations with and without viewing their real-time biometrics to see if biofeedback can alter their physiological responses. Data collection is underway with simulations completed on 7 subjects so far. The goals are to get feedback on improving the simulation experience and continue data collection and analysis to understand the effects of biofeedback on physician stress levels.

D Rppt728 1

tc101

The document summarizes research on college students' academic research habits and needs. It found that most students do research online and their most common first steps are using scholarly databases or popular search engines. While most students were satisfied with the current online research process, the majority also found it time-consuming. Students expressed wanting "smart search" features, a guide through the research process stages, and tools to help organize sources and show connections between sources and content areas.

Student Journey Maps

JP Rains, MBA

This presentation was given at the Education and Information Systems, Technologies and Applications (EISTA) Conference in Orlando. It provides details on a program that was created to help simulate the types of issues that a residential property manager would normally face in his or her job, such as building lease-up, marketing, budgeting, crisis management, and personnel hiring, among several other things. Results are given from an experiment that tested satisfaction with the simulation in both competitive and non-competitive environments, as well as the potential for the simulation to attract students to a "Residential Property Management" concentration. The University of Georgia is one of only about 6-8 colleges and universities that offers such a concentration.

Session 1 e-Learning

Savannah Technical College | Alaska Pacific University

The document discusses best practices for organizing e-learning programs based on research. It defines distance education and compares teaching approaches for face-to-face vs distance delivered instruction. Key indicators of quality for mission, curriculum, faculty support, students, sustainability, and evaluation are outlined. Rules of thumb are provided for designing distance courses based on an equivalency theory for achieving similar learning outcomes for distant and local learners.

Introduction to Learning Analytics in Blackboard

Timothy Harfield

Learning analytics is the measurement and analysis of student data to understand and optimize learning. Blackboard Analytics allows students to monitor their online course engagement over time compared to the class average. Using activity reports in Blackboard, students can view metrics on course access, time spent, interactions, submissions, and current grade to gain insight on their participation and performance.

E-Portfolios for Student Success

Richard Robles

The document discusses e-portfolios for student success at the University of Cincinnati. It provides details on the e-portfolio landscape at UC, including programs in the DAAP college and UC Honors program. The UC Honors program introduced e-portfolios in 2007 to help students develop identity, integrate learning, and showcase experiences. In 2008, the program switched to a new e-portfolio platform, iWebfolio, to allow for customized templates, assessment, and feedback. Lessons learned included the importance of priorities and partnerships, and implications involved developing new assessment methods and building a culture of reflection.

Assessing Experiential Learning Through E-portfolios

Richard Robles

The document discusses the University Honors Program at UC. It provides an overview of the program framework which includes a first-year experience using e-portfolios, honors seminar courses, and experiential learning projects. Students in the top 5% of undergraduates are challenged through honors seminars and projects focused on community engagement, global studies, leadership, research, and creative arts. Experiential learning projects are significant learning experiences outside the classroom related to the thematic areas. E-portfolios are used to showcase and integrate learning through artifacts from coursework and projects.

Niloa webinar on survey final

Suhad Aljundi

This document summarizes the findings of a 2013 survey of university provosts regarding student learning outcomes assessment practices. The major findings were: 1) stated learning outcomes are now common, 2) more assessment is being conducted using expanded tools, 3) accreditation drives assessment, 4) assessment data is used more for accreditation than improvement, and 5) faculty engagement is key to effective assessment but remains a challenge. The implications discussed include focusing assessment on classroom practices, recognizing faculty assessment work, and using assessment results for improvement over compliance.

Assessment 2 feb sarah davies

University of Strathclyde

JISC has supported technology-enhanced assessment for over a decade through their e-Learning Programme, focusing on areas like online testing, formative assessment, quality processes, and curriculum redesign. Their current work examines how to better develop learner skills in self-assessment and use of digital tools for educational purposes. While e-assessment systems and assignment submission tools are commonly used, more advanced techniques have seen limited adoption. JISC's publications and projects aim to illustrate effective practice and build capacity in assessment and feedback through strategic use of technologies.

Personalization in Higher Education: Start Small and Think Big

ISITE Design is now Connective DX

Personalized digital experiences can drive more contextual and relevant experiences for all users in higher education—experiences that are both good for the user and the bottom line—yet the vast majority of today's University websites still provide the same static experience to every visitor. Presented at Eduweb 2014 in Baltimore, this presentation uncovers the opportunity for personalization in higher education and tips on how to find small wins while also thinking big.

Push notifications, digital badges & leaderboards: Evaluating the impact of Q...

Katya Pechenkina, PhD

This paper reports on the efficacy of a mobile learning intervention that combined ‘push notifications’ and game principles within a timed quiz app. An institutional interdisciplinary case study was conducted which compared rates of student retention and academic performance with their usage of a purpose-designed learning app. Leading up to lectures the app ‘pushed’ daily quizzes to students’ personal mobile devices and then rewarded them with feedback, points, badges and a position on a leaderboard. It was found that since the introduction of the app there was an increase in student retention rate of 12.23%, an increase in academic performance of 7.03% and a significant positive correlation of .40 between students’ scoring highly on the app and achieving higher academic grades. Conclusions are made in regards to what these findings mean for the future research into higher education learning enabled via mobile app technologies. More broadly, we discuss the implications of our findings in regards to the key higher education stakeholders: universities, educators and students.

Introduction

University of Strathclyde

Online Course Development and Delivery Reviews: An Interactive Approach

Carla Bradley

Alternative assessments

Marieke Guy

This document discusses alternative assessment methods and provides rationales and ideas for various approaches. It proposes using video assessments to allow students to practice real-world skills, eportfolios to enable continuous assessment and reflection, and industry case studies/scenarios to provide authentic assessments aligned with industry. Other suggestions include mini-quizzes for varied engagement and assessment, and balancing new approaches with resources. The goal is to better prepare students through assessment practices that mimic the real world.

Tom Lowe & Liz Dunne

Lucia Garcia

Tom Lowe and Liz Dunne presented on the REACT project, which aims to investigate the benefits of student engagement, particularly for hard-to-reach students. REACT is a HEFCE Catalyst funded project running from 2015-2017 involving 15 UK universities. The project focuses on researching impact, developing tools and resources, and identifying best practices in student engagement to share across institutions. Challenges discussed included defining student engagement, identifying hard-to-reach students, priorities and support for engagement activities, and determining important outcomes.

Alert 2014-progress-cheng

INSPIRE_Network

This document outlines a proposed international needs assessment study to understand current practices of co-debriefing (using more than one instructor) in simulation-based pediatric education programs. The study would involve a multi-phase mixed methods approach, beginning with an online survey of INSPIRE network members to understand current co-debriefing practices, barriers, and needs. Follow-up qualitative research, including focus groups and video review, would explore the current state of co-debriefing in more depth. The goal is to develop a new co-debriefing framework and conduct empirical research to improve the quality of co-debriefing globally. Key questions are asked about survey dissemination through INSPIRE and the number of sites

Hugh Mannerings & Jonathan Neves

Lucia Garcia

The document discusses several topics related to employability and graduate employment outcomes at universities, including: - Who is responsible for student employability - students, lecturers, careers teams, or others? - Key employability issues for students and potential data to publish on graduate employment rates. - Activities and initiatives students can engage in to maximize employability. - How universities can measure and report how students develop skills for employment outcomes. - Improving future surveys beyond just job outcomes to capture wider successful outcomes. - Current university approaches to addressing employability and how they measure related activities. - Potential improvements to the Destination of Leavers from Higher Education survey to make it more useful for accountability in the Te

Altc12 v mcgarveyv1.1

Vicki McGarvey

This document discusses challenges and solutions for providing technology enhanced learning and teaching (TELT) support with depleted resources. It outlines how the university has restructured its eLearning support services, including moving from an eLearning helpdesk to strategic project support and using the virtual learning environment (VLE) as its new web presence. It then presents the TELT resource production process and evaluation feedback on the resource, which identifies areas for improvement such as simplifying the structure, improving signposting and access to tool guides, and including more multimedia content.

Rethinking Student Success: Analytics in Support of Teaching and Learning

Timothy Harfield

Presented at the 2014 Blackboard Institutional Performance Conference (30-31 October 2014). ABSTRACT: Passing grades and retention through to degree are essential to success in higher education, but these factors are too often mistaken for ends in themselves. A high-performing student environment has provided teachers and researchers at Emory University with a space to think critically about what success means, and about the extent to which data might inform the design of successful learning environments. This presentation will (1) discuss some of the unique challenges encountered by Emory University during its 2013-2014 Blackboard Analytics pilot, (2) describe several provisional insights gained from exploratory data mining, and (3) outline how Emory’s pilot experience has informed support of learning analytics on campus. What we have learned at Emory University has both broad and deep implications for how institutions use data in support of student success, but these insights could only have been achieved in an environment where grade-performance and retention are not significant issues.

What’s mine is yours:14-19 Diplomas

Becta FE and Skills

The document summarizes the Next Generation Learning Conference 2009 and discusses strategies for implementing diploma programs. It outlines a vision for seamless learning opportunities and information sharing between partners. Becta's role is to support interoperability between systems and processes. The key is establishing common frameworks to enable data sharing and learner tracking between organizations. Technology can transform further education by enabling personalized learning and efficient management of student information and performance.

Learning Analytics

Gavin Henrick

The document discusses learning analytics, which is defined as the measurement, collection, analysis and reporting of data about learners and their learning environments. It aims to understand and optimize learning. The document outlines the types of data that is collected on students, including profiles, activities, content accessed, and results. It also discusses the goals of improving student success, retention, and experience. Key topics covered include descriptive, diagnostic, predictive and prescriptive analytics. The document raises important ethical concerns around data access, ownership, transparency and privacy when applying learning analytics and discusses approaches taken by organizations like the Open University.

California Community College Faculty Motivation and Reflection on Open Textbo...

Una Daly

Interviews were conducted with twelve faculty members at community colleges in California who adopted open textbooks in their teaching practice for one academic term or longer. The interviews queried faculty on motivation to undertake the adoption, pedagogical considerations, student savings and feedback, and support from other campus stakeholders. Faculty were asked how their teaching and student learning was affected as a result of adopting an open textbook in their course. Specifically they were asked if they were collaborating more with other faculty members and whether they were now using a wider range of instructional materials in their courses. With regards to student learning, they were asked if they believed that student learning had improved or whether student retention had improved as a result of the adoption of an open and free textbook. Any unanticipated outcomes that had resulted from the adoption either in their own practice or with students was also queried. In addition to the faculty and students, other stakeholders on campus are often involved in the decision and process to adopt an open textbook. College initiatives or pilot programs to increase access and equity were sometimes the instigators for making the change and other times it was strictly a faculty decision. Library, instructional design, and bookstore staff were other stakeholders who played roles in the adoption process. Attend this presentation to better understand the motivations of college faculty who adopt open textbooks and how it affected their teaching practice. Hear about the challenges they encountered and any unexpected outcomes. Learn what students had to say about using open textbooks in the classroom and how it affected their learning and ability to be successful.

Exploring Facilitators / Barriers to implementing Simulation-based Competency...

INSPIRE_Network

This study aims to determine the facilitators and barriers to implementing competency assessments for trainees performing infant lumbar punctures (LPs). Sites in the INSPIRE study that achieved over 50% compliance in administering competency assessments will be compared to those achieving under 50% compliance. Interviews and focus groups will be conducted with site directors to identify themes around factors that affected compliance levels. The results could help improve strategies for administering mandatory competency assessments across institutions.

IPSSW Competency Prediction

Todd

What's hot

Virtual Property Manager: Providing a Simulated Learning Environment in a New...

Andy Carswell

Session 1 e-Learning

Savannah Technical College | Alaska Pacific University

Introduction to Learning Analytics in Blackboard

Timothy Harfield

E-Portfolios for Student Success

Richard Robles

Assessing Experiential Learning Through E-portfolios

Richard Robles

Niloa webinar on survey final

Suhad Aljundi

Assessment 2 feb sarah davies

University of Strathclyde

Personalization in Higher Education: Start Small and Think Big

ISITE Design is now Connective DX

Push notifications, digital badges & leaderboards: Evaluating the impact of Q...

Katya Pechenkina, PhD

Introduction

University of Strathclyde

Online Course Development and Delivery Reviews: An Interactive Approach

Carla Bradley

Alternative assessments

Marieke Guy

Tom Lowe & Liz Dunne

Lucia Garcia

Alert 2014-progress-cheng

INSPIRE_Network

Hugh Mannerings & Jonathan Neves

Lucia Garcia

Altc12 v mcgarveyv1.1

Vicki McGarvey

Rethinking Student Success: Analytics in Support of Teaching and Learning

Timothy Harfield

What’s mine is yours:14-19 Diplomas

Becta FE and Skills

Learning Analytics

Gavin Henrick

California Community College Faculty Motivation and Reflection on Open Textbo...

Una Daly

What's hot (20)

Virtual Property Manager: Providing a Simulated Learning Environment in a New...

Session 1 e-Learning

Introduction to Learning Analytics in Blackboard

E-Portfolios for Student Success

Assessing Experiential Learning Through E-portfolios

Niloa webinar on survey final

Assessment 2 feb sarah davies

Personalization in Higher Education: Start Small and Think Big

Push notifications, digital badges & leaderboards: Evaluating the impact of Q...

Introduction

Online Course Development and Delivery Reviews: An Interactive Approach

Alternative assessments

Tom Lowe & Liz Dunne

Alert 2014-progress-cheng

Hugh Mannerings & Jonathan Neves

Altc12 v mcgarveyv1.1

Rethinking Student Success: Analytics in Support of Teaching and Learning

What’s mine is yours:14-19 Diplomas

Learning Analytics

California Community College Faculty Motivation and Reflection on Open Textbo...

Viewers also liked

Exploring Facilitators / Barriers to implementing Simulation-based Competency...

INSPIRE_Network

IPSSW Competency Prediction

Todd

The Effect of Simulation to determine Frequency for Competency Skill Training

INSPIRE_Network

This document proposes a study to determine the optimal frequency of simulation training to maintain competency in procedural skills. The study would randomly assign healthcare providers to groups that receive simulation training every 3 months, 6 months, or 12 months. Outcomes like confidence, skills performance, and competency would be measured before, during, and after the study to evaluate which frequency best helps providers maintain their skills over time. The document asks how to implement the study, whether it should be single or multi-center, and whether trainees or faculty should be involved.

Building Strategic Linkages: To Map and Measure Your Learning Strategy

Ajay Pangarkar, CTDP, CPA, CMA

The importance of workplace learning is increasing, and knowing how it contributes to organizational strategy is critical for it to deliver real value. Strategy is one of the most poorly understood management areas and little strategic planning occurs in learning; most of it consisting of little more than issuing goals and assigning projects and tasks. However, real strategic planning should begin with the establishment of a theoretical foundation for how to connect learning initiatives and solutions to the organization’s next goal on the road to its visionary future. It should create a cause-and-effect plan for how to achieve that theory’s execution. Participants will team up to work through a case study of a fictitious company. The teams will complete the learning and growth component of a “balanced scorecard,” ensuring their learning strategy completely aligns with the company’s existing scorecard metrics and established strategic objectives. Application on the Job • Develop tangible strategic linkages for learning and growth in a strategy map and the balanced scorecard. • Create learning metrics to populate a performance management framework to measure strategy's execution. • Align your learning strategy to meet business and strategic objectives. • Determine how to map tangible linkages from learning expectations to defined business objectives.

Building Competency with Blended Learning

Dr. Charles M. Ware

This document discusses best practices for integrating simulation into education for adult learners. It defines competency assessment versus education and how that affects simulation design. It reviews key characteristics of adult learners, including that they are self-directed, draw from experience, and want immediately applicable learning. Different learning styles are identified, like visual, auditory, reading/writing, and kinesthetic, and how simulations can address each. Best practices discussed include experiential learning, contextual learning, situated learning, deliberate practice, feedback, and mastery learning. The document emphasizes applying learning theories to the design of simulations and debriefings to effectively educate adult learners.

Bersinby deloitte caterpillarcontentstrategy_final

Xyleme

This document summarizes a webinar discussing how Caterpillar is addressing skills gaps through improved learning content strategies. Caterpillar is developing bite-sized, personalized learning content that can be delivered anywhere, anytime to employees. Content is organized into a single source repository and delivered through multiple channels. Caterpillar's goal is to move towards predictive, personalized learning paths to continuously upskill employees. The webinar discusses how Caterpillar's focus on high-quality, accessible learning content helps close organizational skills gaps and drives long-term capability building.

How Content Strategy Drives the High Impact Learning Organization

Xyleme

According to research by Bersin, profits from High Impact Learning Organizations (HILO) grew three times faster than other organizations studied. So, what makes some Learning & Development organizations better than others? One core capability is Learning Content Strategy. In this webinar, David Mallon, VP of Research at Bersin by Deloitte, will dive into the evolving nature of learning content and share findings from Bersin’s recent High Impact Learning Organization report. Joining David will be Michael Miller, Process and Standards Supervisor at Caterpillar, Inc. Together they will discuss how eLearning has become a small part of the larger pie that now includes the delivery of contextual-based content at the right time and in the right format to drive performance outcomes. Key takeaways for Senior Learning & Talent executives will include the methodologies used by HILOs to build a sustainable content strategy that helps companies solve business and operational problems.

Learning Delivery: Meeting the Learner Where They Are - Part 1

Xyleme

In this 27 minute webinar, part 1 of a 2 part series, Xyleme will have a conversation with Cristine Lipscomb (Duckworth), partner in the Chapman Alliance, about how and where learners learn. Like she does with her many clients from a variety of industries, she will address the big picture questions like ‘how do we adapt our content strategy to address the needs of the modern learner’, and ‘where do we put our technology investments to ensure delivery anytime, anywhere?’

Training For Assessor

Andreas Imawanto

The document provides information and guidance for assessors conducting assessments. It defines assessment and the assessment center process. It describes the roles of competencies, exercises, and assessors. It explains that assessors must observe candidates, record evidence, classify evidence according to competencies, summarize performance, and evaluate candidates. The document also provides examples of competencies, exercises, and the ORCSE process assessors should follow when assessing candidates.

Viewers also liked (9)

Exploring Facilitators / Barriers to implementing Simulation-based Competency...

IPSSW Competency Prediction

The Effect of Simulation to determine Frequency for Competency Skill Training

Building Strategic Linkages: To Map and Measure Your Learning Strategy

Building Competency with Blended Learning

Bersinby deloitte caterpillarcontentstrategy_final

How Content Strategy Drives the High Impact Learning Organization

Learning Delivery: Meeting the Learner Where They Are - Part 1

Training For Assessor

Similar to Alert 2014-new-mallory

Progress ALERT - Sim-based Assessment Tools for General Pediatric Milestones

INSPIRE_Network

Leah Mallory presented on the development of simulation-based assessment tools for general pediatrics milestones. Four milestones were identified as suitable for simulation-based assessment through a survey of program directors and experts, and separate groups were formed to identify or develop tools for each. The groups have conducted literature reviews and are in different stages of tool development or identification, with some requiring validation studies. The goals are to finalize study designs, obtain necessary approvals, and establish feasibility and validity of the tools across multiple sites in the next year.

INSPIRE @ IMSH 2015 ALERTs

INSPIRE_Network

FerrellWalker.pptx

Jisc

The document summarizes a presentation on reimagining assessment and feedback given by consultants from Jisc. It discusses Jisc's current research on trends in assessment, principles of good assessment, results from a poll on concerns in the higher education assessment landscape, examples of how technology can help implement assessment principles, and looking to the future of assessment including what is not yet supported digitally. The presentation engaged participants in activities to discuss tools, examples of good practice, and future support needs.

INSPIRE Network Annual Report 2014

INSPIRE_Network

Evaluation training for wellcome trust 15th may

Bruce Etherington

This document summarizes a presentation on evaluating engagement activities. The presentation aimed to help participants develop evaluation strategies and make strong cases for engagement. It covered why evaluation is important, how to identify what to evaluate using logic models, who evaluations are for, and making the case for engagement through evaluation. The presentation included activities where participants discussed their experiences with evaluation and worked through examples of logic models and evaluation plans.

Trg evaluation

Dreams Design

This document discusses training evaluation, including its purpose, benefits, and process. Training evaluation assesses how effective a training program was at benefiting trainees and the company. It involves collecting outcomes data to determine if the training achieved its goals. Evaluation provides feedback to improve training and control over provision, while demonstrating training's contribution to the organization. Common evaluation methods are expert review, quality review, observation testing, and pilot testing.

FACT2 Learning Analytics Task Group Phase 2 report - CIT2014

Greg Ketcham

The FACT2 Learning Analytics Task Group report summarizes their work in 2013-2014. Their goals were to develop professional learning for faculty on learning analytics and identify best practices. In fall 2013, they presented findings at several SUNY conferences on using data to enhance student experience. A spring 2014 pilot at SUNY Oswego used a retention system called Starfish for nearly 1,000 at-risk students. The task group defined learning analytics as software collecting multiple data sets to predict and impact student success. They recommended establishing an ongoing working group to develop learning analytic practices and tools across SUNY.

How to Assess Students in Virtual Environment?

Attiya Karim Balghari

The document discusses best practices for assessing students in a virtual learning environment. It covers topics such as the importance of formative assessment, using technology to conduct assessments, aligning assessments with learning objectives, examples of student self-assessment tools, and challenges of implementing assessment for learning online. Testing procedures during the pandemic, such as ensuring test security and standard administration, are also addressed. Overall, the document emphasizes that assessment should focus on learning over knowledge and provide meaningful feedback to students.

IPSSW Pre-Conference Workshop 7 (2016, Glasgow)

INSPIRE_Network

Development of an Electronic Decision Support tool to optimize performance du...

INSPIRE_Network

Measuring Student Success: Tutoring and Learning Centers

Lisa D'Adamo-Weinstein

Presented by: Dr. Lisa D’Adamo-Weinstein, Director of Academic Support , SUNY Empire State College Dr. Tacy Holliday, Governance Coordinator, Montgomery College, NCLCA Learning Center Leadership Level Description: Measuring and evaluating student success is crucial to retention efforts and program development. Join us as we talk about the key elements necessary to measure student success in your tutoring and learning centers. We will assist you in developing an assessment plan for your own center.

Redesigning assessment and feedback - landscape review and areas for development

Jisc

E12+Analytics+Workshop+ppt.pptx

chatbot9

Research In Action #2

guestea0a10

This document summarizes research on the effectiveness of different practices used in youth mentoring programs. It presents a framework for evaluating evidence on program practices, which involves categorizing research studies based on their level of evidence and methodological rigor. The framework is then applied to analyze research on the effectiveness of pre-match training for mentors. While evidence is mixed, the framework can help mentoring programs make informed judgments about pre-match training and identify ways to strengthen the evidence base.

Enhancement of teaching & Learning Methodology.pptx

Asokan R

This document discusses enhancing teaching and learning methodology in nursing education. It addresses current challenges in nursing education, best practices for teaching methodology including active learning strategies, collaborative learning techniques, use of technology, and incorporating real-world scenarios. It also discusses implementing effective assessment strategies, and the importance of ongoing faculty development to improve teaching. Resources for faculty development include online courses, professional organizations, and conferences focused on nursing education. The conclusion emphasizes that enhancing teaching methodology in each course is vital for creating effective learning experiences.

Alert 2014-progress-halamek

INSPIRE_Network

The presentation discusses the progress of the DART research study, which aims to develop tools to assess debriefing quality by scoring recorded debriefings. The study has revised its aims, expanded the DART assessment tool into two versions, developed a scoring guide, and plans further testing and data analysis at multiple sites. Challenges include securing time and personnel for the non-funded research, improving inter-rater reliability of scoring, and illustrating debriefing flow visually. Help is requested from INSPIRE in hosting recordings, providing feedback in 3 months, and supporting the research over 1 year.

Alert 2014-progress-ferdman-halamek

INSPIRE_Network

Full Program Design

foreman

The document provides an overview of program design, monitoring and evaluation. It discusses conducting needs assessments to understand community needs and priorities. It also covers developing a causal pathway framework to link program activities, outputs, and outcomes. Monitoring and evaluation are presented as important parts of the process to determine what is working and how programs can be improved.

Real World Evaluation - Monitoring & Evaluation

4th Wheel Social Impact

With the support of Jim Rugh, author of ‘Real World Evaluation’, 4th Wheel Social Impact organised a one day workshop on Real World Evaluation to spread this approach among personnel involved in designing, implementing, monitoring, documenting and evaluating social programs in India. The RealWorld Evaluation approach was developed specifically to address the need for practical strategies on how to ensure the highest level of methodological rigour for evaluation studies, consistent with the circumstances under which the evaluation has to be conducted. Sage first published the book in 2006 and the 2nd edition in 2012. (See www.RealWorldEvaluation.org)

Alert 2014-progress-chang

INSPIRE_Network

This document discusses a study assessing the impact of a train-the-trainer education module on infant life support competency evaluations. The study aims to evaluate how the module affects the number of assessments performed and the scoring distribution. It outlines the timeline, including recruitment, data collection and analysis between 2014-2015. It also notes the progress implementing train-the-trainer modules and collecting viewership data. Challenges include extensive parallel data collection and adherence to protocols. The document requests help from INSPIRE to solidify interested parties, begin data collection and analysis in 3 months, and provide manuscript oversight over the next year.

Similar to Alert 2014-new-mallory (20)

Progress ALERT - Sim-based Assessment Tools for General Pediatric Milestones

INSPIRE @ IMSH 2015 ALERTs

FerrellWalker.pptx

INSPIRE Network Annual Report 2014

Evaluation training for wellcome trust 15th may

Trg evaluation

FACT2 Learning Analytics Task Group Phase 2 report - CIT2014

How to Assess Students in Virtual Environment?

IPSSW Pre-Conference Workshop 7 (2016, Glasgow)

Development of an Electronic Decision Support tool to optimize performance du...

Measuring Student Success: Tutoring and Learning Centers

Redesigning assessment and feedback - landscape review and areas for development

E12+Analytics+Workshop+ppt.pptx

Research In Action #2

Enhancement of teaching & Learning Methodology.pptx

Alert 2014-progress-halamek

Alert 2014-progress-ferdman-halamek

Full Program Design

Real World Evaluation - Monitoring & Evaluation

Alert 2014-progress-chang

More from INSPIRE_Network

Alert 2017 tejani - nbi resident mock code study-2017-updated

INSPIRE_Network

This presentation describes a pediatric and med-peds resident resuscitation quality improvement program using mock code simulations. The program aims to provide residents with additional code experience through simulations and assess changes in their performance scores pre- and post-program. Residents participate in 3 mock codes per year that are video recorded and externally evaluated. The goal is to achieve a 20% improvement in assessment scores by focusing on medical knowledge, communication skills, and team management. Feedback from the conference will help strengthen study design and data collection methods.

Multi-site outreach simulation education to improve premature infant admissio...

INSPIRE_Network

This document summarizes a presentation about using multisite simulation education to improve admission temperatures for premature infants. The presentation describes a pilot study conducted from 2015-2017 that provided simulation education to community hospitals on improving thermal control for preterm infants. The study found improved admission temperatures after education and plans to conduct a larger study to further evaluate the impact of different educational interventions on newborn temperatures.

Gross initial alert

INSPIRE_Network

This document describes a study to compare the effectiveness of using an electronic medical record (EMR) like EPIC for disaster triage versus traditional color-coded tags. The study will randomize first responders at a disaster drill to either use EPIC on a mobile app to register patients and assign triage levels in the field, or to use color-coded tags. The primary outcome is time from triage to treatment, with secondary outcomes like triage time per patient and time of arrival to hospital treatment. Feedback is sought on study design and secondary measures. The goals are to finalize IRB approval and begin the study by February 2017.

Alert 2017 wheaton

INSPIRE_Network

Throughput, cost and standardization: Does a serious game in healthcare work ...

INSPIRE_Network

Making simulation training stick with rapid cycle deliberate practice

INSPIRE_Network

This document describes a proposed study to compare the effectiveness of interleaved versus progressive simulation training scenarios on the long-term retention of pediatric resuscitation skills among nursing staff. The study would involve two cohorts of pediatric nurse teams who receive rapid cycle deliberate practice simulation training, with one cohort receiving interleaved scenarios and the other receiving a single progressive scenario. The primary outcome would be the percentage of team participants who can demonstrate retention of three resuscitation skill bundles at 100% after 12 months. Key steps include receiving feedback on the study design, submitting for IRB approval within two months, and goals to accomplish at the INSPIRE conference.

Alert 2017 deshpande secure_tube study in simulated

INSPIRE_Network

This document summarizes a proposed study to compare the SecureTube endotracheal tube to traditional endotracheal tubes in a simulated setting. The study would involve medical professionals intubating a manikin using both tube types and measuring intubation time and ease of use. Nurses and respiratory therapists would also secure and adjust the tube depths to assess ease of use. The goal is to determine if the SecureTube design improves unplanned extubation rates compared to traditional tubes.

Improving knowledge and confidence of emergency residents in pediatric resusc...

INSPIRE_Network

Interdisciplinary pediatric sedation provider course toolkit

INSPIRE_Network

The document describes a proposed interdisciplinary pediatric sedation provider course toolkit that aims to improve team communication and decrease adverse events. It will develop, test, and evaluate an online and in-person simulation course for medical doctors, registered nurses, and nurse practitioners. The course will include content on evidence-based sedation safety practices and interdisciplinary team communication tools. The goal is to demonstrate improved safe sedation practices and communication through techniques like pre-sedation time outs, SBAR handoffs, and call-outs compared to existing provider courses. Effectiveness will be evaluated through a pilot and revisions before wider dissemination.

Alert 2017 duff co_nsolidating tools for outcomes

INSPIRE_Network

This presentation discusses a study called CONTOUR that aims to improve team performance in pediatric cardiac arrest through the use of cognitive aids. The study will test the impact of a "reader" cognitive aid, the CARD system, and an integrated approach on teamwork and adherence to resuscitation guidelines. It is a randomized controlled simulation-based study involving multi-professional healthcare teams. The presentation provides background on the problem, outlines the study approach and design, research question, timeline, and contact information for the presenter.

Alert 2017 kUse of a defined role/responsibility chart and a color coded floo...

INSPIRE_Network

Simulation as a strategy for learning in pediatrics graduate in high complexi...

INSPIRE_Network

Alert 2017 lopreiato - a handover osce to measure skills in transitions of ...

INSPIRE_Network

The document summarizes a study that used a handover OSCE (objective structured clinical examination) station to measure the handover skills of pediatric interns. Over three years, 126 interns participated in the handover OSCE, which assessed their performance on a 10-item scale. Results showed improvements over time, with interns scoring higher on domains like patient summary, action lists, and contingency planning. The study aims to continue data collection and analysis, with the goal of presenting results at a conference in June 2017.

Validating a serious games strategy to improve multi-patient care in emergenc...

INSPIRE_Network

This presentation discusses a study validating a serious game to improve multi-patient care skills in emergency departments. The study compares game performance and choices to other metrics like medical licensing exam scores and evaluations. It is currently enrolling US medical students and pediatric residents. The goal is to determine if there is a dose-response relationship between game use and multi-patient care ability as assessed by in-game metrics and real patient care efficiency. The presentation outlines the study timeline and seeks advice on funding, data collection best practices, and alternative outcomes.

Using Cognitive task analysis to understand the decision making process for p...

INSPIRE_Network

Alert 2017 sherman - virtual reality simulation training - updated #2

INSPIRE_Network

This document summarizes a presentation on using virtual reality simulation training in pediatric resuscitation. It discusses how VR could help train medical personnel by simulating stressful resuscitation environments without risks to real patients. Currently, training relies on mannequin-based or screen-based simulation, but VR may provide a more immersive experience. The researchers plan to study whether VR training improves trainee decision-making compared to standard simulation, with the goal of enlisting other hospitals to collaborate on the research.

INSPIRE Annual Report 2015 - 2016

INSPIRE_Network

The International Network for Simulation-based Pediatric Innovation, Research, and Education (INSPIRE) is a collaborative research network with investigators and educators from around the globe (http://www.inspiresim.com/) focusing on improving the lives of children using rigorous simulation-based research. This is the 3rd annual report that highlights the work within INSPIRE and by INSPIRE members.

INSPIRE @ IMSH 2016

INSPIRE_Network

This document summarizes the INSPIRE @ IMSH 2016 conference. The conference welcomed participants and provided information about the wireless network. It then introduced the mission of INSPIRE, which is to improve medical care for acutely ill children through simulation-based research questions related to resuscitation, skills, debriefing, and education. The document outlined the research themes of INSPIRE including training/assessment and healthcare innovations. It provided the schedule of presentations and working groups for the conference. Screen-based simulation and reporting guidelines for simulation research were also discussed.

New ALERT - Improving Pediatric Acute Care in Community EDs through Collabora...

INSPIRE_Network

This document proposes a study to compare the effectiveness of a modular pediatric resuscitation improvement program (PRIP) to a pediatric care coordinator (PECC) alone at improving pediatric resuscitation quality in community emergency departments. The study would involve cluster randomization of EDs to either receive the PRIP intervention or act as controls with a PECC. Outcomes would include composite quality scores measured through in-situ simulations, chart review scores, and pediatric readiness survey scores. The goal is to develop and test a low-cost PRIP to help PECCs improve pediatric emergency care.

New ALERT - Factors on quality pediatric care by paramedics using In-Situ Sim...

INSPIRE_Network

This document summarizes a proposed study to evaluate factors associated with high quality pediatric care by paramedics using in-situ simulation. The study would involve paramedics from Northeast and Midatlantic states participating in simulations of 3 standardized pediatric cases using validated checklists and video review. The objectives are to identify factors associated with high quality pre-hospital pediatric care and areas of training that could be improved. The proposed timeline includes IRB submission in 2 months, starting data collection in 6 months, completing data analysis and manuscript in 12 months.

More from INSPIRE_Network (20)

Alert 2017 tejani - nbi resident mock code study-2017-updated

Multi-site outreach simulation education to improve premature infant admissio...

Gross initial alert

Alert 2017 wheaton

Throughput, cost and standardization: Does a serious game in healthcare work ...

Making simulation training stick with rapid cycle deliberate practice

Alert 2017 deshpande secure_tube study in simulated

Improving knowledge and confidence of emergency residents in pediatric resusc...

Interdisciplinary pediatric sedation provider course toolkit

Alert 2017 duff co_nsolidating tools for outcomes

Alert 2017 kUse of a defined role/responsibility chart and a color coded floo...

Simulation as a strategy for learning in pediatrics graduate in high complexi...

Alert 2017 lopreiato - a handover osce to measure skills in transitions of ...

Validating a serious games strategy to improve multi-patient care in emergenc...

Using Cognitive task analysis to understand the decision making process for p...

Alert 2017 sherman - virtual reality simulation training - updated #2

INSPIRE Annual Report 2015 - 2016

INSPIRE @ IMSH 2016

New ALERT - Improving Pediatric Acute Care in Community EDs through Collabora...

New ALERT - Factors on quality pediatric care by paramedics using In-Situ Sim...

Recently uploaded

UGC NET Exam Paper 1- Unit 1:Teaching Aptitude

S. Raj Kumar

Leveraging Generative AI to Drive Nonprofit Innovation

TechSoup

Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx

EduSkills OECD

How to Manage Your Lost Opportunities in Odoo 17 CRM

Celine George

BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...

Nguyen Thanh Tu Collection

How to deliver Powerpoint Presentations.pptx

HajraNaeem15

PIMS Job Advertisement 2024.pdf Islamabad

AyyanKhan40

Advanced Java[Extra Concepts, Not Difficult].docx

adhitya5119

Your Skill Boost Masterclass: Strategies for Effective Upskilling

Excellence Foundation for South Sudan

Film vocab for eal 3 students: Australia the movie

Nicholas Montgomery

Pengantar Penggunaan Flutter - Dart programming language1.pptx

Fajar Baskoro

Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx

siemaillard

A Independência da América Espanhola LAPBOOK.pdf

Jean Carlos Nunes Paixão

BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...

Nguyen Thanh Tu Collection

Liberal Approach to the Study of Indian Politics.pdf

WaniBasim

How to Fix the Import Error in the Odoo 17

Celine George

MARY JANE WILSON, A “BOA MÃE” .

Colégio Santa Teresinha

Traditional Musical Instruments of Arunachal Pradesh and Uttar Pradesh - RAYH...

imrankhan141184

คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1

สมใจ จันสุกสี

spot a liar (Haiqa 146).pptx Technical writhing and presentation skills

haiqairshad

Recently uploaded (20)

UGC NET Exam Paper 1- Unit 1:Teaching Aptitude

Leveraging Generative AI to Drive Nonprofit Innovation

Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptx

How to Manage Your Lost Opportunities in Odoo 17 CRM

BÀI TẬP DẠY THÊM TIẾNG ANH LỚP 7 CẢ NĂM FRIENDS PLUS SÁCH CHÂN TRỜI SÁNG TẠO ...

How to deliver Powerpoint Presentations.pptx

PIMS Job Advertisement 2024.pdf Islamabad

Advanced Java[Extra Concepts, Not Difficult].docx

Your Skill Boost Masterclass: Strategies for Effective Upskilling

Film vocab for eal 3 students: Australia the movie

Pengantar Penggunaan Flutter - Dart programming language1.pptx

Présentationvvvvvvvvvvvvvvvvvvvvvvvvvvvv2.pptx

A Independência da América Espanhola LAPBOOK.pdf

BÀI TẬP BỔ TRỢ TIẾNG ANH 8 CẢ NĂM - GLOBAL SUCCESS - NĂM HỌC 2023-2024 (CÓ FI...

Liberal Approach to the Study of Indian Politics.pdf

How to Fix the Import Error in the Odoo 17

MARY JANE WILSON, A “BOA MÃE” .

Traditional Musical Instruments of Arunachal Pradesh and Uttar Pradesh - RAYH...

คำศัพท์ คำพื้นฐานการอ่าน ภาษาอังกฤษ ระดับชั้น ม.1

spot a liar (Haiqa 146).pptx Technical writhing and presentation skills

Alert 2014-new-mallory

1. ALERT Presentation: Using simulation for competency-based assessment of pediatric residents within the Milestones Project Leah Mallory, MD The Barbara Bush Children’s Hospital at Maine Medical Center International Network for Simulation-based Pediatric Innovation, Research and Education

2. • More and more pediatric residency programs are developing simulation curricula. • ACGME has moved toward competency-based assessment with the Milestones Project • Educators are seeking objective ways to evaluate learners within these milestones • Simulation (manikin, standardized patient, skills trainer and computer-based) offers rich opportunities for structured assessment International Network for Simulation-based Pediatric Innovation, Research and Education Background

3. • P: Pediatric residency programs looking to use simulation as an assessment tool • I: Survey experts in pediatric residency training and simulation based education to identify gaps in existing assessment methods and opportunities for simulation-based assessment • C: • O: Generate a prioritized list of Milestones sub-competencies ripe for simulation-based assessment as well as a review of the literature of current simulation-based assessment tools International Network for Simulation-based Pediatric Innovation, Research and Education PICO Question

4. • Initial plan to use Delphi with group of pedi sim experts and program directors to come to consensus regarding milestone-aligned priorities for sim-based assessment • Plan revised after INSPIRE meeting January 2014 – Survey to pedi program directors to identify gaps in current assessment methodologies – Companion survey to pedi sim experts to identify areas best suited to sim-based assessment • Collaboration with Simulation Pediatric Education Group within APPD – Presented idea and survey for feedback at April 2014 APPD meeting – Concerns that asking PD’s to go through each milestone sub-competency would lead to survey fatigue and weak data (lots of 2’s and 3’s on a likert scale) – Better to return to consensus exercise with smaller, invested group of people who are involved in pediatric resident education and simulation? International Network for Simulation-based Pediatric Innovation, Research and Education Approach / Design

5. 1. Two main questions to answer: 1. Where are the gaps in existing assessment methodologies with regards to pediatric milestone sub-competencies? 2. Which sub-competencies are best suited to simulation-based assessment? 2. Identify group of experts in Pediatric resident education and pediatric simulation 1. Back to delphi or other consensus building technique 2. In person exercise (AAP meeting in San Diego in October?) 3. Results define a prioritized list of areas for simulation-based assessment opportunities tied to pediatric milestones 4. Evidence-based review of current validated simulation-based assessment tools 5. Gap between identified simulation-based assessment priorities and existing simulation-based assessment tools defines research agenda for development of new simulation-based assessment tools International Network for Simulation-based Pediatric Innovation, Research and Education Approach / Design

6. • Spring/Summer 2014 • Identify “experts” and invite to Consensus building exercise at AAP • Design process for consensus building- use pediatric milestone sub-competencies to identify gaps in existing assessment methods and opportunities for simulation- based assessment • October 2014 • Consensus building exercise in San Diego around AAP meeting • November 2014 • Analyze results • January 2015 • Developing manuscript for publication International Network for Simulation-based Pediatric Innovation, Research and Education Timeline

7. 1. Is this return to the “consensus building” study design (based on APPD Sim PEG feedback) the right way to go? 2. If so, how do we define our experts? 3. If so, what does our consensus building exercise design look like? 4. Should we also be more granular than the milestone sub- competenies? (e.g. Patient Care #8 “Prescribe and perform all medical procedures”- which procedures?) International Network for Simulation-based Pediatric Innovation, Research and Education 3 Questions to improve study

8. Name Leah Mallory, MD Institution The Barbara Bush Children’s Hospital at Maine Medical Center E-mail mallol@mmc.org, Phone 207-662-1504 Website / QR Code http://simulation.mmc.org/home International Network for Simulation-based Pediatric Innovation, Research and Education Contact Information

Alert 2014-new-mallory

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (9)

Similar to Alert 2014-new-mallory

Similar to Alert 2014-new-mallory (20)

More from INSPIRE_Network

More from INSPIRE_Network (20)

Recently uploaded

Recently uploaded (20)

Alert 2014-new-mallory