Phase II Overview of Information Literacy Assessment Project
•Download as PPTX, PDF•
0 likes•222 views
The document summarizes improvements made to a standardized assessment tool based on feedback from students, consultants, and library faculty. Key changes included: 1) Improving usability based on usability testing feedback, such as adding a clear menu and making it easier to select questions. 2) Conducting more cognitive interviews with students to improve question wording and clarity. 3) Adding new statistical analysis features like T-tests and correlation templates to provide more meaningful analysis of assessment data. 4) Hosting a focus group to discuss how to best use assessment data and get broader support for the tool.
Report
Share
Report
Share
Recommended
Depending on our users final
This document discusses assessing and improving research consultations through collecting user feedback. It describes implementing a research consultation model in a dedicated library space based on writing centers. An effective assessment program uses immediate feedback through a well-designed instrument that supports learning outcomes. Results from assessments at the University of Denver found that satisfaction was high, most students learned how to access materials, and correlations existed between major, when help was sought, and what students reported learning. Future assessment plans include modifying questions, assessing non-students, and collecting longitudinal data.
Depending On Our Users
Depending On Our Users Collecting User Feedback to Assess and Improve Research Consultations
ACRL March 31, 2011
Depending on our users
This document discusses assessing and improving research consultations at an academic library. It describes implementing a research consultation center model, using effective assessment programs to gather immediate feedback, and designing assessment instruments to support learning outcomes. Survey results showed student satisfaction with consultations was high. Correlations were found between student major, when they sought help, and what they reported learning. The library plans to use point-of-use surveys, integrate questions about demographics, feedback, and learning outcomes to assess consultations going forward.
QIPP Presentation
The document summarizes a quality improvement project to revise a peer evaluation form used during nursing simulations. A survey found the original rubric difficult to follow so the team created a revised form based on feedback. A post-implementation survey found 90% of evaluators felt the new form easier to use. The team recommends communicating changes better and linking skills to specific simulations for clarity.
Pedagogical and Technological Interventions in Peer Review (Shivers-McNair) #...
In this presentation, I discuss a collaboration with Eli Review, teacher-researchers who built a web app to support peer learning through feedback and revision, that led to new features on the app and new research and teaching questions for me.
Academic Uses For Data Collection And Graphing
This is a portion of the slideshow for a graphing presentation. It is in the works and will be edited as other the other presenters add their information.
Getting Them There: A Small-Scale Usability Test of a University Library Website
The document summarizes a small-scale usability test of a university library website during its migration to a new content management system. 7 student workers participated in the test where their actions were observed as they tried to complete tasks like finding a book or article. The test revealed some confusion around terminology and navigation. Students had trouble with title/author searches and understanding concepts like research guides. The results informed redesign efforts, and it was concluded that further testing with different groups could provide more insights to improve the site's usability.
Surveying Users: Be Careful What You Ask For
Tips and cautionary tales about surveying users regarding library use, satisfaction, and user preferences. Concurrent session for the SLA Maryland 2015 event, Leveraging Data to Lead.
Recommended
Depending on our users final
This document discusses assessing and improving research consultations through collecting user feedback. It describes implementing a research consultation model in a dedicated library space based on writing centers. An effective assessment program uses immediate feedback through a well-designed instrument that supports learning outcomes. Results from assessments at the University of Denver found that satisfaction was high, most students learned how to access materials, and correlations existed between major, when help was sought, and what students reported learning. Future assessment plans include modifying questions, assessing non-students, and collecting longitudinal data.
Depending On Our Users
Depending On Our Users Collecting User Feedback to Assess and Improve Research Consultations
ACRL March 31, 2011
Depending on our users
This document discusses assessing and improving research consultations at an academic library. It describes implementing a research consultation center model, using effective assessment programs to gather immediate feedback, and designing assessment instruments to support learning outcomes. Survey results showed student satisfaction with consultations was high. Correlations were found between student major, when they sought help, and what they reported learning. The library plans to use point-of-use surveys, integrate questions about demographics, feedback, and learning outcomes to assess consultations going forward.
QIPP Presentation
The document summarizes a quality improvement project to revise a peer evaluation form used during nursing simulations. A survey found the original rubric difficult to follow so the team created a revised form based on feedback. A post-implementation survey found 90% of evaluators felt the new form easier to use. The team recommends communicating changes better and linking skills to specific simulations for clarity.
Pedagogical and Technological Interventions in Peer Review (Shivers-McNair) #...
In this presentation, I discuss a collaboration with Eli Review, teacher-researchers who built a web app to support peer learning through feedback and revision, that led to new features on the app and new research and teaching questions for me.
Academic Uses For Data Collection And Graphing
This is a portion of the slideshow for a graphing presentation. It is in the works and will be edited as other the other presenters add their information.
Getting Them There: A Small-Scale Usability Test of a University Library Website
The document summarizes a small-scale usability test of a university library website during its migration to a new content management system. 7 student workers participated in the test where their actions were observed as they tried to complete tasks like finding a book or article. The test revealed some confusion around terminology and navigation. Students had trouble with title/author searches and understanding concepts like research guides. The results informed redesign efforts, and it was concluded that further testing with different groups could provide more insights to improve the site's usability.
Surveying Users: Be Careful What You Ask For
Tips and cautionary tales about surveying users regarding library use, satisfaction, and user preferences. Concurrent session for the SLA Maryland 2015 event, Leveraging Data to Lead.
A Survey of Best Practices for Writing and Editing CME Needs Assessments
This e-poster won the People's Choice Award at the 2016 Annual Meeting of the Alliance for Continuing Education in the Health Professions (ACEHP)
Assessment during a pandemic: Using ACRL’s project OUTCOME to assess instruct...
Assessment during a pandemic: Using ACRL’s project OUTCOME to assess instruct...Georgia Libraries Conference (formerly Ga COMO).
Presenter: Ashley Dees
Presented at the virtual Georgia Libraries Conference in October 2020.
In Spring 2020, an assessment project was developed to assess the impact of library instruction to five Speech 102 classes. The assessment was administered in two parts using the immediate and follow-up surveys provided in the project OUTCOME platform. The immediate survey was administered via a print survey directly after the in-person instruction sessions. Due to the pandemic, the follow-up survey was administered six weeks after the instruction sessions via an online survey. This session will discuss using project OUTCOME, the findings of the assessment, and what librarians can learn from assessment projects during a semester of upheaval. Unit 1 assignment 1 blog
Qualitative research provides more in-depth and valuable information compared to quantitative research, which collects more vague findings. Primary research involves directly interviewing, surveying, or questioning people, and can be qualitative or quantitative. It has advantages like interviews providing specific answers or observation allowing researchers to watch people's daily activities without much interaction. Secondary research uses previous research findings from third parties through methods like questionnaires, surveys, books, or newspapers to support conclusions without conducting original research.
Learning impact awards student version
The self assessment modules are designed to help students test their understanding of course readings for each week. They consist of 3 multiple choice questions per topic, with feedback provided. If a question is answered incorrectly, students are directed to re-read that section. The modules include images, audio, video and other media to engage students. Student usage of the modules will be analyzed and a survey conducted to help improve them.
Authentic Assessment For School Libraries
This presentation provides a report from the AASL Fall Forum conference on assessment and school libraries.
High School Instructional Strategies Report 2009/2010
The document describes various instructional programs, strategies, and teacher professional development implemented at a school. Universal Design for Learning Strategies (UDL) and SWIFT reading strategies were implemented. Teacher professional development included training in UDL, reading apprenticeship, data analysis software, and content areas like math and science. Leadership opportunities for teachers included organizing field trips and committees. Assessment strategies incorporated classroom response systems, portfolios, and games.
Lausd Presentation Jan 2009[1]
The document summarizes supplemental chemistry materials created by CST Score Boost to help improve student test scores on California standardized chemistry exams. It provides data showing the materials improved test scores at several underperforming Los Angeles high schools. It describes the materials' weekly lesson plans, advantages like improved classroom management and student engagement, and contact information for the creator.
Prep for mock exam 2
The document provides feedback on a mock exam paper and tips for students. It summarizes that students generally demonstrated a good understanding of case studies and examples but needed to provide more detail. Time management was also an issue, with most only completing one question within the allotted time instead of two. Specific feedback and advice is given for each exam question to help students improve their answers and exam performance.
09-10 Centralia College eLearning Satisfaction Data
Centralia College eLearning conducts a student satisfaction survey every quarter. These are the results for 2009-2010.
Judith Schwartz/QuestionPoint Use Study at Hunter College
An explorative evaluation of chat reference services at Hunter College was conducted over a 3 month period. The evaluation sought to identify question types, completion rates, and ways to improve the chat reference service. Key findings included that 55% of questions were reference questions, 57% of sessions were fully answered, and marketing and accessibility of the chat widget could be improved. The evaluation aims to enhance chat reference and identify areas for additional subject training.
Data Driven Dialogue
This document outlines a protocol called "Data Driven Dialogue" which is meant to guide teams in using data to answer questions about student achievement. The protocol involves 3 phases: 1) Making predictions before seeing data, 2) Objectively observing patterns in the data, and 3) Making inferences and determining appropriate actions/solutions based on the data. Key aspects include focusing discussions around essential questions, limiting assumptions until data is examined, and using data to replace hunches with facts about student performance.
Data Driven Dialogue
This document outlines a four-phase process for data-driven dialogue: 1) Participants predict survey results on standards and questions, rating agreement levels. 2) Teams visualize the survey data in graphics. 3) Participants objectively observe and record statements about direct facts from the data. 4) For each observation, participants infer meanings or questions raised, and discuss patterns, surprises, and new questions from the data.
Running a Survey
The document outlines the 9 main stages of conducting research: 1) Identifying a topic, 2) Background research, 3) Developing objectives, 4) Research strategy, 5) Data collection planning, 6) Data collection, 7) Analysis, 8) Creating a report, and 9) Evaluation. It then provides more details on common data collection methods like interviews, questionnaires, observation, and experiments. Key advice includes having clear objectives, reviewing existing literature, developing ethical and unbiased collection strategies, and analyzing results both quantitatively and qualitatively.
30 Minute Data Dialogue
(1) The document discusses a proposed 30-minute data dialogue process between teachers and principals to efficiently analyze classroom data and improve student outcomes.
(2) The process involves 7 steps: set expectations, observe and discuss data, evaluate curriculum, ask curriculum questions, identify student strengths/weaknesses, create an action step, and set next steps.
(3) The goal is to develop facilitation skills for efficient classroom data evaluation discussions and pilot the 30-minute dialogue process to improve teaching practice based on data analysis.
Science Project Experiment Template
This document outlines the structure and components for a student research project. It includes sections for identifying an independent and dependent variable, conducting research on each variable, formulating a hypothesis, describing required materials and procedures for an experiment, collecting and graphing data, analyzing results to conclude whether the hypothesis was proven, and listing references in a bibliography. Key elements that must be addressed are selecting search terms, finding a minimum number of facts from different sources about each variable, recording experimental data, and citing sources from both online and non-online materials.
DORA and the reinvention of research assessment
This document discusses problems with current research assessment approaches and recommendations from DORA to address them. It outlines eLife's motivations to serve science through a swift, fair review process and exploiting digital media. Current metrics like the Journal Impact Factor are journal-based, proprietary and incomplete. DORA recommends evaluating research based on its own merits using multiple indicators rather than journal names. Funders, institutions, publishers and metric providers are encouraged to consider article-level metrics and outcomes over journal reputation. Progress is being made as funders and institutions explore narrative assessments and considering a wider range of research outputs and impacts.
Exploring the exam paper section a
Section A of the exam paper focuses on media concepts, issues and debates, and wider contexts. For the first question on media concepts, students can answer using just the two unseen exam products provided. For the second question on media issues and debates, students may refer to other media products beyond the exam products. For the third question on wider contexts, students should refer to and include other media products beyond just the exam texts to fully support their answer. Both the second and third questions allow students to incorporate examples from their case studies and class work.
Eli Workshop PowerPoint
1. The document introduces Eli, a peer review tool that allows teachers to assign writing activities, collect student drafts and reviews, and analyze review data.
2. Research shows that routinely engaging in revision is associated with better writing performance, yet students do not often revise without explicit instruction. Eli aims to provide more opportunities for review and revision cycles.
3. The document demonstrates how Eli can be used by assigning a sample writing and review activity, and discusses the types of responses - criteria matching, scaled items, and comments - that Eli allows teachers to incorporate into reviews.
Innovations and Adaptations in Online Geography Education
This document discusses using online and experiential learning tools to teach geography. It covers learning styles, Kolb's experiential learning theory, and using virtual worlds like Second Life for hands-on learning. It proposes using quest-based learning and an AI system to provide feedback on student posts. The AI would score posts for "curiosity", flag low-quality posts, and suggest high-scoring posts for instructors to feature. Weekly reports would provide insights to instructors on discussion participation, post quality, and recommendations. Student reactions were mixed - they liked features for curiosity and interactions but disliked paying separately and lack of LMS integration.
Thailand ebooks market research
Thailand ebooks Market Research Study and White Paper. Determining Thai readership motivations and habits in order to determine market viability of a dedicated e-reader - ThailandeBooks.net
The Analysis and Interpretation of Qualitative Data Analysis.pdf
The document provides guidance for conducting qualitative interviews and analyzing the data for a research assignment on social change. It discusses best practices for interviews, including selecting an appropriate location and asking open-ended questions. It also outlines the assignment, which involves interviewing a peer, coding and analyzing the interview alongside other sources, and summarizing the meaning of social change based on the findings. Trustworthiness of the research process is also emphasized.
Use of online quizzes to support inquiry-based learning in chemical engineering
Online quizzes have been developed to help prepare first year undergraduate Chemical Engineering students for participating in group based assignments carried out in an inquiry-based learning (IBL) format. These online quizzes based within WebCT Vista allow the students to test their understanding of the fundamental chemical process principles required for the assignments before they participate in the IBL activity. Currently, the classes size is about 70 students therefore it is important to develop the students’ ability to carry out independent and self- directed learning to acquire these core skills. Using these online quizzes, the students are able to self-assess their strengths and weaknesses in the core chemical engineering principles and practice so that they come to the IBL group work more prepared.
The effectiveness of the online quizzes has been evaluated, using a triangulation approach incorporating a student questionnaire, student focus group and project leaders’ interview. Preliminary analysis of the results suggests that the students have found the online quizzes beneficial for developing their core skills in chemical process principles. The presentation will provide: a showcase for the online quizzes created; feedback from the first cohort of students to use the resources; and lessons learned and future developments.
More Related Content
What's hot
A Survey of Best Practices for Writing and Editing CME Needs Assessments
This e-poster won the People's Choice Award at the 2016 Annual Meeting of the Alliance for Continuing Education in the Health Professions (ACEHP)
Assessment during a pandemic: Using ACRL’s project OUTCOME to assess instruct...
Assessment during a pandemic: Using ACRL’s project OUTCOME to assess instruct...Georgia Libraries Conference (formerly Ga COMO).
Presenter: Ashley Dees
Presented at the virtual Georgia Libraries Conference in October 2020.
In Spring 2020, an assessment project was developed to assess the impact of library instruction to five Speech 102 classes. The assessment was administered in two parts using the immediate and follow-up surveys provided in the project OUTCOME platform. The immediate survey was administered via a print survey directly after the in-person instruction sessions. Due to the pandemic, the follow-up survey was administered six weeks after the instruction sessions via an online survey. This session will discuss using project OUTCOME, the findings of the assessment, and what librarians can learn from assessment projects during a semester of upheaval. Unit 1 assignment 1 blog
Qualitative research provides more in-depth and valuable information compared to quantitative research, which collects more vague findings. Primary research involves directly interviewing, surveying, or questioning people, and can be qualitative or quantitative. It has advantages like interviews providing specific answers or observation allowing researchers to watch people's daily activities without much interaction. Secondary research uses previous research findings from third parties through methods like questionnaires, surveys, books, or newspapers to support conclusions without conducting original research.
Learning impact awards student version
The self assessment modules are designed to help students test their understanding of course readings for each week. They consist of 3 multiple choice questions per topic, with feedback provided. If a question is answered incorrectly, students are directed to re-read that section. The modules include images, audio, video and other media to engage students. Student usage of the modules will be analyzed and a survey conducted to help improve them.
Authentic Assessment For School Libraries
This presentation provides a report from the AASL Fall Forum conference on assessment and school libraries.
High School Instructional Strategies Report 2009/2010
The document describes various instructional programs, strategies, and teacher professional development implemented at a school. Universal Design for Learning Strategies (UDL) and SWIFT reading strategies were implemented. Teacher professional development included training in UDL, reading apprenticeship, data analysis software, and content areas like math and science. Leadership opportunities for teachers included organizing field trips and committees. Assessment strategies incorporated classroom response systems, portfolios, and games.
Lausd Presentation Jan 2009[1]
The document summarizes supplemental chemistry materials created by CST Score Boost to help improve student test scores on California standardized chemistry exams. It provides data showing the materials improved test scores at several underperforming Los Angeles high schools. It describes the materials' weekly lesson plans, advantages like improved classroom management and student engagement, and contact information for the creator.
Prep for mock exam 2
The document provides feedback on a mock exam paper and tips for students. It summarizes that students generally demonstrated a good understanding of case studies and examples but needed to provide more detail. Time management was also an issue, with most only completing one question within the allotted time instead of two. Specific feedback and advice is given for each exam question to help students improve their answers and exam performance.
09-10 Centralia College eLearning Satisfaction Data
Centralia College eLearning conducts a student satisfaction survey every quarter. These are the results for 2009-2010.
Judith Schwartz/QuestionPoint Use Study at Hunter College
An explorative evaluation of chat reference services at Hunter College was conducted over a 3 month period. The evaluation sought to identify question types, completion rates, and ways to improve the chat reference service. Key findings included that 55% of questions were reference questions, 57% of sessions were fully answered, and marketing and accessibility of the chat widget could be improved. The evaluation aims to enhance chat reference and identify areas for additional subject training.
Data Driven Dialogue
This document outlines a protocol called "Data Driven Dialogue" which is meant to guide teams in using data to answer questions about student achievement. The protocol involves 3 phases: 1) Making predictions before seeing data, 2) Objectively observing patterns in the data, and 3) Making inferences and determining appropriate actions/solutions based on the data. Key aspects include focusing discussions around essential questions, limiting assumptions until data is examined, and using data to replace hunches with facts about student performance.
Data Driven Dialogue
This document outlines a four-phase process for data-driven dialogue: 1) Participants predict survey results on standards and questions, rating agreement levels. 2) Teams visualize the survey data in graphics. 3) Participants objectively observe and record statements about direct facts from the data. 4) For each observation, participants infer meanings or questions raised, and discuss patterns, surprises, and new questions from the data.
Running a Survey
The document outlines the 9 main stages of conducting research: 1) Identifying a topic, 2) Background research, 3) Developing objectives, 4) Research strategy, 5) Data collection planning, 6) Data collection, 7) Analysis, 8) Creating a report, and 9) Evaluation. It then provides more details on common data collection methods like interviews, questionnaires, observation, and experiments. Key advice includes having clear objectives, reviewing existing literature, developing ethical and unbiased collection strategies, and analyzing results both quantitatively and qualitatively.
30 Minute Data Dialogue
(1) The document discusses a proposed 30-minute data dialogue process between teachers and principals to efficiently analyze classroom data and improve student outcomes.
(2) The process involves 7 steps: set expectations, observe and discuss data, evaluate curriculum, ask curriculum questions, identify student strengths/weaknesses, create an action step, and set next steps.
(3) The goal is to develop facilitation skills for efficient classroom data evaluation discussions and pilot the 30-minute dialogue process to improve teaching practice based on data analysis.
Science Project Experiment Template
This document outlines the structure and components for a student research project. It includes sections for identifying an independent and dependent variable, conducting research on each variable, formulating a hypothesis, describing required materials and procedures for an experiment, collecting and graphing data, analyzing results to conclude whether the hypothesis was proven, and listing references in a bibliography. Key elements that must be addressed are selecting search terms, finding a minimum number of facts from different sources about each variable, recording experimental data, and citing sources from both online and non-online materials.
DORA and the reinvention of research assessment
This document discusses problems with current research assessment approaches and recommendations from DORA to address them. It outlines eLife's motivations to serve science through a swift, fair review process and exploiting digital media. Current metrics like the Journal Impact Factor are journal-based, proprietary and incomplete. DORA recommends evaluating research based on its own merits using multiple indicators rather than journal names. Funders, institutions, publishers and metric providers are encouraged to consider article-level metrics and outcomes over journal reputation. Progress is being made as funders and institutions explore narrative assessments and considering a wider range of research outputs and impacts.
Exploring the exam paper section a
Section A of the exam paper focuses on media concepts, issues and debates, and wider contexts. For the first question on media concepts, students can answer using just the two unseen exam products provided. For the second question on media issues and debates, students may refer to other media products beyond the exam products. For the third question on wider contexts, students should refer to and include other media products beyond just the exam texts to fully support their answer. Both the second and third questions allow students to incorporate examples from their case studies and class work.
Eli Workshop PowerPoint
1. The document introduces Eli, a peer review tool that allows teachers to assign writing activities, collect student drafts and reviews, and analyze review data.
2. Research shows that routinely engaging in revision is associated with better writing performance, yet students do not often revise without explicit instruction. Eli aims to provide more opportunities for review and revision cycles.
3. The document demonstrates how Eli can be used by assigning a sample writing and review activity, and discusses the types of responses - criteria matching, scaled items, and comments - that Eli allows teachers to incorporate into reviews.
Innovations and Adaptations in Online Geography Education
This document discusses using online and experiential learning tools to teach geography. It covers learning styles, Kolb's experiential learning theory, and using virtual worlds like Second Life for hands-on learning. It proposes using quest-based learning and an AI system to provide feedback on student posts. The AI would score posts for "curiosity", flag low-quality posts, and suggest high-scoring posts for instructors to feature. Weekly reports would provide insights to instructors on discussion participation, post quality, and recommendations. Student reactions were mixed - they liked features for curiosity and interactions but disliked paying separately and lack of LMS integration.
Thailand ebooks market research
Thailand ebooks Market Research Study and White Paper. Determining Thai readership motivations and habits in order to determine market viability of a dedicated e-reader - ThailandeBooks.net
What's hot (20)
A Survey of Best Practices for Writing and Editing CME Needs Assessments
A Survey of Best Practices for Writing and Editing CME Needs Assessments
Assessment during a pandemic: Using ACRL’s project OUTCOME to assess instruct...
Assessment during a pandemic: Using ACRL’s project OUTCOME to assess instruct...
High School Instructional Strategies Report 2009/2010
High School Instructional Strategies Report 2009/2010
09-10 Centralia College eLearning Satisfaction Data
09-10 Centralia College eLearning Satisfaction Data
Judith Schwartz/QuestionPoint Use Study at Hunter College
Judith Schwartz/QuestionPoint Use Study at Hunter College
Innovations and Adaptations in Online Geography Education
Innovations and Adaptations in Online Geography Education
Similar to Phase II Overview of Information Literacy Assessment Project
The Analysis and Interpretation of Qualitative Data Analysis.pdf
The document provides guidance for conducting qualitative interviews and analyzing the data for a research assignment on social change. It discusses best practices for interviews, including selecting an appropriate location and asking open-ended questions. It also outlines the assignment, which involves interviewing a peer, coding and analyzing the interview alongside other sources, and summarizing the meaning of social change based on the findings. Trustworthiness of the research process is also emphasized.
Use of online quizzes to support inquiry-based learning in chemical engineering
Online quizzes have been developed to help prepare first year undergraduate Chemical Engineering students for participating in group based assignments carried out in an inquiry-based learning (IBL) format. These online quizzes based within WebCT Vista allow the students to test their understanding of the fundamental chemical process principles required for the assignments before they participate in the IBL activity. Currently, the classes size is about 70 students therefore it is important to develop the students’ ability to carry out independent and self- directed learning to acquire these core skills. Using these online quizzes, the students are able to self-assess their strengths and weaknesses in the core chemical engineering principles and practice so that they come to the IBL group work more prepared.
The effectiveness of the online quizzes has been evaluated, using a triangulation approach incorporating a student questionnaire, student focus group and project leaders’ interview. Preliminary analysis of the results suggests that the students have found the online quizzes beneficial for developing their core skills in chemical process principles. The presentation will provide: a showcase for the online quizzes created; feedback from the first cohort of students to use the resources; and lessons learned and future developments.
How to design questionnaire
The document provides guidance on designing effective questionnaires. It emphasizes that questionnaires must have well-defined objectives in order to ask relevant questions and draw meaningful conclusions from the responses. Questions should follow logically from clear objectives. It also stresses that both open-ended and closed-format questions each have advantages, and the type of questions used should depend on the specific information needed. Demographic questions can help analyze response patterns among different groups. Overall, carefully considering objectives, question types, and question wording is essential for creating a questionnaire that efficiently gathers high-quality data.
Rossiter and Biggs (2008) - Development of Online Quizzes to Support Problem-...
Presentation given by Dr Diane Rossiter and Dr Catherine Biggs of the Department of Department of Chemical and Process Engineering at the University of Sheffield at the 2008 International Blended Learning Conference (University of Hertfordshire), entitled: "Development of online quizzes to support problem-based learning in chemical engineering"
In-Depth Interviews: Techniques and Best Practices
Slides from a 2-hour facilitated workshop presented at the Alliance for Continuing Education in the Health Professions
Interview workshop slides final
- The doctor was asked which drug class they prefer to use in patients who fail on oral monotherapy: SGLT2 inhibitors or DPP4 inhibitors
- They explained that they typically prefer SGLT2 inhibitors due to their beneficial effects on cardiovascular and renal outcomes as well as weight loss
- However, they noted that DPP4 inhibitors are better tolerated with less side effects like genital infections
- In the end, they said the decision depends on the individual patient's profile, comorbidities, and preferences
Questionnaires 6 steps for research method.
The document summarizes the six key steps to developing and administering an effective questionnaire: 1) Determine your questions, 2) Draft questionnaire items, 3) Sequence the items, 4) Design the questionnaire, 5) Pilot-test the questionnaire, and 6) Develop a strategy for data collection and analysis. It provides details on each step, including how to write different types of questions, organize sections, and test and distribute the questionnaire. The overall aim is to systematically gather accurate information from respondents through a standardized self-reporting tool.
An evidence based model
An evidence-based model to enhance programme-wide assessment using technology: TESTA to FASTECH . Presented by Tansy Jessop and Yaz El-Hakim (University of Winchester) and Paul Hyland (Bath Spa University). Facilitated by Mark Russell (University of Hertfordshire).
Jisc conference 2011
Reduce, Reuse, Recycle: Revamping a Freshman Seminar Information Literacy Pro...
The document summarizes revisions made to an information literacy program for freshman students at the University of Rhode Island. The original program consisted of a library tour, demonstration of the catalog, and worksheet. It was revised using backward design and assessment principles to make it more engaging for students and mentors. The revised program included a pre-activity research exercise, classroom session with discussion questions, and post-activity scavenger hunt. Assessment found students were more engaged and learned the intended goals and outcomes.
Improving and Demonstrating Impact for Youth Using Qualitative Data
This workshop provided an overview of how to use qualitative data for improving and demonstrating the impact of youth development programs. Tips for collecting, analyzing and using qualitative data are provided. Examples of creative ways to visualize qualitative data are also shared.
Questionnaire as a tool for assessment
This document discusses questionnaires, including what they are, their purpose, and how to create them. A questionnaire is a standardized set of questions used to collect statistical data from respondents. It can be administered in-person, by phone, mail, or online. The main purpose is to efficiently obtain large amounts of data from many people. While a questionnaire simply collects responses, a survey is the full process of collecting, analyzing, and reporting results. Questionnaires can be descriptive to document current information or analytical to explore relationships between variables. Questions can be open-ended for free responses or closed-ended with predetermined answer options. Following best practices like clear goals and proper targeting helps ensure an effective questionnaire design.
Tool design
A questionnaire is a research instrument consisting of a series of questions and other prompts for the purpose of gathering information from respondents.
TESTA to FASTECH (November 2011)
This document summarizes an online presentation about an evidenced-informed approach to enhancing program-wide assessment. The presentation discusses research from the TESTA project, which examined assessment patterns across different university programs. The research found high variability in assessment practices between programs. It also identified trends like high summative assessment and low formative assessment that can discourage regular student effort. The presentation proposes the FASTECH project to use technology to improve feedback and assessment practices in ways that better support student learning.
ENV 101Final Project GuidanceDraft ScaffoldA. INTRODUCTION.docx
ENV 101
Final Project Guidance
Draft Scaffold
A. INTRODUCTION
Why is this topic/question one that you wanted to ask?
Why is it important that we learn more about this topic/question?
My research question(s) is/are…
B. LITERATURE REVIEW:
What do we already know about this topic?
Topic 1:
Topic 2:
Topic 3:
Topic 4:
Topic 5:
C. METHOD
How are you collecting original data/information?
Why is that method the right one for the question you are asking?
Who are your participants?
How do you have access to your participants?
What questions are you asking them? OR In what ways are you modifying a behavior?
D. RESULTS
If you have some results already what are they?
If you don’t have results already, consider your questions or your actions, what do you expect to see?
How do you plan on displaying your results? (This might be a table, if you have multiple participants, it might be a written paragraph for each question that you ask, it might be a log of your behavior modification, day by day)
E. ANALYSIS AND INSIGHTS
What did your literature review tell you in answer to the research question that you asked?
What did your original data collection tell you in answer to your research question?
Did your original data collection support or correspond with what you found in your literature review?
What did you find challenging about you behavior modification, if that is what you did? How did your survey/interview participants struggle with the questions that you asked, if that was your method of data collection?
ENV 101
Introduction to Environmental Science
FINAL PROJECT
The learning objectives for this class are the following:
-understand the basic environmental processes that shape the natural world around them.
-evaluate the reciprocal relationship between human and environmental systems.
-consider environmental problems from both a global and a local perspective.
-understand the impact of human decisions on the natural environment (both positive and negative).
-understand some of the ways in which scientists gather information, as well as, analyze and communicate their findings.
Everything we did in class was aimed at improved your understanding and skill related to these learning objectives. I don’t want you all to leave as scientists, but I want you to be able to navigate scientific information related to environmental issues with some understanding and ability to take it apart and use it to make well-informed decisions.
The final project is designed to give you the opportunity to reflect the improvement in your understanding and skill and to consider your relationship to the environment. For this project, you will select a behavior that you engage in, that has an impact on the environment. This behavior will be the foundation of a research question that investigate and use to inform your perspective on this particular environmental beha ...
Trials by Juries: Suggested Practices for Database Trials
This panel discussion focused on tools and techniques for gathering feedback on database trials from librarians and library users. The panelists from Golden Gate University, University of Nebraska-Kearney, and Clemson University discussed criteria for selecting database trials, scheduling trials, soliciting and recording trial feedback, and closing the loop with participants and vendors after a trial. Key points included using web surveys to gather feedback, timing trials to maximize participation, and maintaining records of past trials and decisions.
DEVELOPMENT of Research Tool Power Point.pptx
This document discusses various research tools and techniques used for data collection. It defines research tools as instruments used by researchers to measure what they intend to study. Some major tools discussed are questionnaires, checklists, observation, interviews, psychological tests, and sociometry. The document provides details on the purpose, types, and use of each tool to effectively collect reliable and valid data relevant to the research questions.
A bibliography is a list of citations of sources such as books, .docx
A bibliography is a list of citations of sources such as books, articles, and documents that were used for one’s research. Bibliographies may also be called ‘references’ especially when found at the end of an academic paper.
An annotation is a summary and/or evaluative comment. The purpose of an annotated bibliography is to inform the reader of the relevance, accuracy, and quality of the sources cited. Thus, an annotated bibliography consists of a citation followed by its descriptive summary and a critical review of the source.
Typically an annotated bibliography includes one or more of the following: summary, assessment, and reflection of the source. In this exercise we will practice writing an annotated bibliography with all three components.
Summary: Annotation provides summary of the source. It is important to paraphrase sources rather than directly copy and paste the content. Here are guiding questions: What are the main arguments? What is the point of this book or article? What topics are covered? If someone asked what this article/book is about, what would you say? The length of your annotations will determine how detailed your summary is.
Assessment: Writing an evaluative comment after summarizing the source. Here are guiding questions: Does it seem like a reliable and current source? Why? Is the research biased or objective? Are the facts well documented? Who is the author? Is s/he qualified in this subject? Is this source scholarly, popular, both? How does it compare with other sources in your bibliography?
Reflection: After summarizing and assessing the source, ask yourself whether or not the source fits your study. Here are guiding questions: Was this source helpful to you? How does it help you shape your argument? How can you use this source in your research project? Has it changed the way you think about your topic?Length:
An annotated bibliography is about 150-300 words in length including the brief summary, assessment, and reflection.
Citation of Article 1 in APA Styles
Summary: Annotation provides summary of the source. It is important to paraphrase sources rather than directly copy and paste the content. Here are guiding questions: What are the main arguments? What is the point of this book or article? What topics are covered? If someone asked what this article/book is about, what would you say? The length of your annotations will determine how detailed your summary is.
Assessment: Writing an evaluative comment after summarizing the source. Here are guiding questions: Does it seem like a reliable and current source? Why? Is the research biased or objective? Are the facts well documented? Who is the author? Is s/he qualified in this subject? Is this source scholarly, popular, both? How does it compare with other sources in your bibliography?
Reflection: After summarizing and assessing the source, ask yourself whether or not the source fits your study. Here are guiding questions: Was this .
Survey research
The document provides an overview of survey research and questionnaire design. It discusses that surveys are used to collect data and facts from a target population about a certain situation or issue. The key steps in survey research include developing hypotheses, designing the survey questions and format, sampling, data collection, analysis, and reporting findings. It also describes different types of surveys, methods of data collection including mail, interview and telephone surveys, and considerations for question structure, format, and response options. The document emphasizes that carefully designing and testing the questionnaire is important for effective survey research.
QUESTIONNAIRE METHOD.pptx
PAPER-2, CONTEMPORARY INDIA AND EDUCATION , Tools of Examination , Questionnaire Method, Important Question for B.Ed. , CRSU, CDLU, MDU, Agra University, Education Colleges
Evidence based librarianship in practice: Using evidence in health sciences l...
The document outlines steps in the evidence-based practice process for health sciences librarians, including identifying barriers, formulating answerable questions, and locating and creating various types of evidence. It discusses barriers like time constraints and provides examples of evidence sources like published research, local usage data, and stakeholder feedback. The objectives are to help librarians understand evidence-based practice and apply it to their work by addressing real questions.
Similar to Phase II Overview of Information Literacy Assessment Project (20)
The Analysis and Interpretation of Qualitative Data Analysis.pdf
The Analysis and Interpretation of Qualitative Data Analysis.pdf
Use of online quizzes to support inquiry-based learning in chemical engineering
Use of online quizzes to support inquiry-based learning in chemical engineering
Rossiter and Biggs (2008) - Development of Online Quizzes to Support Problem-...
Rossiter and Biggs (2008) - Development of Online Quizzes to Support Problem-...
In-Depth Interviews: Techniques and Best Practices
In-Depth Interviews: Techniques and Best Practices
Reduce, Reuse, Recycle: Revamping a Freshman Seminar Information Literacy Pro...
Reduce, Reuse, Recycle: Revamping a Freshman Seminar Information Literacy Pro...
Improving and Demonstrating Impact for Youth Using Qualitative Data
Improving and Demonstrating Impact for Youth Using Qualitative Data
ENV 101Final Project GuidanceDraft ScaffoldA. INTRODUCTION.docx
ENV 101Final Project GuidanceDraft ScaffoldA. INTRODUCTION.docx
Trials by Juries: Suggested Practices for Database Trials
Trials by Juries: Suggested Practices for Database Trials
A bibliography is a list of citations of sources such as books, .docx
A bibliography is a list of citations of sources such as books, .docx
Evidence based librarianship in practice: Using evidence in health sciences l...
Evidence based librarianship in practice: Using evidence in health sciences l...
Phase II Overview of Information Literacy Assessment Project
- 1. A Standardized Approach to Assessment – Phase 2 New Improvements Based on Student , Consultant & Library Faculty Feedback Shannon M. Staley Education & Web Services Librarian
- 2. In 2008 / 2009, We Began By: Developing and testing an assessment tool that could: Facilitate the development of pre and post achievement tests Link survey questions to learning outcomes and ACRL standards Deliver real time reports and statistical analysis
- 3. In 2010, We Asked the Question:How can we improve the tool and the assessment process? Usability testing sessions with librarians who have not used the tool More cognitive interviews with students to improve question development Improved statistical analysis Focus group with librarians who have used the tool
- 5. Usability Sessions: Changes you asked for Comment: I didn’t understand where I was when I entered the tool.
- 6. Usability Sessions: Changes you asked for Remedy: A clearly defined menu as the starting screen
- 7. Usability Sessions: Changes you asked for Comment: Make it easier to toggle from my personal account to all questions and possibly select and copy some for my account.
- 9. It’s easier to add and remove questions.
- 10. The “My Questions” view and “All Questions” view are different colors for more distinction.
- 12. Usability Sessions: Changes you asked for Remedy: A message indicates the survey was created and the URL to the survey is provided so that it can be posted anywhere.
- 13. 2. More Cognitive Interviews
- 15. During the cognitive interview process, the interviewer uses techniques to elicit feedback on survey questions.
- 22. Asteriks by values in the matrix show statistically significant relationships between background factors.
- 25. Do numbers offer the big picture of teaching effectiveness?
- 26. Need more research to develop a cut score or acceptable percentage of correct responses.
- 27. Need to gather support from other SJSU librarians and get campus endorsement
- 29. Complete data collected from usability testing sessions