• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Qualitative and quantitative student assessment
 

Qualitative and quantitative student assessment

on

  • 8,425 views

Workshop given by Gail Matthews-DeNatale to the 2009 NERCOMP conference on assessment in higher education.

Workshop given by Gail Matthews-DeNatale to the 2009 NERCOMP conference on assessment in higher education.

Statistics

Views

Total Views
8,425
Views on SlideShare
8,424
Embed Views
1

Actions

Likes
0
Downloads
0
Comments
0

1 Embed 1

http://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Assessment is a form of research, whether it’s an investigation into what students know/understand, how a program is going, etc.
  • The definition of what’s being assessed is integral to defining a strategy for assessment For example, In the 21st Century, meaning of information is made across a range of media and formats MIT, UC Santa Barbara, Simmons, are all moving in the direction of transliteracy, which is defined as The ability to find, assess credibility, analyze, read, and author across a range of platforms, tools and media: texts, visualizations, multimedia, video, etc.

Qualitative and quantitative student assessment Qualitative and quantitative student assessment Presentation Transcript

  • Qualitative and Quantitative Student Assessment Gail Matthews-DeNatale Simmons College
    • Presentation based on a two day workshop for NERCOMP
    • Developed in collaboration by Brandeis, Simmons, and Bryn Mawr
    • Workshop agenda/files located at http://www.nercomp.org/events/event_single.aspx?id=1763 http://www.nercomp.org/events/event_single.aspx?id=5734
    Preliminary Caveat
  • The Cycle of Assessment … is a cycle of research Identify Issue(s) Define Research Question Design, Implement Strategy Interpret Data Act Upon Findings
  • Issues to Consider
    • Formative vs. Summative
    • How do you plan to use the results?
    • To inform future work OR evaluate accomplishments of students
    • To inform program and workshop offerings OR to evaluate the effectiveness of programs that are in place
    • Be clear, up front, with yourself and with your students
    • Topic: What is it that you’re trying to assess?
    • Purpose: Why is it important to assess?
    • Central Question: What do you want to know?
    50,000 Foot View Topic: Student information literacy Purpose: Ensure college preparedness Question: In what areas do students need to improve? Issues to Consider
    • But It’s Not That Simple
    • What do we mean by “information literacy”?
    • What expectations do colleges have for the information literacy of their incoming students? Does this expectation vary depending on the type of school?
    • How do we intend to use the assessment to improve student preparedness? … Work with individual students? … Change program offerings?
    Issues to Consider
  • Convergence Culture Transliteracy Research Focus & Question What, specifically, is being assessed? For example, “information literacy” as … University of California, Santa Barbara Transliteracies Project, http://transliteracies.english.ucsb.edu Howard Rheingold, 21st Century Literacies http://www.blip.tv/file/2373937
  • Thought Experiment: What would an “information literate” person DO with the following? Assessment Design Strategy: Begin with Outcomes
  • What type of assessment(s) will yield the desired evidence? How will you know what students DID with these examples? Assessment = Evidence
  • Open-ended Question Focus Group Think Aloud ePortfolio One-on-One Interview Observation or Shadowing Role Play or Simulation Thought Experiment Option: Qualitative Assessment In Conjunction with Novice-to-Expert Rubric
  • Surveys T/F and MC Tests Sounds simple, but the devil is in the details!
    • Is the sample statistically significant?
    • Are the questions “testing” what you need to know?
    • Are the questions clear?
    • Do you have the expertise to analyze results?
    Option: Quantitative Assessment
  • Quantitative Tells You “What” Qualitative Tells You “Why” Qualitative vs. Quantitative A False Dichotomy
  • For Example Quant Multiple Choice: You are doing background research for a science project. In addition to perusing library sources, you decide to go online and see what’s available. You come across two web sites. Which site do you think is more credible? Qual Open Ended: Why?
  • Results Only 24% selected the most credible site for the appropriate reasons
    • A website is more credible if it …
    • has a .org domain name (more credible than .gov)
    • has lots of “information” / links
    • has a “shorter,” “easy,” “straightforward” URL
    • includes information on how to “send feedback” and/or contact the webmaster/designer
    • “ comes from the United States”
    • “ claims to be unbiased”
    • is “official,” or has a name that “sounds official” (such as “Centers” and “Organizations”)
    • links to other “well-known organizations”
    • includes advertising … a search option … press releases … has a “professional “look”
    Results
  • Use Results to Guide Teaching, Inform Program Development A Comparison of Student Perceptions of their Computer Skills to their Actual Abilities (NC Central University) Focus: Difference in perception and performance Results: Some areas of self perception vs. ability were accurate, others were significantly divergent. Action: As a result of this research, the curriculum for the introductory course was redesigned to focus on areas of divergence http://jite.org/documents/Vol8/JITEv8p141-160Grant428.pdf
  • Cycle of Assessment, Full Circle! Identify Issue Define Research Question Design, Implement Strategy Interpret Data Act Upon Findings
  • Gail Matthews-DeNatale Simmons College [email_address]