1. This work is supported by the National Science Foundation’s Transforming Undergraduate Education in STEM program within the
Directorate for Education and Human Resources (DUE-1245025).
GETSI CLASSROOM TESTING & STUDENT DATA
COLLECTION
KRISTIN O’CONNELL, ELLEN IVERSON, BETH PRATT-SITAULA
The webinar begins at:
11 am PT | 12 pm MT | 1 pm CT | 2 pm ET
For audio, call: 1-800-704-9804
(or 1-404-920-6604)
Access Code: 472 58 282
Press *6 to mute and unmute
(but hopefully we won’t need any muting)
2. GOALS FOR THIS WEBINAR
By the end of the webinar you will be able to:
1. Find more information as you need it:
– Web resources
– Timeline
– IRB
2. Know timing of piloting testing w/r/t authoring and
rubric review
3. Understand what data will be collected, why, and
how (GLE, attitudinal surveys, student work)
3. Identify Course
& Module
Learning Goals
Identify learning
objectives for
individual
lessons
Determine how
to assess and
measure student
success on goals
and objectives
Design teaching
resources and
materials to
match
assessments
Plan
Instructional
Strategies to
implement
teaching
resources
Pilot Materials,
Make changes
4. CLASSROOM PILOT & DATA COLLECTION
*IRB approval
Development Timeline
http://serc.carleton.edu/getsi/info_team_members/timeline.html
5.
6. • Pre- & Post-course Geoscience Literacy
Assessment (GLE 8 MC questions)
• 2 from each literacy document
• 4 Single answer and 4 “select all that apply”
• Two post-course short essay questions
(interdisciplinary & systems thinking)
http://serc.carleton.edu/integrate/info_team_members/currdev/documents/gle/index.html
9. • Graded by faculty of the pilot testing classroom
based upon a rubric
• Summative and conclusive measuring the level
of understanding when learning related to that
module goal is completed
• Used in the same fashion in all materials pilot-
testing classrooms
http://serc.carleton.edu/integrate/info_team_members/currdev/assessment.html#sum
10. • Pre- & post-course motivation and career interest
survey (related to project evaluation)
http://serc.carleton.edu/getsi/info_team_members/forms_docs/index.html
11. • Course Information
• Demographic data
• Faculty Reflection Surveys
• Checkpoint 4 (after development)
• Notes while teaching (individual reporting page)
• Post-Pilot
• After Revisions
12. • Conducted and setup through SERC using
course set-up form
http://serc.carleton.edu/getsi/info_team_members/forms_docs/course_form.html
13. GETSI COURSE STATUS PAGE
• Once your course set-up form is completed,
this will be your go-to place to see your
progress in the assessment process
http://serc.carleton.edu/integrate/info_team_members/currdev/status_page.html
14.
15. • Make contact with your IRB early (Checkpoint 1)
• Know that IRB procedures vary by institution
• Give project list of which students do not consent
• Carleton College has EXEMPT status
• You will need Carleton letter
• Consent form examples are posted
• http://serc.carleton.edu/getsi/info_team_members/forms_docs/index.h
tml
• Ask for help!
IRB: What you Need to Know
16. • Give students option to opt out at
beginning of term
• Implied consent
• Signed consent
IRB: What you need to know
What about consent?
http://serc.carleton.edu/getsi/info_team_members/timeline.html#irb
18. GOALS FOR THIS WEBINAR
By the end of the webinar you will be able to:
1. Find more information as you need it:
– Web resources
– Timeline
– IRB
2. Know timing of piloting testing w/r/t authoring and
rubric review
3. Understand what data will be collected, why, and
how (GLE, attitudinal surveys, student work)
19. Testing Process and Assessment
What questions do you
have about testing and
data collection?
20. “HOMEWORK”
• Fill out Course Set Up form
• IRB process if needed
http://serc.carleton.edu/getsi/info_team_members/forms_docs/course_form.html
http://serc.carleton.edu/getsi/info_team_members/forms_docs/index.html
