SASTA Psychology Summer Conference Assessment Report 2009 January 2010
Introductions <ul><li>Cliff Rothenberg </li></ul><ul><ul><li>SASTA Board Member </li></ul></ul><ul><li>Geoff Slater (short...
Advice <ul><li>Assessment report </li></ul><ul><ul><li>read, digest, and pass to students </li></ul></ul><ul><li>Like scho...
Assessment Processes <ul><li>Teams (increases the reliability, validity, and  fairness of the outcomes) </li></ul><ul><ul>...
Assessment Modes <ul><li>Assessment Components </li></ul><ul><ul><li>Examination (sets the standard) </li></ul></ul><ul><u...
Examination Specifications <ul><li>Learning Outcomes 1, 4, 5, and 6 </li></ul><ul><li>1 knowledge and understanding </li><...
Specifications <ul><li>Criteria for judging performance </li></ul><ul><ul><li>knowledge   (40) </li></ul></ul><ul><ul><li>...
Total 120 communication evaluation application analysis knowledge Levels Ethics 6 5 4 3 2 1 Criteria TOPIC
Examination 2009
Examination 2008
Historical Data 58.4 2096 2008 51.2 2851 2009 55.5 1996 2007 59.2 1740 2006 59.6 1242 2005 61.3 597 2004 Mean % Enrolment ...
Research Tools <ul><li>Like schools data </li></ul><ul><li>Standard deviation, question means </li></ul><ul><li>Question f...
Q1:  Focus groups are a  QUALITATIVE  investigation  design Question mean: 62.2%
Q2:  One disadvantage of EXPERIMENTAL  investigation  design Question mean: 62.5%
Q4:  Describe DELPHI TECHNIQUE Question mean: 36.5%
Q5:  Describe CONTENT ANALYSIS Question mean: 29.3%  (lowest mean for the exam)
Q7:  One LIMITATION OF SAMPLE (zoo baboons) Question mean: 84.6% (highest mean for the exam)
Q24:  EXTENDED RESPONSE 1 (Social Cognition –ALCOHOL CAMPAIGNS and SOCIAL COMPARISON) Question mean: 52.5% (Exam mean 51.2%)
Q25:  EXTENDED RESPONSE 2 (Altered States and Healthy Minds –STRESS and  RESILIENCE IN YEAR 12) Question mean: 52.2% (Exam...
Statistical Moderation Effects
Used this data to…. School Assessment Report
Moderation Impact … generate this! After moderation After stat. mod 58 58 64 82 82 2004 57 57 64 82 82 2005 2006 2003 2002...
Advice <ul><li>Assessment report </li></ul><ul><ul><li>read, digest, and pass to students </li></ul></ul><ul><li>Like scho...
 
Upcoming SlideShare
Loading in …5
×

Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10

434 views
363 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
434
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • ## * * 07/16/96 No evidence of marks being inflated over time Large moderation effects for a few schools in Practical and Social Relevance in 2002 Exam around 60% each year Note that moderated Course Work = Exam mark Course Work moderated slightly by Examination Practical and Social Relevance would be moderated significantly by examination Averages: Practical 82% , Soc Rel 80%
  • Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10

    1. 1. SASTA Psychology Summer Conference Assessment Report 2009 January 2010
    2. 2. Introductions <ul><li>Cliff Rothenberg </li></ul><ul><ul><li>SASTA Board Member </li></ul></ul><ul><li>Geoff Slater (short-answer) </li></ul><ul><ul><li>Curriculum Leaders Group, SACE Board of SA </li></ul></ul><ul><ul><li>Psychology Study Guide Co-Editor, SASTA </li></ul></ul><ul><li>Penny Spencer (extended-response) </li></ul><ul><ul><li>Curriculum Leaders Group, SACE Board of SA </li></ul></ul>
    3. 3. Advice <ul><li>Assessment report </li></ul><ul><ul><li>read, digest, and pass to students </li></ul></ul><ul><li>Like schools data (moderation) </li></ul><ul><ul><li>from SACE Board coordinator </li></ul></ul><ul><li>School Assessment Information report </li></ul><ul><ul><li>analyse both statistical and final moderation of your class v total cohort </li></ul></ul><ul><li>Moderation Feedback Advice (green) </li></ul><ul><ul><li>seek advice if movement has been great </li></ul></ul><ul><li>Apply to join a marking or moderation panel </li></ul>
    4. 4. Assessment Processes <ul><li>Teams (increases the reliability, validity, and fairness of the outcomes) </li></ul><ul><ul><li>Setting </li></ul></ul><ul><ul><li>Vetting </li></ul></ul><ul><ul><li>Marking 3 (remarks) </li></ul></ul><ul><ul><li>Final Central Moderation </li></ul></ul><ul><li>Expression of interest: advertisements </li></ul>
    5. 5. Assessment Modes <ul><li>Assessment Components </li></ul><ul><ul><li>Examination (sets the standard) </li></ul></ul><ul><ul><li>Assignment </li></ul></ul><ul><ul><ul><li>Statistically moderated </li></ul></ul></ul><ul><ul><li>Collaborative Investigation </li></ul></ul><ul><ul><ul><li>Central moderation </li></ul></ul></ul><ul><ul><li>Individual Investigation </li></ul></ul><ul><ul><ul><li>Central moderation </li></ul></ul></ul>
    6. 6. Examination Specifications <ul><li>Learning Outcomes 1, 4, 5, and 6 </li></ul><ul><li>1 knowledge and understanding </li></ul><ul><li>4 informed decision making </li></ul><ul><li>5 application of knowledge </li></ul><ul><li>6 analysis of behaviour </li></ul><ul><li>Rules of thumb </li></ul><ul><ul><li>1/3, 1/3, 1/3 </li></ul></ul><ul><ul><li>mean 60% </li></ul></ul>
    7. 7. Specifications <ul><li>Criteria for judging performance </li></ul><ul><ul><li>knowledge (40) </li></ul></ul><ul><ul><li>analysis (25) </li></ul></ul><ul><ul><li>application (25) </li></ul></ul><ul><ul><li>evaluation (20) </li></ul></ul><ul><ul><li>communication (10) </li></ul></ul><ul><ul><li>Total 120 </li></ul></ul>
    8. 8. Total 120 communication evaluation application analysis knowledge Levels Ethics 6 5 4 3 2 1 Criteria TOPIC
    9. 9. Examination 2009
    10. 10. Examination 2008
    11. 11. Historical Data 58.4 2096 2008 51.2 2851 2009 55.5 1996 2007 59.2 1740 2006 59.6 1242 2005 61.3 597 2004 Mean % Enrolment Year
    12. 12. Research Tools <ul><li>Like schools data </li></ul><ul><li>Standard deviation, question means </li></ul><ul><li>Question facility indices </li></ul><ul><li>Scaling transformations </li></ul><ul><li>Moderation reports </li></ul><ul><li>Score distribution </li></ul><ul><li>Decile analysis </li></ul>
    13. 13. Q1: Focus groups are a QUALITATIVE investigation design Question mean: 62.2%
    14. 14. Q2: One disadvantage of EXPERIMENTAL investigation design Question mean: 62.5%
    15. 15. Q4: Describe DELPHI TECHNIQUE Question mean: 36.5%
    16. 16. Q5: Describe CONTENT ANALYSIS Question mean: 29.3% (lowest mean for the exam)
    17. 17. Q7: One LIMITATION OF SAMPLE (zoo baboons) Question mean: 84.6% (highest mean for the exam)
    18. 18. Q24: EXTENDED RESPONSE 1 (Social Cognition –ALCOHOL CAMPAIGNS and SOCIAL COMPARISON) Question mean: 52.5% (Exam mean 51.2%)
    19. 19. Q25: EXTENDED RESPONSE 2 (Altered States and Healthy Minds –STRESS and RESILIENCE IN YEAR 12) Question mean: 52.2% (Exam mean 51.2%)
    20. 20. Statistical Moderation Effects
    21. 21. Used this data to…. School Assessment Report
    22. 22. Moderation Impact … generate this! After moderation After stat. mod 58 58 64 82 82 2004 57 57 64 82 82 2005 2006 2003 2002 2001 2000 YEAR 62 62 65 79 80 56 56 65 82 83 63 63 65 82 83 65 65 67 83 83 59 59 68 84 84 Exam Course Work Practical & Social Relevance
    23. 23. Advice <ul><li>Assessment report </li></ul><ul><ul><li>read, digest, and pass to students </li></ul></ul><ul><li>Like schools data (moderation) </li></ul><ul><ul><li>from SACE coordinator </li></ul></ul><ul><li>School Assessment Information report </li></ul><ul><ul><li>analyse both statistical and final moderation of your class v total cohort </li></ul></ul><ul><li>Moderation Feedback Advice (green) </li></ul><ul><ul><li>seek advice if movement has been great </li></ul></ul>

    ×