Designing Assessments (in Engineering)<br />Stuart Palmer<br />http://commons.wikimedia.org/wiki/File:Ready_for_final_exam...
SETU 'assessment' items (T2 2010)<br />
Five contemporary assessment issues in higher education<br />?<br />http://commons.wikimedia.org/w/index.php?title=File:Th...
Five contemporary assessment issues in higher education<br />Capturing the potential of online assessment<br />Designing e...
Differing perspectives on assessment<br />James, R., McInnis, C. & Devlin, M. (2002). Assessing Learning in Australian Uni...
Purpose(s) of assessment<br />?<br />http://commons.wikimedia.org/wiki/File:Belt_Problem_v2.svg?uselang=en-gb<br />
Purpose(s) of assessment – broadly:<br />Formative (for learning)<br /><ul><li>guide and encourage effective approaches to...
assist students to learn
ensuring students can identify high quality work
provide feedback on student performance</li></ul>Summative (of learning)<br /><ul><li>validly and reliably measure expecte...
define and protect academic and professional standards</li></li></ul><li>Where does assessment fit in?<br />Jolly, L. (200...
Program mapping<br />Program objectives<br />   Mechanical design   <br />      Problem solving     <br />Written communic...
Bloom's taxonomy<br />Evaluation<br />Discriminate<br />Think critically<br />Make judgement<br />Argue<br />Argue<br />Ch...
Learning objectives in program core units<br />Knowledge<br />Understanding<br />Application<br />Analysis<br />Synthesis<...
MAE406 – Business and Financial Econometrics<br />Learning objectives<br />On completion of this unit students should be a...
Eng. PBL unitfrom Aus uni.<br />
Assessment criteria / Rubrics<br />From Deakin’s Assessment procedure:<br />“… a tool used to articulate expected standard...
Civil Engrubric<br />http://www.adelaide.edu.au/erga/publications/maier_2ndyr.pdf<br />
In summary …<br />Jolly, L. (2001). Graduate Attributes Fact Sheet 1.10 Implementing Graduate Attributes. Brisbane: Univer...
Continuous formative assessment<br />Put existing weekly problem sets and/or review questions on DSO as online quizzes<br ...
Self-and-peerassessment<br />http://tectra.it.uts.edu.au<br />http://spark.uts.edu.au<br />
Multi-choice quizzes<br />HNN112 - Principles of Nursing Care<br />Content<br />This unit is the first of two in the Clini...
Project-basedlearning<br />Typically involves:<br />solution of a problem or completion of a task requiring students to co...
Student portfolios<br />1. Previously used hardcopy portfolio?<br />2. Previously used electronic portfolio?<br />3. Aware...
ERA 'A' journal publications<br />Palmer, S., Holt, D. and Bray, S. (2008), Does the discussion help? The impact of a form...
ERA 'A' Eng Ed publication opportunities<br />A*	Journal of Engineering Education<br />A	European Journal of Engineering E...
Upcoming SlideShare
Loading in...5
×

Sp110328

338

Published on

Assessment in Engineering

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
338
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sp110328

  1. 1. Designing Assessments (in Engineering)<br />Stuart Palmer<br />http://commons.wikimedia.org/wiki/File:Ready_for_final_exam_at_Norwegian_University_of_Science_and_Technology.jpg<br />#deakeng<br />
  2. 2. SETU 'assessment' items (T2 2010)<br />
  3. 3.
  4. 4. Five contemporary assessment issues in higher education<br />?<br />http://commons.wikimedia.org/w/index.php?title=File:Thomas_Young-An_Essay_on_the_Cohesion_of_Fluids.pdf&page=1&uselang=en-gb<br />
  5. 5. Five contemporary assessment issues in higher education<br />Capturing the potential of online assessment<br />Designing efficient and effective assessment for large classes<br />Responding to plagiarism and developing policies to foster academic honesty<br />Using assessment to guide effective group work<br />Recognising the needs of students unfamiliar with assessment practices in Australian higher education<br />
  6. 6. Differing perspectives on assessment<br />James, R., McInnis, C. & Devlin, M. (2002). Assessing Learning in Australian Universities. Melbourne: CSHE. Page 8.<br />
  7. 7. Purpose(s) of assessment<br />?<br />http://commons.wikimedia.org/wiki/File:Belt_Problem_v2.svg?uselang=en-gb<br />
  8. 8. Purpose(s) of assessment – broadly:<br />Formative (for learning)<br /><ul><li>guide and encourage effective approaches to learning
  9. 9. assist students to learn
  10. 10. ensuring students can identify high quality work
  11. 11. provide feedback on student performance</li></ul>Summative (of learning)<br /><ul><li>validly and reliably measure expected learning outcomes
  12. 12. define and protect academic and professional standards</li></li></ul><li>Where does assessment fit in?<br />Jolly, L. (2001). Graduate Attributes Fact Sheet 1.10 Implementing Graduate Attributes. Brisbane: University of Queensland, The Value Added Career Start Program. Page 3.<br />
  13. 13. Program mapping<br />Program objectives<br /> Mechanical design <br /> Problem solving <br />Written communication<br />
  14. 14. Bloom's taxonomy<br />Evaluation<br />Discriminate<br />Think critically<br />Make judgement<br />Argue<br />Argue<br />Choose<br />Justify<br />Recommend<br />Synthesis<br />Combine ideas<br /> to create an<br /> original product<br />Creative thinking<br />Adapt<br />Design<br />Formulate<br />Hypothesise<br />Analysis<br />Discern patterns<br />Organise parts<br />Identify parts<br />Simplify<br />Analyse<br />Correlate<br />Quantify<br />Interpret<br />Application<br />?<br />Use information<br />Use equipment<br />Solve problems<br />Use methods<br />Calculate<br />Demonstrate<br />Estimate<br />Report<br />Understanding<br />Grasp meaning<br />Order and group<br />Infer causes<br />Translate context<br />Classify<br />Compare<br />Explain<br />Summarise<br />Knowledge<br />Recognition<br />Recall<br />Facts<br />Subject matter<br />Define<br />Describe<br />Find<br />Tabulate<br />http://www.tedi.uq.edu.au/downloads/bloom.pdf<br />
  15. 15. Learning objectives in program core units<br />Knowledge<br />Understanding<br />Application<br />Analysis<br />Synthesis<br />Evaluation<br />
  16. 16. MAE406 – Business and Financial Econometrics<br />Learning objectives<br />On completion of this unit students should be able to:<br />Link the economic theory and real world data and establish a proper econometric model based on the economic and financial concepts;<br />Estimate an econometric model with the most ideal methodology;<br />Interpret the estimated results; and<br />Formulate policies based on results obtained from the econometric analysis.<br />
  17. 17. Eng. PBL unitfrom Aus uni.<br />
  18. 18. Assessment criteria / Rubrics<br />From Deakin’s Assessment procedure:<br />“… a tool used to articulate expected standards at various levels of performance in assessment. The criteria for each level of performance (from high distinction through to fail) are explicitly described in clear language to assist students to understand and interpret these descriptions.”<br />
  19. 19. Civil Engrubric<br />http://www.adelaide.edu.au/erga/publications/maier_2ndyr.pdf<br />
  20. 20. In summary …<br />Jolly, L. (2001). Graduate Attributes Fact Sheet 1.10 Implementing Graduate Attributes. Brisbane: University of Queensland, The Value Added Career Start Program. Page 3.<br />
  21. 21. Continuous formative assessment<br />Put existing weekly problem sets and/or review questions on DSO as online quizzes<br />Computer can ‘mark’ and provide student feedback<br />Student usage and scores are recorded<br />Could be ‘taken into account’ if student requests or needs any form of special consideration later<br />
  22. 22. Self-and-peerassessment<br />http://tectra.it.uts.edu.au<br />http://spark.uts.edu.au<br />
  23. 23. Multi-choice quizzes<br />HNN112 - Principles of Nursing Care<br />Content<br />This unit is the first of two in the Clinical Studies in Nursing: Year 1 cluster. In this unit the notions of person-centred care, the role of nursing in the interdisciplinary team, evidence-based practice, and quality improvement approaches in health care are explored. To achieve this, opportunities are provided for students to explore the role of nurses in promoting healing environments for patients and their families. Key concepts to be addressed include assessment and management of patient function and risk, and promotion of patient comfort. An orienting framework will be provided to enable students to understand nursing skill development throughout the curriculum. Students will have the opportunity to further develop and integrate knowledge and skills learned during a one (1) week clinical placement.<br />Assessment<br />Online tests 3 x 20 minute (equivalent 1000 words) 40%, examination (2 hours) 60%, laboratory skills (equivalent 500 words) hurdle requirement, clinical assessment: 40 hours pass/fail<br />http://www.dreamstime.com/item.php?imageid=7299038<br />
  24. 24. Project-basedlearning<br />Typically involves:<br />solution of a problem or completion of a task requiring students to complete a number of educational activities that drive learning;<br />generally, students work in teams to complete a project;<br />the project is non-trivial and often multidisciplinary in nature, requiring work over an extended period of time;<br />normally, the project involves the development of a concrete artefact – a design, a model, a thesis, a computer simulation, etc.;<br />the culmination of the project is often a written report and/or oral presentation describing the project methods and the final product; and<br />teaching staff take an advisory rather than authoritarian role.<br />
  25. 25. Student portfolios<br />1. Previously used hardcopy portfolio?<br />2. Previously used electronic portfolio?<br />3. Aware of the concept of graduate attributes?<br />4. Aware that Engineers Australia has a list of graduate attributes?<br />5. Aware that Deakin University has a list of graduate attributes?<br />6. Link between study & assessment, and development of GAs?<br />7. Understand the purpose of a student professional portfolio?<br />
  26. 26. ERA 'A' journal publications<br />Palmer, S., Holt, D. and Bray, S. (2008), Does the discussion help? The impact of a formally assessed online discussion on final student results, British Journal of Educational Technology, v39, n5, pp. 847-858.<br />Palmer, S., Bray, S. and Hall W. (2008), What is the on-campus experience? Engineering student study and work, International Journal of Engineering Education, v24, n4, pp. 802-810.<br />Palmer, S. (2004), Authenticity in assessment: reflecting undergraduate study and professional practice, European Journal of Engineering Education, v29, n2, pp. 193-202.<br />Palmer, S. (2002), An Evaluation of Undergraduate Engineering Management Studies, International Journal of Engineering Education, v18, n3, pp 321-330.<br />Palmer, S. (2001), Engineering flexible teaching and learning in engineering education, European Journal of Engineering Education, v26, n1, pp 1-13.<br />
  27. 27. ERA 'A' Eng Ed publication opportunities<br />A* Journal of Engineering Education<br />A European Journal of Engineering Education<br />A International Journal of Engineering Education<br />A IEEE Frontiers in Education conference<br />A SEFI Research on Engineering Education Symposium<br />
  28. 28. STALGS 'assessment' projects<br />Enhancing student engagement: strategies to improve student-staff interactions with particular reference to assessment feedback<br />Fair Assessment and Reflective Learning: A cross-faculty online self-and-peer-assessment tool for teamwork assignments piloted in architecture and business communications<br />Developing a framework for discipline-contextualised graduate attributes in the professional field of engineering: enhancing student achievement of Deakin's graduate attributes<br />Innovative, relevant and responsive assessment practices in higher education<br />https://staff.deakin.edu.au/teaching-learning/grants/stalgs.php<br />
  29. 29. Assessment resources<br />ITL PD modules:http://www.deakin.edu.au/itl/pd/tl-modules/assessment/index.php<br />ATN assessment conference:http://www.iml.uts.edu.au/atnassessment/index.html<br />CSHE report:http://www.cshe.unimelb.edu.au/assessinglearning/index.html<br />Boud / ALTC / UTS assessment futures project:http://www.iml.uts.edu.au/assessment-futures/<br />The Higher Education Academy Engineering Subject Centrehttp://www.engsc.ac.uk/home<br />
  30. 30. Thank you for your time<br />
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×