Your SlideShare is downloading. ×
Learning outcomes
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Learning outcomes

3,378
views

Published on

Published in: Education

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
3,378
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
99
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Alan Jenkins = Oxford Brookes University,
    Dave Unwin = Birbeck College, London
  • Synthesised this definition from various other definitions.
    In this talk we will restrict ourselves to discussing Learning Outcomes of modules.
    STAFF HANDBOOK
    GUIDANCE ON WRITING AND USING LEARNING OUTCOMES.
  • Give example of aim: To develop an understanding of the principles of learning scientific concepts and teaching science to young children.
    Examples of objectives are: Develop a scientific approach to problem solving.
    The aims of the module will be retained but the objectives will be replaced by learning outcomes.
    Far easier to write a learning outcome than to compose objectives.
  • The far away hills are green.
    Learning Outcomes are a step in the right direct.
  • Bloom made a huge contribution in the field of education, had a very optimistic approach to education. Bachelors and Masters degree from Penn State University. PhD in Education from Chicago.
    He was appointed professor at the University of Chicago in 1970.
    Wrote a book called the Taxonomy of Educational Objectives. (1956)
  • Taxonomy = Classification, Categorisation, arrangement.
    His book is used throughout the world in the preparation of evaluation materials.
  • Our thinking can be divided into six increasingly complex levels.
    Each level depends on the student’s ability to perform at the level or levels that are below it.
    For a student to apply knowledge, he or she would need to have the necessary information and understand it.
    Very interested in helping students to move up into the higher mental processes.
    The taxonomy was not simply a classification scheme – it was an effort to arrange the various thinking processes in a hierarchy.
  • A very useful practical tool to describe the levels of mental processes.
    He was interested in what students were thinking when they were interacting with what we were teaching or had taught them.
  • If we want a learning outcome to test a student’s knowledge, we use words drawn from this list.
  • How can we check that they have understood the knowledge – ask them to do things.
    Expanded from Bloom’s original list.
  • Found these on websites. Comment on mistakes in many websites where objectives have been simply replaced by Learning Outcomes.
  • Sketch of circuit in electrical engineering.
  • Note that some terms (e.g. calculate) not mutually exclusive e.g. you could have a calculation that simply involves an application or you could have a calculation that involves analysis as well.
  • Note that summarise appears in both evaluation and synthesis.
  • This could be used in the area of keeping attendance records to judge the commitment of students in attending lectures.
  • Used in Feasibility Study on Practical Assessment.
  • These words could be used in the general aim of a module or programme but not in learning outcomes.
  • Moving from objectives which can often be unclear and wooly to Learning Outcomes which are specific and measurable.
    The more you clarify the outcomes the more you are likely to succeed.
    The students are helped to individualise their learning.
    Comments on
  • Web sites of many universities contain objectives rather than Learning Outcomes.
  • The greatest challenge.
    STAFF HANDBOOK GUIDANCE ON WRITING AND USING LEARNING OUTCOMES.
  • Teaching for Understanding ensures that our Learning Outcomes are achieved.
    Clearly defined Learning Outcomes inform the design of the Teaching for Understanding framework.
    Thus the two are inextricably linked or are in a state of dynamic equilibrium.
    Continuous interaction
  • Paul Ramsden: Learning to Teach in Higher Education.
    John Biggs
    Note that the two cannot run on parallel tracks. The downward arrow is very important.
  • Objective To develop an understanding of magnets.
    Learning outcome:
    Define the term magnet.
    List the metals that can be magnetised.
    Describe how magnets are made.
    Explain how to draw the magnetic field around a bar magnet
    Move towards the teacher as researcher.
  • Transcript

    • 1. 1111 Designing Curricula BasedDesigning Curricula Based on Learning Outcomeson Learning Outcomes 5 March 20095 March 2009 University of WarsawUniversity of Warsaw Dr Declan Kennedy,Dr Declan Kennedy, Department of Education,Department of Education, University College Cork, IrelandUniversity College Cork, Ireland
    • 2. 2 22 1.1. What are LearningWhat are Learning Outcomes?Outcomes? 2.2. How do I writeHow do I write Learning Outcomes?Learning Outcomes? 3.3. How do I designHow do I design curricula based oncurricula based on Learning Outcomes?Learning Outcomes? 4.4. How do I link LearningHow do I link Learning Outcomes, TeachingOutcomes, Teaching and Learning Activitiesand Learning Activities and Assessment?and Assessment?
    • 3. 3 33 What are learning outcomes?What are learning outcomes? Learning outcomes are statements of what is expected thatLearning outcomes are statements of what is expected that a student will be able to DO as a result of a learninga student will be able to DO as a result of a learning activity….(Jenkins and Unwin).activity….(Jenkins and Unwin). Learning outcomes are explicit statements of what we wantLearning outcomes are explicit statements of what we want our students to know, understand or to be able to do as aour students to know, understand or to be able to do as a result of completing our courses. (Univ. New South Wales,result of completing our courses. (Univ. New South Wales, Australia)Australia) ““Learning outcomes are statements that specify whatLearning outcomes are statements that specify what learners will know or be able to do as a result of a learninglearners will know or be able to do as a result of a learning activity. Outcomes are usually expressed as knowledge,activity. Outcomes are usually expressed as knowledge, skills or attitudes”. (American Association of Law Libraries).skills or attitudes”. (American Association of Law Libraries). Learning outcomes are an explicit description of what aLearning outcomes are an explicit description of what a learner should know, understand and be able to do as alearner should know, understand and be able to do as a result of learning. (Learning and Teaching Institute,result of learning. (Learning and Teaching Institute, Sheffield Hallam University)Sheffield Hallam University)
    • 4. 4 44 Working DefinitionWorking Definition Learning outcomes are statements of what aLearning outcomes are statements of what a student should know, understand and/or bestudent should know, understand and/or be able to demonstrate after completion of aable to demonstrate after completion of a process of learning.process of learning. The learning activity could be, for example, a lecture, aThe learning activity could be, for example, a lecture, a module or an entire programme.module or an entire programme. Learning outcomes must not simply be a “wish list” ofLearning outcomes must not simply be a “wish list” of what a student is capable of doing on completion of thewhat a student is capable of doing on completion of the learning activity.learning activity. Learning outcomes must be simply and clearlyLearning outcomes must be simply and clearly described.described. Learning outcomes must be capable of being validlyLearning outcomes must be capable of being validly assessed.assessed.
    • 5. 5 Aims and Objectives The Aim of a module or programme is a broad general statement of teaching intention, i.e. it indicates what the teacher intends to cover. Example of aim: To give students an introduction to organic chemistry The objective of a module or programme is a specific statement of teaching intention, i.e. it indicates one of the specific areas that the teacher intends to cover. Examples of objectives: 1. Give students an appreciation of the unique nature of carbon and it ability to bond to other carbon atoms. 2. To give students an understanding of the concept of hybridisation. 3. To ensure that students know some characteristic properties of alkanes and alcohols. 4. To make students familiar with a range of families of organic compounds: alkanes, alcohols, carboxylic acids and esters.
    • 6. 6 66 From the definition of Learning Outcome we see:From the definition of Learning Outcome we see: Emphasis on the learner.Emphasis on the learner. Emphasis on the learner’s ability to do something.Emphasis on the learner’s ability to do something. Focus on teaching – aimsFocus on teaching – aims and objectives and use ofand objectives and use of terms liketerms like know,know, understand, be familiar with.understand, be familiar with. Outcomes: Focus on what we wantOutcomes: Focus on what we want the student to be able to do - use ofthe student to be able to do - use of terms like define, list, name, recall,terms like define, list, name, recall, analyse, calculate, design, etc.analyse, calculate, design, etc. • Aims: Give broad purpose or general intention of the module. • Objectives: Information about what the teaching of the module hopes to achieve. • Learning outcomes are not designed to replace the traditional way of describing teaching and learning but to supplement it.
    • 7. 7 77 Focus on Learning Outcomes –Focus on Learning Outcomes – BolognaBologna Bologna Agreement signed inBologna Agreement signed in Bologna, Italy in 1999 by 29Bologna, Italy in 1999 by 29 countries. A total of 46 countriescountries. A total of 46 countries have now signed up to thishave now signed up to this agreement.agreement. The overall aim of the BolognaThe overall aim of the Bologna Agreement is to improve theAgreement is to improve the efficiency and effectiveness ofefficiency and effectiveness of higher education in Europe inhigher education in Europe in terms of academic standards ofterms of academic standards of degrees and quality assurancedegrees and quality assurance standards.standards. One of the main features of thisOne of the main features of this process is the need to improve theprocess is the need to improve the traditional ways of describingtraditional ways of describing qualifications and qualificationqualifications and qualification structures.structures. 77 Bologna, Italy (1999)
    • 8. 8 88 What countries have signed the Bologna Agreement? European Union - all 27 countries Austria Belgium Bulgaria Cyprus Czech Republic Denmark Estonia Finland France Germany Greece Hungary Ireland Italy Latvia Lithuania Luxembourg Malta Netherlands Poland Portugal Romania Slovakia Slovenia Spain Sweden United Kingdom Non-European Union Albania Andorra Armenia Azerbaijan Bosnia and Herzegovina Croatia Georgia Holy See Iceland Liechtenstein Montenegro Moldova Norway Macedonia Russia Serbia Switzerland Turkey Ukraine
    • 9. 9 99 What is the Bologna Process all about? Setting up of European Higher Education Area (EHEA) to ensureSetting up of European Higher Education Area (EHEA) to ensure the increased international competitiveness of the Europeanthe increased international competitiveness of the European system of higher education.system of higher education. The Bologna Process is not based on a European Union initiative.The Bologna Process is not based on a European Union initiative. The agreement is between both EU and non-EU countries.The agreement is between both EU and non-EU countries. Setting up of system to make it easier to understand the descriptionSetting up of system to make it easier to understand the description of qualifications and qualification structures.of qualifications and qualification structures. Every student graduating will receive aEvery student graduating will receive a Diploma SupplementDiploma Supplement describing the qualification that the student has received. Thedescribing the qualification that the student has received. The purpose of the Diploma Supplement is to improve transparency andpurpose of the Diploma Supplement is to improve transparency and facilitate recognition. A standard format will be used to helpfacilitate recognition. A standard format will be used to help compare qualifications and make them easier to understand. Thecompare qualifications and make them easier to understand. The Diploma Supplement will also describe the content of theDiploma Supplement will also describe the content of the qualification and the structure of the higher education system inqualification and the structure of the higher education system in which it was issued.which it was issued.
    • 10. 10 1010 Framework of Qualifications for European Higher Education Area (EHEA) Conference of European Ministers Responsible for Higher Education in Bergen, Norway (2005) adopted the overarching framework for qualifications in EHEA. This framework shows - Three cycles (including within national contexts, the possibility of intermediate qualifications) - Generic descriptors for each cycle based on learning outcomes and competences. - ECTS credit ranges in the first and second cycles (i.e. Bachelors and Masters levels). Ministers committed themselves to drawing up National Frameworks for Qualifications compatible with Framework of Qualifications for European Higher Education area by 2010. Bergen, Norway (2005)
    • 11. 11 1111 First Cycle : Bachelor’s Cycle [180 – 240 ECTS credits] Minimum of 3 years = 180 credits 4 years = 240 credits.
    • 12. 12 1212 Second Cycle: Master’s cycle [60 – 120 ECTS credits] 1 year or 2 years
    • 13. 13 1313 Third Cycle: Doctoral cycle [Number of ECTS credits not specified] See two page summary of framework of qualifications on: www.ond.vlaanderen.be/hogeronderwijs/bologna/documents/Framework_qual ificationsforEHEA-May2005.pdf
    • 14. 14 Learning Outcome in Bologna Process ‘Ministers encourage the member States to elaborate a framework of comparable and compatible qualifications for their higher education systems, which should seek to describe qualifications in terms of workload, level, learning outcomes, competences and profile. They also undertake to elaborate an overarching framework of qualifications for the European Higher Education Area.’ Berlin Communique 2003 ‘We adopt the overarching framework for qualifications in the EHEA, comprising three cycles (including, within national contexts, the possibility of intermediate qualifications), generic descriptors for each cycle based on learning outcomes and competences, and credit ranges in the first and second cycles.’ Bergen Communique 2005
    • 15. 15 ‘We underline the importance of curricula reform leading to qualifications better suited both to the needs of the labour market and to further study. Efforts should concentrate in future on removing barriers to access and progression between cycles and on proper implementation of ECTS based on learning outcomes and student workload.’ ‘Qualifications frameworks are important instruments in achieving comparability and transparency within the EHEA and facilitating the movement of learners within, as well as between, higher education systems. They should also help HEIs to develop modules and study programmes based on learning outcomes and credits, and improve the recognition of qualifications as well as all forms of prior learning.’ ‘We urge institutions to further develop partnerships and cooperation with employers in the ongoing process of curriculum innovation based on learning outcomes.’ ‘With a view to the development of more student-centred, outcome- based learning, the next [Stocktaking] exercise should also address in an integrated way national qualifications frameworks, learning outcomes and credits, lifelong learning, and the recognition of prior learning.’ London Communiqué 2007
    • 16. 16 Bologna Process:Bologna Process: As a step towards achieving greaterAs a step towards achieving greater clarity in the description ofclarity in the description of qualifications, by 2010 all modulesqualifications, by 2010 all modules and programmes in third leveland programmes in third level institutions throughout the Europeaninstitutions throughout the European Union must be written in terms ofUnion must be written in terms of learning outcomes.learning outcomes. ““Learning outcomes represent one ofLearning outcomes represent one of the essential building blocks forthe essential building blocks for transparency within higher educationtransparency within higher education systems and qualifications”systems and qualifications” - Bologna Working Group, p.18 (December 2004) Major contribution of exemplar material from staff taking “Postgraduate Certificate / Diploma in Teaching and Learning at Higher Education”. Staff training in UCC – lunchtime session and setting up of “Postgraduate Certificate / Diploma in Teaching and Learning at Higher Education”. To date, translated into Spanish, German, Albanian, Serbian, Lithuanian and Hungarian.
    • 17. 17
    • 18. 18 National Framework of Qualifications Putting the Bologna Process into practice. For many countries, one of the most challenging parts of the Bologna reform process is to make their National Framework of Qualifications compatible with the Framework for Qualifications of the European Higher Education Area. – Showing that National Qualifications Framework is compatible with European Qualifications Framework. – Introducing Learning Outcomes and writing modules and programmes in terms of Learning Outcomes. – Showing evidence that the Learning Outcomes have been achieved. – Workload in terms of ECTS credits and credit accumulation rather than teaching time. – Showing how the National Framework of Qualifications facilitates Lifelong Learning. – Lifelong Learning the only way to avoid obsolescence and is the key for ensuring progress.
    • 19. 19 1919 National Framework of Qualifications in Ireland Available at : http://www.nqai.ie/docs/publications/13.pdf
    • 20. 20 Development of Framework The National Framework of Qualifications was proposed through the Qualifications (Education and Training) Act 1999 and launched in 2003. Definition of framework: The single, nationally and internationally accepted entity through which all learning achievements may be measured and related to each other in a coherent way and which defines the relationship between all education and training awards. An ambitious undertaking: the Framework seeks to encompass the entire spectrum of learning achievements
    • 21. 21 2121 How do I write LearningHow do I write Learning Outcomes?Outcomes?
    • 22. 22 2222 Benjamin BloomBenjamin Bloom (1913 – 1999)(1913 – 1999) He looked on learning as aHe looked on learning as a process – we build upon our formerprocess – we build upon our former learning to develop more complex levels oflearning to develop more complex levels of understandingunderstanding Carried out research in the development ofCarried out research in the development of classification of levels of thinking behaviours in theclassification of levels of thinking behaviours in the process of learning. PhD University of Chicago inprocess of learning. PhD University of Chicago in 1942.1942. Worked on drawing up levels of these thinkingWorked on drawing up levels of these thinking behaviours from the simple recall of facts at the lowestbehaviours from the simple recall of facts at the lowest level up to evaluation at the highest level.level up to evaluation at the highest level.
    • 23. 23 2323 Bloom’s Taxonomy ofBloom’s Taxonomy of Educational ObjectivesEducational Objectives Bloom’s taxonomy (1956) is a very useful aid toBloom’s taxonomy (1956) is a very useful aid to writing learning outcomes.writing learning outcomes. The taxonomy consists of a hierarchy ofThe taxonomy consists of a hierarchy of increasingly complex processes which we wantincreasingly complex processes which we want our students to acquire.our students to acquire. Provides the structure for writing learningProvides the structure for writing learning outcomesoutcomes Bloom’s Taxonomy is frequently used byBloom’s Taxonomy is frequently used by teachers in writing learning outcomes as itteachers in writing learning outcomes as it provides a ready made structure and list ofprovides a ready made structure and list of verbs.verbs.
    • 24. 24 2424 Bloom (1956) proposed that knowing is composed of six successive levels arranged in a hierarchy. 1. Knowledge 2. Comprehension 3. Application 4.Analysis 5. Synthesis 6. Evaluation
    • 25. 25 2525 This area is commonly called the cognitive (“knowing” or “thinking”) domain (involving thought processes). Bloom suggested certain verbs that characterise the ability to demonstrate these processes. These verbs are the key to writing learning outcomes. The list of verbs has been extended since his original publication. The “toolkit” for writing learning outcomes!The “toolkit” for writing learning outcomes!
    • 26. 26 2626 1. Knowledge - ability to recall or1. Knowledge - ability to recall or remember facts without necessarilyremember facts without necessarily understanding themunderstanding them Use action verbs like:Use action verbs like: Arrange, collect, define,Arrange, collect, define, describe, duplicate,describe, duplicate, enumerate, examine,enumerate, examine, find, identify, label, list,find, identify, label, list, memorise, name,memorise, name, order, outline, present,order, outline, present, quote, recall,quote, recall, recognise, recollect,recognise, recollect, record, recount, relate,record, recount, relate, repeat, reproduce,repeat, reproduce, show, state, tabulate,show, state, tabulate, 1. Knowledge 2. Comprehension 3. Application 4.Analysis 5. Synthesis 6. Evaluation
    • 27. 27 2727 Examples: KnowledgeExamples: Knowledge RecallRecall genetics terminology: homozygous, heterozygous,genetics terminology: homozygous, heterozygous, phenotype, genotype, homologous chromosome pair, etc.phenotype, genotype, homologous chromosome pair, etc. IdentifyIdentify and consider ethical implications of scientificand consider ethical implications of scientific investigations.investigations. DescribeDescribe how and why laws change and the consequenceshow and why laws change and the consequences of such changes on society.of such changes on society. ListList the criteria to be taken into account when caring for athe criteria to be taken into account when caring for a patient with tuberculosis.patient with tuberculosis. DefineDefine what behaviours constitute unprofessional practicewhat behaviours constitute unprofessional practice in the solicitor – client relationship.in the solicitor – client relationship. Outline the history of the Celtic peoples from the earliestOutline the history of the Celtic peoples from the earliest evidence to the insular migrations.evidence to the insular migrations. DescribeDescribe the processes used in engineering whenthe processes used in engineering when preparing a design brief for a client.preparing a design brief for a client. Recall the axioms and laws of Boolean algebra.Recall the axioms and laws of Boolean algebra.
    • 28. 28 2828 2. Comprehension - ability to2. Comprehension - ability to understand and interpret learnedunderstand and interpret learned informationinformationUse action verbs like:Use action verbs like: Associate, change, clarify,Associate, change, clarify, classify, construct,classify, construct, contrast, convert, decode,contrast, convert, decode, defend, describe,defend, describe, differentiate, discriminate,differentiate, discriminate, discuss, distinguish,discuss, distinguish, estimate, explain,estimate, explain, express, extend,express, extend, generalise, identify,generalise, identify, illustrate, indicate, infer,illustrate, indicate, infer, interpret, locate, predict,interpret, locate, predict, recognise, report, restate,recognise, report, restate, review, select, solve,review, select, solve, translate.translate. 1. Knowledge 2. Comprehension 3. Application 4.Analysis 5. Synthesis 6. Evaluation
    • 29. 29 2929 Examples: ComprehensionExamples: Comprehension DifferentiateDifferentiate between civil and criminal lawbetween civil and criminal law IdentifyIdentify participants and goals in the development of electronicparticipants and goals in the development of electronic commerce.commerce. DiscussDiscuss critically German literary texts and films in English.critically German literary texts and films in English. PredictPredict the genotype of cells that undergo meiosis and mitosis.the genotype of cells that undergo meiosis and mitosis. TranslateTranslate short passages of contemporary Italian.short passages of contemporary Italian. Convert number systems from hexadecimal to binary and vice versa.Convert number systems from hexadecimal to binary and vice versa. ExplainExplain the social, economic and political effects of World War I on thethe social, economic and political effects of World War I on the post-war world.post-war world. ClassifyClassify reactions as exothermic and endothermic.reactions as exothermic and endothermic. RecogniseRecognise the forces discouraging the growth of the educationalthe forces discouraging the growth of the educational system in Ireland in the 19th century.system in Ireland in the 19th century. ExplainExplain the impact of Greek and Roman culture on Western civilisation.the impact of Greek and Roman culture on Western civilisation. RecogniseRecognise familiar words and basic phrases concerningfamiliar words and basic phrases concerning themselves….when people speak slowly and clearly.themselves….when people speak slowly and clearly.
    • 30. 30 3030 3. Application: ability to use learned3. Application: ability to use learned material in new situations, e.g. put ideasmaterial in new situations, e.g. put ideas and concepts to work in solving problemsand concepts to work in solving problems Use action verbs like:Use action verbs like: Apply, assess, calculate,Apply, assess, calculate, change, choose, complete,change, choose, complete, compute, construct,compute, construct, demonstrate, develop,demonstrate, develop, discover, dramatise, employ,discover, dramatise, employ, examine, experiment, find,examine, experiment, find, illustrate, interpret,illustrate, interpret, manipulate, modify, operate,manipulate, modify, operate, organise, practice, predict,organise, practice, predict, prepare, produce, relate,prepare, produce, relate, schedule, select, show,schedule, select, show, sketch, solve, transfer, use.sketch, solve, transfer, use. 1. Knowledge 2. Comprehension 3. Application 4.Analysis 5. Synthesis 6. Evaluation
    • 31. 31 3131 Examples applicationExamples application ConstructConstruct a timeline of significant events in the history ofa timeline of significant events in the history of Australia in the 19Australia in the 19thth century.century. ApplyApply knowledge of infection control in the maintenance ofknowledge of infection control in the maintenance of patient care facilities.patient care facilities. SelectSelect and employ sophisticated techniques for analysing theand employ sophisticated techniques for analysing the efficiencies of energy usage in complex industrial processes.efficiencies of energy usage in complex industrial processes. ShowShow proficiency in the use of vocabulary and grammar, asproficiency in the use of vocabulary and grammar, as well as the sounds of the language in different styles…..well as the sounds of the language in different styles….. RelateRelate energy changes to bond breaking and formation.energy changes to bond breaking and formation. ModifyModify guidelines in a case study of a small manufacturingguidelines in a case study of a small manufacturing firm to enable tighter quality control of production.firm to enable tighter quality control of production. ShowShow how changes in the criminal law affected levels ofhow changes in the criminal law affected levels of incarceration in Scotland in the 19th century.incarceration in Scotland in the 19th century. ApplyApply principles of evidence-based medicine to determineprinciples of evidence-based medicine to determine clinical diagnoses.clinical diagnoses.
    • 32. 32 3232 4. Analysis: ability to break down information4. Analysis: ability to break down information into its components, e.g. look for inter-into its components, e.g. look for inter- relationships and ideas (understanding ofrelationships and ideas (understanding of organisational structure)organisational structure) Use action verbs like:Use action verbs like: Analyse, appraise, arrange,Analyse, appraise, arrange, break down, calculate,break down, calculate, categorise, classify,categorise, classify, compare, connect, contrast,compare, connect, contrast, criticise, debate, deduce,criticise, debate, deduce, determine, differentiate,determine, differentiate, discriminate, distinguish,discriminate, distinguish, divide, examine,divide, examine, experiment, identify,experiment, identify, illustrate, infer, inspect,illustrate, infer, inspect, investigate, order, outline,investigate, order, outline, point out, question, relate,point out, question, relate, separate, sub-divide, test.separate, sub-divide, test. 1. Knowledge 2. Comprehension 3. Application 4.Analysis 5. Synthesis 6. Evaluation
    • 33. 33 3333 Examples: AnalysisExamples: Analysis AnalyseAnalyse why society criminalises certain behaviours.why society criminalises certain behaviours. CompareCompare and contrast the different electronic businessand contrast the different electronic business models.models. CategoriseCategorise the different areas of specialised interest withinthe different areas of specialised interest within dentistry.dentistry. DebateDebate the economic and environmental effects of energythe economic and environmental effects of energy conversion processes.conversion processes. IdentifyIdentify andand quantifyquantify sources of errors in measurements.sources of errors in measurements. CalculateCalculate gradient from maps in m, km, % and ratio.gradient from maps in m, km, % and ratio. CriticallyCritically analyseanalyse a broad range of texts of different genresa broad range of texts of different genres and from different time periods.and from different time periods. CompareCompare the classroom practice of a newly qualifiedthe classroom practice of a newly qualified teacher with that of a teacher of 20 years teachingteacher with that of a teacher of 20 years teaching experience.experience. Calculate logical functions for coders, decoders andCalculate logical functions for coders, decoders and multiplexers.multiplexers.
    • 34. 34 3434 5. Synthesis - ability to put5. Synthesis - ability to put parts togetherparts together Use action verbs like:Use action verbs like: Argue, arrange, assemble,Argue, arrange, assemble, categorise, collect,categorise, collect, combine, compile,combine, compile, compose, construct,compose, construct, create, design, develop,create, design, develop, devise, establish, explain,devise, establish, explain, formulate, generalise,formulate, generalise, generate, integrate, invent,generate, integrate, invent, make, manage, modify,make, manage, modify, organise, originate, plan,organise, originate, plan, prepare, propose,prepare, propose, rearrange, reconstruct,rearrange, reconstruct, relate, reorganise, revise,relate, reorganise, revise, rewrite, set up, summarise.rewrite, set up, summarise.1. Knowledge 2. Comprehension 3. Application 4.Analysis 5. Synthesis 6. Evaluation
    • 35. 35 3535 Examples: SynthesisExamples: Synthesis RecogniseRecognise and formulate problems that are amenable toand formulate problems that are amenable to energy management solutions.energy management solutions. ProposePropose solutions to complex energy managementsolutions to complex energy management problems both verbally and in writing.problems both verbally and in writing. Assemble sequences of high-level evaluations in theAssemble sequences of high-level evaluations in the form of a program.form of a program. Integrate concepts of genetic processes in plants andIntegrate concepts of genetic processes in plants and animals.animals. SummariseSummarise the causes and effects of the 1917 Russianthe causes and effects of the 1917 Russian revolutions.revolutions. RelateRelate the sign of enthalpy changes to exothermic andthe sign of enthalpy changes to exothermic and endothermic reactions.endothermic reactions. OrganiseOrganise a patient education programme.a patient education programme.
    • 36. 36 3636 6. Evaluation: Ability to judge value6. Evaluation: Ability to judge value of material for a given purposeof material for a given purpose Use action verbs like:Use action verbs like: Appraise, ascertain, argue,Appraise, ascertain, argue, assess, attach, choose,assess, attach, choose, compare, conclude,compare, conclude, contrast, convince,contrast, convince, criticise, decide, defend,criticise, decide, defend, discriminate, explain,discriminate, explain, evaluate, interpret, judge,evaluate, interpret, judge, justify, measure, predict,justify, measure, predict, rate, recommend, relate,rate, recommend, relate, resolve, revise, score,resolve, revise, score, summarise, support,summarise, support, validate, value.validate, value. 1. Knowledge 2. Comprehension 3. Application 4.Analysis 5. Synthesis 6. Evaluation
    • 37. 37 3737 Examples: EvaluationExamples: Evaluation Assess the importance of key participants inAssess the importance of key participants in bringing about change in Irish historybringing about change in Irish history Evaluate marketing strategies for differentEvaluate marketing strategies for different electronic business models.electronic business models. Appraise the role of sport and physical educationAppraise the role of sport and physical education in health promotion for young people.in health promotion for young people. Predict the effect of change in temperature onPredict the effect of change in temperature on the position of equilibrium…the position of equilibrium… Summarise the main contributions of MichaelSummarise the main contributions of Michael Faraday to the field of electromagnetic induction.Faraday to the field of electromagnetic induction.
    • 38. 38 Bloom Revisited: Anderson and Krathwohl (2001) Bloom (1956) Knowledge Comprehension Application Analysis Synthesis Evaluation Anderson and Krathwohl (2001) To remember To understand To apply To analyse To evaluate To create Analysis, Synthesis, Evaluation – Higher Order Thinking Skills
    • 39. 39 3939 AFFECTIVE DOMAIN (“Feeling”) concernedAFFECTIVE DOMAIN (“Feeling”) concerned with value issues : involves attitudes.with value issues : involves attitudes. Two other domains in Bloom’s TaxonomyTwo other domains in Bloom’s Taxonomy 1. Receiving 2. Responding 3. Valuing 4. Organisation 5. Characterisation Willingness to receive information Active participation in own learning Commitment to a value Comparing, relating, synthesising values Integration of beliefs, ideas and attitudes
    • 40. 40 4040 Active verbs for affective domainActive verbs for affective domain Appreciate, accept,Appreciate, accept, assist, attempt,assist, attempt, challenge, combine,challenge, combine, complete, defend,complete, defend, demonstrate (a beliefdemonstrate (a belief in), discuss, dispute,in), discuss, dispute, embrace, follow, hold,embrace, follow, hold, integrate, order,integrate, order, organise, join, share,organise, join, share, judge, praise,judge, praise, question, relate, share,question, relate, share, support, synthesise,support, synthesise, value.value.
    • 41. 41 4141 Examples of Learning Outcomes inExamples of Learning Outcomes in Affective DomainAffective Domain Accept the need for professional ethical standards.Accept the need for professional ethical standards. Appreciate the need for confidentiality in the professionalAppreciate the need for confidentiality in the professional client relationship.client relationship. Display a willingness to communicate well with patients.Display a willingness to communicate well with patients. Relate to participants in an ethical and humane manner.Relate to participants in an ethical and humane manner. Resolve conflicting issues between personal beliefs andResolve conflicting issues between personal beliefs and ethical considerations.ethical considerations. Embrace a responsibility for the welfare of children takenEmbrace a responsibility for the welfare of children taken into care.into care. Participate in class discussions with colleagues and withParticipate in class discussions with colleagues and with teachers.teachers.
    • 42. 42 4242 PSYCHOMOTOR (“Doing”) DOMAIN:PSYCHOMOTOR (“Doing”) DOMAIN: Work never completed by Bloom.Work never completed by Bloom. Involves co-ordination of brain andInvolves co-ordination of brain and muscular activity. Active verbs for thismuscular activity. Active verbs for this domain: bend, grasp, handle, operate,domain: bend, grasp, handle, operate, perform, reach, relax, shorten, stretch,perform, reach, relax, shorten, stretch, differentiate (by touch), perform (skilfully).differentiate (by touch), perform (skilfully).
    • 43. 43 4343 Laboratory skillsLaboratory skills Operate the range of instrumentation specified in the module safelyOperate the range of instrumentation specified in the module safely and efficiently in the chemistry laboratory.and efficiently in the chemistry laboratory. Perform titrations accurately and safely in the laboratory.Perform titrations accurately and safely in the laboratory. Construct simple scientific sketches of geological features in the field.Construct simple scientific sketches of geological features in the field. Clinical SkillsClinical Skills The student is able to perform a comprehensive history and physicalThe student is able to perform a comprehensive history and physical examination of patients in the outpatient setting and the generalexamination of patients in the outpatient setting and the general medical wards, excluding critical care settings.medical wards, excluding critical care settings. The student is competent in performing venipuncture and basic CPR.The student is competent in performing venipuncture and basic CPR. Presentation skillsPresentation skills Deliver an effective presentation.Deliver an effective presentation. Demonstrate a range of graphic and CAD communication techniques.Demonstrate a range of graphic and CAD communication techniques. Perform basic voice and movement tasks (theatre studies).Perform basic voice and movement tasks (theatre studies).
    • 44. 44 4444 Module TitleModule Title: Dental Surgery – 5th Year Dental Students: Dental Surgery – 5th Year Dental Students Module CodeModule Code: DS5001: DS5001 On successful completion of this module, students should be able to:On successful completion of this module, students should be able to: Summarise relevant information regarding the patient’s current conditionSummarise relevant information regarding the patient’s current condition to generate a differential diagnosisto generate a differential diagnosis Formulate an appropriate treatment plan and justify the proposal givingFormulate an appropriate treatment plan and justify the proposal giving due consideration to patient expectations and limitationsdue consideration to patient expectations and limitations Arrange appropriate tests and demonstrate the ability to interpret testsArrange appropriate tests and demonstrate the ability to interpret tests and reportsand reports Administer local anaesthetics safely and perform basic dento-alveolarAdminister local anaesthetics safely and perform basic dento-alveolar surgical procedures in a professional manner showing good clinicalsurgical procedures in a professional manner showing good clinical governancegovernance Recognise, evaluate and manage medical and dental emergenciesRecognise, evaluate and manage medical and dental emergencies appropriatelyappropriately Differentiate between patients that can/can not be safely treated by aDifferentiate between patients that can/can not be safely treated by a GDPGDP Manage competing demands on time, including self-directed learning &Manage competing demands on time, including self-directed learning & critical appraisalcritical appraisal Master the therapeutic and pharmacological management of patients withMaster the therapeutic and pharmacological management of patients with facial pain and oro-facial diseasefacial pain and oro-facial disease (Learning outcomes written by Dr. Eleanor O’Sullivan)(Learning outcomes written by Dr. Eleanor O’Sullivan)
    • 45. 45 Learning Outcomes The ECTS credit system is the common currency for education. Learning Outcomes are the common language for education. Facilitate comparability across the various systems in different countries. Facilitate diversity – formal learning, informal learning, life long learning, etc. The term “competency” is commonly used to point the learner in the general direction but caution must be exercised when using this term.
    • 46. 46 What is the relationship between Learning Outcomes and Competences? Difficult to find a precise definition for the term “competence”. “Some take a narrow view and associate competence just with skills acquired by training” (Stephen Adam, 2004) In Tuning project, the term competence is used to represent a combination of attributes in terms of knowledge and its application, skills, responsibilities and attitudes and an attempt is made to describe the extent to which a person is capable of performing them ECTS Users’ Guide describes competences as “a dynamic combination of attributes, abilities and attitudes. Fostering these competences is the object of educational programmes. Competences are formed in various course units and assessed at different stages. They may be divided in subject- area related competences (specific to a field of study) and generic competences (common to any degree course)” (ECTS, 2005) Advice – if you have to write competences use the language of learning outcomes to describe competences.
    • 47. 47 Competence: The student should be able to use the mass and energy balances for a given food process. Objectives: Understand scope of mass balances in food processing systems. Understand appropriate use of mole fractions and mass fractions in mass balances Learning outcomes: Describe the general principles of mass balances in steady state systems. Draw and use process flow diagrams with labels on flow streams for mass balance problems. Solve mass balance problems associated with food processing operations. Design and solve mass balances for complex process flow systems, including batch mixing problems, multiple stage flow problems, problems with multiple inflows and outflows, recycle streams and multiple components, and processes where chemical reactions take place. Hartel and Foegeding (2004)
    • 48. 48 Competence – a “fuzzy” concept (Van der Klink and Boon) Van der Klink (2002) and Boon describe competence as a “fuzzy concept” On the positive side they state it is a “useful term, bridging the gap between education and job requirements”.
    • 49. 49 Since there is not a common understanding of the term competence, learning outcomes have become more commonly used than competences when describing what students are expected to know, understand and/or be able to demonstrate at the end of a module or programme. The “fuzziness” of competences disappears in the clarity of learning outcomes! The End! In short, useIn short, use LearningLearning Outcomes toOutcomes to clarify what isclarify what is meant by ameant by a statement ofstatement of Competence.Competence. In short, useIn short, use LearningLearning Outcomes toOutcomes to clarify what isclarify what is meant by ameant by a statement ofstatement of Competence.Competence. In short, useIn short, use LearningLearning Outcomes toOutcomes to clarify what isclarify what is meant by ameant by a statement ofstatement of Competence.Competence.
    • 50. 50 5050 The challenge of beginning the taskThe challenge of beginning the task of writingof writing Learning OutcomesLearning Outcomes It is vital that learning outcomes are clearly written so that theyIt is vital that learning outcomes are clearly written so that they are understood by students, colleagues and external examiners.are understood by students, colleagues and external examiners. When writing learning outcomes it may be helpful to you if youWhen writing learning outcomes it may be helpful to you if you focus on what you expect students to be able to demonstratefocus on what you expect students to be able to demonstrate upon completion of the module or programme.upon completion of the module or programme. It is standard practice to list the learning outcomes using a phraseIt is standard practice to list the learning outcomes using a phrase like “On successful completion of this module, students should belike “On successful completion of this module, students should be able to:”able to:” [list of learning outcomes][list of learning outcomes] Avoid complicated sentences. If necessary use one than oneAvoid complicated sentences. If necessary use one than one sentence to ensure clarity.sentence to ensure clarity. General recommendation: 5 – 8 learning outcomes per module.General recommendation: 5 – 8 learning outcomes per module. Avoid certain words……….Avoid certain words……….
    • 51. 51 5151 Words of advice …..Words of advice ….. ““The key word is DO and the key need in drafting learningThe key word is DO and the key need in drafting learning outcomes is to use active verbs”. (Jenkins and Unwin, Fry et al.)outcomes is to use active verbs”. (Jenkins and Unwin, Fry et al.) Avoid verbs like “know”, “understand”, “be familiar with”, “beAvoid verbs like “know”, “understand”, “be familiar with”, “be exposed to” (Osters and Tiu)exposed to” (Osters and Tiu) ““Try to avoid ambiguous verbs such as “understand”, “know”, “beTry to avoid ambiguous verbs such as “understand”, “know”, “be aware” and “appreciate”. (Sheffield Hallam Guide).aware” and “appreciate”. (Sheffield Hallam Guide). ““Care should be taken in using words such as ‘understand’ andCare should be taken in using words such as ‘understand’ and ‘know’ if you cannot be sure that students will understand what it‘know’ if you cannot be sure that students will understand what it means to know or understand in a given context” (Univ NSW).means to know or understand in a given context” (Univ NSW). Certain verbs are unclear and subject to different interpretations inCertain verbs are unclear and subject to different interpretations in terms of what action they are specifying…… These types of verbsterms of what action they are specifying…… These types of verbs should be avoided: know, become aware of, appreciate, learn,should be avoided: know, become aware of, appreciate, learn, understand, become familiar with. (American Association of Lawunderstand, become familiar with. (American Association of Law Libraries).Libraries).
    • 52. 52 5252 Checklist for writingChecklist for writing learning outcomeslearning outcomes for modulesfor modules  Have I begun each outcome with an active verb?Have I begun each outcome with an active verb?  Have I avoided terms likeHave I avoided terms like knowknow,, understandunderstand,, learnlearn,, be familiar withbe familiar with,, be exposed tobe exposed to,, bebe acquainted withacquainted with,, be aware ofbe aware of andand appreciateappreciate??  Have I included learning outcomes across theHave I included learning outcomes across the range of levels of Bloom’s Taxonomy?range of levels of Bloom’s Taxonomy?  Are my outcomes observable and measurable?Are my outcomes observable and measurable?  Do all the outcomes fit within the aims andDo all the outcomes fit within the aims and content of the module?content of the module?
    • 53. 53 Writing Programme LearningWriting Programme Learning OutcomesOutcomes The rules for writing learning outcomes forThe rules for writing learning outcomes for programmes are the same as those for writingprogrammes are the same as those for writing learning outcomes for modules.learning outcomes for modules. The general guidance in the literature is that thereThe general guidance in the literature is that there should be 5 – 10 learning outcomes for ashould be 5 – 10 learning outcomes for a programme and that only the minimum number ofprogramme and that only the minimum number of outcomes considered to be essential be included.outcomes considered to be essential be included. Programme learning outcomes describe theProgramme learning outcomes describe the essential knowledge, skills and attitudes that it isessential knowledge, skills and attitudes that it is intended that graduates of the programme will beintended that graduates of the programme will be able to demonstrate.able to demonstrate. 5353
    • 54. 54 Two types of ProgrammeTwo types of Programme Learning OutcomesLearning Outcomes 1.1. The first type of learning outcome refers to thoseThe first type of learning outcome refers to those learning outcomes that can be assessed during thelearning outcomes that can be assessed during the programme, i.e. within the various modules.programme, i.e. within the various modules. 2.2. ““Aspirational” or “desirable” learning outcomes indicateAspirational” or “desirable” learning outcomes indicate what a good quality student would be expected towhat a good quality student would be expected to achieve by the end of the programme. This type ofachieve by the end of the programme. This type of learning outcome may not be assessed at all but giveslearning outcome may not be assessed at all but gives an indication to employers and other agencies the typean indication to employers and other agencies the type of standard of practical performance that graduates ofof standard of practical performance that graduates of the programme will display at the end of thethe programme will display at the end of the programme.programme. 5454
    • 55. 55 Example of Programme Learning Outcomes [BSc(Ed)] On successful completion of this programme, students should be able to: Recognise and apply the basic principles of classroom management and discipline. Identify the key characteristics of excellent teaching in science. Develop comprehensive portfolios of lesson plans that are relevant to the science curricula in schools. Evaluate the various theories of Teaching and Learning and apply these theories to assist in the creation of effective and inspiring science lessons. Critically evaluate the effectiveness of their teaching of science in the second-level school system. Display a willingness to co-operate with members of the teaching staff in their assigned school. Foster an interest in science and a sense of enthusiasm for science subjects in their pupils. Synthesise the key components of laboratory organisation and management and perform laboratory work in a safe and efficient manner. Communicate effectively with the school community and with society at large in the area of science education.
    • 56. 56 Further Example of ProgrammeFurther Example of Programme Learning OutcomesLearning Outcomes On successful completion of this programme, students should be able to: Derive and apply solutions from knowledge of sciences,Derive and apply solutions from knowledge of sciences, engineering sciences, technology and mathematics.engineering sciences, technology and mathematics. Identify, formulate, analyse and solve engineering problems.Identify, formulate, analyse and solve engineering problems. Design a system, component or process to meet specifiedDesign a system, component or process to meet specified needs and to design and conduct experiments to analyse andneeds and to design and conduct experiments to analyse and interpret data.interpret data. Work effectively as an individual, in teams and in multi-Work effectively as an individual, in teams and in multi- disciplinary settings together with the capacity to undertakedisciplinary settings together with the capacity to undertake lifelong learning.lifelong learning. Communicate effectively with the engineering community andCommunicate effectively with the engineering community and with society at large.with society at large. [Undergraduate engineering degree][Undergraduate engineering degree] 5656
    • 57. 57 Further Example of ProgrammeFurther Example of Programme Learning OutcomesLearning Outcomes On successful completion of this programme, students should beOn successful completion of this programme, students should be able to:able to: Perform problem solving in academic and industrialPerform problem solving in academic and industrial environments.environments. Use, manipulate and create large computational systems.Use, manipulate and create large computational systems. Work effectively as a team member.Work effectively as a team member. Organise and pursue a scientific or industrial research project.Organise and pursue a scientific or industrial research project. Write theses and reports to a professional standard, equivalentWrite theses and reports to a professional standard, equivalent in presentational qualities to that of publishable papers.in presentational qualities to that of publishable papers. Prepare and present seminars to a professional standard.Prepare and present seminars to a professional standard. Perform independent and efficient time management.Perform independent and efficient time management. Use a full range of IT skills and display a mature computerUse a full range of IT skills and display a mature computer literacy.literacy. [Postgrad Comp Sc degree][Postgrad Comp Sc degree] 5757
    • 58. 58 5858 What are the benefits and potentialWhat are the benefits and potential problems of Learning Outcomes?problems of Learning Outcomes?
    • 59. 59 “Learning Outcomes represent one of the essential building blocks for transparent higher education systems and qualifications… It is important that there should be no confusions about their role, nature and significance or the educational foundations of the Bologna process will be weakened” (Adams S, 2004)
    • 60. 60 “Learning outcomes represent what is formally assessed and accredited to the student and they offer a starting point for a viable model for the design of curricula in higher education which shifts the emphasis form input and process to the celebration of student learning” (Allan J, 1996)
    • 61. 61 6161 The benefits of Learning OutcomesThe benefits of Learning Outcomes Help to explain more clearly to students what isHelp to explain more clearly to students what is expected of them and thus help to guide them inexpected of them and thus help to guide them in their studies – motivation and sense of purposetheir studies – motivation and sense of purpose Help teachers to focus more clearly on whatHelp teachers to focus more clearly on what exactly they want students to achieve in terms ofexactly they want students to achieve in terms of knowledge and skills.knowledge and skills. Help teachers to define the assessment criteriaHelp teachers to define the assessment criteria more effectively.more effectively. Help to provide guidance to employers about theHelp to provide guidance to employers about the knowledge and understanding possessed byknowledge and understanding possessed by graduates of programmes.graduates of programmes. Help to start discussion on Teaching andHelp to start discussion on Teaching and Learning in third level institutionsLearning in third level institutions..
    • 62. 62 6262 Potential problems with LearningPotential problems with Learning OutcomesOutcomes Could limit learning if learning outcomes writtenCould limit learning if learning outcomes written within a very narrow framework – lack ofwithin a very narrow framework – lack of intellectual challenge to learners.intellectual challenge to learners. Learning outcomes should not be reductionistLearning outcomes should not be reductionist but rather expansive and intended to promotebut rather expansive and intended to promote the higher order thinking skills.the higher order thinking skills. Danger of assessment-driven curriculum ifDanger of assessment-driven curriculum if learning outcomes too confined.learning outcomes too confined. Could give rise to confusion among studentsCould give rise to confusion among students and staff if guidelines not adhered to whenand staff if guidelines not adhered to when drawing up learning outcomes, etc.drawing up learning outcomes, etc.
    • 63. 63 63636363 How do I link LearningHow do I link Learning Outcomes to TeachingOutcomes to Teaching and Learning Activitiesand Learning Activities and Assessment?and Assessment?
    • 64. 64 “The adoption of a learning outcomes approach represents more than simply expressing learning in terms of outcomes. It entails much more due to their significant implications for all aspects of curriculum design, delivery, expression, assessement and standards”. Adam S, 2004
    • 65. 65 Assessment of Learning Outcomes Having designed modules and programmes in terms of learning outcomes, we must now find out if our students have achieved these intended learning outcomes. How will I know if my students have achieved the desired learning outcomes? How will I measure the extent to which they have achieved these learning outcomes? Therefore, we must consider how to match the method of assessment to the different kinds of learning outcomes e.g. a Learning Outcome such as “Demonstrate good presentation skills” could be assessed by the requirement that each student makes a presentation to their peers. When writing learning outcomes the verb is often a good clue to the assessment technique. How can we design our examination system so that it tests if learning outcomes have been achieved?
    • 66. 66 Formative AssessmentFormative Assessment  AssessmentAssessment FORFOR learning – giveslearning – gives feedback to students and teachersfeedback to students and teachers to help modify teaching andto help modify teaching and learning activities, i.e. helps informlearning activities, i.e. helps inform teachers and students on progressteachers and students on progress being made.being made.  Assessment is integrated into theAssessment is integrated into the teaching and learning process.teaching and learning process.  Clear and rich feedback helpsClear and rich feedback helps improve performance of studentsimprove performance of students (Black and Williams, 1998).(Black and Williams, 1998).  Usually carried out at beginning orUsually carried out at beginning or during a programme, e.g.during a programme, e.g. coursework which gives feedbackcoursework which gives feedback to students.to students.  Can be used as part of continuousCan be used as part of continuous assessment, but some argue that itassessment, but some argue that it should not be part of gradingshould not be part of grading process (Donnelly and Fitzmaurice,process (Donnelly and Fitzmaurice, 2005)2005) 6666
    • 67. 67 Summative AssessmentSummative Assessment Assessment thatAssessment that summarises student learningsummarises student learning at end of module orat end of module or programme – Assessmentprogramme – Assessment OF Learning.OF Learning. Sums up achievement – noSums up achievement – no other use.other use. Generates a grade or mark.Generates a grade or mark. Usually involves assessmentUsually involves assessment using the traditionalusing the traditional examination.examination. Only a sample of theOnly a sample of the Learning Outcomes areLearning Outcomes are assessed – cannot assessassessed – cannot assess all the Learning Outcomes.all the Learning Outcomes. 6767
    • 68. 68 Continuous AssessmentContinuous Assessment A combination ofA combination of summative andsummative and formative assessment.formative assessment. Usually involvesUsually involves repeated summativerepeated summative assessments.assessments. Marks recorded.Marks recorded. Little or no feedbackLittle or no feedback given.given. 6868
    • 69. 69 Assessment “Assessment is the process of gathering and discussing information from multiple and diverse sources in order to develop a deep understanding of what students know, understand and can do with their knowledge as a result of their educational experiences” (Huba and Freed, 2000) “A way of finding out what our students know and can do”
    • 70. 70 Assessing learning outcomes: points to consider • Learning outcomes: “statements of what a student will know, understand, and/or be able to do at the end of a learning experience”. • Having described your courses in terms of learning outcomes, you now want to find out whether students have achieved them • Specify the types of student performance that will provide evidence of learning
    • 71. 71 “Techniques” of assessment Written: tests, examinations, assignments Practical: skills testing; lab/workshop practice Oral: interviews, various formats Aural: listening tests Project work: individual/group; research/design Field work: data collection and reporting Competence testing: threshold standards Portfolio : combination of techniques
    • 72. 72 Example of Matching the Assessment to the Learning Outcome Learning outcomes 1. Demonstrate good presentation skills. 2. Formulate food product 3. Identify an area for research 4. Identify signs and symptoms of MS in a patient Assessment? a) Multiple choice questions b) Prepare a 1000- word research proposal c) Lab-based project d) Make a presentation to peers
    • 73. 73 Assessing your assessment – is it doing the job you want it to do? Is it comprehensive? Assessment Task 1 e.g. Written Exam Assessment Task 2 e.g. Project Assessment Task 3 e.g. Presentation Assessment Task 4 e.g. Lab work Learning Outcome 1 Describe… Learning Outcome 2 Investigate.. Learning Outcome 3 Demonstrate..
    • 74. 74 To what extent has each Learning Outcome been achieved? Not a question of “yes” or “no” to achievement of Learning Outcomes. Rubric: A grading tool used to describe the criteria which are used in grading the performance of students. Rubric provides a clear guide as to how students’ work will be assessed. A rubric consists of a set of criteria and marks or grade associated with these criteria.
    • 75. 75 Linking learning outcomes and assessment criteria. Learning outcome Assessment criteria Grade 1 Grade 2 : 1 Grade 2 : 2 Pass Fail On successful completion of this module, students should be able to: Summarise evidence from the science education literature to support development of a line of argument. Outstanding use of literature showing excellent ability to synthesise evidence in analytical way to formulate clear conclusions. Very good use of literature showing high ability to synthesise evidence in analytical way to formulate clear conclusions. Good use of literature showing good ability to synthesise evidence in analytical way to formulate clear conclusions Limited use of literature showing fair ability to synthesis e evidence to formulate conclusio ns. Poor use of literature showing lack of ability to synthesise evidence to formulate conclusions
    • 76. 76 76767676 Important to ensure that there is alignment between teaching methods,Important to ensure that there is alignment between teaching methods, learning outcomes and assessment criteria.learning outcomes and assessment criteria. Clear expectations on the part of students of what is required of them areClear expectations on the part of students of what is required of them are a vitally important part of students’ effective learning (Ramsden, 2003)a vitally important part of students’ effective learning (Ramsden, 2003) This correlation between teaching, learning outcomes and assessmentThis correlation between teaching, learning outcomes and assessment helps to make the overall learning experience more transparent andhelps to make the overall learning experience more transparent and meaningful for students.meaningful for students. For the good teacher, earning outcomes do not involve a “paradigm shift”.For the good teacher, earning outcomes do not involve a “paradigm shift”. Teaching for understanding Learning outcomes There is a dynamic equilibrium between teaching strategies and Learning Outcomes.
    • 77. 77 77777777 Teacher Learning Teaching Perspectives: Objectives Outcomes Activities Assessment Student Perspectives: Assessment Learning Activities Outcomes It is important that the assessment tasks mirror the Learning Outcomes since, as far as the students are concerned, the assessment is the curriculum: “From our students’ point of view, assessment always defined the actual curriculum” (Ramsden, 1992). Biggs (2003) represents this graphically as follows: “To the teacher, assessment is at the end of the teaching-learning sequence of events, but to the student it is at the beginning. If the curriculum is reflected in the assessment, as indicated by the downward arrow, the teaching activities of the teacher and the learner activities of the learner are both directed towards the same goal. In preparing for the assessment, students will be learning the curriculum” (Biggs 2003)
    • 78. 78 Steps involved in linking Learning Outcomes,Steps involved in linking Learning Outcomes, Teaching and Learning Activities and AssessmentTeaching and Learning Activities and Assessment 1.1. Clearly define the learningClearly define the learning outcomes.outcomes. 2.2. Select teaching andSelect teaching and learning methods that arelearning methods that are likely to ensure that thelikely to ensure that the learning outcomes arelearning outcomes are achieved.achieved. 3.3. Choose a technique orChoose a technique or techniques to assess thetechniques to assess the achievement of theachievement of the learning outcomes.learning outcomes. 4.4. Assess the learningAssess the learning outcomes and check tooutcomes and check to see how well they matchsee how well they match with what was intendedwith what was intended 7878 If the learning outcomes are clearly written, the assessment is quite easy to plan!
    • 79. 79 Linking Learning Outcomes, Teaching andLinking Learning Outcomes, Teaching and Learning Activities and AssessmentLearning Activities and Assessment Learning Outcomes Teaching and Learning Activities Assessment Cognitive (Demonstrate: Knowledge, Comprehension, Application, Analysis, Synthesis, Evaluation) Affective (Integration of beliefs, ideas and attitudes) Psychomotor (Acquisition of physical skills) Lectures Tutorials Discussions Laboratory work Clinical work Group work Seminar Peer group presentation etc. •End of module exam. •Multiple choice tests. •Essays. •Reports on lab work and research project. •Interviews/viva. •Practical assessment. •Poster display. •Fieldwork. •Clinical examination. •Presentation. •Portfolio. •Performance. •Project work. •Production of artefact etc. 7979
    • 80. 80 Learning outcomes Module ED2100 Teaching and Learning Activities Assessment 10 credit module Mark = 200 Cognitive •Recognise and apply the basic principles of classroom management and discipline. •Identify the key characteristics of high quality science teaching. •Develop a comprehensive portfolio of lesson plans Lectures (12) Tutorials (6) Observation of classes (6) of experienced science teacher (mentor) End of module exam. Portfolio of lesson plans (100 marks) Affective •Display a willingness to co- operate with members of teaching staff in their assigned school. •Participate successfully in Peer Assisted Learning project Participation in mentoring feedback sessions in school (4) Participation in 3 sessions of UCC Peer Assisted Learning (PAL) Programme. Peer group presentation Report from school mentor End of project report. (50 marks) Psychomotor •Demonstrate good classroom presentation skills •Perform laboratory practical work in a safe and efficient manner. Teaching practice 6 weeks at 2 hours per week. Laboratory work Supervision of Teaching Practice Assessment of teaching skills (50 marks) 8080
    • 81. 81 Programme Accreditation Module descriptors with clearly written Learning Outcomes – see handout (1) CIT. Framework for Accreditation e.g. Engineer’s Ireland. Mapping of Programme Areas vs Programme Outcomes – see handout (2) CIT. Mapping of Module Learning Outcomes vs Programme Learning Outcomes Prog. Outcome 1 Prog. Outcome 2 Prog. Outcome 3 Prog. Outcome 4 etc Module 1 √ Module 2 √ Module 3 √ Module 4 √ Module 5 √ Module 6 √ √
    • 82. 82 Does every learning outcome have to be assessed? In theory “yes” but in practice “no”. In some cases they have to be assessed, e.g. licence to practice (e.g. medicine) or to perform essential tasks (e.g. aircraft pilot). When assessment is limited purely to an examination paper, it may not be possible to assess all the Learning Outcomes in such a short space of time – sampling of Learning Outcomes. Even if all the Learning Outcomes are assessed on an examination paper, due to choice of questions, a student may not be assessed on all of them.
    • 83. 83 8383 Modularisation A module is a self-contained fraction of a student’s workload for the year and carries a unique examination/assessment mark. The size of a module is indicated by its credit weighting. Under ECTS system, each year of degree programme = 60 credits. Modules are allocated 5, 10, 15 or 20 credits depending on the fraction of the programme workload covered in the module. Each module is given a unique code, e.g. ED2013 ED2013 Education Year 2 Number assigned to this module
    • 84. 84 Advantages of modularisation Gives greater clarity of structure and helps to establish clear relationship between credits and student workload in ECTS system. Reflects more accurately the various elements of students’ workload. Facilitates work abroad, work placement, off-campus study as modules for degree examinations. Gives greater clarity and consistency in assessment. Provides flexibility in the design of degree programmes by incorporating modules from different areas. Facilitates credit accumulation, i.e. increases number of pathways to final degree award. Hence, encourages greater diversity of students, e.g. mature and part time students. Allows third level institutions to participate in schemes like SOCRATES so that students obtain ECTS credits towards their degree. Facilitates greater ease of student transfer between institutions offering ECTS-based programmes.
    • 85. 85 8585 Modules, Marks, Exams in UCC Module Student Workload Marks Exam Paper 5 credits* 125 – 150 hours 100 1.5 hours 10 credits 250 – 300 hours 200 3 hours 15 credits 375 – 450 hours 300 3 hours 20 credits 500 – 600 hours 400 2 x 3 hours Note: Total per year = 60 credits = 1200 marks
    • 86. 86 8686 In University College Cork, a 5-credit module normally consists of 24 hours of lectures plus associated tutorials/essays / readings/practical/coursework OR The equivalent in student workload such as literature projects, field courses, or indeed set reading assessed by written examination, work for problem sets, studying of legal material and cases outside of lecture hours, etc.
    • 87. 87 87878787 1. Identify aims and objectives of module 2. Write learning outcomes using standard guidelines 3. Develop a teaching and learning strategy to enable students to achieve learning outcomes 4. Design assessment to check if learning outcomes have been achieved 5. If necessary modify module content and assessment in light of feedback
    • 88. 88 88888888 “Writing Learning Outcomes is a Process not an Event”
    • 89. 89 The present situation in UCC All undergraduate modules written in Learning Outcomes in 2006 – 2007 academic year. Work in progress on postgraduate modules. Sub-committee set up (Quality Promotion Unit, Teaching and Learning Centre, Registrar’s Office and Educationalist) to study Learning Outcomes submitted. Programme co-ordinators working on programme Learning Outcomes at present. Working towards deadline of 2010.
    • 90. 90 Looking to the Future
    • 91. 91 “Learning outcomes had fundamentally changed the Scottish sector’s approach to learning since the 1990s and had resulted in enhanced coherence of the learning experience, greater transparency, increased dialogue with stakeholders, more opportunity for students to manage their own learning and better support for transitions into and out of learning programmes at points that suited the needs of the student” - Judith Vincent, Univ of West of Scotland (Seminar 21 – 22 February 2008)
    • 92. 92 Students’ Perspective on Learning Outcomes Learning outcomes are an important aspect of student-centred learning which focused on student needs. Learning outcomes provided students with – a clear idea of what was expected – helped them to identify their own personal and professional development – increased their sense of ownership of their educational experience. – encouraged them to engage more actively in their learning. – gave a more accurate and meaningful picture of student achievement than workload. (Jill Little National Union of Students Scotland)
    • 93. 93 Recommendations from students Learning outcomes should not be used in a tokenistic way e.g., only referred to in course handbooks. Learning Outcomes should be communicated to students so that they can articulate the knowledge and skills they have acquired. Learning Outcomes should be neither so prescriptive as to impede freedom of learning nor so broad as to become meaningless. (Jill Little National Union of Students Scotland)
    • 94. 94 Advantages of Learning Outcomes from students’ perspective The use of learning outcomes with ECTS would result in: A broader, fairer and more accurate recognition of students’ knowledge and skills. A more transparent learning environment Easier to engage with and to choose programmes. Easier mobility within academic fields, education systems and countries. Enhanced employability in Europe More student centred learning. (Jill Little National Union of Students Scotland)
    • 95. 95 Issues with Introduction of Learning Outcomes Learning Outcomes are only part of a massive reform package, e.g. Qualification Frameworks, Lifelong Learning, ECTS, Mutual Recognition, Quality Assurance. How best to introduce Learning Outcomes (“top down” or “bottom up”? Best left to local and National autonomy. How best to deal with sceptical attitude of some staff members – “dumbing down”, “restricting academic freedom”? Hence, important to introduce Learning Outcomes in a proper fashion using sources of good practice and advice. Lack of clarity and lack of shared understanding on key terminology, e.g. learning outcomes and competences.
    • 96. 96 Some Advice Introducing learning outcomes at institutional level requires a carefully tailored strategy, whose primary goal should be quality enhancement rather than compliance with external directives; Learning outcomes must be capable of assessment and at the module level should be linked to assessment criteria, also expressed in terms of learning outcomes; The best learning outcomes are the product of sincere reflection about realistic and attainable combinations of knowledge and understanding, practical and cognitive skills, levels of autonomy, learning skills etc. Learning Outcomes are challenging but it is impossible to have a meaningful European Higher Education area without their widespread and consistent use (Stephen Adams, 2008)
    • 97. 97 Some Recommendations from Porto Conference (19 – 20 June 2008) Develop and disseminate user-friendly documentation to explain to all stakeholders the benefits of learning outcomes and credits. Implement a holistic approach, developing learning outcomes as an integral part of teaching, learning and assessment methods within an aligned curriculum. Offer incentives to encourage staff to engage in new approaches to teaching, learning and assessment.
    • 98. 98 Concluding Points Momentum generated by – European University Association project. – International Bologna conferences. – Setting up of Teaching and Learning Centre (Ionad Bairre). – Postgraduate Cert/Diploma and MA in Teaching and Learning in Higher Education – Lunchtime seminars for staff. Keep it simple. Provide support to staff. Staff training is the key. Setting up of expertise within each Department – Postgraduate Cert/Diploma course. The UCC Quality Promotion Unit - the driving force. A team effort.
    • 99. 99 99999999 That’s all Folks. Hope you learned something about designing curricula based on Learning Outcomes!
    • 100. 100 100100 ReferencesReferences Adam, S. (2004)Adam, S. (2004) Using Learning OutcomesUsing Learning Outcomes:: A consideration of the nature,A consideration of the nature, role, application and implications for European education of employingrole, application and implications for European education of employing learning outcomes at the local, national and international levels.learning outcomes at the local, national and international levels. ReportReport on United Kingdom Bologna Seminar, July 2004, Herriot-Watt University.on United Kingdom Bologna Seminar, July 2004, Herriot-Watt University. Allan, J. (1996). Learning Outcomes in Higher Education. Studies in HigherAllan, J. (1996). Learning Outcomes in Higher Education. Studies in Higher Education 21 (1) 93 – 108.Education 21 (1) 93 – 108. Baume, D. (1999).Baume, D. (1999). Specifying Aims and Learning OutcomesSpecifying Aims and Learning Outcomes Milton Keynes:Milton Keynes: Open University.Open University. Biggs J, (2003) Aligning Teaching and Assessing to Course Objectives.Biggs J, (2003) Aligning Teaching and Assessing to Course Objectives. Teaching and Learning in Higher Education: New Trends andTeaching and Learning in Higher Education: New Trends and InnovationsInnovations. University of Aveiro, 13 – 17 April 2003. University of Aveiro, 13 – 17 April 2003 Biggs, J. (2005) Teaching for Quality Learning at University (2003).Biggs, J. (2005) Teaching for Quality Learning at University (2003). Wiltshire: Open University Press ISBN 0335211682Wiltshire: Open University Press ISBN 0335211682 Bingham, J. (1999)Bingham, J. (1999) Guide to Developing Learning OutcomesGuide to Developing Learning Outcomes, The Learning, The Learning and Teaching Institute Sheffield Hallam University, Sheffield.and Teaching Institute Sheffield Hallam University, Sheffield. Black, P and William, D (1998) Inside the Black Box: Raising StandardsBlack, P and William, D (1998) Inside the Black Box: Raising Standards through Classroom Assessment, London: Kings College.through Classroom Assessment, London: Kings College. Council of Europe, Seminar on Recognition Issues in the Bologna Process,Council of Europe, Seminar on Recognition Issues in the Bologna Process, Lisbon, 2002. Available at: http://www.coe.intLisbon, 2002. Available at: http://www.coe.int Dave, R H (1975)Dave, R H (1975) Developing and Writing Behavioural ObjectivesDeveloping and Writing Behavioural Objectives (R J(R J Armstrong, ed.) Educational Innovators PressArmstrong, ed.) Educational Innovators Press
    • 101. 101 101101 Donnelly, R and Fitzmaurice, M. (2005). Designing Modules for Learning .Donnelly, R and Fitzmaurice, M. (2005). Designing Modules for Learning . In:In: Emerging Issues in the Practice of University Learning and TeachingEmerging Issues in the Practice of University Learning and Teaching,, O’Neill, G et al. Dublin : AISHE.O’Neill, G et al. Dublin : AISHE. ECTS Users’ Guide (2005) Brussels: Directorate-General for Education andECTS Users’ Guide (2005) Brussels: Directorate-General for Education and Culture. Available online at:Culture. Available online at: http://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdfhttp://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdf Fry, H., Ketteridge, S., Marshall (2000)Fry, H., Ketteridge, S., Marshall (2000) A Handbook for Teaching andA Handbook for Teaching and Learning in Higher EducationLearning in Higher Education. London: Kogan Page.. London: Kogan Page. Jenkins, A. and Unwin, D.Jenkins, A. and Unwin, D. How to write learning outcomesHow to write learning outcomes. See the. See the following URL:following URL: http://www.ncgia.ucsb.edu/education/curricula/giscc/units/format/outcomes.http://www.ncgia.ucsb.edu/education/curricula/giscc/units/format/outcomes. htmlhtml Kendall Phillips L. (1994) The Continuing Education Guide: the CEU andKendall Phillips L. (1994) The Continuing Education Guide: the CEU and Other Professional Development Criteria. Iowa: Hunt Publishing.Other Professional Development Criteria. Iowa: Hunt Publishing. Kennedy, D (2007)Kennedy, D (2007) Writing and Using Learning Outcomes – A PracticalWriting and Using Learning Outcomes – A Practical GuideGuide. Quality Promotion Unit, University College Cork. (n.ryan@ucc.ie). Quality Promotion Unit, University College Cork. (n.ryan@ucc.ie) Ramsden, P (2005)Ramsden, P (2005) Learning to teach in Higher EducationLearning to teach in Higher Education, London, London Routledge.Routledge. Shuell, T. J. (1986) Cognitive conceptions of learning. Review ofShuell, T. J. (1986) Cognitive conceptions of learning. Review of Educational Research, 56, 411 – 436.Educational Research, 56, 411 – 436. Tuning Educational Structures in Europe:Tuning Educational Structures in Europe: http://tuning.unideusto.org/tuningeu/http://tuning.unideusto.org/tuningeu/
    • 102. 102 102102102102 ReferencesReferences Bologna Working Group on Qualifications Frameworks (2004). Report on “A Framework for QualificationsBologna Working Group on Qualifications Frameworks (2004). Report on “A Framework for Qualifications of the European Higher Education Area”.of the European Higher Education Area”. Bologna Process Stocktaking London 2007. Available at:Bologna Process Stocktaking London 2007. Available at: www.ond.vlaanderen.be/hogeronderwijs/www.ond.vlaanderen.be/hogeronderwijs/bolognabologna/documents/WGR/documents/WGR20072007//StocktakingStocktaking_report_report20072007.pdf.pdf ECTS Users’ Guide (2005) Brussels: Directorate-General for Education and Culture. Available online at:ECTS Users’ Guide (2005) Brussels: Directorate-General for Education and Culture. Available online at: http://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdfhttp://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdf ECTS Key Features:ECTS Key Features: http://www.bologna.msmt.cz/files/ECTSKeyFeatures.pdfhttp://www.bologna.msmt.cz/files/ECTSKeyFeatures.pdf National Qualifications Frameworks Development and Certification – Report from Bologna Working GroupNational Qualifications Frameworks Development and Certification – Report from Bologna Working Group on Qualifications Frameworks. May 2007on Qualifications Frameworks. May 2007 http://www.ond.vlaanderen.be/hogeronderwijs/bologna/documents/Working_group_reports_2007.htmhttp://www.ond.vlaanderen.be/hogeronderwijs/bologna/documents/Working_group_reports_2007.htm Framework website: www.nfq.ie National Qualifications Authority of Ireland: www.nqai.ie Verification of Compatibility of Irish National Framework of Qualifications with the Framework for Qualifications of the European Higher Education Area - Summary of Final Report – November 2006 http://www.nqai.ie/en/International/VerificationofCompatibilityofIrishNationalFrameworkofQualifications/File,1797 www.bologna.ie
    • 103. 103 Dooley, K. E., Lindner, J. R., Dooley, L. M. and Alagaraja, M. (2004). Behaviorally anchored competencies: evaluation tool for training via distance., Human Resource Development International, 7(3): 315- 332. Elkin, G. (1990) ‘Competency-based human resource development’, Industrial and Commercial Training, 22(4): 20-25 ECTS Users’ Guide (2005) Brussels: Directorate-General for Education and Culture. Available online at: http://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdf Hartel, .R.W. and E.A. Foegeding (2004). Learning: Objectives, Competencies, or Outcomes. Journal of Food Science Education, (3) 69 – 70. Hartle, F. (1995) How to re-engineer your Performance Management Process, London: Kogan Page Hendry, C., Arthur, M.B. and Jones, A.M. (1995) Strategy through People: Adaptation and Learning in the Small-Medium Enterprise, London: Routledge. HETAC (2006) Explanatory Guidelines on the Direct Application to HETAC for a Named Award. Dublin: Higher Education and Training Awards Council. Jarvis, P. (1985) The sociology of adult and continuing education. London: Croom Helm.
    • 104. 104 McBeath, G. (1990) Practical Management Development: Strategies for Management Resourcing and Development in the 1990s, Oxford: Blackwell Messick, S. (1975) The standard problem: meaning and values in measurement and evaluation. American Psychologist October 1975 : 955-966 Messick, S. (1982) Abilities and Knowledge in Educational Achievement Testing: The Assessment of Dynamic Cognitive Structures. Princeton: New Jersey: Education Testing Service. Miller, C, Hoggan, J., Pringle, S. and West, C. (1988) Credit Where Credit’s Due. Report of the Accreditation of Work-based Learning Project. Glasgow. SCOTVEC. Mitriani, A., Dalziel, M and Fitt, D. (1992) Competency Based Human Resource Management, London: Kogan Page. Neary, M. (2002). Curriculum studies in post-compulsory and adult education. Cheltenham: Nelson Thornes. Oliver et al (2008). Curriculum structure: principles and strategy. European Journal of Dental Education. (12) 74 –
    • 105. 105 Smith, B. (1993) ‘Building managers from the inside out: competency based action learning’, Journal of Management Development, 12, 1: 43-8 Tate, W. (1995) Developing Managerial Competence: A Critical Guide to Methods and Materials, London: Gower. Training Agency (1989) Development of Accessible Standards for National Certification Guidance: Note No. 1 Sheffield Employment Department/Training Agency. Winterton J, Delamare-Le Deist F and Stringfellow E (2005) Typology of knowledge, skills and competences: clarification of the concept and prototype. CEDEFORP: Tolouse. Available at: http://www.ecotec.com/europeaninventory/publications/metho Wolf, A. (1989) Can competence and knowledge mix? In J. W Burke (ed). Competency-based Education and Training. Lewes: Falmer Press. Woodruffle, C. (1991). Competent by any other name., Personnel Management, September, 30-31.

    ×