SlideShare a Scribd company logo
Chapter 10
Allison barbee
Background
 A formative evaluation, evidence of an instructional program’s worth is gathered
for use in making decisions about how to revise the program while it is being
developed. This is why it is called "formative" evaluation, because the instruction is in its
developmental stages and is not yet "grown up". The idea is to find out if your newly
developed course works at teaching the objectives you need to teach to the learners
who need to learn them, before you present it to your target audience. In any given
formative evaluation, you can find out how to make your instruction more:
 Effective
 Efficient
 Interesting/Motivating
 Usable
 Acceptable You do this by carrying out procedures that will provide you with evidence
as to the effectiveness of your instruction. The emphasis is on collecting data and
revising the instruction.
Objective
 Describe the purposes for and various stages of formative evaluation of instructor-
developed materials, instructor- selected materials, and instructor- presented
instruction.
 Describe the instruments used in a formative evaluation.
 Develop an appropriate formative evaluation plan and construct instruments for a set of
instructional materials or an instructor presentation.
 Collect data according to a formative evaluation plan for a given set of instructional
materials or instructor presentation.
Formative Evaluation
 Definition
The collection of data and information during the development of
instruction that can be used to improve the effectiveness of the instruction.
 Purpose
To obtain data that can be used to revise the instruction to make it more
efficient and effective.
3 PHASES
1 TO 1 EVALUATION
SMALL GROUP
FIELD TRIAL
1 TO 1
 PURPOSE: IDENTIFY AND REMOVE ERRORS IN INSTRUCTION
 CRITERIA
 CLARITY
 IMPACT
 FEASIBILITY
 SELECTING LEARNERS
 DATA COLLECTION
 OUTCOMES
CRITERIA
 During the development of the instructional strategy and the instruction itself, designers and
developers make a myriad of translations and decisions that link the content, learners,
instructional format, and instructional setting. The one- to- one trials provide designers with their
first glimpse of the viability of these links and translations from the learners’ perspective. The
three main criteria and the decisions de-signers will make during the evaluation are as follows:
 1. Clarity: Is the message, or what is being presented, clear to individual target learners?
 2. Impact: What is the impact of the instruction on individual learner’s attitudes and achievement
of the objectives and goals?
 3. Feasibility: How feasible is the instruction given the available resources ( time/ context)?
LEARNER SELECTION
 NOT AN EXPIEREMENT
NO RANDOM SELECTION
 LEARNERS SHOULD REPRESENT A WIDE VARIETY BUT IN A SMALL
GROUP
 EVALUATE
DATA
 1: CLEAR BASIC MESSAGE
 VOCAB, SENTENCE COMPLEXITY, STRUCTURE
 2: LINKS
 WORKS FOR LEARNER, EXAMPLES,
 3: PROCEDURES
 TYPE OF INSTRUCTION, VARIOTION, CLARITY MAY CHANGE IF NOT APPROPIATE
STEPS
 a one- to- one evaluation is to explain to the learner that a new set of instructional materials has
been designed and that you would like his or her reaction to them. You should say that any
mistakes that learners might make are probably due to deficiencies in the material and not theirs.
 Encourage the learners to be relaxed and to talk about the materials.
 You should have the learners not only go through the instructional materials but also have them
take the test( s) provided with the materials.
QUESTIONAIRES
 HELPS YOU SPOT MISTAKES
 LETS YOU KNOW WHY THEY MADE CERTAIN CHOICES
 ALLOWS THE EVALUATION TO BE BASED ON THEIR OPINION AS WELL
INTERPREATING DATE
 The information on the clarity of instruction, impact on learner, and
feasibility of instruction needs to be summarized and focused.
 Particular aspects of the instruction found to be weak can then be
reconsidered in order to plan revisions likely to improve the instruction
for similar learners.
OUTCOMES
 The outcomes of one- to- one trials are instruction that
 1) contains appropriate vocabulary, language complexity, examples, and
illustrations for the participating learner;
 ( 2) either yields reasonable learner attitudes and achievement or is
revised with the objective of improving learner attitudes or performance
during sub-sequent trials; and
 ( 3) appears feasible for use with the available learners, resources, and
setting. The instruction can be refined further using small group trials.
SMALL GROUP
 Purposes To determine the effectiveness of changes made following
the one-to-one evaluation.
 To identify any remaining learning problems that learners may have.
 To determine whether learners can use the instruction without interacting
with the instructor.
EVALUATION
 To determine Weakness(es) in the Instruction
 Focusing the design only on the goals and objectives of the instruction would be too
limited.
 Data on learners’ achievement of goals and objectives would be insufficient, though
important, because these data will only provide information about where errors occur
rather than why they occur.
EVALUATION
 Design Review
 Expert Review
 One-To-One
 Small Group
 Field Trials
 Ongoing Evaluation
DESIGN REVIEW
 Does the instructional goal match the problem identified in the needs assessment?
 Does the learner & environmental analysis match the audience?
 Does the task analysis include all the prerequisite skills?
 Are the test items reliable and valid, and do they match the objectives?
REVIEW
 Is the content accurate & up-to-date?
 Does it present a consistent perspective?
 Are examples, practice exercises, & feedback realistic & accurate?
 Is the pedagogy consistent with current instructional theory?
 Is the instruction appropriate to the audience?
SUMMARY
 Formative evaluation of instructional materials is conducted to determine the effectiveness of the
materials and to revise them in areas where they are ineffective. Formative evaluations should be
conducted on newly developed materials as well as existing materials that are selected based on
the instructional strategy. Evaluations are necessary for both mediated and instructor presented
materials.
THANK YOU
 ALLISON BARBEE
 ABARBEE9832@MYASU.ALASLU.EDU

More Related Content

What's hot

Developing assessment instruments
Developing assessment instrumentsDeveloping assessment instruments
Developing assessment instrumentsLarry Cobb
 
Chapter 11 revising instructional materials
Chapter 11 revising instructional materialsChapter 11 revising instructional materials
Chapter 11 revising instructional materials
Sidney Lanier High School
 
Designing and conducting formative evaluations10
Designing and conducting formative evaluations10Designing and conducting formative evaluations10
Designing and conducting formative evaluations10gnpinkston
 
Designing and Conducting Formative Evaluation
Designing and Conducting Formative EvaluationDesigning and Conducting Formative Evaluation
Designing and Conducting Formative Evaluation
LaSheena Nation
 
Ch. 10 powerpoint apt 501
Ch. 10 powerpoint apt 501Ch. 10 powerpoint apt 501
Ch. 10 powerpoint apt 501
AlyssaSingleterry
 
Developing assessment instruments
Developing assessment instrumentsDeveloping assessment instruments
Developing assessment instruments
Raheen26
 
Principles of good practice in assessing learning outcomes
Principles of good practice in assessing learning outcomesPrinciples of good practice in assessing learning outcomes
Principles of good practice in assessing learning outcomes
Rommel Luis III Israel
 
Designing Teaching: ADDIE
Designing Teaching: ADDIEDesigning Teaching: ADDIE
Designing Teaching: ADDIE
Damian T. Gordon
 
Content,performance standard
Content,performance standardContent,performance standard
Content,performance standardmarvz18
 
Chapter 10 willis white
Chapter 10 willis whiteChapter 10 willis white
Chapter 10 willis white
Willislwhite12
 
Goal setting and objectives
Goal setting and objectivesGoal setting and objectives
Goal setting and objectivesdonwashburn
 
Ch. 11 designing and conducting formative evaluations
Ch. 11 designing and conducting formative evaluationsCh. 11 designing and conducting formative evaluations
Ch. 11 designing and conducting formative evaluations
EzraGray1
 
Samples of supporting student activities
Samples of supporting student activitiesSamples of supporting student activities
Samples of supporting student activities
jdveyra
 
Marzano: Setting Obj and Providing Feedback
Marzano: Setting Obj and Providing FeedbackMarzano: Setting Obj and Providing Feedback
Marzano: Setting Obj and Providing FeedbackDonna Murray
 
Assessment in the K12 Classroom
Assessment in the K12 ClassroomAssessment in the K12 Classroom
Assessment in the K12 Classroom
Patricia Dickenson
 
Setting objectives and providing feedback
Setting objectives and  providing feedbackSetting objectives and  providing feedback
Setting objectives and providing feedbackHolly Grubbs
 
Aif l and raising attainment
Aif l and raising attainmentAif l and raising attainment
Aif l and raising attainment
curriechs
 
Summative and Formative Assessment
Summative and Formative AssessmentSummative and Formative Assessment
Summative and Formative Assessmentmelostee
 
Summative Evaluation PowerPoint
Summative Evaluation PowerPointSummative Evaluation PowerPoint
Summative Evaluation PowerPoint
Joidon Jennings
 

What's hot (20)

Developing assessment instruments
Developing assessment instrumentsDeveloping assessment instruments
Developing assessment instruments
 
Chapter 11 revising instructional materials
Chapter 11 revising instructional materialsChapter 11 revising instructional materials
Chapter 11 revising instructional materials
 
Designing and conducting formative evaluations10
Designing and conducting formative evaluations10Designing and conducting formative evaluations10
Designing and conducting formative evaluations10
 
Designing and Conducting Formative Evaluation
Designing and Conducting Formative EvaluationDesigning and Conducting Formative Evaluation
Designing and Conducting Formative Evaluation
 
Ch. 10 powerpoint apt 501
Ch. 10 powerpoint apt 501Ch. 10 powerpoint apt 501
Ch. 10 powerpoint apt 501
 
Developing assessment instruments
Developing assessment instrumentsDeveloping assessment instruments
Developing assessment instruments
 
Principles of good practice in assessing learning outcomes
Principles of good practice in assessing learning outcomesPrinciples of good practice in assessing learning outcomes
Principles of good practice in assessing learning outcomes
 
Designing Teaching: ADDIE
Designing Teaching: ADDIEDesigning Teaching: ADDIE
Designing Teaching: ADDIE
 
Content,performance standard
Content,performance standardContent,performance standard
Content,performance standard
 
Chapter 10 willis white
Chapter 10 willis whiteChapter 10 willis white
Chapter 10 willis white
 
Goal setting and objectives
Goal setting and objectivesGoal setting and objectives
Goal setting and objectives
 
Design
DesignDesign
Design
 
Ch. 11 designing and conducting formative evaluations
Ch. 11 designing and conducting formative evaluationsCh. 11 designing and conducting formative evaluations
Ch. 11 designing and conducting formative evaluations
 
Samples of supporting student activities
Samples of supporting student activitiesSamples of supporting student activities
Samples of supporting student activities
 
Marzano: Setting Obj and Providing Feedback
Marzano: Setting Obj and Providing FeedbackMarzano: Setting Obj and Providing Feedback
Marzano: Setting Obj and Providing Feedback
 
Assessment in the K12 Classroom
Assessment in the K12 ClassroomAssessment in the K12 Classroom
Assessment in the K12 Classroom
 
Setting objectives and providing feedback
Setting objectives and  providing feedbackSetting objectives and  providing feedback
Setting objectives and providing feedback
 
Aif l and raising attainment
Aif l and raising attainmentAif l and raising attainment
Aif l and raising attainment
 
Summative and Formative Assessment
Summative and Formative AssessmentSummative and Formative Assessment
Summative and Formative Assessment
 
Summative Evaluation PowerPoint
Summative Evaluation PowerPointSummative Evaluation PowerPoint
Summative Evaluation PowerPoint
 

Viewers also liked

Module 1 lesson 5 identifying proportional
Module 1 lesson 5 identifying proportionalModule 1 lesson 5 identifying proportional
Module 1 lesson 5 identifying proportional
Erik Tjersland
 
Business Rules with Brick
Business Rules with BrickBusiness Rules with Brick
Business Rules with Brick
brian d foy
 
PO 101 Political Culture
PO 101 Political CulturePO 101 Political Culture
PO 101 Political Culture
Austin Trantham
 
Programa de Estágio 2017
Programa de Estágio 2017Programa de Estágio 2017
Ada #1 b3
Ada #1 b3Ada #1 b3
Ada #1 b3
Axel De la Cruz
 
What is an art
What is an artWhat is an art
What is an art
A Q KHAN
 
Евгений Калинин. Изменения в УК и УПК РФ 3
Евгений Калинин. Изменения в УК и УПК РФ 3Евгений Калинин. Изменения в УК и УПК РФ 3
Евгений Калинин. Изменения в УК и УПК РФ 3
Ассоциация Национальный платежный совет
 
Writing sample_ Martina Mori
Writing sample_ Martina MoriWriting sample_ Martina Mori
Writing sample_ Martina MoriMartina Mori
 
Qui uf acd_luvl
Qui uf acd_luvlQui uf acd_luvl
Qui uf acd_luvl
Carito Velasco
 
energia
energiaenergia
Act3 jmoy
Act3 jmoyAct3 jmoy
Act3 jmoy
Michell-21
 
ADP02 - Navigating Social Media
ADP02 - Navigating Social MediaADP02 - Navigating Social Media
ADP02 - Navigating Social Media
Chad Landman
 
ADP01 - Why It's Important
ADP01 - Why It's ImportantADP01 - Why It's Important
ADP01 - Why It's Important
Chad Landman
 
La alimentacion saludable en niños
La alimentacion saludable en niños La alimentacion saludable en niños
La alimentacion saludable en niños
7273438
 
Remixing play into a gameplan workshop, Trinidad
Remixing play into a gameplan workshop, TrinidadRemixing play into a gameplan workshop, Trinidad
Remixing play into a gameplan workshop, Trinidad
Sylvester Arnab
 
HBaseConEast2016: HBase on Docker with Clusterdock
HBaseConEast2016: HBase on Docker with ClusterdockHBaseConEast2016: HBase on Docker with Clusterdock
HBaseConEast2016: HBase on Docker with Clusterdock
Michael Stack
 
Perl 5.28 new features
Perl 5.28 new featuresPerl 5.28 new features
Perl 5.28 new features
brian d foy
 
Perl Bag of Tricks - Baltimore Perl mongers
Perl Bag of Tricks  -  Baltimore Perl mongersPerl Bag of Tricks  -  Baltimore Perl mongers
Perl Bag of Tricks - Baltimore Perl mongers
brian d foy
 
Event Detection Pipelines with Apache Kafka
Event Detection Pipelines with Apache KafkaEvent Detection Pipelines with Apache Kafka
Event Detection Pipelines with Apache Kafka
DataWorks Summit
 
Renacimiento
Renacimiento Renacimiento
Renacimiento
milagros blanco
 

Viewers also liked (20)

Module 1 lesson 5 identifying proportional
Module 1 lesson 5 identifying proportionalModule 1 lesson 5 identifying proportional
Module 1 lesson 5 identifying proportional
 
Business Rules with Brick
Business Rules with BrickBusiness Rules with Brick
Business Rules with Brick
 
PO 101 Political Culture
PO 101 Political CulturePO 101 Political Culture
PO 101 Political Culture
 
Programa de Estágio 2017
Programa de Estágio 2017Programa de Estágio 2017
Programa de Estágio 2017
 
Ada #1 b3
Ada #1 b3Ada #1 b3
Ada #1 b3
 
What is an art
What is an artWhat is an art
What is an art
 
Евгений Калинин. Изменения в УК и УПК РФ 3
Евгений Калинин. Изменения в УК и УПК РФ 3Евгений Калинин. Изменения в УК и УПК РФ 3
Евгений Калинин. Изменения в УК и УПК РФ 3
 
Writing sample_ Martina Mori
Writing sample_ Martina MoriWriting sample_ Martina Mori
Writing sample_ Martina Mori
 
Qui uf acd_luvl
Qui uf acd_luvlQui uf acd_luvl
Qui uf acd_luvl
 
energia
energiaenergia
energia
 
Act3 jmoy
Act3 jmoyAct3 jmoy
Act3 jmoy
 
ADP02 - Navigating Social Media
ADP02 - Navigating Social MediaADP02 - Navigating Social Media
ADP02 - Navigating Social Media
 
ADP01 - Why It's Important
ADP01 - Why It's ImportantADP01 - Why It's Important
ADP01 - Why It's Important
 
La alimentacion saludable en niños
La alimentacion saludable en niños La alimentacion saludable en niños
La alimentacion saludable en niños
 
Remixing play into a gameplan workshop, Trinidad
Remixing play into a gameplan workshop, TrinidadRemixing play into a gameplan workshop, Trinidad
Remixing play into a gameplan workshop, Trinidad
 
HBaseConEast2016: HBase on Docker with Clusterdock
HBaseConEast2016: HBase on Docker with ClusterdockHBaseConEast2016: HBase on Docker with Clusterdock
HBaseConEast2016: HBase on Docker with Clusterdock
 
Perl 5.28 new features
Perl 5.28 new featuresPerl 5.28 new features
Perl 5.28 new features
 
Perl Bag of Tricks - Baltimore Perl mongers
Perl Bag of Tricks  -  Baltimore Perl mongersPerl Bag of Tricks  -  Baltimore Perl mongers
Perl Bag of Tricks - Baltimore Perl mongers
 
Event Detection Pipelines with Apache Kafka
Event Detection Pipelines with Apache KafkaEvent Detection Pipelines with Apache Kafka
Event Detection Pipelines with Apache Kafka
 
Renacimiento
Renacimiento Renacimiento
Renacimiento
 

Similar to Presentation5

Designing and conducting formative evaluations
Designing and conducting formative evaluationsDesigning and conducting formative evaluations
Designing and conducting formative evaluationsLarry Cobb
 
Continuous Assessment/Testing Guidelines Summary
Continuous Assessment/Testing Guidelines SummaryContinuous Assessment/Testing Guidelines Summary
Continuous Assessment/Testing Guidelines Summary
Manuel Reyes
 
Continuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summaryContinuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summary
Manolo05
 
Revising Instructional Materials
Revising Instructional MaterialsRevising Instructional Materials
Revising Instructional Materials
1shooks
 
Goals and objectives
Goals and objectivesGoals and objectives
Goals and objectivesItala Diaz
 
Designing and Conducting Formative Evaluation
Designing and Conducting Formative EvaluationDesigning and Conducting Formative Evaluation
Designing and Conducting Formative Evaluation
Angel Jones
 
501 assignment 9 chapter 12 revision
501 assignment 9 chapter 12 revision501 assignment 9 chapter 12 revision
501 assignment 9 chapter 12 revision
KaWright1961
 
Appendix 4 Quality Of Assessment Practices Presentation
Appendix 4    Quality Of Assessment Practices PresentationAppendix 4    Quality Of Assessment Practices Presentation
Appendix 4 Quality Of Assessment Practices Presentation
Kathleen Zarubin
 
Apt501 assignment 10
Apt501 assignment 10Apt501 assignment 10
Apt501 assignment 10
CarlyYasses
 
Unit 301 Essay
Unit 301 EssayUnit 301 Essay
K to 12 classroom assessment ppt
K to 12 classroom assessment pptK to 12 classroom assessment ppt
K to 12 classroom assessment ppt
Carlo Magno
 
Companion Materials Looking Through the Lens of Rubrics
Companion Materials Looking Through the Lens of RubricsCompanion Materials Looking Through the Lens of Rubrics
Companion Materials Looking Through the Lens of Rubrics
anniesyso
 
Chapter 10 class
Chapter 10 classChapter 10 class
Chapter 10 classdx3driver
 
Presentation2
Presentation2Presentation2
Presentation2
Allison barbee
 
ASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).ppt
ASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).pptASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).ppt
ASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).ppt
OscarAncheta
 
Assignment 6 ppt
Assignment 6 pptAssignment 6 ppt
Assignment 6 ppt
KobieJones1
 
Evaluation: Determining the Effect of the Intervention
Evaluation: Determining the Effect of the Intervention Evaluation: Determining the Effect of the Intervention
Evaluation: Determining the Effect of the Intervention
Ijaz Ahmad
 
Spaulding 5 11-25 presentation stofanak
Spaulding 5 11-25 presentation stofanakSpaulding 5 11-25 presentation stofanak
Spaulding 5 11-25 presentation stofanak
competencyworks
 

Similar to Presentation5 (20)

Chapter 11
Chapter 11Chapter 11
Chapter 11
 
Designing and conducting formative evaluations
Designing and conducting formative evaluationsDesigning and conducting formative evaluations
Designing and conducting formative evaluations
 
Continuous Assessment/Testing Guidelines Summary
Continuous Assessment/Testing Guidelines SummaryContinuous Assessment/Testing Guidelines Summary
Continuous Assessment/Testing Guidelines Summary
 
Continuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summaryContinuous asessment / Testing guidelines summary
Continuous asessment / Testing guidelines summary
 
Revising Instructional Materials
Revising Instructional MaterialsRevising Instructional Materials
Revising Instructional Materials
 
Goals and objectives
Goals and objectivesGoals and objectives
Goals and objectives
 
Designing and Conducting Formative Evaluation
Designing and Conducting Formative EvaluationDesigning and Conducting Formative Evaluation
Designing and Conducting Formative Evaluation
 
501 assignment 9 chapter 12 revision
501 assignment 9 chapter 12 revision501 assignment 9 chapter 12 revision
501 assignment 9 chapter 12 revision
 
Appendix 4 Quality Of Assessment Practices Presentation
Appendix 4    Quality Of Assessment Practices PresentationAppendix 4    Quality Of Assessment Practices Presentation
Appendix 4 Quality Of Assessment Practices Presentation
 
Apt501 assignment 10
Apt501 assignment 10Apt501 assignment 10
Apt501 assignment 10
 
Unit 301 Essay
Unit 301 EssayUnit 301 Essay
Unit 301 Essay
 
K to 12 classroom assessment ppt
K to 12 classroom assessment pptK to 12 classroom assessment ppt
K to 12 classroom assessment ppt
 
Companion Materials Looking Through the Lens of Rubrics
Companion Materials Looking Through the Lens of RubricsCompanion Materials Looking Through the Lens of Rubrics
Companion Materials Looking Through the Lens of Rubrics
 
Chapter 10 class
Chapter 10 classChapter 10 class
Chapter 10 class
 
Presentation2
Presentation2Presentation2
Presentation2
 
ASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).ppt
ASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).pptASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).ppt
ASSESSMENT IN LEARNING 1-LESSONS 1-4 (1).ppt
 
Assignment 6 ppt
Assignment 6 pptAssignment 6 ppt
Assignment 6 ppt
 
Evaluation: Determining the Effect of the Intervention
Evaluation: Determining the Effect of the Intervention Evaluation: Determining the Effect of the Intervention
Evaluation: Determining the Effect of the Intervention
 
Afl Presentation
Afl PresentationAfl Presentation
Afl Presentation
 
Spaulding 5 11-25 presentation stofanak
Spaulding 5 11-25 presentation stofanakSpaulding 5 11-25 presentation stofanak
Spaulding 5 11-25 presentation stofanak
 

More from Allison barbee

Module 9
Module 9Module 9
Module 9
Allison barbee
 
handouts study guides and visuals
handouts study guides and visuals handouts study guides and visuals
handouts study guides and visuals
Allison barbee
 
instructional design
instructional design instructional design
instructional design
Allison barbee
 
Distance tech power
Distance tech power Distance tech power
Distance tech power
Allison barbee
 
history of distant education
history of distant educationhistory of distant education
history of distant education
Allison barbee
 
foundations of distance education
foundations of distance educationfoundations of distance education
foundations of distance education
Allison barbee
 
Presentation6
Presentation6Presentation6
Presentation6
Allison barbee
 
Presentation4
Presentation4Presentation4
Presentation4
Allison barbee
 
Presentation3
Presentation3Presentation3
Presentation3
Allison barbee
 
Power point
Power pointPower point
Power point
Allison barbee
 

More from Allison barbee (10)

Module 9
Module 9Module 9
Module 9
 
handouts study guides and visuals
handouts study guides and visuals handouts study guides and visuals
handouts study guides and visuals
 
instructional design
instructional design instructional design
instructional design
 
Distance tech power
Distance tech power Distance tech power
Distance tech power
 
history of distant education
history of distant educationhistory of distant education
history of distant education
 
foundations of distance education
foundations of distance educationfoundations of distance education
foundations of distance education
 
Presentation6
Presentation6Presentation6
Presentation6
 
Presentation4
Presentation4Presentation4
Presentation4
 
Presentation3
Presentation3Presentation3
Presentation3
 
Power point
Power pointPower point
Power point
 

Recently uploaded

DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 

Recently uploaded (20)

DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 

Presentation5

  • 2. Background  A formative evaluation, evidence of an instructional program’s worth is gathered for use in making decisions about how to revise the program while it is being developed. This is why it is called "formative" evaluation, because the instruction is in its developmental stages and is not yet "grown up". The idea is to find out if your newly developed course works at teaching the objectives you need to teach to the learners who need to learn them, before you present it to your target audience. In any given formative evaluation, you can find out how to make your instruction more:  Effective  Efficient  Interesting/Motivating  Usable  Acceptable You do this by carrying out procedures that will provide you with evidence as to the effectiveness of your instruction. The emphasis is on collecting data and revising the instruction.
  • 3. Objective  Describe the purposes for and various stages of formative evaluation of instructor- developed materials, instructor- selected materials, and instructor- presented instruction.  Describe the instruments used in a formative evaluation.  Develop an appropriate formative evaluation plan and construct instruments for a set of instructional materials or an instructor presentation.  Collect data according to a formative evaluation plan for a given set of instructional materials or instructor presentation.
  • 4. Formative Evaluation  Definition The collection of data and information during the development of instruction that can be used to improve the effectiveness of the instruction.  Purpose To obtain data that can be used to revise the instruction to make it more efficient and effective.
  • 5. 3 PHASES 1 TO 1 EVALUATION SMALL GROUP FIELD TRIAL
  • 6. 1 TO 1  PURPOSE: IDENTIFY AND REMOVE ERRORS IN INSTRUCTION  CRITERIA  CLARITY  IMPACT  FEASIBILITY  SELECTING LEARNERS  DATA COLLECTION  OUTCOMES
  • 7. CRITERIA  During the development of the instructional strategy and the instruction itself, designers and developers make a myriad of translations and decisions that link the content, learners, instructional format, and instructional setting. The one- to- one trials provide designers with their first glimpse of the viability of these links and translations from the learners’ perspective. The three main criteria and the decisions de-signers will make during the evaluation are as follows:  1. Clarity: Is the message, or what is being presented, clear to individual target learners?  2. Impact: What is the impact of the instruction on individual learner’s attitudes and achievement of the objectives and goals?  3. Feasibility: How feasible is the instruction given the available resources ( time/ context)?
  • 8. LEARNER SELECTION  NOT AN EXPIEREMENT NO RANDOM SELECTION  LEARNERS SHOULD REPRESENT A WIDE VARIETY BUT IN A SMALL GROUP  EVALUATE
  • 9. DATA  1: CLEAR BASIC MESSAGE  VOCAB, SENTENCE COMPLEXITY, STRUCTURE  2: LINKS  WORKS FOR LEARNER, EXAMPLES,  3: PROCEDURES  TYPE OF INSTRUCTION, VARIOTION, CLARITY MAY CHANGE IF NOT APPROPIATE
  • 10. STEPS  a one- to- one evaluation is to explain to the learner that a new set of instructional materials has been designed and that you would like his or her reaction to them. You should say that any mistakes that learners might make are probably due to deficiencies in the material and not theirs.  Encourage the learners to be relaxed and to talk about the materials.  You should have the learners not only go through the instructional materials but also have them take the test( s) provided with the materials.
  • 11. QUESTIONAIRES  HELPS YOU SPOT MISTAKES  LETS YOU KNOW WHY THEY MADE CERTAIN CHOICES  ALLOWS THE EVALUATION TO BE BASED ON THEIR OPINION AS WELL
  • 12. INTERPREATING DATE  The information on the clarity of instruction, impact on learner, and feasibility of instruction needs to be summarized and focused.  Particular aspects of the instruction found to be weak can then be reconsidered in order to plan revisions likely to improve the instruction for similar learners.
  • 13. OUTCOMES  The outcomes of one- to- one trials are instruction that  1) contains appropriate vocabulary, language complexity, examples, and illustrations for the participating learner;  ( 2) either yields reasonable learner attitudes and achievement or is revised with the objective of improving learner attitudes or performance during sub-sequent trials; and  ( 3) appears feasible for use with the available learners, resources, and setting. The instruction can be refined further using small group trials.
  • 14. SMALL GROUP  Purposes To determine the effectiveness of changes made following the one-to-one evaluation.  To identify any remaining learning problems that learners may have.  To determine whether learners can use the instruction without interacting with the instructor.
  • 15. EVALUATION  To determine Weakness(es) in the Instruction  Focusing the design only on the goals and objectives of the instruction would be too limited.  Data on learners’ achievement of goals and objectives would be insufficient, though important, because these data will only provide information about where errors occur rather than why they occur.
  • 16. EVALUATION  Design Review  Expert Review  One-To-One  Small Group  Field Trials  Ongoing Evaluation
  • 17. DESIGN REVIEW  Does the instructional goal match the problem identified in the needs assessment?  Does the learner & environmental analysis match the audience?  Does the task analysis include all the prerequisite skills?  Are the test items reliable and valid, and do they match the objectives?
  • 18. REVIEW  Is the content accurate & up-to-date?  Does it present a consistent perspective?  Are examples, practice exercises, & feedback realistic & accurate?  Is the pedagogy consistent with current instructional theory?  Is the instruction appropriate to the audience?
  • 19. SUMMARY  Formative evaluation of instructional materials is conducted to determine the effectiveness of the materials and to revise them in areas where they are ineffective. Formative evaluations should be conducted on newly developed materials as well as existing materials that are selected based on the instructional strategy. Evaluations are necessary for both mediated and instructor presented materials.
  • 20. THANK YOU  ALLISON BARBEE  ABARBEE9832@MYASU.ALASLU.EDU