The Shared Data Experience How We Learn to Love Our Data!<br />Akron Ready Steps Assessment Presentation<br />AKRON, OHIP<...
SWI<br />2<br />ALL SUCCESSFUL PROJECTS BEGIN AND END WITH THOUGHTFUL, ACCURATE ASSESSMENT.<br />
Data Drives Our Lives<br />SWI<br />3<br />
Teachers as Scientists<br />SWI<br />4<br />
Rate Yourself- What data (or not) prompts you to choose a curriculum?<br />SWI<br />5<br />
Evaluation as a Key Component<br />SWI<br />6<br />
Let Your Application be Your Guide<br />SWI<br />7<br />
Caveat 1<br />SWI<br />8<br />
Caveat 2<br />SWI<br />9<br />
SWI<br />10<br />
So, Why Assess Children?<br />SWI<br />11<br />
SWI<br />12<br />
So, Why Assess Teachers?<br />SWI<br />13<br />
SWI<br />14<br />
Assessment drives the planning process;<br />which drives our teaching & instructional activities;<br />which are assessed...
Implications for Assessment<br />SWI<br />16<br />
SWI<br />17<br />
Reliability<br />SWI<br />18<br />
Validity<br />SWI<br />19<br />
Bias<br />SWI<br />20<br />
Planning Annual ERF Assessments- <br />SWI<br />21<br />
Set Up a System<br />SWI<br />22<br />
Setup the Assessment Setting<br />SWI<br />23<br />A table for each assessment/ examiner<br />A place for children in betw...
Prepare a Dataset<br />SWI<br />25<br />
Moving Children Through Assessments<br />Use the dataset to create name badges <br />A method by which to track the assess...
ARS Assessments<br />SWI<br />27<br />
Kindergarten Screener<br />SWI<br />28<br />
Kindergarten Screening Tool<br />A screening tool is a short assessment of the presence of behaviors that is a reliable an...
Why Screen?<br />Research shows that learning to read is a process that begins long before children enter kindergarten. Du...
GRTR Screener<br />Use this 20-question research-based screening tool with your 4-year-olds. The score will show if a chil...
SWI<br />33<br />
Peabody Picture Vocabulary Test-IV<br />Measure of Receptive Language<br />SWI<br />34<br />
Peabody Picture Vocabulary Test, Fourth EditionBy Lloyd M. Dunn, PhD and Douglas M. Dunn, PhD<br />
SWI<br />36<br />
SWI<br />38<br />
TRAINING ITEMS Form B ages 4+<br />
Assessment of Language and Literacy<br />Measure of Expressive Language, Phonological Awareness, Alphabet Knowledge, Conce...
SWI<br />42<br />
The Assessment of Literacy and Language (ALL™) aids in early detection of language disorders that could lead to reading di...
Details the nature and severity of the problem<br />Aids in making recommendations for intervention<br />Provides informat...
GET It, Got It, Go!<br />Measure of Progress Monitoring<br />SWI<br />46<br />
GGG (IGDI)<br />Three subtests<br />Rapid Object Naming (1 minute)<br />Rhyming (2 minutes)<br />Alliteration (2 minutes)<...
Standardized Administration DOES Matter<br />(These assessments are formally called Individual Growth and Development Indi...
Each IGDI comes with a set of administration instructions. <br />On the administration cards, bold print indicates exactly...
Always Begin with Sample Items<br />If the child meets the criteria indicated in the sample items, move to administration....
Timing<br />Each IGDI should be administered using a stopwatch according to the exact time specified. <br />SWI<br />51<br />
Prompting<br />Be Careful Not To Provide Corrected Feedback During Administration<br />During IGDI &quot;Administration&qu...
What Happens When Administration Is Not Standardized<br />&quot;Melissa&apos;s&quot; teacher administered the rhyming IGDI...
GGG (IGDI)<br />Picture Naming (Ages 3-5)<br />The format of this indicator presents a child with images of objects common...
Alliteration (Ages 3-5)<br />We identified a set of words commonly known by preschoolers and obtained images of these word...
Rhyming (Ages 3-5)<br />Stimulus cards include a target photo or line drawing at the top of each card (e.g., bees) and a s...
Useful Data <br />SWI<br />57<br />
Bar Graph of Performance by Class<br />SWI<br />58<br />Year 1 Baseline PPVT Standard Scores by Teacher by Kinder Status<b...
Line Graph of Class Performance<br />SWI<br />59<br />
Sample Weekly Data<br />SWI<br />60<br />
GRTR Pretest<br />20.00<br />GRTR 2nd Test<br />15.00<br />10.00<br />5.00<br />0.00<br />Class 1<br />Class 2<br />Class ...
Teacher Report<br />SWI<br />62<br />
Plan, Plan, Plan<br />SWI<br />63<br />
Review, Review, Review<br />SWI<br />64<br />
Celebrate Your Success (based on your data)<br />For more information please contact:<br />Karen Burstein, PhD, Evaluator<...
Upcoming SlideShare
Loading in …5
×

Assessment: The Shared Data Experience

779 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
779
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Assessment: The Shared Data Experience

  1. 1. The Shared Data Experience How We Learn to Love Our Data!<br />Akron Ready Steps Assessment Presentation<br />AKRON, OHIP<br />30 November 2009<br />Karen Burstein, PhD, MPH<br />Project Evaluator<br />
  2. 2. SWI<br />2<br />ALL SUCCESSFUL PROJECTS BEGIN AND END WITH THOUGHTFUL, ACCURATE ASSESSMENT.<br />
  3. 3. Data Drives Our Lives<br />SWI<br />3<br />
  4. 4. Teachers as Scientists<br />SWI<br />4<br />
  5. 5. Rate Yourself- What data (or not) prompts you to choose a curriculum?<br />SWI<br />5<br />
  6. 6. Evaluation as a Key Component<br />SWI<br />6<br />
  7. 7. Let Your Application be Your Guide<br />SWI<br />7<br />
  8. 8. Caveat 1<br />SWI<br />8<br />
  9. 9. Caveat 2<br />SWI<br />9<br />
  10. 10. SWI<br />10<br />
  11. 11. So, Why Assess Children?<br />SWI<br />11<br />
  12. 12. SWI<br />12<br />
  13. 13. So, Why Assess Teachers?<br />SWI<br />13<br />
  14. 14. SWI<br />14<br />
  15. 15. Assessment drives the planning process;<br />which drives our teaching & instructional activities;<br />which are assessed for efficacy based on children’s performance.<br />AND THE CYCLE CONTINUES<br />SWI<br />15<br />
  16. 16. Implications for Assessment<br />SWI<br />16<br />
  17. 17. SWI<br />17<br />
  18. 18. Reliability<br />SWI<br />18<br />
  19. 19. Validity<br />SWI<br />19<br />
  20. 20. Bias<br />SWI<br />20<br />
  21. 21. Planning Annual ERF Assessments- <br />SWI<br />21<br />
  22. 22. Set Up a System<br />SWI<br />22<br />
  23. 23. Setup the Assessment Setting<br />SWI<br />23<br />A table for each assessment/ examiner<br />A place for children in between assessments<br />Limit visual and auditory distraction<br />Make sure teachers have comfortable chairs<br />Make sure that children’s feet are flat on the floor<br />
  24. 24.
  25. 25. Prepare a Dataset<br />SWI<br />25<br />
  26. 26. Moving Children Through Assessments<br />Use the dataset to create name badges <br />A method by which to track the assessments given <br />A daily check sheet of assessments given<br />SWI<br />26<br />
  27. 27. ARS Assessments<br />SWI<br />27<br />
  28. 28. Kindergarten Screener<br />SWI<br />28<br />
  29. 29. Kindergarten Screening Tool<br />A screening tool is a short assessment of the presence of behaviors that is a reliable and valid indicator of a skill. A screening tool should be used to decide whether or not to take specific actions such as seeking referrals, further testing, and instructional activities. A test is a more rigorous and complex assessment of knowledge and skill with more extensive reliability and validity properties. <br />SWI<br />29<br />
  30. 30. Why Screen?<br />Research shows that learning to read is a process that begins long before children enter kindergarten. During the pre-kindergarten years, children develop the early literacy skills that help them to learn how to read during the first few years of elementary school. Early screening and intervention are the keys to overcoming reading difficulties and avoiding the problems that go along with them. Early literacy screening: Helps parents and early childhood professionals understand each child&apos;s progress towards developing literacy concepts and acquiring skills. <br />Helps to identify developmentally appropriate experiences and teaching that can be used to support early literacy learning. <br />Alerts early childhood professionals and parents to seek additional advice if a child does not appear to be making appropriate progress. <br />SWI<br />30<br />
  31. 31. GRTR Screener<br />Use this 20-question research-based screening tool with your 4-year-olds. The score will show if a child&apos;s pre-reading skills are weak, strong, or somewhere in between. And activities and resources to improve those skills will be provided. <br />This tool is designed to screen a child twice during the year before kindergarten. Use the tool first in the fall one year before the child enters kindergarten, and again the next fall before kindergarten begins, to measure the child&apos;s progress. Don&apos;t use the tool more than three times in a year. It&apos;s not designed to measure small changes, and children develop new skills gradually. <br />SWI<br />31<br />
  32. 32.
  33. 33. SWI<br />33<br />
  34. 34. Peabody Picture Vocabulary Test-IV<br />Measure of Receptive Language<br />SWI<br />34<br />
  35. 35. Peabody Picture Vocabulary Test, Fourth EditionBy Lloyd M. Dunn, PhD and Douglas M. Dunn, PhD<br />
  36. 36. SWI<br />36<br />
  37. 37.
  38. 38. SWI<br />38<br />
  39. 39. TRAINING ITEMS Form B ages 4+<br />
  40. 40.
  41. 41. Assessment of Language and Literacy<br />Measure of Expressive Language, Phonological Awareness, Alphabet Knowledge, Concepts of Print<br />SWI<br />41<br />
  42. 42. SWI<br />42<br />
  43. 43. The Assessment of Literacy and Language (ALL™) aids in early detection of language disorders that could lead to reading difficulties. ALL assesses spoken language and written language skills, including: <br />Listening comprehension<br />Language comprehension<br />Semantics<br />Syntax<br />Phonological awareness<br />Alphabetic principles/phonics<br />Concepts about print<br />With ALL, you can identify language disorders, language and emergent literacy deficits, emergent literacy deficits, and weak language and emergent literacy. View case studies to see how ALL can impact a child you know.<br />SWI<br />43<br />
  44. 44. Details the nature and severity of the problem<br />Aids in making recommendations for intervention<br />Provides information about where a child should be in his or her reading and language skills based on grade level. Strategies for improving a child’s language skills in each of the areas assessed are included in the Examiner’s manual.The Parent Questionnaire provides additional information about a child’s language and literacy history and current skills.<br />Norm-referenced scores<br />Criterion-referenced scores<br />SWI<br />44<br />
  45. 45.
  46. 46. GET It, Got It, Go!<br />Measure of Progress Monitoring<br />SWI<br />46<br />
  47. 47. GGG (IGDI)<br />Three subtests<br />Rapid Object Naming (1 minute)<br />Rhyming (2 minutes)<br />Alliteration (2 minutes)<br />SWI<br />47<br />
  48. 48. Standardized Administration DOES Matter<br />(These assessments are formally called Individual Growth and Development Indicators, or IGDIs.)<br />Standardization of administration procedures, which includes: timing, appropriate prompting, administering sample items—is critical so that you get accurate results.<br />By standardizing, we mean that IGDIs are administered in exactly the same way, for each child, across different assessment periods. This assures that IGDIs are administered accurately and reliably.<br />Standardized administrations will minimize any systematic or unnecessary error. By standardizing, we are increasing the accuracy or reliability of our scores from one administrator to the next, from one child to the next, and for an individual child&apos;s scores from time a to b to c to d.<br />SWI<br />48<br />
  49. 49. Each IGDI comes with a set of administration instructions. <br />On the administration cards, bold print indicates exactly what the examiner should say. <br />SWI<br />49<br />
  50. 50. Always Begin with Sample Items<br />If the child meets the criteria indicated in the sample items, move to administration. Discontinue criteria are provided for the picture naming, rhyming, and alliteration measures. These criteria provide an indication of whether a child a). understands the task at hand and b). has sufficient skills for continuing with the administration. <br />For example, the discontinue criteria for picture naming is as follows: The child is administered four sample cards (baby, bear, apple, cat). The administrator may stop administration if the child does not name all four of these pictures correctly.<br />SWI<br />50<br />
  51. 51. Timing<br />Each IGDI should be administered using a stopwatch according to the exact time specified. <br />SWI<br />51<br />
  52. 52. Prompting<br />Be Careful Not To Provide Corrected Feedback During Administration<br />During IGDI &quot;Administration&quot; (not referring to sample card administrations) it is important not to prompt or provide feedback for correct or incorrect responses. Reinforcing statements such as &quot;great,&quot; &quot;good job,&quot; etc. are encouraged. However, feedback should not correspond to correct or incorrect responses made during administration (e.g., &quot;that was right, &quot; &quot;that was wrong, etc).&quot; <br />SWI<br />52<br />
  53. 53. What Happens When Administration Is Not Standardized<br />&quot;Melissa&apos;s&quot; teacher administered the rhyming IGDI to Melissa on Oct. 14th and got a score of 7. She then administered rhyming again on Nov. 14th and got a score of 14. It appears that Melissa grew considerably in rhyming skill during this month. However, Melissa&apos;s teacher indicated that she didn&apos;t use a stopwatch. Instead, she used a clock with no second-hand during both administrations. She simply estimated 2-minutes time. <br />Here, we have a situation where we can not be sure whether Melissa actually grew in rhyming skill, since it may be that there was simply more time allotted to her during her second administration. Furthermore, lets say Melissa&apos;s teacher administered rhyming to all her students without timing exactly 2 minutes. In this case, we can not make accurate comparisons across students since maybe some student may have done better than others, simply because they were allotted more time.<br />SWI<br />53<br />
  54. 54. GGG (IGDI)<br />Picture Naming (Ages 3-5)<br />The format of this indicator presents a child with images of objects commonly found in preschoolers&apos; natural environments (i.e., home, classroom, community), one at a time, asking a child to name the pictures as fast as possible. Categories of objects used in this format include animals, food, people, household objects, games and sports materials, vehicles, tools, and clothing. Each photograph and line drawing is printed on an 8&quot; x 5&quot; index card. After providing a set of sample items, the examiner asks the child to look at each card and name it as quickly as possible. After exactly one minute, the examiner stops the activity and counts the total number of pictures named correctly. <br />SWI<br />54<br />
  55. 55. Alliteration (Ages 3-5)<br />We identified a set of words commonly known by preschoolers and obtained images of these words. Stimulus cards include one image at the top of each card (e.g., rain) and a set of three images in a row at the bottom of each card (e.g., house, rake, pig), one of which starts with the same sound as the target picture. After providing a set of sample items, the examiner asks the child to look at each card and point to one of the three pictures at the bottom of the card with the same initial sound as the fourth, target picture. The task continues for a total of two minutes. The score generated from this format is the number of pictures the child correctly identifies within two minutes. <br />SWI<br />55<br />
  56. 56. Rhyming (Ages 3-5)<br />Stimulus cards include a target photo or line drawing at the top of each card (e.g., bees) and a set of three photos/drawings in a row at the bottom of each card (e.g., pants, gate, cheese), one of which rhymes with the target picture. After providing a set of sample items, the examiner asks the child to look at each card and point to one of the three pictures at the bottom of the card that sounds the same as (or rhymes with) the fourth, target picture. The task continues for a total of two minutes. The score generated from this format is the number of pictures the child correctly identifies within two minutes.<br />SWI<br />56<br />
  57. 57. Useful Data <br />SWI<br />57<br />
  58. 58. Bar Graph of Performance by Class<br />SWI<br />58<br />Year 1 Baseline PPVT Standard Scores by Teacher by Kinder Status<br />KINDER BOUND<br />100<br />GOING TO <br />KINDERGARTEN<br />RETURNING TO <br />PRESCHOOL<br />80<br />60<br />96.8<br />95<br />91.9<br />89.3<br />87<br />85<br />84<br />82.4<br />40<br />80.5<br />79.6<br />78.7<br />77.2<br />76<br />20<br />0<br />6<br />5<br />7<br />2<br />8<br />3<br />1<br />4<br />Class<br />
  59. 59. Line Graph of Class Performance<br />SWI<br />59<br />
  60. 60. Sample Weekly Data<br />SWI<br />60<br />
  61. 61. GRTR Pretest<br />20.00<br />GRTR 2nd Test<br />15.00<br />10.00<br />5.00<br />0.00<br />Class 1<br />Class 2<br />Class 3<br />Site<br />. Get It Got It Go (N = 46, participating in both pretest and 2nd test)<br />SWI<br />61<br />
  62. 62. Teacher Report<br />SWI<br />62<br />
  63. 63. Plan, Plan, Plan<br />SWI<br />63<br />
  64. 64. Review, Review, Review<br />SWI<br />64<br />
  65. 65. Celebrate Your Success (based on your data)<br />For more information please contact:<br />Karen Burstein, PhD, Evaluator<br /> 480-222-8800 x 1 k.burstein@swifamilies.org<br />SWI<br />65<br />

×