Robinson Bai Patrick Articulation


Published on

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Robinson Bai Patrick Articulation

    1. 1. Strengthening K-16 Articulation through Assessment and Placement <ul><ul><li>Deborah W. Robinson, Ph.D. </li></ul></ul><ul><ul><li>NCCSFL President and World Languages Consultant, Ohio Department of Education </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>Jianhua Bai, Ph.D. </li></ul></ul><ul><ul><li>Professor of Chinese, Kenyon College, OH </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>Paula Patrick </li></ul></ul><ul><ul><li>Language Coordinator, Fairfax Co, VA </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul>
    2. 2. Articulation and Credit Flexibility <ul><li>Debbie Robinson </li></ul><ul><li>President, National Council of State Supervisors for Languages and Ohio Department of Education World Languages Consultant </li></ul>
    3. 3. What is Articulation? <ul><li>For Students: Seamless progress through language learning experiences </li></ul><ul><li>For Teachers: Consensus within language departments and across schools/levels on what learning looks like </li></ul>
    4. 4. Why is Articulation Critical? <ul><li>“We want students to transition from class to class, grade to grade, and institution to institution without the deadening duplication of coursework and the drain on motivation that it often implies.” </li></ul><ul><li>(C. Gascoigne The Language Educator, October, 2007, p. 57) </li></ul>
    5. 5. Is language learning…? <ul><li>Mastery of material covered </li></ul><ul><li> Or </li></ul><ul><li>Progress from no control through emerging control to eventual full control </li></ul><ul><li>(M. Met, The Language Educator, October, 2007, p. 54) </li></ul>
    6. 6. Our shared belief <ul><li>“ We are preparing students to use their new language in real-world applications.” </li></ul><ul><li>“… Use structures and vocabulary as a means toward the larger goal of building proficiency in the interpersonal, interpretive and presentational modes.” </li></ul><ul><li>(P. Sandrock, The Language Educator, October, 2007, p. 55) </li></ul>
    7. 7. <ul><li>“ Trying to improve articulation by dictating a grammatical sequence or set of vocabulary word fails to take into consideration how students really learn. </li></ul><ul><li>We need to understand what students can do … rather than confronting them with a list of what they can’t do.” </li></ul><ul><li>Articulation is recognizing the steps a student has taken toward proficiency through prior instruction [or experience].” </li></ul><ul><li>(P. Sandrock, The Language Educator, October, 2007, p. 55) </li></ul>
    8. 8. To demonstrate learning we need… <ul><li>Clearer operational definitions of </li></ul><ul><ul><li>what learning is </li></ul></ul><ul><ul><li>what evidence we will accept of learning </li></ul></ul><ul><li>and </li></ul><ul><li>How we will know learning when we see it </li></ul><ul><li>(M. Met, The Language Educator, October, 2007, p. 54) </li></ul>
    9. 9. The Answers <ul><li>Specific performance targets for each unit or course (benchmarks, Can-Do’s) </li></ul><ul><li>Common performance assessments </li></ul><ul><li>Clear, agreed-upon descriptions of desired student performance (proficiency descriptors > rubrics) </li></ul>
    10. 10. Concept of Assessment <ul><li>From: A static, final product </li></ul><ul><li>To: Ongoing, evolving process </li></ul><ul><li>“… assessment as a continuum and a process that feeds and informs the language learning endeavor, rather than a summative measure … to provide a grade.” </li></ul><ul><li>(C. Gascoigne The Language Educator, October, 2007, p. 57) </li></ul>
    11. 11. Assessments <ul><li>Common end-of-course, performance assessment exams </li></ul><ul><li>Standardized, local assessments based on unit performance outcomes </li></ul><ul><li>LinguaFolio </li></ul><ul><li>National Assessments, such as ELLOPA, SOPA, COPE, NOELLA, STAMP, OPI (OPIc), WPT </li></ul>
    12. 12. <ul><li>“ Point totals from a rubric offer a better way to advance learners through the language sequence than a grade on a report card, the number of chapters covered in a textbook, or hours of seat time accumulated.” </li></ul><ul><li>(L. Sessler, The Language Educator, October, 2007, p. 58) </li></ul>
    13. 13. AP <ul><li>Targeted at the Intermediate-Mid range of instruction </li></ul><ul><li>Helps set upper-performance target for a long sequence of instruction </li></ul><ul><li>Plan backward from there </li></ul>
    14. 14. AP Credit and Placement <ul><li>Disconnect between AP results and amount of credit given (from one to five courses) </li></ul><ul><li>Placement not always consistent with results </li></ul><ul><ul><li>Students should place somewhere in intermediate language sequence or above, but HEIs place lower) </li></ul></ul><ul><li>Marcia Wilbur (November, 2008) </li></ul>
    15. 15. What do you do with gifted freshman language learners? <ul><li>Have the language skills to enter junior level courses, but may lack the academic development and intellectual maturity so become discouraged and abandon language studies </li></ul><ul><li>Need courses that accommodate incoming freshmen with strong language skills. </li></ul><ul><li>(D. Morris, The Language Educator, October, 2007, p. 58) </li></ul>
    16. 16. So… <ul><li>“Once we have a clear idea of what our students are able to do, we must be accountable to them to help them to take the next step up on the proficiency ladder.” </li></ul><ul><li>H. Curtain (The Language Educator, October, 2007, p. 56) </li></ul>
    17. 17. Credit Flexibility Plans <ul><li>Carnegie Units (120-180 hours in a seat) = current currency for measuring learning </li></ul><ul><li>The value of student seat time as an accurate measure of student learning is limited. </li></ul><ul><li>19 States have/propose credit flexibility plans </li></ul>
    18. 18. Credit Flexibility Plans <ul><li>Enable students to earn units of high </li></ul><ul><li>school credit “based on a demonstration </li></ul><ul><li>of subject area competency, instead of or </li></ul><ul><li>in combination with completing hours of </li></ul><ul><li>classroom instruction.” </li></ul><ul><li>Ohio’s Plan for Credit Flexibility (March, 2009) </li></ul>
    19. 19. Credit Flexibility Plans Allow Students to: <ul><li>Show what they know and move on to content they’re ready to learn; and </li></ul><ul><li>Learn subject matter for credit in ways not limited solely to seat time or the walls of a school building. </li></ul><ul><li>Ohio’s Plan for Credit Flexibility (2009) </li></ul>
    20. 20. Students may earn credits by: <ul><li>Completing coursework; </li></ul><ul><li>Testing out of or demonstrating mastery of course content; or </li></ul><ul><li>Pursuing one or more “educational options” </li></ul><ul><ul><li>distance learning </li></ul></ul><ul><ul><li>educational travel </li></ul></ul><ul><ul><li>independent study </li></ul></ul><ul><ul><li>an internship </li></ul></ul><ul><ul><li>after-school/ tutorial program </li></ul></ul><ul><ul><li>community service or engagement project and </li></ul></ul><ul><ul><li>extracurricular activities, such as music, arts and/or sports). </li></ul></ul><ul><li>Ohio’s Plan for Credit Flexibility (2009) </li></ul>
    21. 21. Outcome Statements for Chinese <ul><li>白建华 </li></ul><ul><li>Jianhua Bai </li></ul><ul><li>Professor of Chinese, Kenyon College </li></ul><ul><li>Director, Chinese School, Middlebury College </li></ul>
    22. 22. The Standard-based K-16 Articulation Project for Chinese <ul><li>Introduction to the articulation project : </li></ul><ul><li>Clear and agreed-upon descriptions of desired student performance across different levels </li></ul><ul><li>How can these descriptions of desired learning outcomes be used for effective assessment, placement and instruction and learning? </li></ul>
    23. 23. Interpersonal Communication: descriptions of desired student performance K-4 <ul><li>From Lucy Lee and Jianhua Bai and the team of Standard </li></ul><ul><li>based K-16 articulation project for Chinese: </li></ul><ul><li>Students give and follow simple instructions to participate in age-appropriate classroom and/or Chinese cultural activities. </li></ul><ul><li>Students ask and answer simple questions about topics such as family, school, daily routine, and activities, e.g. 你叫什么名字? 你今年几岁? 你住在哪里? </li></ul><ul><li>Students share likes and dislikes regarding various common objects and everyday activities, e.g. 你喜欢什么? 你喜不喜欢看电视? </li></ul><ul><li>Students exchange descriptions of people and common objects with each other. </li></ul><ul><li>Students exchange essential information such as greetings and leave-takings with each other. </li></ul>
    24. 24. Interpersonal Communication: descriptions of desired student performance K-8 <ul><li>Students follow and give directions for participating in age-appropriate Chinese cultural activities. They ask and respond to questions for clarification. </li></ul><ul><li>Students exchange information about personal events, memorable experiences, and school subjects with peers and/or Chinese speakers e.g. 寒假你到哪儿去了?做什么了 </li></ul><ul><li>Students express opinions and preferences about people, events, and everyday activities. </li></ul><ul><li>Students use Chinese to acquire goods, services, or information through developmentally appropriate oral communication, writing, or the Internet. </li></ul>
    25. 25. Interpersonal Communication: descriptions of desired student performance K-12 <ul><li>Students initiate, sustain, and close a conversation in a variety of real-life situations that reflect social amenities such as making introductions, expressing gratitude and regret, stating complaints, apologizing, and communicating preferences. </li></ul><ul><li>Students discuss and support their personal feelings and ideas with peers and/or speakers of the Chinese language, e.g. 学生表达对升大学的看法。升大学的看法 。 </li></ul><ul><li>Students share their personal reactions to selected level appropriate reading passages or texts, e.g. 学生交换读书心得 </li></ul><ul><li>Students exchange their opinions and discuss individual perspectives on a variety of topics including school or community related issues, or current and past events in Chinese culture. </li></ul>
    26. 26. Interpersonal Communication: descriptions of desired student performance K-14 <ul><li>Students discuss the best solution to issues and problems that are of concern to Chinese communities. </li></ul><ul><li>Students exchange, support, and discuss their opinions and individual perspectives with peers and/or Chinese speakers on a variety of topics dealing with contemporary and historical issues, e.g. 交换有关选举的意见 </li></ul><ul><li>Students exchange opinions on information on topic of interests gathered through a variety of sources such as surveys, interviews, videos, written documents, e.g. 谈论少年喜爱的流行音乐 </li></ul><ul><li>Students discuss, orally or in writing, events and issues that are of significance in Chinese society or that are being studied in another subject. </li></ul><ul><li>Students discuss their personal reactions to and critical understanding of authentic texts with peers and/or native speakers of Chinese, e.g . 谈论电影 </li></ul>
    27. 27. Interpersonal Communication: descriptions of desired student performance K-16 <ul><li>Students discuss breaking news or current events in China and propose solutions to social issues and problems. </li></ul><ul><li>Students exchange their substantiated analyses with peers and Chinese speakers. </li></ul><ul><li>Students exchange personal reactions to expository and literary texts with peers and/native speakers of Chinese. </li></ul>
    28. 28. Interpersonal Communication: descriptions of desired student performance K-16 <ul><li>Similar descriptions for Interpretive and Presentational communication and the other four C areas are available. </li></ul><ul><li>The descriptions of more clear expectations/learning outcomes for different levels of instruction will help strengthen the assessment, placement and better articulation. </li></ul><ul><li>Standards  Progress indicators  Instructional objectives  Learning scenarios  Standard-based formative and summative assessment  Effective placement and credit systems for different types of students </li></ul><ul><li>What can we learn from the Ohio Credit Flexibility Plan? </li></ul><ul><li>What can we learn from the Fairfax World Language Credit Exam? </li></ul>
    29. 29. Using Assessment to Award Credit and Facilitate Articulation <ul><li>Paula Patrick </li></ul><ul><li>Fairfax Co. Virginia World Languages Coordinator </li></ul>
    30. 30. Fairfax County Public Schools World Languages Credit Exam <ul><li>This program is designed to assess students' native language proficiency so that they earn credit toward fulfilling the Virginia foreign language requirement for the Advanced Studies Diploma. </li></ul><ul><li>The exam is for students in grades 7-12 who have experience outside of school with a language other than English. Also, students must not already have two or more credits in that language on their transcript (from another country or from the U.S.). </li></ul>
    31. 31. What Level of Language Proficiency is Expected? <ul><li>Students must demonstrate in writing that they have reached the intermediate-low range of proficiency as described by the American Council on the Teaching of Foreign Languages (ACTFL) K-12 Performance Guidelines. This means that students can write about personal experiences using complete sentences in cohesive paragraphs on a variety of topics. </li></ul><ul><li>Students who participate in the English for Speakers of Other Languages (ESOL) program during grades 7-12 may also apply two units of credit towards fulfillment of requirement for the Advanced Studies Diploma. </li></ul>
    32. 32. Scoring the Assessments <ul><li>Language Assessors are hired and trained to score the credit exams. </li></ul><ul><li>The assessors look for a level of writing that can consistently and accurately describe and narrate in the past, present and future using complete sentences to form coherent paragraphs. The assessors evaluate the writing in six domains: task completion, comprehensibility, level of discourse (degree of sophistication), vocabulary, language control (grammar) and mechanics (spelling and punctuation). A sample scoring rubric is available online at </li></ul>
    33. 33. Credit Exam Rubric Score 18-24 = Pass (Student receives two high school credits) 4 3 2 1 Task Completion Superior completion of the task; content appropriate; complies with all requirements; ideas well developed and organized. Task is complete; content appropriate; complies with all requirements; ideas adequately developed. Partial completion of task; content mostly appropriate; complies with some requirements; ideas underdeveloped. Minimal completion of task; content frequently inadequate but legible. Comprehensibility Text readily comprehensible, requiring no interpretation on the part of the reader. Text comprehensible, requiring minimal interpretation on the part of the reader. Text mostly comprehensible, requiring interpretation of spelling and/or syntax on the part of the reader. Text barely comprehensible. Level of Discourse Uses a variety of simple and complex sentences; well developed paragraphs with creative ideas; and appropriate use of various cohesive devices. Uses a variety of simple, complex, and creative sentences; partially developed paragraphs; and appropriate use of cohesive devices. Uses simple and complex sentences with little repetition; few cohesive devices. Predominate use of simple and complex yet repetitive sentences; few cohesive devices. Vocabulary Command of an extensive variety of vocabulary on several topics; idiomatic expressions used appropriately. Adequate and accurate use of vocabulary. Adequate use of basic vocabulary with some errors. Inadequate and/or inaccurate use of vocabulary. Language Control Control of basic and complex language structures. Emerging control of basic language and complex structures. Emerging use of basic and complex language structures. Inadequate and/or inaccurate use of basic and complex language structures. Mechanics Few or no errors in spelling; use of diacritical marks, punctuation, and capitalization is appropriate. Mostly accurate spelling; use of diacritical marks, punctuation, and capitalization is correct to a large extent. Inaccurate spelling at times; use of diacritical marks, punctuation, and/or capitalization is sometimes incorrect. Inaccurate spelling; lacking accents, diacritical marks, punctuation, and/or capitalization.
    34. 34. Sample Task (Directions and prompts are written in the target language.) <ul><li>Read and respond to EACH prompt below. Write TWO (2) compositions (one for each prompt). Each composition must be well-developed and include, at a minimum, three (3) paragraphs. However, you should write as much as you can to show the assessor how well you can write in your language. Attach any additional sheets to this exam copy. </li></ul><ul><ul><li>Every culture is proud of many aspects of its heritage—music, dance, food, art. Choose one aspect of your culture of which you are the most proud and explain why you feel it is the best aspect of your culture. </li></ul></ul><ul><ul><li>Students always enjoy vacations and time away from school. Think back to when you were younger. Describe a memorable day you spent either on vacation with your family or away from school. </li></ul></ul>
    35. 35. Results from 2008 <ul><li>Number of Exams per Language and Pass Rates 2008 </li></ul><ul><li>Spanish 363 (181 passed—50%) </li></ul><ul><li>Korean 189 (159 passed—84%) </li></ul><ul><li>Chinese 46 (34 passed—74%) </li></ul><ul><li>Vietnamese 50 (37 passed—74%) </li></ul><ul><li>Arabic 34 (11 passed—32%) </li></ul><ul><li>Amharic 23 (11 passed—49%) </li></ul><ul><li>Urdu 31 (13 passed—42%) </li></ul><ul><li>Farsi 17 (9 passed—53%) </li></ul><ul><li>Tagalog 20 (10 passed—50%) </li></ul><ul><li>Russian 14 (11 passed—79%) </li></ul><ul><li>French 10 (5 passed—50%) </li></ul><ul><li>Hindi 14 (4 passed—29%) </li></ul><ul><li>Somali 9 (7 passed—78%) </li></ul><ul><li>Punjabi 3 (2 passed—50%) </li></ul><ul><li>Bengali 7 (3 passed—43%) </li></ul><ul><li>Twi 14 (11 passed—86%) </li></ul><ul><li>Total 844 (509 passed—60%) </li></ul>
    36. 36. Results (continued) <ul><li>By Grade </li></ul><ul><ul><li>7 191 (85 passed—45%) </li></ul></ul><ul><ul><li>8 204 (103 passed—50%) </li></ul></ul><ul><ul><li>MS 395 (188 passed—48%) </li></ul></ul><ul><ul><li>9 138 (96 passed—70%) </li></ul></ul><ul><ul><li>10 134 (94 passed—70%) </li></ul></ul><ul><ul><li>11 125 (93 passed—74%) </li></ul></ul><ul><ul><li>12 52 (38 passed—73%) </li></ul></ul><ul><ul><li>HS 449 (321 passed—71%) </li></ul></ul><ul><li>By Gender </li></ul><ul><ul><li>Males 397 (221 passed—56%) </li></ul></ul><ul><ul><li>Females 447 (288 passed—64%) </li></ul></ul>
    37. 37. Options After Receiving 2 Credits from the Credit Exam <ul><li>Students are able to continue language study at the appropriate level (Level 3 – AP or IB) in the following languages: </li></ul><ul><ul><li>Arabic </li></ul></ul><ul><ul><li>Chinese </li></ul></ul><ul><ul><li>French </li></ul></ul><ul><ul><li>Japanese </li></ul></ul><ul><ul><li>Russian </li></ul></ul><ul><ul><li>Spanish </li></ul></ul>
    38. 38. Benefits <ul><li>Students are granted credit for their language ability. </li></ul><ul><li>Students feel that the study of L1 has been validated. </li></ul><ul><li>In most cases, students wishing to continue the study of L1 are placed at the appropriate level and are challenged. </li></ul><ul><li>Students are encouraged to refine their L1 performance skills, making them more marketable to employers. </li></ul>
    39. 39. Questions to Ponder <ul><li>How can we improve our current practices to s trengthen K-16 articulation through assessment and placement ? </li></ul><ul><li>What are the current practices of assessment and placement? Do they reflect the descriptions of desired student performance discussed above? </li></ul><ul><li>Are we using assessments that reflect the standard-based instructional goals? </li></ul>