Openness and the Future of Assessment

Openness and the Future David WileyInstructional Psychology & Technology Brigham Young University

Download These Slideshttp://slideshare.net/opencontent/

ContextThe societal superstructure is changing

Analog Digital Music, Phones, TV, Newspapers,Movies, Journals, Communications, Intelligence, Defense

Tethered MobilePhones, Internet Access, Employment

Isolated Connected People, Content, Systems

Generic PersonalCars, Computers, Mobile Phones

Consuming CreatingRadio / Podcasting, Newspapers / Blogs Movies / Vodcasting

Closed OpenSoftware (OSs, Applications), Content (Blogs, Wikis)

Then vs Now Analog Digital Tethered Mobile Isolated Connected Generic PersonalConsumption Creating Closed Open

Education vs Everyday Analog Digital Tethered Mobile Isolated Connected Generic PersonalConsumption Creating Closed Open

Characteristics of E-learning Analog or Digital Tethered or Mobile Isolated or Connected Generic or Personal Consuming or Creating Closed or Open

DecimationCalifornia State University system – 33% University of New Hampshire – 50% Double digit cuts everywhere

Exploding DemandFrom 120M to 250M+ in next 15 years

Nonrivalrous Media New opportunities

Free Copy, Distribute, Edit Technology enables us to share and educate as never before

Except We Can’t© forbids copying, distributing, and editing

Internet CopyrightEnables Forbids What to do?

Use copyright to enforce sharing

The 4Rs Reuse – copy verbatimRedistribute – share with others Revise – adapt and edit Remix – combine with others

Over 400 Million Items450,000,000400,000,000350,000,000300,000,000250,000,000200,000,000150,000,000100,000,000 50,000,000 0

The “Open” in OER, OCW, &c. (1) Free (2) 4R permission

Internet OEREnables Allows Sharing and educating at unprecedented scale

OER = Content Infrastructure Platform for education innovation

Informal Learning Open, standards-based way toissue, manage, and display credentials for ANY learning

Transcript 2.0Fixes many problems with current transcripts

OBI = Credential Infrastructure Platform for education innovation

Open Education InfrastructureDemocratizes innovation opportunities

OER Badges Issue Manage Learn DisplayAnything Credentials

Mind the Gap!HUGE demand over the next 10 years Entrepreneurs are on their way

Anywhere, Free If I can learn anywhere for free,and show my credentials anywhere for free…

Assess Anywhere, Free? What does this look like?

1. Ubiquitous Assessment “Assessment as Status Update”(Tweets, product and book reviews, etc.)

Ubiquitous Assessment What kind of infrastructure does this require?

Ubiquitous AssessmentNo one is working on this infrastructure

2. Leveraging Big, Messy Data10s of 1000s of tiny data points per person spread across a year User-generated items

Leveraging Big, Messy Data What kind of psychometrics are needed to deal with this?

3. From Summative to Formative The majority will be formative At scale does formative function as summative?

From Summative to Formative How will the role of high stakes assessments evolve?

4. Scaling Constructed Response We can’t condemn next-gen assessment to selected response

Scaling Constructed Response “Gamify grading”

Google’s ESP Game A symmetric verification game(Verbosity is an asymmetric example)

For Example, In Education• Rubrics• Multi-person Review• Inter-rater Reliability Component• Sanity Sampling

Future Assessment? Analog or Digital Tethered or Mobile Isolated or Connected Generic or PersonalConsuming or Creating Closed or Open

Key Trends Ubiquitous assessmentFrom summative to formative Leveraging big, messy dataScaling constructed response

Expand Our Thinking Beyond traditional educationBeyond traditional psychometrics Beyond traditional assessment

Thank Youhttp://davidwiley.org/

http://www.scoop.it	547
http://cluasacapaill.wordpress.com	103
http://www.corcastro.blogspot.pt	102
http://corcastro.blogspot.pt	65
http://corcastro.blogspot.com.br	13
http://vhsip.pbworks.com	6
http://corcastro.blogspot.com	4
http://twitter.com	2
https://twimg0-a.akamaihd.net	2
https://si0.twimg.com	1
http://bb9.canyons.edu	1
http://translate.googleusercontent.com	1

Openness and the Future of Assessment

by David Wiley

Accessibility

Categories

Upload Details

Usage Rights

12 Embeds 847

Statistics

Openness and the Future of Assessment Presentation Transcript