11. InnovationsInTesting.org
Scope
▪ 33,000 items and performance tasks
▪ Computer-adaptive delivery plus fixed
special forms
▪ Embedded supports
▪ Text-to-speech
▪ Braille
▪ Translation/ASL
▪ Foreign language glossaries
▪ English glossaries
▪ 33,000 items and performance tasks
▪ Computer-adaptive delivery plus fixed
special forms
▪ Embedded supports
▪ Text-to-speech
▪ Braille
▪ Translation/ASL
▪ Foreign language glossaries
▪ English glossaries
12. InnovationsInTesting.org
Content Development Considerations
▪ Metadata tagging for computer adaptive
delivery
▪ Definition of item response types
▪ Creation of export and QC processes
▪ Embedded support tagging
▪ Metadata tagging for computer adaptive
delivery
▪ Definition of item response types
▪ Creation of export and QC processes
▪ Embedded support tagging
16. InnovationsInTesting.org
Item Response Types
MC with one correct response
MC with multiple correct responses
Two Part multiple choice
Matching Tables
Fill In Tables
Yes/No or True/False Tables
Select or order text or graphics
Complex drag and drop
Graphing
Equation or numeric response
Short Text
Long Essay
Constructed
Response
Selected
Response
Response Types
18. InnovationsInTesting.org
Metadata Examples
▪ Operational
▪ Blueprint specific parameters needed for
administration
▪ Embedded support tags
▪ Item Banking
▪ Administration information
▪ Statistics
▪ Development
▪ Standards information
▪ Complexity measures
▪ Operational
▪ Blueprint specific parameters needed for
administration
▪ Embedded support tags
▪ Item Banking
▪ Administration information
▪ Statistics
▪ Development
▪ Standards information
▪ Complexity measures
19. InnovationsInTesting.org
Content Metadata
▪ Primary claim
▪ Primary content domain
▪ Assessment Targets
▪ Primary Standard
▪ Secondary Claim
▪ Secondary Content Domain
▪ Depth of Knowledge
▪ Maximum Points
▪ Maximum Grade
▪ Minimum Grade
▪ Score Points
▪ Maximum Score Points
▪ Achievement Quintile (Estimated Difficulty)
▪ Primary claim
▪ Primary content domain
▪ Assessment Targets
▪ Primary Standard
▪ Secondary Claim
▪ Secondary Content Domain
▪ Depth of Knowledge
▪ Maximum Points
▪ Maximum Grade
▪ Minimum Grade
▪ Score Points
▪ Maximum Score Points
▪ Achievement Quintile (Estimated Difficulty)
20. InnovationsInTesting.org
Domain specific metadata
ELA
▪ Braille
▪ Copyright Source
▪ Evidence Statement
▪ Passage Length
▪ Writing Category
▪ Writing Type
▪ Revision Sub-category
Item
▪ Stimulus Name
▪ Stimulus Type
ELA
▪ Braille
▪ Copyright Source
▪ Evidence Statement
▪ Passage Length
▪ Writing Category
▪ Writing Type
▪ Revision Sub-category
Item
▪ Stimulus Name
▪ Stimulus Type
Math
▪ Braille
▪ Calculator
▪ Mathematical
Practices
▪ Algebra Function
Descriptors
Math
▪ Braille
▪ Calculator
▪ Mathematical
Practices
▪ Algebra Function
Descriptors
21. InnovationsInTesting.org
Export process
▪ Definition of metadata fields and
allowable values
▪ Iterative sample exports/system
QC/export modification
▪ Production exports
▪ Final system QC
▪ Definition of metadata fields and
allowable values
▪ Iterative sample exports/system
QC/export modification
▪ Production exports
▪ Final system QC
22. InnovationsInTesting.org
Data transfer considerations
▪ Standards don’t define everything
▪ Scoring logic
▪ Display format
▪ Math expressions
▪ Graphics size
▪ Item/stimulus associations
▪ Authoring inconsistencies
▪ Standards don’t define everything
▪ Scoring logic
▪ Display format
▪ Math expressions
▪ Graphics size
▪ Item/stimulus associations
▪ Authoring inconsistencies
31. InnovationsInTesting.org
Smarter Balanced Embedded supports
▪ All items
▪ Read-aloud (text-to-speech)
▪ English Glossaries
▪ Math item pool
▪ Stacked Translations (Spanish)
▪ Foreign Language Glossaries
▪ Refreshable Braille
▪ ASL
▪ ELA Item pool
▪ Refreshable Braille
▪ ASL
▪ All items
▪ Read-aloud (text-to-speech)
▪ English Glossaries
▪ Math item pool
▪ Stacked Translations (Spanish)
▪ Foreign Language Glossaries
▪ Refreshable Braille
▪ ASL
▪ ELA Item pool
▪ Refreshable Braille
▪ ASL
32. InnovationsInTesting.org
Challenges
▪ Standards don’t define everything.
▪ Defining metadata values is critical.
▪ Try everything well in advance.
▪ Developers must understand
downstream impacts.
▪ There will be surprises.
▪ Standards don’t define everything.
▪ Defining metadata values is critical.
▪ Try everything well in advance.
▪ Developers must understand
downstream impacts.
▪ There will be surprises.
