Recommended
Recommended
More Related Content
Similar to What is Item Banking? How does it help improve educational assessment, certification, and pre-employment testing?
Similar to What is Item Banking? How does it help improve educational assessment, certification, and pre-employment testing? (20)
Recently uploaded
Recently uploaded (20)
What is Item Banking? How does it help improve educational assessment, certification, and pre-employment testing?
- 2. ABOUT ME Nathan Thompson, PhD CEO of ASC ● PhD in Psychometrics, University of Minnesota ● Topic: Adaptive/Personalized Assessment ● 20 years of experience in item banking and assessment software ● Taught at 2 universities ● Worked with 100s of orgs and traveled to 20 countries ● Written 1000s of items
- 3. What is item banking? • A centralized software system to: • Author test items • Review test items • Store metadata • Assemble test forms • Print/export/deliver the forms… • Typically, part of a cloud-based ecosystem to develop, deliver, and analyze assessments
- 4. Why item banking? • Easier to author/review items • Easier to assemble/manage test forms • Easier to manage item banks and track item usage • Track item metadata • Move towards online delivery • Facilitate reporting to inform stakeholders and manage future work
- 5. Why item banking? • Makes things MUCH more efficient if you have large numbers of items, users, or tests • Can save large amounts of money and time • Drives validity
- 6. What is an item bank? Math.001 Domain: Alg P=0.96 etc… Item Bank Test Form A Test Form B Math.002 Domain: Geo P=0.82 etc… Math.003 Domain: Stats P=0.64 etc… Math.004 Domain: Geo P=0.84 etc… Math.005 Domain: Alg P=0.91 etc… … and many more! Paper Online Third Party
- 7. What is item banking? • Database of assessment items • Items are reusable objects • Metadata: content/domain/standard, statistics, cognitive level, and more • Tracking of usage • Tracking of item history: past edits and by whom • Versioning • Extensive search/filter capability • Item Status Key functionalities and concepts
- 8. What is item banking? • Item review workflow • Item naming conventions • Comments with timestamps • Role- and content-based access for users (e.g., Math Item Reviewers can only see Math items… and only review, not edit) • Dedicated asset manager (multimedia, which are also reusable objects with usage tracking and metadata!) • Collaborative! Same reason that professionals use JIRA or GitHub for software development Key functionalities and concepts
- 10. Examples of functionality Or MS Word Templates!
- 12. Create test blueprints Author items Assign to domains, cognitive levels, etc. Review items Assemble test forms Deliver test forms Psychometric analytics Flagged items: Revise, Retire, Retain The foundation of the test development cycle
- 13. Why item banking? • Items are very valuable, as much effort and expense is invested in developing them Protect your investment • Treat it as a process, with quality control • Easier to improve items over time Improve item quality
- 14. Why item banking? • Makes it much easier to manage large sets of items (compare to MS Word/Excel or LMS) • Reduce the cost of item development More efficient • Easier test assembly • Far easier to publish online tests • Easier to export/migrate to other systems Facilitates Test Development
- 15. Why item banking? • Provides extensive and automated documentation for validity Validity Documentation • Subject experts can more effectively work together • Streamlined processes and appealing UI/UX keep them engaged • Highly scalable Collaboration and engagement
- 16. The Future Automated item generation Automated item review Automated test assembly More AI?
- 17. What’s next? Sign up for a free account at Assess.com!