SlideShare a Scribd company logo
Streamlining assessment,
feedback, and archival with
auto-multiple-choice
WEB SIGMAA meeting
January 8, 2016
Matthew Leingang
Courant Institute of Mathematical Sciences
New York University
My issues
• I like weekly quizzes on paper
• I hate data entry
• I commute by bus
•I am a digital packrat
•I have bad handwriting
Things I have tried
Home rolled
scripts with PDF
forms
Last year
Papers
LMS
My Dream
Scantron ScanSnap
Dream Workflow #1
Papers LMS
Dream Workflow #2
Papers LMS
OMR Software
• SDAPS (python)
• queXF (PHP)
• G’n’T Eval (Ruby)
• AMC (perl)
Why AMC
• FOSS (perl, sqlite, LaTeX)
• Good LaTeX package for creating docs
• features MCQ, FRQ, ID encoding,
numerical answers
• GUI with many features
• Unix Xwindows; Macports package
Examples
Simple Example
documentclass{article}
usepackage[insidebox]{automultiplechoice}
begin{document}
begin{question}{taxicab}
What is the smallest integer that can be represented as the
sum of two cubes in two different ways?
begin{choices}
correctchoice{1729}
wrongchoice{1728}
wrongchoice{1001}
wrongchoice{4104}
wrongchoice{13832}
end{choices}
end{question}
end{document}
Output
Supported Variants
• Check all that apply (questionmult)
• Horizontal vs. vertical layout
(choiceshoriz)
• compatible with the multicols
environment
• smart “None of the above” option
begin{questionmultx}{SEssCalcET2 13-1-012}
scoring{b=2}
Let $R = [0,1]times[1,3]$.par
Evaluate $iint_R ( x^3 - 9x^2
y^2),dA$.
AMCnumericChoices{-7.5}{
digits=3,decimals=2,sign=true,
borderwidth=0pt,
backgroundcol=lightgray,
approx=5}
end{questionmultx}
Numerical Responses
Output
begin{question}{SEssCalcET2 12-3-016}
Let $E$ be the solid that is bounded on the
outside by the sphere $x^2 + y^2 + z^2 = 16$
and inside by the cylinder $x^2 + y^2 = 4$.
Find the volume of $E$.
AMCOpen{lines=3,dots=false}{%
wrongchoice[0]{0}scoring{0}%
wrongchoice[1]{1}scoring{1}%
wrongchoice[2]{2}scoring{2}%
wrongchoice[3]{3}scoring{3}%
correctchoice[4]{4}scoring{4}}
end{question}
Free Response Qs
Output
begin{minipage}[b]{0.3textwidth}
AMCcode{NNumber}{8}%
end{minipage}
hspace*{1em}
begin{minipage}[b]{0.5textwidth}raggedright
MATH-UA 123.007 Calculus III
[...]
Code the eight digits of your N number to the left,
and write your name below.
vspace{3ex}
hfillnamefield{fbox{
begin{minipage}{.9linewidth}
Name:
vspace*{1cm}
end{minipage}
}}hfillvspace{0.1ex}
end{minipage}
end{document}
ID Blocks
Output
Problem Groups
• Select k from a group
of n
• shuffle items in a
group
• pipe dream: keep
questions in a flat file
or database
Workflows
Method #1 (quizzes)
Prof AMCStudents LMS
LaTeX
PDF
give quiz
take quiz
PDF
Scores
Scan
write
Roster CSV
Gradebook CSV Gradebook CSV
Annotated PDF
Grade
Streamlining assessment, feedback, and archival with auto-multiple-choice
Streamlining assessment, feedback, and archival with auto-multiple-choice
Streamlining assessment, feedback, and archival with auto-multiple-choice
Streamlining assessment, feedback, and archival with auto-multiple-choice
Streamlining assessment, feedback, and archival with auto-multiple-choice
AMC Workflow #1
Papers LMS
Dream Workflow #1
Papers LMS
Method #1 (quizzes)
Prof AMCStudents LMS
LaTeX
PDF
give quiz
take quiz
PDF
Scores
Scan
write
Roster CSV
Gradebook CSV Gradebook CSV
Annotated PDF
Grade
Method #2 (exams)
( (exams)quizzes)Prof AMCStudents LMS
take quiz
PDF
Scores
Scan
write
Problem PDFs
Grade
on iPad
Problem PDFs
PDFExpert Grading
• PDF annotator
• Syncs with cloud
storage apps
• $10 but totally
worth it
� ���� ��
Streamlining assessment, feedback, and archival with auto-multiple-choice
Emoji
Stamps
More stamps
Image Stamps
AMC Annotation
Report
Annotation
Annotation
Annotation
Annotation
Annotation
Cool trick: returning
graded “papers”
• AMC annotation method marks MCQs and
creates a new PDF
• Email feature sends them back
• Sakai “dropbox” (not Dropbox) has a DAV
interface
• Script to batch PUT PDFs into Sakai!
What is DAV?
• Distributed Authoring
and Versioning
• Treat website “directory”
like a bona fide
filesystem share.
• Extension of HTTP
AMC-sakai-return.pl
• Command line, interfaces with AMC data model and
app config.
• Attach files (e.g., solutions, summary stats)
• Encrypt so they can't alter the file
• Dry run feature
• Upload via curl library
$ curl --netrc -T file.pdf
https://newclasses.nyu.edu/dav/group-user/<si
Money Line
Another cool trick: saving
files to Evernote
What is Evernote?
• Instead of folders and files, notebooks and
notes (and tags)
• notes can contain rich text and file
attachments
• a note is only in one notebook but can have
arbitrarily many tags
• Very searchable
Archiving Script
• Same command line interface
• Create note with PDF, tagged by course,
term, student, etc.
• Upload via Evernote SDK
Advantages
• Paper when you need it, not when you don't
• No more office/book bag clutter
• Quick turnaround
• Reduces cheating by good eyesight
• Eliminates cheating by altering the graded sheet
• Regrades and post-exam conferences are easy
Disadvantages
• Command line is not for everyone
• Printing individual exams can take time
• Scanning multipage exams on a ScanSnap
takes time
• Files can be big
• Students who write in the margins!
Streamlining assessment, feedback, and archival with auto-multiple-choice
Future directions
Next steps
• Scale up
• Tighter integration with AMC GUI
• Item analysis
Goodnight Seattle
Credits
Francois Roche
Mark Atwood
Torben Hansen
Credits
Paul Van der Werf
Andi Narvaez
simasima.info unknown
Credits
Wiki episteme
Jody Cloutier
Wonderlane
Credits
Kevin Kerrick
Dan McKay
Adelle Charles
Another cool trick: saving
files to Evernote
Seattle Municipal Archives
Credits
Ethan Kan
Clipart from OpenClipArt.org

More Related Content

What's hot

No sql Database
No sql DatabaseNo sql Database
No sql Database
mymail2ashok
 
To Have Own Data Analytics Platform, Or NOT To
To Have Own Data Analytics Platform, Or NOT ToTo Have Own Data Analytics Platform, Or NOT To
To Have Own Data Analytics Platform, Or NOT To
SATOSHI TAGOMORI
 
ArangoDB – A different approach to NoSQL
ArangoDB – A different approach to NoSQLArangoDB – A different approach to NoSQL
ArangoDB – A different approach to NoSQL
ArangoDB Database
 
Performance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4jPerformance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4j
ArangoDB Database
 
Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...
Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...
Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...
guest5b1607
 
Hadoop for the Absolute Beginner
Hadoop for the Absolute BeginnerHadoop for the Absolute Beginner
Hadoop for the Absolute Beginner
Ike Ellis
 
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
jaxLondonConference
 
A quick review of Python and Graph Databases
A quick review of Python and Graph DatabasesA quick review of Python and Graph Databases
A quick review of Python and Graph Databases
Nicholas Crouch
 
Hybrid MongoDB and RDBMS Applications
Hybrid MongoDB and RDBMS ApplicationsHybrid MongoDB and RDBMS Applications
Hybrid MongoDB and RDBMS Applications
Steven Francia
 
Null 1
Null 1Null 1
NoSQL Introduction
NoSQL IntroductionNoSQL Introduction
NoSQL Introduction
John Kerley-Weeks
 
Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015
Taro L. Saito
 
Hotcode 2013: Javascript in a database (Part 2)
Hotcode 2013: Javascript in a database (Part 2)Hotcode 2013: Javascript in a database (Part 2)
Hotcode 2013: Javascript in a database (Part 2)
ArangoDB Database
 
Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...
Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...
Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...
Grokking VN
 
Building a spa_in_30min
Building a spa_in_30minBuilding a spa_in_30min
Building a spa_in_30min
Michael Hackstein
 
Big data week presentation
Big data week presentationBig data week presentation
Big data week presentation
Joseph Adler
 
What's new in pandas and the SciPy stack for financial users
What's new in pandas and the SciPy stack for financial usersWhat's new in pandas and the SciPy stack for financial users
What's new in pandas and the SciPy stack for financial users
Wes McKinney
 
NoSQL in Perspective
NoSQL in PerspectiveNoSQL in Perspective
NoSQL in Perspective
Jeff Smith
 
AWS July Webinar Series - Getting Started with Amazon DynamoDB
AWS July Webinar Series - Getting Started with Amazon DynamoDBAWS July Webinar Series - Getting Started with Amazon DynamoDB
AWS July Webinar Series - Getting Started with Amazon DynamoDB
Amazon Web Services
 
Crafting Evolvable Api Responses
Crafting Evolvable Api ResponsesCrafting Evolvable Api Responses
Crafting Evolvable Api Responses
darrelmiller71
 

What's hot (20)

No sql Database
No sql DatabaseNo sql Database
No sql Database
 
To Have Own Data Analytics Platform, Or NOT To
To Have Own Data Analytics Platform, Or NOT ToTo Have Own Data Analytics Platform, Or NOT To
To Have Own Data Analytics Platform, Or NOT To
 
ArangoDB – A different approach to NoSQL
ArangoDB – A different approach to NoSQLArangoDB – A different approach to NoSQL
ArangoDB – A different approach to NoSQL
 
Performance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4jPerformance comparison: Multi-Model vs. MongoDB and Neo4j
Performance comparison: Multi-Model vs. MongoDB and Neo4j
 
Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...
Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...
Text Analytics Summit 2009 - Roddy Lindsay - "Social Media, Happiness, Petaby...
 
Hadoop for the Absolute Beginner
Hadoop for the Absolute BeginnerHadoop for the Absolute Beginner
Hadoop for the Absolute Beginner
 
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
Designing and Building a Graph Database Application - Ian Robinson (Neo Techn...
 
A quick review of Python and Graph Databases
A quick review of Python and Graph DatabasesA quick review of Python and Graph Databases
A quick review of Python and Graph Databases
 
Hybrid MongoDB and RDBMS Applications
Hybrid MongoDB and RDBMS ApplicationsHybrid MongoDB and RDBMS Applications
Hybrid MongoDB and RDBMS Applications
 
Null 1
Null 1Null 1
Null 1
 
NoSQL Introduction
NoSQL IntroductionNoSQL Introduction
NoSQL Introduction
 
Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015Presto @ Treasure Data - Presto Meetup Boston 2015
Presto @ Treasure Data - Presto Meetup Boston 2015
 
Hotcode 2013: Javascript in a database (Part 2)
Hotcode 2013: Javascript in a database (Part 2)Hotcode 2013: Javascript in a database (Part 2)
Hotcode 2013: Javascript in a database (Part 2)
 
Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...
Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...
Grokking TechTalk #24: Thiết kế hệ thống Background Job Queue bằng Ruby & Pos...
 
Building a spa_in_30min
Building a spa_in_30minBuilding a spa_in_30min
Building a spa_in_30min
 
Big data week presentation
Big data week presentationBig data week presentation
Big data week presentation
 
What's new in pandas and the SciPy stack for financial users
What's new in pandas and the SciPy stack for financial usersWhat's new in pandas and the SciPy stack for financial users
What's new in pandas and the SciPy stack for financial users
 
NoSQL in Perspective
NoSQL in PerspectiveNoSQL in Perspective
NoSQL in Perspective
 
AWS July Webinar Series - Getting Started with Amazon DynamoDB
AWS July Webinar Series - Getting Started with Amazon DynamoDBAWS July Webinar Series - Getting Started with Amazon DynamoDB
AWS July Webinar Series - Getting Started with Amazon DynamoDB
 
Crafting Evolvable Api Responses
Crafting Evolvable Api ResponsesCrafting Evolvable Api Responses
Crafting Evolvable Api Responses
 

Viewers also liked

Lesson 27: Integration by Substitution (slides)
Lesson 27: Integration by Substitution (slides)Lesson 27: Integration by Substitution (slides)
Lesson 27: Integration by Substitution (slides)
Matthew Leingang
 
教育ガラパゴスは必要ですか?
教育ガラパゴスは必要ですか?教育ガラパゴスは必要ですか?
教育ガラパゴスは必要ですか?
Tsutomu Kawamura
 
Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...
Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...
Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...
Matthew Leingang
 
Introductiontoquantummechanics 141017184458-conversion-gate01
Introductiontoquantummechanics 141017184458-conversion-gate01Introductiontoquantummechanics 141017184458-conversion-gate01
Introductiontoquantummechanics 141017184458-conversion-gate01
Minh Tân Đinh Hoàng
 
Giáo trình jackson classicalelectrodynamics
Giáo trình jackson classicalelectrodynamicsGiáo trình jackson classicalelectrodynamics
Giáo trình jackson classicalelectrodynamics
Minh Tân Đinh Hoàng
 
QED: Quantum Electrodynamics
QED: Quantum ElectrodynamicsQED: Quantum Electrodynamics
QED: Quantum Electrodynamics
Tristan Roddis
 
Problems and solutions on atomic, nuclear, and particle physics kuo lim
Problems and solutions on atomic, nuclear, and particle physics   kuo limProblems and solutions on atomic, nuclear, and particle physics   kuo lim
Problems and solutions on atomic, nuclear, and particle physics kuo lim
sbsburbano burbano
 
Lesson 24: Areas, Distances, the Integral (Section 041 slides)
Lesson 24: Areas, Distances, the Integral (Section 041 slides)Lesson 24: Areas, Distances, the Integral (Section 041 slides)
Lesson 24: Areas, Distances, the Integral (Section 041 slides)
Matthew Leingang
 
Solutions manual
Solutions manualSolutions manual
Solutions manual
Minh Tân Đinh Hoàng
 
Optical Mark Recognition
Optical Mark RecognitionOptical Mark Recognition
Optical Mark Recognition
Himanshu Popli
 
1 interaction of radiation with matter
1 interaction of radiation with matter1 interaction of radiation with matter
1 interaction of radiation with matter
Shahid Younas
 
Skm symps poster 2015 spect ct
Skm symps poster 2015 spect ctSkm symps poster 2015 spect ct
Skm symps poster 2015 spect ct
Shahid Younas
 
1 interaction of radiation with matter
1 interaction of radiation with matter1 interaction of radiation with matter
1 interaction of radiation with matter
Shahid Younas
 
Lesson 21: Partial Derivatives in Economics
Lesson 21: Partial Derivatives in EconomicsLesson 21: Partial Derivatives in Economics
Lesson 21: Partial Derivatives in Economics
Matthew Leingang
 
Lesson 2: Limits and Limit Laws
Lesson 2: Limits and Limit LawsLesson 2: Limits and Limit Laws
Lesson 2: Limits and Limit Laws
Matthew Leingang
 
Units Dimentions Error QA 2
Units Dimentions Error QA 2Units Dimentions Error QA 2
Units Dimentions Error QA 2
Lakshmikanta Satapathy
 
Sequences and Series QA 1
Sequences and Series QA 1Sequences and Series QA 1
Sequences and Series QA 1
Lakshmikanta Satapathy
 
Wave Motion QA 2
Wave Motion QA 2Wave Motion QA 2
Wave Motion QA 2
Lakshmikanta Satapathy
 

Viewers also liked (18)

Lesson 27: Integration by Substitution (slides)
Lesson 27: Integration by Substitution (slides)Lesson 27: Integration by Substitution (slides)
Lesson 27: Integration by Substitution (slides)
 
教育ガラパゴスは必要ですか?
教育ガラパゴスは必要ですか?教育ガラパゴスは必要ですか?
教育ガラパゴスは必要ですか?
 
Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...
Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...
Lesson 8: Derivatives of Logarithmic and Exponential Functions (worksheet sol...
 
Introductiontoquantummechanics 141017184458-conversion-gate01
Introductiontoquantummechanics 141017184458-conversion-gate01Introductiontoquantummechanics 141017184458-conversion-gate01
Introductiontoquantummechanics 141017184458-conversion-gate01
 
Giáo trình jackson classicalelectrodynamics
Giáo trình jackson classicalelectrodynamicsGiáo trình jackson classicalelectrodynamics
Giáo trình jackson classicalelectrodynamics
 
QED: Quantum Electrodynamics
QED: Quantum ElectrodynamicsQED: Quantum Electrodynamics
QED: Quantum Electrodynamics
 
Problems and solutions on atomic, nuclear, and particle physics kuo lim
Problems and solutions on atomic, nuclear, and particle physics   kuo limProblems and solutions on atomic, nuclear, and particle physics   kuo lim
Problems and solutions on atomic, nuclear, and particle physics kuo lim
 
Lesson 24: Areas, Distances, the Integral (Section 041 slides)
Lesson 24: Areas, Distances, the Integral (Section 041 slides)Lesson 24: Areas, Distances, the Integral (Section 041 slides)
Lesson 24: Areas, Distances, the Integral (Section 041 slides)
 
Solutions manual
Solutions manualSolutions manual
Solutions manual
 
Optical Mark Recognition
Optical Mark RecognitionOptical Mark Recognition
Optical Mark Recognition
 
1 interaction of radiation with matter
1 interaction of radiation with matter1 interaction of radiation with matter
1 interaction of radiation with matter
 
Skm symps poster 2015 spect ct
Skm symps poster 2015 spect ctSkm symps poster 2015 spect ct
Skm symps poster 2015 spect ct
 
1 interaction of radiation with matter
1 interaction of radiation with matter1 interaction of radiation with matter
1 interaction of radiation with matter
 
Lesson 21: Partial Derivatives in Economics
Lesson 21: Partial Derivatives in EconomicsLesson 21: Partial Derivatives in Economics
Lesson 21: Partial Derivatives in Economics
 
Lesson 2: Limits and Limit Laws
Lesson 2: Limits and Limit LawsLesson 2: Limits and Limit Laws
Lesson 2: Limits and Limit Laws
 
Units Dimentions Error QA 2
Units Dimentions Error QA 2Units Dimentions Error QA 2
Units Dimentions Error QA 2
 
Sequences and Series QA 1
Sequences and Series QA 1Sequences and Series QA 1
Sequences and Series QA 1
 
Wave Motion QA 2
Wave Motion QA 2Wave Motion QA 2
Wave Motion QA 2
 

Similar to Streamlining assessment, feedback, and archival with auto-multiple-choice

Apache Arrow: Leveling Up the Analytics Stack
Apache Arrow: Leveling Up the Analytics StackApache Arrow: Leveling Up the Analytics Stack
Apache Arrow: Leveling Up the Analytics Stack
Wes McKinney
 
Why ruby and rails
Why ruby and railsWhy ruby and rails
Why ruby and rails
Reuven Lerner
 
Mashups with Drupal and QueryPath
Mashups with Drupal and QueryPathMashups with Drupal and QueryPath
Mashups with Drupal and QueryPath
Matt Butcher
 
A machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companiesA machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companies
DataWorks Summit
 
Untangling spring week1
Untangling spring week1Untangling spring week1
Untangling spring week1
Derek Jacoby
 
IWMW 2002: Portals and CMS:" Why You Need Them Both
IWMW 2002: Portals and CMS:" Why You Need Them BothIWMW 2002: Portals and CMS:" Why You Need Them Both
IWMW 2002: Portals and CMS:" Why You Need Them Both
IWMW
 
Publishing strategies for API documentation
Publishing strategies for API documentationPublishing strategies for API documentation
Publishing strategies for API documentation
Tom Johnson
 
High Performance Machine Learning in R with H2O
High Performance Machine Learning in R with H2OHigh Performance Machine Learning in R with H2O
High Performance Machine Learning in R with H2O
Sri Ambati
 
Untangling fall2017 week1
Untangling fall2017 week1Untangling fall2017 week1
Untangling fall2017 week1
Derek Jacoby
 
Javascript best practices
Javascript best practicesJavascript best practices
Javascript best practices
Jayanga V. Liyanage
 
Building FoundationDB
Building FoundationDBBuilding FoundationDB
Building FoundationDB
FoundationDB
 
Node.js
Node.jsNode.js
Node.js
Matt Simonis
 
Be faster then rabbits
Be faster then rabbitsBe faster then rabbits
Be faster then rabbits
Vladislav Bauer
 
The Why and How of Scala at Twitter
The Why and How of Scala at TwitterThe Why and How of Scala at Twitter
The Why and How of Scala at Twitter
Alex Payne
 
ACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data FramesACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data Frames
Wes McKinney
 
Transactional writes to cloud storage with Eric Liang
Transactional writes to cloud storage with Eric LiangTransactional writes to cloud storage with Eric Liang
Transactional writes to cloud storage with Eric Liang
Databricks
 
Low Latency Polyglot Model Scoring using Apache Apex
Low Latency Polyglot Model Scoring using Apache ApexLow Latency Polyglot Model Scoring using Apache Apex
Low Latency Polyglot Model Scoring using Apache Apex
Apache Apex
 
Cross-platform interaction
Cross-platform interactionCross-platform interaction
Cross-platform interaction
Oleksii Duhno
 
.NET per la Data Science e oltre
.NET per la Data Science e oltre.NET per la Data Science e oltre
.NET per la Data Science e oltre
Marco Parenzan
 
ClojuTRE2015: Kekkonen - making your Clojure web APIs more awesome
ClojuTRE2015: Kekkonen - making your Clojure web APIs more awesomeClojuTRE2015: Kekkonen - making your Clojure web APIs more awesome
ClojuTRE2015: Kekkonen - making your Clojure web APIs more awesome
Metosin Oy
 

Similar to Streamlining assessment, feedback, and archival with auto-multiple-choice (20)

Apache Arrow: Leveling Up the Analytics Stack
Apache Arrow: Leveling Up the Analytics StackApache Arrow: Leveling Up the Analytics Stack
Apache Arrow: Leveling Up the Analytics Stack
 
Why ruby and rails
Why ruby and railsWhy ruby and rails
Why ruby and rails
 
Mashups with Drupal and QueryPath
Mashups with Drupal and QueryPathMashups with Drupal and QueryPath
Mashups with Drupal and QueryPath
 
A machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companiesA machine learning and data science pipeline for real companies
A machine learning and data science pipeline for real companies
 
Untangling spring week1
Untangling spring week1Untangling spring week1
Untangling spring week1
 
IWMW 2002: Portals and CMS:" Why You Need Them Both
IWMW 2002: Portals and CMS:" Why You Need Them BothIWMW 2002: Portals and CMS:" Why You Need Them Both
IWMW 2002: Portals and CMS:" Why You Need Them Both
 
Publishing strategies for API documentation
Publishing strategies for API documentationPublishing strategies for API documentation
Publishing strategies for API documentation
 
High Performance Machine Learning in R with H2O
High Performance Machine Learning in R with H2OHigh Performance Machine Learning in R with H2O
High Performance Machine Learning in R with H2O
 
Untangling fall2017 week1
Untangling fall2017 week1Untangling fall2017 week1
Untangling fall2017 week1
 
Javascript best practices
Javascript best practicesJavascript best practices
Javascript best practices
 
Building FoundationDB
Building FoundationDBBuilding FoundationDB
Building FoundationDB
 
Node.js
Node.jsNode.js
Node.js
 
Be faster then rabbits
Be faster then rabbitsBe faster then rabbits
Be faster then rabbits
 
The Why and How of Scala at Twitter
The Why and How of Scala at TwitterThe Why and How of Scala at Twitter
The Why and How of Scala at Twitter
 
ACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data FramesACM TechTalks : Apache Arrow and the Future of Data Frames
ACM TechTalks : Apache Arrow and the Future of Data Frames
 
Transactional writes to cloud storage with Eric Liang
Transactional writes to cloud storage with Eric LiangTransactional writes to cloud storage with Eric Liang
Transactional writes to cloud storage with Eric Liang
 
Low Latency Polyglot Model Scoring using Apache Apex
Low Latency Polyglot Model Scoring using Apache ApexLow Latency Polyglot Model Scoring using Apache Apex
Low Latency Polyglot Model Scoring using Apache Apex
 
Cross-platform interaction
Cross-platform interactionCross-platform interaction
Cross-platform interaction
 
.NET per la Data Science e oltre
.NET per la Data Science e oltre.NET per la Data Science e oltre
.NET per la Data Science e oltre
 
ClojuTRE2015: Kekkonen - making your Clojure web APIs more awesome
ClojuTRE2015: Kekkonen - making your Clojure web APIs more awesomeClojuTRE2015: Kekkonen - making your Clojure web APIs more awesome
ClojuTRE2015: Kekkonen - making your Clojure web APIs more awesome
 

More from Matthew Leingang

Making Lesson Plans
Making Lesson PlansMaking Lesson Plans
Making Lesson Plans
Matthew Leingang
 
Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)
Matthew Leingang
 
Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)
Matthew Leingang
 
Lesson 27: Integration by Substitution (handout)
Lesson 27: Integration by Substitution (handout)Lesson 27: Integration by Substitution (handout)
Lesson 27: Integration by Substitution (handout)
Matthew Leingang
 
Lesson 26: The Fundamental Theorem of Calculus (handout)
Lesson 26: The Fundamental Theorem of Calculus (handout)Lesson 26: The Fundamental Theorem of Calculus (handout)
Lesson 26: The Fundamental Theorem of Calculus (handout)
Matthew Leingang
 
Lesson 25: Evaluating Definite Integrals (slides)
Lesson 25: Evaluating Definite Integrals (slides)Lesson 25: Evaluating Definite Integrals (slides)
Lesson 25: Evaluating Definite Integrals (slides)
Matthew Leingang
 
Lesson 25: Evaluating Definite Integrals (handout)
Lesson 25: Evaluating Definite Integrals (handout)Lesson 25: Evaluating Definite Integrals (handout)
Lesson 25: Evaluating Definite Integrals (handout)
Matthew Leingang
 
Lesson 24: Areas and Distances, The Definite Integral (handout)
Lesson 24: Areas and Distances, The Definite Integral (handout)Lesson 24: Areas and Distances, The Definite Integral (handout)
Lesson 24: Areas and Distances, The Definite Integral (handout)
Matthew Leingang
 
Lesson 24: Areas and Distances, The Definite Integral (slides)
Lesson 24: Areas and Distances, The Definite Integral (slides)Lesson 24: Areas and Distances, The Definite Integral (slides)
Lesson 24: Areas and Distances, The Definite Integral (slides)
Matthew Leingang
 
Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)
Matthew Leingang
 
Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)
Matthew Leingang
 
Lesson 22: Optimization Problems (slides)
Lesson 22: Optimization Problems (slides)Lesson 22: Optimization Problems (slides)
Lesson 22: Optimization Problems (slides)
Matthew Leingang
 
Lesson 22: Optimization Problems (handout)
Lesson 22: Optimization Problems (handout)Lesson 22: Optimization Problems (handout)
Lesson 22: Optimization Problems (handout)
Matthew Leingang
 
Lesson 21: Curve Sketching (slides)
Lesson 21: Curve Sketching (slides)Lesson 21: Curve Sketching (slides)
Lesson 21: Curve Sketching (slides)
Matthew Leingang
 
Lesson 21: Curve Sketching (handout)
Lesson 21: Curve Sketching (handout)Lesson 21: Curve Sketching (handout)
Lesson 21: Curve Sketching (handout)
Matthew Leingang
 
Lesson 20: Derivatives and the Shapes of Curves (slides)
Lesson 20: Derivatives and the Shapes of Curves (slides)Lesson 20: Derivatives and the Shapes of Curves (slides)
Lesson 20: Derivatives and the Shapes of Curves (slides)
Matthew Leingang
 
Lesson 20: Derivatives and the Shapes of Curves (handout)
Lesson 20: Derivatives and the Shapes of Curves (handout)Lesson 20: Derivatives and the Shapes of Curves (handout)
Lesson 20: Derivatives and the Shapes of Curves (handout)
Matthew Leingang
 
Lesson 19: The Mean Value Theorem (slides)
Lesson 19: The Mean Value Theorem (slides)Lesson 19: The Mean Value Theorem (slides)
Lesson 19: The Mean Value Theorem (slides)
Matthew Leingang
 
Lesson 18: Maximum and Minimum Values (slides)
Lesson 18: Maximum and Minimum Values (slides)Lesson 18: Maximum and Minimum Values (slides)
Lesson 18: Maximum and Minimum Values (slides)
Matthew Leingang
 
Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)
Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)
Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)
Matthew Leingang
 

More from Matthew Leingang (20)

Making Lesson Plans
Making Lesson PlansMaking Lesson Plans
Making Lesson Plans
 
Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)
 
Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)Lesson 26: The Fundamental Theorem of Calculus (slides)
Lesson 26: The Fundamental Theorem of Calculus (slides)
 
Lesson 27: Integration by Substitution (handout)
Lesson 27: Integration by Substitution (handout)Lesson 27: Integration by Substitution (handout)
Lesson 27: Integration by Substitution (handout)
 
Lesson 26: The Fundamental Theorem of Calculus (handout)
Lesson 26: The Fundamental Theorem of Calculus (handout)Lesson 26: The Fundamental Theorem of Calculus (handout)
Lesson 26: The Fundamental Theorem of Calculus (handout)
 
Lesson 25: Evaluating Definite Integrals (slides)
Lesson 25: Evaluating Definite Integrals (slides)Lesson 25: Evaluating Definite Integrals (slides)
Lesson 25: Evaluating Definite Integrals (slides)
 
Lesson 25: Evaluating Definite Integrals (handout)
Lesson 25: Evaluating Definite Integrals (handout)Lesson 25: Evaluating Definite Integrals (handout)
Lesson 25: Evaluating Definite Integrals (handout)
 
Lesson 24: Areas and Distances, The Definite Integral (handout)
Lesson 24: Areas and Distances, The Definite Integral (handout)Lesson 24: Areas and Distances, The Definite Integral (handout)
Lesson 24: Areas and Distances, The Definite Integral (handout)
 
Lesson 24: Areas and Distances, The Definite Integral (slides)
Lesson 24: Areas and Distances, The Definite Integral (slides)Lesson 24: Areas and Distances, The Definite Integral (slides)
Lesson 24: Areas and Distances, The Definite Integral (slides)
 
Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)
 
Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)Lesson 23: Antiderivatives (slides)
Lesson 23: Antiderivatives (slides)
 
Lesson 22: Optimization Problems (slides)
Lesson 22: Optimization Problems (slides)Lesson 22: Optimization Problems (slides)
Lesson 22: Optimization Problems (slides)
 
Lesson 22: Optimization Problems (handout)
Lesson 22: Optimization Problems (handout)Lesson 22: Optimization Problems (handout)
Lesson 22: Optimization Problems (handout)
 
Lesson 21: Curve Sketching (slides)
Lesson 21: Curve Sketching (slides)Lesson 21: Curve Sketching (slides)
Lesson 21: Curve Sketching (slides)
 
Lesson 21: Curve Sketching (handout)
Lesson 21: Curve Sketching (handout)Lesson 21: Curve Sketching (handout)
Lesson 21: Curve Sketching (handout)
 
Lesson 20: Derivatives and the Shapes of Curves (slides)
Lesson 20: Derivatives and the Shapes of Curves (slides)Lesson 20: Derivatives and the Shapes of Curves (slides)
Lesson 20: Derivatives and the Shapes of Curves (slides)
 
Lesson 20: Derivatives and the Shapes of Curves (handout)
Lesson 20: Derivatives and the Shapes of Curves (handout)Lesson 20: Derivatives and the Shapes of Curves (handout)
Lesson 20: Derivatives and the Shapes of Curves (handout)
 
Lesson 19: The Mean Value Theorem (slides)
Lesson 19: The Mean Value Theorem (slides)Lesson 19: The Mean Value Theorem (slides)
Lesson 19: The Mean Value Theorem (slides)
 
Lesson 18: Maximum and Minimum Values (slides)
Lesson 18: Maximum and Minimum Values (slides)Lesson 18: Maximum and Minimum Values (slides)
Lesson 18: Maximum and Minimum Values (slides)
 
Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)
Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)
Lesson 17: Indeterminate forms and l'Hôpital's Rule (slides)
 

Recently uploaded

BRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptx
BRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptxBRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptx
BRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptx
kambal1234567890
 
Unlocking Educational Synergy-DIKSHA & Google Classroom.pptx
Unlocking Educational Synergy-DIKSHA & Google Classroom.pptxUnlocking Educational Synergy-DIKSHA & Google Classroom.pptx
Unlocking Educational Synergy-DIKSHA & Google Classroom.pptx
bipin95
 
How to Create a New Article in Knowledge App in Odoo 17
How to Create a New Article in Knowledge App in Odoo 17How to Create a New Article in Knowledge App in Odoo 17
How to Create a New Article in Knowledge App in Odoo 17
Celine George
 
Odoo 17 Social Marketing - Lead Generation On Facebook
Odoo 17 Social Marketing - Lead Generation On FacebookOdoo 17 Social Marketing - Lead Generation On Facebook
Odoo 17 Social Marketing - Lead Generation On Facebook
Celine George
 
How to Manage Early Receipt Printing in Odoo 17 POS
How to Manage Early Receipt Printing in Odoo 17 POSHow to Manage Early Receipt Printing in Odoo 17 POS
How to Manage Early Receipt Printing in Odoo 17 POS
Celine George
 
How to Create Sequence Numbers in Odoo 17
How to Create Sequence Numbers in Odoo 17How to Create Sequence Numbers in Odoo 17
How to Create Sequence Numbers in Odoo 17
Celine George
 
CTD Punjab Police Past Papers MCQs PPSC PDF
CTD Punjab Police Past Papers MCQs PPSC PDFCTD Punjab Police Past Papers MCQs PPSC PDF
CTD Punjab Police Past Papers MCQs PPSC PDF
hammadmughal76316
 
Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...
Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...
Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...
Murugan Solaiyappan
 
ENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUM
ENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUMENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUM
ENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUM
HappieMontevirgenCas
 
NC Public Schools Involved in NCDPI, Zipline Partnership
NC Public Schools Involved in NCDPI, Zipline PartnershipNC Public Schools Involved in NCDPI, Zipline Partnership
NC Public Schools Involved in NCDPI, Zipline Partnership
Mebane Rash
 
Genetics Teaching Plan: Dr.Kshirsagar R.V.
Genetics Teaching Plan: Dr.Kshirsagar R.V.Genetics Teaching Plan: Dr.Kshirsagar R.V.
Genetics Teaching Plan: Dr.Kshirsagar R.V.
DrRavindrakshirsagar1
 
Views in Odoo - Advanced Views - Pivot View in Odoo 17
Views in Odoo - Advanced Views - Pivot View in Odoo 17Views in Odoo - Advanced Views - Pivot View in Odoo 17
Views in Odoo - Advanced Views - Pivot View in Odoo 17
Celine George
 
Imagination in Computer Science Research
Imagination in Computer Science ResearchImagination in Computer Science Research
Imagination in Computer Science Research
Abhik Roychoudhury
 
The Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdf
The Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdfThe Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdf
The Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdf
JackieSparrow3
 
Edukasyong Pantahanan at Pangkabuhayan 1: Personal Hygiene
Edukasyong Pantahanan at  Pangkabuhayan 1: Personal HygieneEdukasyong Pantahanan at  Pangkabuhayan 1: Personal Hygiene
Edukasyong Pantahanan at Pangkabuhayan 1: Personal Hygiene
MJDuyan
 
Bedok NEWater Photostory - COM322 Assessment (Story 2)
Bedok NEWater Photostory - COM322 Assessment (Story 2)Bedok NEWater Photostory - COM322 Assessment (Story 2)
Bedok NEWater Photostory - COM322 Assessment (Story 2)
Liyana Rozaini
 
Individual Performance Commitment Review Form-Developmental Plan.docx
Individual Performance Commitment Review Form-Developmental Plan.docxIndividual Performance Commitment Review Form-Developmental Plan.docx
Individual Performance Commitment Review Form-Developmental Plan.docx
monicaaringo1
 
"DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ...
"DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ..."DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ...
"DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ...
thanhluan21
 
NAEYC Code of Ethical Conduct Resource Book
NAEYC Code of Ethical Conduct Resource BookNAEYC Code of Ethical Conduct Resource Book
NAEYC Code of Ethical Conduct Resource Book
lakitawilson
 
modul ajar kelas x bahasa inggris 2024-2025
modul ajar kelas x bahasa inggris 2024-2025modul ajar kelas x bahasa inggris 2024-2025
modul ajar kelas x bahasa inggris 2024-2025
NurFitriah45
 

Recently uploaded (20)

BRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptx
BRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptxBRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptx
BRIGADA ESKWELA OPENING PROGRAM KICK OFF.pptx
 
Unlocking Educational Synergy-DIKSHA & Google Classroom.pptx
Unlocking Educational Synergy-DIKSHA & Google Classroom.pptxUnlocking Educational Synergy-DIKSHA & Google Classroom.pptx
Unlocking Educational Synergy-DIKSHA & Google Classroom.pptx
 
How to Create a New Article in Knowledge App in Odoo 17
How to Create a New Article in Knowledge App in Odoo 17How to Create a New Article in Knowledge App in Odoo 17
How to Create a New Article in Knowledge App in Odoo 17
 
Odoo 17 Social Marketing - Lead Generation On Facebook
Odoo 17 Social Marketing - Lead Generation On FacebookOdoo 17 Social Marketing - Lead Generation On Facebook
Odoo 17 Social Marketing - Lead Generation On Facebook
 
How to Manage Early Receipt Printing in Odoo 17 POS
How to Manage Early Receipt Printing in Odoo 17 POSHow to Manage Early Receipt Printing in Odoo 17 POS
How to Manage Early Receipt Printing in Odoo 17 POS
 
How to Create Sequence Numbers in Odoo 17
How to Create Sequence Numbers in Odoo 17How to Create Sequence Numbers in Odoo 17
How to Create Sequence Numbers in Odoo 17
 
CTD Punjab Police Past Papers MCQs PPSC PDF
CTD Punjab Police Past Papers MCQs PPSC PDFCTD Punjab Police Past Papers MCQs PPSC PDF
CTD Punjab Police Past Papers MCQs PPSC PDF
 
Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...
Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...
Lecture_Notes_Unit4_Chapter_8_9_10_RDBMS for the students affiliated by alaga...
 
ENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUM
ENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUMENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUM
ENGLISH-7-CURRICULUM MAP- MATATAG CURRICULUM
 
NC Public Schools Involved in NCDPI, Zipline Partnership
NC Public Schools Involved in NCDPI, Zipline PartnershipNC Public Schools Involved in NCDPI, Zipline Partnership
NC Public Schools Involved in NCDPI, Zipline Partnership
 
Genetics Teaching Plan: Dr.Kshirsagar R.V.
Genetics Teaching Plan: Dr.Kshirsagar R.V.Genetics Teaching Plan: Dr.Kshirsagar R.V.
Genetics Teaching Plan: Dr.Kshirsagar R.V.
 
Views in Odoo - Advanced Views - Pivot View in Odoo 17
Views in Odoo - Advanced Views - Pivot View in Odoo 17Views in Odoo - Advanced Views - Pivot View in Odoo 17
Views in Odoo - Advanced Views - Pivot View in Odoo 17
 
Imagination in Computer Science Research
Imagination in Computer Science ResearchImagination in Computer Science Research
Imagination in Computer Science Research
 
The Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdf
The Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdfThe Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdf
The Jewish Trinity : Sabbath,Shekinah and Sanctuary 4.pdf
 
Edukasyong Pantahanan at Pangkabuhayan 1: Personal Hygiene
Edukasyong Pantahanan at  Pangkabuhayan 1: Personal HygieneEdukasyong Pantahanan at  Pangkabuhayan 1: Personal Hygiene
Edukasyong Pantahanan at Pangkabuhayan 1: Personal Hygiene
 
Bedok NEWater Photostory - COM322 Assessment (Story 2)
Bedok NEWater Photostory - COM322 Assessment (Story 2)Bedok NEWater Photostory - COM322 Assessment (Story 2)
Bedok NEWater Photostory - COM322 Assessment (Story 2)
 
Individual Performance Commitment Review Form-Developmental Plan.docx
Individual Performance Commitment Review Form-Developmental Plan.docxIndividual Performance Commitment Review Form-Developmental Plan.docx
Individual Performance Commitment Review Form-Developmental Plan.docx
 
"DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ...
"DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ..."DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ...
"DANH SÁCH THÍ SINH XÉT TUYỂN SỚM ĐỦ ĐIỀU KIỆN TRÚNG TUYỂN ĐẠI HỌC CHÍNH QUY ...
 
NAEYC Code of Ethical Conduct Resource Book
NAEYC Code of Ethical Conduct Resource BookNAEYC Code of Ethical Conduct Resource Book
NAEYC Code of Ethical Conduct Resource Book
 
modul ajar kelas x bahasa inggris 2024-2025
modul ajar kelas x bahasa inggris 2024-2025modul ajar kelas x bahasa inggris 2024-2025
modul ajar kelas x bahasa inggris 2024-2025
 

Streamlining assessment, feedback, and archival with auto-multiple-choice

Editor's Notes

  1. I don’t think of this as SIGMAA WEB so much as SIGMAA Tech or SIGMAA Cloud. I’m demonstrating a workflow that involves desktops, mobile devices, and paper. And a scanner. That’s a big deal.
  2. PDF forms was my previous workflow for quizzes.
  3. big choke point when creating PDF forms. Took me a long time. Also a drag to identify students.
  4. One less link in the process! More automated
  5. One less link in the process! More automated
  6. Image &amp;lt;https://en.wikipedia.org/wiki/Optical_mark_recognition#/media/File:LegacyStyleOMRFormSm.jpg&amp;gt; by Wiki episteme [CC-BY-3.0] SDAPS is python (good), more focused on SSR and surveying queXF is PHP. I am done with PHP. G’n’T Eval is beta and in Ruby. I know no Ruby. AMC is perl (meh), more focused on math and assessment
  7. Each question has an ID. More about that later.
  8. The dots are to help the processor find the corners. The bar code identifies which paper this is of how many. The numbers are a human-readable version of the same.
  9. ID and MCQs on front, SAQ/FRQ on backStack of 30-40 is pretty lightGrade on paper, fill in the circleScan the graded papers, run AMCProcessingScores MCQReads FRQ marksReads IDsAfter loading CSV roster file, matches namesEasy matching of badly encoded IDs with handwritten names (screenshot?)Export spreadsheet report (good to find invalid responses or missing responses)Export CSV file (customizable fields) for uploading to LMS
  10. Pretty darn close to Dream Workflow #1
  11. More automated
  12. ID and MCQs on front, SAQ/FRQ on backStack of 30-40 is pretty lightGrade on paper, fill in the circleScan the graded papers, run AMCProcessingScores MCQReads FRQ marksReads IDsAfter loading CSV roster file, matches namesEasy matching of badly encoded IDs with handwritten names (screenshot?)Export spreadsheet report (good to find invalid responses or missing responses)Export CSV file (customizable fields) for uploading to LMS
  13. ID and MCQs on front, SAQ/FRQ on backStack of 30-40 is pretty lightGrade on paper, fill in the circleScan the graded papers, run AMCProcessingScores MCQReads FRQ marksReads IDsAfter loading CSV roster file, matches namesEasy matching of badly encoded IDs with handwritten namesExport spreadsheet report (good to find invalid responses or missing responses)Export CSV file (customizable fields) for uploading to LMS
  14. This is a rather pricey app ($10), but I have gotten more than that out of it.
  15. Handwritten comments with stylusTyped commentsCircles, boxes, arrows
  16. Students love these.
  17. One way this is useful is that you can “mount” parts of a WebDAV share on your filesystem. So Sakai exposes this protocol to make it easy to upload files by drag-and-drop. BUT when you have to transfer 40+ files into separate directories, that can be a pain. Plus mounting the DAV share requires a little handshake which is annoying. SO here’s the other cool feature of DAV: it’s built on HTTP so you can upload files with PUT requests. That makes it scriptable.
  18. --netrc tells curl to read your .netrc file for passwords (potential security issue) -T issues a PUT request &amp;lt;site-id&amp;gt; is an identifier of your section (All Sakai instances have this) dav/group-user/&amp;lt;username&amp;gt; is location of dropbox name it anything you want. I crunch the CSV file and the AMC config file (XML) to get it.
  19. Evernote is a cloud storage systemRather than files and folders it uses notebooks, notes, and tags.Notes can hold text, images, PDFs, and any other file in the premium versionNotes can be tagged any which wayA note can only be in one notebook, though.Storage limit is per month instead of total!FERPA compliant privacyNotebooks can sync to platform or live in the cloudFast, broad searching (by text, tag, date, etc)Available on just about any platform used (desktop, web, mobile)Developer API for uploading notesImage via &amp;lt;https://blog.evernote.com/blog/2012/04/18/14-new-evernote-wallpapers-designed-for-your-ipads-retina-display/&amp;gt; by Adelle Charles
  20. notebook: big projects, status tags: student, course, subjects, etc. can create views by saving searches but also just “google your Evernote” available on all platforms upload limit is by month rather than total storage
  21. I’ve written an earlier version of this script (in python) that inputs a flat CSV file and uploads to Evernote. For tighter integration with AMC, I should either pull from the SQLite Database and XML application configuration. Or I should use the AMC data model and write in perl. Kinda torn.
  22. I keep the hard copies on a shelf and shred at the end of the semester. No more having to track down students to give them weeks-old quizzes Regrades—have you ever given an MC item and discovered an error in the key? Post-exam—pull it up on the big monitor, project onto board even?
  23. We have a multifunction printer/copier/scanner. But even then a single exam takes about a minute to print.  Maybe multifunction can do scanning faster, haven&amp;apos;t tried yet. Of course, it can also be parallelized
  24. Scaling—more exams this spring. Integration—There are plugins to AMC but not for all features (Report, yes; Send, no) Uploading CSV to Sakai should be possible. An obvious place to plug in the “return by DAV” script would be at the point of “Send” but there’s no plugin mechanism there. Item analysis is ready to go! Each item has a unique ID. Student scores and responses by item are accessible. NumPy or R (or perl) should be able to handle that. There is a report plugin.