Question generation for custom lesson plans

1. Generation Q
Question generation for custom lesson plans
Drew Serles
Insight Artificial Intelligence

2. Motivation
● The “testing effect” - active
recall improves retention [1]
● Teachers are very busy and have
other priorities
Solution
2
● Automatic question generation
● Quizzes for any reading material
[1] Roediger & Butler, 2011

3. Question Generation with Seq2Seq
● Question answering is well
studied, generation is not
● Recent success with deep
learning
● Inspired by “Learning to Ask”
www.opennmt.com
3
Du et al. 2017

4. Project Goals
4
● Reimplement model in Python
● Create user-facing application
● Replicate results

5. SQuAD Dataset
5
● From Wikipedia articles
● Human generated questions
● 85,000 data points
https://rajpurkar.github.io/mlx/qa-and-squad/

6. Challenges and
Solutions
6
● Scope was outside 2 week timeline
● Repurposed OpenNMT framework
● Quality experience with RNNs

7. Generation Q demo
www.generationq.online
7

8. Results and Validation
8
Results
● Implemented Python model with OpenNMT
● Created user-facing app
Validation
● Matched BLEU scores
Future work
● Explore Q&A in tandem

9. Drew Serles
9
Mechanical Engineer Controls Software Machine Learning

10. Additional Slides
BLEU Score
10
● Concept from machine translation
● “The closer a translation is to a human translator, the better”
● Modified precision metric using n-grams

11. Text
11
● Everest's first known summitting occurred by 1953, and
interest by climbers increased. Despite the effort and attention
poured into expeditions, only about 200 people had summitted
by 1984. Everest remained a difficult climb for decades, even
for serious attempts by professional climbers and large
national expeditions, which were the norm until the
commercial era began in the 1990s.