SlideShare a Scribd company logo

A Data-Driven Question Generation Model for Educational Content - by Jack Wang

•
•
Yan Xu
Yan Xu

Deep learning workshop at Houston machine learning meetup. Video at: https://youtu.be/8fmcn7ull8M?t=3

Science
1 of 101
Download to read offline
QG-Net: Data-Driven Question Generation Model for Educational Content Jack Wang June 25, 2018
[ J. D. Karpicke et. al., 2012 ] [ R. J. Hift. 2014 ] [ D. Rohrer et. al., 2010 ]
?
Input text QG-Net
… one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
… one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
… one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question
… one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question ✓ Fluent ✓ relevant
Input text QG-Net Generated question ✓ Generates fluent and relevant questions
Input text QG-Net Generated question ✓ Generates fluent and relevant questions
Input text QG-Net Generated question ✓ Generates fluent and relevant questions
Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
QG-Net
QG-Net
QG-Net Reader
QG-Net Reader Generator
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation 1. D. Bahdanau et. al., 2014 2. A. See et. al., 2017 1 2
QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism ✓ Fluent and relevant questions ✓ Adaptive to texts from various subjects 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, …
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American
Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American What is Tesla’s nationality?
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD
Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD ○ Compared to 2 of the best existing models (baseline11, baseline 22) 1. M. Heilman, 2010 2. X. Du et. al., 2017
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people’s reactions to inequality were moderated by class differences and rates of social mobility, ...
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ...
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale? Chapter 12.1 Chapter 1.3
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson.
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? QG-Net: ✓ Generates fluent and relevant questions ✓ Is adaptive to text from various subjects
Human evaluation experiment ● We sample 150 sentences from each textbook ● We use the three models to generate questions ● Human evaluators evaluate the quality of generated questions ○ Fluency ○ relevance ● Human evaluators pick which question(s) could have been generated by human ○ Can choose none of them
Human evaluation results Baseline 1 Baseline 2 OS = OpenStax
Human evaluation results Baseline 1 Baseline 2
Human evaluation results Baseline 1 Baseline 2 QG-Net: ✓ Generates superior questions in terms of both fluency and relevance ✓ Works well for inputs from various subjects
Human evaluation results Baseline 1 Baseline 2
Human evaluation results Baseline 1 Baseline 2 Perceptually, QG-Net generates questions of superior quality than those generated by baseline models.
Input text QG-Net Generated question
Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
Or
Acknowledgements Rich Baraniuk Andrew Lan Phil Grimaldi Drew Waters Weili Nie John and Ann Doerr Arthur & Carlyse Ciocca Charitable Foundation
Questions? QG-Net is on Github! https://github.com/moonlightlane/QG-Net jzwang@rice.edu Input text QG-Net Generated question
Appendix
Appendix
Appendix

Recommended

Shared Rationales in Group Activities
Shared Rationales in Group ActivitiesShared Rationales in Group Activities
Shared Rationales in Group ActivitiesLu Xiao
 
Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Jindra Cekan, PhD
 
Encouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetEncouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetSean Munson
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010guest1d1e7b
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010Marc Maxson / GlobalGiving
 
Drupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityDrupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityAll Things Open
 
Cls8 decarbonet
Cls8 decarbonetCls8 decarbonet
Cls8 decarbonetDiana Maynard
 
People's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksPeople's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksMSL
 

Recommended

Shared Rationales in Group Activities
Shared Rationales in Group ActivitiesShared Rationales in Group Activities
Shared Rationales in Group ActivitiesLu Xiao
 
Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Valuing Voices Cekan Wageningen Conference 0315
Valuing Voices Cekan Wageningen Conference 0315Jindra Cekan, PhD
 
Encouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetEncouraging Reading of Diverse Political Viewpoints with a Browser Widget
Encouraging Reading of Diverse Political Viewpoints with a Browser WidgetSean Munson
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010guest1d1e7b
 
Washington evaluation may 6 2010
Washington evaluation may 6 2010Washington evaluation may 6 2010
Washington evaluation may 6 2010Marc Maxson / GlobalGiving
 
Drupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityDrupal's Credit System and Evidence-Based Open-Source Sustainability
Drupal's Credit System and Evidence-Based Open-Source SustainabilityAll Things Open
 
Cls8 decarbonet
Cls8 decarbonetCls8 decarbonet
Cls8 decarbonetDiana Maynard
 
People's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksPeople's Insights Volume 1, Issue 20 : Celebrate What Works
People's Insights Volume 1, Issue 20 : Celebrate What WorksMSL
 
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020Shuman Ip
 
Are online communities the way forward?
Are online communities the way forward?Are online communities the way forward?
Are online communities the way forward?Questback UK
 
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISUSER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISRuth Garcia Gavilanes
 
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...Sustainable Brands
 
Policy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPolicy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPatricia Curmi
 
487816 959(1)
487816 959(1)487816 959(1)
487816 959(1)behrooz Kazemi
 
M&E workshop for riversee
M&E workshop for riverseeM&E workshop for riversee
M&E workshop for riverseeproMENTE social research
 
GlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCGlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCMarc Maxson / GlobalGiving
 
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSParagraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSDarian Pruitt
 
ProfessionalProjectProposal
ProfessionalProjectProposalProfessionalProjectProposal
ProfessionalProjectProposalPeggy Strickling
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz Group
 
Online Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarOnline Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarAliakbar Akbaritabar
 
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERA NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERIRJET Journal
 
Msu College Application Essay Questions
Msu College Application Essay QuestionsMsu College Application Essay Questions
Msu College Application Essay QuestionsCarolyn Smith
 
Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...IIIT Hyderabad
 
The State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USThe State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USmysociety
 
Digital Workplace Trends and Transformation
Digital Workplace Trends and TransformationDigital Workplace Trends and Transformation
Digital Workplace Trends and TransformationJane McConnell
 
Emerging power of big data 2014
Emerging power of big data 2014Emerging power of big data 2014
Emerging power of big data 2014haramaya university
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...John Mauremootoo
 
Vera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptVera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptSara Vera
 
Kaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingKaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingYan Xu
 
Basics of Dynamic programming
Basics of Dynamic programming Basics of Dynamic programming
Basics of Dynamic programming Yan Xu
 

More Related Content

Similar to A Data-Driven Question Generation Model for Educational Content - by Jack Wang

AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020Shuman Ip
 
Are online communities the way forward?
Are online communities the way forward?Are online communities the way forward?
Are online communities the way forward?Questback UK
 
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISUSER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISRuth Garcia Gavilanes
 
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...Sustainable Brands
 
Policy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPolicy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPatricia Curmi
 
GlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCGlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCMarc Maxson / GlobalGiving
 
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSParagraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSDarian Pruitt
 
ProfessionalProjectProposal
ProfessionalProjectProposalProfessionalProjectProposal
ProfessionalProjectProposalPeggy Strickling
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz Group
 
Online Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarOnline Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarAliakbar Akbaritabar
 
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERA NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERIRJET Journal
 
Msu College Application Essay Questions
Msu College Application Essay QuestionsMsu College Application Essay Questions
Msu College Application Essay QuestionsCarolyn Smith
 
Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...IIIT Hyderabad
 
The State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USThe State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USmysociety
 
Digital Workplace Trends and Transformation
Digital Workplace Trends and TransformationDigital Workplace Trends and Transformation
Digital Workplace Trends and TransformationJane McConnell
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...John Mauremootoo
 
Vera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptVera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptSara Vera
 

Similar to A Data-Driven Question Generation Model for Educational Content - by Jack Wang (20)

AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
AgileTO Quick Talk Social Identity and Change Management - Nov 18 2020
 
Are online communities the way forward?
Are online communities the way forward?Are online communities the way forward?
Are online communities the way forward?
 
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASISUSER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
USER BEHAVIOR IN MICROBLOGS WITH A CULTURAL EMPHASIS
 
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
The Art of Assigning Specific Dollar Values to Previously Ignored Social Impa...
 
Policy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for moneyPolicy tools, wellbeing impacts and value for money
Policy tools, wellbeing impacts and value for money
 
487816 959(1)
487816 959(1)487816 959(1)
487816 959(1)
 
M&E workshop for riversee
M&E workshop for riverseeM&E workshop for riversee
M&E workshop for riversee
 
GlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRCGlobalGiving - case study - presented at Skoll ISIRC
GlobalGiving - case study - presented at Skoll ISIRC
 
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTSParagraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
Paragraph-Plan-For-Ielts-Task-2-Essay - TED IELTS
 
ProfessionalProjectProposal
ProfessionalProjectProposalProfessionalProjectProposal
ProfessionalProjectProposal
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems Change
 
Online Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabarOnline Social Capital measurement tool presentation @akbaritabar
Online Social Capital measurement tool presentation @akbaritabar
 
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIERA NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
A NOVEL APPROACH FOR TWITTER SENTIMENT ANALYSIS USING HYBRID CLASSIFIER
 
Msu College Application Essay Questions
Msu College Application Essay QuestionsMsu College Application Essay Questions
Msu College Application Essay Questions
 
Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...Modeling Online User Interactions and their Offline effects on Socio-Technica...
Modeling Online User Interactions and their Offline effects on Socio-Technica...
 
The State of Civic Tech Impact in the US
The State of Civic Tech Impact in the USThe State of Civic Tech Impact in the US
The State of Civic Tech Impact in the US
 
Digital Workplace Trends and Transformation
Digital Workplace Trends and TransformationDigital Workplace Trends and Transformation
Digital Workplace Trends and Transformation
 
Emerging power of big data 2014
Emerging power of big data 2014Emerging power of big data 2014
Emerging power of big data 2014
 
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
Searching for outcomes in rural Tanzania: Harvesting directly from those infl...
 
Vera Data 2.0 Slides and Script
Vera Data 2.0 Slides and ScriptVera Data 2.0 Slides and Script
Vera Data 2.0 Slides and Script
 

More from Yan Xu

Kaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingKaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingYan Xu
 
Basics of Dynamic programming
Basics of Dynamic programming Basics of Dynamic programming
Basics of Dynamic programming Yan Xu
 
Walking through Tensorflow 2.0
Walking through Tensorflow 2.0Walking through Tensorflow 2.0
Walking through Tensorflow 2.0Yan Xu
 
Practical contextual bandits for business
Practical contextual bandits for businessPractical contextual bandits for business
Practical contextual bandits for businessYan Xu
 
Introduction to Multi-armed Bandits
Introduction to Multi-armed BanditsIntroduction to Multi-armed Bandits
Introduction to Multi-armed BanditsYan Xu
 
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...Yan Xu
 
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...Yan Xu
 
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...Yan Xu
 
Introduction to Autoencoders
Introduction to AutoencodersIntroduction to Autoencoders
Introduction to AutoencodersYan Xu
 
State of enterprise data science
State of enterprise data scienceState of enterprise data science
State of enterprise data scienceYan Xu
 
Long Short Term Memory
Long Short Term MemoryLong Short Term Memory
Long Short Term MemoryYan Xu
 
Deep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and RegularizationDeep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and RegularizationYan Xu
 
Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)Yan Xu
 
HML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep LearningHML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep LearningYan Xu
 
Secrets behind AlphaGo
Secrets behind AlphaGoSecrets behind AlphaGo
Secrets behind AlphaGoYan Xu
 
Optimization in Deep Learning
Optimization in Deep LearningOptimization in Deep Learning
Optimization in Deep LearningYan Xu
 
Introduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkIntroduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkYan Xu
 
Convolutional neural network
Convolutional neural network Convolutional neural network
Convolutional neural network Yan Xu
 
Introduction to Neural Network
Introduction to Neural NetworkIntroduction to Neural Network
Introduction to Neural NetworkYan Xu
 
Nonlinear dimension reduction
Nonlinear dimension reductionNonlinear dimension reduction
Nonlinear dimension reductionYan Xu
 

More from Yan Xu (20)

Kaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales ForecastingKaggle winning solutions: Retail Sales Forecasting
Kaggle winning solutions: Retail Sales Forecasting
 
Basics of Dynamic programming
Basics of Dynamic programming Basics of Dynamic programming
Basics of Dynamic programming
 
Walking through Tensorflow 2.0
Walking through Tensorflow 2.0Walking through Tensorflow 2.0
Walking through Tensorflow 2.0
 
Practical contextual bandits for business
Practical contextual bandits for businessPractical contextual bandits for business
Practical contextual bandits for business
 
Introduction to Multi-armed Bandits
Introduction to Multi-armed BanditsIntroduction to Multi-armed Bandits
Introduction to Multi-armed Bandits
 
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
Deep Learning Approach in Characterizing Salt Body on Seismic Images - by Zhe...
 
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
Deep Hierarchical Profiling & Pattern Discovery: Application to Whole Brain R...
 
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
Detecting anomalies on rotating equipment using Deep Stacked Autoencoders - b...
 
Introduction to Autoencoders
Introduction to AutoencodersIntroduction to Autoencoders
Introduction to Autoencoders
 
State of enterprise data science
State of enterprise data scienceState of enterprise data science
State of enterprise data science
 
Long Short Term Memory
Long Short Term MemoryLong Short Term Memory
Long Short Term Memory
 
Deep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and RegularizationDeep Feed Forward Neural Networks and Regularization
Deep Feed Forward Neural Networks and Regularization
 
Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)Linear algebra and probability (Deep Learning chapter 2&3)
Linear algebra and probability (Deep Learning chapter 2&3)
 
HML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep LearningHML: Historical View and Trends of Deep Learning
HML: Historical View and Trends of Deep Learning
 
Secrets behind AlphaGo
Secrets behind AlphaGoSecrets behind AlphaGo
Secrets behind AlphaGo
 
Optimization in Deep Learning
Optimization in Deep LearningOptimization in Deep Learning
Optimization in Deep Learning
 
Introduction to Recurrent Neural Network
Introduction to Recurrent Neural NetworkIntroduction to Recurrent Neural Network
Introduction to Recurrent Neural Network
 
Convolutional neural network
Convolutional neural network Convolutional neural network
Convolutional neural network
 
Introduction to Neural Network
Introduction to Neural NetworkIntroduction to Neural Network
Introduction to Neural Network
 
Nonlinear dimension reduction
Nonlinear dimension reductionNonlinear dimension reduction
Nonlinear dimension reduction
 

Recently uploaded

SCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdfSCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdfSELF-EXPLANATORY
 
Topography and sediments of the floor of the Bay of Bengal
Topography and sediments of the floor of the Bay of BengalTopography and sediments of the floor of the Bay of Bengal
Topography and sediments of the floor of the Bay of BengalMd Hasan Tareq
 
platelets- lifespan -Clot retraction-disorders.pptx
platelets- lifespan -Clot retraction-disorders.pptxplatelets- lifespan -Clot retraction-disorders.pptx
platelets- lifespan -Clot retraction-disorders.pptxmuralinath2
 
Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Sérgio Sacani
 
RNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCINGRNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCINGAADYARAJPANDEY1
 
ESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptxESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptxmuralinath2
 
Microbial Type Culture Collection (MTCC)
Microbial Type Culture Collection (MTCC)Microbial Type Culture Collection (MTCC)
Microbial Type Culture Collection (MTCC)abhishekdhamu51
 
Mammalian Pineal Body Structure and Also Functions
Mammalian Pineal Body Structure and Also FunctionsMammalian Pineal Body Structure and Also Functions
Mammalian Pineal Body Structure and Also FunctionsYOGESH DOGRA
 
INSIGHT Partner Profile: Tampere University
INSIGHT Partner Profile: Tampere UniversityINSIGHT Partner Profile: Tampere University
INSIGHT Partner Profile: Tampere UniversitySteffi Friedrichs
 
Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...Sérgio Sacani
 
insect taxonomy importance systematics and classification
insect taxonomy importance systematics and classificationinsect taxonomy importance systematics and classification
insect taxonomy importance systematics and classificationanitaento25
 
Shuaib Y-basedComprehensive mahmudj.pptx
Shuaib Y-basedComprehensive mahmudj.pptxShuaib Y-basedComprehensive mahmudj.pptx
Shuaib Y-basedComprehensive mahmudj.pptxMdAbuRayhan16
 
Cancer cell metabolism: special Reference to Lactate Pathway
Cancer cell metabolism: special Reference to Lactate PathwayCancer cell metabolism: special Reference to Lactate Pathway
Cancer cell metabolism: special Reference to Lactate PathwayAADYARAJPANDEY1
 
biotech-regenration of plants, pharmaceutical applications.pptx
biotech-regenration of plants, pharmaceutical applications.pptxbiotech-regenration of plants, pharmaceutical applications.pptx
biotech-regenration of plants, pharmaceutical applications.pptxANONYMOUS
 
Richard's entangled aventures in wonderland
Richard's entangled aventures in wonderlandRichard's entangled aventures in wonderland
Richard's entangled aventures in wonderlandRichard Gill
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxAlaminAfendy1
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONChetanK57
 
GEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdf
GEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdfGEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdf
GEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdfUniversity of Barishal
 
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdfPests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdfPirithiRaju
 
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243Sérgio Sacani
 

Recently uploaded (20)

SCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdfSCHIZOPHRENIA Disorder/ Brain Disorder.pdf
SCHIZOPHRENIA Disorder/ Brain Disorder.pdf
 
Topography and sediments of the floor of the Bay of Bengal
Topography and sediments of the floor of the Bay of BengalTopography and sediments of the floor of the Bay of Bengal
Topography and sediments of the floor of the Bay of Bengal
 
platelets- lifespan -Clot retraction-disorders.pptx
platelets- lifespan -Clot retraction-disorders.pptxplatelets- lifespan -Clot retraction-disorders.pptx
platelets- lifespan -Clot retraction-disorders.pptx
 
Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...Climate extremes likely to drive land mammal extinction during next supercont...
Climate extremes likely to drive land mammal extinction during next supercont...
 
RNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCINGRNA INTERFERENCE: UNRAVELING GENETIC SILENCING
RNA INTERFERENCE: UNRAVELING GENETIC SILENCING
 
ESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptxESR_factors_affect-clinic significance-Pathysiology.pptx
ESR_factors_affect-clinic significance-Pathysiology.pptx
 
Microbial Type Culture Collection (MTCC)
Microbial Type Culture Collection (MTCC)Microbial Type Culture Collection (MTCC)
Microbial Type Culture Collection (MTCC)
 
Mammalian Pineal Body Structure and Also Functions
Mammalian Pineal Body Structure and Also FunctionsMammalian Pineal Body Structure and Also Functions
Mammalian Pineal Body Structure and Also Functions
 
INSIGHT Partner Profile: Tampere University
INSIGHT Partner Profile: Tampere UniversityINSIGHT Partner Profile: Tampere University
INSIGHT Partner Profile: Tampere University
 
Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...Multi-source connectivity as the driver of solar wind variability in the heli...
Multi-source connectivity as the driver of solar wind variability in the heli...
 
insect taxonomy importance systematics and classification
insect taxonomy importance systematics and classificationinsect taxonomy importance systematics and classification
insect taxonomy importance systematics and classification
 
Shuaib Y-basedComprehensive mahmudj.pptx
Shuaib Y-basedComprehensive mahmudj.pptxShuaib Y-basedComprehensive mahmudj.pptx
Shuaib Y-basedComprehensive mahmudj.pptx
 
Cancer cell metabolism: special Reference to Lactate Pathway
Cancer cell metabolism: special Reference to Lactate PathwayCancer cell metabolism: special Reference to Lactate Pathway
Cancer cell metabolism: special Reference to Lactate Pathway
 
biotech-regenration of plants, pharmaceutical applications.pptx
biotech-regenration of plants, pharmaceutical applications.pptxbiotech-regenration of plants, pharmaceutical applications.pptx
biotech-regenration of plants, pharmaceutical applications.pptx
 
Richard's entangled aventures in wonderland
Richard's entangled aventures in wonderlandRichard's entangled aventures in wonderland
Richard's entangled aventures in wonderland
 
In silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptxIn silico drugs analogue design: novobiocin analogues.pptx
In silico drugs analogue design: novobiocin analogues.pptx
 
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATIONPRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
PRESENTATION ABOUT PRINCIPLE OF COSMATIC EVALUATION
 
GEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdf
GEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdfGEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdf
GEOLOGICAL FIELD REPORT On Kaptai Rangamati Road-Cut Section.pdf
 
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdfPests of sugarcane_Binomics_IPM_Dr.UPR.pdf
Pests of sugarcane_Binomics_IPM_Dr.UPR.pdf
 
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
Constraints on Neutrino Natal Kicks from Black-Hole Binary VFTS 243
 

A Data-Driven Question Generation Model for Educational Content - by Jack Wang

  • 1. QG-Net: Data-Driven Question Generation Model for Educational Content Jack Wang June 25, 2018
  • 2.
  • 3.
  • 4.
  • 5.
  • 6. [ J. D. Karpicke et. al., 2012 ] [ R. J. Hift. 2014 ] [ D. Rohrer et. al., 2010 ]
  • 7.
  • 8.
  • 9. ?
  • 10.
  • 11.
  • 12.
  • 14. … one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
  • 15. … one of the positive contributions of deviance is that it fosters social change. Input text QG-Net
  • 16. … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question
  • 17. … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? Input text QG-Net Generated question ✓ Fluent ✓ relevant
  • 18. Input text QG-Net Generated question ✓ Generates fluent and relevant questions
  • 19. Input text QG-Net Generated question ✓ Generates fluent and relevant questions
  • 20. Input text QG-Net Generated question ✓ Generates fluent and relevant questions
  • 21. Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
  • 26. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 27. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 28. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 29. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 30. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 31. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 32. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 33. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 34. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 35. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 36. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 37. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 38. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 39. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 40. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change.
  • 41. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 42. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 43. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 44. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 45. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 46. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 47. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 48. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 49. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 50. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 51. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 52. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 53. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 54. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 55. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation 1. D. Bahdanau et. al., 2014 2. A. See et. al., 2017 1 2
  • 56. QG-Net Reader Generator … one of the positive contributions of deviance is that it fosters social change. What is one of the positive contributions of deviance? LSTM network LSTM network Attention mechanism Copy mechanism ✓ Fluent and relevant questions ✓ Adaptive to texts from various subjects 0100010101 0100110100 1010001010 0111010101 01010101... Intermediate representation
  • 57. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD
  • 58. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, …
  • 59. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American
  • 60. Experiment overview Source sentence (from Wikipedia) Answer (selected from text) Generated question[ ] ● QG-Net learns to generate questions using SQuAD Nikola Tesla was a Serbian American inventor, … Serbian American What is Tesla’s nationality?
  • 61. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 62. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 63. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 64. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks
  • 65. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD
  • 66. Experiment overview ● QG-Net learns to generate questions using SQuAD ● We test it on three OpenStax textbooks ○ Pre-processed the textbook texts to the same format as SQuAD ○ Compared to 2 of the best existing models (baseline11, baseline 22) 1. M. Heilman, 2010 2. X. Du et. al., 2017
  • 67. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people’s reactions to inequality were moderated by class differences and rates of social mobility, ...
  • 68. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ...
  • 69. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by?
  • 70. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
  • 71. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,?
  • 72. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
  • 73. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
  • 74. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale?
  • 75. Qualitative evaluation result #1 (Sociology) Weber noted that different groups were affected differently based on education, race and gender, and that people's’ reactions to inequality were moderated by class differences and rates of social mobility, ... QG-Net: Along with education and race, what did Weber believe different groups were affected by? Baseline 1: What was education, race, and,? Baseline 2: Along with education, race, race, and race, what other groups were affected by the Kinsey scale? Chapter 12.1 Chapter 1.3
  • 76. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson.
  • 77. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
  • 78. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. Chapter 10.4
  • 79. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Chapter 10.4
  • 80. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
  • 81. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Chapter 10.4
  • 82. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
  • 83. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? Chapter 10.4
  • 84. Qualitative evaluation result #2 (History) The 1830 Indian Removal Act and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfilled the vision of a white nation and became one of the identifying characteristics of the age of Jackson. QG-Net: What act became one of the identifying characteristics of the age of Jackson? Baseline 1: What did and subsequent displacement of the Creek, Choctaw, Chickasaw, Seminole, and Cherokee tribes of the southeast fulfil the vision of a white nation? Baseline 2: What was the name of the act that caused a white nation to become a white nation? QG-Net: ✓ Generates fluent and relevant questions ✓ Is adaptive to text from various subjects
  • 85. Human evaluation experiment ● We sample 150 sentences from each textbook ● We use the three models to generate questions ● Human evaluators evaluate the quality of generated questions ○ Fluency ○ relevance ● Human evaluators pick which question(s) could have been generated by human ○ Can choose none of them
  • 86. Human evaluation results Baseline 1 Baseline 2 OS = OpenStax
  • 88. Human evaluation results Baseline 1 Baseline 2 QG-Net: ✓ Generates superior questions in terms of both fluency and relevance ✓ Works well for inputs from various subjects
  • 90. Human evaluation results Baseline 1 Baseline 2 Perceptually, QG-Net generates questions of superior quality than those generated by baseline models.
  • 92. Input text QG-Net Generated question ✓ Generates fluent and relevant questions ✓ Adaptive to texts from various subjects
  • 93.
  • 94.
  • 95.
  • 96. Or
  • 97. Acknowledgements Rich Baraniuk Andrew Lan Phil Grimaldi Drew Waters Weili Nie John and Ann Doerr Arthur & Carlyse Ciocca Charitable Foundation
  • 98. Questions? QG-Net is on Github! https://github.com/moonlightlane/QG-Net jzwang@rice.edu Input text QG-Net Generated question