SlideShare a Scribd company logo
1 of 17
Download to read offline
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
How “Quantitatively Inclined” are Incoming Freshmen?
Northeast Consortium for Quantitative Literacy XVIII
Yale University — May 9, 2015
Matt Salomone
Assistant Professor, Mathematics Department
Director, Math Services
Coordinator, Quantity Across the Curriculum
Bridgewater State University
Bridgewater, MA 023251
1This work is supported by a Summer Grant from the Center for the Advancement of Research and
Scholarship at BSU.
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Do Freshmen “Want to Do the Dishes?”
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Do Freshmen “Want to Do the Dishes?”
How “Quantitatively Inclined” are Incoming Freshmen?
To what extent does a quantitative habit of mind exist among incoming
freshman students?
Use their extemporaneous persuasive writing to correlate:
1 Engagement & success with quant evidence vs. Student characteristics
2 vs. Writing readiness score
3 vs. Retention into second year
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Do Freshmen “Want to Do the Dishes?”
How “Quantitatively Inclined” are Incoming Freshmen?
To what extent does a quantitative habit of mind exist among incoming
freshman students?
Use their extemporaneous persuasive writing to correlate:
1 Engagement & success with quant evidence vs. Student characteristics
2 vs. Writing readiness score
3 vs. Retention into second year
Frame & Features of Assessment
1 Holistic scoring for extent & quality of QR (Modified QuIRK)
2 “State of nature” measurement (Not a “QR task”)
3 Potential new proxies for early math/QR course success?
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Verbal Skill = Key Enabler of Quantitative Reasoning
Reading Comprehension
High cognitive reading load impairs QR success (Gillmor et al. 2015)
Unusually high-quality attention required to avoid bias (Kahneman 2011)
Basic logical/statistical vocabulary often missing (Bennett, NNN list)
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Verbal Skill = Key Enabler of Quantitative Reasoning
Reading Comprehension
High cognitive reading load impairs QR success (Gillmor et al. 2015)
Unusually high-quality attention required to avoid bias (Kahneman 2011)
Basic logical/statistical vocabulary often missing (Bennett, NNN list)
Writing Fluency
Writing at core of many QR assessment rubrics (LEAP &c.)
Difficulty expressing simple Q ideas with precision (Schield 2008)
Students frequently miss opportunities to use QR (Miller 2004,
Rutz & Grawe 2009)
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Verbal Skill = Key Enabler of Quantitative Reasoning
Reading Comprehension
High cognitive reading load impairs QR success (Gillmor et al. 2015)
Unusually high-quality attention required to avoid bias (Kahneman 2011)
Basic logical/statistical vocabulary often missing (Bennett, NNN list)
Writing Fluency
Writing at core of many QR assessment rubrics (LEAP &c.)
Difficulty expressing simple Q ideas with precision (Schield 2008)
Students frequently miss opportunities to use QR (Miller 2004,
Rutz & Grawe 2009)
Key idea: It is never enough to assess only computational skill — QR always
involves a trade of information both out of a context (reading) and back into a
context (writing).
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Facts on the Ground at Bridgewater State University
BSU is a comprehensive, Masters-large university focused on undergraduate
education and with a heritage as a teacher-preparatory normal school.
By the numbers
≈ 8500 undergraduates
60% female
60% are one or more:
1 Of color (15%)
2 1st generation (50%)
3 Pell eligible (25%)
Hum/SS	
  
47%	
  
Educa.on	
  
27%	
  
Business	
  
15%	
  
Sci/Math	
  
11%	
  
Freshman Class of 2013 N = 1436
Average SAT-Math: 501
Average Elem. Alg.: 78.5
Average SAT-Verb: 492
Average Read. Comp.: 85.5
Developmental math: 35.2%
Developmental writing: 14.4%
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Writing Placement – Process & Prompt
Locally developed exam feeds: (60 minutes)
ENGL 101 + ENGL 144 ENGL 101 ENGL 102
Writing Rhetorically (3 cr.) Writing Rhetorically (3 cr.) Writing Rhet. w Sources (3 cr.)
Academic Strategies (1 cr.)
Score 3 or SAT-V 500 Score 4 or SAT-V 600
195 students (14.4%) 1,082 students (75.3%) 150 students (10.4%)
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Writing Placement – Process & Prompt
Locally developed exam feeds: (60 minutes)
ENGL 101 + ENGL 144 ENGL 101 ENGL 102
Writing Rhetorically (3 cr.) Writing Rhetorically (3 cr.) Writing Rhet. w Sources (3 cr.)
Academic Strategies (1 cr.)
Score 3 or SAT-V 500 Score 4 or SAT-V 600
195 students (14.4%) 1,082 students (75.3%) 150 students (10.4%)
Essay is rhetorical in nature — students must construct an argument based on
≈ 1 page of evidence. Beginning 2012, some evidence is quantitative.
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Writing Placement – Process & Prompt
Locally developed exam feeds: (60 minutes)
ENGL 101 + ENGL 144 ENGL 101 ENGL 102
Writing Rhetorically (3 cr.) Writing Rhetorically (3 cr.) Writing Rhet. w Sources (3 cr.)
Academic Strategies (1 cr.)
Score 3 or SAT-V 500 Score 4 or SAT-V 600
195 students (14.4%) 1,082 students (75.3%) 150 students (10.4%)
Essay is rhetorical in nature — students must construct an argument based on
≈ 1 page of evidence. Beginning 2012, some evidence is quantitative.
Significant differences in math skill vs. writing placement
0	
   20	
   40	
   60	
   80	
   100	
   120	
   140	
  
TENGL	
  
ENGL101	
  
ENGL102	
  
Accuplacer	
  Elementary	
  Algebra	
  Score	
  
200	
   300	
   400	
   500	
   600	
   700	
   800	
  
TENGL	
  
ENGL101	
  
ENGL102	
  
SAT-­‐Mathema3cs	
  Score	
  
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
The Road Ahead: Assessing Responses for Extent & Quality
Need to re-assess writing samples (n = 120) for QR extent and quality.
Modified QuIRK rubric Two scorers per sample Sum of scores
Relevance Extent of Use Quality of Use
None No potential use of
numbers, or misc. use only
1 No explicit numbers/QR used 1 Misses opportunity for QR
completely, even for back-
ground/context
Peripheral Potential
uses of numbers to
provide useful de-
tail/background/reference
2 1–2 instances of explicit numeri-
cal evidence / QR
2 Uses numerical evidence incon-
sistently or non-contextually
Central Potential uses of
numbers to address central
theme
3 Explicit QR used throughout ar-
gument
3 Uses numerical evidence consis-
tently and in context, but some op-
portunities are missed
4 Uses numerical evidence
throughout, effectively, insightfully,
and thoroughly
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Ways of “Closing the Loop” with this Study
If QR engagement (extent) is ⊕ correlated with writing placement
QR/writing workshops with high school partners could reduce developmental
writing placements & forward-place more students into ENGL 102
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Ways of “Closing the Loop” with this Study
If QR engagement (extent) is ⊕ correlated with writing placement
QR/writing workshops with high school partners could reduce developmental
writing placements & forward-place more students into ENGL 102
If extent & quality varies significantly across student characteristics
Correlate longitudinally with extent & quality at capstone to look for “value
added”; offer focused faculty development for instructors of student groups
who are least engaged/successful
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Ways of “Closing the Loop” with this Study
If QR engagement (extent) is ⊕ correlated with writing placement
QR/writing workshops with high school partners could reduce developmental
writing placements & forward-place more students into ENGL 102
If extent & quality varies significantly across student characteristics
Correlate longitudinally with extent & quality at capstone to look for “value
added”; offer focused faculty development for instructors of student groups
who are least engaged/successful
If extent & quality is ⊕ correlated with 1st-2nd year retention
(Controlling for other known predictors of retention) Targeted interventions,
esp. in first-year writing courses, to increase QR engagement could have
positive retention benefits
How
“Quantitatively
Inclined” are
Incoming
Freshmen?
Matt Salomone
The Motivation
QR & Verbal Skills
Context @ BSU
Writing Placement
Assessment Ahead
Ways of “Closing the Loop” with this Study
If QR engagement (extent) is ⊕ correlated with writing placement
QR/writing workshops with high school partners could reduce developmental
writing placements & forward-place more students into ENGL 102
If extent & quality varies significantly across student characteristics
Correlate longitudinally with extent & quality at capstone to look for “value
added”; offer focused faculty development for instructors of student groups
who are least engaged/successful
If extent & quality is ⊕ correlated with 1st-2nd year retention
(Controlling for other known predictors of retention) Targeted interventions,
esp. in first-year writing courses, to increase QR engagement could have
positive retention benefits
We hope to have initial results by the end of summer & will be happy to share!

More Related Content

Recently uploaded

How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSCeline George
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxheathfieldcps1
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701bronxfugly43
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfPoh-Sun Goh
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
Dyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptxDyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptxcallscotland1987
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17Celine George
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docxPoojaSen20
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxDenish Jangid
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsMebane Rash
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptxMaritesTamaniVerdade
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentationcamerronhm
 

Recently uploaded (20)

How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Dyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptxDyslexia AI Workshop for Slideshare.pptx
Dyslexia AI Workshop for Slideshare.pptx
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 

Featured

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 

Featured (20)

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 

How “Quantitatively Inclined” are Incoming College Freshmen? by Dr. Matthew Salomone

  • 1. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead How “Quantitatively Inclined” are Incoming Freshmen? Northeast Consortium for Quantitative Literacy XVIII Yale University — May 9, 2015 Matt Salomone Assistant Professor, Mathematics Department Director, Math Services Coordinator, Quantity Across the Curriculum Bridgewater State University Bridgewater, MA 023251 1This work is supported by a Summer Grant from the Center for the Advancement of Research and Scholarship at BSU.
  • 2. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead
  • 3. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Do Freshmen “Want to Do the Dishes?”
  • 4. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Do Freshmen “Want to Do the Dishes?” How “Quantitatively Inclined” are Incoming Freshmen? To what extent does a quantitative habit of mind exist among incoming freshman students? Use their extemporaneous persuasive writing to correlate: 1 Engagement & success with quant evidence vs. Student characteristics 2 vs. Writing readiness score 3 vs. Retention into second year
  • 5. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Do Freshmen “Want to Do the Dishes?” How “Quantitatively Inclined” are Incoming Freshmen? To what extent does a quantitative habit of mind exist among incoming freshman students? Use their extemporaneous persuasive writing to correlate: 1 Engagement & success with quant evidence vs. Student characteristics 2 vs. Writing readiness score 3 vs. Retention into second year Frame & Features of Assessment 1 Holistic scoring for extent & quality of QR (Modified QuIRK) 2 “State of nature” measurement (Not a “QR task”) 3 Potential new proxies for early math/QR course success?
  • 6. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Verbal Skill = Key Enabler of Quantitative Reasoning Reading Comprehension High cognitive reading load impairs QR success (Gillmor et al. 2015) Unusually high-quality attention required to avoid bias (Kahneman 2011) Basic logical/statistical vocabulary often missing (Bennett, NNN list)
  • 7. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Verbal Skill = Key Enabler of Quantitative Reasoning Reading Comprehension High cognitive reading load impairs QR success (Gillmor et al. 2015) Unusually high-quality attention required to avoid bias (Kahneman 2011) Basic logical/statistical vocabulary often missing (Bennett, NNN list) Writing Fluency Writing at core of many QR assessment rubrics (LEAP &c.) Difficulty expressing simple Q ideas with precision (Schield 2008) Students frequently miss opportunities to use QR (Miller 2004, Rutz & Grawe 2009)
  • 8. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Verbal Skill = Key Enabler of Quantitative Reasoning Reading Comprehension High cognitive reading load impairs QR success (Gillmor et al. 2015) Unusually high-quality attention required to avoid bias (Kahneman 2011) Basic logical/statistical vocabulary often missing (Bennett, NNN list) Writing Fluency Writing at core of many QR assessment rubrics (LEAP &c.) Difficulty expressing simple Q ideas with precision (Schield 2008) Students frequently miss opportunities to use QR (Miller 2004, Rutz & Grawe 2009) Key idea: It is never enough to assess only computational skill — QR always involves a trade of information both out of a context (reading) and back into a context (writing).
  • 9. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Facts on the Ground at Bridgewater State University BSU is a comprehensive, Masters-large university focused on undergraduate education and with a heritage as a teacher-preparatory normal school. By the numbers ≈ 8500 undergraduates 60% female 60% are one or more: 1 Of color (15%) 2 1st generation (50%) 3 Pell eligible (25%) Hum/SS   47%   Educa.on   27%   Business   15%   Sci/Math   11%   Freshman Class of 2013 N = 1436 Average SAT-Math: 501 Average Elem. Alg.: 78.5 Average SAT-Verb: 492 Average Read. Comp.: 85.5 Developmental math: 35.2% Developmental writing: 14.4%
  • 10. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Writing Placement – Process & Prompt Locally developed exam feeds: (60 minutes) ENGL 101 + ENGL 144 ENGL 101 ENGL 102 Writing Rhetorically (3 cr.) Writing Rhetorically (3 cr.) Writing Rhet. w Sources (3 cr.) Academic Strategies (1 cr.) Score 3 or SAT-V 500 Score 4 or SAT-V 600 195 students (14.4%) 1,082 students (75.3%) 150 students (10.4%)
  • 11. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Writing Placement – Process & Prompt Locally developed exam feeds: (60 minutes) ENGL 101 + ENGL 144 ENGL 101 ENGL 102 Writing Rhetorically (3 cr.) Writing Rhetorically (3 cr.) Writing Rhet. w Sources (3 cr.) Academic Strategies (1 cr.) Score 3 or SAT-V 500 Score 4 or SAT-V 600 195 students (14.4%) 1,082 students (75.3%) 150 students (10.4%) Essay is rhetorical in nature — students must construct an argument based on ≈ 1 page of evidence. Beginning 2012, some evidence is quantitative.
  • 12. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Writing Placement – Process & Prompt Locally developed exam feeds: (60 minutes) ENGL 101 + ENGL 144 ENGL 101 ENGL 102 Writing Rhetorically (3 cr.) Writing Rhetorically (3 cr.) Writing Rhet. w Sources (3 cr.) Academic Strategies (1 cr.) Score 3 or SAT-V 500 Score 4 or SAT-V 600 195 students (14.4%) 1,082 students (75.3%) 150 students (10.4%) Essay is rhetorical in nature — students must construct an argument based on ≈ 1 page of evidence. Beginning 2012, some evidence is quantitative. Significant differences in math skill vs. writing placement 0   20   40   60   80   100   120   140   TENGL   ENGL101   ENGL102   Accuplacer  Elementary  Algebra  Score   200   300   400   500   600   700   800   TENGL   ENGL101   ENGL102   SAT-­‐Mathema3cs  Score  
  • 13. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead The Road Ahead: Assessing Responses for Extent & Quality Need to re-assess writing samples (n = 120) for QR extent and quality. Modified QuIRK rubric Two scorers per sample Sum of scores Relevance Extent of Use Quality of Use None No potential use of numbers, or misc. use only 1 No explicit numbers/QR used 1 Misses opportunity for QR completely, even for back- ground/context Peripheral Potential uses of numbers to provide useful de- tail/background/reference 2 1–2 instances of explicit numeri- cal evidence / QR 2 Uses numerical evidence incon- sistently or non-contextually Central Potential uses of numbers to address central theme 3 Explicit QR used throughout ar- gument 3 Uses numerical evidence consis- tently and in context, but some op- portunities are missed 4 Uses numerical evidence throughout, effectively, insightfully, and thoroughly
  • 14. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Ways of “Closing the Loop” with this Study If QR engagement (extent) is ⊕ correlated with writing placement QR/writing workshops with high school partners could reduce developmental writing placements & forward-place more students into ENGL 102
  • 15. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Ways of “Closing the Loop” with this Study If QR engagement (extent) is ⊕ correlated with writing placement QR/writing workshops with high school partners could reduce developmental writing placements & forward-place more students into ENGL 102 If extent & quality varies significantly across student characteristics Correlate longitudinally with extent & quality at capstone to look for “value added”; offer focused faculty development for instructors of student groups who are least engaged/successful
  • 16. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Ways of “Closing the Loop” with this Study If QR engagement (extent) is ⊕ correlated with writing placement QR/writing workshops with high school partners could reduce developmental writing placements & forward-place more students into ENGL 102 If extent & quality varies significantly across student characteristics Correlate longitudinally with extent & quality at capstone to look for “value added”; offer focused faculty development for instructors of student groups who are least engaged/successful If extent & quality is ⊕ correlated with 1st-2nd year retention (Controlling for other known predictors of retention) Targeted interventions, esp. in first-year writing courses, to increase QR engagement could have positive retention benefits
  • 17. How “Quantitatively Inclined” are Incoming Freshmen? Matt Salomone The Motivation QR & Verbal Skills Context @ BSU Writing Placement Assessment Ahead Ways of “Closing the Loop” with this Study If QR engagement (extent) is ⊕ correlated with writing placement QR/writing workshops with high school partners could reduce developmental writing placements & forward-place more students into ENGL 102 If extent & quality varies significantly across student characteristics Correlate longitudinally with extent & quality at capstone to look for “value added”; offer focused faculty development for instructors of student groups who are least engaged/successful If extent & quality is ⊕ correlated with 1st-2nd year retention (Controlling for other known predictors of retention) Targeted interventions, esp. in first-year writing courses, to increase QR engagement could have positive retention benefits We hope to have initial results by the end of summer & will be happy to share!