Presentation given April 2014 in Chicago for advancement officers of NCSSSMST schools. Outlining study findings as well as strategies for using institutional data to promote advancement activities.
1. THE NSF STEM SCHOOL
STUDY: FINDINGS AND
LOCALIZED STRATEGIES
Christopher Kolar
Director of Institutional Research and Effectiveness
2. Why Study Selective Science High Schools?
Advanced students are not being sufficiently challenged in many of
today’s high schools and SMT schools offer one way to meet their
educational needs.
Recognition that some students complete middle school with strong
interests, skills, and knowledge in science and mathematics, and
aspire to high level careers in STEM.
Curricular and environmental components of SMT schools that
appear to predict completion of STEM degrees might be adapted
more widely.
3. What Do We Know from the Literature on STEM
Talent Development
Challenging curriculum
Expert instruction
Peer stimulation
Apprenticeship/role models
Appreciation of the utility and value of STEM disciplines
Persistence in the “science pipeline”
To what degree do these factors exist in SMT high schools?
4. Study Research Goals
Overarching Research Question: What is the impact of participation in
a selective science high school (SMT) or Talent Search program on
completion of a STEM major in university.
Sub-research question 1: What characteristics of (a) the SMT
school/TS or (b) the participants contribute to this outcome?
Sub-research question 2: Do these characteristics differentially affect
male and female graduates? Those whose parents are not college
graduates? Those whose parents are not in STEM related careers?
5. School Model Descriptions
Residential: Draws from an entire state. All students reside on campus.
(n=8)
Half-Time: Students attend a regional center for SMT courses daily.
(n=7)
Full-Time Commuter: Whole school is SMT and draws from local
metropolitan population. (n=4)
School-within-School: An academy within a regular high school. (n=6)
No meaningful differences were found among school models in predicting
outcomes.
6. Participants
2004-2007 graduates of 25 selective SMT schools N=3,510
Comparison group of same age peers who attended Talent Search
and enrolled in mathematics or science classes in the summer: N=
603
BA+ HS-
SMT 2,703 SMT 546
TS 534 TS 13
Males Females
SMT 1,579 SMT 1,797
TS 257 TS 319
7. Completion of a STEM Degree
49.8% percent of specialized SMT high school
graduates completed a STEM undergraduate degree.
School w School: 58.3%
Residential: 51.7%
Half-Day: 48.4%
Full-Time Commuter: 42.3%
53.4% percent of comparison group completed a
STEM undergraduate degree.
According to the National Science Foundation, 22.6%
of students entering college graduate with a STEM
undergraduate degree.
9. What is associated with this
intensification or growth in interest?
Emphasis on Deep
Conceptual
Understanding
Connections to Other
Content Areas
Laboratory Experiences
Hands On Experiences
Field Trips
Guest Lectures
Demonstrations
Internships
Allowed to Pursue Own
Interests
Collaboration
Pace (Too Fast, Too Slow)
Level of Teacher
Enthusiasm
Expertise of Teacher in
STEM
Awareness of Careers
Reinforce Self-Confidence
Reinforce Interest
15. 90.5% of IMSA graduates reported having a
parent that had attained a college degree
67.9% of IMSA graduates reported a parent
who worked in a field that required STEM
expertise
16. Intensification of interest while
at IMSA
29% of
graduates
reported an
intensification
of interest in
STEM while
at IMSA.
These
students were
2.5x more
likely to attain
a STEM
degree.
Faculty reinforcement of interest
increased the odds of reporting
intensification by 347%.
Faculty reinforcement of self-
confidence suppressed odds of
intensification.
Having selected intended major by
sophomore year suppressed odds
of intensification.
17. Loss of interest
If primary motivation
was “desire to be
with academically
focused peer
group”: 7.8 times
more likely
If pace too fast: 2x
Faculty engagement
in student interest: .
01 as likely
Experienced
environment as
competitive: .003 as
likely
Amplification Suppression
18. Undergraduate research
IMSA grads
who
participated in
independent
research were
2.23 times
more likely to
engage in
undergraduate
research.
50% of graduates reported
participation in undergraduate
research.
Undergraduate research boosts
STEM attainment odds by 3.9x
Mediation effect?
19. This material is based upon work supported by the
National Science Foundation under
Grant #0815421
20. Some presentation materials provided by:
Rena Subotnik American Psychological
Association
John Almarode James Madison
University
Editor's Notes
Study on Women and Mathematics by Titu Andreescu, Joseph A. Gallian, Jonathan M. Kane, and Janet E. Mertz in Notices of the American Mathematical Society
Disproportionate # of US women who won Olympiads and Putnam Competition went to Specialized SMT schools
Idea came from Joshua Lederberg and the study is being conducted in honor of him.
Bio and Biomed defined as Biology and Health Sciences
Phy Science defined as Physics and Chemistry
These percents represent the following: of the total number of females reporting that they completed a degree, XX% of them reported degrees in the above areas. For example, of those female respondents that reported a major or concentration, 9.3% (SMT) and 10.0% (TS) of them were in the physical sciences.
This is where I need to talk about how everyone wants to know if we “won.” Our internal audience is very interested in school to school comparative data. The most important data is actually looking within our graduates for differential loadings of experiences on outcomes – though even at this granular level we can see that our numbers are slightly higher than the means across all groups.
This is a critical connection to the other study participants. Like the other high potential students, they had a notable level of parental education. In addition, a very high proportion of participants reported having a parent in a STEM fields. I will note here, in the version of the PowerPoint for slideshare, that I could find no record of any female students withdrawing from IMSA if their mother had a graduate degree. That is bonus material for reading this far.
It looks like there is a class of students whose interests are not over-determined and that benefit from faculty engagement of their emerging interests. While we look for students during the admission process who show a strong commitment to a STEM outcomes, one of the important “effects” or our program may be activation of latent potential in students who do not have a clear plan for what a STEM career would look like.
83% of the students reporting peer group as their primary motivation for attending reported losing interest in STEM during their time in the program. This could be part of a big fish, little pond effect. Note that this is 14% of our respondents. These are graduates, this is not the drop out rate.
We need to take a longer look at the competitive aspect as a suppressing factor.
With the rise of undergraduate research experiences being built into many STEM programs, we felt it would be worthwhile to see whether high school research experiences had a carryover effect on student engagement in undergraduate research programs. Research indicates that undergraduate research strongly influences STEM degree and career outcomes, so it is possible to view our high school program as part of a pipeline as opposed to looking for a direct influence on degree outcomes. The next stages of analysis will include looking for mediated and indirect effects in both the IMSA data as well as in the complete study dataset.