The Office of Assessment & Institutional Research at NYU Tandon School of Engineering provides objective research and analysis to support decision making, planning, evaluation, and performance improvement. It is led by Director Michael Mainiero and Associate Director Edwing Medina. The office conducts institutional research like data reporting, surveys, and supports accreditation and rankings. It aims to serve the NYU Tandon community through comprehensive and collaborative work.
A Critique of the Proposed National Education Policy Reform
Tandon AIR
1. Office of Assessment &
Institutional Research
Office of
Assessment
&
Institutional
Research
May 2020
2. Office of Assessment &
Institutional Research
WHO ARE WE?
May 2020 2
MICHAEL MAINIERO, Director EDWING MEDINA, Associate Director
• Institutional Research
Lead
• 25+ Years at Poly/NYU
• Former Registrar
• Ed.M., Information
Systems Design and
Organizational
Analysis, Boston
University
• Assessment Lead &
Accreditation Liaison
• Since March 2019
• Previously at Univ. of
Miami, CUNY/City
College, NYC Dept. of
Education, & St. Thomas
University
• Ph.D., STEM Education,
University of Miami
Office: (646) 997-3060 / e-mail: mmainier@nyu.edu Office: (646) 997-3152 / e-mail: Edwing.Medina@nyu.edu
GRADUATE ASSISTANTS
ABHISHEK GUPTA (’19 – ’21) MACLEEN PEREIRA (’19 – ’21)
• M.S., Management of
Technology (2019 –
2021), New York
University
• B.E., Bachelor of
Engineering (2011 –
2015), PEC University of
Technology
• M.S., Management of
Technology (2019 –
2021), New York
University
• B.E., Bachelor of
Engineering (2013 -
2017), University of
Mumbai
3. Office of Assessment &
Institutional Research
WHAT WE DO
3
The core function of AIR is to serve the NYU Tandon
community (students, faculty, and staff) by
providing:
• objective,
• research-based information, and
• analysis
to support:
• decision-making,
• planning,
• evaluation, and
• performance improvement.
May 2020
4. Office of Assessment &
Institutional Research
4
INSTITUTIONAL RESEARCH – EXTERNAL DATA REPORTING (Annual)
• Best Graduate Engineering Schools
• Best Online Programs
• College Profile
• Faculty Salary Survey
• Undergraduate Engineering Retention & Diversity
• Engineering Data Management System
• Annual Data Exchange Reports
• Graduate Enrollment and Degrees
• International Graduate Admissions
• Graduate Programs (in collaboration with NYU IR)
• NOTE: NCES’ IPEDS (Integrated Postsecondary Education Data System) and U.S. News & World Report’s “Best Colleges”
data collection conducted by NYU IR
May 2020
5. Office of Assessment &
Institutional Research
5
INSTITUTIONAL RESEARCH – INTERNAL DATA REPORTING
• Periodic or ad hoc
• Particular time-frames
as of non-Census date;
Historical (over multiple semesters or
Academic Years)
Comparison of particular semesters or
Academic Years
pre- vs. post-Poly/NYU merger
• Unique combination of criteria
gender;
Ethnicity (including International);
citizenship;
New vs. Continuing students;
Cohort vs. all currently enrolled;
by Academic Program vs. Department
Engineering vs. non-Engineering;
discrete degree levels (Bachelors vs.
Masters vs. Ph.D.)
Tenured/Tenure-Track vs. non-Tenured
Online vs. On-Campus (Student vs.
Academic Program)
* NOTE: Due to limited access to row-level data, the Tandon AIR office generally must collaborate with
Admissions, Wasserman, and HR for Undergraduate applicants & admits and financial aid, career and
post-graduation “Life Beyond the Square”, and atypical faculty and staff data requests, respectively.May 2020
6. Office of Assessment &
Institutional Research
5/18/20 6
ASSESSMENT & INSTITUTIONAL RESEARCH – ACCREDITATION (Program & School)
• 5 Brooklyn BS Engineering programs (Chemical & Biomolecular; Civil;
Computer; Electrical; Mechanical)
• 6-Year Reaccreditation Cycle
• Next Reaccreditation (‘20-’21) Visit: Oct. 25-28, 2020
• Work with Dr. Richard Thorsen (MAE Chair & VP Emeritus)
• AIR Support: Data; Public Disclosures; Intra-/Inter-Narrative Consistency;
Logistics; Alignment of Student Outcomes to Program Education
Objectives; Ancillary support of sister Abu Dhabi programs
• NYU Office of Academic Program Review and Assessment (OAPRA)
• Conducts and Provides Feedback on the annual Academic Program
Assessment Review
• Tandon Academic Reports due from programs annually: July/August
• OAPRA feedback to annual reports (to incorporate into following year’s
report) received: March/April
• Work with Diana Leilani Karafin (Ph.D., Associate Vice Provost) and Dr.
Richard Thorsen (MAE Chair & VP Emeritus)
• All NYU (and, therefore, Tandon) Academic Programs, Administrative
Offices, and Policies & Procedures
• 10-Year Reaffirmation Cycle
• Next Mid-Point Peer Review (handled by NYU IR): 2020
• Next Reaffirmation Cycle: 2023-2024
• Work with Dr. Richard Thorsen (MAE Chair & VP Emeritus)
• AIR Support: Data on behalf of Tandon; Intra-/Inter-Narrative
Consistency; Logistics; Annual Academic Program Assessment Review
(for/with OAPRA)
7. Office of Assessment &
Institutional Research
7
ASSESSMENT & INSTITUTIONAL RESEARCH – TANDON RANKINGS SUPPORT
•Best Engineering Schools
•Engineering School Specialty
Rankings
•Best Online Graduate
Engineering Programs
•QS World University Rankings
by Subject
• NOTE: NYU Rankings (such as U.S. News & World Report’s “Best Colleges”, Times Higher Education “World University
Rankings”, Kaplan, Princeton Review, etc.) support provided by NYU IR.
May 2020
8. Office of Assessment &
Institutional Research
8
INSTITUTIONAL RESEARCH – DATA SOURCES & ANALYTICAL SOFTWARE
May 2020
9. Office of Assessment &
Institutional Research
9
HISTORICAL TANDON CENSUS DATA
https://engineering.nyu.edu/about/assessment-and-institutional-research
Census Date: One week after
“Last day to add/drop NYU courses.”
May 2020
10. Office of Assessment &
Institutional Research
5/18/20 10
COURSE EVALUATIONS (1 of 2)
https://www.nyu.edu/students/student-information-and-resources/registration-records-and-graduation/registration/course-evaluation/student-guides.html
EVERY SEMESTER:
• Liaise between NYU Tandon Academic Departments & NYU Registrar to Modify/Verify
Course-Specific Evaluation questions for up to 1,000 sections;
• Modify/Verify Course Evaluation instruction e-mails to Students and Faculty;
• Set Course Evaluations Start & End Dates (Typically 3 weeks; ends before Final Exams
begin);
• Field/Troubleshoot Faculty’s & Students’ questions during Course Evaluations Period;
• Communicate “3/5 Rule” to all constituents:
Courses with <5 Enrolled Students or <3 Students’ Responses = NOT Reported to
Faculty;
intended to protect student anonymity;
provides some level of validity/reliability.
• Compile/Disseminate/Archive Departmental Summaries of Department’s Individual
Faculty Course Evaluations & Departmental Summary Statistics from Albert & UDW+;
• About to launch Tableau-based Tandon Historical Course Evaluations Dashboard to
complement and expedite the Course Evaluations results currently available to students
and faculty via Albert;
• Debrief each Course Evaluations cycle with NYU-wide, 50+ member “Course
Evaluations User Group”
11. Office of Assessment &
Institutional Research
5/18/20 11
COURSE EVALUATIONS (2 of 2)
https://engineering.nyu.edu/about/assessment-and-institutional-research/course-evaluation-results
• YOU MUST BE ON VPN (Cisco AnyConnect
Secure Mobility Client), if off-campus)
• Select the " Sign in to NYU Tableau Server-QA"
Button
• Secured access by Tandon community (students,
faculty, staff) currently being finalized.
• Already available to department chairs and
relevant Tandon Leadership (with exclusive
access to all Open-Ended comments)
12. Office of Assessment &
Institutional Research
12
OTHER TANDON SURVEYS
Survey Target Audience Topics Surveyed Frequency
Exit /
Graduating
Students*
All Spring, (prior) Fall, &
(prior) Summer degree-
completers
Academic Experiences; Advisement; ABET Student Outcomes; Extracurriculars;
Interactions with Others; Start Over, Recommend, and Proud of?
Annually
(ideally in 2 phases: Feb./ March
for Fall & Summer graduates;
June/July for Spring graduates)
Alumni*
-1, -5, -10, -15, and -20 Year
Alumni from Polytech /
Tandon
(i.e., 2020 Survey Year =
‘19, ‘15, ‘10, ‘05, ‘00 Alumni)
Employment; Job Function; Importance of Skills & Abilities (Importance at work;
Polytech/Tandon Preparation); ABET Student Outcomes & Program Educational
Objectives (at work; Polytech/Tandon Preparation); Hire of other Alumni?;
Participation in Alumni Activities; post-Polytech/Tandon academics; Start Over,
and Recommend?
Annually
(June - August)
SESS: Student
Engagement &
Satisfaction
All enrolled Tandon students
A myriad of Tandon and NYU personnel, offices, resources, policies/practices (i.e.,
Jasper Kane and other Dining Services, Public Safety; both Career Services; Dibner
and other Libraries; Residence Life; Academic Advisement; Tutoring; StudentLink;
Admissions; Registrar; Financial Aid; Technology; etc.)
Annually
(ideally in 4 phases:
2 in the Fall; 2 in the Spring)
FESS: Faculty
Engagement &
Satisfaction
All tenured and tenure-track,
and Full-time Contract
Tandon faculty
Nature of Work; Research; Academics/Teaching; Service; Facilities & Work
Resources; Interdisciplinary Work & Collaboration; Faculty Mentoring; Promotion;
NYU, Tandon, & Department Leadership; Shared Governance; Departmental
Collegiality, Quality, & Engagement; Appreciation & Recognition; Best/Worst
aspects; Employment Negotiations; Staying at/Leaving NYU
Annually
(proposed ‘20-’21)
AFESS: Adjunct
Faculty
Engagement &
Satisfaction
All Tandon Adjunct faculty
Nature of Work; Academics/Teaching; Service; Facilities & Work Resources;
Interdisciplinary Work & Collaboration; Faculty Mentoring; Tandon, & Department
Leadership; Shared Governance; Departmental Collegiality, Quality, &
Engagement; Appreciation & Recognition; Best/Worst aspects
Annually
(proposed ‘20-’21)
Staff
Engagement &
Satisfaction
All full-time Tandon staff,
administrators, etc.
Overall satisfaction; Organization leadership; Organization culture &
communication; Diversity & multiculturalism; Teamwork; Relationship with
supervisor; Relationship with peers; Job passion and self-evaluation; Training &
Development; Feedback; Work/Life balance; Fairness at Work; Policies; Facilities &
Resources
Annually
(proposed ‘20-’21)
* Including academic department-specific, ad hoc surveys
May 2020
13. Office of Assessment &
Institutional Research
13
DATA GOVERNANCE (Data Reporting and Access Protocols & Business Glossary)
•Communicate relevant administrative data management policies, as well as the
requirements of the Family Educational Rights and Privacy Act of 1974 (FERPA).
•Work with NYU Data Governance to make any necessary Data Definition
updates to the NYU Business Glossary (https://nyu.service-now.com/servicelink/glossary_search_results.do)
•Work with NYU IR to develop “Data Request Roadmap” (designating the
Reporting Authority based on the Domain, Scope, Ultimate Audience, and
Sample Questions)
•Work with Decision Support Group (DSG) to coordinate UDW+ Course
Evaluations reporting access and training
•Maintain Tandon’s Data Dictionary as a supplement to NYU Business Glossary,
including
“Degrees & Certificates” (including Academic Plan, CIP and HEGIS codes)
“Subjects (by Degree Level)” (including Departmental affiliation(s))
May 2020
14. Office of Assessment &
Institutional Research
14
NYU-WIDE & TANDON COMMITTEE PARTICIPATION – Assessment
Committee AIR Liaison Lead / Chair(s) Committee Objectives Frequency
NYU Course
Evaluation User
Group
Mike Mainiero;
Edwing Medina
David Treimanis
[Registration Specialist,
NYU Office of the
Registrar]
• Recommends and Prioritizes Course Evaluations reporting, data
collection, and scheduling enhancements and protocols
• Debrief on Course Evaluation Response Rates and best practices to
maximize these
• Works to reconcile Albert and UDW+ Course Evaluations Reporting
features and troubleshooting discrepancies
Each Semester
(~ 3 - 4 x
per year)
NYU Academic
Assessment
Council
Mike Mainiero
(and Richard
Thorsen)
Cybele Raver
[Deputy Provost] &
Diana L. Karafin
[Assoc. Vice Provost]
• Creates innovative assessment strategies,
• Monitors compliance with university and accreditation assessment
policies,
• Shares success stories and assessment-related challenges,
• Develops meaningful practices to improve student learning across
NYU programs and units.
Each Semester
(~ 2 - 3 x
per year)
NYU Course
Evaluations
Committee
Edwing Medina
Gigi Dopico [Vice Provost
for Undergraduate Academic
Affairs and for the Humanities] &
J. Ryan Poynter [Associate
Vice Provost for Undergraduate
Academic Affairs]
• Reduce bias in student responses to course evaluations
• Maximize the usefulness of course evaluations for improving
teaching and learning
Monthly
(alternating
between Main and
Sub-Committee
meetings)
NYU Survey
Committee
Edwing Medina
Emily Schlam [Senior
Director, NYU Student
Success]
• Review and evaluate the landscape, current data collected, and
administrative cycles for surveys across the University.
• Recommend best practices for conducting surveys and the
appropriate sharing of survey data.
• Review and recommend any supplementary survey questions for
the spring 2020 administration of YFCY (Your First College Year) &
CSS (College Senior Survey).
Monthly
(alternating
between Main and
Sub-Committee
meetings)
Tandon ABET /
Assessment
Committee
Mike Mainiero;
Edwing Medina
Richard Thorsen
(Mechanical and
Aerospace Engineering
Department Chair; Vice
President Emeritus)
• Coordinate Tandon’s ABET Reaccreditation requirements and Self-
Study reports
• Recommends and Prioritizes Tandon’s Assessment-related and
Course Evaluations reporting, data collection, and scheduling
enhancements, protocols, and troubleshooting
Monthly
May 2020
15. Office of Assessment &
Institutional Research
15
NYU-WIDE COMMITTEE PARTICIPATION – Institutional Research +
Committee AIR Liaison Lead / Chair(s) Committee Objectives Frequency
NYU Student
Data Operating
Committee
Mike Mainiero;
Edwing Medina
Addis Crooks-Jones
[Associate Director,
University Data
Warehouse]
• Recommends new UDW+
enhancements
• Prioritizes UDW+ enhancements & fixes
for future releases
• Advises UDW+ Leadership on Student
Reporting roadmap
Each
Semester
(~ 3 - 4 x
per year)
NYU SIS School
Advisory
Committee
Mike Mainiero
(and Wanda
Green)
Beth Kienle-Granzo
[University Registrar]
• Recommends and Prioritizes Albert
Student Information System & Registrar
reporting, data collection, and
scheduling enhancements, protocols,
and troubleshooting
Periodically
NYU AMC
(Administrative
Management
Council)
Mike Mainiero
Cassandra Bizzaro
[NYU AMC
Chairperson]
• Initiates, deliberates, and responds to
the issues and concerns of its
constituents and the University
community.
• Promotes the professional growth and
development of NYU administrators,
and
• Deep commitment to community
service.
Monthly
May 2020
16. Office of Assessment &
Institutional Research
THANK YOU! QUESTIONS?
16
MICHAEL MAINIERO,
Director
EDWING MEDINA,
Associate Director
• Institutional
Research Lead
• 25+ Years at
Poly/NYU
• Former Registrar
• Also: Executive
Director, Academic
Administrative
Services
• Assessment Lead &
Accreditation Liaison
• Since March 2019
• Previously at Univ. of
Miami, CUNY/City
College, NYC Dept. of
Education, & St.
Thomas Univ.
• Ph.D., STEM Education
Office: (646) 997-3060 /
e-mail: mmainier@nyu.edu
Office: (646) 997-3152 /
e-mail: Edwing.Medina@nyu.edu
May 2020