Table 2 Instrument key features (part 1)
From: Describing undergraduate STEM teaching practices: a comparison of instructor self-report instruments
Instrument | Intended population | Number of items and time to completion | Reliability and validity |
|---|---|---|---|
Approaches to Teaching Inventory (ATI) (Trigwell & Prosser 2004)a | Postsecondary faculty | 9 teaching practice items 16 total items No time to complete given | ● Two pilots ● Categories of teaching approaches based on interviews with 24 science teachers ● Principal component analysis with varimax rotation (16 items, 2 sub-scales) ● Confirmatory factor analysis |
Borrego Engineering Faculty Survey (BEFS) (Borrego et al. 2013) | Engineering faculty members teaching engineering science courses | 27 teaching practice items No total number of items given No time to complete given | ● Based on previously developed survey ● Research-based instructional strategies (RBIS) and critical components of research-based instructional strategies based on expert literature review ● Reliability α = 0.921 (internal consistency) |
Faculty Survey of Student Engagement (CPRIU 2012) | Postsecondary faculty in the US | 23 teaching practice items 130 total items 15–20 min | ● 2013 version refined based on user feedback ● Exploratory and confirmatory factor analysis (9 constructs) |
Henderson & Dancy Physics Faculty Survey (HDPFS) (Henderson & Dancy 2009) | Physics faculty teaching introductory quantitative physics courses | 40 teaching practice items 61 total items No time to complete given | ● RBIS and critical components of research-based instructional strategies based on expert literature review ● Developed in consultation with experts at the American Institute of Physics Statistical Research Center |
Higher Education Research Institute Faculty Survey (HERI) (Hurtado et al. 2012) | Postsecondary faculty in the US | 35 teaching practice items 284 total items 25 min | ● Item pools created based on literature ● Exploratory factor analysis (11 constructs) |
National Study of Postsecondary Faculty (NCES 2004) | Postsecondary faculty in the US | 10 teaching practice items 83 total items 30 min | ● Based on the 1999 version ● Revised based on comments from project Technical Review Panel, previous respondents, government officials, and postsecondary researchers ● Revised instrument was then field tested |
On the Cutting Edge Survey (OCES) (Macdonald et al. 2005) | Geosciences faculty teaching undergraduate geoscience courses | 29 teaching practice items 46 total items No time to complete given | ● Based on a previous biology faculty instrument (First II) and Using Data in the Classroom (Manduca & Mogk, 2002) ● Piloted with 16 faculty at an American Geophysical Union meeting |
Postsecondary Instructional Practices Survey (PIPS) (Walter et al. 2014) | All postsecondary instructors | 24 teaching practice items 33 total items 10 min | ● Initial items based on the literature ● Reviewed by 4 educational researchers ● Pilot tested with 827 instructors ● Exploratory and confirmatory factor analysis (2 and 5 factor solutions) |
STEP Survey (Marbach-Ad et al. 2012) | Chemistry and biology faculty, graduate teaching assistants, and undergraduates | 30 teaching practice items 86 total items No time to complete given | ● Initial items based on the literature ● Pilot testing and review by experts from the sciences, education, and psychology |
Statistics Teaching Inventory (STI) (Zieffler et al. 2012) | Statistics faculty across disciplines and institutions | 21 teaching practice items 50 total items No time to complete given | ● Initial items based on the curriculum Guidelines for Assessment and Instruction in Statistics Education ● Piloted with members of the statistics education community ● Revised instrument was used for think aloud interviews (reliability) ● Another small-scale pilot was done with local statistics educators |
SUCCEED Survey (Brawner et al. 2002) | Engineering faculty at eight US universities | 12 teaching practice items 67 total items No time to complete given | ● Initial items based on the literature ● Piloted by project leadership team |
Teaching Practices Inventory (TPI) (Wieman & Gilbert 2014) | Postsecondary science and math instructors | 60 teaching practice items 72 total items 13 min | ● Initial items developed based on authors’ experience and previous teaching practice rubric ● Two pilot tests with 150 and 179 instructors ● Multiple rounds of expert review ● Scoring procedure based on the literature |