Skip to main content

A model for examining middle school students’ STEM integration behavior in a national technology competition

Abstract

Background

Research on teaching and learning for science, technology, engineering, and mathematics (STEM) subjects has increased, and has demonstrated the importance of integrating interdisciplinary knowledge and skills. Our research model was based on the theory of planned behavior (TPB) and the data were analyzed by partial least squares-structural equation modeling. The present study aims to identify factors that play an important role in students’ ability to integrate STEM knowledge and skills.

Results

Data were collected from participants who had won awards in local contests and represented their regions in a national technology competition. The reliability and validity of our instrument, the Students’ STEM Integration Scale, were verified. The findings demonstrated that students’ intentions to integrate STEM knowledge and skills to solve complex problems can be predicted by their attitude and perceived behavioral control.

Conclusions

This work highlights factors which are associated with students’ intentions to integrate interdisciplinary knowledge and skills, and serves as a reference for research on the gap between intentions and actual behavior. The findings could help teachers and instructors design STEM-based activities to enhance students’ attitudes, perceived behavioral control, and intentions, to improve their ability to integrate STEM knowledge and skills.

Introduction

The importance of integrating interdisciplinary knowledge and skills to solve complex problems in daily life is widely acknowledged (Bybee, 2013; Lin et al., 2021); however, the OECD (2019) reported that students who perform well in science and mathematics continue to lack confidence when confronted with undefined problems, particularly in Taiwan. The report showed that students who lack practical experience are unable to solve complex problems, even with good knowledge, owing to their lack of familiarity with approaches for integrating science, technology, engineering, and mathematics (STEM) knowledge and skills. Studies on K-12 learners and K-12 learning in STEM subjects have increased significantly in the last decade (Fan et al., 2021; Li et al., 2019; Lin et al. 2020a, 2020b). Research has indicated that students’ learning motivation is correlated with their attitudes and perceptions (Brown et al., 2016; Roberts et al., 2018; Tseng et al., 2013); therefore, it is important for teachers to understand the factors associated with students’ intentions and behavior with respect to integrating STEM knowledge and skills.

Studies focusing on students’ intentions in STEM education are typically limited to one school (Zhang et al., 2019, 2020). Although some studies have included more than one school, the lectures and activities differed (Luan et al., 2020), and studies collecting data from different schools are limited overall (Chittum et al., 2017; Miller et al., 2018). Moreover, to the best of our knowledge, no study has investigated factors that may be associated with students’ intentions and behavior with respect to integrating STEM knowledge and skills. To address the deficit in studies including students from more than two schools, and the inconsistency in teaching content between participating schools, the present study recruited students from various regions of Taiwan, who then participated in a national competition in which they could integrate their STEM knowledge and skills to solve complex problems.

The present study aims to identify the factors that play an important role in students’ intentions and behavior with respect to the integration of STEM knowledge and skills. Our research model was based on the theory of planned behavior (TPB) (Ajzen, 1991), which was deemed more appropriate than other theories due to its applicability for investigating intentions and behaviors (Cheng, 2019; Chu & Chen, 2016). The TPB model hypothesizes that attitude, subjective norm, and perceived behavioral control play important roles in behavioral intention, while perceived behavioral control and behavioral intention are also related to actual behavior. Therefore, the research model used in this study consists of five factors: attitude, subjective norm, perceived behavioral control, behavioral intention, and “STEM integration behavior” (see Table 1 for a definition of each factor).

Table 1 Definitions of the variables of interest

Attitude

Attitude refers to an individual’s evaluation (favorable or unfavorable) of a particular behavior (Ajzen, 1991). In the present study, attitude refers to students’ appraisal (positive or negative) of the application of STEM knowledge and skills to the problem-solving process. Earlier studies found attitude to be a significant predictor of students’ behavioral intentions, including to engage in e-learning (Park, 2009), use technology (Teo & Zhou, 2014), and use tablet computers in particular (Zheng & Li, 2020). Students’ attitudes toward the integration of STEM knowledge and skills are hypothesized to positively relate to their behavioral intentions toward STEM integration behavior (H1).

Subjective norm

Subjective norm refers to social pressure that relates to an individual to engage in or refrain from a given behavior (Ajzen, 1991). These social pressures usually originate from the media, family, and schools (Ajzen & Driver, 1991). Empirical research has provided evidence for a positive relationship between an individual’s subjective norm and behavioral intention, particularly in studies that attempted to investigate individuals’ intentions toward technology use (Chen et al., 2018; Watson & Rockinson-Szapkiw, 2021; Zheng & Li, 2020). However, some studies observed no such relationship (Padilla-Angulo, 2019; Zulfiqar et al., 2019). The present study defines subjective norm as social pressure exerted by important groups, such as society, parents, classmates, and the competition committee, to integrate STEM knowledge and skills. We postulate that students will exhibit strong intentions to integrate their STEM knowledge and skills in response to social pressure (H2).

Perceived behavioral control

Ajzen and Fishbein (2000) and Ajzen (1991) defined perceived behavioral control as the perceived ease or difficulty with which an individual engages in a given behavior. Perceived behavioral control can be affected by an individual’s experiences and anticipated obstacles. In the abovementioned studies, perceived behavioral control is defined as the perceived ease or difficulty with which students integrate STEM knowledge and skills to solve complex problems with limited resources. Students’ perceived behavioral control has been found to be associated with their behavioral intentions, for example to participate in Massive Online Open Courses (MOOCs) (Lung-Guang, 2019) as well as their intentions to use Mobile Web 2.0 while learning (Dalvi-Esfahani et al., 2020). Thus, we hypothesized that students’ perceived behavioral control with respect to integrating STEM knowledge and skills would positively relate to their behavioral intentions toward STEM integration (H3).

Among individuals who hold equally strong intentions to engage in a given behavior, those with greater confidence are more likely than others to persevere (Ajzen, 1991). Therefore, an individual’s perceived behavioral control can be used to predict their actual behavior (Cheng, 2019). In this study, STEM integration behavior refers to students’ self-evaluations of their success in integrating STEM knowledge and skills during the competition. We hypothesized that students’ perceived behavioral control with respect to integrating STEM knowledge and skills plays an important role in their STEM integration behavior (H4).

Behavioral intention

Behavioral intention refers to an individual’s willingness to engage in a particular behavior (Ajzen, 1991; Fishbein & Ajzen, 1975), and is usually used to predict actual behavior (Chu & Chen, 2016; Lee, 2006; Nie et al., 2020; Tosuntaş et al., 2015; Zhang et al., 2019). In the present study, behavioral intention refers to students’ willingness to integrate STEM knowledge and skills when solving complex problems, and is used to predict students’ actual STEM integration behavior. It is hypothesized that students’ behavioral intentions to integrate STEM knowledge and skills is significantly associated with STEM integration behavior (H5).

Research model and hypotheses

This study’s purpose is to identify factors related to students’ intentions and behavior with respect to integrating STEM knowledge and skills, using a research model based on the TPB (Ajzen, 1991). In addition to the TPB, the technology acceptance model (TAM) has been widely used as a basis for research on individual intention. Some studies have explored intention using the TAM, which focuses on how an individual’s perception of a particular technology influences their willingness to use it; it emphasizes the influence of the features of the technology rather than social factors on intention (Chu & Chen, 2016). Social factors, such as peer influence (Hartshorne & Ajjan, 2009) and family support (Zheng & Li, 2020), are important in students’ intentions so were considered by our research model. Cheng (2019) observed that TPB provided more comprehensive explanations than TAM, while combining the theories yielded little improvement. In summary, TPB is more powerful than TAM for exploring the influence of social factors on intention, so was used in the present study. Our research model is shown in Fig. 1; the paths therein are in accordance with the abovementioned literature.

Fig. 1
figure 1

Research model

H1

Students’ attitudes toward integrating STEM knowledge and skills are positively related to their intentions toward STEM integration behavior.

H2

Students’ subjective norms with respect to integrating STEM knowledge and skills are positively related to their intentions toward STEM integration behavior.

H3

Students’ perceived behavioral control with respect to integrating STEM knowledge and skills is positively related to their intentions toward STEM integration behavior.

H4

Students’ perceived behavioral control with respect to integrating STEM knowledge and skills plays an important role in STEM integration behavior.

H5

Students’ behavioral intentions to integrate STEM knowledge and skills are significantly associated with STEM integration behavior.

Methodology

Participants

The present study involved 92 middle school students from eight different regions of Taiwan, who participated in a national technology competition from September to December. Their demographic information is presented in Table 2. Among the participants, 75 (82%) were male and 17 (18%) were female. Regarding the grade distribution, 51 (55%) students were in Grade 8 and 41 (45%) were in Grade 9. As for the distribution of regions, 32 (35%) students came from Taipei City, 6 (7%) are from New Taipei City, 4 (4%) are from Keelung City, 22 (24%) are from Taoyuan City, 3 (3%) are from Taichung City, 5 (5%) are from Kaohsiung City, 13 (14%) are from Yilan City, and 7 (8%) came from Taitung City. The study population consisted of contestants who had won preliminary awards in local contests and represented their regions in a national technology competition. Compared with other contestants, those who win awards are usually regarded to have demonstrated more proficiency in integrating STEM knowledge and skills throughout the competition. Therefore, instead of collecting data from all contestants, analysis only of the winning contestants’ data is preferable for understanding intentions and actual behavior with respect to integrating STEM knowledge and skills. No data were collected from 7th grade students, because they were among the contest winners. As students in Grade 7 were only a few months into their technology courses when the competition was held, their understanding of how to integrate STEM knowledge and skills was likely relatively undeveloped.

Table 2 Demographic information of the participants

Procedure

The annual national technology competition included preliminary and final rounds. Preliminary rounds were held in various regions, and the winning teams were eligible to participate in the final. We collected data from the contestants who took part in the final which included students from Grades 7–9 after the whole competition was finished. In the competition, students were asked to complete the tasks independently, without any assistance from their teachers throughout the entire process.

Prior to the competition, the committee issued basic guidelines regarding the theme and rules, as well as a list of necessary materials and tools. Teachers were given time to ensure that their students were capable of solving problems during designing and making activities. To enhance students’ competence in terms of thinking, collaborating, and communicating, rather than simply presenting the designs of their teachers, the variables were slightly different in each preliminary round. Therefore, even if the students had received good instruction prior to participating in the competition, they still needed to integrate their STEM knowledge and skills, and make adjustments in accordance with the design variables that the committee announced on the day.

The competition’s theme was hydraulic systems, and the main purpose was to provide students with the opportunity to learn about the principles of hydraulics, and apply their knowledge and skills to complete the tasks. The students were asked to design two hydraulic devices, a “hydraulic arm” and a “batting device”, using syringes of various sizes (Figs. 2, 3, 4). Each session was 4 min in duration. During the sessions, the students controlled the hydraulic arm to grab balls and shot them with the batting device. The number of shots was unlimited. The target at which the balls were shot was divided into five parts, each worth a different amount of points (20, 40, 60, 80, or 100; Fig. 2). Areas closer to the center of the target were worth more points. The total points corresponded to the final score. The variables in the preliminary rounds were the ball size and positions in which they were initially placed. The students did not know the details of these variables until the day of the competition.

Fig. 2
figure 2

Schematic diagram of the national technology competition arena

Fig. 3
figure 3

Use of the hydraulic arm to grab a ball

Fig. 4
figure 4

National technology competition area

The committee guidelines included several questions prompting students to think and discuss before they began designing their own devices, such as “What kind of chuck on the hydraulic arm is able to grab balls of various sizes?” and “According to Pascal’s principle, what is the effect of using different-sized syringes? What can we achieve with the different syringes?” By addressing these questions, students were able to acquire the required knowledge and apply it to the problem-solving process. Moreover, the questions encouraged the students to integrate STEM knowledge and skills to solve complex problems when designing and making their own devices.

Study instrument

The study instrument, the Students’ STEM Integration Scale, included 30 items relating to five factors, and was based on studies by Ajzen (1991) and Ajzen and Fishbein (1980, 2000). Appendix 1 shows the items used to measure students’ attitudes, subjective norms, perceived behavioral control, behavioral intentions, and STEM integration behavior on a 7-point Likert scale (1 = strongly disagree, 7 = strongly agree). To test the reliability and validity of the Students’ STEM Integration Scale, three experts in relevant fields were invited to review the contents, and the scale was then revised according to their feedback.

After the initial scale had been compiled, a model (N = 95 samples) was built, and the measurement model of partial least squares–structural equation modeling (PLS–SEM) was used to assess its reliability and validity. Cronbach’s α values were calculated to check the internal consistency reliability, where values greater than 0.7 are considered acceptable (Fornell & Larcker, 1981). The overall Cronbach’s α for the Students’ STEM Integration Scale was 0.96, and the Cronbach’s α values of all factors were satisfactory (attitude = 0.86, subjective norm = 0.86, perceived behavioral control = 0.91, behavioral intention = 0.95, STEM integration behavior = 0.94). Four items with loadings less than 0.7 were removed (two on attitude, one on subjective norm, and one on perceived behavioral control) (Hair et al., 2021). Ultimately, 26 items (loadings range: 0.70–0.94) were included in the Students’ STEM Integration Scale, including 4 on attitude, 5 on subjective norm, 4 on perceived behavioral control, 6 on behavioral intention, and 7 on STEM integration behavior (see Appendix 1).

Data analysis

Partial least squares–structural equation modeling (PLS–SEM) was employed to test the hypothesized model by two steps, including the measurement model and the structural model. All analyses were performed using SmartPLS (version 3.3.2). The measurement model was used to assess the reliability and validity of the Students’ STEM Integration Scale, and the structural model was used to explore the relationships among the five factors, and the hypothesized paths, as a means of assessing their relationships with students’ intentions and behavior with respect to integrating STEM knowledge and skills. Although the estimated bias issue of using PLS–SEM was discussed, research has shown that there only exists a very low level of difference between PLS–SEM and Covariance-based SEM (CB-SEM) estimates (Reinartz et al., 2009). Besides, in some conditions (e.g., small sample size or non-normal data), PLS–SEM shows greater statistical power than CB-SEM (Hair et al., 2011).

PLS–SEM is originally developed for exploratory research and the main purpose of using the technique in studies is to identify relationships between factors (Hair et al., 2017). In the study, the skewness and kurtosis values of some items did not meet the thresholds of normality (values ranged from − 2 to + 2 and absolute values lower than 1) (see Appendix 2), indicating a non-normal distribution (Hair et al., 2021). It could be related to the participants in the study who were selected out from the group of preliminary winning students which may lead to the issue of a highly homogeneous sample. To sum up, because the aim of the study is to explore the factors which are able to predict students’ STEM integration behavior with the non-normal data, given this rationale, PLS–SEM is recommended as an appropriate technique for examining the proposed model for its ability to identify predictors and analyze non-normal data. Other advantage for the widespread use of PLS–SEM are its ability to explore small sample sizes (Lin et al. 2020a). According to Chin and Newsted (1999), ten times the maximum number of formative indicators is sufficient for PLS; in the present study, the collection of 92 samples was acceptable.

Results and discussion

Measurement model analysis

The results of the measurement model analysis are summarized in Table 3. The findings verified the internal consistency reliability and convergent validity. All of the items’ loadings were above the suggested threshold value (0.50) (Fornell & Larcker, 1981). The composite reliability (CR), Cronbach’s α, and Rho_A values all exceeded 0.70, indicating that the internal consistency reliability was acceptable (Dijkstra & Henseler, 2015; Hair et al., 2021; Nunnally, 1994). The average variance extracted (AVE) for each factor was greater than the threshold value of 0.50 (Bagozzi & Yi, 1988), indicating acceptable convergent validity.

Table 3 Results of the measurement model analysis

To further examine the discriminant validity of the proposed model, the Fornell–Larcker criterion (1981) and Heterotrait–Monotrait (HTMT) ratio was used, as common conservative approaches. Fornell and Larcker (1981) suggest that the square root of the AVE value of each factor should be greater than the latent variable correlations (LVC). As Table 4 illustrates, the root square of AVE values (indicated by the bold values forming a diagonal) were all greater than the LVC (i.e., below the diagonal). The HTMT ratio is also used to confirm that factors are not modeled as common factors (Henseler et al., 2015). The HTMT values must not be close to 1, i.e., higher than a threshold value of 0.90; otherwise, discriminant validity is considered lacking (Gold et al., 2001). Table 4 illustrates that all HTMT values were lower than 0.90 (i.e., above the diagonal), thus confirming good discriminant validity of the factors.

Table 4 Results of the discriminant validity analysis

Structural model analysis

Bootstrapping is a commonly applied resampling technique for testing structural models in research with small sample sizes, including the significance of hypothesized paths (Chin & Newsted, 1999); 5000 bootstraps has been suggested for such analyses (Lin et al. 2020a). The beta coefficients (β), significance values of the path coefficients, and corresponding t values are reported in Table 5. All hypothesized paths were supported, except that between subjective norm and behavioral intention (β = − 0.04, t = 0.33). In addition to the p values, the Q2 and f2 statistics are reported; these reflect model predictive power and the effect size, respectively (Hair et al., 2021). The Q2 values should be above zero (Hair et al., 2021), and f2 values of 0.02, 0.15, and 0.35 represent small, moderate, and strong effect sizes, respectively (Cohen, 2013).

Table 5 Statistics for the paths in the proposed model

In this study, H1 hypothesizes that students’ attitudes toward integrating STEM knowledge and skills positively relate to their behavioral intentions toward STEM integration. The results showed that attitude correlated positively with behavioral intention, and the effect size was moderate (β = 0.51, t = 4.98, p < 0.001, f2 = 0.317). Thus, hypothesis 1 was supported. This result is consistent with findings reported by Brown et al. (2016), Park (2009), Teo and Zhou (2014), and Zheng and Li (2020), who found that students with positive attitudes tend to exhibit strong intentions to engage in particular behaviors. Our results indicated that students showing a positive attitude toward integrating STEM knowledge and skill while participating in the competition were also willing to do so in their daily lives.

H2 hypothesized that students’ subjective norms with respect to integrating STEM knowledge and skills would correlate positively with their behavioral intentions toward STEM integration. However, in contrast to Chen et al. (2018), Watson and Rockinson-Szapkiw (2021), and Zheng and Li (2020), the results of our study indicate that subjective norm had no significant relationship with behavioral intention (β = − 0.04, t = 0.33, p > 0.05, f2 = 0.001), which aligns with findings reported by several other studies (Padilla-Angulo, 2019; Uzun & Kilis, 2020; Zulfiqar et al., 2019). A possible reason for this finding is that students who participated in the final of the competition integrated STEM knowledge and skills as a requirement to solve complex problems during the designing and making activities, and not because they were under pressure from their peers, families, teachers, or social media. Social influences may have been less important to those students, because they were operating autonomously. Several studies have argued that subjective norms can be multidimensional, where multiple social influences may have different effects on an individual’s intentions (Hodgins et al., 1996). This idea was supported by Cheung and Vogel (2013), who found that peer influence exerted a positive effect on intentions, while instructors and media did not.

H3 of this study posited that students’ perceived behavioral control with respect to integrating STEM knowledge and skills correlates positively with their behavioral intentions toward STEM integration. Our findings suggest that perceived behavioral control has a significant positive relationship with behavioral intention; the effect size was moderate (β = 0.36, t = 2.97, p < 0.01, f2 = 0.174). These findings are similar to those of Dalvi-Esfahani et al. (2020) and Lung-Guang (2019). Students who were particularly interested in STEM subjects (e.g., those who followed related news or took part in relevant activities) were more likely to have strong intentions toward integrating their STEM knowledge and skills.

H4 hypothesized that students’ perceived behavioral control with respect to integrating STEM knowledge and skills plays an important role in STEM integration behavior. In line with Ajzen’s studies (2012, 2020), which argued for a direct effect of perceived behavioral control on behavior, our study’s findings indicated that perceived behavioral control was significantly positively related to STEM integration behavior, with a moderate effect size (β = 0.39, t = 4.24, p < 0.001, f2 = 0.237). Therefore, students with greater confidence in their ability to integrate STEM knowledge and skills performed more “dynamically” during the competition. The results also corroborate Wigginton et al.’s (2016) findings, which demonstrated that children’s perceived behavioral control was a significant predictor of their actual behavior.

H5 predicts that students’ behavioral intentions toward integrating STEM knowledge and skills will be significantly associated with STEM integration behavior. As Table 5 demonstrates, behavioral intention was significantly positively associated with STEM integration behavior, with a moderate effect size (β = 0.45, t = 4.01, p < 0.001, f2 = 0.316). Cheng (2019) also observed, the students were more likely to use a particular technology for the group assignment when they showed strong intentions to do so. Zhang et al. (2019) also found that students’ intentions were significantly related to their behavior, in the context of obtaining a degree in a STEM subject. Other studies have reported similar findings (Chu & Chen, 2016; Lee, 2006; Nie et al., 2020; Tosuntaş et al., 2015). In our study, students with strong behavioral intentions toward integrating STEM knowledge and skills during designing, making, or revising activities were more likely to engage in STEM integration behavior while participating in the competition.

In correlations analyses, R2 provides a measure of a model’s explanatory power; values of 0.25, 0.5, and 0.7 are used as thresholds for weak, moderate, and strong coefficients, respectively (Hair et al., 2021). In this study, the R2 of behavioral intention was 0.49, i.e., 49% of the total variance in the proportion of “behavioral intention” was explained by “attitude,” “subjective norm,” and “perceived behavioral control”. Meanwhile, 54% (R2 = 0.54) of the total variance in “STEM integration behavior” was explained by “perceived behavioral control” and “behavioral intention” (Fig. 5). According to Hair et al. (2021), both of these R2 values reflect moderate explanatory power. The predictive relevance (Q2) is assessed using the blindfolding procedure, where values greater than zero indicate predictive relevance (Hair et al., 2021). In the present study, the Q2 values were 0.31 and 0.28 for behavioral intention and STEM integration behavior, respectively, indicating predictive relevance.

Fig. 5
figure 5

Results of the hypothesized research model. **p < 0.01; ***p < 0.001

Figure 5 shows the results for the paths in the proposed research model.

Our study aimed to identify factors that are associated with students’ behavioral intentions and actual behavior with respect to integrating STEM knowledge and skills. According to our research model, which is based on the TPB and was used to test hypotheses generated from a literature review, attitude and perceived behavioral control, but not subjective norm, were positively associated with behavioral intention. This implies that students with favorable attitudes toward, and confidence in, their STEM knowledge and skills integration have greater intentions to apply what they have learned to solve complex problems. The results also revealed that perceived behavioral control and behavioral intention were significantly related to STEM integration behavior: students who believe they are capable of mastering integration of STEM knowledge and skills, and who have a strong intention to do so, are more likely to engage in this behavior.

Implications

Research on teaching and learning in STEM subjects should pay more attention to the factors that might be associated with students’ learning. Studies typically apply TPB to explore individuals’ intentions without simultaneously examining their behaviors. This may be because actual behavior is difficult to measure and a gap often exists between intention and action. In contrast, this study investigated both intention and actual behavior via a model with a sound theoretical basis (i.e., based on the TPB). The results suggest that students’ perceived behavioral control and behavioral intention have a direct effect on their behaviors. Furthermore, our study included students from several regions of Taiwan, all of whom participated in the same competition and received the same information from the competition committee. Thus, there was no asymmetry in information between urban and rural students.

In this study, students’ attitudes and perceived behavioral control were identified as two important factors which had significant relationships with their intention to integrate STEM knowledge and skills. Therefore, before teachers begin instructing students regarding how to integrate their knowledge and skills, they must first improve their attitudes and encourage positive appraisals, as well as enhance their confidence in integrating what they have learned. Research has shown that students’ attitudes could be effectively improved by encouraging them to participate in related activities (Padilla-Angulo, 2019) or had them believe that a particular ability or tool may enhance their performance (Zheng & Li, 2020). For teachers, it is recommended to design an authentic and student-centered learning context which related to students’ life experiences and provide students with opportunities to integrate their knowledge and skills. Besides, the learning activities can be planned as a series of project-based, problem-based, or inquiry-based activities to facilitate students’ STEM integration behavior while learning. Implementing an appropriate STEM lesson is suggested to have students experience how and when to integrate their interdisciplinary knowledge and skills, and to realize the importance of STEM integration behavior. By doing so, students can be expected to show a positive and confident attitude regarding STEM integration behavior.

Finally, increasing students’ perceived behavioral control and intention makes them more likely to engage in STEM integration behavior. To better enhance students’ confidence in integrating STEM knowledge and skills, teachers may manage to create an environment in which students can be supported with imperative assistance while learning, for example, delivering STEM lessons with a sequential teaching process to lecture and demonstrate related knowledge and skills, or preparing necessary equipment, resources, materials, manuals or guidance to facilitate students in their learning process, etc. In addition, it is suggested that teachers have students reflect on their experience, including success or failure experience by asking students to develop a portfolio to record their learning process. In summary, teachers need to improve students’ perceived behavioral control by planning their teaching and arranging the learning environment to successfully engage students in STEM integration behavior.

Limitations and suggestions for future research

In addition to the contributions mentioned above, here we acknowledge some of the present study’s limitations. First, the sample was limited to students who won preliminary awards and were eligible to participate in the final of the national technology competition. We included these students to ensure that all participants were able to answer the questions precisely, although this meant that the sample was small. Nevertheless, the diversity and uniqueness of our sample constitutes a strength of our research. As mentioned, targeting those outstanding performance students in the competitions helped the study analyzed their STEM integration behaviors; however, due to the targeted sample were selected from elite students, who won preliminary awards in local contests, the generalizability of the findings in the present study may limit. We recommend that future studies enroll participants from international STEM-based competitions, to avoid small samples and thus explore students’ perceptions regarding the integration of STEM knowledge and skills in more depth, as well as additional predictors of students’ intentions or behavior when confronted with various problems. Together with more data are collected, the findings are possible to be generalized to a more general student population.

Second, subjective norm was not tested as a single factor potentially predicting students’ intentions. Although the findings were consistent with several previous studies (Padilla-Angulo, 2019; Uzun & Kilis, 2020; Zulfiqar et al., 2019), they were contrary to the original conception of the TPB. Research has indicated that subjective norms play an important role of individuals’ intentions (Chen et al., 2018; Cheng, 2019; Lung-Guang, 2019; Zheng & Li, 2020). Hodgins et al. (1996) and Cheung and Vogel (2013) argued that social factors can be divided into multiple types, including peer influence, family support, media, and teacher influence. Few studies have investigated these social factors individually, which should be a target for future research.

Finally, the data collection method used in this study, namely, self-evaluation, has been questioned in previous research. The aim was to obtain data that were sufficiently powerful to explain the students’ STEM integration behavior. The reliability and validity of the Students’ STEM Integration Scale used to this end were verified, and its suitability for use in future research was demonstrated.

Conclusions

This study investigated factors which are associated with students’ intentions and behavior with respect to integrating STEM knowledge and skills, using a model based on the TPB. Previous studies tended to recruit participants from few schools, and lectures and activities were generally inconsistent among those schools. However, our participants were drawn from multiple schools/regions, so the results generalize to a wider range of students. We confirmed that students’ attitudes and perceived behavioral control, but not subjective norms, affected their behavioral intentions. Furthermore, perceived behavioral control and behavioral intentions positively predicted STEM integration behavior. We hope that our findings will lead to more attention being paid to these factors by studies on students’ intentions and behavior. Our study could serve as a reference for future investigations of STEM students’ behavioral intentions.

Availability of data and materials

Not applicable.

Abbreviations

STEM:

Science, Technology, Engineering, and Mathematics

TPB:

The theory of planned behavior

TAM:

Technology acceptance model

SEM:

Structural equation modeling

HTMT:

Heterotrait–Monotrait

LVC:

Latent variable correlations

AVE:

Average variance extracted

CFA:

Confirmatory factor analysis

CR:

Composite reliability

PBC:

Perceived behavioral control

BI:

Behavioral intention

STEM-IB:

STEM integration behavior

References

  • Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211.

    Article  Google Scholar 

  • Ajzen, I. (2012). The theory of planned behavior. In P. A. M. Lange, A. W. Kruglanski, & E. T. Higgins (Eds.), Handbook of theories of social psychology (Vol. 1, pp. 438–459). Sage Publications.

    Chapter  Google Scholar 

  • Ajzen, I. (2020). The theory of planned behavior: Frequently asked questions. Human Behavior and Emerging Technologies, 2(4), 314–324. https://doi.org/10.1002/hbe2.195.

    Article  Google Scholar 

  • Ajzen, I., & Driver, B. L. (1991). Prediction of leisure participation from behavioral, normative, and control beliefs: An application of the theory of planned behavior. Leisure Sciences, 13(3), 185–204.

    Article  Google Scholar 

  • Ajzen, I., & Fishbein, M. (1980). Understanding attitudes and predicting social behavior. Prentice-Hall.

    Google Scholar 

  • Ajzen, I., & Fishbein, M. (2000). Attitudes and the attitude-behavior relation: Reasoned and automatic processes. European Review of Social Psychology, 11(1), 1–33.

    Article  Google Scholar 

  • Bagozzi, R. P., & Yi, Y. (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74–94.

    Article  Google Scholar 

  • Brown, P. L., Concannon, J. P., Marx, D., Donaldson, C., & Black, A. (2016). An examination of middle school students’ STEM self-efficacy, interests and perceptions. Journal of STEM Education: Innovations and Research, 17(3), 27–38.

    Google Scholar 

  • Bybee, R. W. (2013). The case for STEM education: Challenges and opportunities. NSTA Press.

    Google Scholar 

  • Chen, Y., Liang, C., & Cai, D. (2018). Understanding WeChat users’ behavior of sharing social crisis information. International Journal of Human–computer Interaction, 34(4), 356–366.

    Article  Google Scholar 

  • Cheng, E. W. (2019). Choosing between the theory of planned behavior (TPB) and the technology acceptance model (TAM). Educational Technology Research and Development, 67(1), 21–37.

    Article  Google Scholar 

  • Cheung, R., & Vogel, D. (2013). Predicting user acceptance of collaborative technologies: An extension of the technology acceptance model for e-learning. Computers & Education, 63, 160–175.

    Article  Google Scholar 

  • Chin, W. W., & Newsted, P. R. (1999). Structural equation modeling analysis with small samples using partial least squares. Statistical Strategies for Small Sample Research, 1(1), 307–341.

    Google Scholar 

  • Chittum, J. R., Jones, B. D., Akalin, S., & Schram, Á. B. (2017). The effects of an afterschool STEM program on students’ motivation and engagement. International Journal of STEM Education, 4(1), 1–16.

    Article  Google Scholar 

  • Chu, T. H., & Chen, Y. Y. (2016). With good we become good: Understanding e-learning adoption by theory of planned behavior and group influences. Computers & Education, 92, 37–52.

    Article  Google Scholar 

  • Cohen, J. (2013). Statistical power analysis for the behavioral sciences. Academic Press.

    Book  Google Scholar 

  • Dalvi-Esfahani, M., Wai Leong, L., Ibrahim, O., & Nilashi, M. (2020). Explaining students’ continuance intention to use Mobile web 2.0 learning and their perceived learning: An integrated approach. Journal of Educational Computing Research, 57(8), 1956–2005.

    Article  Google Scholar 

  • Dijkstra, T. K., & Henseler, J. (2015). Consistent partial least squares path modeling. MIS Quarterly, 39(2), 297–316.

    Article  Google Scholar 

  • Fan, S. C., Yu, K. C., & Lin, K. Y. (2021). A framework for implementing an engineering-focused STEM curriculum. International Journal of Science and Mathematics Education, 19, 1523–1541.

    Article  Google Scholar 

  • Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Addison-Wesley.

    Google Scholar 

  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.

    Article  Google Scholar 

  • Gold, A. H., Malhotra, A., & Segars, A. H. (2001). Knowledge management: An organizational capabilities perspective. Journal of Management Information Systems, 18(1), 185–214.

    Article  Google Scholar 

  • Hair, J. F., Jr., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2021). A primer on partial least squares structural equation modeling (PLS-SEM). Sage Publications.

    Book  Google Scholar 

  • Hair, J. F., Ringle, C. M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139–152.

    Article  Google Scholar 

  • Hair, J. F., Jr., Sarstedt, M., Ringle, C. M., & Gudergan, S. P. (2017). Advanced issues in partial least squares structural equation modeling. Sage Publications.

    Google Scholar 

  • Hartshorne, R., & Ajjan, H. (2009). Examining student decisions to adopt web 2.0 technologies: Theory and empirical tests. Journal of Computing in Higher Education, 21(3), 183–198.

    Article  Google Scholar 

  • Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135.

    Article  Google Scholar 

  • Hodgins, H. S., Koestner, R., & Duncan, N. (1996). On the compatibility of autonomy and relatedness. Personality and Social Psychology Bulletin, 22(3), 227–237.

    Article  Google Scholar 

  • Lee, Y. C. (2006). An empirical investigation into factors influencing the adoption of an e-learning system. Online Information Review, 30(5), 517–541.

    Article  Google Scholar 

  • Li, Y., Froyd, J. E., & Wang, K. (2019). Learning about research and readership development in STEM education: A systematic analysis of the journal’s publications from 2014 to 2018. International Journal of STEM Education, 6(19), 1–8. https://doi.org/10.1186/s40594-019-0176-1

    Article  Google Scholar 

  • Lin, H. M., Lee, M. H., Liang, J. C., Chang, H. Y., Huang, P., & Tsai, C. C. (2020a). A review of using partial least square structural equation modeling in e-learning research. British Journal of Educational Technology, 51(4), 1354–1372.

    Article  Google Scholar 

  • Lin, K. Y., Hsiao, H. S., Williams, P. J., & Chen, Y. H. (2020b). Effects of 6E-oriented STEM practical activities in cultivating middle school students’ attitudes toward technology and technological inquiry ability. Research in Science and Technological Education, 38(1), 1–18. https://doi.org/10.1080/02635143.2018.1561432

    Article  Google Scholar 

  • Lin, K.-Y., Lu, S.-C., Hsiao, H.-H., Kao, C.-P., & Williams, P. J. (2021). Developing student imagination and career interest through a STEM project using 3D printing with repetitive modeling. Interactive Learning Environments. https://doi.org/10.1080/10494820.2021.1913607

    Article  Google Scholar 

  • Luan, H., Li, T. L., & Lee, M. H. (2020). High school students’ environmental education in Taiwan: Scientific epistemic views, decision-making style, and recycling intention. International Journal of Science and Mathematics Education. https://doi.org/10.1007/s10763-020-10136-z

    Article  Google Scholar 

  • Lung-Guang, N. (2019). Decision-making determinants of students participating in MOOCs: Merging the theory of planned behavior and self-regulated learning model. Computers & Education, 134, 50–62.

    Article  Google Scholar 

  • Miller, K., Sonnert, G., & Sadler, P. (2018). The influence of students’ participation in STEM competitions on their interest in STEM careers. International Journal of Science Education, Part B, 8(2), 95–114.

    Article  Google Scholar 

  • Nie, J., Zheng, C., Zeng, P., Zhou, B., Lei, L., & Wang, P. (2020). Using the theory of planned behavior and the role of social image to understand mobile English learning check-in behavior. Computers & Education. https://doi.org/10.1016/j.compedu.2020.103942

    Article  Google Scholar 

  • Nunnally, J. C. (1994). Psychometric theory 3E. Tata McGraw-Hill Education.

    Google Scholar 

  • Organization for Economic Cooperation and Development (OECD). (2019). PISA 2018 results (volume III): What school life means for students’ lives. PISA, OECD Publishing. https://doi.org/10.1787/acd78851-en

    Book  Google Scholar 

  • Padilla-Angulo, L. (2019). Student associations and entrepreneurial intentions. Studies in Higher Education, 44(1), 45–58. https://doi.org/10.1080/03075079.2017.1336215.

    Article  Google Scholar 

  • Park, S. Y. (2009). An analysis of the technology acceptance model in understanding university students’ behavioral intention to use e-learning. Journal of Educational Technology & Society, 12(3), 150–162.

    Google Scholar 

  • Reinartz, W., Haenlein, M., & Henseler, J. (2009). An empirical comparison of the efficacy of covariance-based and variance-based SEM. International Journal of Research in Marketing, 26(4), 332–344.

    Article  Google Scholar 

  • Roberts, T., Jackson, C., Mohr-Schroeder, M. J., Bush, S. B., Maiorca, C., Cavalcanti, M., Schroeder, D. C., Delaney, A., & Cremeans, C. (2018). Students’ perceptions of STEM learning after participating in a summer informal learning experience. International Journal of STEM Education, 5(1), 1–14.

    Article  Google Scholar 

  • Teo, T., & Zhou, M. (2014). Explaining the intention to use technology among university students: A structural equation modeling approach. Journal of Computing in Higher Education, 26(2), 124–142.

    Article  Google Scholar 

  • Tosuntaş, ŞB., Karadağ, E., & Orhan, S. (2015). The factors affecting acceptance and use of interactive whiteboard within the scope of FATIH project: A structural equation model based on the Unified Theory of acceptance and use of technology. Computers & Education, 81, 169–178.

    Article  Google Scholar 

  • Tseng, K. H., Chang, C. C., Lou, S. J., & Chen, W. P. (2013). Attitudes towards science, technology, engineering and mathematics (STEM) in a project-based learning (PjBL) environment. International Journal of Technology and Design Education, 23(1), 87–102.

    Article  Google Scholar 

  • Uzun, A. M., & Kilis, S. (2020). Investigating antecedents of plagiarism using extended theory of planned behavior. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103700

    Article  Google Scholar 

  • Watson, J. H., & Rockinson-Szapkiw, A. (2021). Predicting preservice teachers’ intention to use technology-enabled learning. Computers & Education. https://doi.org/10.1016/j.compedu.2021.104207

    Article  Google Scholar 

  • Wigginton, M., Lee, J., Marshak, H. H., & Freier, K. (2016). Modifying the theory of planned behavior to predict children's exercise behaviors. International Journal of Health, Wellness & Society, 6(2), 57–71. https://doi.org/10.18848/2156-8960/CGP/v06i02/57-71.

    Article  Google Scholar 

  • Zhang, Y. L., Adamuti-Trache, M., & Connolly, J. (2019). From community college attendants to baccalaureate recipients: A planned behavior model for transfer students in STEM fields of study. The Journal of Higher Education, 90(3), 373–401.

    Article  Google Scholar 

  • Zheng, J., & Li, S. (2020). What drives students’ intention to use tablet computers: An extended technology acceptance model. International Journal of Educational Research. https://doi.org/10.1016/j.ijer.2020.101612

    Article  Google Scholar 

  • Zheng, J., Xing, W., Zhu, G., Chen, G., Zhao, H., & Xie, C. (2020). Profiling self-regulation behaviors in STEM learning of engineering design. Computers & Education. https://doi.org/10.1016/j.compedu.2019.103669

    Article  Google Scholar 

  • Zulfiqar, S., Sarwar, B., Aziz, S., Ejaz Chandia, K., & Khan, M. K. (2019). An analysis of influence of business simulation games on business school students’ attitude and intention toward entrepreneurial activities. Journal of Educational Computing Research, 57(1), 106–130. https://doi.org/10.1177/0735633117746746.

    Article  Google Scholar 

Download references

Funding

This study was based upon work supported by the Ministry of Science and Technology in Taiwan under MOST 108-2511-H-003-058-MY4, and the “Institute for Research Excellence in Learning Sciences” of National Taiwan Normal University from The Featured Areas Research Center Program within the framework of the Higher Education Sprout Project by the Ministry of Education in Taiwan. We are extremely grateful to teacher Yan-An, Jin for collecting the data and the teachers and students who participated in this study.

Author information

Authors and Affiliations

Authors

Contributions

C-JK: the leader of this research, she is in charge of the literature collecting and analyzing, research design, data analysis, and writing the manuscript (contributions to this research: 30%). Y-SH: responsible for research design, conducting questionnaire survey, providing comments to this research and revised the manuscript (contributions to this research: 20%). M-CC: responsible for research design, conducting questionnaire survey, providing comments to this research and revised the manuscript (contributions to this research: 20%). K-YL: responsible for research design, conducting questionnaire survey, collecting the data, and writing the manuscript (contributions to this research: 30%). All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kuen-Yi Lin.

Ethics declarations

Consent for publication

Not applicable.

Competing interests

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1. The students’ STEM integration scale

Factors and items

Attitude

 1. It is helpful for me to refer to relevant scientific principles (e.g., Pascal’s principle, the lever principle) when making a hydraulic arm or batting device

 2. It is helpful for me to learn how to operate manual and power tools to make a hydraulic arm or batting device

 3. It is helpful for me to apply engineering knowledge (e.g., of mechanics) when making a hydraulic arm or batting device

 4. It is helpful for me to apply mathematical knowledge (e.g., of measurements, calculations, or geometry) when making a hydraulic arm or batting device

Subjective norm

 1. I will integrate STEM knowledge and skills when designing and making the devices requested by my teacher

 2. I will integrate STEM knowledge and skills when designing and making devices according to the requests of my peers

 3. Based on newspapers, magazines, television, online news, social media, etc.), I will integrate STEM knowledge and skills when designing and making devices

 4. I will integrate STEM knowledge and skills when designing and making devices according to requests from my family

 5. I will integrate STEM knowledge and skills when designing and making devices according to competition guidelines

Perceived behavioral control

 1. I take the initiative when collecting relevant news on science, technology, engineering, and mathematics

 2. I like to integrate STEM knowledge and skills into hands-on activities

 3. I have the ability to integrate STEM knowledge and skills to design and make a functioning device

 4. I am able to take the initiative when collecting information relevant to STEM knowledge and skills to design and make a functional device

Behavioral intention

 1. I intend to integrate STEM knowledge and skills into the design process in the future

 2. I intend to integrate STEM knowledge and skills into the manufacturing process in the future

 3. I intend to integrate STEM knowledge and skills into the testing and revising process in the future

 4. I will encourage peers to integrate STEM knowledge and skills to solve problems in the future

 5. I intend to acquire more knowledge and skills relevant to STEM

 6. After participating in the competition, I intend to solve problems by integrating STEM knowledge and skills

STEM integration behavior

 1. I integrated scientific principles (e.g., the lever principle and Pascal’s principle) to design and make devices during the competition

 2. I integrated technological knowledge (e.g., of problem-solving, materials and tools) to design and make devices during the competition

 3. I integrated engineering knowledge (e.g., mechanistic knowledge) to design and make the devices during the competition

 4. I integrated mathematics knowledge (e.g., of measurements, calculations, or geometry) to design and manufacture equipment during the competition

 5. I integrated STEM knowledge and skills to solve problems during the testing and revising process

 6. By integrating STEM knowledge and skills, I was able to design and make devices efficiently during the competition

 7. By integrating STEM knowledge and skills during the competition, my practical skills were improved

Appendix 2. Descriptive statistic results of the scale items

 

Mean

Standard deviation

Skewness

Kurotsis

ATT1

6.04

0.97

− 0.97

0.42

ATT2

6.22

0.99

− 1.28

1.22

ATT3

6.21

1.02

− 1.19

0.51

ATT4

5.88

1.18

− 0.90

0.23

SN1

6.15

0.97

− 0.90

− 0.24

SN2

5.47

1.30

− 1.23

2.60

SN3

5.21

1.37

− 1.01

1.32

SN4

4.79

1.63

− 0.55

− 0.26

SN5

6.01

1.05

− 1.69

4.91

PBC1

5.25

1.31

− 0.65

0.28

PBC2

5.74

1.30

− 1.31

1.87

PBC3

5.11

1.45

− 0.86

0.59

PBC4

5.36

1.31

− 1.23

1.79

BI1

6.23

0.96

− 1.31

1.52

BI2

6.24

0.98

− 1.37

1.58

BI3

6.34

0.94

− 1.70

2.84

Bi4

6.02

0.99

− 1.00

0.66

BI5

6.18

1.04

− 2.01

5.19

BI6

6.32

0.88

− 1.37

1.83

B1

5.64

1.30

− 1.00

1.05

B2

5.87

1.01

− 0.59

− 0.14

B3

5.53

1.38

− 1.27

2.00

B4

5.55

0.99

− 0.40

0.26

B5

5.88

1.03

− 1.07

1.78

B6

5.85

0.99

− 0.85

0.63

B7

5.89

1.08

− 1.21

1.63

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ku, CJ., Hsu, YS., Chang, MC. et al. A model for examining middle school students’ STEM integration behavior in a national technology competition. IJ STEM Ed 9, 3 (2022). https://doi.org/10.1186/s40594-021-00321-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40594-021-00321-z

Keywords