Skip to main content

Table 7 Mean (± SD) change scores for youth self-reported outcomes (CIS-S) by STEM program quality level (DoS—overall score)

From: From quality to outcomes: a national study of afterschool STEM programming

Variable

Quality levels

Test statistics

Effect sizes—all domains and by individual domains

Lower

Average

Higher

Stat.

Signif.

All domains

FLE

ActEng

STEM K&P

YD & STEM

STEM attitudes

M

SD

M

SD

M

SD

χ2 (2)

p

d

[95% CI]

d

[95% CI]

d

[95% CI]

d

[95% CI]

d

[95% CI]

 STEM engagement

7.71a

14.90

8.76a,b

13.96

11.20b

15.85

11.81

0.003

0.23

[0.07, 0.38]

n.s.

0.06

[− 0.10,0.21]

n.s.

n.s.

 STEM career interest

7.32a

17.42

8.61a,b

15.35

11.51b

17.18

16.18

< 0.001

0.24

[0.08, 0.40]

n.s.

0.09

[− 0.06,0.25]

0.30

[0.15,0.44]

0.19

[0.02,0.36]

 STEM career knowledge

7.54a

14.65

10.56b

14.51

13.56c

15.96

25.04

< 0.001

0.39

[0.23, 0.55]

0.12

[− 0.02,0.26]

0.21

[0.06,0.37]

0.45

[0.31,0.60]

0.25

[0.08,0.42]

 STEM activity participation

8.47

12.86

8.45

12.65

9.94

14.42

2.56

0.278

n.s.

n.s.

n.s.

n.s.

n.s.

 STEM identity

5.08a

13.56

7.61b

12.32

11.01c

14.79

32.38

< 0.001

0.42

[0.26, 0.58]

0.18

[0.04,0.32]

0.27

[0.11,0.42]

0.39

[0.25,0.54]

0.27

[0.10,0.44]

SEL/twenty-first-century skills

 Critical thinking

7.69a

15.30

8.71a,b

14.96

11.49b

16.55

12.26

0.002

0.24

[0.08, 0.40]

n.s.

0.11

[− 0.04,0.26]

0.20

[0.06,0.35]

n.s.

 Perseverance

6.75a

15.03

7.97a

14.95

11.51b

16.61

16.86

< 0.001

0.30

[0.14, 0.46]

0.16

[0.02,0.30]

0.13

[− 0.02,0.28]

n.s.

n.s.

 Relationships with adults

4.93a

13.99

7.42a,b

14.21

9.71b

15.40

17.18

< 0.001

0.32

[0.16, 0.48]

0.18

[0.04,0.32]

0.13

[− 0.02,0.28]

n.s.

n.s.

 Relationships with peers

3.48a

12.96

5.35a,b

12.24

7.53b

15.22

12.06

0.002

0.28

[0.13, 0.44]

n.s.

0.13

[− 0.02,0.28]

0.27

[0.12,0.41]

n.s.

  1. Note: Sample size differed across levels of quality; lower, n = 279 students across 28 programs; average, n = 972 students across 91 programs; higher, n = 348 students across 27 programs. For each variable, within each row, mean change scores with different letters are statistically significant (p < 0.01, two-tailed). Effect sizes were only reported for CIS-S outcomes that were statistically significant; M mean, SD standard deviation, χ2 chi-squared, stat. statistic, signif. significance, d Cohen’s d, CI confidence interval, n.s. non-significant, FLE Features of the Learning Environment, ActEng Activity Engagement, STEM K&P STEM Knowledge and Practices, YD & STEM Youth Development in STEM