4 minute read

6.3 Making Meaning of Effect Sizes

A7.3 Standardized Difference-in-Differences, Data Collapsed at School Level

Table 43. EGRA School Level Difference-in-Differences, Standardized Scores

(1) (2) (3) (4) (5) (6) Letter Sounds Onset Sounds Non-word Reading Familiar Word Reading Passage Fluency Reading Comp.

KG-G2 KG-G2 KG-G3 KG-G3 G1-G3 G1-G3

Bridge 3.77** 0.29+ 1.04* 0.94* 0.86+ 0.80+ (0.66) (0.15) (0.37) (0.35) (0.45) (0.41)

Baseline Task Score 5.48 -0.45 13.42+ 3.67* 5.38* 0.94 (9.41) (0.75) (6.89) (1.11) (1.70) (2.86)

Baseline Task Score ^2 -5.86 -0.80 -2.10 -0.12 -1.80 0.50 (9.83) (0.84) (2.04) (1.90) (1.21) (1.73)

Baseline Task Score ^3

0.92 0.66 0.06 -0.29 0.23 0.05 (1.37) (0.54) (0.15) (0.55) (0.20) (0.17) Constant 1.75 1.10 -0.05 1.51 2.51* 0.34 (3.34) (0.59) (0.44) (0.99) (0.88) (1.14)

Count 12 12 12 12 12 12 R-squared 0.89 0.62 0.79 0.85 0.85 0.77

Table 44. EGMA School Level Difference-in-Differences, Standardized Scores

(7) (8) (9) (10) (11) (12) (13) (14)

One to One Corresp.* Number Id.* Quantity Disc. Addition 1 Addition 2* Subtraction 1 Subtraction 2*

Word Problems

KG KG-G1 KG-G2 KG-G3 G2-G3 G1-G3 G2-G3 G1-G3

Bridge 0.29 0.41** 0.34** 0.85** 0.27* 0.26 0.10 0.25* (0.17) (0.09) (0.10) (0.10) (0.11) (0.16) (0.17) (0.10)

Baseline Task Score Baseline Task Score ^2 2.31* 1.65** 1.82* 1.05** 0.24 0.07 2.12* 0.87 (0.87) (0.37) (0.70) (0.24) (0.38) (0.30) (0.69) (0.74) -0.89 -0.23+ -0.30 -0.47 -0.76* 0.29 1.25 -0.40* (0.82) (0.11) (0.36) (0.36) (0.27) (0.49) (0.84) (0.16)

Baseline Task Score ^3

-0.66 0.01 -0.40 0.09 0.07 -0.02 -1.04+ -0.05 (0.53) (0.01) (0.38) (0.05) (0.23) (0.05) (0.45) (0.25) Constant 1.49+ 0.36** 1.13** 1.04** 1.17** 0.45 0.04 0.69** (0.61) (0.06) (0.28) (0.30) (0.24) (0.42) (0.53) (0.16)

Count 10 11 12 12 12 12 12 12 R-squared 0.67 0.95 0.93 0.94 0.75 0.49 0.66 0.77

A7.4 Standardized Difference-in-Differences by Grade

Table 45. Kindergarten Simple Difference-in-Differences, Standardized Scores

Table 46. Grade 1 Simple Difference-in-Differences, Standardized Scores

Table 47. Grade 2 Simple Difference-in-Differences, Standardized Scores

Bridge PSL Public School Traditional Public School

Baseline Endline Baseline Endline

Diff-nSubtask Count Mean Mean Diff Count Mean Mean Diff Diff

Letter Sounds 53 -0.23 3.82 4.05 91 -0.26 -0.19 0.07 3.97 Onset Sounds 53 -0.26 0.53 0.79 91 -0.30 0.33 0.62 0.17 Non-Word Reading 53 -0.22 1.56 1.79 91 -0.15 -0.16 -0.01 1.79

Familiar Word Reading 53 -0.60 0.70 1.30 91 -0.56 -0.40 0.16 1.14 One to One Correspondence 53 -0.15 0.33 0.48 90 0.22 0.29 0.07 0.41 Number Identification 53 -0.36 0.20 0.55 91 0.05 0.24 0.19 0.36

Quantity Discrimination 53 -0.84 0.25 1.09 91 -0.40 0.37 0.76 0.33 Addition 1 53 -1.00 0.21 1.21 90 -0.44 0.04 0.49 0.72

Bridge PSL Public School Traditional Public School

Baseline Endline

Baseline Endline Subtask Mean Mean Mean Mean Diff

Letter Sounds 69 -0.08 3.17 3.26 92 -0.05 0.80 0.85 2.41 Onset Sounds 69 0.16 1.00 0.84 92 -0.08 0.64 0.72 0.12

Non-Word Reading 69 -0.19 1.62 1.81 92 -0.20 0.70 0.90 0.91

Familiar Word Reading 69 -0.30 1.99 2.28 92 -0.40 0.36 0.75 1.53 Passage Fluency 69 -0.37 1.91 2.28 92 -0.48 0.18 0.65 1.62 Reading Comprehension 69 -0.22 1.28 1.50 92 -0.24 -0.12 0.13 1.37

Number Identification 69 0.27 0.83 0.56 92 0.18 0.56 0.38 0.18 Quantity Discrimination 69 0.18 1.34 1.16 92 0.25 0.82 0.58 0.59 Addition 1 69 -0.23 1.17 1.40 92 -0.05 0.50 0.55 0.85 Subtraction 1 69 -0.47 0.73 1.21 92 -0.34 0.34 0.69 0.52 Word Problems 69 -0.50 0.20 0.70 92 -0.36 -0.06 0.30 0.40

Diff-nCount Diff Count Diff

Bridge PSL Public School Traditional Public School

Baseline Endline

Baseline Endline Subtask Mean Mean Mean Mean Diff

Letter Sounds 76 0.19 3.80 3.62 64 0.58 1.08 0.50 3.11 Onset Sounds 76 0.23 1.25 1.03 64 0.38 1.06 0.68 0.35

Non-Word Reading 79 0.20 3.45 3.24 67 0.31 1.35 1.04 2.21

Familiar Word Reading 76 0.24 2.48 2.24 67 0.27 1.31 1.05 1.19 Passage Fluency 79 0.17 2.77 2.60 67 -0.18 1.27 1.45 1.16 Reading Comprehension 79 0.04 2.51 2.47 67 -0.22 1.01 1.23 1.24 Quantity Discrimination 76 0.58 1.31 0.73 64 0.54 1.16 0.62 0.11 Addition 1 79 0.35 1.83 1.48 67 0.27 1.06 0.79 0.69 Addition 2 78 -0.16 0.57 0.74 67 -0.03 0.27 0.30 0.44 Subtraction 1 79 -0.04 1.08 1.13 67 0.21 0.68 0.47 0.66 Subtraction 2 78 -0.27 0.43 0.70 67 -0.04 0.22 0.26 0.44 Word Problems 79 0.13 0.65 0.52 67 0.09 0.53 0.45 0.07

Diff-nCount Diff Count Diff

Table 48. Grade 3 Simple Difference-in-Differences, Standardized Scores

Bridge PSL Public School Traditional Public School

Baseline Endline

Baseline Endline Subtask Mean Mean Mean Mean Diff

Non-Word Reading 74 0.22 1.55 1.33 69 0.07 0.96 0.90 0.44

Familiar Word Reading 72 0.47 2.84 2.37 69 0.77 2.07 1.29 1.08 Passage Fluency 74 0.40 3.75 3.35 70 0.71 2.30 1.59 1.76 Reading Comprehension 74 0.41 2.76 2.35 71 0.44 2.00 1.56 0.80 Addition 1 74 0.55 2.37 1.82 69 0.62 1.63 1.01 0.80 Addition 2 74 0.14 0.88 0.74 69 0.13 0.63 0.50 0.24 Subtraction 1 74 0.53 1.16 0.63 68 0.53 1.12 0.59 0.04 Subtraction 2 74 0.21 0.91 0.70 68 0.19 0.76 0.57 0.13 Word Problems 74 0.37 0.67 0.30 69 0.28 0.54 0.26 0.05

Diff-nCount Diff Count Diff

1. A8. Yearly Growth in Subtasks by Grade

Figure 11. Yearly Growth on EGRA Subtasks by Grade Figure 12. Yearly Growth on EGMA Subtasks by Grade

This article is from: