Camp Fire School Readiness & Early Education Apprenticeship Program Report 2022-2023

Camp Fire

School Readiness Program & Early Education Apprenticeship Program EVALUATION REPORT 2022-2023 School Year Camp Fire First Texas 817.831.2111 / campfirefw.org 2700 meacham blvd, fort worth, tx 76137

APRIL 2024 Prepared by: CNM and AWare Research Solutions

Table of Contents 4 LIST OF FIGURES 5 LIST OF TABLES 6 EXECUTIVE SUMMARY 9 GLOSSARY OF TERMS 11 INTRODUCTION 12 CAMP FIRE SCHOOL READINESS PROGRAM 13 Program Characteristics • Program Tiers • Center Characteristics • Children Characteristics • Staff Characteristics • Mentor Characteristics

18 Program Implementation • Teacher Retention Beginning of Year (BOY) to End of Year (EOY) • Student Retention (BOY to EOY) • Teacher and Director Professional Development Participation • Teacher and Director Stipends • One-on-One Mentor Activity

22 Child Outcomes • Infants and Toddlers: Child Development • Prekindergarten Children: Math and Literacy • All Ages: Social-Emotional Development

26 Classroom and Center Outcomes • Classroom Environment Quality • Childcare Center Quality

43 Program Participation • Apprentice Recruitment • Apprentice Progress

44 Apprentice Outcomes • Self-Evaluation • Appendix A

45 Discussion 46 2022-2023 EEAP Evaluation Recommendations

47 CONCLUSION 49 LIST OF APPENDICES 50 APPENDIX A: 51 52 54 57 60 61

29 CFSRP Contributions to School Readiness • Prekindergarten Literacy Skills (Fall 2023) • Kindergarten Readiness (Fall 2023) • Continued Academic Success

36 Conclusions and Discussion 38 2022-2023 CFSRP Evaluation

62

63

Recommendations

40 CAMP FIRE EARLY EDUCATION APPRENTICESHIP PROGRAM 42 Participant Characteristics • Apprentices • Host Sites

64 65

CFSRP Program Components APPENDIX B: Evaluation Methods APPENDIX C: Child Development and Center Quality: Assessment Tools and Data Analysis APPENDIX D: Data Analysis and Assessment Tools for FWISD Data APPENDIX E: CFSRP and Comparison Group Demographics (FWISD, Fall 2023) APPENDIX F: Year-to-Year Comparisons of Prekindergarten Readiness Results (Fall 2018 – Fall 2023) APPENDIX G: Year-to-Year Comparisons of Kindergarten Readiness Results (Fall 2018 – Fall 2023) APPENDIX H: Year-to-Year Comparisons of Kindergarten Fall MAP Reading Fluency Results (Fall 2020 – Fall 2023) APPENDIX H (continued): Year-to-Year Comparisons of Kindergarten Fall MAP Reading Growth Results (Fall 2020 – Fall 2023) APPENDIX I: Year-to-Year Comparisons of Kindergarten, 1st and 2nd Grade MAP Reading Growth Results APPENDIX J: Early Education Apprenticeship Tracks

List of Figures 12 Figure 1: CFSRP Theory of Change Figure 2: CFSRP Children Served, 20092010 (pilot) to 2022-2023

27 Figure 10: CFSRP Classroom Environment and Management at EOY (CLASSTM), 2021-2022 and 2022-2023

18 Figure 3: CFSRP Teacher Retention Rates from BOY to EOY, 2014-2015 to 2022-2023

28 Figure 11: Center Management Scores at BOY and EOY (PAS), 2022-2023 (N=15)

19 Figure 4: CFSRP Student Retention Rates from BOY to EOY, 2015-2016 to 2022-2023

29 Figure 12: Comparison of Prekindergarten Early Literacy Skills (Fall 2023)

22 Figure 5: Percentage of Infants Demonstrating Age-Appropriate Skills by Assessment Area (ASQ®-3), 2022-2023 (N=42)

30 Figure 13: Comparison of Kindergarten Early Literacy Skills (TX-KEA, Fall 2023)

14

22 Figure 6: Percentage of Toddlers Demonstrating Age-Appropriate Skills by Assessment Area (ASQ®-3), 2022-2023 (N=105)

30 Figure 14: Comparison of Kindergarten Social Competence Skills (TX-KEA, Fall 2023)

List of Tables

33 Figure 15: Percent of Kindergarten – 2nd Grade Students Meeting Reading Growth™ Targets Spring 2023

23 Figure 7: Percentage of 4- and 5-Year-Old Children Developmentally On-Target at BOY and EOY (CPALLS+), 2022-2023 (N=34)

33 Figure 16: Percent of Kindergarten – 2nd Grade Students At or Above Average Reading Growth™ (MAP® Reading Growth™, Spring 2023)

24 Figure 8: Percentage of 4- and 5-Year-Old Children Improving or Making Acceptable Progress from BOY to EOY (CPALLS+), 2022-2023 (N=34)

34 Figure 17: Percent of Students Meeting MAP Reading Growth Targets and Showing Average or Above Growth in Reading Skills

25 Figure 9: Social Emotional Development at BOY and EOY (DECA), 2022-2023

39 Figure 18: EEAP Theory of Change

13 Table 1: ‌Description of CFSRP Professional Development Levels 13 Table 2: CFSRP Participating Centers, 2021-2023 14

Table 3: Number of Centers, Classrooms, Staff, and Children served by the Camp Fire School Readiness Program, 2009-2010 (pilot) to 2022-2023

15 Table 4: CFSRP Children Characteristics, 2022-2023 (N=822) 16 Table 5: CFSRP Staff Characteristics, 2022-2023 (N=196) 17

Table 6: CFSRP Mentor Characteristics, 2022-2023 (N=13)

20 Table 7: Mentor Activities, 2022-2023 21 Table 8: CFSRP Infant and Toddler Development Outcome Targets Versus Actual (ASQ®-3), 2022-2023 23 Table 9: CFSRP Prekindergarten Development Outcome Goals versus Actual (CPALLS+), 2022-2023

4

Executive Summary CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

26 Table 10: CLASS™ Domain Descriptions 31 Table 11: Comparison of Kindergarten Reading Fluency Skills (MAP® Fluency™, Fall 2023) 31 Table 12: Comparison of Kindergarten Achievement (MAP® Reading Growth™, Fall 2023) 32 Table 13: Percent of Students At or Above Average Reading Achievement Levels MAP® Reading Growth™ (Spring 2023) 34 Table 14: 3rd Grade Reading Achievement: Longitudinal Cohorts 40 Table 15: EEAP Apprentice Characteristics (N=91), 2022-2023 41

Table 16: Apprentice Program Progression, by Cohort

41

Table 17: Apprentice Reasons for Leaving EEAP before Completion, 2022-2023

42 Table 18: Apprentice Self-Evaluation Results, 2022-2023 43 Table 19: Apprentice Appendix A Results, 2022-2023

Executive Summary CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

5

Executive Summary Background Camp Fire First Texas has been committed to serving young children, their families, and the North Texas community for over 100 years. Two prominent avenues for strengthening early childhood services and supports that Camp Fire First Texas has pioneered are the Camp Fire School Readiness Program (CFSRP) and Camp Fire Early Education Apprenticeship Program (EEAP). Through these initiatives, children and educators access highquality programming and support. CFSRP aims to strengthen children’s school readiness (i.e., literacy, developmental, and social-emotional growth) through educator professional development and individualized mentoring. EEAP provides a career and educational pathway for early childhood educators by offering financial incentives, professional development, individualized incentives, and connection to higher educational institutions.

Report Structure This report includes an evaluation of both CFSRP and EEAP. Each program is treated separately, allowing readers to examine the results of each program separately, or to consider their results jointly. Evaluation of each program addresses specific questions for the 2022-2023 school year:

School Readiness Program

Early Education Apprenticeship Program

To what extent did the CFSRP…

To what extent did the EEAP…

1.

1.

Implement professional development, stipend allocation, and mentorship activities as intended?

2. Improve the percentage of children demonstrating ageappropriate developmental, early literacy, and socialemotional skills during the 2022-2023 program year?

3. Impact children’s growth in developmental, early literacy, and social-emotional skills during the 20222023 program year?

Differences in participant retention and success become evident?

2. Components collectively support educators’ knowledge and skills?

3. Participants attain (and maintain) portable child care credentials and wage increases?

4. Enhance the quality of teaching, classroom management, and centers’ family engagement practices during the 2022-2023 program year?

5. Impact CFSRP children’s school readiness as they enter prekindergarten and kindergarten and progress to the third grade?

6

Executive Summary CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

CFSRP Results PROGRAM IMPLEMENTATION Process evaluation describes the extent to which the CFSRP program implemented program activities as intended and how those activities resulted in the expected program outcomes. Findings from a process evaluation enable Camp Fire to determine which aspects of the program are working as expected, and which processes require additional support and clarification to be most effective. Data from the 2022-2023 program year indicates a high teacher retention rate of 79%, but a decreased student retention rate of 67% for the program year.

Child Outcomes (ASQ®-3, CPALLS+) Data from the ASQ-3 screening tool show infants in CFSRP classrooms demonstrating developmental progress in three of the five domains (communication, gross motor and problem solving) from beginning to end of year but showing less developmental progress in fine motor and personal-social skills. Similarly, toddlers demonstrated developmental progress in communication, personal-social skills and problem-solving skills, but showed a decrease in gross and fine motor skills from beginning to end of year.

Preschool CPALLS+ results show 4- and 5-year-old children making acceptable progress from beginning to end of year across all domains, with Rhyming and Rhyming 2 increasing by 24% and 23%, respectively.

Although children showed the lowest growth in math skills (9%), the end of year percentage of children making acceptable progress was an impressive 97%.

Social emotional development measures show that the number of infants showing need decreased over the program year, indicating that appropriate supports were offered to address developmental needs.

Toddler children show a slight increase in need during the program year and preschool children show little change. From beginning to end of year, 46% of infants, 41% of toddlers, and 49% of prekindergarten students showed improvement in their DECA score.

Center Outcomes (CLASS™, PAS) At the end of year 2022-2023, CLASS™ scores for infant classrooms showed higher average scores than seen in 2021-2022 (+0.7 points), while toddler classrooms showed similar end-of-year results across both years. CLASS™ scores for pre-K classrooms showed increased averages in emotional support compared to the prior year but showed lower average scores in classroom organization and instructional support. National quality thresholds are defined for preschool classrooms, and Camp Fire goals include meeting those thresholds. At the end of the year, average preschool CLASS™ scores met the quality threshold for classroom organization but fell short in emotional and instructional support.

PAS results show CFSRP-supported centers exhibited mixed results within all three assessment areas, with the greatest improvements in program evaluation. Small improvements were also made in strategic planning and family communication. Slight decreases were seen in screening and identifying special needs, assessment in support of learning, and family support and involvement.

School Readiness and Academic Progress Using results from FWISD assessments already in place, the evaluation examines student performance comparing cohorts of CFSRP children currently in grades prekindergarten through third grade to demographically similar groups of children who did not attend a CFSRP center.

As in prior years, results indicate that the CFSRP continues to contribute to prekindergarten and kindergarten students’ early literacy skills, with mixed results relative to academic progress in first, second and third grades.

• Prekindergarten CFSRP students had higher ratings than the matched comparison group on the Letter Naming, Vocabulary and Listening Skills measures.

• Kindergarten students had higher ratings on all the TX-KEA Early Literacy measures as well as on the MAP Reading Fluency Decoding, Listening Comprehension and Overall Achievement measures.

• At the end of 2023, higher percentages of kindergarten CFSRP students met their MAP Reading Growth Targets, but the results were similar for both groups of first grade students, and, in third grade higher percentages of the comparison group met their MAP Reading Growth Targets.

Executive Summary CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

7

Glossary of Terms EEAP Results PARTICIPANT RETENTION AND SUCCESS EEAP is a two-year program that admits new apprentices every year. Of the 91 apprentices served in 2022-2023, 77 (85%) were new apprentices and 14 (15%) were returning for their 2nd year of enrollment in the program. By August 2023, 34 of the 91 apprentices served graduated from the program (37%); 29 are continuing into their 2nd year of enrollment (32%); and 28 (31%) cancelled their participation in the program.

KNOWLEDGE AND SKILL DEVELOPMENT The EEAP program continues to focus on increasing the knowledge and skill level of participants. Among the 20222023 apprentices, 35 had completed Child Development Associate Credentials (CDA) (38%), of which, 14 completed their CDA before program enrollment and 19 completed their CDA during the program. Additionally, 56 completed EEI*.

APPENDIX A

Assessment tool created by the National Association for the Education of Young Children (NAEYC) to evaluate early childhood educators core competencies in six standards representing the core body of knowledge, skills, values, and dispositions early childhood educators must demonstrate to effectively promote the development, learning and well-being of all young children.

ASQ®-3

Ages and Stages Questionnaires®, Third Edition A developmental screening tool for use with children ages one month to 5½ years old. The ASQ®-3 highlights a child’s developmental strengths and areas of concern. Camp Fire uses ASQ®-3 to see where individual children need additional support, assess development over time, and identify developmental domains to emphasize in the classroom.

BOY

Beginning of Year Generally refers to measurements taken at the beginning of a school year (September through November).

BPOT

Best Practices Observation Tool A research-based checklist for classroom observers to measure the presence or absence of teaching practices that align with the CFSRP professional development curriculum. Checklists are tailored to classroom type (infant, toddler, Pre-K3 and Pre-K4).

CFSRP

Camp Fire School Readiness Program Camp Fire First Texas’ research-based initiative to strengthen school readiness through improving language and socialemotional skills among children age 0-5 and enhancing the quality of teaching and childcare centers.

CIRCLE

Circle Progress Monitoring Tool A criterion-referenced assessment used to identify prekindergarten students who are on track, need monitoring, or need support for development of early literacy and social emotional skills.

CLASS

Classroom Assessment Scoring System A quality improvement tool focused on teacher-student interactions that measures the teaching quality within a classroom.

Camp Fire uses CLASS™ to gauge classroom quality and provide individualized feedback to improve educator practices.

CPALLS+

An assessment of prekindergarten learning (literacy, math, science, social studies), social development, and critical Head Start skills. Camp Fire uses CPALLS+ to assess older children’s language and math skill development over time.

DECA

Devereux Early Childhood Assessment A strengths-based social-emotional screening and assessment tool for infants and toddlers (ages one month to 36 months) and preschoolers (ages three to five years). Camp Fire uses DECA to assess children’s social-emotional wellbeing and level of protective factors.

8

Executive Summary CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Executive Summary CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

9

Glossary of Terms EEAP

Camp Fire Early Education Apprenticeship Program Camp Fire First Texas’ workforce development initiative to build a career pathway for early childhood educators by combining paid, on-the-job learning with coaching, professional development, and professional certification.

EEI

Early Educators Institute The Early Educator Institute (EEI) offers biweekly 16-week sessions in Infant/Toddler and Pre-K tracks that explore early childhood topics supporting theoretical knowledge and practical application of developmentally appropriate practices in early learning spaces.

EOY

End of year Generally refers to measurements taken at the end of a school year (April through June).

FWISD

Fort Worth Independent School District The K-12 public school system that serves most students after they age out of the CFSRP.

MAP Reading Fluency ®

An online screening and progress monitoring tool that assesses basic reading skills with an emphasis on oral fluency (e.g., listening comprehension, words per minute, accuracy, decoding). It is part of a standardized, normreferenced series of assessments that can be used to measure students’ performance against the performance of a national sample. Students receive a MAP® Reading Fluency™ rating of below, approaching, meeting, or exceeding grade level expectations.

MAP Growth

An online screening and progress monitoring tool that assesses early literacy skills, reading comprehension, and use of vocabulary. It is part of a standardized, norm-referenced series of assessments that can be used to measure students’ performance against the performance of a national sample. Students receive a score that places them at one of five levels (low, low average, average high average or high), based on the national sample.

MOY

Middle of year

®

Generally refers to measurements taken in the middle of a school year (January or February).

PAS

Program Administration Scale A leadership and program management assessment tool designed for center-based early childhood education programs. Camp Fire uses the PAS to assess center quality and support continuous improvement.

TX-KEA

Texas Kindergarten Entry Assessment An assessment of entering Texas kindergarten students’ language, literacy, STEM, social emotional, executive function, and academic motor skill. Kindergarten teachers in Texas administer the TX-KEA to their students at the beginning, middle, and end of the school year.

10

Executive Summary CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Introduction Camp Fire First Texas’ commitment to youth development begins right from the start, with early childhood. By strengthening the systems, programs, and professionals that support infants and young children, Camp Fire invests in strong starts for children across Fort Worth and beyond.

Since 2005, the Camp Fire School Readiness Program (CFSRP) has helped children be ready to start school through improving quality of care at neighborhood childcare centers. CFSRP supports early education programs that feed into the Fort Worth Independent School District with professional development and individual coaching/mentoring focused on teaching practices that improve language and social-emotional skills among children age 0-5.

In 2020, Camp Fire began its Early Education Apprenticeship Program (EEAP), a 1–5-year program combining paid on-the-job learning, coaching, professional development, and professional certification to strengthen career and educational pathways for early childhood professionals. EEAP is an innovative approach to a critical need: stabilizing the workforce through improved wages and decreased turnover. Two additional occupations were added in the Fall of 2023 –ECE II (Associate of Applied Science in Child Development) and ECE III (Bachelor of Applied Science in Child Development and Family Studies). The first U.S. Department of Labor-certified early childhood apprenticeship program in the state of Texas, EEAP is supported by the Texas Workforce Commission, Workforce Solutions for Tarrant County, Tarrant County College, Tarleton State University, North Central Texas College, San Antonio College, and the T.E.A.C.H. Early Childhood Scholarship through the Texas Association for the Education of Young Children, as well as generous local foundations.

Each year, Camp Fire prepares an evaluation report to share with partners and the community. The evaluation provides opportunities to reflect on challenges and successes in the preceding year, adjust to more effectively support children’s education, and have transparent, productive conversations across the community. The report separately addresses the activities and achievements of CFSRP and EEAP, enabling readers to consider each program independently and jointly.

CFSRP CAMP FIRE SCHOOL READINESS PROGRAM The CFSRP evaluation summarizes literacy, developmental, and social-emotional growth among children attending childcare centers supported by CFSRP in 2022-2023, center and classroom quality measures, and academic outcomes through third grade. It addresses five central evaluation questions. To what extent did the CFSRP: 1. Implement professional development, stipend allocation,

and mentorship activities as intended?

2. Improve the percentage of children demonstrating age-

appropriate developmental, early literacy, and socialemotional skills during the 2022-2023 program year?

3. Impact children’s growth in developmental, early literacy,

and social-emotional skills during the 2022-2023 program year?

4. Enhance the quality of teaching, classroom management,

and centers’ family engagement practices during the 2022-2023 program year?

5. Impact CFSRP children’s school readiness as they enter

prekindergarten and kindergarten and progress to the third grade?

EEAP EARLY EDUCATION APPRENTICESHIP PROGRAM The EEAP evaluation summarizes participation and outcomes for new and returning apprentices in the third-year of the EEAP program since EEAP was instituted in 2020. Central evaluation questions for EEAP include: 1. What differences in participant retention and success are

evident?

2. How did EEAP components collectively support educators’

knowledge and skills?

3. To what extent are EEAP participants attaining (and

maintaining) portable child care credentials and wage increases?

Introduction CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

11

Camp Fire School Readiness Program Healthy development in early childhood supports lifelong health, academic achievement, economic stability, and community strength. High-quality early childhood care and education are foundational for social, cognitive, and developmental growth that lead to kindergarten readiness.1 Nowhere else are the benefits of high-quality early care as pronounced as among children from low-income households, who are at increased risk of entering kindergarten less prepared than their peers,2 with lasting disadvantages,3 but with strong potential to close gaps when supported in the first years of life.4 The CFSRP addresses this need by partnering with childcare centers in targeted areas of Fort Worth to support educators with the knowledge and skills to provide quality care to neighborhood children. This solution meets families and neighborhoods where they are, enhancing quality care without displacing current providers or developing new childcare centers.

The CFSRP measures its success in terms of child learning and development, classroom quality, and center quality at the beginning and end of each school year, as shown in the CFSRP theory of change5 (Figure 1). The components of the program are outlined in detail in Appendix A. To understand how and why these outcomes came about, the evaluation includes program implementation indicators: teacher and student retention, teacher participation in professional development, and mentoring activities.

Camp Fire School Readiness Program

Program Characteristics PROGRAM TIERS The CFSRP is designed to operate over multiple years, bringing center partners in to first gain familiarity with program components (Level 2), then commit to intensive professional development and mentoring (Level 3), and then receive ongoing professional development support to maintain quality over time (Level 4). In 2022-2023, CFSRP matured to the point of having over half of supported centers and classrooms at the sustainability level and the capacity to bring on new centers for support (Table 1).

PROFESSIONAL DEVELOPMENT LEVEL

NUMBER OF CENTERS (CLASSROOMS)

LEVEL 1

0 (0)

LEVEL 2

3 (13)

Figure 1: CFSRP Theory of Change

LEVEL 3

4 (21)

1 2

LEVEL 4

8 (30)

PROGRAM COMPONENTS

PROFESSIONAL DEVELOPMENT CLASSES

ON-SITE, INDIVIDUALIZED COACHING

FAMILY ENGAGEMENT

Center/Teacher Outcomes

Teachers improve teaching practices

Directors improve leadership and management practices

Improved center and classroom quality

(FIRST-ORDER) Child Outcomes (SECOND-ORDER)

Improved language and social-emotional skills in CFSRP children

CFSRP children are prepared to enter school

CFSRP children demonstrate academic success in school

DESCRIPTION RELATIONSHIP BUILDING BETWEEN CFSRP AND THE CENTER

Does not include professional development.

BASIC

Center participates for one year INTENSE

Center participates for three years SUSTAINABILITY

3 4 5

Snow, K. L. (2006). Measuring school readiness: conceptual and practical considerations. Early Educ. Dev. 17, 7–41. doi: 10.1207/s15566935eed1701_2 Reardon, S. F. & Portilla, X. A. (2016). Recent trends in income, racial, and ethic school readiness gaps at kindergarten entry. AERA Open 2(3), 1-18. doi: 10.1177/2332858416657343 Garcia, E. & Weiss, E. (2017). Education inequalities at the school starting gate. Economic Policy Institute. epi.org/132500 Magnuson, K.A., Meyers, M.K., Ruhm, C.J., & Waldfogel, J. (2004). Inequality in preschool education and school readiness. American Educational Research Journal. 41(1):115-157. doi:10.3102/00028312041001115 A theory of change provides an illustration of a program’s impact pathway—the logical causal change that is expected to occur as a result of program activities.

12

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Center participation begins after the third, intensity-level year and continues as long as the center remains in the program

Table 1: ‌Description of CFSRP Professional Development Levels

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

13

CENTER CHARACTERISTICS

NUMBER OF…

In the 2022-2023 school year, the CFSRP served 15 child development centers, reaching 196 staff members and 822 children in targeted areas of Fort Worth. Most participating centers were engaged in CFSRP Level 4 (53%). Of the 15 child development centers, three participated in Level 2 programming, four in Level 3 intensive support, and eight in Level 4 sustainability work.

Eleven centers (73%) also participated in Texas Rising Star (TRS) during the 2022-2023 school year; each of those centers rated either three or four stars (Table 2). Texas Rising Star is the quality rating and improvement system for Texas early childhood programs. All program receiving child care subsidy payments are required to participate in the TRS program.

Classrooms

Child Development Centers

Family Child Care Homes

Teachers and Directors

Children

2009–2010 (PILOT)

39

6

15

38

307

2011–2012

69

13

13

119

675

2012–2013

80

24

8

171

967

2013–2014

102

28

8

263

1,158

2014–2015

100

26

6

285

1,458

2015–2016

106

23

3

302

1,808

2016–2017

124

25

0

238

1,338

2017–2018

86

21

0

209

1,100

2018–2019

87

19

0

201

1,177

2019–2020

86

19

0

167

937

2020–2021

70

16

0

166

772

2021–2022

50

13

0

119

726

2022–2023

64

15

0

161

822

CENTER NAMES

Zip Code

CFSRP Level

TRS Level

Total Children

1

All Stars Early Learning Center

76120

LEVEL 3: INTENSE

LICENSED

68

2

Amazing Creations

76133

LEVEL 2: BASIC

4 STAR

83

3

Children’s Early Development

76111

LEVEL 4: SUSTAINING

LICENSED

30

4

Community of Hope

76119

LEVEL 2: BASIC

LICENSED

44

5

Faith Academy Learning Center

76103

LEVEL 3: INTENSE

3 STAR

8

6

Good Shepherd Christian Academy

76119

LEVEL 4: SUSTAINING

4 STAR

50

7

International Kids Academy

76134

LEVEL 2: BASIC

3 STAR

82

8

Joy Learning Palace

76103

LEVEL 4: SUSTAINING

4 STAR

42

9

Kiddyland Childcare

76133

LEVEL 4: SUSTAINING

4 STAR

56

10 Like My Own

76104

LEVEL 4: SUSTAINING

4 STAR

21

11

Little Tyke Creative Childcare

76112

LEVEL 4: SUSTAINING

3 STAR

70

12

Mother Goose

76164

LEVEL 4: SUSTAINING

4 STAR

23

13 One Safe Place

76104

LEVEL 3: INTENSE

4 STAR

43

(PILOT)

14

76120

LEVEL 3: INTENSE

LICENSED

85

09-10 11-12 12-13 13-14 14-15 15-16 16-17 17-18 18-19 19-20 20-21 21-22 22-23

76102

LEVEL 4: SUSTAINING

4 STAR

117

Temple Days

15 YMCA – Ella McFadden

14

YEAR

Table 3: Number of Centers, Classrooms, Staff, and Children served by the Camp Fire School Readiness Program, 2009-2010 (pilot) to 2022-2023.

2,000

Table 2: CFSRP Participating Centers, 2022-2023

1,500

Currently, CFSRP exclusively serves center-based providers, helping them to enhance the quality of the education they provide, strengthen classroom management and teacher-child interactions, and advance their Texas quality rating and improvement rating through TRS. The number of classrooms served in a year provides a strong indicator of CFSRP investment of time and money. The classrooms participating in the CFSRP in 2022-2023 were primarily single age group classrooms (84%). The number of classrooms participating in CFSRP in 2022-2023 increased somewhat, as three additional centers were supported, increasing the number of classrooms served. A trend from 2020-2021 and 2021-2022 showed declines in classrooms served, attributed to center closures due to teacher shortages and persistent low enrollment associated with the COVID-19 pandemic, as well as to shifting partner priorities. Seeing an increase in center support and classrooms participating show results trending back toward pre-pandemic counts.

1,000

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

SCHOOL YEAR

500

1,808 1,458 967 675

1,158

1,338 1,100

1,177 937

822 772

726

307

CHILDREN SERVED

Figure 2: CFSRP Children Served, 2009-2010 (pilot) to 2022-2023.

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

15

CHILDREN CHARACTERISTICS Center recruitment to CFSRP is designed to engage early education programs in targeted areas served by Fort Worth ISD. The CFSRP served a diverse set of 822 young children in the 2022-2023 school year (Table 4). Children are predominantly African American (58%), Caucasian (20%), or Hispanic/ Latino (15%), in keeping with prior years. Ages served are well balanced from infancy (27%) to prekindergarten (13%), with toddlers representing the greatest share (36%). The number of prekindergarten children continues to decline (down 8% since 2020-2021), most likely because of the number of options for free prekindergarten education provided through local school districts, including Fort Worth ISD.

CHARACTERISTIC

N (%)

CHARACTERISTIC

N (%)

Age Group INFANTS TODDLERS PRESCHOOL (3 YEAR OLDS) PREKINDERGARTEN (4-6 YEAR OLDS)

Education 225 300 189 104

(27%) (36%) (23%) (13%)

477 1 164 121 38 2

(58%) (0%) (20%) (15%) (5%) (0%)

385 423

(47%) (51%)

Race/Ethnicity AFRICAN AMERICAN ASIAN CAUCASIAN HISPANIC/LATINO MULTIRACIAL OTHER Gender FEMALE MALE

Table 4. CFSRP Children Characteristics, 2022-2023 (N=822)

EARLY CHILDHOOD CERTIFICATION (CDA, ECMI, DIRECTOR CERTIFICATE, ETC.) HIGH SCHOOL DIPLOMA OR GED SOME COLLEGE ASSOCIATE’S DEGREE BACHELOR’S DEGREE MASTER’S DEGREE NOT REPORTED

The CFSRP engages a variety of early childhood professionals—including center directors, lead teachers, assistant float classroom teachers, and others—in professional development and support to enhance quality of care and education. In approximate alignment with student demographics, 51% of staff supported by the CFSRP in 2022-2023 are African American, 15% are Caucasian, and 18% are Hispanic/Latino (Table 5); 88% of staff are female.

In general, early childhood staff in childcare centers have less formal training and education than those affiliated with school districts. Current Texas Child Care Regulation requires that child care providers have a High School diploma or General Education Development Test (GED) to work in child care settings. (https://public.tecpds.org/about-us/state-of-theece-workforce-report/2022-report/) Staff supported by the CFSRP follow this trend: most have less than an associate degree: 44% have a high school diploma or GED as their highest educational attainment, and 19% have some college but less than an associate degree. 19% have some type of childcare credential, generally a CDA. Years of experience in the field of childcare varied across staff, with 40% of staff having three years of experience or less and 20% having ten years or more. This division is generally consistent with prior years, with the most difference seen in the percentage of staff having ten years of more experience (32% in 2021-2022).

16

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

(19%)

86 37 12 15 2 45

(44%) (19%) (6%) (8%) (1%) (23%)

99 1 29 35 7 1 24

(51%) (1%) (15%) (18%) (4%) (1%) (12%)

Race/Ethnicity AFRICAN AMERICAN ASIAN CAUCASIAN HISPANIC/LATINO MULTI-RACIAL OTHER NOT REPORTED

Camp Fire assigns experienced mentors to support teachers in the program. These mentors provide teachers with guidance on best practices in the classroom, how to handle challenging situations, and how to support child development and provide high quality care in ageappropriate ways. Camp Fire had 13 mentors in 2022-2023, an increase to accommodate mentorship requirements with Camp Fire’s Early Education Apprenticeship Program. 62% of mentors had a master’s degree. Eight were African American, two were Caucasian, and three were either Hispanic/Latino, multi-racial, or other. Three had more than 10 years of childcare experience, and four had between seven and 10 years of experience. Additionally, in 2022-2023 there were two mentors with 7-10 years of experience with CFSRP (see Table 6).

CHARACTERISTIC

ASSOCIATE’S DEGREE BACHELOR’S DEGREE MASTER’S DEGREE UNKNOWN

(88%) (4%) (9%)

Years of Childcare Experience 29 49 23 12 40 43

(15%) (25%) (12%) (6%) (20%) (22%)

92 49 19 13 21 2

(47%) (25%) (10%) (7%) (11%) (1%)

Years with CFSRP LESS THAN 1 YEAR 1-3 YEARS 4-6 YEARS 7-10 YEARS MORE THAN 10 YEARS NOT REPORTED Table 5. CFSRP Staff Characteristics, 2022-2023 (N=196)

2 2 8 1

(15%) (15%) (62%) (8%)

Race/Ethnicity 172 7 17

LESS THAN 1 YEAR 1-3 YEARS 4-6 YEARS 7-10 YEARS MORE THAN 10 YEARS NOT REPORTED

N (%)

Education

Gender FEMALE MALE NOT REPORTED

STAFF CHARACTERISTICS

37

MENTOR CHARACTERISTICS

AFRICAN AMERICAN CAUCASIAN HISPANIC/LATINO MULTI-RACIAL UNKNOWN

8 2 1 1 1

(62%) (15%) (13%) (8%) (8%)

13 0

(100%) (0%)

Gender FEMALE MALE

Years of Childcare Experience 7-10 YEARS MORE THAN 10 YEARS

10 3

(77%) (23%)

Years with CFSRP LESS THAN 1 YEAR 1-3 YEARS 4-6 YEARS 7-10 YEARS

7 3 1 2

(54%) (23%) (8%) (15%)

Table 6. CFSRP Mentor Characteristics, 2022-2023 (N=13)

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

17

Program Implementation

6

Process evaluation describes the extent to which the CFSRP program implemented program activities as intended and how those activities resulted in the expected program outcomes. Findings from a process evaluation enable Camp Fire to determine which aspects of the program are working as expected, and which processes require additional support and clarification to be most effective.

TEACHER RETENTION BEGINNING OF YEAR (BOY) TO END OF YEAR (EOY)

CHILD RETENTION (BOY TO EOY) Continuity of care—in terms of having a consistent learning environment as well as maintaining healthy relationships with a consistent adult—is a critical element of early childhood learning and development. 14,15 Additionally, because Camp Fire measures developmental change from beginning of year to end of year, stable class enrollment is imperative to understanding child and program outcomes. From fall 2022 to spring 2023, CFSRP centers retained 549 of 822 children for 67% retention, a lower rate than in recent years (Figure 4).

Upon further exploration into child retention rates during 2022-2023, CFSRP children trended from highest to lowest retention among toddlers (73%), 3-year-olds (67%), infants (64%), and lastly, preschoolers (55%). The lowest retention among preschoolers is expected since 4-year-olds are eligible for free, full-day prekindergarten programs at FWISD locations. Like teacher retention rates, higher child retention rates were seen for children at centers and classrooms more developed through CFSRP support; 55% at Level 2 centers, 79% at Level 3 centers, and 67% at Level 4 centers.

Low teacher retention is a persistent challenge to providing high-quality early childhood care and education. Turnover adds program expenses, increases staff burdens, and can harm child development.7 Children benefit from having a secure attachment to caregivers;8 thus, teacher turnover within a school year has been negatively associated with children’s language, literacy, and social-emotional development, while teacher retention is linked to better outcomes for children.9,10,11 Further, teacher turnover is highest among the types of centers CFSRP serves: centers that are not school district-sponsored or otherwise publicly funded.12

SCHOOL YEAR 14-15 15-16 16-17 17-18 18-19 19-20 20-21 21-22 22-23

Teacher turnover rates in all areas nationwide have risen in recent years and Texas has experienced one of the highest turnover rates in early childhood education in the nation at 20%.13 Low wages are cited as the primary reason for high turnover, with challenging working conditions and lack of administrative support as additional factors. In many cases, early childhood educators can earn more money in an unrelated field, increasing the challenge of hiring staff.

100%

In the context of state and national teacher retention trends, CFSRP teachers showed above-average employment stability. Of the 136 CFSRP teachers employed during the 2022-2023 school year, 108 remained at their childcare center from beginning to end of year, for a 79% retention rate (see Figure 3).13 Teacher retention rates for the program are typical for the CFSRP in recent years and exceed those expected industry-wide in regular years as well as during the pandemic.

60%

Upon further exploration into teacher retention rates during 2022-2023, CFSRP teachers showed higher retention rates among teachers with more years of childcare experience; 65% for teachers with less than 1 year of childcare experience, 78% for teachers with between 1-6 years, and 100% for teachers with 7+ years of childcare experience. Similarly, higher teacher retention rates were seen for teachers at centers and classrooms more developed through CFSRP support; 54% at Level 2 centers, 91% at Level 3 centers, and 87% at Level 4 centers. According to the end-of-year survey distributed to teachers, survey participants reported that their biggest motivators for staying with the center were relationships with children and families (74%) and relationships with staff (48%).

20%

86%

79%

80% 64%

79%

71%

77%

91%

79%

74%

40%

0% Figure 3: CFSRP Teacher Retention Rates from BOY to EOY, 2014-2015 to 2022-2023

15-16 16-17 17-18 18-19 19-20 20-21 21-22 22-23 6 7

A description of the methods used for this report are provided in Appendix B. Buffett Early Childhood Institute at the University of Nebraska. (2018). Early childhood teacher turnover in Nebraska. https://buffettinstitute.nebraska.edu/-/ media/beci/docs/early-childhood-teacher-turnover-in-nebraska-new.pdf8 Garcia, E. & Weiss, E. (2017). Education inequalities at the school starting gate.

Economic Policy Institute. epi.org/132500 8 Folbre, N. (2012). For Love or Money. New York: Russell Sage Foundation.

9 Markowitz, A. J. (2019). Within-year teacher turnover in Head Start and children’s school readiness. EdPolicyWorks, University of Virginia. https://curry.virginia. edu/sites/default/files/uploads/epw/70_Teacher_Turnover_in_Head_Start.pdf 10 Hamre, B., Hatfield, B., Pianta, R., & Jamil, F. (2014). Evidence for general and domain-specific elements of teacher-child interactions: Associations with preschool children’s development. Child Development, 85(3), 1257-1274.

11 Hale-Jinks, C., Knopf, H., & Kemple, K. (2006). Tackling teacher turnover in childcare: Understanding causes and consequences, identifying solutions. Childhood Education, 82(4), 219–226.

12 Grunewald, R., Nunn, R., Palmer, V. (2022). Examining teacher turnover in early care and education. Federal Reserve Bank of Minneapolis. https://www. minneapolisfed.org/article/2022/examining-teacher-turnover-in-early-care-and-education 13 Retention rates during the 2019-2020 school year were artificially high due to centers keeping teachers on staff, in hiatus, during the coronavirus pandemic.

Not all teachers on the staff lists were not actually present in childcare centers. This unique situation led to an artificially high retention rate on paper, in spite of having fewer children to serve in spring 2020. Delohery, Caitlin. Turnover Rate for Early Childhood Education Jobs in Texas: Overview, texestest.org, 2024 14 Sabol, T.J. & Pianta, R.C. (2012). Recent trends in research on teacher-child relationships. Attachment & Human Development 14(3). doi: 10.1080/14616734.2012.672262 15 Curby, T.W., Grimm, K.J., & Pianta, R.C. (2010). Stability and change in early childhood classroom interactions during the first two hours of a day. Early Childhood Research Quarterly 25(3): 373-384. doi: 10.1016/j.ecresq.2010.02.004

18

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

100% 80%

73%

74% 74%

60% 40%

88%

80%

72%

67%

42%

20% 0% Figure 4: CFSRP Student Retention Rates from BOY to EOY, 2015-2016 to 2022-2023 Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

19

TEACHER AND DIRECTOR PROFESSIONAL DEVELOPMENT PARTICIPATION A key element of the CFSRP is professional development for center teachers and directors. Teachers can increase their knowledge and skills related to classroom management and child development through foundational professional development and the Early Education Institute (EEI) courses the CFSRP provides. Directors and Assistant Directors can increase their knowledge of leadership practices, business management, and child development through the CFSRP Director’s Institute (DI). In 2022-2023, professional development was offered both virtually and in person. Of 196 staff people participating in the CFSRP, 178 (91%) participated in EEI and/or foundational professional development. Professional development participation for staff across center level shows the highest percentage of participation at Level 4 centers (91%); 53% at Level 2 centers and 85% at Level 3 centers.

TEACHER AND DIRECTOR STIPENDS In the 2022-2023 school year, within CFSRP, directors of Level 4 centers and mentor teachers were eligible to receive stipends of $500 each at the end of the school year, based on completion of agreed upon leadership and mentoring duties. A total of 45 CFSRP mentor teachers and directors received stipends in 2022-2023 (87% of eligible educators).

ONE-ON-ONE MENTOR ACTIVITY CFSRP mentors typically provide on-site, individualized coaching to teachers and directors. Mentors help integrate assessment results into teacher action plans, improve the use of best practices in teaching and classroom management, and coach teachers and directors on how to provide quality education.

One-on-one mentoring activities in the 2022-2023 school year continued to utilize strategies developed during the pandemic for virtual interaction, such as introducing the use of Bluetooth and tablets to provide real-time coaching in addition to side-by-side work. Table 7 summarizes the CFSRP’s key mentoring activities and the number of visits in which mentors focused on each activity.

Consistent with 2021-2022, mentors were especially supportive of teacher reflective follow-up on situations encountered in the classroom with classroom observation. Trending over the last couple of years, the total number of visit activities continues to increase (93% more visit activities performed in 2022-2023 compared to 2021-2022) as mentors had greater ability to conduct visits in person and additional mentors were onboarded for CFSRP.

TYPE OF VISIT ACTIVITY

NUMBER OF ACTIVITIES

PERCENTAGE OF ACTIVITIES

1

OBSERVING

443

28.8%

2

REFLECTIVE FOLLOW UP

375

24%

3

MODELING

208

13.3%

4

INSTRUCTIONAL PLANNING

168

10.7%

5

PHYSICAL CLASSROOM ENVIRONMENT

157

10.0%

6

SIDE-BY-SIDE COACHING

92

5.9%

7

HELP WITH CHILD ASSESSMENTS

65

4.2%

8

PROBLEM SOLVING TO GENERATE OPTIONS*

37

2.4%

9

CO-TEACHING

16

1.0%

10

FAMILY ENGAGEMENT*

5

0.3%

1,566

100.0%

TOTAL

*Activity only relevant to director mentoring visits.

Table 7: Mentor Activities, 2022-2023

20

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Child Outcomes

16 ASQ DEVELOPMENTAL DOMAIN

The CFSRP measures its success in helping children attain age-appropriate developmental, early literacy, and social-emotional skills through consistent use of validated assessments. For younger children, key outcomes are developmental: gross and fine motor skills, communication, problem solving, and personal-social skills. For prekindergarten students, key outcomes are academic and developmental: literacy, numeracy, and social-emotional skills. For all children, social-emotional outcomes are an additional outcome and dimension of childhood development that supports school readiness. Descriptions of the assessments used to measure child outcomes are available in Appendix C.

Infants (N=42) TARGET

Each year, to determine the program’s level of success in each of these domains, CFSRP staff set targets for the percent of children developmentally on-target at the end of the year. This evaluation assesses the extent to which these targets are met and how much individual children maintain and/or improve their developmental skills.

Toddlers (N=104)

BOY ACTUAL EOY ACTUAL

TARGET

BOY ACTUAL EOY ACTUAL

COMMUNICATION SKILLS

65%

50%

55%

80%

64%

65%

FINE MOTOR SKILLS

70%

74%

57%

70%

62%

52%

GROSS MOTOR SKILLS

75%

76%

78%

85%

85%

81%

PERSONAL-SOCIAL SKILLS

70%

52%

43%

80%

61%

70%

PROBLEM SOLVING SKILLS

70%

50%

53%

80%

60%

64%

*Shaded end of year figures met or exceeded the year’s target.

Table 8: CFSRP Infant and Toddler Development Outcome Targets Versus Actual (ASQ®-3), 2022-2023

INFANTS AND TODDLERS: CHILD DEVELOPMENT Center teachers administered the Ages and Stages Questionnaire (ASQ®-3) to infants and toddlers ages 0-3 at the beginning and end of the program year to screen for potential developmental concerns. Developmental concerns are identified when a child scores below the cut-off in at least one of the ASQ®-3’s five developmental domains (i.e., problem solving, communication, fine motor, gross motor, and personal-social skills). When developmental concerns are identified, center staff use the screening results to implement individualized instruction in their classrooms and refer families to external support services if the concerns are more severe.

Figure 5: Percentage of Infants Demonstrating Age-Appropriate Skills by Assessment Area (ASQ®-3), 2022-2023 (N=42)

In the aggregate, infants in CFSRP classrooms demonstrated developmental progress in three of the five domains (communication, gross motor and problem solving) from beginning to end of year but showed less developmental progress in fine motor and personal-social skills (Figure 5). Similarly, toddlers demonstrated developmental progress in communication, personal-social skills and problem-solving skills, but showed a decrease in gross and fine motor skills from beginning to end of year (Figure 6).

100 80

Because the ASQ is used as a screening tool for developmental concerns, it is designed to be used in six-month increments. Teachers use the tool that is closest to the child’s current age, so not all children in an infant or toddler classroom receive the same screening.

60

End-of-year targets were met in only one category – gross motor skills for infants (Figure 8).

% OF CHILDREN DEVELOPMENTALLY ON-TARGET AT END-OF-YEAR

®

50

85 81

76 78

74 55

Figure 6: Percentage of Toddlers Demonstrating Age-Appropriate Skills by Assessment Area (ASQ®-3), 2022-2023 (N=105)

57

52

40

43

50 53

64 65

62

Communication

Fine Motor

61

52

70

60 64

20 % OF CHILDREN 0 Communication 16

22

Fine Motor

Gross Motor

Personal- Problem Social Solving

Gross Motor

Personal- Problem Social Solving

A description of CFSRP assessments is provided in Appendix C.

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

23

PREKINDERGARTEN CHILDREN: MATH AND LITERACY

CPALLS+ DEVELOPMENTAL DOMAIN

Center teachers administered the CPALLS+ assessment to children ages three-and-a-half through five to assess their listening skills, ability to determine if two words rhyme (rhyming 1), ability to independently present a word that rhymes with a given word (rhyming 2), and early math skills. Rhyming 2 is one of the most challenging skills to master, and many children may not master Rhyming 2 skills until they turn five or six years old. For the purposes of the evaluation, the results for four- and five-year-old children (i.e., prekindergarten) are considered.

85

40

Figure 8: Percentage of 4- and 5-Year-Old Children Improving or Making Acceptable Progress from BOY to EOY (CPALLS+), 2022-2023 (N=34)

85%

RHYMING 1

80%

74%

RHYMING 2

60%

63%

MATH

95%

97%

Center teachers administered the Devereux Early Childhood Assessment (DECA) to infant, toddler, and prekindergarten children at CFSRP-supported centers participating at Level 3 and 4.17 The DECA identifies whether children’s social-emotional skills need intervention (need), are within typical range for their age (typical) or exceed the typical range (strength).

Listening

The percentage of infants and toddlers in the “strengths” category decreased (infants) or held steady (toddlers) from beginning to end of year, but the number of infants showing typical development increased and the number of toddlers showing typical development decreased only slightly. Percentages for preschool children remained relatively steady, with a small decrease of strength from beginning to end of year and a small increase of typical growth during the same period.

97 85

88 74

71

63

50 40

63

BOY

40

Math

BOY

50 40

EOY

The number of infants showing need decreased over the program year, indicating that appropriate supports were offered to address developmental needs. Toddler children show a slight increase in need during the program year and preschool children show little change (Figure 9). From the beginning to end of year, 46% of infants, 41% of toddlers, and 49% of prekindergarten students showed improvement in their DECA score.

EOY

20

BOY EOY

0

Listening 100 Rhyming 2 Rhyming

Math

STRENGTH TYPICAL NEED

Rhyming Rhyming 2 100

88

88 80

80 60

62

% OF CHILDREN 9 9

20

30 29

27 22

52 48

55

8

18 22

18 17

Infants (N=21)

Toddlers (N=65)

Preschool (N=119)

60

41

40

40

54 38

80

60

62

23

24

90%

60

20 100

LISTENING

74

71

60

% OF CHILDREN

EOY ACTUAL

80

88

Figure 7: Percentage of 4- and 5-YearOld Children Developmentally OnTarget at BOY and EOY (CPALLS+), 2022-2023 (N=34)

0

TARGET

100

97

100

ALL AGES: SOCIAL-EMOTIONAL DEVELOPMENT

Prekindergarteners (N=34)

Table 9: CFSRP Prekindergarten Development Outcome Goals versus Actual (CPALLS+), 2022-2023

The increase in the percentage of 4- and 5-year-old children making acceptable progress from beginning to end of year was significant across all domains, with Rhyming and Rhyming 2 increasing by 24% and 23%, respectively. Although children showed the lowest growth in math skills (9%), the end of year percentage of children making acceptable progress was an impressive 97% (Figures 7 and 8).

80

% OF CHILDREN DEVELOPMENTALLY ON-TARGET AT END-OF-YEAR

23 32

41

32 30 33 30 9 3 0 7 Math Rhyming 2

18

9 18 6 9 20 % OF 9 0 6 CHILDREN 3 0 Listening Rhyming 0 Listening Math Rhyming IMPROVED NO CHANGE: NEEDS MORE MAKING ACCEPTABLE NO CHANGE: IMPROVED MAKING NO CHANGE: DECLINED PROGRESS IMPROVED ASSISTANCE ACCEPTABLE PROGRESS NO CHANGE: NEEDS MORE ASSISTANCE NO CHANGE: MAKING ACCEPTABLE PROGRESS DECLINED NO CHANGE: NEEDS MORE ASSISTANCE DECLINED

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

30 33 30 % OF 7

CHILDREN

Rhyming 2

40

61

54 29

20 0

17

17 Eleven of the 15 centers were able to successfully administer the DECA in 2022-2023.

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

25

Classroom and Center Outcomes

CLASS™ DOMAIN

QUALITY THRESHOLD

MEASURES TEACHERS’ ABILITY TO… Infant Classrooms

CLASSROOM ENVIRONMENT QUALITY The Classroom Assessment Scoring System (CLASS™) is a widely used measure of the quality of teacher-child interactions in center-based early childhood programs. CLASS observations were conducted by certified Camp Fire staff at the end of the program year in a portion of infant, toddler, and PreK classrooms.18 Different domains are captured based on the developmental stage of the children in the classroom. In infant classrooms, CLASS™ measures teacher ability to respond to and interact with infants during play, routine care, and other activities (responsive caregiving). In toddler classrooms, it measures teachers’ ability to promote intentional, prosocial interactions that encourage children’s capacity for self-regulation and social skills (emotional-behavioral support) and teachers’ ability to promote emerging, expressive language skills in children (engaged support for learning). In preschool classrooms, it measures teacher ability to foster positive relationships and respond to children’s emotions or interests (emotional support); set clear behavioral guidelines and maintain a classroom that supports children’s interactions with teachers and peers through the effective management of children’s time, behavior, and attention (classroom organization); and help children learn to solve problems, develop more complex language skills, and use feedback to deepen children’s skills and knowledge (instructional support). Empirical studies have shown positive outcomes for children in classrooms with high CLASS™ assessment ratings.19, 20 Studies have also provided evidence of a threshold effect indicating a minimal level at which classroom quality in preschool classrooms is met to achieve positive student outcomes.21, 22 A description of the teacher-student interaction domains CLASS™ captures and associated quality thresholds is available in Table 10.

In 2022-2023, Camp Fire relied on third party providers to participate in the Texas Rising Star (TRS) program recommendation that quality early childhood centers participate in CLASS assessments. They discovered that some centers did not choose to follow the TRS recommendations and did not welcome CLASS observers into centers for classroom assessment. Eight of the 15 centers participating in the CFSRP completed CLASS™ assessments at the end of year. Barriers to completion on schedule included teacher turnover, which delayed training, lack of assessments completed

by TRS CLASS observers and administration timelines.23 CLASS™ provides ratings that place the quality of teacher-child interactions in a high (5.6 or above), mid (3.0 to 5.5) or low range. Camp Fire thresholds include scoring in the mid-quality range or higher in all domains. It expects an overall increase from beginning to end of year in each CLASS™ domain for infant, toddler, and preschool classrooms. Due to limited assessments results in the beginning of year 2022-2023, the end of year results for 2022-2023 will be directly compared with end of year results in 2021-2022 (Figure 10).

RESPONSIVE CAREGIVING Respond to and interact with infants during play, routine care and other activities Toddler Classrooms EMOTIONAL-BEHAVIORAL Promote intentional, prosocial interactions that encourage children’s capacity for self-regulation and SUPPORT social skills ENGAGED SUPPORT

18 19

In 2022 the decision was made to conduct CLASS observations only at EOY rather than BOY and EOY. Carr, R., Mokrova, I., Vernon-Feagans, Burchinal, M. (2019). Cumulative classroom quality during prekindergarten and kindergarten and children’s language, literacy, and mathematics skills. Early Childhood Research Quarterly, 47, 218-228.

20 Vitiello, V. E., Bassok, D., Hamre, B. K., Player, D., & Williford, A. P. (2018). Measuring the quality of teacher–child interactions at scale: Comparing researchbased and state observation approaches. Early Childhood Research Quarterly, 44(3), 161-169.

21 Burchinal, M., Vandergrift, N., Pianta, R., & Mashburn, A. (2010). Threshold analysis of association between childcare quality and child outcomes for low-income children in prekindergarten programs. Early Childhood Research Quarterly, 25, 166-176.

22 For Pre-K CLASSTM, the quality threshold is set at 5 for the Emotional Support and Classroom Organization domains, and at 3.25 for the Instructional Support domain. For infants and toddlers, scores of 3 to 5 indicate a mix of effective teacher-child interactions, while scores of 6 to 7 indicate consistently effective teacher-child interactions.

23 The centers that were not able to complete CLASSTM assessments at the end of year in 2022-2023 include Amazing Creations, Faith Academy Learning Center, International Kids Academy, Kiddyland Childcare, Mother Goose, and Temple Days.

26

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Promote emerging, expressive language skills in children

NA NA

Preschool Classrooms

Foster positive relationships and respond to children’s emotions or interests

5.00

CLASSROOM ORGANIZATION

Set clear behavioral guidelines and maintain a classroom that supports children’s interactions with teachers and peers through the effective management of children’s time, behavior, and attention

5.00

INSTRUCTIONAL SUPPORT

Help children learn to solve problems, develop more complex language skills, and use feedback to deepen children’s skills and knowledge

3.25

EMOTIONAL SUPPORT

Table 10: CLASS™ Domain Descriptions

INFANT CLASSROOMS (N=5)

At the end of year 2022-2023, CLASS™ scores for infant classrooms showed higher average scores than seen in 2021-2022 (+0.7 points), while toddler classrooms showed similar end-of-year results across both years. CLASS™ scores for pre-K classrooms showed increased averages in emotional support compared to the prior year but showed lower average scores in classroom organization and instructional support. National quality thresholds are defined for preschool classrooms, and Camp Fire goals include meeting those thresholds. At the end of the year, average preschool CLASS™ scores met the quality threshold for classroom organization but fell short in emotional support and instructional support (Figure 11).

The small number of classrooms observed makes it difficult to draw significant conclusions on overall classroom quality. Camp Fire will restructure the CLASS observation process for the 2023-2024 program year.

NA

AVERAGE CLASS SCORE

6 5 4 3 2 1 0

4.4

5.1

TODDLER CLASSROOMS (N=9)

PRESCHOOL CLASSROOMS (N=2)

5.3 4.4 4.2 3.2 3.2

4.6 4.9 3.6

3.1 2.0

Responsive Caregiver

Emotional Engaged and Behavioral Support Support for Learning

Classroom Organi- Emotional zation Support

Intructional Support

Figure 10: CFSRP Classroom Environment and Management at EOY (CLASS™), 2021-2022 and 2022-2023

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

27

CFSRP Contributions to School Readiness

CHILDCARE CENTER QUALITY The Program Administration Scale (PAS) is a research-based instrument that captures childcare center leadership and management quality. Each CFSRP-supported center was assessed by the director and director’s mentor to identify areas of strength and improvement. CFSRP staff identified three focal areas: child assessments, program planning and evaluation, and family partnerships. Collectively, CFSRP-supported centers exhibited mixed results within all three areas, with the greatest improvements in program evaluation. Small improvements were also made in strategic planning and family communication. Slight decreases were seen in screening and identifying special needs, assessment in support of learning, and family support and involvement (Figure 12).

AVERAGE SCORE

7 6 5 4 3 2 1 0

FAMILY PARTNERSHIPS

4.4

CHILD ASSESSMENTS

PROGRAM PLANNING AND EVALUATION

3.9

3.4

3.9

3.7

Family Support and Family Involvement Communications

2.8 3.0

80 2.7

2.4

1.6

Program Evaluation

Strategic Planning

PREKINDERGARTEN LITERACY SKILLS (FALL 2023) FWISD administers the Circle Progress Monitoring Tool (CIRCLE)24 to prekindergarten students at the beginning of each year to identify specific early literacy skills that the children have (or have not) developed.

Teachers use the CIRCLE results to plan instruction targeting individual student needs.

Figure 12 shows comparisons of the CIRCLE results for the children who attended a CFSRP center in the year prior to entering prekindergarten and their demographically similar comparison group. Although CIRCLE assesses multiple early literacy skills, the results reported in Figure 12 are for early literacy skills the CFSRP teachers focus on in their early childhood classrooms.

Descriptive analyses revealed higher percentages of CFSRP students on target for Letter Naming, Vocabulary and Listening skills. Appendix F shows results of the group comparisons of prekindergarten early literacy skills since 2018. Each year the CFSRP children had higher performance on measures of Letter Naming, Vocabulary and Listening Skills. The comparison group had higher ratings for Phonological Awareness.

100

4.7

1.2

Screening & Identification of Special Needs

Figure 11: Center Management Scores at BOY and EOY (PAS), 2022-2023 (N=15)

28

The CFSRP also measures its success in terms of children’s school readiness upon entering Fort Worth Independent School District (FWISD) prekindergarten or kindergarten and continued academic progress through third grade. Using results from FWISD assessments already in place, the evaluation examines student performance comparing cohorts of CFSRP children currently in grades prekindergarten through three to demographically similar groups of children who did not attend a CFSRP center.

The comparison groups were randomly selected and matched for school, grade level, socio-economic status, ethnicity, and gender.

For prekindergarten and kindergarten students, the evaluation compares results of assessments administered at the beginning of the year. For each subsequent grade level, the results are from assessments administered at the end of each year. Where enough students in the CFSRP group were available (≥40), statistical analyses were used to determine if any observed differences are statistically significant. Otherwise, differences of 5 percentage points or greater are noted. Additional information about each assessment is included in the sections below and in Appendix D. Appendix D also describes the matching process. Appendix E shows the demographic characteristics of the CFSRP students and their comparison groups.

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Assessment in Support of Learning

CFSRP (N=34) COMP. (N=95) % ON TRACK

60 40 20 0

66.7

64.1 53.8 42.3

*Smaller group sizes for this item (CFSRP n=20; Comp. n=64)

72.3

Figure 12: Comparison of Prekindergarten Early Literacy Skills (Fall 2023)

50.0 33.3 23.1 22.1

12.8 10.6

15.0

Letter Vocabulary Phon. Syllabication Rhyming I Listening* Naming Awareness

24 CIRCLE is a criterion-referenced assessment that identifies students who are on-track, need monitoring, or need support for their early literacy and social emotional skills. CLI Engage (2017). CIRCLE Progress Monitoring System. https://cliengage.org/public/tools/assessment/circle-progress-monitoring/.

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

29

KINDERGARTEN READINESS (FALL 2023) Figure 13 shows the comparisons for the KEA language and literacy measures and Figure 14 shows the comparisons for the KEA social competence measures.

Kindergarten Assessments FWISD administers the Texas Kindergarten Entry Assessment (TX-KEA)25 and the MAP® Reading Fluency™26 and Growth™27 assessments to kindergarten students at the beginning of each year. As with the prekindergarten assessments, these assessments are screening tools that help teachers plan instruction that targets individual student needs.

The MAP® Reading Fluency™ and Growth™ assessments each measure slightly different aspects of children’s reading ability. MAP® Reading Fluency™ assesses the extent to which students have mastered specific grade level reading skills. MAP® Reading Growth™ assesses children’s ability to use their reading skills for learning. For the current evaluation, the comparison group excluded children who attended FWISD prekindergarten in the prior year.

• The CFSRP group included kindergarten students who attended a CFSRP centers for prekindergarten in 2022-2023 or as 3-yearolds28, in 2021-2022, and • The comparison group included students who did not attend FWISD prekindergarten in the prior year or a CFSRP center at any time.

25 TX-KEA is a screening tool designed to assess whether kindergarten students are on-track with their literacy and social emotional skills. TX-KEA meets the Texas Educations Agency requirement for school districts to administer a Kindergarten assessment for all Kindergarten students. https://www.texaskea.org/.

26 MAP® Reading Fluency™ is an online screening and progress monitoring tool that assesses basic reading skills with an emphasis on oral fluency (e.g., listening comprehension, words per minute, accuracy, decoding). Students receive a rating of below, approaching, meeting, or exceeding grade level expectations. https://www.nwea.org/map-reading-fluency/.

27 The Kindergarten MAP® Reading Growth™ is a standardized, norm referenced assessment that also focuses on early literacy including reading comprehension and use of vocabulary. Students are rated as low, low average, average high average or high, based on the performance of a national sample. https://www.nwea. org/map-growth/.

28 Some CFSRP students entered prekindergarten in FWISD once they turned 4 years old while others remained at a CFSRP center for their prekindergarten year.

29 Although TX-KEA includes additional literacy measures as well as math measures, the evaluation focuses on overall language and literacy scores and on 5 specific skills identified by CFSRP staff as most important for kindergarten readiness.

30

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

LITERACY 80.0

80 CFSRP (N=39) COMP. (N=83) % ON TARGET

65.0 61.4

60 40

56.4

0

56.4

55.0

37.5 36.1

53.8

42.0

43.9

26.8

23.5

20 OVERALL Vocabulary Listen.

Comp.

OVERALL

Letter Names

Letter Sounds

32.1

Blending

Figure 13: Comparison of Kindergarten Early Literacy Skills (TX-KEA, Fall 2023)

For Language skills, descriptive analyses revealed that CFSRP children had higher ratings for Listening Comprehension measures relative to students who had never attended a CFSRP center or FWISD prekindergarten. The ratings for Overall Language and Vocabulary are similar for both groups. For Literacy skills, the CFSRP children had higher ratings for all measures.

For Social Competence skills, like the prior year results, descriptive analyses revealed higher ratings for the CFSRP students for Inhibition and Social Emotional skills. However, also like the prior year results, the comparison group received higher ratings for Emotional Management skills. See Appendix G for results of the analyses from prior years.

LANGUAGE

100

100

EXECUTIVE FUNCTION

80 CFSRP (N=34) COMP. (N=32) % ON TARGET

60

SOCIAL EMOTIONAL 76.7

56.0 53.5

40

64.0 67.8 48.0

75.0

68.7 60.0

42.8

20 0

Working Memory

Inhibition

Attention

Social Emotional Emotional Management

Figure 14: Comparison of Kindergarten Social Competence Skills (TX-KEA, Fall 2023)

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

31

DECODING SKILLS MAP® Reading Fluency™ and Growth™ Results (Fall 2023) Table 11 shows the percentages of children in each group rated below, approaches, meets, or exceeds grade level expectations for the MAP® Fluency™ measures. CFSRP students had higher percentages of students at or above grade level expectations than the comparison group for three of the four measures (Phonological Awareness, Phonics and Listening Comprehension (highlighted in green). The differences were statistically significant for Phonological Awareness and Word Recognition. The ratings were similar for both groups (highlighted in yellow) on Picture Vocabulary measures. These results are similar to prior years when the CFSRP students had higher ratings on the majority of MAP® Fluency™ measures (see Appendix H).

MAP® Reading Growth™Results MAP® Reading Growth™. Table 12 shows the percentage of children rated as low, low-average, average, high-average or high (compared to a national sample) on the MAP® Reading Growth™ measures.

As in Fall 2022 (see Appendix H), the CFSRP higher percentages of students were at or above average for Overall Reading Achievement and for Reading and Writing Skills. The two groups showed similar performance on the comprehension measures.

Table 11: Comparison of Kindergarten Reading Fluency Skills (MAP® Fluency™, Fall 2023)

BELOW APPROACHING MEETS EXCEEDS AT/ABOVE

% At Each Level: Phonological Awareness CFSRP (N=49) COMP. (N=138) 0% 0% 16.3% 40.6% 30.6% 11.6% 53.1% 47.8% 83.7% 59.4%

LANGUAGE SKILLS

Table 11a: Comparison of Kindergarten Reading Fluency Skills (MAP® Fluency™, Fall 2023)

RATING

RATING BELOW APPROACHING MEETS EXCEEDS AT/ABOVE

% At Each Level: Listening Comprehension CFSRP (N=49) COMP. (N=138) 34.7% 34.1% 8.2% 21.0% 34.7% 31.2% 22.4% 13.8% 57.1% 45.3%

% At Each Level Expectations: Phonics/Word Recognition CFSRP (N=49) COMP. (N=138) 0% 0% 18.4% 44.9% 44.9% 29.7% 36.7% 25.4% 81.6% 55.1%

% At Each Level: Picture Vocabulary CFSRP (N=49) COMP. (N=138) 24.5% 25.4% 14.3% 17.4% 28.6% 26.8% 32.7% 30.4% 61.2% 57.2%

OVERALL ACHIEVEMENT QUINTILE

CFSRP (N=55)

COMP. (N=161)

LOW LOW AVERAGE AVERAGE HIGH AVERAGE HIGH AT/ABOVE

10.9% 25.5% 27.3% 27.3% 9.1% 63.6%

18.5% 23.5% 29.0% 16.0% 13.0% 58.0%

Table 12: Comparison of Kindergarten Achievement (MAP® Reading Growth™, Fall 2023)

FOUNDATIONAL SKILLS QUINTILE LOW LOW AVERAGE AVERAGE HIGH AVERAGE HIGH AT/ABOVE

% At Each Quintile: Reading/Writing CFSRP (N=55) COMP. (N=161) 12.7% 21.7% 32.7% 29.8% 18.2% 24.8% 18.2% 13.7% 18.2% 9.9% 54.5% 48.4%

% At Each Quintile: Vocabulary CFSRP (N=55) COMP. (N=161) 23.6% 14.9% 18.2% 22.4% 30.9% 19.9% 20.0% 25.5% 7.3% 17.4% 58.2% 62.7%

CONTINUED ACADEMIC SUCCESS The current evaluation uses the MAP® Reading Growth™ Assessment to measure student achievement at the end of each year and to measure student growth over time30. For kindergarten, first and second grade students, the MAP® assessments have replaced the ITBS. For third grade students, the MAP® Reading Growth™ assessment presents an alternative to STAAR for several reasons, primarily because it provides consistent measures from one grade level to the next as well as standardized measures and measures of academic growth.31 As with the analyses of the prekindergarten and kindergarten readiness assessments, analyses of the MAP® Reading Growth™ assessments compare results of the CFSRP students at each grade level with a demographically similar group of students who did not attend one of the CFSRP centers. The results for kindergarten, first, and second grade groups are shown in Table 13. For these groups, the comparisons are made using a cross-sectional design as in prior years. They are not longitudinal samples that follow the same students from year to year.

However, for third grade, the current evaluation uses a longitudinal approach. The students in the 3rd grade CFSRP and comparison groups were also in FWSID in their kindergarten year. With this approach, the CFSRP and Comparison Group students had likely all been in FWISD since kindergarten, providing even more similar groups for the comparisons. Figures 15 shows these results. For both the cross-sectional and longitudinal comparisons, the results identify: • the percentage of students at or above average grade level achievement at the end of each year based on the national normed sample, • the percentage of students who met their growth targets at the end of each year, and • the percentage of students with average or above average growth by the end of each school year compared to the national sample.

COMPREHENSION SKILLS QUINTILE LOW LOW AVERAGE AVERAGE HIGH AVERAGE HIGH AT/ABOVE

32

% At Each Quintile: Analyzing Text CFSRP (N=55) COMP. (N=161) 10.9% 16.7% 27.3% 21.0% 27.3% 21.6% 29.1% 22.8% 5.5% 17.9% 61.8% 62.3%

% At Each Quintile: Comprehension CFSRP (N=55) COMP. (N=161) 10.9% 21.0% 40.0% 30.2% 25.5% 25.9% 12.7% 11.7% 10.9% 11.1% 49.1% 48.8%

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

30 RP also reviewed results of the MAP® Fluency™ and MAP Math Growth™ Assessments for internal use.

31 Differences include the following: (1) STAAR is a criterion referenced assessment measuring whether a student meets a designated grade level standard at a given time. (2) As a standardized assessment, MAP® Reading Growth™ provides measures of end-of-year student achievement relative to other similar students from a norm-referenced nationwide sample. (3) MAP® Reading Growth also includes measures at the end of the year that indicate the extent to which students meet projected growth targets. The targets set for each student are based on their baseline beginning of year scores and the observed growth for similar students in the norm-referenced sample. (4) MAP® Reading Growth™ assesses the amount of students’ growth from beginning to end of year, relative to the amount of growth observed in the norm-referenced sample.

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

33

When considering the extent to which students met their projected growth targets at the end of the 2021–2022 school year, and the amount of growth from the beginning to the end of the year, the results are also mixed. In kindergarten, higher percentages of CFSRP students met their growth targets (see Figure 15) and showed average or above average growth32in reading skills (see Figure 16). However, in 2nd grade the percentages were higher for the comparison group. The differences were statistically significant for the 2nd grade comparisons.

End of Year Reading Achievement and Growth, Kindergarten-2nd Grade As shown in Table 13, results of the end-of-year achievement level analyses for kindergarten, first, and second grade students are mixed, with higher ratings for the CFSRP students at the end of their

kindergarten year and at the end of second grade. The comparison group students had higher ratings at the end of their first-grade year on the Composition measures (highlighted in green).

Kindergarten READING SKILL

Foundational Skills

Grade 1

Grade 2

CFSRP (N=35)

COMP (N=107)

CFSRP (N=51)

COMP (N=191)

CFSRP (N=68)

COMP (N=156)

READING/WRITING

60%

59.8%

49.0%

46.1%

47.1%

50.6%

VOCABULARY

57.1%

50.5%

49.0%

49.2%

48.5%

49.4%

ANALYZING TEXT

57.1%

48.6%

41.2%

49.7%

51.5%

50.6%

60.0%

54.7%

39.2%

44.5%

39.7%

49.4%

60.0%

48.6%

41.2%

44.5%

44.1%

49.1%

Literal Comprehension COMPOSITION Overall Achievement

As mentioned above, the current evaluation used a longitudinal approach to compare CFSRP students’ reading achievement with even more similar groups of students who had not attended one of the CFSRP programs in their early childhood years. In addition to matching the two groups on demographic characteristics, the evaluator used FWISD enrollment data to create comparison groups who, like the CFSRP students, had been enrolled in FWISD in their kindergarten year. This new matching process was conducted for two cohorts of students: those in 3rd grade in 2021-2022 and those in 3rd grade in 2022-2023. Table 14 and Figure 17 show results of the analyses comparing the MAP Reading Achievement and MAP® Reading Growth™ results for these two cohorts of students.

End of Year Reading Achievement and Growth, 3rd Grade Grade 3 Spring 2022 CFSRP COMP (N=231) (N=64)

Grade 3 Spring 2023 CFSRP COMP (N=160) (N=56)

READING/WRITING

64.1%

67.1%

55.4%

63.7%

VOCABULARY

65.6%

62.8%

57.1%

63.7%

Literal

56.0%

63.2%

62.5%

61.9%

Overall Achievement

62.5%

65.4%

58.9%

64.4%

READING SKILL

Foundational Skills

Table 13: Percent of Students at or Above Average Reading Achievement Levels MAP® Reading Growth™ (Spring 2023)

READING GROWTH ANALYZING TEXT CFRSP: AT OR ABOVE AVERAGE READING GROWTH CFRSP: AT OR ABOVE AVERAGEComprehension COMP: AT OR ABOVE AVERAGE READING GROWTH COMP: AT OR ABOVE AVERAGE READING GROWTH

CFSRP: MET GROWTH COMP: MET GROWTH

100

The results of the third-grade comparisons are also mixed. In terms of reading achievement, the comparison group had higher ratings than the CFRP group, particularly in 2023 (see Table 14). However, these measures do not account for students’ earlier levels of achievement. When considering earlier achievement, higher percentages of the CFSRP students met their growth targets and showed higher levels of growth (see Figure 17). Academic growth was similar for both groups in 2023.

Table 14: 3rd Grade Reading Achievement: Longitudinal Cohorts

80 60

44.7

40

45.2 37.1

42.2 46.7

44.7

55.6 52.8

51.6 41.0

53.3 36.9

29.2

55.6 52.8

51.6 41.0

CFSRP: MET GROWTH TARGET COMP: MET GROWTH TARGET

53.3

100

36.9

80

20 %

d ‘23

0

Kinder Spr.‘23

1st Spr.‘23

2nd Spr.‘23

Figure 15: Percent of Kindergarten – 2nd Grade Students Meeting Reading Growth™ Targets Spring 2023

Kinder Spr.‘23

1st Spr.‘23

2nd Spr.‘23

Kinder Spr.‘23

1st Spr.‘23

60

2nd Spr.‘23

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

68.9

67.1 59.7

55.6 57.0

50.0 53.8

Figure 17: Percent of Students Meeting MAP Reading Growth Targets and Showing Average or Above Growth in Reading Skills

20 %

34

77.0

40

Figure 16: Percent of Kindergarten – 2nd Grade Students At or Above Average Reading Growth™ (MAP® Reading Growth™, Spring 2023)

32 Comparisons are relative to the MAP® Reading Growth’s norm-referenced sample.

CFRSP: AT OR ABOVE AVE. GROWTH COMP: AT OR ABOVE AVE. GROWTH

0

3rd Spr.‘22

3rd Spr.‘23

3rd Spr.‘22

3rd Spr.‘23

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

35

Conclusions and Discussion

SCHOOL READINESS OUTCOMES Prekindergarten and Kindergarten Readiness

PROCESS EVALUATION

CLASSROOM AND CENTER OUTCOMES

Teacher retention from beginning to end of year remained high (79%), while lower retention rates were seen for children (67%).

While teacher retention is high, the average years of employment are relatively low at 2.53 years. Teacher participation in professional development remained high at 91%. Mentor teacher and director stipends remained high for eligible participants at 87%. Education for early childhood staff continues to be a challenge, with only 14% of staff holding any early childhood certification.

Classroom quality was variable during the 2022-2023 school year.

Overall, CLASS™ scores were mixed among infant, toddler and preschool classrooms. Responsive Caregiving (infant), Engaged Support for Learning (toddler) and Emotional Support (preschool) domains increased or held steady year over year, but Emotional and Behavioral Support (toddler) and Classroom Organization and Instructional Support (preschool) decreased during the same period.

Infants and toddlers made up 63% of enrollment (infants – 27% and toddlers – 36%) with three-year-olds making up another 23%. Only 12% of children in SRP programs were four- or five-years-old, in line with recent trends of preschool children leaving childcare centers for public PreK programs at local school districts or charter schools.

Center quality showed some improvement in family communications, program evaluation and strategic planning. The areas of family support and involvement, screening and identification of special needs and assessment in support of learning showed some decline during the program year.

CHILD OUTCOMES Overall, child outcomes were mixed: preschool children showed positive academic gains, but infants and toddlers showed mixed development and did not meet most target goals. Social emotional development among all ages remained steady or showed slight improvement.

Infants and toddlers showed some development in the areas of communication skills, gross motor skills and problem-solving skills (infants) and communication skills, personal-social skills, and problem-solving skills (toddlers), but did not meet targets in ASQ ®-3 domains except for infant gross motor skills.

Among prekindergarten students, academic results, as measured by CPALLS+, were positive. In all domains, the percentage of children improving or making acceptable progress increased over the year.

Targets were met for mathematics and rhyming 2, but not for listening and rhyming 1.

As in prior evaluations, the current evaluation suggests that CFSRP continues to contribute to prekindergarten and kindergarten early literacy skills. FWISD prekindergarten students who attended a CFSRP center had higher ratings than the comparison group in Letter Naming, Vocabulary and Listening. Of note are the higher ratings in Vocabulary, a particularly important early literacy skill for later success in reading (64% for CFSRP vs. 50% for the comparison groups).

FWISD kindergarten students with prior attendance at a CFSRP center had higher ratings on all of the TX-KEA literacy measures.

Of note are the higher ratings (53.8%) for the CFSRP students’ blending skills relative to the percentages reported in the prior year evaluation (26.5%; see Appendix D). This finding suggests

that CFSRP successfully followed recommendations to increase their focus on developmentally appropriate activities to support early literacy blending skills.

On the TX-KEA Social Competence measures, the CFSRP students had higher ratings on the Social Emotional Competence measure.

However, the comparison group had higher ratings for Emotional Management. Given that these results are like those of the prior year evaluation, CFSRP should continue their approach to supporting social emotional skills but also identify additional activities supporting specific behaviors related to Emotional Management.

The CFSRP kindergarten students also had higher ratings on 3 of the 4 MAP® Reading Fluency™ measures and Overall Reading Achievement on the MAP Reading Growth™ measures. These results highlight the importance of early education to help children be ready to learn in kindergarten and provide additional evidence that the CFSRP is successfully addressing early literacy development in their early childhood classrooms.

For CFSRP program improvement efforts, staff can continue to use results of the evaluation to better understand how their program impacts school readiness and to identify specific areas that need additional focus.

CONTINUED ACADEMIC SUCCESS The findings related to CFSRP students’ success as they continue through school to the 3rd grade are not as clear and difficult to interpret. As in the prior year evaluation (see Appendices E and F), the analyses of the Spring 2023 MAP® Reading Growth™ measures for kindergarten, first, second and third grade students produced mixed results. The CFSRP children had higher ratings in some areas and the comparison group students had higher ratings in other areas. Even with the new approach to compare results for longitudinal samples of third grade students, the results are mixed. On the measures of Reading Growth, higher percentages of the 2022 cohort of CFSRP students met their growth targets but for the 2023 cohort, higher percentages of the comparison group met their growth targets.

Finally, results from the DECA assessment showed that social emotional skills increased among infants and toddlers and held constant among preschoolers from BOY to EOY.

36

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

37

2022-2023 CFSRP Evaluation Recommendations The following recommendations are based on the findings of the 2022-2023 evaluation.

CHILD OUTCOMES: • Continue targeting personal-social skill development in infant and toddler classrooms through teacher training, modeling, and classroom practices.

• Consider additional developmentally appropriate classroom teaching strategies for listening and introductory rhyming skills for preschool classrooms.

• Camp Fire and other community organizations should continue their efforts to support early childhood programs and to encourage families to enroll their children in quality public or private centers.

• Camp Fire and other community organizations should consider ways to support the expansion of infant and toddler classrooms as more families enroll preschool children in public preschool programs.

• Reevaluate ASQ-3 target goals based on trend data for the past several years.

CENTER OUTCOMES: • Strengthen center quality supports, particularly in the areas of identifying and serving children with special needs and conducting and using child assessments.

SCHOOL READINESS OUTCOMES: • Continue the successful focus on early literacy skills with an increased focus on phonological awareness.

• Identify additional developmentally appropriate activities to address children’s social-emotional management skills.

EVALUATION PROCEDURES: • Work with childcare centers to ensure complete and accurate records for educators and students.

• Increase training for childcare staff in administering the ASQ-3 screening tool.

• Meet with FWISD staff to discuss potential factors that may be contributing to the mixed results related to the end-of-year measures of continued academic success. Consider new or modified evaluation methods to address these mixed results including potential value of continued longitudinal analysis, additional child data to include in the analyses and/ or a primary focus only on the prekindergarten and kindergarten school readiness measures.

• Identify opportunities to maintain or enhance classroom quality from beginning to end of year.

38

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Early Education Apprenticeship Program A key component of high-quality early childhood education that has received increasing attention in recent years is a stable, wellqualified workforce of educators and caregivers. Research has made clear that teacher-child relationships are an important element of early childhood learning and development33 and that centers with lower wages have higher teacher turnover rates.34 Further, support in early childhood has potential to reduce disparities and support the economic and academic success of children and families from lower-income and minority populations,35making wage shortcomings a threat to educational equity and achieving universal kindergarten readiness.

The child care industry has long been challenged by wages and provider turnover; the issue has been compounded in recent years by pandemic-related employment declines and relative wage increases in non-childcare industries that compete for workers.36 Nationwide, median hourly wages for childcare workers (excluding preschool teachers) are $13.22,37 placing childcare workers in the second percentage of all occupations.38 Wage levels in early education are lower still in Texas; in 2019, the median hourly wage among Texas teachers in early learning programs was $10.15, compared to $32.41 among kindergarten teachers. Despite the importance of the early childhood workforce, structural forces limit educators’ ability to attain living wages and supportive career pathways.

Camp Fire Early Education Apprenticeship Program (EEAP)— the first early childhood apprenticeship program in Texas to be registered with the U.S. Department of Labor—works to address these issues. Through EEAP, apprentices have paid positions at host site child development centers, where Camp Fire negotiates wage increases and provides a program stipend in addition to coaching from experienced educators, professional development through Camp Fire’s Early Education Institute and foundational professional development programs, and the opportunity to obtain a Child Development Associate (CDA) credential before graduation. Through the program, apprentices can expand their education and earning potential beyond a CDA by earning up to 33 hours of college credit and being directly connected to local college and university partners for advanced education.

EEAP enrolls apprentices in cohorts each fall and is designed to support progress at an individual pace, with completion at either 12 months (for those with an existing CDA or related credential) or 24 months (for those with limited prior work experience and/or no current CDA; see Appendix K). The theory of change39 below outlines the causal model for the program (Figure 23), with the expectation that through strengthening educators within host sites, educators and centers are both strengthened, ultimately to the benefit of child development.

33 Markowitz, A. J. (2019). Within-year teacher turnover in Head Start and children’s school readiness. University of Virginia EdPolicyWorks Working Paper. https:// curry.virginia.edu/sites/default/files/uploads/epw/70_Teacher_Turnover_in_Head_Start.pdf. Hamre, B., Hatfield, B., Pianta, R., and Jamil, F. (2013). Evidence for general and domain-specific elements of teacher-child interactions: Associations with preschool children’s development. Society for Research in Child Development 85(3). doi: 10.1111/cdev.12184.

34 Grunewald, R., Nunn, R., and Palmer, V. (2022). Examining teacher turnover in early care and education. Federal Reserve Bank of Minneapolis. https://www. minneapolisfed.org/article/2022/examining-teacher-turnover-in-early-care-and-education.

35 Iruka, I. U., Oliva-Olson, C., & Garcia, E., (2021) Research to practice brief: Delivering on the promise through equitable polices. SRI International. https:// childcareta.acf.hhs.gov/sites/default/files/public/pdgb5ta_equitablepractices_rtp_acc.pdf 36 Ibid.

37 Bureau of Labor Statistics. (2022). Table 39-9011 Childcare workers, Occupational employment and wages, May 2021. https://stats.bls.gov/oes/current/ oes399011.htm.

38 Whitebook, M., Phillips, D., and Howes, C. (2014). Worthy Work, Still Unlivable Wages: The Early Childhood Workforce 25 Years after the National Child Care Staffing Study. University of California, Berkeley: Center for the Study of Child Care Employment. https://cscce.berkeley.edu/wp-content/uploads/2014/ ReportFINAL.pdf.

39 A theory of change provides an illustration of a program’s impact pathway—the logical causal change that is expected to occur as a result of program activities.

40

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Camp Fire Early Education Apprenticeship Program Program Components

PD Classes

On-site Individualized Coaching

Handoff to Higher Education Partners for Further Career Progression

FIRST ORDER Apprentice outcomes (teacher or director)

Improved teaching knowledge and classroom experience

Improved teaching practices

Educational and career progression, increased wage capacity

SECOND ORDER Center outcomes

Increased staff wages and qualifications (years of experience, credentials)

Increased teacher retention and staff stability

Increased classroom and center quality

THIRD ORDER Child outcomes

Improved child-teacher interactions

Improved child learning and development

Children enter pre-K and kindergarten ready

Figure 18: EEAP Theory of Change

In the 2022-2023 school year, Camp Fire launched the third year of the apprenticeship program. The program continued to expand hybrid work to allow for participation beyond Tarrant County and saw approximately double the number of centers supported since the previous year (16 centers in 2021-2022 and 33 in 2022-2023). Overlap in apprenticeship participation of those also supported by Camp Fire’s School Readiness Program dropped 20% showing the apprenticeship program is increasing its reach outside of those centers supported by CFSRP. The program continued to increase engagement with Spanish-speaking educators, and to be inclusive of many educator backgrounds while addressing childcare deserts and workforce weaknesses. This evaluation report summarizes participant characteristics, program progress, and workforce outcomes for apprentices served in 2022-2023.

Camp Fire School Readiness Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

41

Participant Characteristics

Program Participation

APPRENTICES

APPRENTICE RECRUITMENT

APPRENTICE PROGRESS

In EEAP’s first and second years (2020-2022), Camp Fire First Texas recruited apprentices in collaboration with partners, particularly centers participating in the School Readiness Program. EEAP introduced potential apprentices to the opportunity through virtual interest sessions and onsite recruitment with childcare center partners. It prioritized admission for teachers who have been in the field at least one year and who work at centers with a Texas Rising Star rating of 3 or 4.

EEAP is a two-year program that admits new apprentices every year. Of the 91 apprentices served in 2022-2023, 77 (85%) were new apprentices and 14 (15%) were returning for their 2nd year of enrollment in the program. By August 2023, 34 of the 91 apprentices served graduated from the program (37%); 29 are continuing into their 2nd year of enrollment (32%); and 28 (31%) cancelled their participation in the program (Table 13).

Fall 2022 started the 3rd year of the Early Education Apprenticeship Program with 91 total apprentices participating. Of the 91 apprentices, 14 (15%) were continuing apprentices from 20212022, enrolled in their 2nd year in the program and 77 apprentices were new to the program (85%). New apprentice enrollment spiked in 2022-2023 compared to the previous year and the initial pilot cohort; 23 in 2020-2021, 34 in 2021-2022, and 77 in 2022-2023.

Apprentices in 2022-2023 were overwhelmingly female and came from varied age, racial/ethnic, and educational backgrounds upon program entry (Table 11). These participants had higher hourly wages at entry ($13.31 compared to $11.79 for the second-year participants) and a higher proportion of participants had no prior credentials at apprenticeship entry (64% compared to 56%).

HOST SITES Thirty-three early childhood centers served as host sites for apprentices during the 2022-2023 school year (more than double the early childhood centers served in 20212022). These host sites support apprentice professional development, credential attainment, and annual wage increases through providing time, space, and financial support for early childhood educator career opportunities. Host sites had from one and nine participating apprentices in their classrooms.

CHARACTERISTIC

ALL APPRENTICES N

(%)

EDUCATION GED 45 HIGH SCHOOL GRADUATE 4 ANY COLLEGE OR POSTSECONDARY TRAINING 42 CREDENTIALS HELD AT APPRENTICESHIP ENTRY CDA (ANY KIND, CURRENT) 20 ASSOCIATE’S DEGREE 3 BACHELOR’S DEGREE 10 NO PRIOR CREDENTIAL 58 RACE/ETHNICITY* ASIAN 6 BLACK OR AFRICAN AMERICAN 36 HISPANIC/LATINO 28 WHITE 19 NO RACE IDENTIFIED 2 GENDER FEMALE 90 SCHOOL READINESS PROGRAM PARTICIPATION SCHOOL READINESS HOST SITE 18 NON-SCHOOL READINESS HOST SITE 73 AGE, MEDIAN

32.0

STARTING HOURLY WAGE, MEDIAN

$13.31

(49%) (4%) (46%) (22%) (3%) (11%) (64%) (7%) (40%) (31%) (21%) (2%)

All apprentices agreed to full program participation, with the support of their center director. They agreed to attend program professional development courses, complete associated coursework, meet with an assigned mentor on a regular basis, and maintain employment at their current center (i.e., host site) for a minimum of twelve months after graduation from the program. For this commitment, apprentices would receive up to $2,000 in stipends, assistance with wage increase negotiations, a non-expiring CDA credential, professional development, mentoring support, and assistance with entering or continuing in higher education opportunities.

Within the 2022-2023 apprentices, a portion of apprentices left the apprenticeship before completing it (31%). The top reasons for leaving the program were “voluntarily quit” and “left to accept other employment,” 32% and 29%, respectively (Table 14).

(99%) (20%) (80%)

*Race/ethnicity sums to more than 100% due to selection of multiple characteristics.

Table 15. EEAP Apprentice Characteristics (N=91), 2022-2023

2020-2021

2021-2022

2022-2023

N

%

N

%

N

%

APPRENTICES SERVED

23

---

43

---

91

---

NEW ENTERING APPRENTICES

23

100%

34

79%

77

85%

GRADUATED

12

52%

20

59%

34

37%

CANCELLED

11

48%

9

21%

28

31%

COMPLETED CDA

12

52%

30

70%

35

38%

COMPLETED EEI*

12

52%

25

58%

58

62%

RATING

*Early Educators Institute Table 16. Apprentice Program Progression, by Cohort

42

Among the 2022-2023 apprentices, 35 had completed CDAs (38%), of which, 14 completed their CDA before program enrollment and 19 completed their CDA during the program.

Additionally, 56 completed EEI* during enrollment (62%) and 15 apprentices weren’t required to completed EEI.

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

REASON FOR LEAVING EEAP

2022-2023

VOLUNTARILY QUIT

9

LEFT TO ACCEPT OTHER EMPLOYMENT

8

NOT ATTENDING RELATED INSTRUCTION

6

RETIRED/RESIGNED

3

DISCHARGED/RELEASED

2

Total Apprentices Leaving Before Completion

28

Table 17. Apprentice Reasons for Leaving EEAP before Completion, 2022-2023

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

43

Apprentice Outcomes

APPENDIX A

EEAP is an educational and career pathway building program designed to have a lasting, positive effect on the careers of educators. In addition to near-term goals of apprentice program completion and demonstration of classroom best practices, success for EEAP means wage increases and educational certifications for early childhood professionals.

In 2022-2023, Camp Fire staff implemented a new self-evaluation assessment and Appendix A assessment (see below for description of Appendix A).

The evaluation assesses the extent to which these newly implemented assessments measure the apprentice’s confidence and outcomes throughout program participation.

DECLINING CONFIDENCE AREAS:

% CONFIDENT/VERY CONFIDENT MIDDLE

END

DECLINE

Understanding of child development for the age group I work with

86

83

-3

Understanding each child has own needs, strengths, interests

90

85

-5

Understanding that learning doesn’t just happen at school

95

86

Understanding the value of diversity in families

88

Collaborating with families to meet the needs of children

IMPROVING CONFIDENCE AREAS:

% CONFIDENT/VERY CONFIDENT

PERIOD 1

PERIOD 2

PERIOD 3

PERIOD 4

28 19 24

50 68 58

93 N/A N/A

100 N/A N/A

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

45

Appendix A is a tool developed by the National Association for the Education of Young Children (NAEYC) that assesses the core body of knowledge, skills, values, and dispositions early childhood educators must demonstrate to effectively promote the development, learning, and well-being of young children.

It covers six standards as outlined in NAEYC’s Professional Standards and Competencies for Early Childhood Educators, including:

IMPROVE

Making educational decisions based on children’s backgrounds

81

83

+2

• Child Observation, Documentation, and Assessment

Connecting families with community resources they need

73

81

+8

• Developmentally, Culturally, and Linguistically Appropriate Teaching Practices

Involving families with assessments

80

85

+5

-9

Knowing what resources to use to plan lessons and experiences

80

83

+3

86

-2

Understanding how to include children’s cultures in the classrooms

80

83

+3

92

85

-7

Understanding the purpose of child assessments

88

86

-2

SELF-EVALUATION

Understanding different types of child assessments

81

80

-1

Demonstrating positive, caring, supportive relationships

95

86

-9

Incorporating play in the classroom

92

83

-9

Creating relevant and engaging lesson plans

88

85

-3

Apprentices completed the self-evaluation assessment at the middle and end of the school year to identify areas where they have changed their confidence levels throughout program participation. Fifty-nine apprentices completed the self-evaluation in the middle and at the end of the year.

Understanding the content that I need to teach

93

85

-8

Understanding different ways to teach concepts

88

85

-3

Reflecting on my teaching to improve more and more over time

95

85

-10

44

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Two Year Track (n=31) Combined (n=71)

Table 19. Apprentice Appendix A Results, 2022-2023

• Family-Teacher Partnerships and Community Connections

END

Table 18. Apprentice Self-Evaluation Results, 2022-2023

One-Year Track (n=40)

• Child Development and Learning in Context

MIDDLE

At mid-year, apprentices have varying high confidence levels from 73%-95% across all areas. At the end of 2022-2023, apprentices show increased confidence in “connecting families with community resources they may need” (+8%) and “involving families with assessments” (+5%). The biggest decline in confidence was seen in “reflecting on my teaching to improve more and more over time” (-10%). Decreases in confidence levels may indicate an over-estimation of skills by apprentices before they were exposed to additional support and training. (Table 15)

% OF APPRENTICES MEETING/EXCEEDING IN AT LEAST 60% OF AREAS

• Knowledge, Application, and Integration of Academic Content in the Early Childhood Curriculum • Professionalism as an Early Childhood Educator EEAP Apprentices are assessed with the tool four times over the two-year program. (Table 16).

Cultivating Growth In 2022-2023, the EEAP built on the success of its initial two-year pilot and guided a large new cohort of apprentices in pursuing increased education and professional development. When educator stability within a role has been particularly tenuous, EEAP brought stability and opportunity to apprentice and host site participants. Initial apprentice outcome results are promising, with graduates showing wage growth, commitment to ongoing educational pursuits, and the stability associated with earning a non-expiring professional credential. A key area for increasing focus and improvement is building and measuring the quality of teacher-child interactions in the classroom and increasing support designed to decrease attrition and increase completion of the CDA credential.

2022-2023 EEAP Evaluation Recommendations The following recommendations are based on the findings of the 2022-2023 evaluation.

APPRENTICE SELECTION • Clearly communicate to potential apprentices recruited through current CFSRP partners the differences between CFSRP and EEAP

PROGRAM SUPPORT • Identify barriers for participant completion • Provide increased support to apprentices at risk for cancelling participation in the program • Provide increased support to apprentices working towards the CDA credential

POST-PROGRAM SUPPORT • After connecting graduates with institutes of higher education, utilize data sharing agreements to understand graduates’ postprogram academic outcomes • Follow up with graduates to track post-program outcomes including career and educational progression, wage increases, and duration with their center and the field

EVALUATION PROCEDURES • Consistently measure and report on all apprentices’ classroom quality at beginning and end of year, with the capacity for rapid response and improvement before end of year or end of program • Standardize wage reporting on a consistent, hourly basis • Collect standardized reasons for leaving the program in apprentice exit interviews

46

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Conclusion Camp Fire First Texas’ early childhood programs address fundamental family and community needs while pursuing high-quality educational experiences. The Camp Fire School Readiness Program (CFSRP) prepares children for school by supporting teacher and classroom quality through professional development and mentoring. The Early Education Apprenticeship Program (EEAP) strengthens the early education workforce in Tarrant County and surrounding areas through rigorous training and support. Each program has continued to evolve with community circumstances to best support the well-being of children, families, communities, and school districts. Overall, Camp Fire's programs to support early childhood educators and children in 2022-2023 demonstrated a commitment to growth, with innovative solutions to complex issues facing the field of early childhood education today.

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

47

List of Appendices APPENDIX A

APPENDIX G

CFSRP Program Components

Year-to-Year Comparisons of Kindergarten Readiness Results

APPENDIX B Evaluation Methods

APPENDIX C Child Development and Center Quality: Assessment Tools and Data Analysis

APPENDIX D Data Analysis and Assessment Tools for FWISD Data

APPENDIX E CFSRP and Comparison Group Demographics (FWISD, Fall 2023)

APPENDIX H Year-to-Year Comparisons of Kindergarten Fall MAP® Reading Fluency™ Results (Fall 2020 - Fall 2023)

APPENDIX I Year-to-Year Comparisons of Kindergarten, 1st and 2nd Grade MAP® Reading Growth™ Results (Fall 2020 - Fall 2023)

APPENDIX J Early Education Apprenticeship Tracks

APPENDIX F Year-to-Year Comparisons of Prekindergarten Readiness Results

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

49

APPENDIX A, CONTINUED: CFSRP PROGRAM COMPONENTS

APPENDIX A: CFSRP PROGRAM COMPONENTS LEVELS OF SUPPORT The CFSRP supports 64 classrooms in 15 licensed, non-residential child development centers that provide care services and early education. The CFSRP engages participating child development centers at four levels of professional development intensity. A child development center’s movement from a lower intensity level (Level 1: Initial Relationship Building) to a higher intensity level (Level 4: Sustainability) is determined by factors such as length of participation in the program, class participation requirements, and center performance and capacity. The table below shows the four professional development levels, three of which include professional development support.

PROFESSIONAL DEVELOPMENT (PD) AND STIPENDS Professional development is offered to teachers through Foundational PD and the Early Education Institute (EEI). Both are designed to increase knowledge and skills in techniques that promote child development and classroom management. In addition, the EEI specifically addresses five components of reading science cited as critical for effective early literacy instruction.40 Directors attend many teacher sessions and participate in the Director’s Institute (DI). The DI is designed to increase knowledge of child development and center business management and leadership practices.

Historically, to promote teacher retention and engagement, full-time teachers who have completed foundational professional development and directors have been eligible for a stipend based on attendance and

demonstrated competency in Camp Fire professional development.

The incentive pay is distributed at the end of the EEI at the program year's end. The teachers’ and directors’ fulfilment of the requirements is reviewed prior to payment distribution. In 2022-2023, stipends for professional development participation were targeted toward EEAP apprentices, directors of CFSRP Level 4 centers, and CFSRP mentor teachers were eligible for stipends of up to $2,000.

NUMBER OF CENTERS (CLASSROOMS)

LEVEL 1

0 (0)

LEVEL 2

3 (13)

LEVEL 3

4 (21)

MENTORING On-site individualized coaching is provided by CFSRP mentors who hold associate, bachelor’s, or master's degrees in child development or early childhood education; have three to five years of experience coaching, mentoring and/or working in early childhood settings; and hold certifications in child development assessments. CFSRP mentors provide coaching visits to Centers based on Center level, with Level 2 and 3 Centers receiving more visits than Level 4 Centers.

The practice-based coaching sessions with teachers consist of creating Teacher Action Plans with SMART (Specific-MeasurableAttainable-Realistic-Timely) goals based on needs identified from assessments (e.g., using teaching best practices, improving classroom management) and supporting the attainment of the identified goals. The coaching sessions with directors also consist of setting SMART goals based on needs identified from assessments related to center business management and leadership practices and supporting the attainment of the identified goals.

41

DESCRIPTION RELATIONSHIP BUILDING BETWEEN CFSRP AND THE CENTER

Does not include professional development BASIC

Center participates for one year INTENSE

Center participates for three years SUSTAINABILITY

LEVEL 4

8 (30)

Center participation begins after the third, intensity-level year and continues as long as the center remains in the program

Description of CFSRP Professional Development Levels

FAMILY ENGAGEMENT

APPENDIX B: EVALUATION METHODS43

The CFSRP family engagement component is an ongoing collaboration between directors and center staff, which consists of a focus on reciprocal communication between families and center staff, as well as family support and involvement-- a range of activities that allows a childcare center to be responsive to family needs, including Parent Cafés42 and Playgroups.

The CFSRP evaluation consists of both a process and outcome evaluation. The process evaluation component provides a clearer picture of how the CFSRP was being implemented in practice and determines to what extent the program was operating as designed in the theory of change. Findings from process evaluation can inform program improvement and help explain why a program achieved or failed to achieve the intended outcomes. The CFSRP process evaluation included a specific focus on professional development participation, stipend allocation, and mentor activities.

40 National Council on Teacher Quality (2020). Program Performance in Early Reading Instruction retrieved from https://www.nctq.org/publications/home.

41 The CFSRP established a Mentor Professional Pathway framework which categorizes mentors into four levels based on their existing level of training and experience. For example, Level 1 (Beginning) mentors may need support with close guidance, Level 2 (Developing) mentors may need support with increasing independence, Level 3 (Proficient) mentors may need limited support and can independently enhance the knowledge and skills of others in the profession, and Level 4 (Exemplary) mentors can develop program policies and practices and enhance the knowledge and skills of others in the profession. The CFSRP Director uses the Mentor Professional Pathway framework to monitor mentor needs and promote professional development opportunities. There were 5 mentors during the 2018-2019 school year: one at Level 1, one at Level 2, and 3 at Level 3.

42 Parent Cafés are a type of family meeting/support group that CFSRP has supported partner centers in offering to their parents. Parent Cafés are carefully designed, structured discussions that use the principles of adult learning and family support to help participants explore their strengths, learn about Protective Factors, and create strategies to help strengthen their families. CFSRP has also encouraged the use of play groups as a family support. Play groups provide opportunities for parents and their children to interact together in a planned ‘play activity’ that aligns learning opportunities between school and home. The play groups promote social-emotional development, support parent/child relationships, and encourage parents to interact with other parents in the group.

CFSRP also provides information and presentations about community resources to center directors who can then use this information to refer families to supportive services regarding family issues, which is another form of family engagement. The CFSRP uses the Family Engagement Measure from the Program Administration Scale (PAS) to set programmatic goals in this area.

50

PROFESSIONAL DEVELOPMENT LEVEL

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

The outcome evaluation included a focus on child outcomes (developmental, academic, and social-emotional) and center outcomes (classroom environment and management, Center leadership and management). The CFSRP outcome evaluation also includes a comparative analysis of outcomes for CFSRP children and demographically similar groups non-CFSRP children enrolled in Fort Worth Independent School District (FWISD).

This part of the evaluation uses assessments already in place to compare the performance of the CFSRP children and the comparison groups when they enter prekindergarten and at the end of their kindergarten through third grade years.

The EEAP evaluation includes both process and outcome evaluation components. It examines characteristics, motivations, and barriers/supports for success of apprentices in the initial cohort, and a summary of apprentice progress to completion. Its focus is on identifying participant characteristics and needs to fully formulate and scale the program for future cohorts. Additionally, outcome measures are collected through a self-evaluation survey and Appendix A, which measures best classroom practices.

43

Assessment tools and data analysis procedures are described in Appendix C and D.

Early Education Apprenticeship Program CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

51

APPENDIX C: CHILD DEVELOPMENT AND CENTER QUALITY: ASSESSMENT TOOLS AND DATA ANALYSIS

APPENDIX C, CONTINUED: CHILD DEVELOPMENT AND CENTER QUALITY: ASSESSMENT TOOLS AND DATA

CFSRP contracts with CNM to provide program evaluation consulting services and CNMpact outcomes services. CNM created secure, web-based online data entry spreadsheets for each CFSRP child development center. Directors at CFSRP-supported child development centers entered student and teacher enrollment information, classroom information, and assessment data. The Classroom Assessment Scoring System (CLASS™) was used by trained CLASS™ observers and submitted the final data to the CNM evaluation team to analyze. Other assessment data were provided by the CFSRP Director. Prior to data analysis, CFSRP staff reviewed and cleaned final data. The table below presents each assessment and its associated assessment areas.

ASSESSMENT

AREA ASSESSED

DATA ANALYSIS

Classroom/Center Outcomes CLASSROOM ASSESSMENT SCORING SYSTEM (CLASS™)

ASSESSMENT

AREA ASSESSED

DATA ANALYSIS

Child Outcomes AGES AND STAGES QUESTIONNAIRE, VERSION 3 (ASQ®-3) A standardized, screening tool designed to identify infants and young children who are and are not displaying typical age-appropriate development. CFSRP recommends that children ages three years and five months or younger receive the ASQ®-3 assessment.

CIRCLE PHONOLOGICAL AWARENESS, LANGUAGE AND LITERACY SCREENER PLUS MATH (CPALLS+) A standardized, criterion-referenced assessment designed to measure children’s literacy and language skills. CPALLS+ recommends that children ages three years and six months or older receive the CPALLS+ assessment.

DEVEREUX EARLY CHILDHOOD ASSESSMENT (DECA) A strengths-based, standardized assessment and planning system that supports educators in promoting children’s social and emotional development, thus promoting resilience.

52

Cognitive and Physical Development Language and Literacy Development

Language and Literacy Development Cognitive Development (Math)

SocialEmotional Development

The evaluation team calculated the percentage of children meeting the cut-off for developmental skills in five domains at the beginning and end of the year. The results were disaggregated by age group.

The percentage of children demonstrating improvement in developmental skills from the beginning to the end of the year was also calculated.

The evaluation team calculated the percentage of children meeting the cut-off for language and literacy skills at the beginning and end of the year. Separate analyses were conducted for three-year-old children (MOY-EOY comparisons) and four-and five-year-old children (BOYEOY). The results were disaggregated by age group.

The percentage of four- and five-year old children demonstrating improvement in developmental skills from the beginning to the end of the year was also calculated.

The evaluation team calculated the percentage of children who scored in the Typical or Strength category in social-emotional/resilience at the beginning and the end of the year. The percentage of children demonstrating improvement in their scores was also calculated.

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

A standardized, observation-based assessment designed to assess classroom management and quality on a 7-point scale. The Infant CLASS™ measures the quality of responsive caregiving in infant classrooms. The Toddler CLASS™ measures the quality of emotional and behavioral support and engaged support for learning in toddler classrooms. The Pre-K CLASS™ measures the quality of emotional support, classroom organization, and instructional support. For Pre-K CLASS™, the quality threshold is set at 5 for the Emotional Support and Classroom Organization domains, and at 3.25 for the Instructional Support domain.

Classroom Management and Quality

The evaluation team included only teachers with matched pre- and post-assessment scores in the analysis. The average CLASS™ pre- and post-assessment scores were compared. In addition, for Pre-K classrooms, analyses examined the percent of teachers who met a researchbased quality threshold for each domain.

BEST PRACTICES OBSERVATION TOOL (BPOT) A research-based observational checklist that measures the presence or absence of research-based teaching practices that align with CFSRP professional development curriculum. This tool is intended for professional development purposes. Teachers in infant classrooms are rated on 105 best-practice teaching strategies, and teachers in toddler classrooms are rated on 110 bestpractice teaching strategies. The BPOT for three-year-old classrooms and four-year-old classrooms includes 110 and 120 best-practice teaching strategies, respectively.

PROGRAM ADMINISTRATION SCALE (PAS) A 25-item research-based instrument that measures the quality of leadership and management practices of early childhood programs. PAS measures quality on a 7-point scale (1 = inadequate, 3 = minimal, 5 = good, 7 = excellent).

Quality in Teaching Practices

Based on the design of the BPOT assessments, the evaluation team calculated the total observations and created a weighted system that categorized scores as ‘needs support’, ‘emerging’, and ‘consistently meets’. The results were disaggregated by domain.

This assessment is used internally to assist mentors with identifying target areas for teacher development.

Center Leadership and Management Quality

The evaluation team used each center’s individual score to calculate an overall average for each of the 10 domains.

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

53

APPENDIX D: DATA ANALYSIS AND ASSESSMENT TOOLS FOR FWISD DATA Camp Fire partners with FWISD to gain access to data from student assessments currently used in the school district. Through this partnership, the CFSRP evaluation team has been able to assess the impact of the program for eight years with analyses of the children’s assessment scores not only as they enter school but also through their kindergarten, 1st, 2nd, and 3rd grade years. Camp Fire contracted with Aware Research Solutions Inc. to provide evaluation and data analysis services.

Each year, using a random selection process44, the evaluation team compares the assessment scores of children who attended a CFSRP-supported center in one of the prior six years and children in -demographically similar comparison groups who did not attend one of the centers. This technique allows the evaluation team to create a random, non-biased sample of children who are like the sample of CFSRP children and, in turn, make valid comparisons between the two groups. Any statistically significant differences identified in the results provide evidence that the differences between CFSRP children’s scores and the comparison group’s scores can be attributed, in part, to the CFSRP program rather than to random chance.

ASSESSMENT

ASSESSMENT

DOMAINS

Kindergarten Readiness47

The groups were matched on the following characteristics: • School location • Grade level • Ethnicity • Free/Reduced Lunch Status • Gender • Limited English Proficiency (LEP) status • Special Education status To get the best possible match, the comparison groups are necessarily larger than the CFSRP groups. Students with Special Education and/ or LEP designations included in the analyses only if the CFSRP group included 5 or more with the designation (see Appendix E for the demographic descriptions of the CFSRP and comparison groups).

Depending on the grade level for each set of comparison groups, the analyses were conducted with the FWISD assessment data described in the table on the next page, “FWISD Assessments Used in the Evaluation.” Because very few CFSRP children were assessed in Spanish only the English versions of each assessment were included in the analyses.

DOMAINS

Prekindergarten Readiness45 CIRCLE PROGRESS MONITORING TOOL (CIRCLE)46 CIRCLE is similar to the CPALLS+ assessment used in the CFSRP three and four-year old classrooms. It is a criterion-referenced assessment based on the Texas Education Agency (TEA) prekindergarten guidelines for literacy, math, and social skills. Teachers use CIRCLE at the beginning of the school year to help identify children who meet or do not meet developmental benchmarks so they can plan individualized instruction.

44 For the current evaluation, the random selection process used SAS Statistical Analysis Software, SAS/STAT | SAS to select the comparison group students.

45 This description is taken from the Texas Kindergarten Entry Assessment User Guide at: https://cliengage.org/user-guides/User_Guide_TX-KEA_8.13.2018.pdf.

46 CLI Engage (2017). CIRCLE Progress Monitoring System. https://cliengage.org/public/tools/assessment/circle-progress-monitoring/.

47 A variety of sources provided the information included in these descriptions. 1Brief_PhonologicalAwareness.pdf (d1yqpar94jqbqm.cloudfront.net) Phonological Awareness | LEARN - Children's Literacy Initiative (cli.org), Kindergarten_TEKS_0820 (texas.gov), Phonics | LEARN - Children's Literacy Initiative (cli.org), Reading Curriculum Ladders (fortheteachers.org) 48 Texas Kindergarten Entry Assessment (TX-KEA).https://www.texaskea.org/.

54

APPENDIX D, CONTINUED: DATA ANALYSIS AND ASSESSMENT TOOLS FOR FWISD DATA

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

TEXAS KINDERGARTEN ENTRY ASSESSMENT (TX-KEA)48 TX-KEA is a screening tool designed to assess kindergarten children’s skills in seven areas of school readiness: Language, Early Literacy, Math, Science, Executive Functioning, Social Emotional Skills, and Physical Skills. For each measure, students receive a score indicating if they are on-track, need monitoring or need additional support/ intervention. Teachers use the TX-KEA is to identify children who may need additional support and to plan individualized instruction.

Texas school districts and charter schools are required to administer a Kindergarten assessment for all Kindergarten students. The TX-KEA is on the Commissioner’s approved list of assessment Instruments for meeting this requirement.

The TX-KEA includes four domains: language, literacy, executive functioning, and social emotional competence and emotion management.

LANGUAGE DOMAIN VOCABULARY is a foundational language skill that supports learning in all content domains. Knowing a student’s vocabulary abilities helps teachers adjust their own vocabulary usage during instruction to levels that are most beneficial for individual children.

LISTENING COMPREHENSION, a foundational language skill that supports learning in all areas, assesses students’ ability to understand verbal information and follow directions. Knowing students’ receptive language abilities allows teachers to adjust the complexity of their own language during instruction.

LITERACY DOMAIN The LETTER NAMES subtest assesses children’s knowledge of the names associated with various letters of the alphabet.

Letter names is one component of letter knowledge which can predict reading achievement The LETTER SOUNDS subtest assesses children’s knowledge of letter sounds. Letter knowledge at kindergarten entry is a strong predictor of literacy achievement The BLENDING SOUNDS subtest assesses children’ phonological awareness, or sensitivity to the sound structure of oral language. Phonological awareness is necessary for learning to read and write and is predictive of literacy achievement.

The SPELLING subtest assesses children’s early spelling abilities, which is the ability to use sound-symbol relationships to write words. TX-KEA assesses spelling because it is highly related to later literacy achievement. Attempting to spell words requires children to apply multiple literacy skills simultaneously, such as alphabet knowledge and phonological awareness.

EXECUTIVE FUNCTIONING The Executive Functioning domain addresses the cognitive skills used by children to plan, problem solve, and follow classroom rules.

INHIBITION. Students are asked to respond accurately to a specific stimulus (e.g., butterfly), and withhold, or inhibit, a response to a different stimulus (e.g., bee). Scores reflect the student’s ability to respond accurately while inhibiting a response WORKING MEMORY. Students are assessed on their ability to hold in memory 1 – 3 pieces of information in an increasingly complex setting. In this subtest, children recall where cars are parked in a garage. The number of cars and the number of parking spaces increases as the student progresses.

ATTENTION. Students are assessed on their ability to focus their attention, stay on task, as well as quickly and accurately focus on relevant features of the task. They are provided 2 minutes to make as many correct matches as possible between the target object, a flower, and five answer choices, other flowers.

SOCIAL EMOTIONAL COMPETENCE AND EMOTION MANAGMENT The SOCIAL/EMOTIONAL COMPETENCE subtest focuses on children’s social and emotional skills within a classroom setting. The subtest evaluates children’s pro-social skills, approaches to learning, and emotion understanding.

The EMOTION MANAGEMENT subtest focuses on children’s ability to manage their emotions and respond appropriately to an emotional experience. They are evaluated on whether they can adapt to the demands of a classroom and school environment.

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

55

APPENDIX E: CFSRP AND COMPARISON GROUP DEMOGRAPHICS (FWISD, FALL 2023)

APPENDIX D, CONTINUED: DATA ANALYSIS AND ASSESSMENT TOOLS FOR FWISD DATA ASSESSMENT

DOMAINS

Kindergarten-3rd Grade Reading Fluency49 LANGUAGE DOMAIN MAP® READING FLUENCY™50 is an online

screening and progress monitoring tool. The assessment establishes a benchmark oral reading fluency level for students, and depending on the level, assesses foundational or advanced reading skills. For kindergarten students, MAP® Reading Fluency™ assesses Language Skills (Listening Comprehension & Vocabulary) and Decoding Skills (Phonological Awareness & Phonics).

For each skill, students are rated at, below, approaching, meets or exceeds grade level.

LISTENING COMPREHENSION includes the ability to listen to a passage that is read aloud and ask and answer questions about the passage, as well as the ability to repeat and follow sequenced, multi-step directions.

PERCENTAGE IN EACH GROUP (BY ASSESSMENT AND GRADE LEVEL)

PICTURE VOCABULARY refers to the students’ ability to understand the meaning of spoken words (receptive vocabulary) by correctly identifying pictures related to the spoken words.

DEMOGRAPHIC DESCRIPTION

DECODING DOMAIN PHONOLOGICAL AWARENESS is the ability to recognize and work with sounds in the spoken language, including skills such as: identifying rhyming words, recognizing words with same initial sound, blending syllables, and segmenting multisyllabic words.

Kindergarten-3 Grade Reading Growth

BLACK

HISPANIC

51 ETHNICITY

MAP® READING GROWTH™52 is a standardized assessment that provides categorical (quintiles) and continuous scale (RIT) scores designed to measure achievement at a given point in time as well as growth over the school year and from one year to another.

The quintile scores identify students as low, low average, average, high average, or high, relative to a national norm-referenced group, for overall reading achievement, foundational skills (Reading/Writing & Vocabulary) and Literal Comprehension skills (Analyzing Text & Composition.). MAP® Reading Growth™ also includes measures of each student’s projected growth (from fall to spring), identifies whether the student met that projection and provides a growth quintile based on their baseline beginning of year scores and the observed growth for similar students in the norm-referenced sample.53

WHITE

FOUNDATIONAL SKILLS OTHER

BEGINNING READING AND WRITING skills include phonological awareness and phonics (described above) as well as correct use of oral language.

USE OF VOCABULARY refers to the students’ ability to understand how words can be used such as the ability to identify words with the same meaning or finish an incomplete sentence.

SOCIO-ECONOMIC STATUS

FREE/REDUCED LUNCH

LITERAL COMPREHENSION ANALYZING TEXT refers to students’ ability to understand key ideas, implied meaning, and details in an oral or written passage.

COMPOSITION: Inquiry and Research refers to the students’ ability to use critical thinking to analyze and summarize text.

Fall 2023 Kindergarten

Fall 2023 PreK KEA

PHONICS/WORD RECOGNITION refers to students’ ability to recognize the sounds of the spoken language and the letters and combinations of letters (words) that represent those sounds.

rd

GROUP

MALE GENDER FEMALE

MAP® FLUENCY MAP® GROWTH

CFSRP

64.1%

42.5%

36.7%

40.0%

COMP

66.0%

42.2%

36.7%

37.7%

CFSRP

15.4%

40.0%

46.9%

43.6%

COMP

17.5%

42.2%

46.8%

45.1%

CFSRP

17.9%

15.0%

14.3%

14.5%

COMP

15.5%

15.7%

16.5%

16.7%

CFSRP

2.6%

2.5%

2.0%

1.8%

COMP

1.0%

0.0%

0%

0.6%

CFSRP

76.9%

72.5%

67.3%

69.1%

COMP

76.3%

75.0%

69.1%

69.8%

CFSRP

60.0%

57.5%

55.1%

54.5%

COMP

58.8%

56.6%

55.4%

53.7%

CFSRP

41.0%

42.5%

44.9%

45.5%

COMP

41.2%

43.4%

44.6%

46.3%

49 A variety of sources provided the information included in these descriptions. 1Brief_PhonologicalAwareness.pdf (d1yqpar94jqbqm.cloudfront.net) Phonological Awareness | LEARN - Children's Literacy Initiative (cli.org), Kindergarten_TEKS_0820 (texas.gov), Phonics | LEARN - Children's Literacy Initiative (cli.org), Reading Curriculum Ladders (fortheteachers.org) 50 https://www.nwea.org/map-reading-fluency/ 51 A variety of sources provided the information included in these descriptions. 1Brief_PhonologicalAwareness.pdf (d1yqpar94jqbqm.cloudfront.net) Phonological Awareness | LEARN - Children's Literacy Initiative (cli.org), Kindergarten_TEKS_0820 (texas.gov), Phonics | LEARN - Children's Literacy Initiative (cli.org), Reading Curriculum Ladders (fortheteachers.org) 52 https://www.nwea.org/map-growth/ 53 NWEA. (2020). 2020 NWEA MAP Growth normative data overview. https://teach.mapnwea.org/impl/MAPGrowthNormativeDataOverview.pdf

56

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

57

APPENDIX E, CONTINUED: CFSRP AND COMPARISON GROUP DEMOGRAPHICS (FWISD, FALL 2023) LONGITUDINAL COMPARISON (3RD GRADE)

PERCENTAGE IN EACH GROUP (BY ASSESSMENT AND GRADE LEVEL) DEMOGRAPHIC DESCRIPTION

GROUP Kinder

BLACK

HISPANIC ETHNICITY WHITE

OTHER

SOCIO-ECONOMIC STATUS

FREE/REDUCED LUNCH

MALE GENDER FEMALE

SPECIAL EDUCATION OTHER GIFTED

58

DEMOGRAPHIC DESCRIPTION

1st Grade

2nd Grade

3rd Grade

CFSRP

63.8%

63.5%

41.2%

33.3%

COMP

62.8%

61.2%

41.8%

31.6%

CFSRP COMP

24.1% 26.2%

22.9% 21.8%

39.2% 39.5%

33.0%

8.6%

11.8%

17.5%

25.6%

COMP

11.1%

17.0%

18.7%

27.4%

CFSRP

2.4%

3.2%

2.1%

8.1%

COMP

0.0%

0.0%

0.0%

7.7%

CFSRP

82.7%

82.4%

67.1%

76.7%

COMP

80.2%

78.1%

67.3%

72.6%

COMP

43.1% 43.0%

41.9% 42.0%

53.6% 52.4%

56.7%

56.9%

58.1%

46.4%

43.4%

COMP

57.0%

57.9%

47.6%

43.2%

COMP

NA NA

8.1% 9.5%

10.3% 9.9%

HISPANIC ETHNICITY WHITE

OTHER

SOCIO-ECONOMIC STATUS

GENDER FEMALE

SPECIAL EDUCATION

17.1% 13.3%

CFSRP

NA

8.1%

11.3%

15.2%

COMP

NA

9.6%

11.2%

12.9%

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

FREE/REDUCED LUNCH

MALE

56.6%

CFSRP CFSRP

BLACK

33.3%

CFSRP

CFSRP

GROUP SPRING 2022 MAP® READING GROWTH™

SPRING 2023 MAP® READING GROWTH™

CFSRP

37.5%

41.1%

COMP

35.9%

38.8%

CFSRP

32.8%

39.3%

COMP

34.2%

44.4%

CFSRP

23.4%

19.6%

COMP

23.8%

16.9%

CFSRP

6.3%

0%

COMP

6.1%

0%

CFSRP

75.0%

57.1%

COMP

77.1%

61.3%

CFSRP

57.8%

48.2%

COMP

56.7%

50.0%

CFSRP

42.2%

51.8%

COMP

43.3%

50.0%

CFSRP

12.5%

NA

COMP

11.7%

NA

CFSRP

21.9%

25.0%

COMP

21.2%

25.0%

SPRING 2023 MAP® READING GROWTH™

OTHER GIFTED

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

59

APPENDIX F: YEAR-TO-YEAR COMPARISONS OF PREKINDERGARTEN READINESS RESULTS (FALL 2018 – FALL 2023)

APPENDIX G: YEAR-TO-YEAR COMPARISONS OF KINDERGARTEN READINESS RESULTS (FALL 2018 – FALL 2023)

Comparison of Beginning of Year Pre-K Skills: CIRCLE Assessment Fall 2018-Fall 2023 For all comparison charts, Yellow = stat. significant, p<.05 ; Green = 5 point or higher difference

FWISD Kindergarten Entry Assessment (TX-KEA) Ratings: CFSRP Students and Comparison Group (Fall 2018 - Fall 2023)54 For all comparison charts, Yellow = stat. significant, p<.05 ; Green = 5 point or higher difference

Fall 2018 KEA ASSESSMENT ITEM

Fall 2018 EARLY LITERACY SKILL

CFSRP COMP. (N=115) (N=452)

Fall 2019 CFSRP (N=92)

COMP. (N=456)

Fall 2020 CFSRP (N=48)

COMP. (N=136)

Fall 2021 CFSRP (N=45)

COMP. (N=153)

Fall 2022 CFSRP (N=36)

COMP. (N=94)

COMP. (N=95) LANGUAGE

LETTER NAMING

42%

26%

46%

32%

42.7%

30.9%

48.8%

29.9%

35.1%

29.2%

53.8%

42.3%

VOCABULARY

48%

49%

54%

48%

39.6%

37.0%

64.4%

45.1%

41.7%

42.5%

64.1%

50.0%

PHON. AWARENESS

64%

63%

61%

59%

66.0%

53.6%

88.9%

67.1%

57.6%

60.4%

66.7%

72.3%

ALLITERATION

5%

4%

4%

2%

4.2%

2.1%

2.2%

5.4%

2.8%

1.1%

12.8%

6.4%

SYLLABICATION

16%

12%

15%

10%

14.9%

9.6%

24.4%

13.3%

8.3%

9.9%

23.1%

22.1%

ONSET RIME RHYMING I

13% 11%

14% 9%

13% 8%

12% 9%

23.4% 17.0%

22.5% 16.4%

13.3% 22.2%

17.8% 11.3%

14.3% 17.1%

5.5% 6.6%

10.3% 12.8%

10.5% 10.6%

RHYMING II

12%

8%

14%

5%

11.4%

10.9%

13.2%

7.0%

3.3%

3.0%

12.8%

5.3%

LISTENING

32%

31%

30%

24%

28.9%

27.0%

32.5%

20.5%

20.0%

15.6%

33.3%

15%

WORDS

16%

8%

20%

13%

15.9%

11.8%

23.1%

12.5%

9.4%

3.4%

15.4%

13.7%

BOOK PRINT

77%

77%

79%

68%

66.7%

61.9%

83.9%

69.2%

82.5%

62.4%

78.9%

68.1%

EARLY WRITING

94%

94%

100%

91%

96.3

94.1%

91.2%

84.6%

94.3%

73.9%

60

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

LITERACY

EXECUTIVE FUNCTION

Fall 2021

Fall 2022

Fall 2023

COMP (N=549)

CFSRP (N=91)

COMP (N=480)

CFSRP (N=94)

COMP (N=586)

CFRSP (N=65)

COMP (N=195)

CFRSP (N=34)

COMP (N=32)

CFRSP (N=39)

COMP (N=83)

OVERALL

76.0%

71.1%

80.0%

65.3%

72.0%

73.0%

71.9%

61.0%

71.4%

44.1%

37.5%

32.1%

VOCABULARY

78.8%

74.6%

65.6%

60.2%

66.0%

59.6%

72.7%

58.7%

80.0%

48.6%

65.0%

61.4%

LISTENING COMP.

73.2%

71.9%

72.6%

63.0%

72.2%

73.1%

63.1%

51.3%

60.0%

35.3%

56.4%

43.9%

OVERALL

82.0%

69.1%

75.3%

62.3%

42.6%

37.4%

62.3%

58.3%

79.4%

37.5%

55.0%

23.5%

LETTER NAMES

83.3%

73.0%

81.4%

67.1%

76.6%

69.5%

66.7%

59.0%

82.9%

45.7%

80.0%

42.0%

LETTER SOUNDS

82.5%

68.3%

71.6%

58.5%

86.2%

77.3%

53.8%

40.7%

60.0%

26.5%

56.4%

26.8%

BLENDING

67.3%

66.1%

33.7%

32.5%

50.0%

54.8%

32.8%

42.1%

26.5%

18.8%

53.8%

32.1%

SPELLING

96.3%

91.3%

79.3%

63.6%

60.0%

52.8%

56.1%

48.2%

66.7%

38.2%

60.5%

30.0%

WORKING MEMORY

66.3%

68.5%

56.5%

61.6%

62.0%

62.4%

60.0%

54.4%

56.0%

53.5%

58.8%

46.6%

INHIBITION

55.9%

62.0%

63.7%

60.0%

57.7%

67.4%

55.6%

58.4%

48.0%

42.8%

84.8%

62.0%

ATTENTION

72.0%

66.2%

74.4%

63.6%

63.2%

52.7%

67.1%

63.6%

64.0%

67.8%

74.3%

67.6%

82.0%

84.1%

82.4%

77.9%

85.7%

83.0%

80.4%

77.1%

76.7%

68.7%

81.1%

58.4%

78.7%

74.2%

68.5%

77.4%

81.2%

81.4%

81.5%

81.7%

60.0%

75.0%

62.9%

84.7%

MATH

73.8%

68.5%

60.2%

42.4%

43.6%

38.9%

47.7%

33.0%

54.3%

31.4%

60.5%

28.4%

SCIENCE

74.8%

69.1%

49.0%

45.7%

51.7%

57.1%

51.6%

48.1%

56.7%

26.7%

40.5%

35.9%

ACADEMIC MOTOR

90.0%

83.0%

90.8%

81.7%

38.8%

30.8%

71.7%

78.0%

88.0%

66.7%

91.4%

72.2%

SOCIAL EMOTIONAL SOCIAL EMOTIONAL EMOTIONAL MANAGEMENT

OTHER

Fall 2020

CFSRP (N=103)

Fall 2023 CFSRP (N=39)

Fall 2019

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

61

APPENDIX H: YEAR-TO-YEAR COMPARISONS OF KINDERGARTEN FALL MAP READING FLUENCY RESULTS (FALL 2020 – FALL 2023)

APPENDIX H, CONTINUED: YEAR-TO-YEAR COMPARISONS OF KINDERGARTEN FALL MAP READING GROWTH RESULTS (FALL 2020 – FALL 2023)

QUINTILE

Fall 2020

MAP READING FLUENCY ITEM

LISTENING COMPREHENSION (LANGUAGE)

PICTURE VOCABULARY (LANGUAGE)

PHONOLOGICAL AWARENESS (DECODING)

PHONICS (DECODING)

62

Fall 2021

Fall 2022

Fall 2023

LEVELS CFSRP

COMP.

CFSRP

COMP.

CFSRP

COMP.

CFSRP

COMP.

BELOW

16.9%

22.2%

17.5%

34.6%

34.4%

41.7%

34.7%

34.1%

APPROACHING

13.3%

16.8%

21.1%

27.7%

12.5%

33.3%

8.2%

21.0%

MEETS

28.9%

31.6%

31.6%

25.0%

37.5%

25.0%

34.7%

31.2% LITERACY SKILL

EXCEEDS

41.0%

29.4%

29.8%

12.7%

15.6%

0.0%

22.4%

13.8%

MEETS/EXCEEDS

70.4%

60.9%

61.4%

37.7%

53.1%

25.0%

57.1%

45.3%

BELOW

13.3%

18.8%

17.5%

30.4%

28.1%

33.3%

24.5%

25.4%

APPROACHING

9.6%

12.1%

14.0%

20.8%

12.5%

19.4%

14.3%

17.4%

MEETS

27.7%

30.3%

22.8%

23.8%

21.9%

36.1%

28.6%

26.8%

EXCEEDS

49.4%

38.8%

45.6%

25.0%

37.5%

11.1%

32.7%

30.4%

MEETS/EXCEEDS

76.5%

68.9%

68.4%

48.8%

59.4%

47.2%

61.2%

57.2%

APPROACHING

24.1%

32.7%

33.3%

42.7%

40.6%

38.9%

16.3%

40.6%

MEETS

10.8%

9.9%

15.8%

13.1%

21.9%

19.4%

30.6%

11.6%

EXCEEDS

65.1%

57.4%

50.9%

44.2%

37.5%

41.6%

53.1%

47.8%

AT/ABOVE

76.5%

67.2%

66.7%

57.3%

59.3%

61.0%

83.7%*

59.4%

APPROACHING

16.9%

23.2%

25.0%

43.8%

21.8%

41.7%

18.4%

44.9%

MEETS

38.6%

38.0%

41.1%

32.3%

37.5%

30.6%

44.9%

29.7%

EXCEEDS

44.6%

38.8%

33.9%

23.8%

40.6%

27.8%

36.7%

25.4%

AT/ABO MEETS/EXCEEDS

82.7%

76.6%

73.7%

56.2%

78.1%

58.3%

81.6%*

55.1%

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

FOUNDATIONAL SKILLS

LITERAL COMPREHENSION

Fall 2021

Fall 2022

Fall 2023

CFSRP

COMP.

CFSRP

COMP.

CFSRP

COMP.

CFSRP

COMP.

LOW

7.0%

10.8%

4.5%

11.4%

11.4%

24.2%

10.9%

18.5%

LOW AVERAGE

17.4%

19.7%

36.0%

26.9%

22.8%

33.3%

25.5%

23.5%

AVERAGE

17.4%

24.3%

29.2%

31.9%

31.4%

21.2%

27.3%

29.0%

HIGH AVERAGE

36.0%

19.7%

18.1%

18.0%

14.3%

15.2%

27.3%

16.0%

HIGH

22.1%

25.6%

12.4%

11.7%

20.0%

6.1%

9.1%

13.0%

AT/ABOVE

75.6%

69.6%

59.6%

61.7%

65.7%

42.4%

63.6%

58.0%

MAP Reading Fluency Scores: CFSRP Students and Comparison Group (Fall 2020 - Fall 2023)55 OVERALL ACHIEVEMENT

Fall 2020

QUINTILE

LOW LOW AVERAGE AVERAGE READING WRITING HIGH AVERAGE HIGH AT/ABOVE LOW LOW AVERAGE AVERAGE VOCABULARY HIGH AVERAGE HIGH AT/ABOVE LOW LOW AVERAGE ANALYZING AVERAGE TEXTS HIGH AVERAGE HIGH AT/ABOVE LOW LOW AVERAGE AVERAGE GOAL 4 COMPOSITION HIGH AVERAGE HIGH AT/ABOVE

Fall 2020 CFSRP 9.3% 19.8% 26.7% 19.8% 24.4% 70.9% 8.1% 14.0% 26.7% 22.1% 29.1% 72.2% 9.3% 10.5% 20.9% 30.2% 29.1% 80.2% 8.1% 25.6% 17.4% 23.3% 25.6% 66.3%

COMP. 14.8% 21.3% 22.6% 16.1% 25.2% 63.5% 9.9% 17.8% 25.1% 17.1% 30.1% 77.9% 9.9% 17.8% 23.8% 18.8% 29.7% 72.2% 16.7% 23.0% 15.2% 15.8% 29.3% 60.3%

Fall 2021 CFSRP 12.4% 28.4% 24.7% 16.9% 11.2% 52.8% 5.6% 21.3% 20.2% 39.3% 13.5% 73.0% 10.1% 31.5% 22.5% 20.2% 15.7% 58.4% 12.5% 29.5% 28.4% 17.0% 12.5% 58.0%

COMP. 20.1% 34.8% 21.4% 20.8% 9.4% 51.6% 12.7% 21.6% 24.2% 25.2% 16.4% 65.6% 12.2% 19.2% 28.0% 23.8% 16.8% 68.6% 20.0% 28.6% 19.7% 18.4% 13.2% 51.4%

Fall 2022 CFSRP 11.4% 20.0% 25.7% 25.7% 17.1% 65.6% 8.6% 37.1% 20.0% 20.0% 14.3% 54.3% 2.9% 31.4% 20.0% 28.6% 17.1% 65.7% 20.0% 8.6% 31.4% 25.7% 14.3% 71.4%

COMP. 24.2% 30.3% 21.2% 15.2% 9.1% 45.5% 27.3% 30.3% 18.2% 12.1% 12.1% 42.4% 24.2% 30.3% 18.2% 12.1% 15.2% 45.5% 21.2% 36.4% 24.2% 9.1% 9.1% 42.4%

Fall 2023 CFSRP 12.7% 32.7% 18.2% 18.2% 18.2% 54.5% 23.6% 18.2% 30.9% 20.0% 7.3% 58.2% 10.9% 27.3% 27.3% 29.1% 5.5% 61.8% 10.9% 40.0% 25.5% 12.7% 10.9% 49.1%

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

COMP. 21.7% 29.8% 24.8% 13.7% 9.9% 48.4% 14.9% 22.4% 19.9% 25.5% 17.4% 62.7% 16.7% 21.0% 21.6% 22.8% 17.9% 62.3% 21.0% 30.2% 25.9% 11.7% 11.1% 48.8%

63

APPENDIX I: YEAR-TO-YEAR COMPARISONS OF KINDERGARTEN, 1ST AND 2ND GRADE MAP READING GROWTH RESULTS

APPENDIX K: EARLY EDUCATION EARLY EDUCATION APPRENTICESHIP TRACKS

APPRENTICESHIP TRACKS

Spring 2022 LITERACY SKILL

No prior work experience

Expired or no CDA or other qualifying related instruction

Prior related work experience

Active CDA or other related instruction

Complete EEI and concentration classes

Complete EEI and concentration classes

Request credit for prior work experience

Request credit for prior instruction

Obtain valid CDA

Obtain valid CDA

Complete EEI and concentration classes

Complete EEI and concentration classes

Complete remaining on-the-job learning (4,000 hours)

Complete remaining on-the-job learning (2,000 or 4,000 hours)

Receive credit for up to 2,000 hours of prior work experience

Receive credit for qualifying related instruction

Complete CDA, remaining education and on-the-job learning

Complete remaining education and on-the-job learning

Spring 2023

GRADE

READING WRITING

CFSRP

COMP.

CFSRP

COMP.

KINDER

51.7%

46.5%

60.0%

59.8%

FIRST

48.7%

52.6%

49.0%

46.1%

SECOND

48.5%

53.7%

47.1%

50.6%

KINDER

51.7%

48.5%

57.1%

50.5%

FIRST

56.7%

51.5%

49.0%

49.2%

SECOND

51.5%

46.2%

48.5%

49.4%

KINDER

44.9%

47.1%

57.1%

48.6%

FIRST

43.2%

50.5%

41.2%

49.7%

SECOND

50.5%

43.5%

51.5%

39.7%

KINDER

48.3%

49.4%

60.0%

54.7%

FIRST

43.4%

48.4%

39.2%

44.5%

SECOND

54.6%

59.5%

50.6%

49.4%

FOUNDATIONAL SKILLS VOCABULARY

ANALYZING TEXTS LITERAL COMPREHENSION COMPOSITION

EARLY CHILDHOOD EDUCATOR CERTIFICATE 64

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

65

2022-2023 DEMOGRAPHICS

Camp Fire School Readiness Program Since 2005, the Camp Fire School Readiness Program (CFSRP) has helped children be ready to start school through improving quality of care at neighborhood childcare centers. CFSRP supports early education programs that feed into the Fort Worth Independent School District with professional development and individual coaching/mentoring focused on teaching practices that improve language and social-emotional skills among children age 0-5.

822

LD HI

RETEN

TI

196 4.35

67%

children

African American

teachers & directors

Caucasian

Race/ Ethnicity

O N

C

Our Students

Our Teachers & Directors

average years of employment

Hispanic/Latino Multiracial Not Reported 1% Asian

1% Other

51% 15% 18% 5% 12%

44% 5%

2%

EDUCATION ACHIEVED

15%

20%

27%

Infants

36%

Toddlers

23%

Preschool

6%

Race/ Ethnicity

Caucasian Hispanic/Latino Multiracial 2% Not Reported

66

8%

1%

High School Some Associate’s Bachelor’s Master’s Diploma College Degree Degree degree or GED

88% FEMALE 4% MALE

Not reported

1%

Pre K

African American

2% Not reported

58%

13%

47% Female 51% Male

23%

19%

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

58% 20% 15% 5% 0% Asian

0% Other

15% 22%

7% 25%

20% 6%

9% NOT REPORTED

11%

12%

Years of Childcare Experience

10%

47% 25%

<1

1-3

4-6

7-10

>10N

R

Years with CFSRP

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

67

Early Education Apprenticeship Program

2022-2023 DEMOGRAPHICS

Continued Our Centers

15

CFSRP Centers

7%

Caucasian

40%

Hispanic/Latino Asian

31%

CFSRP classrooms

20%

20% 53%

27%

Level 2 _ Basic

68

40% 21% 31% 7% 2%

African American

21%

64

Centers

by Level:

Race/Ethnicity

2%

47% 33%

Classrooms

by Level:

Level 3 _ Intense

No Race Identified

2020-2021

2021-2022

2022-2023

N

%

N

%

N

%

APPRENTICES SERVED

23

---

43

---

91

---

NEW ENTERING APPRENTICES

23

100%

34

79%

77

85%

GRADUATED

12

52%

20

59%

34

37%

COMPLETED CDA

12

52%

30

70%

35

38%

RATING

58 64% No prior credential

$13.31 Starting hourly wage, median

33 early

childhood centers Thirty-three early childhood centers served as host sites for apprentices during the 2022-2023 school year (more than double the early childhood centers served in 2021-2022).

Level 4 _ Sustaining

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

Appendices CAMP FIRE SCHOOL READINESS & EARLY EDUCATION APPRENTICESHIP PROGRAM | 2022-2023 SCHOOL YEAR EVALUATION REPORT

69

Camp Fire School Readiness Program & Early Education Apprenticeship Program Evaluation Report 2022-2023 School Year