Primer on Large-Scale Assessments of Educational Achievement

Page 27

Introduction and Overview

Other large-scale assessments are more difficult to classify because they do not fit neatly into any of the conventional categories (see annex 1A). Two ­examples are the Early Grade Reading Assessment (EGRA) and the Early Grade Mathematics Assessment (EGMA).1 EGRA was developed in 2006 as a simple, low-cost measure of pre- and early reading skills that governments, international development organizations, donors, or civil society could use in low-resource contexts (Gove and Cvelich 2011). EGMA followed a few years later as a ­measure of ­early mathematical or numeracy skills. EGRA tests letter ­ ­ recognition, ­ phonemic awareness, ability to read simple words, and ­listening comprehension. EGMA tests number recognition, comparisons, and ordering sets of objects. Together, these two tools, and variations on them, have been administered in more than 50 countries and almost 100 languages. The EGRA toolkit provides a template that can be customized for a particular country using its alphabet, language, and texts. The EGMA toolkit is similar in nature. EGRA and EGMA are meant to be administered orally to children (usually enrolled in grades 1 to 3) in a one-to-one setting. This individual administration can make the data collection exercise more time intensive than a typical large-scale assessment, which would be administered using paper and pencil or digital devices in a group setting. In addition, unlike most large-scale assessments, the results from an EGRA or EGMA exercise are typically reported in terms of student performance on individual items or tasks rather than as an overall score. EGRA and EGMA have functioned best to generate data quickly on reading and math levels in low-resource environments and as baseline and follow-up tools for impact evaluations of targeted interventions to improve early reading and mathematics. They also can be a starting point on the journey to creating more-standardized, more-representative, large-scale assessment programs aligned with a defined curriculum. Another popular type of assessment is citizen-led assessment (CLA), which emerged in India in 2005 as a way to raise public awareness of low learning levels and to increase bottom-up accountability and action to improve the quality of education and learning.2 Thousands of volunteers traveled to rural districts and administered simple reading and math tests to children at home. The dismal results helped stimulate debate and prioritize learning in national policy in India. From this beginning, CLAs quickly expanded around the globe and are now also used in Kenya, Mali, Senegal, Tanzania, and Uganda, among others. Many government-led, large-scale assessment programs could learn useful lessons from CLAs in terms of how to work effectively with the media to accessibly disseminate assessment results to the public. In general, CLAs are administered in people’s homes, rather than in schools. As a result, they capture the learning levels not only of children attending school but also of those who have never enrolled or have dropped out. This approach is crucial to ensuring that no child is written off, particularly in countries with high dropout rates or where population subgroups are not enrolled in the education system at the same rate 1 https://www.eddataglobal.org/. 2 http://www.asercentre.org/.

5


Turn static files into dynamic content formats.

Create a flipbook

Articles inside

Glossary of Technical Terms

7min
pages 159-163

Asia Primary Learning Metrics 2019 Assessment

1min
page 155

Primary Learning Metrics 2019 Reading Literacy Assessment

1min
page 154

Benchmarks for Grades 4 and 6

2min
page 149

Metrics 2019 Mathematical Literacy Assessment

4min
pages 152-153

CONFEMEN 2014

1min
page 142

Programme d’Analyse des Systèmes Éducatifs de la CONFEMEN

2min
page 141

Assessment, 2000–18

1min
page 131

Eastern Africa Consortium for Monitoring Educational Quality

2min
page 138

8.9 Translation and Adaptation of International Large-Scale Assessments

2min
page 130

Study, 2001–16

1min
page 125

Mathematics and Science Study

2min
page 124

International Mathematics and Science Study

4min
pages 119-120

References

1min
pages 115-116

Chapter 8. What Are the Main International Large-Scale Student Assessments?

1min
page 117

Achievement Survey

1min
page 109

What Are Other Ways to Communicate Large-Scale Assessment Results?

2min
page 112

Chapter 7. How Can Effective Communication of Large-Scale Assessment Results Be Ensured?

1min
page 105

7.1 Features That a National Large-Scale Assessment Can Highlight

3min
pages 107-108

References

1min
page 104

Assessment According to Sex

2min
page 97

Key Ideas

1min
page 103

Student Achievement?

2min
page 99

6.2 Scoring Rubrics

2min
page 95

6.1 Example of an Item and Its Codebook Information

1min
page 94

References

1min
page 92

Key Ideas

1min
page 91

Administration?

2min
page 89

Structure and Main Changes over Time

1min
page 81

5.1 National Large-Scale Assessment: Student Tracking Form

1min
page 88

References

1min
page 84

What Should Be Included in the Test Administration Manual?

2min
page 79

How Will the Assessment Be Administered?

1min
page 78

4.5 The Importance of Item Piloting

2min
page 75

4.4 Item Writing Guidelines

1min
page 74

Chapter 4. What Are the Key Decisions in Designing Large-Scale Assessments?

1min
page 67

References

1min
page 66

Key Ideas

1min
page 65

3.2 National Large-Scale Assessment Funding Checklist

2min
pages 63-64

Team Personnel

2min
page 60

Católica de Chile in Supporting National and International Large-Scale Assessment Initiatives

9min
pages 56-59

3.1 Saudi Arabia’s Education and Training Evaluation Commission

2min
page 54

Syndicate

1min
page 55

References

4min
pages 49-52

Key Ideas

1min
page 48

Goals in Brazil

2min
page 43

2.6 Communicating National Large-Scale Assessment Results in Peru

2min
page 41

National Assessment

1min
page 39

Practice in Argentina

2min
page 47

What Are Some Common Policy Implications of Large-Scale Assessment Findings?

2min
page 42

9.3 Proportion of Students in Each Reading Proficiency Level in Grade

2min
page 27

2.5 Investing in Technical Expertise in Indonesia

2min
page 40

What Will You Learn from This Primer?

2min
page 32
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.
Primer on Large-Scale Assessments of Educational Achievement by World Bank Publications - Issuu