under two-fifths of project M&E quality in 2007 and 2008 as high or substantial and noted that shortcomings in M&E design and implementation could contribute to problems in project supervision and reporting.21 Shortcomings in M&E prevent the Bank from demonstrating the results of activities it supports. In some instances, poor development outcome ratings of Bank-financed operations derive, at least in part, from either deficient specification of indicators or lack of information regarding their evolution. This suggests that inadequacies in M&E systems may result in a significant understatement of the results that Bank operations help bring about. The latest data suggest that stepped-up efforts are needed. The share of operations rated high or substantial in M&E quality dropped from 32 percent of projects closed in FY06–08 to 26 percent for those closed in FY09–11 (figure 2.8). The Middle East and North Africa Region improved its ratings from a low of 6 percent during FY06–08 to 22 percent for FY09–11. In contrast, the Latin America and the Caribbean Region experienced a significant decline, from considerably above the Bank average in FY06–08 (44 percent) to only slightly above the Bank average in FY09–11 (29 percent). Most sectors experienced the same downward trend, with particularly significant declines in ratings for M&E in the transport and environment sectors. Both of these were rated considerably higher than the Bank average in FY06–08 but are now rated below the average (see appendix E). Evaluations can help pinpoint weaknesses in M&E practice. These include limited availability of sound baseline data, too many unfocused indicators in general, and too few outcome indicators (IEG 2009a). A review of a random sample of 10 percent of projects completed in FY09–11 whose M&E quality was rated modest or negligible in ICR Reviews indicates that these challenges persist. One-third did not have baseline data for performance indicators; close to one-fifth measured outputs rather than outcomes; and 15 percent did not specify target values. The review also found that institutional factors and support infrastructure matter. High staff turnover and delays in recruiting M&E staff in country counterpart teams, lack of clarity over roles and responsibilities in data collection, problems
Box 2.1
Improvement in Human Development Sectors
Human development was the only area in which the share of projects rated moderately satisfactory or better in development outcome ratings improved between FY06–08 and FY09–11. Although the change is not statistically significant, it is a positive development for the sectors that can be examined further. Since the mid-2000s, ratings for human development operations have been poorer than those in other areas. The 2011 Results and Performance report (IEG 2011d) argues that achieving results in the health and education sectors has become more difficult because interventions have moved beyond enhancing basic access to addressing more complex quality objectives and systemic reforms. However, ratings of quality of supervision improved significantly for health, nutrition, and population projects. This change is statistically significant. Source: IEG.
30
Results and Performance of the World Bank Group 2012