I M P ROV I N G E F F E C T I V E N E S S A N D OUT C O M E S F O R T H E P OO R I N H E A LT H , N UT R IT I O N , A N D P O P U L AT I O N
7. As explained in appendix B, the analysis of staff specialties is based on job titles only; there was no known reliable data source that would have allowed tracking by actual staff expertise over the period. The extent to which the job titles accurately reflect staff expertise is unclear. 8. IEG evaluates projects by assessing their results in relation to their stated objectives. The outcome rating is based on: (a) the relevance of the project’s objectives and design in relation to country needs and institutional priorities; (b) efficacy, which is the extent to which the project’s objectives have been (or are expected to be) achieved; and (c) efficiency, which is the extent to which the objectives have been (or are expected to be) achieved without using more resources than necessary. Outcome is rated on a six-point scale: highly satisfactory, satisfactory, moderately satisfactory, moderately unsatisfactory, unsatisfactory, and highly unsatisfactory. For ease of comparison, this report uses the percentage of ratings that are moderately satisfactory or higher in making comparisons across project groupings. 9. The share of project exits in other sectors that were Development Policy Loans remained a constant 15–16 percent between the two periods. 10. The share of Africa Region projects with satisfactory outcomes rose from 60 to 67 percent among projects exiting in fiscal 1998–2001 and fiscal 2003–07, compared with an increase from 73 to 78 percent Bankwide. Outcome ratings for African HNP projects are thus considerably lower than the Regional average across all sectors. 11. However, it is important to note that there was a large increase in HNP project approvals in the Africa Region in fiscal 2002–06 and they will constitute a much larger share of exits in the HNP portfolio over the next five years. 12. While Africa Region projects performed less well on average in other sectors than did the other Regions combined (64 percent satisfactory in Africa, 79 percent in other Regions over the 10-year period), the outcome ratings of Africa Region projects increased at a faster rate (from 58 to 72 percent satisfactory over the two periods). When Africa Region projects are excluded, the ratings for other Regions and sectors combined are higher, but the amount of increase is lower (rising only from 78 to 81 percent satisfactory, as opposed to 72 to 79 percent satisfactory if Africa is included). 166
13. Ratings on institutional development impact of HNP-managed projects (a rating that was discontinued in fiscal 2006) are as low as those for other sectors. 14. Of the 220 projects approved from fiscal 1997 to 2006 that were subjected to in-depth review, 110 had closed and 99 had been rated by IEG as of September 30, 2008. Fifty-eight percent of the HNP projects approved from 1997 to 2006 that had closed had satisfactory outcomes, while about two-thirds had satisfactory Bank and borrower performance. The outcome ratings for the sample in the portfolio review (58 percent satisfactory) are different from those in figure 2.4 (68 percent satisfactory) because they apply to a different group of projects. Figure 2.4 shows the outcomes for all projects that closed in a given fiscal year, irrespective of when they were approved, while the IEG sample is of 220 projects approved from fiscal 1997 to 2006, only half of which have closed to date. Most of the projects that have closed were approved in fiscal 1997–2001, but a few approved in fiscal 2002–06 (for example, Development Policy Loans) are also included. The performance of most of the projects approved more recently is unknown. 15. While there are several possible explanations for the overall increase in supervision costs across all sectors, examination of the supervision cost data by Region reveals no pattern that would explain why average HNP supervision costs for three years were so much greater than for the rest of the Bank. 16. The ratio of the percent of unsatisfactory projects with this characteristic relative to the percent of satisfactory projects with the characteristic. 17. Projects in Africa are also largely responsible for lower outcomes for IDA projects. Half of IDA-financed HNP projects had satisfactory outcomes, compared to about three-quarters of IBRD projects. However, this rises to 77 percent if IDA projects in Africa are excluded. 18. For a fuller definition and discussion of sectorwide approaches (SWAps), see chapter 3. 19. See appendix F for more on the performance of these projects. 20. World Bank Group 2007. The Detailed Implementation Review (DIR) was conducted by the Department of Institutional Integrity. 21. World Bank Group 2007, p. 11. The DIR team visited all 15 food and drug laboratories and 2 offices that received equipment from the project (p. 67). 22. World Bank Group 2007, p. 12. The DIR team visited 55 hospitals in 23 districts, representing 35 per-