TABLE B.9
Relationship between AAA, Technical Assistance, and Lessons from Other Projects and Project Outcomes, among the 84 Projects in the Sample Portfolio That Were Rated for Overall Outcome and Sustainability
N
Percentage rated satisfactory on overall outcome
N
Percentage rated sustainable
Yes
15
93
15
87
No
22
77
18
67
Was project informed by the following? World Bank ESW
World Bank ESW and/or project lessons Yes
18
94
17
82
No
19
74
16
69
Yes
8
88
8
75
No
29
83
25
76
Yes
17
94
17
82
No
20
75
16
69
Non-World Bank ESW
All ESW
Policy dialogue, advice, technical assistance Yes
23
91
23
74
No
14
71
10
80
ESW and technical assistance Yes
26
92
26
77
No
11
64
7
71
Source: Evaluation portfolio. Note: Bolded cells are statistically signiďŹ cantly dierent from each other.
uct against a series of indicators, statements can be made on what leads to a results-rich piece of AAA and what could be done in the Bank to ensure that more results are achieved from AAA. Indicators are grouped into four general categories: results, strategic relevance and ownership, technical quality, and dissemination and sustained dialogue. A fourpoint rating scale was used: high, substantial, modest, and negligible. Summary Findings Technical Quality Based on the sample, the quality of ARD AAA is rated between substantial and high. The Bank has put in place a thorough and systematic process that ensures this outcome. Given that the Bank is an important repository of global knowledge on development, the fact that only about twothirds of the studies drew on examples from within the Region or across Regions to illustrate a point indicates that an important area is not being fully exploited. Recommendations provided in AAA reviewed by this evaluation usually fell short of best practice. Only 10 reports provided specified actions to be taken by specified actors. Only
112
|
Growth and Productivity in Agriculture and Agribusiness
one report produced a matrix of recommendations that included what changes should be made, who should make those changes (what organization), and when they should be made. None described how such changes could be undertaken. None discussed the sequencing of changes. Strategic Relevance and Ownership Strategic relevance and ownership measures are slightly below substantial. Over 85 percent of the products addressed issues that had been identified as development constraints in earlier work or in policy dialogue with clients. And a full 77 percent of products were delivered in time to affect relevant policy decisions by the government. There is no evidence from the sample that demand-driven AAA produces better results than supply-driven AAA. Ownership appears to be an important ingredient in overall results achieved. Seven studies with low results also had low ownership. Dissemination and Sustained Dialogue Inadequate dissemination and dialogue are limiting results. In this assessment, the score for dissemination and sustained dia-