1 minute read
1.1 Methodology
The study was carried out in two phases. During the first phase, we undertook a detailed analysis of past MOPAN reviews and a brief literature review, to help formulate hypotheses and refine our research questions. During the second phase, we tested those hypotheses through four case studies. The analysis of MOPAN scores in the first phase revealed five Key Performance Indicators (KPIs) from the MOPAN assessment framework where HOs as a group scored significantly lower than other multilateral organisations (Box 1). These relate to planning, budgeting, results-management, external partnerships (particularly, working with partner countries) and sustainability of results.
Box 1: Statistical analysis of past MOPAN results
Advertisement
In the 2015 to 2018 period, MOPAN conducted assessments of 26 multilateral organisations, five of which (IOM, UNHCR, UN-OCHA, UNRWA and WFP) are classed by MOPAN as ‘humanitarian’. The organisations were assessed on a five-point scale against 12 Key Performance Indicators (KPIs). HOs performed worse on average than other groups in 9 of the 12 KPIs. However, a more detailed statistical analysis found these differences were statistically significant for only four KPIs:
KPI 1: Organisational architecture and financial framework enable mandate implementation and achievement of expected results
KPI 4: Organisational systems are cost- and value-conscious and enable financial transparency and accountability KPI 7: The focus on results is strong, transparent and explicitly geared towards function KPI 12: Results are sustainable
In addition, we found that there was one KPI on which the HOs performed worse as a group than the International Financial Institutions (IFIs), although not compared to multilateral organisations as a whole:
KPI 5: Operational planning and intervention design tools support relevance and agility within partnerships In these KPIs, a ranking of all the assessed organisations reveals a cluster of HOs appearing towards the bottom of the rankings, with OCHA, UNHCR and IOM appearing most frequently in the bottom quartile. Source: MOPAN Methodology manual
