Context
Survey
Engagement
ICN Agency Effectiveness Working Group
Method
Use
Experience
Multiyear project: „Planning, monitoring and measuring effectiveness
• 2023: Planning (Singapore)
• 2024: Measuring (Hungary)
Survey on CAs practice
• Descriptive, not prescriptive
• ICN
members
Survey
Engagement
Method
Use
Experience
Broad concept
Survey Engagement
Method Use
Experience
Broad scope
• Effectiveness before court(s)
• Effectiveness of implementation
• Simplified calculation of expected consumer savings, aka Ex-ante impact assessments
• Evaluation of actual impact of interventions, aka Ex-post evaluations
• Other measurements of agency effectiveness
• External assessments
Anonymity
Past 5 years
2019-2023
Same/similar set of basic questions
Sample
Survey
Engagement
Target group: ICN members
35 responses (34% overall response rate)
Response rates by continent
Method
Use
Experience
Not representative, still informative
Ex-ante impact assessments
Survey Engagement
Method
Use
Experience
Engagement
Survey
Survey
Engagement
Method
Use
Experience
Institutional aspects
Publicly available?
OECD Guide
Survey
No specific question about it
Engagement
Method
Use
Experience
• 9 CAs referred to it anyway (out of the 17 active respondents)
• All of them say they follow it
• 8 of them OECD members
+ others who follow or are aware of it without mentioning
+ others who follow or are aware of it without responding
Survey
Engagement
Method
Use
Scope & Constraints
• Direct, static, price effects
Experience
• Dynamic effects, non-price effects (e.g. innovation) but inclusivity at the margins (nature of method)
• Deterrence but effort
BLIND SPOTS
Primarily utilised in
Survey
Engagement
Method
Use
Experience
Survey
Engagement
Method
Use
Experience
Overall Experience & Main Challenges
Survey
Engagement
Method
Use
Experience
Survey
Engagement
Method
Use
Experience
Fit for purpose
Survey
Engagement
Method
Use
Experience
