In-depth impacts

In-depth impacts

7.26

7.27 Building upon the two areas of data already discussed, Creative Scotland and its partners could consider a range of in-depth work to support an evaluation of the Glasgow 2014 Cultural Programme. This activity would need to be determined as and when Creative Scotland and other funding partners are able to identify projects or clusters of projects with specific intentions (e.g. to be World Stage or Out of Place). Additional investment in resources in this area should focus carefully in adding to the available data, analysis and understanding relating to specific areas of potential intervention. For example, if a project is working with the local community in the east end of Glasgow, to improve the skills and employment opportunities for those people, then a specific evaluation might be required in order to assess the success of that project. Alternatively, Creative Scotland might feel that a specific area of interest across the entire programme would be the opportunity to raise the profile of cultural activity in Scotland; a specific assessment looking at media responses across the programme might be required.

The in-depth evaluation (Table 15):

- Could be programme-wide, but specifically looking at an impact area like profile or economic value; - Could be project specific, exploring whether a specific project has achieved its aims; - Is useful in exploring complex projects, and understanding what has happened; or, - Will be helpful in testing whether aims and objectives are underpinned by operational and tactical planning (effectively, in testing the validity of a logic model for individual projects and for wider programme aims)

Table 15: In-depth impacts

Theme

Cultural Social Economic Image Management/ Process

Impact/ activity Area

Programme Audiences, visitors, participants and volunteers: access, diversity, benefits and beneficiaries Tourism; Job creation/ skills; Business interventions Programme Partnerships/ cross-sector working; Funding

Indicator/Measure

- Media/key critics responses to programmme

- Responses from peers in the sector - Explore the effects of individual/collective projects and programmes, according to what they sought to achieve. - Enable more direct observation and engagement with audiences, visitors, participants and volunteers, as well as with connected beneficiaries (e.g. parents, wider community, etc). - Could include Social Return on Investment calculation; exploration of specific effects on communities in east Glasgow; range of other specific indicators/measures, dependent on programme. - Explore the effects of individual/collective projects and programmes, according to what they sought to achieve - Could include complex economic impact modeling, looking at tourism, effects upon the supply chain of additional funding, and any specific job creation/business development interventions. - Media responses - Social media sentiment - Explore the effects of individual/collective projects and programmes, according to what they sought to achieve

Methods for/notes on data generation

- Media clippings/assessment – could include coding of media items and analysis of positive/ negative sentiment, areas of focus, etc. - Peer review process (e.g. Arts Council England’s formal peer

assessment for NPOs). - Require bespoke and specific evaluation, relevant to the size/ scale of project, and the benefits sought - Could include follow-up survey with a cohort of audiences/ visitors/participants/volunteers after the programme has finished,

to begin to explore legacy - Require bespoke and specific evaluation, relevant to the size/ scale of project, and the benefits

sought - Media clippings/assessment – could include coding of media items and analysis of positive/ negative sentiment, areas of focus, etc.

- Require bespoke and specific evaluation, relevant to the size/ scale of project, and the benefits sought