A: Evaluation Mapping

7.0 Appendix

This mapping is intended to provide insight into the approaches that have been taken to evaluation in some projects, it is not exhaustive but comprises a selection of the evaluations gathered during the scoping for this work. That few of these interventions have set out to reflect specifically upon the efficacy of the evaluation approach taken as part of that process should be kept in mind.

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/Objectives

Area of Intervention/ Evaluation https://tinyurl. com/2p9snkcj

WEMWBS

16 young adults & 6 peer mentors took part in 4-week pilot culminating in professional standard dance performance to invited audience. Participants began project with WEMWBS score in midforties, at completion this had increased by 10 points to 53.9 (clinically significant). Positive team and trust building opportunity, developing sense of community.

Delivered by Dance United alongside Institute of Psychiatry at King’s College, South London & Maudsley NHS Foundation Trust. Coaching and mentoring participants to produce a life dance performance of professional standard to be performed in front of audience as part of integrated recovery model in Early Intervention in Psychosis

Dance

Project

The Alchemy Project –Maudsley Charity, Guy’s & St Thomas’ Charity, ACE and others

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/49ny6wyf

WEMWBS & SWEMWBS supplemented by a referral form to collect demographic data and an ‘activity evaluation’ form administered on completion of sessions. Service-user focus groups. 2 facilitated & focussed conversations with artists & referrers 1-2-1 interviews with carers/facilitators

The evaluation undertook to understand:

1: Patient profile and their reasons for participating

2: GP, stakeholder & artist perceptions

Patient data gathered using questionnaires, phone interviews with GPs, stakeholders & artists.

11 patients referred for first 10-week block, 7 participated. All of whom attended between 5-10 sessions and were rereferred for the second block of 10-weeks.

Conceived as a preventative, nonmedical, accessible, flexible, demandled and evidencebased intervention. Commissioning services from approved list of approx. 20 artists and arts agencies to deliver activities to those referred in 6 weeks blocks.

Arts on prescription delivered through Darlington Arts Studio

Arts for Well-being’

–Primary Care Trust, County Durham https://tinyurl. com/58v2xbc8

Nine patients participated in second block of 10 weeks’ duration, 8 of whom were classified as having completed the block at the endpoint.

Referral of patients for an 8-10 week art programme usually delivered in a community based or primary care setting.

Art on referral to address health and wellbeing

Artlift Wiltshire

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/6z4bdf6t

WEMWBS alongside qualitative interviews, focus groups, consultation events, case study analysis.

Creation of evidence base re: benefits of creative activity and analysis of impact in both qualitative and quantitative terms.

Approx. 70 museums, Northumberland bait projects and commissions have utilised WEMWBS with 522 people completing the assessment bait works in partnership to support more people in South-East Northumberland to create & take part in inspiring, high-quality arts experiences. All projects aim to build a stronger future with the people who live in the area. Museums with a focus on measuring wellbeing at a community level, particularly mental wellbeing in adults.

Project

Museums

Northumberland -bait.

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/k9dee9ef

Numerical mood data collected using Depression, Anxiety and Stress Scale. Wellbeing data: WEMWBS. Both administered twice (start/ end). 18 participant interviews to discover pros/cons of approach. Analysis of WhatsApp conversations.

Numerical data showed ‘clinically meaningful’ increases in participants’ wellbeing.

People experiencing low mood and anxiety participated in 30 days of simple creative challenges. They shared their work and reflections on a facilitated WhatsApp group. There were 55 participants over the course of the intervention.

Co-created, online, creativity-based intervention to improve mood and wellbeing

Project

64 Million Artists

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

This project was not specifically wellbeing focused though wellbeing emerged as a benefit through evaluation. https://tinyurl. com/bdfnj89v

Interviews and focus groups, assessment of workshop learning, creative survey (exploring skills development), mapping industry need, recording course participants’ progression into further education & employment.

Workshops for delivery of highquality skills training, teaching industry standards for work. Tailored learner support, provision of work placements, monitoring, tailored support and coaching, independent evaluation.

Develop programme to support up to 30 women prisoners to develop skills for high quality garment manufacture, duration of min 6 months. Create training programme and deliver industry recognised qualifications. Source jobs for women eligible for release upon successful completion of course Reduce barriers to finding work post-release, reduce re-offending.

Training & manufacturing workshops for fashion industry from HMPS & London College of Fashion

Project

Making for Change https:// tinyurl.com/ mwmbefap

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

Notes Tune In Programme

WEMWBS, Office for National Statistics personal wellbeing measure ( ONS4 ), Positive and Negative Affect Schedule (PANAS). Text and video feedback using an app, recorded interviews on several occasions, entry and exit polling (conducted 11x across 5 locations at start and end of singing sessions).

Creation of singing groups to improve/ maintain employee wellbeing. Groups were regularly invited to perform at internal events. Each (of 5) group hosted a Christmas concert for friends, family and colleagues.

Delivery of choir/ singing based work to deliver programs that are effective in supporting the wellbeing and mental health needs of staff. In Tune comprised weekly, hour long lunchtime singing sessions.

On: Song runs choirs and singing workshops for companies and organisations. In this case Tune In is a collaboration between On: Song & Lloyds Banking Group.

Project

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/yx3hybw3

Formal evaluation took place for 5 months once groups had established themselves. CORE10 & full WEMWBS at baseline, 3 & 6 months. Qualitative feedback through questionnaire comments and semi-structured interview.

4 community singing groups ran weekly for period of just over 12 months. Data was gathered according to the framework delineated at the outset of the project.

Building on prior pilot to provide weekly singing for people with enduring mental health issues. To assess changes in mental distress and mental wellbeing using CORE10 & WEMWBS respectively. To gather qualitative feedback and to document project through photography and film.

Singing for people with persistent mental health challenges.

Project

Singing for Mental Health & Wellbeing (Kent & Medway)

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

Measure what matters! Feedback can be gathered in written, spoken or participatory ways. Likert scales are simple way to collect quantitative data. WEMWBS is easy to use and, correctly administered, enables comparison between different types of intervention.

Toolkit: available here .

Consolidation of knowledge and learning to assist other museums to bring aspects of health and wellbeing into their work.

Museum health and wellbeing evaluation toolkit developed with funding from Arts Council England & Canterbury City Council

Project

The Beaney Health & Wellbeing in Museums Toolkit

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/2p89yr7j

Focus groups (including creative elicitation i.e. collage), participant case studies, semi-structured interviews.

Improved self- management of chronic conditions, improved patient wellbeing (primary outcome), increased sharing and connection, confidence, motivation and selfesteem. 50 2hr arts workshops delivered. One artist training day, 50 artist-health worker debriefs.

Non-medical referral option to support existing treatments and support health & wellbeing, support improved patient self-management of chronic conditions, alleviation of symptoms of stress, social isolation, boredom, pain, anxiety, depression, mobility or dexterity issues. Enable sharing of experiences, improve quality of life outside hospital, improve support resource knowledge.

Arts and creative participation in supported settings to improve health and wellbeing

Project

Fresh Arts on Referral

ACE, North Bristol NHS Trust, Macmillan Cancer Support, Southmead Hospital Charity

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

CWS is a visual analogue scale consisting of five sub-scales designed for use by those with mild-to- moderate levels of dementia. See Strohmaier et al. (2021).

N.B. M4W is a social enterprise Community Interest Company (CIC).

Canterbury Wellbeing Scale, short-WEMWBS, social discussions, videoed vox pop comments, participant self-recording of ‘noteworthy’ incidences, participant observation focussing on creative outputs.

Total membership across groups 275, average group composition: 41% carer, 38% caredfor, 15% volunteers, 6% partner organisation staff. Project-specific online resource & Goals Framework for facilitators of arts health activities developed, mentor training for volunteer leaders, professional development for M4W facilitators of music and dance, launch of 2 similar local projects.

Delivery of programme for carers of people living with dementia and their cared-for, focussed on singing, rhythmic movement and dance for groups comprising representatives of both groups. Highlight event included visual arts & crafts, i-tablet photography, djembe drumming and song cycle writing.

Therapeutic and community engagement through music.

Project

Music 4 Wellbeing (M4W): Carers Create https://tinyurl.com/ bddr8kzw

Notes

Evaluation/ Tools Used

Outputs/ Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/59h6vs7k

Pre and post intervention questionnaires comprising general participant history, WEMWBS, Generalised Anxiety Disorder Assessment (GAD7) & Patient Health Questionnaire (PHQ). Weekly ‘luggage tag’ qualitative feedback. Participants asked to fill what they learned and discovered on one side and, express how this made them feel on the reverse. Participant observation.

Two blocks of 6 workshops were delivered with 3-week break at midpoint for review. Workshops comprised: making marks, print making, collage, willow weaving, stitch craft & textiles.

Participants were GP referrals or self-referrals from posters or from Improving Access to Psychological Therapies NHS programme.

All presented with some form of low-level mental ill health (i.e. anxiety, stress, depression). Pilot arts on prescription in NW Leicestershire, work with up to 12 patients experiencing low level MH issues. Improve mental wellbeing, anxiety and depression scores through delivery of art and craft activities supported by experienced practitioners, encourage exploration of how such practice might become sustainable in the long term, replicate other arts on prescription programmes (for efficacy).

Weekly sessions in which those referred carried out planned, self-contained, creative activities.

Arts on Prescription, North-West Leicestershire N-W Leicestershire District Council’s ‘Staying Healthy Partnership’ Grant

Notes

Evaluation/ Tools Used

Outputs/ Outcomes https://tinyurl. com/yckwse5a

Baseline and postcompletion ShortWEMWBS, analysed using paired-sample t-test to measure difference in wellbeing scores of the sample. Scores of each statement on the scale were also compared for a deeper analysis of wellbeing.

1,22,072 calls story calls placed to 32, 748 active listeners over 30 days. The project found a statistically significant improvement in participants’ emotional wellbeing, problem solving abilities, social relationships, and decision-making abilities.

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

A 30-day project using artsbased activities relayed through story telling phone calls to help participants manage stress and improve wellbeing.

A project to help 620,000 teenagers in Tamil Nadu, India, to improve their wellbeing during the COVID19 pandemic.

Project

Take it Eazy Nalada Way, Cities Rise, Unicef

Notes

Evaluation/ Tools Used

Outputs/ Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

Evaluation found that ‘in the short term [the intervention] may in fact have increased demand for services by surfacing emotional issues with young people’

‘Monitoring’ (no further description) and WEMEBS (described as an administrative ‘burden’).

6 commissions delivered with young people’s involvement. Required monitoring and reporting completed. 655 young people participated ‘in-depth’, many taking cocreation roles.

Involve vulnerable young people in project, enabling them to practise the Six Ways to Wellbeing

Activities related to Six Ways to Wellbeing framework, delivering arts and culture-based interventions for young people based around the Six Ways and participate in festivals through the latter part of the pilot period

Project https://tinyurl. com/334rbzkz

Arts at the Heart of New Public Services / Six Ways to Wellbeing Kent County Council.

Notes

Evaluation/ Tools Used

Outputs/ Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

Nb. Evaluation focussed on effect of Sounding Out on participants (wellbeing understood as self-confidence, esteem & efficacy) and, to understand how the project has evolved and how its development related to the outcomes (impact).

Semi-structured interviews with programme participants, their family members and staff involved in delivery. Evaluation based on 5 one-off, post completion interviews, 5 interviews with participants shortly after participation began and 6 weeks in. 6 one off interviews with staff and one, one off interview with family member.

Delivery of 2-year programme based in London.

Music creation project, live performance opportunities, one-on-one pastoral support, training, workshop delivery, mentoring and work placement for ex-prisoners to develop transferable skills in team-working, communication & to increase self-discipline, selfconfidence, self-esteem and self-motivation. Improve social skills and develop mentoring skills.

Music traineeship for ex-prisoners with longer term rehabilitative opportunities upon release to bridge the gap between life inside and outside prison.

Project

Sounding Out Programme https://tinyurl. com/4ya55aas

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation

Nb. The evaluation aimed to identify opportunities for improvement in programme delivery and explain how the programme achieved its effects… when participants shared what they had gained from the workshop these statements were unsolicited… and part of the social interactions of the workshop participants and their audience.

Participant observation.

Delivery of dance-theatre workshop developed by Odd Arts Theatre and Company Chameleon in secure settings in the criminal justice, health and educational settings. Long term aims: improve and develop communication & self-esteem to reduce violence and self-harming behaviours, to improve wellbeing, increase resilience and overcome barriers.

Delivery of movement and dramabased exercises punctuated by discussions about relationships, feelings and emotional self- management in challenging situations based on participants’ experiences.

Dance & performance

Project

Building Resilience and Overcoming Adversity through Dance (BROAD) Part funded by Arts Council England. https://tinyurl. com/3c32dpxd

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/Objectives

Area of Intervention/ Evaluation

Planned from outset and delivered by freelance evaluation consultant who was commissioned for the role. Emphasis was on collaborative approach with evaluator as leader/ coordinator. Use of an outcomes framework matching intended outcomes to indicators and appropriate methods. Illuminative evaluation: not intended to foreground predefined intended outcomes but to use an inductive approach to capture actual effects.

Pragmatic mixed methods –using whatever technique is appropriate for the evaluation, combining quantitative and qualitative approach as required Methods: participant registration form, end of course evaluation form, in-house questions and follow up phone interviews. Phone interviews were also conducted with some delivery stakeholders. Participants who left the course early were also asked to respond to an email questionnaire in an effort to find out why.

Participants learned more effective management of breath/breathing; gained peer support and connection, increased awareness of available community-based health services. Local healthcare practitioners increased awareness of support available for patients; those designing and delivering project had increased understanding of its efficacy. Delivery partner Music for Wellbeing CIC increased local profile.

Sing and Breathe Salisbury was a year-long pilot project to develop a social prescribing approach to supporting people with respiratory conditions through singing. Sing and Breathe Salisbury. Activity strands were: Salisbury Breathless Singers: to continue and expand an established singing group for people with respiratory conditions in Salisbury; Introductory Courses: a 6-week introductory course for people with respiratory conditions (taking place 4 times over the year) to introduce people to techniques for managing their breath with option to join Breathless Singers for continuation; Outreach

Singing fo lung health

Sing & BreatheWiltshire https://tinyurl. com/2p8hnv4p

Sessions: monthly outreach sessionsto raise awareness of project and Singing for Lung Health among health professionals, community services and potential participants.

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/2mdvjaxm

Interviews with stakeholders (community audience, R&D participants; staff and artists; local civic and business representatives) to establish impact of participation in project; self- assessments for those participating in R&D; participant observation of R&D workshops and launch.

An increased demand for the arts for those actively using the trails (where sculptures appear)

Sense of place & heritage increased artistic awareness for participants in R&D groups increased sense of community/ pride Increased in ‘everyday wellbeing’ & happiness in the moment. Civic organisations increasing community embeddedness. Local people in leadership roes know the value of quality art.

Artist Joseph Hillier commissioned to produce sculptures for the town centre, celebrating its history, R&D undertaken with a variety of local groups. Final 14 sculptures unveiled in 2016.

Part of On Your Doorstep; public realm enhancement projects where artists, designers and sculptors were commissioned by local groups, residents, and organisations to improve public spaces, making them more interesting, attractive and cared for.

Spalding’s Hidden Corners Transported Art

Notes

Evaluation/ Tools Used

Outputs/Outcomes

Description of Project, Target Group, Aims/ Objectives

Area of Intervention/ Evaluation https://tinyurl. com/4emr7dr5

Participants were surveyed before and after 3 of 4 workshops they attended. Participant observation. Interviews of library staff, artists and others. Workshop participants also took part in an indepth focus group.

Included: Participants’ feeling that they had experienced an increase in artistic skill an increase in sense of belonging, community pride and creation of new, locally focussed material culture (the books) an increase in sense of ‘everyday wellbeing’ among participants Library service diversification. Artists reported increase in everyday wellbeing & development of artistic practice.

Overarching purpose of project: to create new audiences for the arts, from places with least engagement.

Book and printmaking workshops –artist led workshops for self-selected participants to create a small book based on their own topic/interest. Completed books were displayed in the library.

Project

A Small Library, Open Book Transported Art & Local Authority Library Service