Beverly Parsons - Social innovation evaluation

Beverly Parsons • bparsons@insites.org • www.insites.org

Key Message

Beverly Parsons • bparsons@insites.org • www.insites.org

Social Innovation Evaluation: From Afterthought to Forethought

2

Then: Our Stable, limited Changing connections

World Now: Social Complex, connected, Systems dynamic

Beverly Parsons • bparsons@insites.org • www.insites.org

3

Then: Individual programs, policies

Our Changing World Now: Social Multi-faceted, Interventions overlapping, dynamic Beverly Parsons • bparsons@insites.org • www.insites.org

4

Then: Formative and Summative

Our Changing World Now: Evaluation Developmental with Approach Nested Formative and Summative Beverly Parsons • bparsons@insites.org • www.insites.org

5

Beverly Parsons • bparsons@insites.org • www.insites.org

Beverly Parsons • bparsons@insites.org • www.insites.org

Beverly Parsons • bparsons@insites.org • www.insites.org

Traditional Strategy Approach

Beverly Parsons • bparsons@insites.org • www.insites.org

Establish goals Develop action plan Implement plan Evaluate results

9

Evaluation and Strategy Repositioned and Redesigned Adaptive STRATEGY Developmental EVALUATION

Beverly Parsons • bparsons@insites.org • www.insites.org

Developing an Evaluation Framework

Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change

Beverly Parsons • bparsons@insites.org • www.insites.org

11

Framework for Social Innovation Evaluation ____________________ (innovation) Baseline Understanding To what extent:

Trying Out Interventions

Tipping Point

Sustainable Adaptive Balancing

_________________________ (initiative)

Points of Systemic Influence (Individual/ relationship) (Community: informal) (Community: formal) (Societal—City, state, national) (Learning & Capacity Building) (Networks/ Partnerships)

bparsons@insites.org • www.insites.org

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation

13

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture

14

Placeholder ZOOM 1

From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai.

Used by permission of Viking Penguin, a division of Penguin Group 15 (USA) LLC.

Placeholder ZOOM 2

From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai.

Used by permission of Viking Penguin, a division of Penguin Group 16 (USA) LLC.

Placeholder ZOOM 3

From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai.

Used by permission of Viking Penguin, a division of Penguin Group 17 (USA) LLC.

Placeholder ZOOM 4

From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai.

Used by permission of Viking Penguin, a division of Penguin Group 18 (USA) LLC.

Placeholder ZOOM 5

From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai.

Used by permission of Viking Penguin, a division of Penguin Group 19 (USA) LLC.

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture Map actions among partners

20

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture Map actions among partners Be transparent

21

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture Map actions among partners Be transparent Map progress over time 22

Articulate Fundamental Social Innovation

Beverly Parsons • bparsons@insites.org • www.insites.org

23

Concrete Support in Times of Need Children’s Social/Emotiona l Competence

Center for the Study of Social Policy (www.cssp.org)

Identify Points of Systemic Influence First: Identify Relevant Domains of the Social Ecology

Beverly Parsons • bparsons@insites.org • www.insites.org

25

Beverly Parsons • bparsons@insites.org • www.insites.org

26

Beverly Parsons • bparsons@insites.org • www.insites.org

27

Identify Points of Systemic Influence First: Identify Relevant Domains of the Social Ecology Second: Identify Potential Levers for Change

Beverly Parsons • bparsons@insites.org • www.insites.org

28

Beverly Parsons • bparsons@insites.org • www.insites.org

Beverly Parsons • bparsons@insites.org • www.insites.org

Framework for Social Innovation Evaluation _________________________ (initiative) Strengthening Families Innovation

Points of Systemic Influence

Baseline Understanding To what extent:

Trying Out Interventions

Tipping Point

Sustainable Adaptive Balancing

CaregiverChild-Family

Neighborhood/Co mmunity Organizations, Providers (Norms, infrastructures,

policy) Societal Actors (State & national) (Norms, policies, infrastructures)

Stakeholder Learning & Capacity Building

Networks/ Partnerships

bparsons@insites.org •

Identify Actors within the Domains of Social Ecology

Identify Actors within the Domains of Social Ecology

Theory of Change in Complex Systems Framework for Social Innovation ____________________ (innovation) Trying Out Sustainable Adaptive Balancing Tipping Point Evaluation Interventions Points of Systemic Influence

Baseline Understanding To what extent:

(Individual/ relationship)

(Community: informal)

(Community: formal)

(Societal—City, state, national)

(Learning & Capacity Building)

(Networks/ Partnerships)

bparsons@insites.org •

Developing an Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change

35

Weave strategy & evaluation with social change over time Beverly Parsons • bparsons@insites.org • www.insites.org

Assessing Where We Are in relation to our vision Beverly Parsons • bparsons@insites.org • www.insites.org

Trying Out Interventions within & across system domains, dimensions, and across time Beverly Parsons • bparsons@insites.org • www.insites.org

Beverly Parsons • bparsons@insites.org • www.insites.org

Reaching a Tipping Point: Activities are clearer, scaled up, and crossing more parts of the system

Beverly Parsons • bparsons@insites.org • www.insites.org

Sustainable Adaptive Balancing: We are here, new things happen, system changes, and we are able to adapt

Eventually the cycle begins again with a new paradigm shift.

Beverly Parsons • bparsons@insites.org • www.insites.org

Weave strategy & evaluation with social change over time Beverly Parsons • bparsons@insites.org • www.insites.org

Framework for Social Innovation ____________________ (innovation) Evaluation Points of Systemic Influence

Baseline Understanding To what extent:

Trying Out Interventions

Tipping Point

Sustainable Adaptive Balancing

(Individual/ relationship) (Community: informal)

(Community: formal)

(Societal—City, state, national)

(Learning & Capacity Building)

(Networks/ Partnerships)

bparsons@insites.org • www.insites.org

Developing an Evaluation Framework

Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change

Beverly Parsons • bparsons@insites.org • www.insites.org

44

Identify Indicators of Social Benefit

Beverly Parsons • bparsons@insites.org • www.insites.org

45

Framework for Social in Innovation Evaluation Theory of Change Complex Systems Strengthening Families Innovation

Points of Systemic Influence

Baseline Understanding To what extent:

Trying Out Interventions

Tipping Point

Sustainable Adaptive Balancing

CaregiverChild-Family

Neighborhood/Co mmunity Organizations, Providers (Norms, infrastructures, policy) Societal Actors (State & national) (Norms, policies, infrastructures) Stakeholder Learning & Capacity Building

Networks/ Partnerships

bparsons@insites.org •

Framework for Social Innovation EvaluationStrengthening Families Innovation

Framewor of SocialinInnovat ion St rat egy and Theory ofkChange Complex Systems p 1 Strengthening Families(initiative) Example _________________________ S te

Points of Systemic Influence

CaregiverChild-Family

Step

3

Baseline Understanding To what extent: of and Are families aware factors? Do e practicing protectiv anized and rg parents use both o ? adaptive dynamics

Trying Out Interventions

protective f o e s u t s te nges in Families a h c e in m r e t e factors and d and boundaries in relationships ilies learn to selfm daily life. Fa rotective factors. of p assess use s pilot ie it n u m m o /c

y and Evaluat ion i n Complex Social Sy st ems ms

ut ons

tective changes in daries in n to selfve factors.

nities pilot g that are factors and

ilot new

Tipping Point

Sustainable Adaptive Balancing

bitually using a h re a s e ili Enough fam rotective factors that p f and building are shifting in support o . family norms tors framework for living c protective fa g realized. in e b Benefits

Caregivers are connecte d family members who are with other caregivers and sk ing protective factors. Fa illed at using and buildmily norms support protec tive factors. (Evidence of well-being of families an d levels of child maltreatm ent regularly monitored.)

e commit to us rs e d a le & s d Neighborhoo rotective factors. They p rt o p p and su and adaptive n d e iz n a rg o e leverag l cohesio esired socia dynamics. D . ed/supported being achiev

Neighborhoods & leade rs itions in community and adjust to social condemphasis on supporting protective factors. They consider and reflect on their ways of functioning . (Evidence monitored.)

to iders commit ies that v ro /p s n o ti a res/polic Organiz orms/structu amework & n d e n ig s e d re ctors fr protective fa e d an d

Organizations/providers use caregiver, child, fam outcome and other data ily to adjust to social conditions in community wi presence of protective fac th emphasis on tors. Organiza

Framework for Social Innovation Evaluation Strengthening Families Innovation Points of Systemic Influence

Baseline Understanding To what extent:

Trying Out Interventions

Tipping Point

Sustainable Adaptive Balancing

CaregiverChild-Family

Neighborhood/Co mmunity Organizations, Providers (Norms, infrastructures, policy) Societal Actors (State & national) (Norms, policies, infrastructures) Stakeholder Learning & Capacity Building Networks/ Partnerships bparsons@insites.org •

Developing an Evaluation Framework

Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change

Beverly Parsons • bparsons@insites.org • www.insites.org

50

Process for Developing an Evaluation Framework

Who:

Leadership Team Evaluator

Stakeholders When: Near beginning Review, revise, adapt

Beverly Parsons • bparsons@insites.org • www.insites.org

51

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation

52

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture

53

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture Map actions among partners

54

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture Map actions among partners Be transparent

55

Value of the Evaluation Framework

Beverly Parsons • bparsons@insites.org • www.insites.org

Link strategy and evaluation See the big picture Map actions among partners Be transparent Map progress over time 56

?

Q&A Beverly Parsons • bparsons@insites.org • www.insites.org

57

bparsons@insites.org www.insites.org

Beverly Parsons • bparsons@insites.org • www.insites.org

58