Quarterly Review of Milestones

Evaluation of BHST Part Two: OC Navigator

• The milestones completed during the April through June 2022 quarter consisted of presentations/ engagement meetings, workgroups, marketing, co-chair meetings/collaborations, subject matter expert meetings, data governance discussions, Google dashboard studios, community requests and feedback.

• The most common engagement strategies present in Chorus’ activities during this quarter were transparency, respect, and two-way knowledge exchange. • The least common engagement strategy was power sharing. • Subject matter meetings included the fewest engagement strategies, yet still included transparency, respect, and two-way knowledge exchange.

This section describes our review of the quarterly project milestones submitted by Chorus. We constructed a survey to determine how the activities on the milestone report aligned with Community-Partnered Participatory Research approach engagement strategies. This survey was completed by Orange County Health Care Agency MHSA Innovation Staff and Chorus staff.

Quarterly milestones are submitted as part of the deliverables from Chorus Innovations. These milestones outline the activities that Chorus completed during each quarter. We reviewed the activities from the Installment 5 Deliverable Report (April 1, 2022 – June 30, 2022) and coded activities to identify the types of activities completed during that period. We identified eight main types of activities.

Presentations / Engagement Meetings

Workgroups

Marketing

Co-Chair Meetings / Collaborations

Subject Matter Expert (SME) Meetings

Data Governance Discussions

Google Data Studios Dashboard

Community Requests / Feedback

Presentations and meetings with community partners

Monthly workgroup meetings with project stakeholders or stakeholder meetings with specific groups

Community outreach through advertising

Meetings with the community co-chairs, who are community stakeholders comprising an advisory council

Meetings with experts in areas to identify resources, functions, or dissemination of the OC Navigator

Discussions related to the process of managing the availability, usability, integrity, and security of data in the OC Navigator

Development and use of a dashboard to provide information on the use of the OC Navigator and some marketing

Input from the community on the design, functionality, and/or dissemination of the platform Meeting with the Council of Aging Southern California, Connect OC, Orange County Health Care Agency Division of Public Health

BeWell Prenatal-5, Grupo VeLA

Angels’ Stadium Campaign, Veterans Day Postcard

Weekly co-chairs meetings

SMEs for family safety, access, basic needs

Orange County Health Care Agency MHSA Leads, MHSA Prevention and Early Intervention, MHRS Research and Development

Google Data Studios dashboard for interactions with OC Navigator and Angels’ Stadium Campaign landing page

Adding resources, making the category page more engaging, design and functionality enhancements

After the activities were coded and the main type of activities were identified, we made a survey that asked respondents to indicate which of the five core engagement concepts, noted below, were represented in each set of activities. The five core engagement concepts are:

Decisions are made with the participants present and through agreed-upon mechanisms.

Understanding and respecting that people have different perspectives and opinions. Allowing respectful disagreement.

Including and engaging all individuals, especially those who have not been included, in decision making.

Providing opportunities for both formal and informal leaders to make substantial contributions.

Recognizing that each individual and group bring their own expertise and that expertise, including lived experience or formal education, all make equal contributions to the project.

The survey then asked for each type of activity to describe how the engagement concepts that were indicated for that activity occurred. Findings demonstrate the most common types of activities that occurred, the most prevalent engagement strategies, and which types of activities tended to relate to which engagement strategies.

The five core engagement concepts were present in most of the types of activities reported in the milestones report.

Of all the types of activities, subject matter expert meetings had the fewest engagement elements endorsed. Subject matter expert meetings included transparency, respect, and two-way knowledge exchange, but not the other engagement elements. Both data governance discussions and Google data studios dashboards included transparency, respect, co-leadership, and two-way knowledge exchange, but not power sharing.

Activities incorporating transparency include accurate and responsible representation of the OC Navigator platform including other similar platforms, its functionality, limitations, and data collection needs. It also includes providing information about the current state of the project including activities, milestones, and data metrics.

Activities incorporating respect include appreciation of the various resources stakeholders contribute to the project – their time, expertise (including lived experience), and values. It also includes styles of interaction including listening before answering, responding in a timely manner to requests, and engaging in proactive follow-up.

Activities incorporating co-development and collaborative learning. These activities provide the Chorus OC Navigation team with the opportunity to learn from individuals with lived experience, subject matter experts, and community members to include their feedback on tailoring materials and content for various stakeholders. They also provide the Chorus OC Navigation team the opportunity to share about the Navigation platform including its objectives, content, and features.

Activities incorporating project leadership including planning and decision-making included multiple stakeholders such as the advisory council co-chairs and the county counsel.

Activities incorporating input and participation by various community members. Power sharing actively attempted to empower stakeholders to ask questions and share thoughts and to offer different modes of participation and feedback.

Engagement elements align with general principles of the Chorus development process including co-development and stakeholder-informed outputs. Engagement elements are present based on how an activity is performed, not just that an activity is performed. For example, meetings that include opportunities for discussion and collaboration, proactive follow-up, and adopting an approach of listening more than asking. Structural factors – advisory councils and co-chairs – can help embed engagement elements into activities.