Advanced Programs Standard Five Table of Contents

Quality Assurance System - Mapping and Rationale

Standard Five Compendium 1 – RA5.1 Quality Assurance System

Evidence:

Grambling State University Quality Assurance System Handbook

Graphic representation of the Quality Assurance System

Crosswalk of all measures included in the Quality Assurance System

Verification of the Quality Assurance System through demonstration (Elementary Education Taskstream DRF)

Standard Five Compendium 2 – RA5.1 and RA5.2 Representativeness of Data

Evidence:

Links to Standard RA1 – RA4 Compendia

Assessment Planning and Data Review Documents

System supports the ability to monitor operational effectiveness (e.g., setting program priorities and data tracking)

Evidence/data from a coherent set of multiple measures are used to inform, modify, and evaluate EPP’s operational effectiveness

Evidence the system has the capacity to collect, analyze, monitor, a nd report data/evidence on all CAEP Standards

Evidence that the system supports disaggregation of data by specialty licensure area and other dimensions (e.g., over time, by race/ethnicity, gender, etc.)

RA5.1 Quality Assurance System The provider has developed, implemented, and modified, as needed, a functioning quality assurance system that ensures a sustainable process to document operational effectiveness. This system documents how data enter the system, how data are reported and used in decision making, and how the outcomes of those decisions inform programmatic improvement.

Documentation that EPP regularly and systematically does the following:

Reviews quality assurance system data

Identifies patterns across preparation programs (both strengths and weaknesses)

Uses data/evidence for continuous improvement tests innovations

RA5.1 Quality Assurance System The provider has developed, implemented, and modified, as needed, a functioning quality assurance system that ensures a sustainable process to document operational effectiveness. This system documents how data enter the system, how data are reported and used in decision making, and how the outcomes of those decisions inform programmatic improvement.

RA5.2 Data Quality This provider’s quality assurance system from RA5.1 relies on relevant, verifiable, representative, cumulative, and actionable measures to ensure interpretations of data are valid and consistent.

Advanced Programs Standard Five Table of Contents

Quality Assurance System - Mapping and Rationale

Documentation that evidence (as defined in CAEP Evidence Guide) is:

Standard Five Compendium 3 – RA5.2 and RA5.4 Actionability of Results

Evidence:

Changes and Modifications based on Data

Future Directions

Standard Five Compendium 4 – RA5.2 Reliability and Validity of EPP Assessments

Evid ence

Reliability and validity process documentation and data

Sampling procedures

At least 3 cycles of data for R1-R4

Process to meet CAEP Sufficiency on evaluation measures

Relevant (related to standard)

Verifiable (accuracy of sample)

Representative (specificity on sample characteristics)

Cumulative (generally 3 cycles or more)

Actionable (in a form to guide program improvement)

Documentation that interpretations of evidence are consistent, accurate, and supported by data/evidence

At least 75% of EPP created assessments used in quality assurance system are scored at the minimal level of sufficiency as defined by the CAEP Evaluation Framew ork and Tool for EPP-Created Assessments

Documentation that EPP-created assessments (except for surveys) have:

established content validity

inter-rater reliability or agreement at .80 or 80% or above (except for surveys), for surveys, questions align to standards

RA5.2 Data Quality This provider’s quality assurance system from RA5.1 relies on relevant, verifiable, representative, cumulative, and actionable measures to ensure interpretations of data are valid and consistent.

RA5.4 Continuous Improvement The provider regularly, systematically, and continuously assesses performance against its goals and relevant standards, tracks results over time, documents modifications and/or innovations and their effects on EPP outcomes.

RA5.2 Data Quality This provider’s quality assurance system from RA5.1 relies on relevant, verifiable, representative, cumulative, and actionable measures to ensure interpretations of data are valid and consistent.

Advanced Programs Standard Five Table of Contents

Quality Assurance System - Mapping and Rationale

Standard Five Compendium 5 – RA5.3 Stakeholder Involvement

Specific evidence of diverse stakeholder involvement is documented through multiple sources in each of these areas:

Evidence:

Links to Standard RA2, RA3, and RA4

MOUs/partnerships

Advisory Board feedback/input

Co-construction or assessments/surveys: example of Professional Responsibility of Danielson changes made from meetings with mentor teachers and supervisors, and candidates)

Documentation of meetings and decisions

Standard Five Compendium 6 – RA5.4

Continuous Improvement Linked to Annual Measures

Evidence:

Annual Reports

Link to Website where Annual Outcomes are shared widely

Continuous Improvement Chart

Decision-making

Program evaluation

Selection and implementation of changes for improvement

EPP identifies at least two examples of input from stakeholders and use of that input.

RA5.3 Stakeholder Involvement The provider includes relevant internal (e.g., EPP administrators, faculty, staff, candidates) and external (e.g., alumni, practitioners, school and community partners, employers) stakeholders in the program design, evaluation, and continuous improvement processes.

CAEP’s outcome and impact measures are appropriately monitored and reported together with the following:

Accurate analysis of trends

Comparisons with benchmarks

Evidence of corresponding resource allocations

Data inform future direction

Evidence that the outcome and impact measures and their trends are posted on the EPP website and in other ways widely shared

Program changes and modifications are directly linked to evidence/data with specific examples

RA5.4 Continuous Improvement The provider regularly, systematically, and continuously assesses performance against its goals and relevant standards, tracks results over time, documents modifications and/or innovations and their effects on EPP outcomes.