Introduction to CWRA+

Page 1

teach learn assess

cwra+

cae | 215 Lexington Avenue, Floor 16 | New York, NY 10016 | cla@cae.org | 212.217.0700 | @cla_beat


The skills needed by today’s students are far greater than those required of students just a decade or so ago. Students can no longer rely solely on collection and mastery of disciplinarybased information. Rather, they need to be able analyze and evaluate information, solve problems, and communicate effectively to a variety of audiences. Content, distributed over the internet, is increasingly free and tremendously easy to access. While students have a massive amount of information available at their fingertips, they need to be able to successfully process that information, make sense of it, and evaluate and apply it to real world settings. In short, they need to exhibit the ability to think critically. But how do we know if students possess this ability? Since 2002, CAE has pioneered the use of performance-based assessments for determining whether students can, indeed, make use of information in a sufficiently critical way. To date over 700 institutions--both in the United States and internationally--have participated in our performance assessments, either through the Collegiate Learning Assessment (CLA) or the College and Work Readiness Assessment (CWRA). Performance assessments--constructed response instruments that require students to demonstrate their ability to perform --are directly aligned with current reform efforts in the improvement and evolution of teaching and learning. When the CWRA was founded, these performance assessments were designed to provide high school educators with evidence about how their students as a whole were performing on the 21st Century skills measured by the CWRA.

We are pleased to announce that through the next iteration of the CWRA, CWRA+, we are now able to provide this same information at the individual-student level. CWRA+ retains aspects of the CWRA that have made it novel and indispensible for educational improvement. Chief among these retentions is the Performance Task. An improved version of the Performance Task remains the anchor of CWRA+, but is now combined with a selected response section (modeled on and aligned to the Performance Tasks themselves). Selected response items improve the precision of student-level results, meaning that these data points may now be used by faculty to provide direct, formative feedback to students, or for use in making individualized decisions about grading, scholarships, admission, or placement. These additional uses are facilitated by new--common-core aligned--subscore categories, expanded norming groups (such as independent schools), and criterion-referenced proficiency levels that indicate how well students have mastered the skills measured by CWRA+. We’re also pleased to announce that, for the first time, middle schools may participate in CWRA+ through the assessment of their 8th grade students. Our fundamental goal at CAE has been and remains the better alignment of assessment with teaching and learning. It is with this goal in mind that we are pleased to introduce CWRA+.

We need to insist on a combination of locally developed assessments and new nationally-normed online tests, such as the CWRA, that measure students’ analyticreasoning, critical thinking, problem-solving, and writing skills. Tony Wagner, Rigor Redefined I think most people would agree that the skills like critical thinking, complex reasoning and writing -- the skills that CAE does measure -- are pretty important. Bill Gates, The Gates Notes


performance tasks

sample prompts cwra+ selected response

ductivity in college collllege Are grades in college and overall productivity negatively affected by a student’s use of social networks? A group of researchers hypothesized that students who use social networks on a regular basis get lower grades in college than students who do not. In order to test this hypothesis, researchers collected data from students at a large university. The researchers stood on a popular corner of campus and asked 50 students to answer a few questions. The Newmont School Board is deciding whether or not to build a new gymnasium for Newmont High School. There has been some controversy in the community regarding whether resources should be spent to build the new gymnasium. The School Board, which is responsible for making this decision, has The city of Springfield is deciding whether to implement a tax on collected several documents to help them make their decision. junk food. Some citizens of Springfield believe that junk food is Some board members feel this is an unnecessary expenditure, the cause of the obesity epidemic in their city. Others believe particularly given Newmont’s limited resources. Other members that individuals have the right to consume whatever foods they feel that there are considerable benefits to building the new choose and citizens should not be taxed for purchasing foods gymnasium. that are high in fat, sugar, or sodium. The representatives in Springfield’s senate are deciding whether to implement this tax. As the chair of a special committee on the board, your task is to As an intern for one of the senators, you have been asked to write a memo that addresses whether the Springfield senate should implement a tax on junk food. Draw evidence from the following documents: An abstract from a study reporting a relationship between obesity and junk food consumption A political cartoon depicting how taxing junk food affects the under-priviledged A blog posting for people that support healthy eating

write a recommendation that addresses whether the Newmont School Board should build the new gymnaisum. Draw evidence from the following documents: A survey of townspeople reflecting a belief that the district cannot afford to build the gym A cost analysis to build the gymnasium, including a budget for the town An Engineer’s report on the structural status of the current gymansium A blueprint showing the specfications of the new gymnasium

Students take 60 minutes to complete a single Performance Task, designed to, among other things, measure their ability to problem solve, analytically reason, write effectively and exhibit standards of writing mechanics.

Researchers found that 75% of the students said that they did not think that spending time social networking interfered with their grades. The researchers decided to compare the average amount of time that students spend on social networks each week with each student’s GPA. Based on the results, researchers conducted that their hypothesis is correct: students who social network on a regular basis do worse in college than students who do not. The researchers would like to conduct another study to see if their hypothesis holds true. Which of the following research designs will best test their hypothesis? (A) Ask the same questions at the same university but to a different group of people. (B) Ask the same set of questions but at a different large university. (C) Ask a different set of questions at a different large university. (D) Ask the same questions but at numerous universities of varying sizes. Students are alloted 30 minutes to take 25 selected response items, designed not to assess their mastery of content, but rather their ability to scientifically and quantitatively reason, read and evaluate information with a critical eye, and critique faulty arguments.

cae | 215 Lexington Avenue, Floor 16 | New York, NY 10016 | cla@cae.org | 212.217.0700 | @cla_beat


high school institutional report cwra+

Thank you for participating in the CWRA+. We hope your high school finds the below information helpful in your larger educational improvement efforts. CWRA staff welcome any questions you may have about interpreting this report. Further, feedback on the usefulness of the report itself is also always welcome.

national performance seniors

sophomores

juniors

seniors

1184 0.25

1214 0.54

1245 0.89

1047

1088 0.19

1125 0.49

1170 0.77

performance task analysis & problem solving writing effectiveness writing mechanics

1102

1178

1216

1254

1052

1089

1124

1173

2.6 2.5 2.7

3.1 3.2 3.3

3.6 3.6 3.8

3.9 4.1 4.3

2.4 2.5 2.4

2.9 2.7 2.9

3.3 3.4 3.3

3.5 3.7 3.5

selected response scientific/quantitative reasoning critical reading & evaluation critique an argument

1096

1190

1213

1236

1043

1085

1126

1168

3.2 3.4 1.9

4.0 4.2 2.3

5.1 5.4 3.6

6.8 6.5 3.9

3.1 3.2 1.4

4.0 4.3 2.2

4.8 5.1 2.9

6.3 6.4 3.2

total cla+ effect size vs. freshmen

6 6 6

10 10 5

freshmen

juniors

1100

freshmen

sophomores

total possible

your overall performance

other norms 900

1100

1000

your school your district all pubic schools all NAIS schools all schools freshmen

sophomores

juniors

seniors

1200

1300

explain this to me

The total CWRA+ score is determined by students’ combined performance on a Performance Task and a set of Selected Response items. These scores are further informed by student traits, as represented by the subscore categories of analysis & problem solving, writing effectiveness, etc. You may choose to compare your scores to the national norms to get a sense for how well your students compare against other students across the country. If your institution assessed a freshmen cohort and any other class (sophomores, juniors, seniors), we are able to provide value-added information in the form of effect sizes, which take into consideration the varying characteristics of students when they entered your (and other) high schools. Thus, comparisons across institutions can be made on an even playing field. Recognizing that participating schools may have a variety of needs for comparative purposes, a number of different perspectives on normative performance are provided (where applicable). Note that the population of institutions and/or students that make up these figures may not be nationally representative.

cae | 215 Lexington Avenue, Floor 16 | New York, NY 10016 | cla@cae.org | 212.217.0700 | @cla_beat


jane doe student report cwra+

Thank you for participating in the CWRA+. This assessment--unlike more common tests--focuses on the general outcomes of your education; namely, your ability to think critically, problem-solve, and write. These are the types of higher-order skills that are increasingly necessary for success in and beyond college.

jane doe elite high school senior total cwra+: performance task: selected response:

cwra+

1381 1343 1418

percentile rank among students at your institution percentile rank among students at all institutions

1170

1343

1254

1173

4 5 4

3.9 4.1 4.3

3.5 3.7 3.9

1236

1168

6.8 6.5 3.9

6.3 6.4 3.2

selected response 1418 scientific/quantitative reasoning 9 critical reading & evaluation 8 4 critique an argument

6 6 6

10 10 5

across all institutions (other seniors)

1245

out of possible

average at all institutions (other seniors)

1381

within your institution (other seniors)

performance task analysis & problem solving writing effectiveness writing mechanics

asverage at your institution (other seniors)

total cwra+

selected response

percentile ranks your score

your overall performance

performance task

99

95

85

83

98

97

explain

this to me

Your total CWRA+ score is determined by your combined performance on a Performance Task and a set of Selected Response items. These scores are further informed by specific traits, such as analysis & problem solving or writing effectiveness. You may choose to compare your scores to the averages of other CWRA+ students at your institution or across all institutions. For ease of intrepetation, these comparisons are provided as percentile ranks for your total CWRA+ score, your performance task score and your selected reponse score (e.g. a percentile of 95% means you performed better than 95% of your classmates or all students, respectively). We hope you’ll use this report to assess how prepared you are with the skills necessary to succeed in and beyond college. As applicable, we encourage you to review these scores with your teachers and--depending on how well you feel you performed--provide them to any colleges you might consider applying to.

cae | 215 Lexington Avenue, Floor 16 | New York, NY 10016 | cla@cae.org | 212.217.0700 | @cla_beat


Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.