Page 1

New Evidence of Improved Student Performance with WileyPLUS with ORION Wiley commissioned a quantitative study to measure the benefits of using WileyPLUS with ORION. WileyPLUS is a research-based, online environment for effective teaching and learning that includes ORION adaptive practice to help students build their proficiency while using their time more effectively. Fourteen instructors and 1,054 students across six disciplines (Accounting, Anatomy & Physiology, Business, Chemistry, Physics, and Psychology) from diverse campuses around the country participated during the Spring 2015*.

Study Highlights Greater engagement with the study tools is associated with higher class performance. The study segmented students into three groups based on their level of engagement with the programs. Students in the high engagement group (4 out of 10 students) achieved grades that were two grade points higher compared to those in the low engagement group (15% of students). A moderate level of engagement by students (47% of students) was associated with more than a grade better performance.

Course Performance by Student Segment

Average Course Grade

3.00

2.92 2.22

2.00

0.96

1.00

0.00

High Engagement

Medium Engagement

*Independent review conducted by Broadview Analytics, Inc., 2015.

Low Engagement


ORION Proficiency and Performance Overview

Proficiency is a probabilistic metric of how likely a student is to answer a question correctly on a given learning objective, based on his/her past performance. There are several factors used to calculate proficiency:

of questions and how the

Difficulty of the learning objective Difficulty of the question Performance on the question Pathway through the practice (% right first time, etc.) Student’s stated confidence in the answer

program adapted to my level of learning.

With ORION adaptive practice, students start at different levels of understanding and work through various levels of question difficulty as ORION tracks both performance and proficiency. The scores can be used as a study tool to help students see where they excel and the areas they need to improve. The study shows that more time with ORION—in chapters attempted or time on task, and increased proficiency level—is associated with higher class performance. Those students who engaged in 100% of their ORION assignments earned, on average, one letter grade higher than those who did not attempt any assignments. Even one additional hour of ORION can result in a higher course grade. Students who reached an extra 50% of proficiency in ORION had, on average, a course grade that was one letter grade higher.

– Luis Velazquez, Student, Delgado Community College, Anatomy & Physiology

In my opinion, the greatest benefit of ORION is an improved understanding of course material, leading to higher exam grades and higher overall course grades. – Tracy Sewell, Instructor, Gulf Coast State College, Principles of Financial Accounting

• • • • •

I benefited from the variety

Course Performance by Average Proficiency Score (among all students)

Average Course Grade

4.00

3.00

2.00

1.00

1.77

0-10

2.07

2.11

11-20

21-30

2.28

31-40

2.55

41-50

3.17

3.27

3.37

61-70

71-80

81-90

3.49

2.79

51-60

Average ORION Proficiency Score

91-100

WileyPLUS with ORION Efficacy Summary 2015-2016