Page 1

MONTHLY DATA ANALYSIS REPORT AMERICAN INTERNATIONAL SCHOOL OF KALIFORNIA APRIL 2012 CONFIDENTIAL DOCUMENT – FOR ADMINISTRATION USE ONLY DATA SOURCES:

NWEA MAP Testing, Grades 3-9 PSAT Testing, Grades 10-11 IB Examination Results, Grade 12 Student Demographics, Grades K-12 Teacher-Assigned Course Grades, Grades 6-12

MONTHLY QUESTION:

“Our sense is that the science department is grading harsher than the other departments in the high school. Is this backed up by data?”

ANSWER SUMMARY:

Data analysis of high school student grades year-over-year confirms that the science department is indeed awarding students lower grades than is the norm at AISK (see pp. 6-7).

RECOMMENDATIONS:

GC has three recommendations: 1) determine whether or not the science department’s standards are age and gradeappropriate, and align with the mission and vision of the school; 2) determine whether or not the science department’s assessments are aligned to standards; 3) give specific professional development on grading and assessment to Mr. Knight and, to a lesser extent, Ms. Lewison. – their grades are the ones that are lower than the others.

DATA MINING:

GC has noticed that, in addition to the science department giving low grades, there is also a clear gender gap with Mr. Knight. Girls are outperforming boys by a significant margin (see page 9). There could also be a gender preference for girls in the Foreign Language Department (see Decision Tree). GC continues to note cumulative MAP testing anomalies with spikes at approximately 30th, 45th, 65th and 85th percentiles in grades 3-8 (see * in page 2). Data does not follow any expected distribution. 45th percentile spike is most evident, particularly among girls (see supplemental graphs on page 8).

Page 1 of 12


MONTHLY GRAPHS AND CHARTS CUSTOMIZED FOR AMERICAN INTERNATIONAL SCHOOL OF KALIFORNIA 1. PARENT SURVEY – SATISFACTION VS ETHNICITY OF STUDENT (FEBRUARY 2011)

2. PSAT RESULTS (OCTOBER 2011)

Page 2 of 12


3. CUMULATIVE MAP RESULTS (THROUGH JANUARY 2012)*

4. MAP DELTA YEAR-OVER-YEAR (THROUGH JANUARY 2012)

Page 3 of 12


5. MS GRADES (Q1 THROUGH Q3)

6. HS GRADES (Q1 THROUGH Q3)

Page 4 of 12


Â

7. IB EXAM SCORE DISTRIBUTION (THROUGH MAY 2011) Group 1

Group 2

Group 3

Group 4

Group 5

Group 6

EE

TOK

Bonus Points

AISK Total Average

4.72

4.91

4.74

4.57

4.78

4.85

B

C

1.20

IB World Average 2010

4.90

5.14

4.55

4.22

4.56

4.69

C

C

1.11

AISK Total Points

30.72

AISK Pass Rate

85.9%

IB World Total Points 2010

29.55

IB World Pass Rate 2010

78.1%

AISK IB Exam Scores 2010-2011

IB World Scores 2010

Page 5 of 12

Highest Scores 2006 Sarah Goddard

39 points

2007 Annie Lewis

36 points

2008 Emma Dennis

40 points

2009 Henry Saddle

43 points

2010 Mary Jacobine

41 points

2011 Penelope Hansen

37 points


RESEARCH ON HS GRADING TRENDS BY DEPARTMENT SPECIFIC INVESTIGATION OF SCIENCE DEPT VS OTHERS HIGH SCHOOL GRADES 2010-2012 BY DEPARTMENT

DISTRIBUTION OF SCIENCE DEPARTMENT GRADES 2010-2012

MEDIAN GRADE ISSUED BY SCIENCE DEPARTMENT = 80% (VERSUS 87% IN OTHER DEPARTMENTS COMBINED)

Page 6 of 12


INTERQUARTILE RANGE (HALF OF STUDENTS RECEIVED GRADES IN THIS RANGE): 70% TO 89% (VERSUS 80% TO 91% IN ALL OTHER DEPARTMENTS COMBINED) NOTES:

1. NOTE SPIKES AT DECILES (60%, 70%, 80%, 90%) AND AT 55%; THIS INDICATES THAT DESPITE PERCENTAGE GRADING, THE SCIENCE DEPARTMENT IS NOT GRADING TO THE 1% LEVEL OF PRECISION. THIS IS NOT UNUSUAL FOR A PERCENTAGE GRADING SYSTEM; GC RECOMMENDS INVESTIGATING MORE AUTHENTIC GRADING SYSTEMS SUCH AS STANDARDS-BASED GRADING (SBG). 2. THERE IS A VERY LARGE SPIKE AT THE 55% GRADE POINT; NOTE THAT 25% OF ALL STUDENTS RECEIVE GRADES BELOW 70%. THIS INDICATES THAT NOT ONLY DOES THE SCIENCE DEPARTMENT GRADE LOWER THAN OTHERS, IT IS CALCULATING EVEN LOWER GRADES BUT THEN MANUALLY CHANGING THEM BACK TO 55% (MINIMUM GRADE POSSIBLE IN YOUR SIS).

DISTRIBUTION OF SCIENCE DEPARTMENT GRADES BY TEACHER 2010-2012

Page 7 of 12


DISTRIBUTION OF ALL OTHER DEPARTMENT GRADES 2010-2012

Page 8 of 12


DATA MINING SUPPLEMENT 1. MAP YOY: GENDER VS. TEST PERCENTILE

45th percentile spike

THERE IS AN ABNORMAL SPIKE OF GIRLS AT THE 45TH PERCENTILE FOR GIRLS ON MAP TESTING; WE CALCULATE OVER 95% CONFIDENCE THAT THIS SPIKE IS NOT DUE TO RANDOMNESS. GC RECOMMENDS LOOKING AT OUTSIDE FACTORS THAT MAY HAVE AFFECTED TESTING AND/OR GENDER BIAS IN TEST MATERIALS. GC ALSO RECOMMENDS CONTACTING NWEA TO SEE IF OTHER SCHOOLS ARE EXPERIENCING SIMILAR SPIKES. NOTE DIFFERENCE IN PATTERN BETWEEN GIRLS AND BOYS; BOYS SHOW NORMAL SCATTER ACROSS PERCENTILE RANGES.

Page 9 of 12


C LUSTER A NALYSIS

OF

G ENDER

VS .

MAP YOY

NOTE THAT LEFT CLUSTER IS LOWER THAN RIGHT CLUSTER, SHOWING A SLIGHTLY HIGHER YOY DELTA FOR GIRLS THAN BOYS. THERE IS AN INTENTIONAL “JITTER” ON THIS GRAPH TO ILLUSTRATE DETAIL; ALL DOTS IN SHADED AREA ARE BOYS REGARDLESS OF HORIZONTAL PLACEMENT (SAME FOR GIRLS). COLOR INDICATE GRADES OF STUDENTS (3-9), WITH RED BEING 9TH GRADE AND BLUE BEING 3RD GRADE. M ULTIPLE R EGRESSION A NALYSIS

OF FACTORS AFFECTING

G RADES

NOTE THAT, ACCORDING TO THESE CALCULATIONS, THE SINGLE FACTOR THAT AFFECTS GRADES IS THE STUDENT HIM/HERSELF (I.E. STUDENTS WITH GOOD GRADES TEND TO GET GOOD GRADES ACROSS THE BOARD, YEAR OVER YEAR). NEXT GREATEST FACTOR IS THE

Page 10 of 12


TEACHER, AND THEN GENDER.

HOWEVER THESE CORRELATION COEFFICIENTS (R VALUES) ARE VERY LOW AND THUS DO NOT SHOW ANY STRONG RELATIONSHIPS. 2. GENDER BIAS OF MR. KNIGHT VS. MS. LEWISON GRADE DISTRIBUTION OF MR. KNIGHT 2010-2012

GRADE DISTRIBUTION OF MS. LEWISON 2010-2012

NOTE NO SIGNIFICANT DIFFERENCE IN GENDER WITH MS. LEWISON, BUT OVER 10% DIFFERENCE WITH MR. KNIGHT. Page 11 of 12


D ECISION T REE

OF

G ENDER B IAS

AGAINST

G RADES

NOTE THAT, ACCORDING TO THIS MODEL, THE DEPARTMENT IS THE LARGEST SINGLE FACTOR AFFECTING GRADES AT AISK. NEXT IN ORDER IS USUALLY THE GRADE OF THE STUDENTS (612) EXCEPT FOR THE PE DEPARTMENT, THE SCIENCE DEPARTMENT AND THE FOREIGN LANGUAGE DEPARTMENT. IN PE, THE GRADES ARE SO HIGH THAT NO OTHER FACTOR COMES INTO PLAY. IN SCIENCE AND FOREIGN LANGUAGE, GENDER OF THE STUDENT IS THE NEXT IMPORTANT FACTOR (RATHER THAN GRADE AS EXPECTED).

Page 12 of 12

GC sample monthly report  
Advertisement