IMPACT REPORT: Results from Na7onal Pilot
Math Hoops improves math literacy by crea3ng and distribu3ng innova3ve, fun, and effec3ve educa3onal tools that harness the power of basketball.
RESEARCH DESIGN
Na7onally, over 130 teachers implemented the program and proctored pre (n= 4,060) and post (n= 1,490) tests. The math por7on of the test was comprised of released items from past NAEP assessments, and was compiled with the guidance and consul7ng of the American Ins7tutes for Research (AIR). AIR also analyzed the pre and post data upon the program’s comple7on, yielding the following results.*
*All achievement, aTtude, teamwork, and work ethic data was analyzed by AIR, but certain demographic and teacher-‐percep7on sta7s7cs were calculated internally by Math Hoops
Free Lunch Eligibility
USAGE
% of students eligible 0 -‐ 20%
12%
21 -‐ 40% 8%
18 Hours
41%
61 -‐ 80%
Average/Classroom 18%
21%
Grade Level Distribu7on 21%
13%
22% 19%
15% 9%
4th
5th
6th
7th
8th
41 -‐ 60%
9th
81 -‐ 100%
THE RESULTS: IMPROVEMENT IN MATH ACHIEVEMENT
4th grade: +55.9% 5th grade: +28.6% 6th grade: +15.6% 7th grade: +16.2% These es7mated results represent the percentage increase in average test scores between baseline and follow-‐up for students who took both tests, which was 35% of the students who took the baseline test.
THE RESULTS: ATTITUDES
77% of the students in this sample like playing NBA Math Hoops
54% of the students in this sample say NBA Math Hoops made them like math more
47% of the students in this sample say NBA Math Hoops made them beder at math
THE RESULTS: WORK ETHIC
“How ohen do you try as hard as you can in math class?”
50% of the students who at baseline answered that they try hard just some 7mes, answered they were
trying hard most of the 3me aher the program
“How ohen do you pay aden7on in math class?”
50% of the student who at baseline answered that
they paid aden7on just some 7mes, answered they were paying aden7on most of the 3me aher the For students who agree that NBA Math program Hoops made them like math more: 87% claim they try hard in math class “How ohen do you complete your math assignments?” most of the 7me of the students who at baseline answered that 90% claim they pay aden7on in math they completed their assignments just some 7mes, class most of the 7me 87% claim they complete their math answered they were comple7ng them most of the assignment most of the 7me 3me aher the program
67%
These figures are smaller for those who are either neutral or don’t like the program as much.
THE RESULTS: TEAMWORK
65%
of the students in this sample say NBA Math Hoops helped them work well with others. Post test scores for those who are in the neutral or agree categories are sta7s7cally different from those who disagree. That is, those who worked beder with others are also the ones who did beder on the math test.
THE RESULTS: TEACHERS
75% say using NBA Math Hoops made them
happier or more excited to go to school and teach
41% say they are beder at iden7fying strengths in their students that they were unaware of before
63% would buy NBA Math Hoops (and would pay $90 on average)
85% indicate posi7vely that they will keep using NBA Math Hoops
CONCLUSIONS: ENCOURAGING PRELIMINARY RESULTS
• The es7mated results of the Na7onal Pilot are quite encouraging • Program effects, however, may vary should the program be implemented with a more rigorous design (e.g., address the poten7al selec7ve nature of program par7cipants) • The next evalua7on will have a stronger design, with poten7al for findings to be more widely applicable
CREATING MATH CHAMPIONS ONE GAME AT A TIME
CONTACT US
Math Hoops, Inc. 95 Chestnut St. Providence, RI 02908 1 (855) NBA-‐Math Info@nbamathhoops.org NBAMathHoops.org Researchers from the American Ins7tutes for Research conducted the analyses presented here. A final memo will be available in the fall of 2013. Please contact Info@nbamathhoops.org to obtain a copy.