Resource Home| Documents Home

Evaluation of the 1998 Summer Sears Enrichment Academic Success Program

Nicole Haan

Overview

To evaluate the effectiveness of the Summer Enrichment and Academic Success Program (SEAS), students were administered a multiple-choice test during the first week of summer school as a pre-test and the same test during the final week as a post-test. The average pre-test and post-test scores of matched tests were assessed for gain or loss at the individual student level, the summer school site level, and the program level. To avoid comparability issues, only data from matched pre and post-tests were used to analyze the SEAS program. An increase in matched average scores was used to indicate success.

Summary of Results

Elementary Schools

Elementary schools administered 3 levels of science\language arts tests and mathematics tests. Level A was taken by first grade classes, B by second and third, and C by fourth and fifth. Students attend summer school for both remedial and enrichment purposes and consequently, these levels correspond to the grade level of the class and not necessarily the grade level of each student. Similarly, students are not required to attend their home sites for summer school and therefore, analysis at this level is reflective of the sites summer school population. Accordingly, gains and losses of each site are not comparable.

Across all schools, there was a gain in average number correct at each level for both Science/Language Arts and Mathematics. Table A summarizes the results.

Table A

Levels Science/Language Arts

% Increase in Average # Correct

Mathematics

% Increase in Average # Correct

A 8.20 14.70
B 8.20 9.80
C 6.27 4.53

Middle Schools

Middle schools administered tests in science/language arts, mathematics, and reading comprehension. The reading test comprised of two sub-tests, one in contextual meaning and another in word parts (prefixes, suffixes, and roots). Since some sites administered one reading comprehension sub-test only, the middle school data assessment is divided into the following four areas: science/language arts, mathematics, contextual meaning, and word parts.

There was gain in each area. Science/language arts gain in average number correct was 8.37 percent, contextual meaning 4.6 percent, word parts 28.27 percent, and mathematics 10 percent. This data is presented in Table B on page 2.

Table B

Subject Area

Percent Increase/Decrease in Average # Correct

Science/Language Arts

8.37

Contextual Meaning

4.60

Word parts

28.27

Mathematics

10.00

High Schools

There were eight tests administered at the high school level. Subject areas tested included applied math, consumer math, and foundations; intermediate algebra; algebra; geometry; biology; earth science; and reading comprehension. Reading comprehension was assessed using two levels corresponding to grades 9 and 10 and grades 11 and 12. All areas except intermediate algebra showed a gain in average number correct when comparing pre-test and post-test results. Table C summarizes the results.

Table C

Subject Area

Percent Increase/Decrease in Average # Correct

Science/Language Arts

Biology

2.40

Earth Science

4.17

Reading Comprehension

.5

Mathematics

Applied, Consumer, & Foundations Math

6.10

Intermediate Algebra

-7.50

Algebra

14.70

Geometry

12.25

Recommendations

In order to increase the number of student results available for analysis and the depth of analysis feasible, there are several recommendations:

  • Skill-based tests should be designed.
  • At the high school level, post-tests should be administered at the end of each summer session.
  • Summer school site attended, grade-level test taken, and test language-version (English or Spanish) should be information that is collected at the time the test is administered.

Designing skill-based tests aligned with the identified problem areas of the Standford9, Core Curriculum Assessments, and when available, the AIMS will eliminate the need for pre testing during summer school. The results of post-tests administered upon summer school course completion would be comparable to recent results in the previously specified subject areas targeted. Eliminating pre tests would increase the number of student performances assessable by eliminating pre testing during the first week of summer school, a period when class rosters are not finalized.

Administering post-tests at the end of each session in high school is necessary since courses are completed during this time frame. For analysis of high school results this year, pre tests were administered during the beginning of summer school session 1 and post-tests at the end of summer school session 2. This resulted in comparing student’s performances in part one of courses to their final test performances for part 2 of courses. For example, students in Algebra I were tested to collect pre test scores and Algebra II students were tested to collect post-test scores. The scores were matched by student and average gain or loss was recorded.

Site attended, grade level test taken, and language-version (English or Spanish) test taken was information that was gathered once the data reached the Department of Planning & Assessment for analysis. Collecting this data at each site would expedite the analysis process and allow for more in depth analysis. For example, gap analysis, site comparisons, etc. are all assessable, but time consuming due to the inaccurate and/or incomplete state of the data received.

Summer School 1998 

Elementary Language Arts & Mathematics 

Average Test Scores


  Region 1

125    Blenman

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    20                   9.00           9.70          0.70                    9.15             9.45        0.30

         C                    16                 21.06         22.31          1.25                  18.81            19.19       0.38

131    Bonillas

       Level           Count              LApre      LApost         Diff                Mathpre     Mathpost   Diff

         B                    22                10.14          12.68         2.54                   9.09            12.86       3.77

         C                     7                 15.43         18.29          2.86                 15.57           16.57       1.00

137     Booth

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                     8                  7.38           10.38          3.00                 4.75            4.13            -.62

         C                    12               14.92         19.42          4.50                 19.58            4.75        -14.83

143     Borton

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    23                   7.04           8.83          1.79                    7.30             8.70         1.40

         C                    21                14.81         15.29          0.48                  13.71            16.67        2.96

149     Brichta

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    33                   8.48         10.55          2.07                    8.45            11.82        3.37

         C                    21                 18.52         24.10          5.58                  19.76            23.95       4.19

161     Carillo

       Level           Count              LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    21                 9.14          9.71          0.57                    9.52             8.43        -1.09

         C                     8                 8.50          8.25          -0.25                  14.00            14.88        0.88


179     Cragin

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    23                   9.65         11.09          1.44                    9.96             10.87      0.91

         C                    14                 18.79         20.93          2.14                  17.71            19.36       1.65

203     Drachman

       Level           Count              LApre      LApost      Diff                  Mathpre     Mathpost    Diff

         B                    7                   6.43           8.29          1.86                    4.29             4.43         0.14


215     Erickson

       Level           Count           LApre   LApost      Diff                Mathpre     Mathpost    Diff

         B                   16                6.94       11.31        4.37                  7.38             9.44          2.06

         C                    7                 9.57         9.29       -0.28                  9.57           10.43          0.86


245     Howell

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    26                   9.88          11.65         1.77                    8.35             9.65         1.30

         C                    13                 16.69         17.08          0.39                  13.46            19.85        6.39

263     Jefferson Park

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    32                  11.09         11.72         0.63                  9.44             10.50        1.06

         C                     8                   14.00         15.88         1.88                 20.00            17.38       -2.62

275     Kellond

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost     Diff

         B                    34                   9.88         10.74          0.86                    9.12            12.59        3.47

         C                    18                 18.00         18.44          0.44                  18.61            19.44        0.83

   

293      Manzo

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    27                   9.15           8.04        -1.11                 8.81             10.52         1.71

         C                     9                 10.00         13.11          3.11                 9.89            12.56           2.67

323     Ochoa

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         B                    16                   7.81           8.63          0.82               11.38            11.38         0.00

         C                    10                 10.90         12.20         1.30                  9.00            11.80        2.80

377     Roskruge

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    15                   6.40           9.80          3.40                    8.87            12.93        4.06

         C                    10                 15.00         16.00          1.00                  15.20            19.40        4.20

383     Safford

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    2                   4.00           6.50          2.50                    5.00             14.00        9.00

395     Sewell

       Level           Count              LApre      LApost      Diff                  Mathpre     Mathpost     Diff

         B                    4                   4.75          17.50         12.75                    5.50            14.50        9.00

         C                    1                 24.00         20.00          -4.00                  24.00            27.00        3.00

419     Tully

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         B                    29                   8.03           7.83        -0.20                    7.97             9.14        1.17

         C                    11                13.36         14.00          0.64                  10.55            14.82       4.27



  Region 2

167     Cavett

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    26                   6.31           8.31          2.00                    4.85             7.23        2.38

         C                    11                 14.64         15.18          0.54                  15.55            15.27       -.28

   

185     Davidson

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         B                    33                   3.18         10.27          7.09                  2.24             7.91        5.67

         C                    18                14.78         11.89         -2.89                10.17          12.56          2.39

308     Miller

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         B                    21                   6.29           6.95          0.66                   8.48             8.67        0.19

         C                    17                 12.94         16.59          3.65                  0.00            14.29      14.29

   

317     Myers

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         B                    25                   6.64           8.12         1.48                    6.36             6.32       -0.04

         C                    19                 14.58         16.53         1.95                  16.63          16.11       -0.52

341     Richey

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    22                   6.18           6.36          0.18                   5.41             6.91         1.50

         C                    15                11.93         10.60         -1.33                 10.27            12.87        2.60

347     Roberts

       Level           Count               LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    45                  7.71           9.78          2.07                    6.80             8.36         1.56

         C                    36                  9.81        12.00           2.19                 10.69            12.78        2.09

401     Smith

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    27                   8.52          12.11         3.59                    6.52           12.26         5.74

         C                    21                 15.29         18.48          3.19                  14.90           18.81        3.91


443     Wheeler

       Level           Count              LApre      LApost      Diff                Mathpre     Mathpost  Diff

         B                    7                 13.29         13.71          0.42                 12.29           15.29       3.00

         C                    3                 20.00         19.33        -0.67                 20.00           21.00       1.00

 
           
  

461     Wright

       Level           Count                LApre     LApost      Diff                Mathpre     Mathpost    Diff

         B                   27                   7.78          14.41         6.63                    7.96           12.52         4.56

         C                   13                 15.00         15.38         0.38                  16.69            13.23       -3.46


  Region 3

  

231     Grijalva

       Level           Count             LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    22                 5.18           6.00          0.82                    5.36             5.18       -0.18

         C                    15                 9.80         15.27          5.47                  15.13            16.67       1.54

286     Urquides

       Level            Count              LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                     5                   5.60           5.80          0.20                    5.00             4.80      -0.20

         C                    11                 8.55         10.27          1.72                  12.00            11.91      -0.09

288     Lyons

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         B                    13                10.54           9.54         -1.00                  10.92             9.31      -1.61

         C                     4                 19.25         22.25          3.00                  20.25            23.25       3.00

290     Maldonado

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    25                   8.48           9.04          0.56                    8.88            11.08       2.20

         C                    14                 11.71         15.00          3.29                  13.86            18.00       4.14

299    Menlo Park

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    33                   6.85           6.30          -0.55                    6.24             7.76      1.52

         C                    11                 17.91         15.82          -2.09                  16.91            17.18     0.27

413     Steele

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    19                 13.00         11.53         -1.47                    8.58             9.58        1.00

         C                    14                 17.57         16.14         -1.43                  16.43            17.00       0.57


417     Tolson

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         B                    22                  6.23           6.41          0.18                    7.18             6.23        -0.95

         C                     7                 11.86         13.71          1.85                  11.29            10.14      -1.15

440     Warren

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         B                    23                  8.09          10.17          2.08                    7.35             9.65        2.30

         C                     9                 12.78         18.00          5.22                  13.78            17.00       3.22


  Region 8

   

499  Site Unknown

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost   Diff

         A                    357                  5.43           6.39          0.96                 3.57             5.14         1.39

         C                       5                 26.00         26.00          0.00               25.40            25.60        0.20

      

498    Santa Cruz   (Out of District)

       Level           Count                LApre      LApost      Diff                Mathpre     Mathpost    Diff

         A                    3                   4.00           6.50          2.00                    3.00             6.67         3.67

         B                    3                   5.00           5.00          0.00                    6.00             5.00        -1.00

         C                    2                 7.50         28.00          20.50                  11.50            20.50        9.00





Total Number of tudents Having Pre and Post Test LA or Mathematics1574


Summer School 1998
 Middle School Matched Pre & Post Average Test Scores




  Region 1

502    Dodge

 

Count = 63 total Subject Pre Post Difference
Language Arts 14.67 19.00 4.33
Mathematics 11.52 14.97 3.45
Contextual Meaning 6.78 7.56 0.78
Word Parts 6.70

9.21

2.51


   
510    Fickett
Count = 63 total Subject Pre Post Difference
Language Arts 5.70 5.58 -0.12
Mathematics 6.93 6.43 -0.50

513     Hohokam
Count = 47 total Subject Pre Post Difference
Language Arts 10.13 14.02 3.89
Mathematics 6.74 9.83 3.09
Contextual Meaning 5.04 5.04 0.00


   
535     Safford
Count = 31 total Subject Pre Post Difference
Language Arts 12.81 14.13 1.32
Mathematics 8.16 11.35 3.19
Contextual Meaning 3.97 5.65 1.68


   
545     Townsend
Count = 55 total Subject Pre Post Difference
Language Arts 9.18 14.07 4.89
Mathematics 8.42 11.73 3.31
Contextual Meaning 4.56 6.18 1.62
Word Parts 4.42

8.00

3.58
  
550     Utterback

 

Count = 41 total Subject Pre Post Difference
Mathematics 7.34 13.46 6.12
Contextual Meaning 6.27 7.78 1.51
Word Parts 4.98 9.68 4.70

   
555     Vail

Count = 63 total Subject Pre Post Difference
Language Arts 13.81 16.90 3.09
Mathematics 9.35 14.71 5.36
Contextual Meaning 5.98 6.81 0.83
Word Parts 5.97

9.17

3.20

   
595     Bilingual

Count = 59 total Subject Pre Post Difference
Language Arts 10.61 13.31 2.70
Mathematics 7.86 8.22 0.36
Contextual Meaning 4.93 5.46 0.53
Word Parts 5.80

7.58

1.78

  Region   2


  
505     Doolen
Count = 38 total Subject Pre Post Difference
Language Arts 12.16 14.00 1.84
Mathematics 7.74 10.26 2.52
Contextual Meaning 5.74 6.21 0.47
Word Parts 5.24

6.68

1.44

   
520     Mansfeld
Count = 100 total Subject Pre Post Difference
Language Arts 12.04 14.66 2.62
Mathematics 8.40 11.50 3.10
Contextual Meaning 5.51 5.89 0.38
Word Parts 5.35

6.63

1.28


   
525     Naylor
Count = 57 total Subject Pre Post Difference
Language Arts 12.46 15.33 2.87
Mathematics 8.77 11.60 2.83
Contextual Meaning 5.88 6.21 0.33
Word Parts 6.04

7.09

1.05

  Region    3


   
503     Carson
Count = 31 total Subject Pre Post Difference
Language Arts 12.26 14.87 2.61
Mathematics 8.26 12.45 4.19
Contextual Meaning 6.13 6.90 0.77
Word Parts 5.26

6.06

0.80


511     Gridley
Count = 48 total Subject Pre Post Difference
Language Arts 12.58 13.92 1.34
Mathematics 9.71 13.69 3.98
Contextual Meaning 6.56 6.92 0.36
Word Parts 5.92

7.96

2.04



   
527     Pistor
Count = 41 total Subject Pre Post Difference
Language Arts 11.63 11.95 0.32
Mathematics 8.71 11.39 2.68
Contextual Meaning 5.54 6.07 0.53
Word Parts 5.32

7.73

2.41

  
557     Valencia

                    
Count = 118 total Subject Pre Post Difference
Language Arts 13.06 14.71 1.65
Mathematics 8.34 10.83 2.49
Contextual Meaning 5.10 6.15 1.05
Word Parts 5.00

7.28

2.28
Region   5


   
578    Jr. High          Accomodations
Count = 14 total Subject Pre Post Difference
Contextual Meaning 6.07 6.71 0.64
Word Parts 7.00

10.29

3.29

   
580     Southwest            Alternative
Count = 9 total Subject Pre Post Difference
Language Arts 13.56 15.00 1.44
Mathematics 10.11 11.11 1.00
Contextual Meaning 6.22 4.44 -1.78
Word Parts 6.33

4.67

-1.66

Total Number of Middle School Students Having Pre and Post Tests in LA, ath, Context Mng, or Wrd Pts 882



1998 Summer School Results
High School Pre & Post Scores Matched



610    Catalina
Count Subject Pre Post Difference
10 Algebra 4.20 6.90 2.70
21 Reading Comprehensions 5.14

8.39

3.25


   
615     Cholla
   
Count Subject Pre Post Difference
5 Applied, Consumer, & Foundations Math 5.20 6.20 1.00
21 Algebra 3.95 7.00 3.05
13 Geometry 7.46 9.38 1.92
8 Biology 8.63 14.63 6.00
44 Reading Comprehensions 7.84 8.09 0.25
620     Palo Verde

 

Count Subject Pre Post Difference
26 Geometry 8.00 9.00 1.00
1 Intermediate Algebra 6.73 10.42 3.69
77 Reading Comprehensions 9.01 9.38 0.37



      
640     Rincon
      
Count Subject Pre Post Difference
28 Geometry 9.07 11.04 1.97
11 Reading Comprehensions 8.73 7.82 -0.91
645     Sabino

 

Count Subject Pre Post Difference
5 Geometry 4.80 11.20 6.40
13 Reading Comprehensions 8.92 8.77 -0.15

   
      
655     Santa Rita
Count Subject Pre Post Difference
1 Intermediate Algebra 6.00 2.00 -4.00
47 Reading Comprehensions 8.98 9.02 0.04

      
660     Tucson High
Count Subject Pre Post Difference
77 Applied, Consumer, & Foundations Math 10.42 8.96 -1.46
25 Geometry 6.80 7.96 1.16
1 Earth Science 6.00 1.00 -5.00
51 Reading Comprehensions 10.41 9.04 -1.37
670     Project Rise
Count Subject Pre Post Difference
4 Applied, Consumer, & Foundations Math 8.50 9.00 0.50

674     Project MORE
Count Subject Pre Post Difference
2 Algebra 4.00 7.00 3.00
2 Biology 10.50 10.50 0.00
3 Earth Science 6.67 10.00 3.33

Total number of students having a pre & post test score in the same subject area (matched scores) 496

Top of Page

Last updated 2/15/06