Resource Home| Documents Home

Evaluation of the 2002 Summer Enrichment Program

Gregg Cannon, Ph.D.:

September 10, 2002

Executive Summary

Mathematics

Tests aligned with the summer school curriculum were administered to all elementary, middle, and high school students at the beginning and end of the Summer Enrichment and Success Program (SEAS). Grade level appropriate math pretests and posttests were administered to all SEAS students in grades 1 through 8. The pretests given to students in grades 1 through 8 were identical to the posttests given at the end of the program. High school students were administered either the algebra or geometry portions of the CCSA Mathematics Test at the beginning and end of the SEAS program.

Reading

Elementary school students (grades 1–5) were administered a grade level appropriate reading test. Although all elementary school students were administered both a reading pretest and posttest this is the only group where the pretest was a different test than the posttest. Middle school students were given an appropriate grade level language test (reading and writing) at the beginning of summer school (pretest) and an identical test at the end of summer school (posttest). High school students were given the ninth grade CCSA Reading Test at the beginning and end of summer school.

Writing

Elementary school students were not only administered an identical pretest and posttest, but the test was identical across grades (1 through 5). Middle school students were not given a separate writing test since writing was included as part of their language test.High school students took the ninth grade CCSA Writing test for both the pretest and posttest.

Data Analysis

The pretest and posttest scores were aggregated by grade, subject, and summer school location. Percent correct was used as the comparison metric since the number of items varied across grades and subjects. This year all students taking the pretest were compared to all students taking the posttest, unlike last year where students were matched making identical pretest and posttest groups. This decision was made due to the fact that an unacceptable number of students are lost using a matching model.

The following tables are color coded where blue indicates posttest scores that increased compared to the pretest scores while red indicates the reverse. Due to formatting constraints pretest means are located in the upper row while posttest means are located in the lower row for each school for grades 1 through 8. High school pretest and posttest means are located in adjacent columns along with the number of students used to calculate the mean.

Grade 1 Pretest – Posttest Comparisons

Schools  Pre

Mathematics (%correct)

Reading (%correct)

Writing (%correct)

Schools  Post

Mean

N

Means

N

Means

N

Blenman      

52.81

31

70.67

30

47.22

30

Blenman     

60.67

17

86.25

16

52.08

16

Bonillas       

62.17

29

64.14

29

41.38

29

Bonillas       

59.43

20

53.00

20

59.17

20

Booth          

56.48

13

80.00

7

27.08

8

Booth           

61.27

9

51.11

9

57.41

9

Cavett        

54.69

14

51.43

14

41.67

14

Cavett         

60.78

11

76.36

11

53.03

11

Cragin         

56.79

8

51.43

7

40.48

7

Cragin        

58.96

11

51.11

9

68.33

10

Drachman  

55.24

21

48.89

18

54.63

18

Drachman

54.72

13

58.33

12

63.89

12

Dunham  

55.71

6

53.33

6

47.22

6

Dunham  

62.86

5

28.00

5

53.33

5

Erickson

44.95

15

42.22

9

44.44

9

Erickson

46.79

16

37.50

16

57.29

16

Fort Lowell

48.57

9

54.29

7

73.81

7

Fort Lowell

60.95

6

28.00

5

50.00

5

Howell 

69.92

17

67.69

13

53.85

13

Howell  

73.06

14

75.00

12

77.78

12

Manzo   

37.15

2

80.00

2

33.33

2

Manzo   

NA

0

NA

0

NA

0

Menlo Park

59.29

8

56.67

6

0.00

6

Menlo Park

54.29

8

37.50

8

29.17

8

Ochoa   

48.22

8

42.50

8

35.42

8

Ochoa   

53.88

7

60.00

7

42.86

7

Richey  

48.22

8

30.00

8

56.25

8

Richey  

60.00

6

36.67

6

69.44

6

Roberts 

52.50

16

66.67

12

47.22

12

Roberts

66.91

12

41.67

12

55.55

12

Schumaker

57.78

9

68.57

7

71.43

7

Schumaker

65.14

10

70.00

10

73.33

10

Tully   

61.52

15

63.08

13

53.85

13

Tully   

65.00

8

75.00

8

56.25

8

Van Buskirk

56.36

22

49.52

21

50.79

21

Van Buskirk

57.30

18

61.11

18

55.55

18

Wright  

41.33

15

38.67

15

61.11

15

Wright  

55.04

34

60.00

27

57.47

29

All Schools (Pre)

55.08

266

57.16

232

47.78

233

All Schools (Post)

59.11

225

57.54

211

57.94

214

Grade 2 Pretest – Posttest Comparisons

Schools (Pre)

Mathematics (%correct)

Reading (%correct)

Writing (%correct)

Schools (Post)

Means

N

Means

N

Means

N

Blenman 

55.30

21

65.63

20

61.67

20

Blenman 

56.45

16

51.56

16

72.92

16

Bonillas

53.76

18

63.89

18

53.70

18

Bonillas

51.94

20

63.82

19

62.50

20

Booth   

52.82

16

62.50

16

57.84

17

Booth   

63.91

16

80.47

16

80.21

16

Cavett  

34.95

12

36.11

9

50.00

10

Cavett  

42.74

4

62.50

4

54.17

4

Cragin  

49.68

5

70.00

5

43.33

5

Cragin  

52.69

6

68.75

6

69.45

6

Drachman

38.71

9

56.25

8

44.44

9

Drachman

40.73

8

56.25

8

56.25

8

Dunham  

49.91

17

66.91

17

47.06

17

Dunham  

56.58

13

71.15

13

65.38

13

Erickson

45.90

13

58.65

13

58.98

13

Erickson

49.46

12

56.25

12

56.95

12

Fort Low

46.45

5

47.50

5

45.24

7

Fort Low

36.77

5

57.50

5

73.33

5

Howell  

56.27

9

76.39

9

64.82

9

Howell  

50.90

9

59.72

9

66.67

9

Menlo Park

53.00

14

62.50

14

45.24

14

Menlo Park

48.07

10

37.50

10

48.48

11

Ochoa   

34.10

7

31.25

6

27.78

6

Ochoa   

59.45

7

58.93

7

52.38

7

Richey  

57.53

12

68.75

12

48.61

12

Richey  

65.95

9

77.78

9

79.63

9

Roberts 

46.68

17

47.79

17

50.98

17

Roberts 

48.12

12

56.25

12

61.11

12

Schumaker

51.62

2

50.00

2

58.33

2

Schumaker

56.22

7

82.14

7

66.67

7

Tully   

56.68

14

64.29

14

63.10

14

Tully   

51.61

9

90.00

5

69.44

6

Van Buskirk

50.66

17

34.38

16

48.96

16

Van Buskirk

54.03

12

37.50

11

54.55

11

Wright  

45.16

5

37.50

5

40.00

5

Wright  

46.55

7

53.57

7

40.48

7

All Schools (Pre)

49.87

213

57.52

206

52.13

211

All Schools (Post)

53.01

182

61.58

176

63.69

179

Grade 3 Pretest – Posttest Comparisons

Schools (Pre)

Mathematics (%correct)

Reading (%correct)

Writing (%correct)

Schools (Post)

Means

N

Means

N

Means

N

Blenman 

58.54

21

NA

0

62.70

21

Blenman 

62.35

20

66.11

18

59.17

20

Bonillas

61.23

22

64.44

18

67.50

20

Bonillas

63.30

23

70.00

18

67.39

23

Booth   

54.86

23

55.00

22

71.21

22

Booth   

57.28

21

56.47

17

75.93

18

Brichta 

51.47

2

NA

0

41.67

2

Brichta 

NA

0

NA

0

NA

0

Cavett  

44.61

12

50.00

12

56.67

10

Cavett  

47.33

11

55.45

11

59.09

11

Cragin  

NA

0

NA

0

NA

0

Cragin  

53.31

8

55.71

7

60.42

8

Dunham  

51.21

17

52.73

11

58.33

16

Dunham  

59.74

16

67.86

14

71.87

16

Erickson

53.68

12

54.17

12

70.83

12

Erickson

60.00

10

70.00

10

63.33

10

Fort Lowell

50.74

8

51.67

6

45.24

7

Fort Lowell

45.29

5

46.00

5

63.33

5

Howell  

49.27

12

44.00

10

63.64

11

Howell  

46.08

9

48.75

8

52.38

7

Manzo   

46.47

5

NA

0

43.33

5

Manzo   

50.00

4

NA

0

54.17

4

Menlo Park

46.03

20

41.25

16

54.17

16

Menlo Park

48.20

18

41.43

14

56.41

13

Ochoa   

60.17

24

57.62

21

47.73

22

Ochoa   

57.01

26

44.76

21

53.47

24

Richey  

38.24

9

NA

0

53.70

9

Richey  

48.32

7

61.67

6

52.38

7

Schumaker

59.67

14

50.77

13

55.95

14

Schumaker

71.81

12

70.91

11

78.79

11

Tully   

57.97

24

56.36

22

44.93

23

Tully   

60.29

12

56.36

11

43.94

11

Van Buskirk

39.78

19

40.00

2

77.08

16

Van Buskirk

42.65

10

36.00

10

30.00

10

Wright  

44.12

13

30.00

1

42.59

9

Wright  

48.53

12

60.00

1

68.33

10

All Schools (Pre)

52.48

255

53.19

166

58.58

233

All Schools (Post)

55.95

224

57.09

182

60.74

208

Grade 4 Pretest – Posttest Comparisons

Schools (Pre)

Mathematics (%correct)

Reading (%correct)

Writing (%correct)

Schools (Post)

Means

N

Means

N

Means

N

Blenman 

54.32

17

76.67

15

62.50

16

Blenman 

50.23

13

67.50

8

57.69

13

Bonillas

48.53

22

73.68

19

70.45

22

Bonillas

50.74

20

72.00

15

70.83

20

Booth