1999 Summer Program

Executive Summary

September 3, 1999

Evaluation of the Summer Enrichment Academic Success Program was approached using a simple pretest-posttest paradigm. Students were tested the first day of summer school and again following the final day of instruction. The tests were designed to measure knowledge of a specific content that closely paralleled the curriculum of the course. The pre-test and the post-test were identical forms of a four option multiple-choice test ranging from 10 items (first grade¹) to 20 items (high school). Scores were expressed as the percentage of items answered correctly. All students were matched from pre-test to post-test resulting in two identical groups. In effect, each student served as his or her own control.

This report is divided into three major sections according to grade level. Within each section specific pre-test and post-test performance is presented graphically by school followed by a table of actual scores by school.

Elementary Schools

Reading: Comparisons between pre-test and post-test reading scores resulted in 21 out of 27 schools showing gains. Schools showing the greatest gain were Miller, Lyons, Davidson, Cragin, and Booth. The large gains found for two of the schools was likely due to very low pre-test scores (e.g., Miller and Lyons). Steele was the highest scoring in reading, both pre-test and post-test. Six schools actually showed a drop from pre-test to post-test. Two of the six schools showing a drop Smith and Wright had only seven students. Cavett on the other hand showed the largest drop based on 51 matched students.

Mathematics: The results of the mathematics comparison were almost the reverse of those found for reading. Twenty out of 28 schools showed a drop from pre-test to post-test in mathematics. The only schools to show substantial gains were Drachman and Miller. The school showing the greatest loss Richey dropped from 47.5 percent correct on the pre-test to 32.8 percent correct on the post-test for 24 matched students.

Language: Fifteen out of 27 elementary schools showed post-test gains in Language. Miller and Manzo had the largest gains, while Booth, Richey and Van Buskirk had the greatest loss from pre-test to post-test. Although Booth experienced the second highest loss from pre-test to post-test, it also had the highest pre-test average.

Middle Schools

Reading: Thirteen out of fourteen middle schools demonstrated gains on the Summer school Reading Assessment. The highest gains were found for Townsend and Middle School Accommodations. The only middle school to show a loss from pre-test to post-test was Gridley.

Mathematics: Eleven out of the fourteen middle schools showed post-test gains in mathematics. The greatest gains in mathematics were found for Townsend and Valencia. Although Gridley showed a post-test loss in reading they showed an almost equivalent gain in mathematics. Overall pre-test and post-test means indicated that the test was moderately difficult for most students, the means were 37.94 and 42.23 percent correct respectively.

Language: The results for language were much like those for reading. Thirteen out of fourteen middle schools showed post-test gains. The only middle school to show a loss from pre-test to post-test was Mansfeld, and their drop was small 61.4 to 61.3 percent correct.

High Schools

High School Students were tested in six different content areas. The six content area assessed were: Earth Science, Algebra, Applied and Consumer Math, Geometry, Intermediate Algebra and Reading. Post-test gains were observed in all six content areas. The greatest gains were found for Algebra followed closely by Reading. The smallest gains were found for Earth Science, which also had the smallest number of matched students. According to the pre-test and post-test means the Earth Science Test was the easiest while the Intermediate Algebra Test was the most difficult.

1 While first grade was also given a pre-test and a post-test in Reading, Math and Language their summary data are not presented here due to problems encountered in identifying many of the students and the school they attended during the summer. Additionally, for many students it could not be determined whether a given test was a pre-test or a post-test.

Elementary Schools

Bonillas
Booth
Brichta
Carrillo
Cavett
Cragin
Davidson
Drachman
Howell
Lynn
Lyons
Manzo
Manlo Park
Miller
Myers
Richey
Roberts
Safford
Smith
Steele
Tully
Van Buskirk
Warren
Wheeler
Wright
Wrightstown

Pre-Test and Post-Test Means on Reading on Matched Students

Summary Table of Means on Reading

School	Pre-Test	Post-Test	Change	N*
Bonillas	63.33	72.05	8.72	26
Booth	60.00	72.45	12.45	15
Brichta	64.30	67.74	3.44	31
Carrillo	54.53	59.04	4.51	28
Cavett	53.20	49.94	-3.26	51
Cragin	54.17	62.50	8.33	32
Davidson	54.85	64.24	9.39	44
Drachman	60.84	69.16	8.32	8
Howell	59.72	61.98	2.26	71
Lynn/Urq	63.10	67.86	4.76	28
Lyons	45.89	59.62	13.73	17
Manzo	58.11	65.65	7.54	46
Menlo Park	44.93	50.43	5.5	23
Miller	43.77	62.90	19.13	23
Myers/Ga	56.32	60.55	4.23	49
Richey	53.63	55.07	1.44	23
Roberts	49.49	59.38	9.89	59
Safford	57.78	67.01	9.23	39
Smith	68.57	65.71	-2.86	7
Steele	71.43	78.10	6.67	28
Tolson	52.35	51.86	-0.49	27
Tully	61.07	62.10	1.03	19
Van Buskirk	59.77	58.86	-0.91	29
Warren	61.07	69.89	8.82	31
Wheeler	63.14	63.13	-0.01	17
Wright	58.11	57.13	-0.98	7
Wrightstown	67.87	72.13	4.26	11
All Schools	57.02	62.48	5.46	789

* Represents the number of matching students on the pre-test and post-test.

Pre-Test and Post-Test Means on Math on Matched Students

Summary Table of Means Mathematics

School	Pre-Test	Post-Test	Gain	N*
Blenman	42.92	40.98	-1.94	48
Bonillas	48.80	45.07	-3.73	25
Booth	65.14	61.53	-3.61	13
Brichta	49.90	50.75	0.85	31
Carrillo	40.24	32.86	-7.38	28
Cavett	39.75	32.70	-7.05	53
Cragin	41.38	43.89	2.51	24
Davidson	49.09	43.33	-5.76	44
Drachman	50.00	59.98	9.98	6
Howell	42.63	38.40	-4.23	71
Lynn/Urq	53.81	47.86	-5.95	28
Lyons	37.64	31.37	-6.27	17
Manzo	44.00	44.59	0.59	45
Menlo Park	36.51	34.50	-2.01	23
Miller	36.15	49.49	13.34	26
Myers/Ga	43.48	40.72	-2.76	46
Richey	47.50	32.78	-14.72	24
Roberts	40.69	44.48	3.79	58
Safford	45.98	43.41	-2.57	39
Smith	54.27	47.61	-6.66	7
Steele	58.34	54.76	-3.58	28
Tolson	38.77	34.56	-4.21	27
Tully	47.41	44.82	-2.59	18
Van Buskirk	44.60	45.52	0.92	29
Warren	46.85	42.29	-4.56	35
Wheeler	53.81	41.91	-11.9	14
Wright	35.23	41.90	6.67	7
Wrightstown	58.19	45.45	-12.74	11
All Schools	44.94	42.24	-2.70	825

* Represents the number of matching students on the pre-test and post-test.

Pre-Test and Post-Test Means on Language on Matched Students

Summary Table of Means Language

School	Pre-Test	Post-Test	Gain	N*
Bonillas	58.46	56.41	-2.05	26
Booth	71.10	66.11	-4.99	12
Brichta	57.85	60.22	2.37	31
Carrillo	44.77	41.91	-2.86	28
Cavett	44.87	48.71	3.84	26
Cragin	51.26	48.51	-2.75	29
Davidson	56.51	56.21	-0.30	44
Drachman	42.22	38.88	-3.34	6
Howell	53.22	59.56	6.34	61
Lynn/Urq	59.52	63.09	3.57	28
Lyons	35.68	40.41	4.73	17
Manzol	54.79	72.71	17.92	32
Menlo Park	33.64	42.62	8.98	23
Miller	36.54	56.54	20.00	27
Myers/Ga	47.68	46.81	-0.87	46
Richey	51.21	44.54	-6.67	22
Roberts	48.52	53.80	5.28	36
Safford	47.86	51.80	3.94	39
Smith	51.44	53.34	1.90	7
Steele	65.47	69.53	4.06	28
Tolson	34.74	40.71	5.97	19
Tully	58.59	57.89	-0.70	19
Van Buskirk	59.70	55.15	-4.55	22
Warren	50.51	49.70	-0.81	33
Wheeler	60.41	59.58	-0.83	16
Wright	34.68	38.68	4.00	5
Wrightstown	50.92	51.52	0.60	11
All Schools	51.12	54.04	2.92	693

* Represents the number of matching students on the pre-test and post-test

Middle Schools

Dodge
Doolen
Gridley
Hohokam
Mansfeld
Naylor
Pistor
Safford
Townsend
Utterback
Vail
Valencia
Middle School Accom.
Bilingual Magnet
Pre-Test and Post-Test Means on Reading on Matched Students

Summary Table of Means on Reading

School	Pre-Test	Post-Test	Gain	N*
Safford	33.82	44.36	10.54	11
Dodge	60.38	60.86	0.48	42
Doolen	50.29	53.59	3.30	63
Gridley	56.11	52.33	-3.78	36
Hohokam	38.72	40.32	1.60	25
Mansfeld	48.00	55.38	7.38	52
Naylor	46.94	55.76	8.82	68
Pistor	42.79	48.00	5.21	33
Townsend	47.50	59.17	11.67	24
Utterback	53.36	59.36	6.00	50
Vail	50.93	59.73	8.80	75
Valencia	59.56	64.67	5.11	18
Middle	47.67	65.67	18.00	12
Bilingual	35.06	43.53	8.47	34
All Schools	49.04	55.01	5.97	543

* Represents the number of matching students on the pre-test and post-test.

Pre-Test and Post-Test Means on Math on Matched Students

Summary Table of Means on Mathematics

School	Pre-Test	Post-Test	Gain	N*
Safford	37.87	34.84	-3.03	11
Dodge	42.78	49.12	6.34	42
Doolen	40.80	44.87	4.07	83
Gridley	40.83	44.72	3.89	36
Hohokam	29.39	29.59	0.20	33
Mansfeld	37.96	41.01	3.05	72
Naylor	37.26	39.45	2.19	67
Pistor	33.84	32.03	-1.81	33
Townsend	35.01	45.65	10.64	26
Utterback	37.77	45.91	8.14	48
Vail	39.25	47.16	7.91	80
Valencia	37.46	50.16	12.70	21
Middle	48.73	50.51	1.78	13
Bilingual	31.48	30.55	-0.93	36
All Schools	37.94	42.23	4.29	601

* Represents the number of matching students on the pre-test and post-test

Pre-Test and Post-Test Means on Language on Matched Students

Summary Table of Means on Language

School	Pre-Test	Post-Test	Gain	N*
Safford	52.13	62.73	10.60	11
Dodge	61.70	78.14	16.44	43
Doolen	57.65	62.31	4.66	85
Gridley	57.39	58.65	1.26	37
Hohokam	49.46	52.61	3.15	37
Mansfeld	61.45	61.31	-0.14	71
Naylor	49.37	54.21	4.84	69
Pistor	54.85	60.29	5.44	33
Townsend	59.34	69.71	10.37	35
Utterback	61.67	65.13	3.46	50
Vail	62.17	69.09	6.92	80
Valencia	65.44	68.08	2.64	19
Middle	58.05	59.73	1.68	12
Bilingual	53.53	55.74	2.21	36
All Schools	57.70	62.76	5.06	618

* Represents the number of matching students on the pre-test and post-test
>

High Schools
Catalina
Cholla
Palo Verde
Pueblo
Sabino
Sahuaro
Santa Rita
Tucson
Alternative

Earth Science

School	Pre-Test	Post-Test	Gain	N*
Catalina	25.00	45.00	20.00	1
Sahuaro	49.75	55.50	5.75	20
Alternative	37.14	40.71	3.57	7
All Schools	45.71	51.43	5.72	28

Algebra

School	Pre-Test	Post-Test	Gain	N*
Cholla	28.39	42.50	14.11	28
Palo Verde	20.42	32.50	12.08	12
Pueblo	25.83	47.92	22.09	12
Sabino	33.24	45.88	12.64	17
Sahuaro	35.68	54.32	18.64	22
Santa Rita	22.92	48.75	25.83	12
Tucson	15.00	40.00	25.00	2
Alternative	25.00	31.25	6.25	8
All Schools	28.36	44.65	16.29	113

Applied, Consumer, or Foundations
>

School	Pre-Test	Post-Test	Gain	N*
Cholla	35.56	52.78	17.22	9
Palo Verde	35.00	67.50	32.50	2
Pueblo	37.50	41.25	3.75	16
Tucson	39.00	43.50	4.50	10
Alternative	50.63	51.88	1.25	8
All Schools	39.67	47.11	7.44	45

* Represents the number of matching students on the pre-test and post-test

Geometry

School	Pre-Test	Post-Test	Gain	N*
Cholla	33.93	46.79	12.86	42
Palo Verde	33.33	60.00	26.67	9
Pueblo	37.00	51.00	14.00	15
Tucson	36.96	40.65	3.69	23
Alternative	42.50	71.25	28.75	4
All Schools	35.48	48.28	12.80	93

Intermediate Algebra

School	Pre-Test	Post-Test	Gain	N*
Palo Verde	33.33	47.04	13.71	27
Pueblo	20.00	40.00	20.00	1
Rincon	30.00	55.00	25.00	1
Sahuaro	41.58	42.89	1.31	19
Santa Rita	28.18	40.45	12.27	11
Alternative	30.00	42.50	12.50	2
All Schools	34.59	44.43	9.84	61

Reading

School	Pre-Test	Post-Test	Gain	N*
Catalina	35.00	41.25	6.25	4
Cholla	28.39	42.50	14.11	28
Palo Verde	20.42	32.50	12.08	12
Pueblo	25.83	47.92	22.09	12
Sabino	33.24	45.88	12.64	17
Sahuaro	35.68	54.32	18.64	22
Santa Rita	22.92	48.75	25.83	12
Tucson	15.00	40.00	25.00	2
Alternative	30.00	33.33	3.33	9
All Schools	28.94	44.58	15.64	118

* Represents the number of matching students on the pre-test and post-test

Evaluation of the 1999 Summer Enrichment Academic Summer Program