Skip to comments.Gains in Houston Schools: How Real Are They?
Posted on 12/03/2003 1:24:34 PM PST by shrinkermd
HOUSTON As a student at Jefferson Davis High here, Rosa Arevelo seemed the "Texas miracle" in motion. After years of classroom drills, she passed the high school exam required for graduation on her first try. A program of college prep courses earned her the designation "Texas scholar."
At the University of Houston, though, Ms. Arevelo discovered the distance between what Texas public schools called success and what she needed to know. Trained to write five-paragraph "persuasive essays" for the state exam, she was stumped by her first writing assignment. She failed the college entrance exam in math twice, even with a year of remedial algebra. At 19, she gave up and went to trade school.
"I had good grades in high school, so I thought I could do well in college," Ms. Arevelo said. "I thought I was getting a good education. I was shocked."
In recent years, Texas has trumpeted the academic gains of Ms. Arevelo and millions more students largely on the basis of a state test, the Texas Assessment of Academic Skills, or TAAS. As a presidential candidate, Texas's former governor, George W. Bush, contended that Texas's methods of holding schools responsible for student performance had brought huge improvements in passing rates and remarkable strides in eliminating the gap between white and minority children.
The claims catapulted Houston's superintendent, Rod Paige, to Washington as education secretary and made Texas a model for the country. The education law signed by President Bush in January 2002, No Child Left Behind, gives public schools 12 years to match Houston's success and bring virtually all children to academic proficiency.
But an examination of the performance of students in Houston by The New York Times raises serious doubts about the magnitude of those gains. Scores on a national exam that Houston students took alongside the Texas exam from 1999 to 2002 showed much smaller gains and falling scores in high school reading.
Compared with the rest of the country, Houston's gains on the national exam, the Stanford Achievement Test, were modest. The improvements in middle and elementary school were a fraction of those depicted by the Texas test and were similar to those posted on the Stanford test by students in Los Angeles.
Over all, a comparison of the performance of Houston students who took the Stanford exam in 2002 and in 1999 showed most did not advance in relation to their counterparts across the nation. More than half of them either remained in the same place or lost ground in reading and math.
"Is it better or worse than what's going on anywhere else?" said Edward H. Haertel, a professor of education at Stanford University. "On average it looks like it's not." Stanford University has no relationship to the test.
In an interview, Dr. Paige defended Texas's system, saying that it had gradually raised the standards for success over the last 20 years. "Texas measures far more than minimal skills," he said. "The bar is far above what other districts use."
But questions about Houston's accomplishments are increasing. In June, the Texas Education Agency found rampant undercounting of school dropouts. Houston school officials have also been accused of overstating how many high school graduates were college bound and of failing to report violent crimes in schools to state authorities.
The Houston officials strenuously defend the district's record.
Kathryn Sanchez, head of assessment for Houston's schools, said students were doing well on both the Texas exam and the Stanford test, given the city's large number of poor and minority students. Ms. Sanchez said that Houston students had also done well on the National Assessment of Educational Progress, a federally mandated test widely referred to as "the nation's report card."
On that test, fourth graders in Houston and New York outdid children in four other cities in writing, to score at the national average. Fourth graders in New York and Houston also led children in other cities in reading, yet fell short of the national average. Of all six cities, however, Houston excluded the most children with limited English from taking the national assessment, and some researchers suggest that removing such students may have helped raise Houston's score.
But in interviews, Houston school officials acknowledge that the progress in the elementary grades peters out in high school. About 13,600 eighth graders in 1998 dwindled to fewer than 8,000 high school graduates. Though 88 percent of Houston's student body is black and Latino, only a few hundred minority students leave high school "college ready," according to state figures.
Miracle or Mirage?
With its own exam to measure pupil achievement, Texas managed to show educational progress over the last decade on a scale rarely, if ever, achieved before. But as the state's paradigm for school accountability became law for the rest of the nation, the authenticity of Texas's accomplishments has become a major question in education policy.
The Stanford test provides a useful contrast to the state exam, at least for Houston. More than 75,000 students in grades 3 through 8 and grade 10 took the state exam as well as the Stanford test from 1999 to 2002. The Times analyzed performances on these tests, excluding students in special education, and had educational testing experts review the results. The data were obtained under the state's open records act by George Scott, president of the Tax Research Association of Houston and Harris County, a taxpayers group.
"I don't think there was a miracle," said Robert L. Linn, co-director of the Center for Research on Evaluation, Standards and Student Testing at the University of Colorado, who reviewed the calculations. "There were some good positive results, but not extraordinary results like TAAS seemed to show."
The modest improvements in Houston have implications for the national debate. "If you anticipate that you can have the gains shown on TAAS and that's what No Child Left Behind would be requiring in many states that's not going to be likely to happen, based on this," Dr. Linn said.
The Times analysis of performance on the Stanford Achievement Test and the Texas exam shows this:
Houston students improved from 1999 to 2002 in most grades, but at only a fraction of the rate portrayed by the state exam. Using a widely employed statistical measure that allows different kinds of tests to be compared called effect size, the gains in the average scores on the Stanford test were about a third of the average gain in the TAAS scores.
Even students with the poorest skills posted high scores on the Texas test. In reading, a passing score of 70 on the test was the equivalent to scores below the 30th percentile in national ranking on the Stanford test in every grade.In 10th grade, passing the state exam was equivalent to the fifth percentile in the national ranking.
While the Houston gains on the Stanford test in some grades were large enough to be considered significant in educational testing, the city was not making much headway when compared with national averages. Some 57 percent of Houston students who took the math test in 1999 and 2002, and 51 percent of those who took the reading test, saw their standing relative to children around the country either fall or remain the same.
On the Stanford tests, the average reading scores for Houston students of all races in grades 9 through 11 have actually dropped since 1999. By contrast, the reading scores for 10th graders on the Texas exam the only high school grade in which the state test is given showed a large gain over the same period.
The achievement gap between whites and minorities, which Houston authorities have argued has nearly disappeared on the Texas exam, remains huge on the Stanford test. The ranking of the average white student was 36 points higher than that of the average black student in 1999 and fell slightly, to 34 points, in 2002.
"This says that the progress on TAAS is probably overstated, possibly by quite a margin," said Daniel Koretz of the Harvard School of Education, who also reviewed The Times's analysis, "And when all is said and done, Houston looks average or below average."
Tougher Texas Test
While Texas minority students have made gains on the federal government's mandated national assessment test of reading and math, they were already largely ahead of the average scores of minority students from around the country before the current Texas accountability system began in 1993.
In Houston, the share of college-bound high school graduates that the Texas Higher Education Coordinating Board deemed "college ready" fell to 28.5 percent, or 977 students in 2001, from 33.7 percent, or 1,155 students, in 2000, according to the latest figures available. The board counts only graduates who seek admission to public institutions of higher education in Texas, and says another 10 to 15 percent may seek admission elsewhere.
But many here saw the replacement of the Texas exam last spring with a tougher exam as the most stinging indictment of the test. On the new test, the Texas Assessment of Knowledge and Skills, or TAKS, race gaps widened, and passing rates fell.
Officials here now say that TAAS was only a test of "minimal skills," paving the way for ratcheting up standards with a new exam.
Dr. Paige contends that the TAAS and Stanford tests could not be compared because the Texas test gauges mastery of the Texas curriculum while the Stanford test measures a more general notion of what children should know in a given grade.
But education researchers disagreed.
"These two tests ought to be telling the same story, and they're telling different stories," said Dr. Haertel, of Stanford University.
Dr. Paige also argued that statistical anomalies in the results on the Texas test made comparisons impossible. But testing experts who examined those anomalies said that, if anything, they would reduce the disparities between the two tests.
Watching Children Struggle
In one way or another, Jo Arevelo, Rosa's mother, has watched each of her children struggle through an educational system that was focused tightly on producing high test scores on state exams.
Last summer, Ms. Arevelo tutored her youngest daughter, 10-year-old Angelica, in spelling. Because the state exam does not test spelling, Angelica's teacher never got to it, Ms. Arevelo said one recent afternoon.
Earlier that day, her son, Joseph, took the preparatory exam for the SAT college entrance test, but like many other children that day, he left the exam in frustration mystified by vocabulary words like parallelism and euphemism, words he had never encountered in school.
Patricia Anderson, a veteran social studies teacher in Houston, said she was not surprised. Noticing that her high school students could not answer questions after reading passages in their textbooks, she began giving them a vocabulary test at the fourth grade level. Typically, she said, "They flunk it."
"We're all very very frustrated, because all these great scores are coming out of the elementary schools, and when they get to high school it's not happening," Ms. Anderson said. "They do not have the skills they need."
It was not always like this. Many parents welcomed the accountability system that the Houston district pioneered in the 1980's and early 1990's. It was a way, they reasoned, to force schools in poor neighborhoods not to write off their children.
And in some places, it seemed to work, said Rene Barrios, lead organizer for the Metropolitan Organization, a chapter of a group that monitors public services. But in many other places, Ms. Barrios said, the system became the single most important measure of school success and the test itself, for many teachers, became the curriculum. "The whole system has been taken over by the test," she said.
Rosa Arevelo, who graduated from Davis High with a B average, tried to keep pace in college. She made flash cards to help her remember what she studied. She had never learned how to take notes in high school, so at her lectures in college, she took down everything the teacher said.
Her textbook looks as if it is filled with neon lights: entire paragraphs are highlighted in bars of bright pink and yellow. In the unrelenting array of information, she could not tell what mattered.
"When you get to college," she said, "you're just supposed to know. But nobody ever taught us."
Most, including the President, assume that all children are equal and all can attend college. Usually this assumption is unspoken or is assiduously hedged in further discussion to maintain a core conviction that we are all equal. All equal mind you not before God and the Constitution, but equal in our ability to master a tough, academic college curriculum.
Equality is one of those high-minded ideals that have been used by leftists for generations to tear down the existing structure of society. The slogan seems to be, all are equal therefore the government must achieve this with law and public policy. This belief is particularly noxious when it comes to possible racial differences in intellectual ability including college entrance. (see below)
Some time ago, I did a book review on Rochesters BESIEGED SCHOOLS, BEWILDERED PARENTS, and BETRAYED KIDS AND THE ATTACK ON EXCELLENCE. It is posted on FR. Basically Mr. Rochester found that in Kansas City the school district did everything possible to dumb down the curriculum so as to permit the least able students to compete with the most able. Usually, this resulted in a racial problem since the White, upwardly mobile parents were for tough curricula and academic excellence while the school personnel seemed to want an easier and more democratic approach. To his credit Mr. Rochester prevailed in some respects: in any case, one of his sons was accepted at Yale. I refer to this book so as to introduce another high school that has a different approach to college preparatory work.
Recently Edward Humes (Pulitzer prize-winning journalist) published School of Dreams. This book was written after a year teaching advanced writing at Whitney High School in California. This school ranks number one in the nation for public schools placement in colleges and, most especially, for the big threeHarvard, Yale and Princeton. It is a public school but before you can get in (people come from other countries to enroll their children) you must past a test. Of course, this is not called an IQ test, but the result is the same a highly selected, able population of highly motivated children. In passing most of the students are Asian followed by a White minority, followed by an even smaller minority of Blacks and Hispanics. (Does anyone ever wonder about the logic and usefulness of categorizing people by the language they speak?)
As Humes (a classic liberal in my view) says there are some people just smarter than others. Every effort has been made to deny this. From Phillip Wylie in the 1920s to Thomas Sowell in the 90s reasons have been postulated denying there are individual and racial differences in intelligence. Thomas Sowell (a man I admire) castigates society and Black society in particular for failing the students.
Then what is the truth? From the Bell Curve by Herrnstein and Murray, Race, Revolution and Behavior by Rushton as well as the internet (free) available The G Factor by Chris Brand you can find that for 100 years or more we know the following: (1) Intelligence is distributed on a curve distribution; (2) There are profound individual and lesser racial differences in intelligence; (3) And, intelligence is the most effective predictive variable in assessing future performance in an academic setting.
In respect to the racial differences they can be roughly subsumed as follows: Ashkenazi Jews have average IQ of 115, Asians have an average IQ of 108, European Whites have an average IQ of 100, Hispanics have an average IQ of 92 and African-Americans have an average IQ of 85. If it takes about an average IQ of 110 to be successful in a rigorous academic college or be a professional such as a physician, lawyer or college professor: then, 60% of the Jews, almost 40% of the Asians, 20% of the Whites and 5% of the African Americans will be able to make the cut of 110. Actually, for most successful professionals only a small minority (perhaps 2-5%) are truly able to be something better than trained in a trade.
There are all kinds of arguments against IQ. Not the least of which are posed by really fine (and very intelligent) people such as Dr. Sowell (See his marvelous book Inside American Education). But the problem is it is more than a test. Tom Wolfe in Hooking Uprelates a vignette where someone discovered (and this is scientifically valid) that with evoked potentials and an EEG one could roughly determine IQ. This would seem to be a great advance (and also substantiate the biological basis of IQ) but it failed because everyone was afraid to take a chance on marketing a fail safe IQ test.
Emotions often rule where reason should. Plato once argued that a truly educated person did nothing but see reality rather than what he wanted to see or should see. That is where we are at with educationas a people we dont want to see what the reality is and how we should respond to it.
Butressing this last point Brand's book was withdrawn by his publisher because he asserted individual and racial differences in "G" that were inherited. It is a good book, well written and available to all.
This wouldn't be a problem if the test wasn't garbage.
In 10th grade, passing the state [reading] exam was equivalent to the fifth percentile in the national ranking.
Note that these figures are about Houston ISD (Independent School District). (Translation: Inner city)
There are many school districts which surround Houston that have much better graduation rates, etc.