Showing posts with label test scores. Show all posts
Showing posts with label test scores. Show all posts

Thursday, November 7, 2013

Is It Really a Test? Or Just Another Task?

revised 1/25/19
Per aspera ad astra. Through difficulties, to the stars.

From a test-taker's point of view every test is a task. But not every task is actually a test, even if it looks like one. What is it that makes a task a test? This is a question of great practicality. State governments allocate funds to school districts on the basis of efficiency. This efficiency is determined by tasks-activities provided by state departments of education and imposed on local school districts. But what is necessary if this procedure, this task-activity, is to be anything more than a charade?


To avoid overlooking assumptions built into a widely accepted notion of testing, let's use a substitute concept: rank-task. We begin our investigation by talking about "rank-tasks" rather than about "tests." A rank-task is a type of activity some outcomes of which can be ranked, as, for example, better, the same, or worse. Think of a rank-task as any procedure which assigns someone a number. This can be interpreted as a rank to compare that person to others involved with the procedure.

Cinderella's Prince, looking to fit the glass slipper, would be undertaking such a rank-task. Some feet are too small; others, too large; only Cinderella's, just right. But trying to sort football players by the numbers on their jerseys is not a rank-task because there is generally no significance to the comparison of any two numbers other than that they indicate a different wearer.

Tests are, at the minimum, rank-tasks. They can be performed with more or less skill. But the skill demonstrated may not be what it is we wish to measure. For instance, Students take SAT preparation courses to learn test-taking skills, not the information the tests are designed to measure. Often these test-taking skills can be as crucial to a good score as actually knowing the material covered in the test.

For example, The Princeton Review has for many years provided materials and training in simple test taking procedures which seem to be able to raise SAT scores significantly. The SAT's are intended to measure scholastic aptitude. But the effectiveness of the Princeton Review's materials suggests that the SAT's are also measuring something else, namely the ability to take standardized tests of this type. This observation illustrates the very practical nature of our seemingly theoretical observations about testing. (See "Rationales for Intervention: From Test to Treatment to Policy: a forensic theory of warrants & rebuttals")

Among the readers of this article are certain to be individuals who did not get a scholarship, or who failed to get in to the college or university of their choice because of the score they received on the SAT. And there is a fair chance that the reason they did not get a higher score was not because they lacked scholastic aptitude, but because they lacked certain test-taking skills.


To consider other things that make a rank-task a test, see Justice Through Testing


Cordially
--- EGR

Tuesday, December 6, 2011

Providing Services for Children in Special Education: what should they be?

Handicapped kids and those who care for them have pretty consistently ended up losers in the public schools. Neglect didn’t work. Special education didn’t work, either. Will our efforts to fully include special children in regular classes do any better, given our insatiable desire to raise achievement and measure it by test scores?

Working with less-fortunate kids in academic classes might help the “included” kids a bit, and it will undoubtedly make the “including” kids better people. But let’s also admit that it will take time away from kids’ test preparation, and we all know damn well what really counts.

Teachers all know what suffering we create when we neglect the needy. But we should also consider the grief that follows when overzealous service is provided. Maybe it’s time to explore alternatives when public providers are not satisfactory, for example, private, even religion-based experts, more aggressively ...but with more care than enthusiasm.

To examine these issues further, see Special Education: misgivings and reconsiderations

-- WAC

Saturday, August 6, 2011

Raising Test Averages: is this good?

Put down six and carry two. ... Gee, but this is hard to do.
You can think and think and think, till your brains are numb.
I don't care what teacher says,I can't do that sum.
-- Victor Herbert & Kenny Baker

Suppose we find that over time more and more kids in a school have test scores above average. Is this good? Not necessarily, even though most people would jump to the conclusion that achievement was going up.

Suppose we find find that over time more and more kids in a school have test scores below average. Is this bad? Not necessarily, even though most people would jump to the conclusion that achievement was going down.

Find out how a common misunderstanding (even by so-called “authorities”) makes schools look bad. -- EGR

To see the details go to Every Child Above Average
Cordially,
-- EGR