Showing posts with label research. Show all posts
Showing posts with label research. Show all posts

Tuesday, October 11, 2016

The Art of Constructive Criticism

“Don't trust a mirror that only tells you how wonderful you look.” -- Matshona Dhliwayo
Constructive Criticism must be criticism and it must be constructive. It is criticism when it focuses on standards; it is constructive when it articulates those standards so that the shortcomings in a piece of writing (or item of construction) can be dealt with.

"Pats on the head," effusions of delight and the like are not criticism. They dodge the issue of criticism, except in the case where the text being critiqued is so excellent, so far removed from improvement that there is nothing left to do but to express wonderment and pleasure. (This is a rare situation.)

Criticism minimally expresses to an author,"There are standards which are relevant here that your paper does not meet." To be constructive, the critic must go beyond, indeed, avoid simple formulations like,
"This is poorly written," or "This makes no sense." 
It is more useful - not to mention, non-threatening - to avoid using such statements entirely. One might say, "The problems with this paper are that ...." This foregoes unnecessary emotional engagement and does the work that a critique should do: specify what it is that makes the paper fall below expectable standards!

We may - and sometimes do - encounter the following situation: a disagreement as to what standards are applicable in judging a paper. For example, what is acceptable as a report in a business might be criticized in an academic context as a hodgepodge pasting together of plagiarized material. Understanding the context of presentation and the audience that will receive your text is, consequently, important here.

The best procedure as as constructive critic is to adapt the attitude of a team-member trying to improve the workmanship of a colleague. Don't hold back from expressing concern if you think there is a problem; but don't try to intimidate or "one-up" the person whose paper you are criticizing by delivering judgment, but withholding the reasons for it.
(Note that this essay itself is a kind of critique. Do you think it, itself, meets the standards it articulates for constructive criticism?)

For specialized applications of constructive criticism, see:
What is a Synopsis? Controversy Analysis Worksheet (Interrogatory)
Worksheet with Examples 
Solving School Problems: a conflict resolution approach
Cordially, EGR

Sunday, August 14, 2016

School “Success”: hoping for miracles.

edited 7/26/18
In a country where celebrity counts so much that Donald Trump can apparently found a university on sheer bluster, and Miley Cyrus can generate 300,000 tweets per minute, why bother remembering Avogadro’s number? -- James Graff The Week 9/6/13 p. 3.
Having been in education almost 50 years, I have long wondered why a country that can put a man on the moon and work abundant wonders in many another field, can persist as a whole in being so distracted by plain, dumb slogans and suggestions of how and why schools should be run. (See Blocking School Reform: “scientific” metaphors)

I studied philosophy, math and smatterings of various sciences throughout my academic education. The questions I encountered were often confusing, ambiguous and, even when sufficiently clarified, hard. Being enthusiastic or well-intentioned or hard-working, by themselves, didn’t help answer those questions. Having knowledge did.

However, when I started teaching as an occupation I encountered practices that, even when failing, seldom were questioned as to their whys and wherefores. Questions? Who really wants to be bothered? Bothersome people need not expect a long or successful career. So, don’t ask questions; just look like you’re getting something done!

However, if you persisted and had not quit in your first three years as most new teachers do, explanations, “theories,” as they were called, abounded. (Actual research, unless it supported "enthusiasm," was disregarded. For an example, see Who Controls Teachers’ Work?) "Theories" virtually gushed from the mouths of anyone who claimed to sport an advanced degree. No matter; their nostrums were generally too vague, or it was too impolitic, or even illegal to put them to the test.

Unless … special funds were available for school “reform.” Then those who could seduce funders into believing that grant applicants could spin straw into gold would often end up making a mint by rebottling old wine or, even, substituting turpentine as a new beverage. see Ineffective Instruction: through ignorance, or distraction?


Some researchers have gone abroad to see “why,” for example, South Korean, Polish or Finnish kids do better in school than American kids do. The researchers report back interpreting what generalities they could make as causes of higher school achievement. (See the review of the book, The Smartest Kids in the World: And How They Got That Way. by Amanda Ripley. Simon & Schuster , in The Week 9/6/13 p. 20.) Such reasoning is riddled with logical error.

Invariably someone will claim title to being an “educational consultant” by invoking either or both of two long-recognized logical fallacies:
a. After this, therefore because of this; e.g. “Kids whose parents started attending PTA meetings got better grades. So, parents, join the PTA!” or

b. confusing correlation with cause; e.g. kids who (said that they?) believed there was a connection leading from high school to college to a good job, worked harder in high school. So parents, get your kids to (say that they?) believe in that connection and their school work will improve!” (But see Success in College: what might influence it?)
In past years I would mention such things to people in other fields and they would shake their heads in dismay that I had chosen such a madhouse-occupation.

Times have changed. Now when they hear that I have been in education for many years they repeat to me the easy reform slogans of the many ed-hucksters chasing after federal and foundation bucks. And of course, everyone, just everyone has a recipe for making schools better.

Concocting proposals to reform public schools has been a pastime in this country for well over 100 years. (See Perpetual Reform: an American Insanity?) You might think it’s been time better spent than paying attention to Donald Trump or Miley Cyrus. But when you consider not only the money frittered away, but the expectations futilely raised, the hopes dashed, in the long run the costs of playing at “school reform” far exceed the benefits.

Nearing the end of my half-century in this profession, this business, this ministry, I do not believe all the hocus-pocus, the hugger-mugger, about school improvement is merely a matter of stupidity, or disinterest. I doubt, for example, the few thoughtful people imagine that narrowing the focus on teachers will accomplish much.

Rather, I suspect that the widespread attitude that somehow education on its lonesome is going to make up for the weakness in its supporting factors, comes from the unwillingness to concede that even people quite removed from the public schools -- not just students, parents, teachers, or administrators -- are substantially responsible for their failings. (See What Can a Teacher Do? Two myths of responsibility.)

Very likely, what is described as the “failure of the public schools” is promulgated to distract from their abandonment by other, stronger, outside institutions, who finesse away their moral responsibilities to society by settling blame on one of its weakest members.

To examine these issues further, see Moral Responsibility in the Education Industry

Cordially

--- EGR

Tuesday, August 9, 2016

Searching for “Reality"? Stipulate A Turtle!

edited 102119
"What you have told us is rubbish. The world is really a flat plate supported on the back of a giant tortoise." The scientist gave a superior smile before replying, "What is the tortoise standing on?" "You're very clever, young man, very clever," said the old lady. "But it's turtles all the way down!"
— Hawking, 1988 A Brief History of Time

Traditions of Stipulation Define Disciplines. We find in West’s Encyclopedia of Law[**] the following characterization of stipulation as it is used in legal proceedings:
An agreement between attorneys that concerns business before a court and is designed to simplify or shorten litigation and save costs. During the course of a civil lawsuit, criminal proceeding, or any other type of litigation, the opposing attorneys may come to an agreement, foregoing further investigation, about certain "facts" and "issues". Such an agreement is called a stipulation.

From this conception of stipulation it is easy to construct parallels for almost any kind of research that does not or cannot push to some ultimate, incorrigible result. Within a discipline practitioners tend to pursue answers to questions arguably recognized as within the scope of their discipline, using methods arguably related to traditional methodologies. One cannot proceed within a discipline without some potential for recognition from others in that discipline that their undertaking is appropriate. Every graduate student learns early on how narrowly one must frame a research question for it to be acceptable to an advisor. (See Becher, T. Academic Tribes & Territories: the Cultures of the Disciplines. 1989.) See All Definition Ultimately Rests on Stipulation, i.e. Communal Agreement.

Of course, one can strike out on one’s own pursuing “gigantic truths” and risk possible self-delusion, uncompensated-for bias,and dismissal, should one's efforts, in the long run, not stand up to criticism from interested parties. Many famous discoverers have run this gauntlet and met with success, if only posthumously. (Many more of us console ourselves with advice from an ancient and also unremembered author: Pan metron ariston.)

But even well-established contexts of research have their own problems. Coordinated group activities, in general, are subject to tensions among authority, consensus and efficiency. Research problems frequently raise issues as to who decides procedures and goals, how much agreement among participants has to be obtained on these issues to come to a decision; and, how best to use the resources available for it.

The sticking point is this: such decision-types, i.e. those arbitrating authority, consensus and efficiency, may reiterate themselves for every decision consequently reached. This reiteration is often dismissed by invoking some tradition of stipulation contexts, e.g. budget limits, time and opportunity costs, political opposition from funding sources, diminishing returns on output, even researcher fatigue or boredom. (See The Fractalization of Social Enterprise)

Just as lawyers on opposing sides may stipulate evidence they have no hope of subverting, so do researchers in any field forego spending time and effort on pursuits that consume scarce resources with little promise of compensatory yield.

But What About Objectivity? Wouldn’t stipulation make it impossible?

In the early 1970’s I met a researcher whose speciality was disease etiology. Her interest was aroused by an apparent correlation between increased density of cancer cases and density of chemical manufacturers in certain neighborhoods of a large Eastern city. She obtained federal funding and began her investigations by interviewing people in those neighborhoods.

Two weeks into her interview schedule, she received a phone call at 3:00 A.M. The caller warned her not to continue the interviews; not even to come back in to the neighborhood. Otherwise, she would “end up with two broken legs.”

Being of a somewhat crusading spirit, she considered continuing with her research despite the phone call. Her husband, however, was not comfortable with her ignoring the threat. Little matter: one day later, while she was still weighing a decision, she received a phone call — this time at an appropriate hour — telling her that the funding for her research had been cancelled. No explanation was given.

No doubt from the research perspective of trying to see if there was a relationship between cancer victims and numbers of chemical plants, a set of conditions had been stipulated which impaired the objectivity of her research. The research was terminated before the experimenter’s intended procedures had been carried out. Lacking more information, we can speculate as to what the research-termination procedure was stipulated to be, although we do not know who had the power or authority to do it.

Objectivity depends on what the proposed object is. If all you want to do is stare through a tube to see pretty patterns, then a kaleidoscope will do as well as a telescope. Every procedure, or instrument employed in a procedure, can be questioned to what extent it creates as well as gathers “data.” Reliable instruments, stipulated as such, may permit reasonable stipulated outcomes, e.g. abridgments of otherwise lengthy procedures. (See Can Criminal or Immoral Behavior Be Dealt With Objectively?)

For references and to examine these issues further, see Knowledge: The Residues of Practical Caution


Cordially
--- EGR

[**] West's Encyclopedia of American Law, edition 2. S.v. "stipulation." Retrieved August 9 2016 from http://legal-dictionary.thefreedictionary.com/stipulation

Tuesday, September 23, 2014

Common Sense, or Merely Common Hubris?

edited120918
“Nothing is more fairly distributed than common sense: no one thinks he needs more of it than he already has.” ― René Descartes, Discourse on Method

Hume was on to something. John Locke had proposed that our senses responded to our experience by presenting sensations to the mind. The mind in turn worked to store these sensations as memories or to connect and then store these sensations as complex memories.

David Hume saw Locke’s theory as disabling the distinction between what we nowadays call “correlation” and “causation.” Our sensations are of events in our experience. All we can observe through our senses, even our senses amplified by instruments, are events. But we are in the habit of believing in cause and effect if one kind of event is consistently followed by events of another, different kind.

Indeed this tendency to connect one predecessor class of events to another following class gives rise to the fallacy of post hoc, ergo propter hoc, “after that, therefore because of that.” For example, people more often feel queasy after eating raw clams, than after eating zucchini; so, they think, "Raw clams cause queasiness more so than does zucchini.” (But what if people who eat raw clams stuff themselves more frequently than those who eat zucchini?}

Between correlated event-classes we do not observe an intermediate event, a causal nexus, as it is sometimes called, that helps us distinguish between causation and “mere” correlation. True. But there is another way to look at this.

Maintaining Cause and Effect. Immanuel Kant attempted a rescue by proposing that Locke had gotten it wrong. The Mind (in German, Verstand, translated both as “mind” and as “understanding,” -- not Seele, Gemüt, or Sinn also translatable as “mind”) does not merely make connections of sensation brought in through the senses. The Mind’s very structure tends to process correlative event classes as cause and effect. We can hardly help but understand -- at least initially -- repeated correlation as indicating cause. This theory has been found to be much more attractive in the US since the withering of radical Behaviorism in the later 20th Century. (See A Critical Review of B.F. Skinner's Philosophy )

However, invoking some logic, there is a more direct way of thinking about it. We can accept Hume, yet maintain the distinction between correlation and causation. Consider universal negatives, which are statements that propose that, at any place or at any time, something is not; or, that nothing is, a certain way or thing.

For example, “There are no such thing as dragons,” or, what is logically equivalent, “There are no dragons, anywhere, ever.” The issue here is not whether the claim of the non-existence of dragons is true or false; but, whether there is an observation we -- or beings like us, of limited breadth of experience in space and time -- can perform to establish it.

Note that it is easier to disprove a negative universal than to establish it. The find of one dragon disproves it. But despite a very, very large number of failures to find a dragon, any claim that they don’t exist is not proven by that failure.

It was, in fact, widely believed in the 19th Century and earlier that there was no such thing as a black swan. There are, in Australia. Also, tomatoes were considered to be poisonous, e.g. there was no such thing as a tomato that could safely eaten by humans. We know differently.

 
Disproving "No Swans are Not White."
Reconsider the example given above about the relation of eating raw claims and queasiness. The very argument against its being causation demonstrates that we bring much more to such a causal claim than a narrow consideration of correlation: we consider possible alternatives, or intermediaries, standardly characterized as confounding or mediating variables. A host of assumptions and presuppositions supports our observational reports.(See Identifying Trans-ideological Epistemological Presuppositions)

The “Common Sense” of American (School) Reform. There is always the possibility of hidden, overlooked or disregarded causes or effects that undermine an assertion that one situation causes another. As many have discovered, an apparent “common-sense” causal relation can disappear under closer scrutiny due to confounding or mediating variables.

There are a host of causal myths involved with all sorts of reform efforts, in particular, American education, primary, secondary, and higher, be it public, private or parochial. For example:

Bad or insensitive teachers are the primary cause of failing students.

Students have learning styles. Teachers can teach to them, i.e. no child is unteachable.

College is a pure waste of time, i.e. nothing worth the cost is learned.

Today’s schools are in a position to forestall 21st Century employment problems.
(See References to Schooling Myths.)

Such “common sense” beliefs underlie the hubris that drives a great many of today’s school reform undertakings. Their prospect is to continue on in a century-long American tradition: the cavalier waste of mis-aimed scarce resources leading to reform failure.

To examine these and related issues at greater length, see Moral Responsibility in the Education Industry: 
how much can school reform enhance a student's occupational fitness?)


Cordially
--- EGR

Saturday, May 25, 2013

Question the Question: avoiding premature closure on options.

There are disturbing signs that even many individuals and groups who should know better have learned little about the complexities of schools and educational improvements and are comfortable with the old bromides. Simple diagnoses and correspondingly simple solutions abound. --- John Goodlad, A Place Called School (1984)
What are educational problems? Why are there schooling controversies? What conflicts underlie them? How can we deal with them?

Stop. Don’t jump to formulating answers to these questions. Don’t confuse readiness or speed of response with knowledge or wisdom. Such shows of “decisiveness” or “leadership” often work to bias the direction of inquiry, restricting the range of perspectives brought up for consideration. In addition these "answers" may prematurely cement the discussion into forms which serve special interests and unfairly rule out diversity of opinion.

For example, consider this question from a Linkedin educational forum:
Is the American educational system wrecked or it has simply become inadequate since it can’t longer fulfill the essential requirements of the current and future generations? - Linkedin Educational Leadership Group, May 24, 2013.
This “question” is actually a bundle of answers in interrogatory form. It likely promotes agendas dear to the heart of its authors. It’s fairly obvious that
a. the “question” restricts discussion to two options: the American educational system is either “wrecked,” or it has become “inadequate.”

b. It finesses in a diagnosis for the proposed “inadequacy,” i. e. the system can’t fulfill “the essential requirements” …

c. “wrecked” and “inadequacy” are, themselves, evaluative terms requiring specification and justification.

d. It is far from clear what the following terms are being used to refer to: “the American educational system,” “the essential(?) requirements.” Which populations are being referred to by the terms “current and future generations?” (Don’t assume much consensus on these issues. American politics evidence otherwise.)
I responded to the “question” in the online forum with the following:

Would you mind listing "essential requirements of the current and future generations"? It might help draw this discussion down to practical considerations and to define the political environments in which any implementation efforts will need to seek support. (Don't presume any broad consensus on these issues.)

In addition, it might help to bring up some of the many, many other possibilities the forced two-pronged alternatives of your original question has overlooked.
For references and to examine these issues further, see Solving School Problems: a conflict resolution approach


Cordially
--- EGR

Wednesday, October 26, 2011

What is Truth? Does It Matter to You?

In a controversy the instant we feel anger we have already ceased striving for the truth, and have begun striving for ourselves. -- Buddha
You may have come across this somewhere: the truth shall set you free. How free are you? How free do you want to be?

A history professor once told me that she forbids her students from talking about “truth.” “It’s a pointless chase, a matter of opinion!” she exclaimed.

“Do you have your students do research in order to write a paper?” I asked. “Of course,” she replied. I continued, “If what you say about truth is true (!), then what does it matter? Why can’t they just make it up out of their heads?”

The professor asked that we continue our conversation at another time because she had just remembered an important meeting she had to attend. We never got to discuss it again. That was fifteen years ago. In the time since then, I have talked with many people in the Liberal Arts and Humanities who expressed similar disregard for what they called "a hegemonic conception of truth", invoking a condition called post-modernism, in which our society is putatively now existing.

Recently, much concern has been expressed about the withering of the Liberal Arts and Humanities at many universities, and warnings abound about the "corporatization" of the Academy. But what attraction does a discipline have if it holds out no hope for truth, even in approximation? Very few people treat their studies as some kind of game with which to while away their life and fortunes.

To examine these issues further, see Personal Liberation Through Education

Cordially,
-- EGR

Tuesday, October 11, 2011

What Works in Schooling: the “Newfanglers” versus the “Oldfashioned.”

Invention consists in avoiding the constructing of useless contraptions and in constructing the useful combinations which are in infinite minority. -- Henri Poincare
After a century or more of fiddling with schools and the kids in them, it should be apparent to anyone who can fog a mirror that there is not even a will-o’-the-wisp of a new method for teaching everyone, everything, everytime, everywhere, as is often “mandated” by federal, state and local school authorities. The “newfanglers” who populate our educational research institutes are much more adept at promoting their careers than student learning.

This is not to say that there is some "good old fashioned" method that works best, either. Time magazine recently featured the dicta of yet another befuddled educator: “what works best is a good teacher with a chalkboard and a class of willing students.”

This is mere rhetoric: it is like saying that health will be achieved by eradicating sickness; or, strength, by overcoming weakness. Such buffoonery is not uncommon in many areas of our public discourse.

Since our Home of the Free and Land of the Brave purports to be democratic, equal “respect” is accorded all opinions, from the least informed, most prejudiced to those most carefully considered. So it is that, to avoid a suspiciously “elitist” complexity, our public discourse, even among the technically skilled, tends towards vacuous hyperbole.

Thus, we Sons and Daughters of Liberty, lacking the means to even identify, much less achieve, ill-advised or unclear school goals, persist in trying to fix schools that either aren't broken, or which can't be fixed.

To follow this train of thought further, see What Works? Under What Conditions? And Who Really Cares?
-- EGR

Tuesday, July 20, 2010

Hard Wired Choice?

Intelligence, wisdom, circumspection, delay of gratification, strategic skill: it looks like it all might be a matter of neural growth. What, then, about our practices of reward and punishments for the choices people make?

Or, to take it from the other end, what if supporting healthy development in children is crucial? Can we continue to pretend that one person’s poverty is not our general concern?

But maybe we are just mechanisms, generating text and uttering sounds, living in the delusion that we are in control. We do what we do and we don’t what we don’t. End of discussion. Permanently.

To review the article which prompted these conjectures , see Separate Neural Systems Value Immediate and Delayed Monetary Rewards

For practical application, see PAIN VERSUS ANGUISH:
Is There No Need For Corporal Punishment?


Cordially -- EGR