Outcome assessment

This idea from Dean Dad is only going to work with an extremely objective metric.  It works fine for sales or time in a race, but I think that the assessment of soft skills is sufficently difficult that this is likelty to cause more trouble than it is worth.  Consider:

With the overall allocation flat or shrinking, every college is pretty much up against it already. None of them has much margin for error.  That’s especially true given how fixed most of the costs are, and how old most of the buildings are.  (Gotta love 70’s architecture!) 
Now they’re being told that it’s not enough that they do well; they must do better than their counterparts.  If Northern State’s “score” -- however defined -- moves up five points, but Southern State’s moves up ten, then Northern State takes a cut. 
If the colleges had large endowments, this could be a spur to entrepreneurialism.  If they were gambling with money they could afford to lose, then this could be just the kick in the pants they needed to start trying more ambitious things.  The prospect of the big win can justify the risky play.
But when the colleges are running on empty at the outset, the prospect of any meaningful loss is simply intolerable.  Instead of spurring innovation, this will heighten the already-strong culture of loss aversion.  Taking a flyer on a strategy that would take years to pay off isn’t an option when the years in between could require layoffs.
Worse, any kind of statewide collaboration -- exactly the sort of thing that would “move the needle” on educational attainment, workforce development, or any social good you care to name -- would be entirely out of the question.  Why would I share my breakthrough innovation with Nearby State, when it would erode my competitive advantage? 
And just how long, exactly, do you think it would take before the quick fix of grade inflation starts to look attractive?

 It is the quick fix of grade inflation that I consider to be the most important threat.  Even with externally administered objective tests we are creating massive incentives to find any way to improve on the tests possible.  Some of these approaches will align with the goals of the program (e.g. improving classroom instruction).  But other goals will be to load the deck in any way possible (inflating grades, changing admisison standards, shifting learning to the test-based goals) in order to try and avoid these crushing cuts.  After all, even small amounts of advantage will add up to more resources in the future.  And I am becoming more and more convinced that a lot of outcomes are driven by resources as much as anything else. 

I am not saying no version of this approach can work, but it is always concerning when outcomes are not hard but rather soft.

A perspective on Ayn Rand

From XKCD:

I had a hard time with Ayn Rand because I found myself enthusiastically agreeing with the first 90% of every sentence, but getting lost at 'therefore, be a huge asshole to everyone.

It is true that Randianism has some rather perverse suggestions for human behavior and some rather idealistic assumptions about how actual human beings will act in the face of competition.  

Context

Context can really matter in terms of what we consider to be virtuous behavior:

So there it is: the difference between a stay-home mother and a welfare mother is money and a wedding ring. Unlike any other kind of labor I can think of, domestic labor is productive or not, depending on who performs it. For a college-educated married woman, it is the most valuable thing she could possibly do, totally off the scale of human endeavor. What is curing malaria compared with raising a couple of Ivy Leaguers? For these women, being supported by a man is good—the one exception to our American creed of self-reliance. Taking paid work, after all, poses all sorts of risks to the kids. (Watch out, though, ladies: if you expect the father of your children to underwrite your homemaking after divorce, you go straight from saint to gold-digger.) But for a low-income single woman, forgoing a job to raise children is an evasion of responsibility, which is to marry and/or support herself. For her children, staying home sets a bad example, breeding the next generation of criminals and layabouts.

I think that domestic work is extremely challenging to fit into our framework of how we define productive activity.  It is clear that domestic work is essential to the creation of the next generation of people and that it is not easy labor.  The idea that dignity can only come from paid employment rather than worthwhile work is perverse.

I would consider a Buddhist monk, for example, to have plenty of dignity even if their vocation never (ever) results in paid employment.  I think that this might be part of the modern social darwinist ideal that Jon Chait talks about in which the market doesn't just act to increase economic efficiency but it also grants moral status based on economic outcomes.  There are a lot of activities in the world that are not paid employment but are worth doing.  

Sure it saved us twenty billion, but it sounds funny

I was very pleased to read this report (via Mr. Salmon,) in the Washington Post:

Rep. Jim Cooper (D-Tenn.) believes it is time the sex life of the screwworm got its due.

 On Wednesday afternoon, Cooper rose to the defense of taxpayer-funded research into dog urine, guinea pig eardrums and, yes, the reproductive habits of the parasitic flies known as screwworms--all federally supported studies that have inspired major scientific breakthroughs. Together with two House Republicans and a coalition of major science associations, Cooper has created the first annual Golden Goose Awards to honor federally funded research “whose work may once have been viewed as unusual, odd, or obscure, but has produced important discoveries benefiting society in significant ways.” Federally-funded research of dog urine ultimately gave scientists and understanding of the effect of hormones on the human kidney, which in turn has been helpful for diabetes patients. A study called “Acoustic Trauma in the Guinea Pig” resulted in treatment of early hearing loss in infants. And that randy screwworm study? It helped researchers control the population of a deadly parasite that targets cattle--costing the government $250,000 but ultimately saving the cattle industry more than $20 billion, according to Cooper’s office.

This is a good story in the sense that it's good news -- for too many years, important research with huge economic pay-offs has been ignored and often mocked -- but it's also a good story for a guy trying to write  a post for a science and technology blog because it illustrates so nicely some of the reasons that so much science reporting is so bad:

1. Most reporters have a weak grasp of what goes into good research. For example, studying conditions in different animals often produces giggles from the press (see the dog urine study) even though changing the population of animals studied is generally an excellent idea.

2. The press corps have an urban bias accompanied with a pronounced disinterest in agriculture. As a result, even agricultural research of immense and obvious economic value is routinely mocked by publications like the New York Times.

3. The press corps also has decided ddulite tendencies and unfortunately this research doesn't sound cool. (Even though it is.)

update: Upon review, I'm thinking that I didn't out my point sufficiently. The studies described on the WP were good, solid research that paid for itself. The media's inability to recognise good science makes it all the more difficult to fund and pursue good science.

Organizational strategy

Brad DeLong:

The strategy that Berkeley has settled on is to seek to produce the funding stream necessary to maintain a great University by becoming a finishing school for the superrich of Asia. This may be the wrong strategy--I sometimes think so, many others think so, and you can certainly argue so. But it is the strategy that we have. And the worst strategy of all is to have no strategy. A bad strategy is vastly preferable to no strategy, or to an unimplemented strategy.

There is a lot of good stuff in this particular post.  In global terms, the critique of reducing access to education in the United States is probably the single most important point in Dr. DeLong's piece.

But I think that the point above is one that academics should pay a lot more attention to.  You may or may not agree with a particular strategy (or Dr. DeLong's specific recommendations as to how to approach the strategy) but it is critical that there be a strategy.  I have seen bad strategies work out for all sorts of unexpected reasons (nobody can know all possible variables).

But it is true that sticking to a strategy is a sensible plan.  The costs of constantly changing strategies is non-trivial and may replicate the worst elements of no strategy.  

On the tech beat

Lots of interesting technology stories out that I ought to be blogging about, most via Felix Salmon.

Salmon examines the career of "the Man Who Makes the Future."

Neal Stephenson and Tyler Cowen have some questions about innovation in the internet age.

While the other side seems to be retreating to the position that we're doing fine; just look at how slow progress was in 1900.

And finally, Noah Smith effectively makes the case that, in an era of limited budgets, particle accelerators are a bad place to spend our research dollars.

Is this really the basic lesson of economics?

Frances Woolley:

The basic lesson of economics is that people - including governments - aren't stupid. If it was possible to generate an immediate increase in tax revenues by reducing tax rates, taxes would be cut instantly. Taxes are what they are in part because reducing taxes creates an immediate revenue short-fall.

But it is worth noting that countries don't immediately do a "race to the bottom" on tax rates and so there has to be some underlying level of support for current policies.  It is not that change is never good, but it is the case that it pays to carefully examine the full set of incentives.

Somebody is usually benefiting from social arrangements.  

Can you plagiarize folklore?

[the following is a follow-up of sorts to this earlier post on plagiarism.]

You can certainly steal the wording, perhaps the narrative structure, but does it make any sense to talk about plagiarizing something that has neither distinct authors or authorship dates? That's a question raised by by this kerfuffle over the following paragraph lifted by Karl Weick:

The young lieutenant of a small Hungarian detachment in the Alps sent a reconnaissance unit out into the icy wilderness. It began to snow immediately, snowed for two days, and the unit did not return. The lieutenant suffered, fearing that he had dispatched his own people to death. But the third day the unit came back. Where had they been? How had they made their way? Yes, they said, we considered ourselves lost and waited for the end. And then one of us found a map in his pocket. That calmed us down. We pitched camp, lasted out the snowstorm, and then with the map we discovered our bearings. And here we are. The lieutenant borrowed this remarkable map and had a good look at it. He discovered to his astonishment that it was not a map of the Alps but of the Pyrenees.

It's possible that this story really happened (I have reason to doubt it but I'll get into that later), but that's not really important. Some times the events in folk tales and urban myths do happen but that doesn't stop the tales and myths from functioning, culturally and aesthetically, as folklore.

The genre of worthless items proving valuable stretches at least from Stone Soup (which merits its own type in the Aarne-Thompson folktale classification system) to Mamma's Bank Account. Add to that the related genre of false or misunderstood instructions and you can find literally thousands of antecedents.

Now check out the "original" version (again from Gelman):

1916: Albert Szent-Györgyi, a medical student in Budapest, serves in World War 1.

1930: Working in Szeged, Hungary, Szent-Györgyi and his colleagues discover vitamin C. In the next several decades, he continues to make research contributions and becomes a prominent scientist, eventually moving to the U.S. after World War 2. He dies in 1986.

1972: Medical researcher Oscar Hechter reports the following in the proceedings of a “an international conference on cell membrane structure,” published in 1972:

Let me close by sharing with you a story told me by Albert Szent-Györgyi. A small group of Hungarian troops were camped in the Alps during the First World War. Their commander, a young lieutenant, decided to send out a small group of men on a scouting mission. Shortly after the scouting group left it began to snow, and it snowed steadily for two days. The scouting squad did not return, and the young officer, something of an intellectual and an idealist, suffered a paroxysm of guilt over having sent his men to their death. In his torment he questioned not only his decision to send out the scouting mission, but also the war itself and his own role in it. He was a man tormented.

Suddenly, unexpectedly, on the third day the long-overdue scouting squad returned. There was great joy, great relief in the camp, and the young commander questioned his men eagerly. “Where were you?” he asked. “How did you survive, how did you find your way back?” The sergeant who had led the scouts replied, “We were lost in the snow and we had given up hope, had resigned ourselves to die. Then one of the men found a map in his pocket. With its help we knew we could find our way back. We made camp, waited for the snow to stop, and then as soon as we could travel we returned here.” The young commander asked to see this wonderful map. It was a map not of the Alps but of the Pyrenees!

The moral of the story, as given by Hechter and by Bernard Pullman at another symposium a year later, is that the map gave the soldiers the confidence to make good decisions
...

1977: Immunologist Miroslav Holub publishes a poem (of the prosy, non-rhyming sort) telling the lost-soldiers story (again, crediting Szent-Györgyi) in the Times Literary Supplement, translated from the Czech. Holub may have actually attended the meeting reported on by Hechter.

Take a good look at the format here. The narrator says a person he knows told him a story which he then repeats. The source is specific and reliable. The story is improbable, involves unnamed protagonists and a fairly non-specific setting, and has folkloristic aspects. This puts us squarely into urban myth territory and a map of that territory is useful when you try to what's happening here.

Much of the pernicious staying power of urban myths is the tendency to attribute the credibility of the source to the story itself. Of course, with an urban myth, the source is simply another link in the chain just as we are when we repeat the story.

With that in mind, when Gelman emphasizes the importance of crediting Szent-Györgyi, it begs the question, what should we credit him with? What is Szent-Györgyi's role here? Though we can't say for certain, it seems unlikely that he came up with the story (and if so, he certainly misrepresented it). Likewise, it doesn't seem like these events happened to him or that he witnessed them. Instead, based on the evidence that we have in front of us, it seems obvious that Szent-Györgyi's role here was the same as Hechter's and Holub's and Weick's; he heard a story and he repeated it.

Weick certainly owes Holub an apology and an acknowledgement, but as for not mentioning Szent-Györgyi, I think he made the right call. Naming Szent-Györgyi implies that we know the source and can trust the story's veracity (I doubt that we do or can). Saying nothing about where the story came from is possibly more honest; it doesn't imply anything we have reason to believe is untrue. Instead it presents this as an apocryphal tale, a bit of folklore. As such, it has to stand on its own merits: is it interesting and thought provoking?; does it make a valid point?

Weick unquestionably stole the words he used to tell this story, but I suspect the story itself has been told and retold since soldiers started carrying maps. Arguing about plagiarism at this point seems rather silly.

What I'm currently blogging about in some alternate reality

Via Andrew Gelman, Gary Rubinstein digs through NYC's data dump and produces a series of interesting posts. If you can't read the whole thing, make sure to check out part 1 and part 3.

Elsewhere in education, Felix Salmon points us to this case of a foundation providing high school lesson plans that push a definite agenda.

Back on the USPS beat, the NYT explains how the service's attempts to diversify are often blocked through the lobbying of competitors. Dean Baker has more on the subject.

And on the subject of the growth fetish (with a bit of ddulitism thrown in), Noah Smith looks at the performance of venture capital firms since the bubble burst.

On the plagiarism front, stealing from unpublished work is especially egregious.

When you're feeling old, reading Tennyson can improve your outlook.

Like complaining about saucy language in Sodom and Gomorrah

Here's an idea for a novel: in a dystopian future/alternate history, the country is governed by a totalitarian central government that forces teams of teenagers to battle to the death in an annual televised event. In the hands of competent writer it's a premise that could generate plenty of drama and suspense and it has highly cinematic elements.

I'll get back to that idea in a minute but first I want to direct your attention to this recent post by Andrew Gelman. Go ahead, take a look. I'll wait...

There are a number of things to discuss here but let's start with this assertion quoted by Gelman:

“The essence of plagiarism is passing off someone else’s work as your own."

This nicely catches the stark moral terms that we often see in this debate, but when look at this more closely, particularly when we look at what's entailed in different types of plagiarism and the reactions to those types, the picture is a bit murkier.

Let's go back to the idea from the top of the page and fantasy stories about young adults. Back in the mid-Nineties, J.K. Rowling came up with the inspired notion of combining the two great traditions of British juvenile literature. The concept and Rowling's skillful execution produced the enormously successful Harry Potter and the Philosopher's Stone.

Rowling's success was followed by a wave of science fiction and fantasy novels aimed at the young adult market. These included Percy Jackson, the Lorien Legacies (co-written by the disgraced James Frey), Gregor the Overlander, and, of course, Twilight and the Hunger Games.

But one thing Rowling's success didn't inspire was the idea I mentioned at the top. That one came from a Japanese writer who used it for a novel written in 1996 and published in 1999 under the name Battle Royale,

The book and the movie that followed a year later were huge international hits. Despite the somewhat disturbing subject matter, both generally received positive reviews. Here's the Guardian in 2001, "Some will find the explicit violence of this movie repulsive - or plain boring. But this is a film put together with remarkable confidence and flair. Its steely candour, and weird, passionate urgency make it compelling." And Stephen King, writing in Entertainment Weekly (February 1, 2007) gave the book an enthusiastic endorsement (while noting it had some elements in common with his novel The Long Walk).

A little bit more than a year and a half later, Scholastic published the Hunger Games.

Given the number of blogs by fans of science fiction and Japanese popular culture, it's not surprising that the resemblance was discussed at some length.

From Wikipedia:

The 2008 American young adult novel The Hunger Games by Suzanne Collins has been accused of being strikingly similar to Battle Royale in terms of the basic plot premise and the world within the book. While Collins maintains that she "had never heard of that book until her book was turned in", Susan Dominus of The New York Times reports that "the parallels are striking enough that Collins's work has been savaged on the blogosphere as a baldfaced ripoff," but argued that "there are enough possible sources for the plot line that the two authors might well have hit on the same basic setup independently."

That "might well have" is an awfully weak defense (particularly given the puff piece tone of the NYT article) and it points to one of the central problems in the plagiarism debate: while it's easy to prove the relatively trivial crime of lifting wording, it's next to impossible to prove more substantial thefts. We can look at the timeline. We can look at Collins' previous career as a writer of fairly derivative kids' shows (no Spongebob or Pete & Pete) and the author of the Underworld books (a series that bears a marked resemblance to Harry Potter). Nothing here gives us any reason to believe that she didn't steal the idea but also nothing that could be called evidence that she did.

This is not meant as an attack on Collins who is, as far as I can tell, an excellent writer and who is doing a wonderful job getting kids to read. I'm in favor of what she's doing and I couldn't care less how she does it.

My point is that the theft of wording -- a problem that is both trivial and rare, but easy to prove -- is treated as a major offence while stealing more substantial elements -- a problem that is both serious and common, but is hard to prove -- is largely ignored.

If we truly want to embrace the inclusive definition of plagiarism we quickly ourselves in the uncomfortable position of pointing out the extensive lapses of friends and colleagues rather than the failings of a few convenient pariahs.

If we're going to be anywhere near consistent and proportional, we're going to have to ask ourselves whose names really belong on a research paper. I can think of at least one case where the credit was given to someone who happened to be the spouse of the main researcher's thesis advisor (the valid reasons for being listed as an author do not include marrying well). If you didn't substantially contribute to the research behind or the writing of a paper and you put your name to it, you're a plagiarist.

And we need to ask ourselves how much journalism consists of simply paraphrasing and regurgitating other people's ideas, arguments and interpretations. When you hear someone talking about a meme, they actually mean that stories are being borrowed and recycled on a massive scale.

Discouraging plagiarism in the broad sense is a worthy goal, but focusing exclusively on those few people who lift some phrases from other published work is simply a distraction.

Job cuts in science

From Alyssa:

. . . last week, the Government of Canada announced that thousands of public service jobs will be cut. This includes a10% budget cut at the Canadian Space Agency (CSA).* Their budget is about $300 million (paltry compared to NASA's budget of about $20 billion - clearly not scaled by population), so cutting 10% is pretty huge. So, apparently the decision was made to completely abolish the CSA Space Awareness & Learning program - the program that funds 100% of my salary.
We have one more year on our grant. We're hoping that they'll make good on all their current grants and contracts - but looking at our contract with the CSA, it clearly states that they are entitled to change/cancel grants if the federal budget changes.
So, here's where I start preparing for any number of possibilities, from best- to worst-case scenario:
1. The last year of our grant comes through, and we have a year to come up with other funding sources.
2. The last year of our grant doesn't come through, but we find another source of funding. Depending on the source, this could be a short- or long-term solution, and could potentially mean a pay cut.
3. The last year of our grant doesn't come through, and we can't find another source of funding. I am out of a job. We have to pull Evan out of daycare. We can live on DH's salary alone if we cut back slightly on our spending, but we would not be able to do anything else. I have to find another job.

This is a really good (and actually Canadian) example of how austerity economics cause trouble during a recession.  Right now, unemployment rates are high.  This makes it a bad time to decide to cut programs.  In good times, the elimination of a government program would lead people to retool themselves for the public sector.  In a recession, it merely increases the overall level of hardship without people being easily able to find new employment.

What I found most interesting about this situation is that the person in question was funded on short-term rotating grant funding.  This is not the sort of high-security and extensive benefits type of work that is at the center of the public debate.  Instead, it is a PhD level educated person who is being funded entirely through a competitive mechanism.  So it is hard to imagine that the person in question isn't working very hard (I know I did under this sort of funding).

Perhaps now is not the ideal moment to reconsider precisely which government workers need to be re-purposed.  Maybe we could wait for the glut among the unemployed to pass?

Derivative originality -- the paradox of Harry Potter

Another lemma post (but at least it's the last in the series) in support of a longer piece I'm working on. The topic of that one is going to be plagiarism which leads naturally to the topic of originality, and since the post will involve Harry Potter/Twilight/Hunger Games, I thought I should address the question of J.K. Rowling's originality in advance.

Stephen King has said that Rowling is a terrific writer and I'm fully prepared to bow to his judgement, but it's possible for a writer to be good without being original and original without being otherwise good. Rowling built Harry Potter around an extraordinarily original idea working with parts that were almost completely derivative.

Let's start with the parts.

You could argue that there are two distinctly British traditions of coming-of-age novels: the Arthurian (think the Sword in the Stone) and the school story. The best known example of the latter is Tom Brown's School Days; the best is Mike. Both genres are uniquely tied to British character and culture but, as far as I know, no one saw how fundamentally similar they were until Rowling came along.

You can see that underlying similarity of the two genres (and Rowling's skill at combining them) by imagining the Harry Potter and the Philosopher's Stone first with the fantasy elements removed, then with the public school elements removed. The results would be, respectively, a conventional school novel and a conventional juvenile fantasy novel, but they would both be basically the same story. Most of the characters and the majority of the plot work equally well in both genres.

To see connections between seemingly disparate elements and to find a way to bring them together in a coherent whole is pretty much the soul of originality, even those elements are old and familiar and worn smooth with use. This is in sharp contrast to most of the writers in the upcoming post.

Quote of the week

From NPR:

"Blowing up carcasses is a little bit of an inexact science."

Out of town

I will be at a conference for the next four days.  Posting may be lighter than usual.

Is working through school still a viable plan?

Prices have risen for education in the past thirty years:

Representative Foxx would have paid $279 for the academic year—about $2,140 today. That’s about equivalent to what students pay right now at community colleges, not public four-year institutions—especially not public flagships.  

In-state students at Representative Foxx’s alma mater pay $7,008—more than three times what Foxx paid. It took Foxx seven years to graduate, probably because she was working to put herself through college. During the 7-year period she was at UNC, tuition and fees increased about 0.6 percent per year. Compare that to UNC students who have seen their tuition and fees increase on average 7.2 percent per year since 2005. UNC students who take fewer classes in order to subsidize their tuition through work have found themselves in a losing battle with steep tuition increases.  

They have also come up against work that pays less and less. When Representative Foxx was working her way through college, the minimum wage was worth about $9.62 in today’s dollars. Today’s students who work minimum wage jobs earn about 30 percent less per hour while paying much more in tuition. If Representative Foxx worked 20 hours a week for an entire year during her time at UNC, she would have made approximately $9,795 before taxes, which would probably cover her entire cost of attendance. Using the same calculation, a student today working 20 hours a week for an entire year would make $7,176. This would barely cover tuition and fees. It wouldn’t even make a dent in the estimated full cost of attendance of $20,660. Indeed, if a student worked 40 hours a week, a situation not feasible for a full-time student, he would only net $14,352—still leaving a considerable gap. That gap is exactly where student loans have come into play.

 I think that this (long) piece illustrates a few things (and neglects how the difference in costs for state schools is heavily driven by less state support for higher education).  One, is that there is a huge difference between $2,000 year (five years of school = $10,000 in tuition) which leaves manageable levels of debts (as I have seen people pay off $10,000 in debt).  Two, the return on unskilled labor continues to drop. 

The drop in unskilled labor compensation have two syngeristic effect.  First, they make working one's way through school even less viable.  Second, they make the opportunity cost of not getting a degree much higher.  When you couple this loss of value of unskilled labor with a dramatic rise in tuition, the real story seems to be that the rational choice seems to be to focus on being successful in school (to rise your eventual market wage) and give up on working.

This is not, as Representative Foxx seems to suggest, a loss of virtue among the youth of today.  Instead it is the best strategy available (among a set of bad strategies).  However, it is also predicated on having good information on the real value of special educational pathways.  Since guessing the job market in four years is always a "crap shoot", it just about guarentees a certian proportion of students will end up with a lot of debt and no way to pay it back. 

Most of this problem could be fixed on the tuition side as it is clearly the larger problem.  If state schools cost 2000/year and tuition was stable then working one's way through school would make a lot more sense.