After a couple of posts whacking teachers’ involvement in VCE exams, it seems only fair to tell a story about a university exam debacle.
Once upon a time, about eighty years ago, I was a PhD student at a pretty good American university. Let’s call it Stanford. As part of the scholarship, PhD students were required to assist with the undergraduate teaching, which was a plus. The teaching was not onerous or overly time consuming and, unsurprisingly, the Stanford undergraduates were excellent students. Even the humanities students, reluctantly completing their “math requirement” and typically weak in maths, were smart and had a good work ethic.
The first year mathematics was taught in bulk at both the slower, “humanities” level and at the faster, “science” level. This faster level, for a couple hundred students, was a solid first year calculus course, taught from one of the very good monster texts: Edwards and Penney, when I was there. There were five lectures a week, three from the main lecturer with the students altogether, and two sessions with the undergrads split off into smaller groups led by us PhD students. These smaller groups were not that small – 30 to 40 in a class – and the sessions were still very lecturey: new material had to be covered, albeit not as densely as in the main lectures. There was decent space for back and forth and, once one was experienced enough to not be scared to death, the sessions were a lot of fun.
The lecturers in these subjects tended to be the younger academics, post-docs and the like, rather than the tenured or tenure-track staff. So, they were not the Stanford elite, but they were there for a reason and tended to be very smart guys. They also tended to be good guys; they were younger, not sure of their future and had natural empathy with we very unsure PhD students. One term, however, there was an exception.
I have no idea where “Bill” came from but he was a complete screw-up. Bill was a Grateful Dead fan, which was no big deal. Bill also appeared to be tripping a lot of the time, and even that wasn’t that big a deal. This was California after all.1 And it was not like we were prudes or untarnished innocents. It was broadly, sensibly accepted that what mattered was doing your job properly. Bill didn’t.
Bill seldom finished the lecture content. According to the undergrads, he chatted away in the lectures about this and that. Which can be a good thing: lectures are theatre and engaging with students, backing and forthing, is a way to make the lectures fun and to make the subject alive and meaningful, particularly if such exchanges are conducted with purpose and thoughtful control. But, notwithstanding the value of ad libbing, there is still a script and the lecturer has to pay attention to it. If your lecture finishes with a critical example half-done or not begun at all then you’ve screwed up. Which Bill did, repeatedly. But not to worry: the PhD students could make up for the missing content in their sessions, which, every week, Bill demanded we do.
Of course this was exhausting and infuriating. We had our own material to cover, as well as trying to inject a proper tutorish element to the sessions, allowing extended discussions on points of concern. Bill was also nasty about it. If we objected that we had no time to cover the extra material, if we suggested to cut short aspects of the material or to have him make up the time, he would boom as Lord Lecturer that we had to do what he said.
Bill was a screw-up and an asshole and the undergrads also knew it. They were remarkably understanding, and we all suffered through it together. But then, at the end of term, the final exam had to be written, with zero interest or energy with which to write it. It went as well as might be expected.
Exams for these subjects were always written pretty quickly and efficiently, with everyone bringing questions or ideas for questions and then hammering it out together. There were drafts and proofreading, but not to the nth degree, and minor typos and errors were not uncommon. These were easily sorted out during the exam; lecturers proctored the exams themselves, so if and when a student raised a valid issue it was announced to the entire theatre and the correction written on the blackboard at the front. The system typically worked well, without driving anyone nuts. Not with Bill.
The exam meeting began with Bill suggesting something for the Lagrange multipliers topic, a story question on buying tickets for a Grateful Dead concert. It was appalling. There’s nothing intrinsically wrong, of course, with such a story framing and maybe buried inside Bill’s story there was a decent mathematical question, but none of us could see it. The thing was so self indulgent and clumsy and over-cute and over-egged, we PhD students quickly and unanimously vetoed it. Bill couldn’t overrule this unanimity but he was really pissed off. Bill’s contribution for the rest of the meeting consisted of sulking back in his chair and muttering “Yeah, whatever”.2
We PhD students did our best and cobbled together an exam, but our best was very bad. We were in no frame of mind to concentrate in the required manner, so the questions were thoughtless and pedestrian, and were quickly checked but no more. And someone came up with the rocket question. I remember it as a “rocket”, although the question was supposed to be pretty standard projectile motion. I don’t remember who came up with the question, quite possibly me, but I remember feeling there was something not right about it. But, like all of us, I was too tired and disillusioned to put my mind to it. Until the exam.
Bill was absent for the exam, of course, with three or four of us PhD students around to proctor. All went fine, for about fifteen minutes. Then a student came out, asking about the rocket question. The equation of motion for which, he noted, contained a +t2 term. Which meant that the rocket was burrowing parabolically into the ground before emerging into the air.
Having drawn the short straw, Marty went to the front of the theatre to announce the screw-up to the students. Which was met with the predictable disbelief and laughter. I wrote the correction on the blackboard, to treat the rocket equation as a given. The bemused students got on with it, finding the time when the rocket sprang free from the Earth, and the exam went on fine. For about ten minutes.
Then another student came out, flagging another error. Not as bad as the miracle rocket, but an error is an error and Short Straw Marty went out again, to announce and to write up the new error. Then there was another error. And another.
I can’t remember how many errors there were by the end of the exam, maybe half a dozen or so. It was absurd and embarrassing, of course. Although, for all that, the exam functioned well enough for its purpose. With all the students in the one place, and with us proctors also being the graders, we could be human about the real-time exam adjustment and we could be human about the subsequent grading. A million miles from perfect but the damage control for a one-location exam for a few hundred is very different from that for a statewide exam for thousands.
That’s basically the end of the story. Some Stanford lecturers, who were aware of Bill’s screwing up, took us PhD students out for a sorry-and-thank-you beer. Bill did not reappear next term. And of course I learned my lesson and I’ve never again made an error in writing a mathematics exam.3
1. My first and very stressful PhD “Qual” exam was taken with the Stanford Marching Band blasting their excellent rendition of The Tubes’ excellent White Punks on Dope just outside the exam room. You got used to these things.
2. Soon after, a friend, also a Deadhead, noticed that Bill had whined about the veto of his question on a Grateful Dead newsgroup. All the replies were sympathetic, of course, incredulous that we would veto a question simply for being about the Dead. Which was nonsense. We vetoed the question purely and simply because it sucked.
3. This is false, of course. But I really am paranoid about the signs of quadratic terms.
Marty – publish or not, no biggie.
—————
Just for the lolz, here is an exam story. With even less of a point or conclusion than Marty’s.
Twenty-plus years ago, I was working at an upstanding private school in Melbourne. It was fine.
One day, I was walking out of the building after a normal school day, and noticed the head of science working feverishly away at her computer. Conversationally, I asked what she was up to, and she replied that she was writing the science exam for the year 10s. My eyes must have opened wide, because I knew the exam was the next day, and it’s a big deal writing an exam for more than a couple of hundred kids in an upstanding school. The exam should have been done weeks prior, so all the teachers of the subject (I don’t think I was even teaching this subject at the time) could have made sure they’d covered the content.
Anyways, I could tell she was struggling, so I said, “If you’re not coping, call me any time, and I’ll come in and help. 3am, no worries. Or I can stay now.” She assured me she was all fine, so home I went.
And, 4am or something, the phone rings, “Can you possibly come in and give me a hand?” So in I go, typing, editing, adding pictures, and somehow we have a document by 8am. The exam is at 9. Off she goes to the printer to run off 200 copies… and the printer is busted. They end up doing the afternoon’s exam in the morning, and the science exam in the afternoon. The head of science gets called up for a chat with the HeadMaster. I think people look at me as part of the problem, not knowing that I was actually part of the solution.
The two “morals”:
– she never thanked me in any way – surely I was owed (at least) a little whispered, gee, mate, thanks. The next day, there was no mention.
– she ended up working as some kind of higher up in VCAA – I saw her presenting at a conference years later.
And since then, like Marty, I have never been late with anything, or made a mistake with anythign.
Except, that is, for spelling “anything”.
That was an on-purpose joke. Well spotted.
Really? Well done (and funny either way).
I learnt (got burnt. Once.) long ago that in this sort of situation, which rarely ends well due to Murphys Law, there is a continuum of outcomes for the good samaritan:
At best you will get no thanks.
At worst you will get thrown under the bus because the responsible person (in this case the HoD) needs someone to blame.
A valuable lesson.
That is a nice story, very nice, alas not unique. A very similar thing happened to me in PhD days.
Great post Marty. I had to front my class with corrections during our SAC the day I read this post. My first tap dance to fix the question broke another part later on… Assessment writing is hard. Requires great care and effort.
Assessment writing is very very hard. Which is why, for major statewide tests, you have very strong people involved very deeply.
And why it should not be devolved to already over-worked teachers (who my guess is, would rather not do it). An interesting statistic would be the % of SACS that had errors – I reckon it could be pretty high. I very often find errors in my lower high school tests after the fact and I’m not even being asked to set an advanced open-ended papers!
Thanks, JJ. Regarding the VCE exam writing, I assume there are teachers who want to do it, as a way of feeling superior. Regarding SACs, I’m not sure I’ve ever read one that was totally free of errors, and the vast majority I have read had at least one bad error.