A Tale of Three Cities

This is kind of a WitCH, but there’s plenty of non-crap as well. It is also properly a tale of two states and a planet, but the title was difficult to resist.

A few months ago a teacher-reader sent me three recent assessment questions from three different sources: NSW’s HSC Extension 2 Exam, the World’s IB Higher Level Analysis Exam, and Victoria’s VCE Specialist Mathematics Sample Assessment Tasks (SACs). All three questions involve integrating functions of the form \boldsymbol{x^ne^{kx}}, and the teacher-reader had suggested that there was a smell of plagiarism about it all. We weren’t convinced of that; the functions are very natural fodder for senior mathematics questions, and if there is arguably some borrowing, it is definitely not a Harvard standard of plagiarism. Indeed, the three questions are notably different in, um, style. That seemed worthy of a post.

Here are the three questions. Readers can have at it. Continue reading “A Tale of Three Cities”

Gaming the Mathematics Exams in 1903

Trying to understand when and how Victorian maths education went so wrong has led us down some pretty obscure rabbit holes. A very helpful guide to this warren is Ken Clements and, in particular, Clements’ interesting and interestingly slanted history of Victorian school mathematics, Mathematics for the Minority. Pictured above is one of the rabbits (so to speak). Continue reading “Gaming the Mathematics Exams in 1903”

Unbowed

One of the movies that didn’t make it into Math Goes to the Movies, appearing just too late, is the 2011 Korean drama, Unbowed. The movie is a legal drama about a mathematics professor and contains almost no mathematics. But mathematics underlies the story, which begins with the professor finding an error in his university’s entrance exam, and with his mathematics department’s reaction: Continue reading “Unbowed”

Further Exams and Further Errors

By overwhelming demand,* we have decided, much belatedly, to put up a post for discussion of the 2021 Further Mathematics exams. We have no particular plans to update this post, although we will do so if anything of interest arises. We’ll just note the two excerpts below, from Exam 2, the first of which is discussed here, at 5:30. Thanks to Simon and SRK to bringing these to our attention.**

Continue reading “Further Exams and Further Errors”

Untried Methods

We’re sure we’ll live to regret this post, but yesterday’s VCE Methods Exam 1 looked like a good exam.

No, that’s not a set up for a joke. It actually looked like a nice exam. (It’s not online yet. Update: Now online.). Sure, there were some meh questions, the inevitable consequence of an incompetent study design. And yes, there was a minor Magritte aspect to the final question. And yes, it’s much easier to get an exam right if it’s uncorrupted by the idiocy of CAS, with the acid test being Exam 2. And yes, we could be plain wrong; we only gave the exam a cursory read, and if there’s a dodo it’s usually in the detail.

But for all that the exam genuinely looked good. The questions in general seemed mathematically natural. A couple of the questions also appeared to be difficult in a good, mathematical way, rather than in the familiar “What the Hell do they want?” manner.

What happened?

 

Inferiority Complex

This one is long, a real Gish gallop. Question 4, Part 2 from the 2017 VCE Specialist Mathematics Exam 2 is a mess. The Examiners’ Report is, predictably, worse.

Part (a) of Question 4 is routine, requiring students to express {-2-2\sqrt{3}i} in polar form. One wonders how a quarter of the students could muck up this easy 1-mark question, but the question is fine.

The issues begin with 4(b), for which students are required to

Show that the roots of \color{red}\boldsymbol{z^2 + 4z + 16 = 0}} are {\color{red} \boldsymbol{z=-2-2\sqrt{3}i}} and \boldsymbol{\color{red}{z=-2+2\sqrt{3}i}}.

The question can be answered with an easy application of completing the square or the quadratic formula. So, why did almost half of the students get it wrong? Were so many students really so clueless? Perhaps, but there is good reason to suspect a different source of the cluelessness.

The Examiners’ Report indicates three general issues with students’ answers. First,

students confused factors with solutions or did not proceed beyond factorising the quadratic.

Maybe the students were confused, but maybe not. Maybe some students simply thought that, once having factorised the quadratic, the microstep to then write “Therefore z = …”, to note the roots written on the exam in front of them, was too trivial in response to a 1 mark question.

Second, some students reportedly erred by

not showing key steps in their solution.

Really? The Report includes the following calculation as a sample solution:

\color{blue} \boldsymbol{z = \frac{-4\pm \sqrt{4^2 \ - \ 4 \times 1 \times 16}}{2}=\frac{-4\pm \sqrt{-48}}{2}=\frac{-4\pm 4\sqrt{3}i}{2} = -2\pm2\sqrt{3}i\, .}

Was this whole tedious, snail-paced computation required for one measly mark? It’s impossible to tell, but the Report remarks generally on ‘show that’ questions that

all steps that led to the given result needed to be clearly and logically set out.

As we have noted previously, demanding “all steps” is both meaningless and utterly mad. For a year 12 advanced mathematics student the identification of the roots is pretty much immediate and a single written step should suffice. True, in 4(b) students are instructed to “show” stuff, but it’s hardly the students’ fault that what they were instructed to show is pretty trivial.

Third, and by far the most ridiculous,

some students did not correctly follow the ‘show that’ instruction … by [instead] solely verifying the solutions given by substitution.

Bullshit.

VCAA examiners love to worry that word “show”. In true Princess Bride fashion, however, the word does not mean what they think it means.

There is nothing in standard English usage nor in standard mathematical usage, nor in at least occasional VCE usage (see Q2(a)), that would distinguish “show” from “prove” in this context. And, for 4(b) above, substitution of the given values into the quadratic is a perfectly valid method of proving that the roots are as indicated.

It appears that VCE has a special non-English code, in which “show” has a narrower meaning, akin to “derive“. This cannot alter the fact that the VCE examiners’ use of the word is linguistic and mathematical crap. It also cannot alter the fact that students being penalised for not following this linguistic and mathematical crap is pedagogical and mathematical crap.

Of course all the nonsense of 4(b) could have been avoided simply by asking the students to find the roots. The examiners declined to do so, however, probably because this would have violated VCAA’s policy of avoiding asking any mathematical question with some depth or difficulty or further consequence. The result is a question amounting to no more than an infantile and infantilising ritual, penalising any student with the mathematical common sense to answer with the appropriate “well, duh”.

***************************

Onwards we trek to 4(c):

Express the roots of \color{red} \boldsymbol{z^2 + 4z + 16 = 0}} in terms of  \boldsymbol{{\color{red}   2 -2\sqrt{3}i}}.

Less than a third of students scored the mark for this question, and the Report notes that

Misunderstanding of the question was apparent in student responses. Many attempts at solutions were not expressed in terms of  {\color{blue} \boldsymbol{2 -2\sqrt{3}i}} as required.

Funny that. The examiners pose a question that borders on the meaningless and somehow this creates a sea of misunderstanding. Who would’ve guessed?

4(c) makes little more sense than to ask someone to write 3 in terms of 7. Given any two numbers there’s a zillion ways to “express” one number “in terms of” the other, as in 3 = 7 – 4 or whatever. Without further qualification or some accepted convention, without some agreed upon definition of “expressed in terms of”, any expression is just as valid as any other.

What was expected in 4(c)? To approach the question cleanly we can first set w = 2 - 2\sqrt{3}i, as the examiners could have and should have and did not. Then, the intended answers were -w and -\overline{w}.

These expressions for the roots are simple and natural, but even if one accepts a waffly interpretation of 4(c) that somehow requires “simple” solutions, there are plenty of other possible answers. The expressions w-4 and \overline{w-4} and w^2/4 and w^4/|w|^3 are all reasonable and natural, but nothing in the Examiners’ Report suggests that these or similar answers were accepted. If not, that is a very nasty cherry on top of an incredibly silly question.

***************************

The pain now temporarily lessens (though the worst is yet to come). 4(d) asks for students to show that the relation |z| = |z - (2-2\sqrt{3}i)| has the cartesian form x-\sqrt{3}y - 4 = 0, and in 4(e) students are asked to draw this line on an Argand diagram, together with the roots of the above quadratic.

These questions are routine and ok, though 4(d) is weirdly aimless, the line obtained playing no role in the final parts of Q4. The Examiners’ Report also notes condescendingly that “the ‘show that’ instruction was generally followed”. Yes, people do tend to follow the intended road if there’s only one road.

The final part, 4(g), is also standard, requiring students to find the area of the major segment of the circle |z| = 4 cut off by the line through the roots of the quadratic. The question is straight-forward, the only real trick being to ignore the weird line from 4(d) and 4(e).

***************************

Finally, the debacle of 4(f):

The equation of the line passing through the two roots of {\color{red} \boldsymbol{z^2 + 4z + 16 = 0}} can be expressed as {\color{red} \boldsymbol{|z-a| = |z-b|}}, where \color{red}\boldsymbol{a, b \in C}. Find \color{red}\boldsymbol{b} in terms of \color{red}\boldsymbol{a}.

The Report notes that

This question caused significant difficulty for students.

That’s hilarious understatement given that 99% of students scored 0/1 on the question. The further statements acknowledging and explaining and apologising for the stuff-up are unfortunately non-existent.

So, what went wrong? The answer is both obvious and depressingly familiar: the exam question is essentially meaningless. Students failed to comprehend the question because it is close to incomprehensible.

The students are asked to write b in terms of a. However, similar to 4(c) above, there are many ways to do that and how one is able to do it depends upon the initial number a chosen. The line through the two roots has equation \operatorname{Re} z = x = -2. So then, for example, with a = -4 we have b = 0 and we can write b = a + 4 or b = 0 x a or whatever. If a = -5 then b = 1 and we can write b = -a – 4, and so on.

Anything of this nature is a reasonable response to the exam question as written and none of it resembles the answer in the Report. Instead, what was expected was for students to consider all complex numbers a – except those on the line itself – and to consider all associated complex b. That is, in appropriate but non-Specialist terminology, we want to determine b as a function f(a) of a, with the domain of f being most but not all of the complex plane.

With the question suitably clarified we can get down to work (none of which is indicated in the Report). Easiest is to write a = (-2+c) + di. Since b must be symmetrically placed about the line \operatorname{Re} z = -2, it follows that b = (-2-c) + di. Then b+2 = -c + di = -\overline{(a+2)}. This gives b = -2 - \overline{(a + 2)}, and finally

\color{blue}\boldsymbol{b = -4 -\overline{a}\, ,}

which is the answer indicated in the Examiners’ Report.

In principle 4(f) is a nice question, though 1 mark is pretty chintzy for the thought required. More importantly, the exam question as written bears only the slightest resemblance to the intended question, or to anything coherent, with only the slightest, inaccurate hint of the intended generality of a and b.

99% of 2017 Specialist students have a right to be pissed off.

***************************

That’s it, we’re done. One more ridiculous VCE exam question, and one more ridiculously arrogant Report, unsullied by an ounce of self-reflection or remorse.

The Arc Enemy

Our previous post was on good guys making a silly, funny and inconsequential mistake. This post is not.

Question B1 of Exam 2 for 2018 Northern Hemisphere Specialist Mathematics begins innocently enough. In part (a), students are required to graph the function \boldsymbol{f(x) = 10\arccos(2-2x)} over its maximal domain. Then, things begin to get stupid.

In part (b), the graph of f is rotated around the y-axis, to model a vase. Students are required to find the volume of this stupid vase, by setting up the integral and then pushing the stupid buttons on their stupid calculators. So, a reasonable integration question lost in ridiculous pseudomodelling and brainless button-pushing. Whatever. Just standard VCE crap. Then, things stay stupid.

Part (c) is a related rates question. In principle a good problem, though it’s hard to imagine anyone ever requiring dh/dt when the water depth is exactly \boldsymbol{5\pi} cm. Whatever. Standard VCE crap. Then, things get really, really stupid.

Part (d) of the problem has a bee climbing from the bottom of the vase to the top. Students are required to find the minimum distance the bee needs to travel.

Where to begin with this idiotic, 1-mark question. Let’s begin with the bee.

Why is it a bee? Why frame a shortest walk question in terms of a bug with wings? Sure, the question states that the bug is climbing, and the slight chance of confusion is overshadowed by other, much greater issues with the question. But still, why would one choose a flying bug to crawl up a vase? It’s not importantly stupid, but it is gratuitously, hilariously stupid.

Anyway, we’re stuck with our stupid bee climbing up our stupid vase. What distance does our stupid bee travel? Well, obviously our stupid, non-flying bee should climb as “up” as possible, without veering left or right, correct?

No and yes.

It is true that a bottom-to-top shortest path (geodesic) on a surface of revolution is a meridian. The proof of this, however, is very far from obvious; good luck explaining it to your students. But of course this is only Specialist Mathematics, so it’s not like we should expect the students to be inquisitive or critical or questioning assumptions or anything like that.

Anyway, our stupid non-flying bee climbs “up” our stupid vase. The distance our stupid bee travels is then the arc length of the graph of the original function f, and the required distance is given by the integral

    \[\boldsymbol{{\Huge \int\limits_{\frac12}^{\frac32}}\sqrt{1+\left[\tfrac{20}{1 - (2-2x)^2}\right]^2}}\ {\bf d}\boldsymbol{x}\]

The integral is ugly. More importantly, the integral is (doubly) improper and thus has no required meaning for Specialist students. Pretty damn stupid, and a stupidity we’ve seen not too long ago. It gets stupider.

Recall that this is a 1-mark question, and it is clearly expected to have the stupid calculator do the work. Great, sort of. The calculator computes integrals that the students are not required to understand but, apart from being utterly meaningless crap, everything is fine. Except, the calculators are really stupid.

Two brands of CAS calculators appear to be standard in VCE. Brand A will readily compute the integral above. Unfortunately, Brand A calculators will also compute improper integrals that don’t exist. Which is stupid. Brand B calculators, on the other hand, will not directly compute improper integrals such as the one above; instead, one first has to de-improper the integral by changing the limits to something like 0.50001 and 1.49999. Which is ugly and stupid. It also requires students to recognise the improperness in the integral, which they are supposedly not required to understand. Which is really stupid. (The lesser known Brand C appears to be less stupid with improper integrals.)

There is a stupid way around this stupidity. The arc length can also be calculated in terms of the inverse function of f, which avoid the improperness and then all is good. All is good, that is, except for the thousands of students who happen to have a Brand B calculator and who naively failed to consider that a crappy, 1-mark button-pushing question might require them to hunt for a Specialist-valid and B-compatible approach.

The idiocy of VCE exams is truly unlimited.

Inverted Logic

The 2018 Northern Hemisphere Mathematical Methods exams (1 and 2) are out. We didn’t spot any Magritte-esque lunacy, which was a pleasant surprise. In general, the exam questions were merely trivial, clumsy, contrived, calculator-infested and loathsomely ugly. So, all in all not bad by VCAA standards.

There, was, however, one notable question. The final multiple choice question on Exam 2 reads as follows:

Let f be a one-to-one differentiable function such that f (3) = 7, f (7) = 8, f′(3) = 2 and f′(7) = 3. The function g is differentiable and g(x) = f –1(x) for all x. g′(7) is equal to …

The wording is hilarious, at least it is if you’re not a frazzled Methods student in the midst of an exam, trying to make sense of such nonsense. Indeed, as we’ll see below, the question turned out to be too convoluted even for the examiners.

Of course –1 is a perfectly fine and familiar name for the inverse of f. It takes a special cluelessness to imagine that renaming –1 as g is somehow required or remotely helpful. The obfuscating wording, however, is the least of our concerns.

The exam question is intended to be a straight-forward application of the inverse function theorem. So, in Leibniz form dx/dy = 1/(dy/dx), though the exam question effectively requires the more explicit but less intuitive function form, 

    \[\boldsymbol {\left(f^{-1}\right)'(b) = \frac1{f'\left(f^{-1}(b)\right)}}.}\]

IVT is typically stated, and in particular the differentiability of –1 can be concluded, with suitable hypotheses. In this regard, the exam question needlessly hypothesising that the function g is differentiable is somewhat artificial. However it is not so simple in the school context to discuss natural hypotheses for IVT. So, underlying the ridiculous phrasing is a reasonable enough question.

What, then, is the problem? The problem is that IVT is not explicitly in the VCE curriculum. Really? Really.

Even ignoring the obvious issue this raises for the above exam question, the subliminal treatment of IVT in VCE is absurd. One requires plenty of inverse derivatives, even in a first calculus course. Yet, there is never any explicit mention of IVT in either Specialist or Methods, not even a hint that there is a common question with a universal answer.

All that appears to be explicit in VCE, and more in Specialist than Methods, is application of the chain rule, case by isolated case. So, one assumes the differentiability of –1 and and then differentiates –1(f(x)) in Leibniz form. For example, in the most respected Methods text the derivative of y = log(x) is somewhat dodgily obtained using the chain rule from the (very dodgily obtained) derivative of x = ey.

It is all very implicit, very case-by-case, and very Leibniz. Which makes the above exam question effectively impossible.

How many students actually obtained the correct answer? We don’t know since the Examiners’ Report doesn’t actually report anything. Being a multiple choice question, though, students had a 1 in 5 chance of obtaining the correct answer by dumb luck. Or, sticking to the more plausible answers, maybe even a 1 in 3 or 1 in 2 chance. That seems to be how the examiners stumbled upon the correct answer.

The Report’s solution to the exam question reads as follows (as of September 20, 2018):

f(3) = 7, f'(3) = 8, g(x) = f –1(x) , g‘(x) = 1/2 since

f'(x) x f'(y) = 1, g(x) = f'(x) = 1/f'(y).

The awfulness displayed above is a wonder to behold. Even if it were correct, the suggested solution would still bear no resemblance to the Methods curriculum, and it would still be unreadable. And the answer is not close to correct.

To be fair, The Report warns that its sample answers are “not intended to be exemplary or complete”. So perhaps they just forgot the further warning, that their answers are also not intended to be correct or comprehensible.

It is abundantly clear that the VCAA is incapable of putting together a coherent curriculum, let alone one that is even minimally engaging. Apparently it is even too much to expect the examiners to be familiar with their own crappy curriculum, and to be able to examine it, and to report on it, fairly and accurately.

VCAA Plays Dumb and Dumber

Late last year we posted on Madness in the 2017 VCE mathematics exams, on blatant errors above and beyond the exams’ predictably general clunkiness. For one (Northern Hemisphere) exam, the subsequent VCAA Report had already appeared; this Report was pretty useless in general, and specifically it was silent on the error and the surrounding mathematical crap. None of the other reports had yet appeared.

Now, finally, all the exam reports are out. God only knows why it took half a year, but at least they’re out. We have already posted on one particularly nasty piece of nitpicking nonsense, and now we can review the VCAA‘s own assessment of their five errors:

 

So, the VCAA responds to five blatant errors with five Trumpian silences. How should one describe such conduct? Unprofessional? Arrogant? Cowardly? VCAA-ish? All of the above?

 

Little Steps for Little Minds

Here’s a quick but telling nugget of awfulness from Victoria’s 2017 VCE maths exams. Q9 of the first (non-calculator) Methods Exam is concerned with the function

    \[\boldsymbol {f(x) = \sqrt{x}(1-x)\,.}\]

In Part (b) of the question students are asked to show that the gradient of the tangent to the graph of f” equals \boldsymbol{ \frac{1-3x}{2\sqrt{x}} } .

A normal human being would simply have asked for the derivative of f, but not much can go wrong, right? Expanding and differentiating, we have

    \[\boldsymbol {f'(x) = \frac{1}{2\sqrt{x}} - \frac32\sqrt{x}=\frac{1-3x}{2\sqrt{x}}\,.}\]

Easy, and done.

So, how is it that 65% of Methods students scored 0 on this contrived but routine 1-point question? Did they choke on “the gradient of the tangent to the graph of f” and go on to hunt for a question written in English?

The Examiners’ Report pinpoints the issue, noting that the exam question required a step-by-step demonstration …. And, [w]hen answering ‘show that’ questions, students should include all steps to demonstrate exactly what was done (emphasis added). So the Report implies, for example, that our calculation above would have scored 0 because we didn’t explicitly include the step of obtaining a common denominator.

Jesus H. Christ.

Any suggestion that our calculation is an insufficient answer for a student in a senior maths class is pedagogical and mathematical lunacy. This is obvious, even ignoring the fact that Methods questions way too often are flawed and/or require the most fantastic of logical leaps. And, of course, the instruction that “all steps” be included is both meaningless and utterly mad, and the solution in the Examiners’ Report does nothing of the sort. (Exercise: Try to include all steps in the computation and simplification of f’.)

This is just one 1-point question, but such infantilising nonsense is endemic in Methods. The subject is saturated with pointlessly prissy language and infuriating, nano-step nitpicking, none of which bears the remotest resemblance to real mathematical thought or expression.

What is the message of such garbage? For the vast majority of students, who naively presume that an educational authority would have some expertise in education, the message is that mathematics is nothing but soulless bookkeeping, which should be avoided at all costs. For anyone who knows mathematics, however, the message is that Victorian maths education is in the clutches of a heartless and entirely clueless antimathematical institution.