WitCH 10: Malfunction

It’s a long, long time since we’ve had a WitCH. They have been not-so-slowly accumulating, however. And now, since we’re temporarily free of the Evil Mathologer, it is the WitCHing hour.

Due mostly to the hard work of Damo, all of the outstanding WitCHes have been resolved, with the exception of WitCH 8. That one will take time: it’s a jungle of half-maths. Our new WitCHes are not so tricky, although there is perhaps more to be said than indicated at first glance.

The first of our new batch of WitCHes is from the VCE 2018 Specialist Exam 1:

The Examiners’ Report gives the answer as \int_0^{\frac34}\left(2-t^2\right)dt. The Report also indicates that the average score on this question was 1.3/5, with 98% of students scoring 3 or lower, and over a third of students scoring 0.

Happy WitCHing.

WitCH 7: North by Southwest

Our new WitCH, below, comes courtesy of Charlie the Enforcer. Once again, this WitCH is from the 2018 SCSA Mathematical Methods Exam (here and here): it’s the gift that keeps on giving. (And a reminder, WitCH 2 and WitCH 3 still require attention are still unresolved.)

Question 11 and the solution in SCSA’s marking key are below. Happy hunting.

Update

John has pretty much caught it all. The killer issue is the use of the term “deceleration” in part (c) which, the solution implies, refers to the drone speeding up in the southerly direction. This is arguably permissible, since deceleration can be (though is far from universally) defined as a negative acceleration, and since way back in part (a) it was implied that North coincides with the positive x direction.

Permissible acts, however, can nonetheless be idiotic: voting Liberal or Republican, for example. And, to use “deceleration” on a high stakes exam to refer implicitly to increasing speed is idiotic. Moreover, to use “deceleration” in this manner immediately after explicitly indicating the “due south” direction of motion is truly ruly idiotic. Still not as idiotic as voting Liberal or Republican, but genuinely special-effort idiotic.

That’s enough to condemn the question, even by SCSA standards. But, the question is also awful in many other ways:

  • The question is boring and butt ugly.
  • No indication is given whether exact or numerical solutions are permitted or required.
  • Having a drone an arbitrary 5m up in the sky for a 1D problem is asking for trouble. For example:
  • The “displacement” of x(0) = 0 for a drone 5m up is pretty stupid.
  • “Where is the drone in relation to the [mysterious] pilot?” Um, kind of uppish?
  • “How far has the drone travelled …” is needlessly wordy and ambiguous. If you want a distance, for God’s sake say “distance”.
  • Given the position function x(t) is at hand, part (c) can easily and naturally be solved by hand. But of course why think about things when you can do mindless calculator crap?

WitCH 5: What a West

This one’s shooting a smelly fish in a barrel, almost a POSWW. Sometimes, however, it’s easier for a tired blogger to let the readers do the shooting. (For those interested in more substantial fish, WitCH 2, WitCH 3 and Tweel’s Mathematical Puzzle still require attention.)

Our latest WitCH comes courtesy of two nameless (but maybe not unknown) Western troublemakers. Earlier this year we got stuck into Western Australia’s 2017 Mathematics Applications exam. This year, it’s the SCSA‘s Mathematical Methods exam (not online. Update: now online here and here.) that wins the idiocy prize. The whole exam is predictably awful, but Question 15 is the real winner:

The population of mosquitos, P (in thousands), in an artificial lake in a housing estate is measured at the beginning of the year. The population after t months is given by the function, \color{blue}\boldsymbol{P(t) = t^3 + at^2 + bt + 2, 0\leqslant t \leqslant 12}.

The rate of growth of the population is initially increasing. It then slows to be momentarily stationary in mid-winter (at t = 6), then continues to increase again in the last half of the year. 

Determine the values of a and b.

Go to it.

Update

As Number 8 and Steve R hinted at and as Damo nailed, the central idiocy concerns the expression “the rate of population growth”, which means P'(t) and which then makes the problem unsolvable as written. Specifically:

  • In the second paragraph, “it” has a stationary point of inflection when t = 6, which is impossible if “it” refers to the quadratic P'(t).
  • On the other hand, if “it” refers to P(t) then solving gives a < 0. That implies P”(0) = 2a < 0, which means “the rate of population growth” (i.e. P’) is initially decreasing, contradicting the first claim of the second paragraph.

The most generous interpretation is that the examiners intended for the population P, not the rate P’, to be initially increasing. Other interpretations are less generous.

No matter the intent, the question is inexcusable. It is also worth noting that even if corrected the question is awful, a trivial inflection problem dressed up with idiotic modelling:

  • Modelling population growth with a cubic is hilarious.
  • Months is a pretty stupid unit of time.
  • The rate of population growth initially increasing is irrelevant.
  • Why is the lake artificial? Who gives a shit?
  • Why is the lake in a housing estate? Who gives a shit?

Finally, it’s “latter half” or “second half”, not “last half”. Yes, with all else awful here, it hardly matters. But it’s wrong.

Further Update

The marking schemes for the exam are now up, here and here.  As was predicted, “the rate of growth of the population” was intended to mean “population”. As is predictable, the grading scheme gives no indication that the question is garbled garbage.

The gutless contempt with which certain educational authorities repeatedly treat students and teachers is a wonder to behold.

A Loss of Momentum

The VCE maths exams are over for another year. They were mostly uneventful, the familiar concoction of triviality, nonsense and weirdness, with the notable exception of the surprisingly good Methods Exam 1. At least two Specialist questions, however, deserve a specific slap and some discussion. (There may be other questions worth whacking: we never have the stomach to give VCE exams a close read.)

Question 6 on Specialist Exam 1 concerns a particle acted on by a force, and students are asked to

Find the change in momentum in kg ms-2 …

Doh!

The problem of course is that the suggested units are for force rather than momentum. This is a straight-out error and there’s not much to be said (though see below).

Then there’s Question 3 on part 2 of Specialist Exam 2. This question is concerned with a fountain, with water flowing in from a jet and flowing out at the bottom. The fountaining is distractingly irrelevant, reminiscent of a non-flying bee, but we have larger concerns.

In part (c)(i) of the question students are required to show that the height h of the water in the fountain is governed by the differential equation 

    \[\boldsymbol{\frac{{\rm d}h}{{\rm d}t} = \frac{4 - 5\sqrt{h}}{25\pi\left(4h^2 + 1\right)}\,.}\]

The problem is with the final part (f) of the question, where students are asked

How far from the top of the fountain does the water level ultimately stabilise?

The question is typical in its clumsy and opaque wording. One could have asked more simply for the depth h of the water, which would at least have cleared the way for students to consider the true weirdness of the question: what is meant by “ultimately stabilise”?

The examiners are presumably expecting students to set dh/dt = 0, to obtain the constant, equilibrium solution (and then to subtract the equilibrium value from the height of the fountain because why not give students the opportunity to blow half their marks by misreading a convoluted question?) The first problem with that is, as we have pointed out before, equilibria of differential equations appear nowhere in the Specialist curriculum. The second problem is, as we have pointed out before, not all equilibria are stable.

It would be smart and good if the VCAA decided to include equilibrium solutions in the Specialist curriculum, along with some reasonable analysis and application. Until they do, however, questions such as the above are unfair and absurd, made all the more unfair and absurd by the inevitably awful wording.

********************

Now, what to make of these two questions? How much should VCAA be hammered?

We’re not so concerned about the momentum error. It is unfortunate, it would have confused many students and it shouldn’t have happened, but a typo is a typo, without deeper meaning.

It appears that Specialist teachers have been less forgiving, and fair enough: the VCAA examiners are notoriously nitpicky, sanctimonious and unapologetic, so they can hardly complain if the same, with greater justification, is done to them. (We also heard of some second-guessing, some suggestions that the units of “change in momentum” could be or are the same as the units of force. This has to be Stockholm syndrome.)

The fountain question is of much greater concern because it exemplifies systemic issues with the curriculum and the manner in which it is examined. Above all, assessment must be fair and reasonable, which means students and teachers must be clearly told what is examinable and how it may be examined. As it stands, that is simply not the case, for either Specialist or Methods.

Notably, however, we have heard of essentially no complaints from Specialist teachers regarding the fountain question; just one teacher pointed out the issue to us. Undoubtedly there were other teachers bothered by the question, but the relative silence in comparison to the vocal complaints on the momentum typo is stark. And unfortunate.

There is undoubted satisfaction in nitpicking the VCAA in a sauce for the goose manner. But a typo is a typo, and teachers shouldn’t engage in small-time point-scoring any more than VCAA examiners.

The real issue is that the current curriculum is shallow, aimless, clunky, calculator-poisoned, effectively undefined and effectively unexaminable. All of that matters infinitely more than one careless mistake.

Update (24/02/19)

The exam Reports are now out, here and here. There’s no stupidity so large or so small that the VCAA won’t remain silent.

Inferiority Complex

This one is long, a real Gish gallop. Question 4, Part 2 from the 2017 VCE Specialist Mathematics Exam 2 is a mess. The Examiners’ Report is, predictably, worse.

Part (a) of Question 4 is routine, requiring students to express {-2-2\sqrt{3}i} in polar form. One wonders how a quarter of the students could muck up this easy 1-mark question, but the question is fine.

The issues begin with 4(b), for which students are required to

Show that the roots of \color{red}\boldsymbol{z^2 + 4z + 16 = 0}} are {\color{red} \boldsymbol{z=-2-2\sqrt{3}i}} and \boldsymbol{\color{red}{z=-2+2\sqrt{3}i}}.

The question can be answered with an easy application of completing the square or the quadratic formula. So, why did almost half of the students get it wrong? Were so many students really so clueless? Perhaps, but there is good reason to suspect a different source of the cluelessness.

The Examiners’ Report indicates three general issues with students’ answers. First,

students confused factors with solutions or did not proceed beyond factorising the quadratic.

Maybe the students were confused, but maybe not. Maybe some students simply thought that, once having factorised the quadratic, the microstep to then write “Therefore z = …”, to note the roots written on the exam in front of them, was too trivial in response to a 1 mark question.

Second, some students reportedly erred by

not showing key steps in their solution.

Really? The Report includes the following calculation as a sample solution:

\color{blue} \boldsymbol{z = \frac{-4\pm \sqrt{4^2 \ - \ 4 \times 1 \times 16}}{2}=\frac{-4\pm \sqrt{-48}}{2}=\frac{-4\pm 4\sqrt{3}i}{2} = -2\pm2\sqrt{3}i\, .}

Was this whole tedious, snail-paced computation required for one measly mark? It’s impossible to tell, but the Report remarks generally on ‘show that’ questions that

all steps that led to the given result needed to be clearly and logically set out.

As we have noted previously, demanding “all steps” is both meaningless and utterly mad. For a year 12 advanced mathematics student the identification of the roots is pretty much immediate and a single written step should suffice. True, in 4(b) students are instructed to “show” stuff, but it’s hardly the students’ fault that what they were instructed to show is pretty trivial.

Third, and by far the most ridiculous,

some students did not correctly follow the ‘show that’ instruction … by [instead] solely verifying the solutions given by substitution.

Bullshit.

VCAA examiners love to worry that word “show”. In true Princess Bride fashion, however, the word does not mean what they think it means.

There is nothing in standard English usage nor in standard mathematical usage, nor in at least occasional VCE usage (see Q2(a)), that would distinguish “show” from “prove” in this context. And, for 4(b) above, substitution of the given values into the quadratic is a perfectly valid method of proving that the roots are as indicated.

It appears that VCE has a special non-English code, in which “show” has a narrower meaning, akin to “derive“. This cannot alter the fact that the VCE examiners’ use of the word is linguistic and mathematical crap. It also cannot alter the fact that students being penalised for not following this linguistic and mathematical crap is pedagogical and mathematical crap.

Of course all the nonsense of 4(b) could have been avoided simply by asking the students to find the roots. The examiners declined to do so, however, probably because this would have violated VCAA’s policy of avoiding asking any mathematical question with some depth or difficulty or further consequence. The result is a question amounting to no more than an infantile and infantilising ritual, penalising any student with the mathematical common sense to answer with the appropriate “well, duh”.

***************************

Onwards we trek to 4(c):

Express the roots of \color{red} \boldsymbol{z^2 + 4z + 16 = 0}} in terms of  \boldsymbol{{\color{red}   2 -2\sqrt{3}i}}.

Less than a third of students scored the mark for this question, and the Report notes that

Misunderstanding of the question was apparent in student responses. Many attempts at solutions were not expressed in terms of  {\color{blue} \boldsymbol{2 -2\sqrt{3}i}} as required.

Funny that. The examiners pose a question that borders on the meaningless and somehow this creates a sea of misunderstanding. Who would’ve guessed?

4(c) makes little more sense than to ask someone to write 3 in terms of 7. Given any two numbers there’s a zillion ways to “express” one number “in terms of” the other, as in 3 = 7 – 4 or whatever. Without further qualification or some accepted convention, without some agreed upon definition of “expressed in terms of”, any expression is just as valid as any other.

What was expected in 4(c)? To approach the question cleanly we can first set w = 2 - 2\sqrt{3}i, as the examiners could have and should have and did not. Then, the intended answers were -w and -\overline{w}.

These expressions for the roots are simple and natural, but even if one accepts a waffly interpretation of 4(c) that somehow requires “simple” solutions, there are plenty of other possible answers. The expressions w-4 and \overline{w-4} and w^2/4 and w^4/|w|^3 are all reasonable and natural, but nothing in the Examiners’ Report suggests that these or similar answers were accepted. If not, that is a very nasty cherry on top of an incredibly silly question.

***************************

The pain now temporarily lessens (though the worst is yet to come). 4(d) asks for students to show that the relation |z| = |z - (2-2\sqrt{3}i)| has the cartesian form x-\sqrt{3}y - 4 = 0, and in 4(e) students are asked to draw this line on an Argand diagram, together with the roots of the above quadratic.

These questions are routine and ok, though 4(d) is weirdly aimless, the line obtained playing no role in the final parts of Q4. The Examiners’ Report also notes condescendingly that “the ‘show that’ instruction was generally followed”. Yes, people do tend to follow the intended road if there’s only one road.

The final part, 4(g), is also standard, requiring students to find the area of the major segment of the circle |z| = 4 cut off by the line through the roots of the quadratic. The question is straight-forward, the only real trick being to ignore the weird line from 4(d) and 4(e).

***************************

Finally, the debacle of 4(f):

The equation of the line passing through the two roots of {\color{red} \boldsymbol{z^2 + 4z + 16 = 0}} can be expressed as {\color{red} \boldsymbol{|z-a| = |z-b|}}, where \color{red}\boldsymbol{a, b \in C}. Find \color{red}\boldsymbol{b} in terms of \color{red}\boldsymbol{a}.

The Report notes that

This question caused significant difficulty for students.

That’s hilarious understatement given that 99% of students scored 0/1 on the question. The further statements acknowledging and explaining and apologising for the stuff-up are unfortunately non-existent.

So, what went wrong? The answer is both obvious and depressingly familiar: the exam question is essentially meaningless. Students failed to comprehend the question because it is close to incomprehensible.

The students are asked to write b in terms of a. However, similar to 4(c) above, there are many ways to do that and how one is able to do it depends upon the initial number a chosen. The line through the two roots has equation \operatorname{Re} z = x = -2. So then, for example, with a = -4 we have b = 0 and we can write b = a + 4 or b = 0 x a or whatever. If a = -5 then b = 1 and we can write b = -a – 4, and so on.

Anything of this nature is a reasonable response to the exam question as written and none of it resembles the answer in the Report. Instead, what was expected was for students to consider all complex numbers a – except those on the line itself – and to consider all associated complex b. That is, in appropriate but non-Specialist terminology, we want to determine b as a function f(a) of a, with the domain of f being most but not all of the complex plane.

With the question suitably clarified we can get down to work (none of which is indicated in the Report). Easiest is to write a = (-2+c) + di. Since b must be symmetrically placed about the line \operatorname{Re} z = -2, it follows that b = (-2-c) + di. Then b+2 = -c + di = -\overline{(a+2)}. This gives b = -2 - \overline{(a + 2)}, and finally

\color{blue}\boldsymbol{b = -4 -\overline{a}\, ,}

which is the answer indicated in the Examiners’ Report.

In principle 4(f) is a nice question, though 1 mark is pretty chintzy for the thought required. More importantly, the exam question as written bears only the slightest resemblance to the intended question, or to anything coherent, with only the slightest, inaccurate hint of the intended generality of a and b.

99% of 2017 Specialist students have a right to be pissed off.

***************************

That’s it, we’re done. One more ridiculous VCE exam question, and one more ridiculously arrogant Report, unsullied by an ounce of self-reflection or remorse.

The Arc Enemy

Our previous post was on good guys making a silly, funny and inconsequential mistake. This post is not.

Question B1 of Exam 2 for 2018 Northern Hemisphere Specialist Mathematics begins innocently enough. In part (a), students are required to graph the function \boldsymbol{f(x) = 10\arccos(2-2x)} over its maximal domain. Then, things begin to get stupid.

In part (b), the graph of f is rotated around the y-axis, to model a vase. Students are required to find the volume of this stupid vase, by setting up the integral and then pushing the stupid buttons on their stupid calculators. So, a reasonable integration question lost in ridiculous pseudomodelling and brainless button-pushing. Whatever. Just standard VCE crap. Then, things stay stupid.

Part (c) is a related rates question. In principle a good problem, though it’s hard to imagine anyone ever requiring dh/dt when the water depth is exactly \boldsymbol{5\pi} cm. Whatever. Standard VCE crap. Then, things get really, really stupid.

Part (d) of the problem has a bee climbing from the bottom of the vase to the top. Students are required to find the minimum distance the bee needs to travel.

Where to begin with this idiotic, 1-mark question. Let’s begin with the bee.

Why is it a bee? Why frame a shortest walk question in terms of a bug with wings? Sure, the question states that the bug is climbing, and the slight chance of confusion is overshadowed by other, much greater issues with the question. But still, why would one choose a flying bug to crawl up a vase? It’s not importantly stupid, but it is gratuitously, hilariously stupid.

Anyway, we’re stuck with our stupid bee climbing up our stupid vase. What distance does our stupid bee travel? Well, obviously our stupid, non-flying bee should climb as “up” as possible, without veering left or right, correct?

No and yes.

It is true that a bottom-to-top shortest path (geodesic) on a surface of revolution is a meridian. The proof of this, however, is very far from obvious; good luck explaining it to your students. But of course this is only Specialist Mathematics, so it’s not like we should expect the students to be inquisitive or critical or questioning assumptions or anything like that.

Anyway, our stupid non-flying bee climbs “up” our stupid vase. The distance our stupid bee travels is then the arc length of the graph of the original function f, and the required distance is given by the integral

    \[\boldsymbol{{\Huge \int\limits_{\frac12}^{\frac32}}\sqrt{1+\left[\tfrac{20}{1 - (2-2x)^2}\right]^2}}\ {\bf d}\boldsymbol{x}\]

The integral is ugly. More importantly, the integral is (doubly) improper and thus has no required meaning for Specialist students. Pretty damn stupid, and a stupidity we’ve seen not too long ago. It gets stupider.

Recall that this is a 1-mark question, and it is clearly expected to have the stupid calculator do the work. Great, sort of. The calculator computes integrals that the students are not required to understand but, apart from being utterly meaningless crap, everything is fine. Except, the calculators are really stupid.

Two brands of CAS calculators appear to be standard in VCE. Brand A will readily compute the integral above. Unfortunately, Brand A calculators will also compute improper integrals that don’t exist. Which is stupid. Brand B calculators, on the other hand, will not directly compute improper integrals such as the one above; instead, one first has to de-improper the integral by changing the limits to something like 0.50001 and 1.49999. Which is ugly and stupid. It also requires students to recognise the improperness in the integral, which they are supposedly not required to understand. Which is really stupid. (The lesser known Brand C appears to be less stupid with improper integrals.)

There is a stupid way around this stupidity. The arc length can also be calculated in terms of the inverse function of f, which avoid the improperness and then all is good. All is good, that is, except for the thousands of students who happen to have a Brand B calculator and who naively failed to consider that a crappy, 1-mark button-pushing question might require them to hunt for a Specialist-valid and B-compatible approach.

The idiocy of VCE exams is truly unlimited.

Inverted Logic

The 2018 Northern Hemisphere Mathematical Methods exams (1 and 2) are out. We didn’t spot any Magritte-esque lunacy, which was a pleasant surprise. In general, the exam questions were merely trivial, clumsy, contrived, calculator-infested and loathsomely ugly. So, all in all not bad by VCAA standards.

There, was, however, one notable question. The final multiple choice question on Exam 2 reads as follows:

Let f be a one-to-one differentiable function such that f (3) = 7, f (7) = 8, f′(3) = 2 and f′(7) = 3. The function g is differentiable and g(x) = f –1(x) for all x. g′(7) is equal to …

The wording is hilarious, at least it is if you’re not a frazzled Methods student in the midst of an exam, trying to make sense of such nonsense. Indeed, as we’ll see below, the question turned out to be too convoluted even for the examiners.

Of course –1 is a perfectly fine and familiar name for the inverse of f. It takes a special cluelessness to imagine that renaming –1 as g is somehow required or remotely helpful. The obfuscating wording, however, is the least of our concerns.

The exam question is intended to be a straight-forward application of the inverse function theorem. So, in Leibniz form dx/dy = 1/(dy/dx), though the exam question effectively requires the more explicit but less intuitive function form, 

    \[\boldsymbol {\left(f^{-1}\right)'(b) = \frac1{f'\left(f^{-1}(b)\right)}}.}\]

IVT is typically stated, and in particular the differentiability of –1 can be concluded, with suitable hypotheses. In this regard, the exam question needlessly hypothesising that the function g is differentiable is somewhat artificial. However it is not so simple in the school context to discuss natural hypotheses for IVT. So, underlying the ridiculous phrasing is a reasonable enough question.

What, then, is the problem? The problem is that IVT is not explicitly in the VCE curriculum. Really? Really.

Even ignoring the obvious issue this raises for the above exam question, the subliminal treatment of IVT in VCE is absurd. One requires plenty of inverse derivatives, even in a first calculus course. Yet, there is never any explicit mention of IVT in either Specialist or Methods, not even a hint that there is a common question with a universal answer.

All that appears to be explicit in VCE, and more in Specialist than Methods, is application of the chain rule, case by isolated case. So, one assumes the differentiability of –1 and and then differentiates –1(f(x)) in Leibniz form. For example, in the most respected Methods text the derivative of y = log(x) is somewhat dodgily obtained using the chain rule from the (very dodgily obtained) derivative of x = ey.

It is all very implicit, very case-by-case, and very Leibniz. Which makes the above exam question effectively impossible.

How many students actually obtained the correct answer? We don’t know since the Examiners’ Report doesn’t actually report anything. Being a multiple choice question, though, students had a 1 in 5 chance of obtaining the correct answer by dumb luck. Or, sticking to the more plausible answers, maybe even a 1 in 3 or 1 in 2 chance. That seems to be how the examiners stumbled upon the correct answer.

The Report’s solution to the exam question reads as follows (as of September 20, 2018):

f(3) = 7, f'(3) = 8, g(x) = f –1(x) , g‘(x) = 1/2 since

f'(x) x f'(y) = 1, g(x) = f'(x) = 1/f'(y).

The awfulness displayed above is a wonder to behold. Even if it were correct, the suggested solution would still bear no resemblance to the Methods curriculum, and it would still be unreadable. And the answer is not close to correct.

To be fair, The Report warns that its sample answers are “not intended to be exemplary or complete”. So perhaps they just forgot the further warning, that their answers are also not intended to be correct or comprehensible.

It is abundantly clear that the VCAA is incapable of putting together a coherent curriculum, let alone one that is even minimally engaging. Apparently it is even too much to expect the examiners to be familiar with their own crappy curriculum, and to be able to examine it, and to report on it, fairly and accurately.

VCAA Plays Dumb and Dumber

Late last year we posted on Madness in the 2017 VCE mathematics exams, on blatant errors above and beyond the exams’ predictably general clunkiness. For one (Northern Hemisphere) exam, the subsequent VCAA Report had already appeared; this Report was pretty useless in general, and specifically it was silent on the error and the surrounding mathematical crap. None of the other reports had yet appeared.

Now, finally, all the exam reports are out. God only knows why it took half a year, but at least they’re out. We have already posted on one particularly nasty piece of nitpicking nonsense, and now we can review the VCAA‘s own assessment of their five errors:

 

So, the VCAA responds to five blatant errors with five Trumpian silences. How should one describe such conduct? Unprofessional? Arrogant? Cowardly? VCAA-ish? All of the above?

 

The Wild and Woolly West

So, much crap, so little time.

OK, after a long period of dealing with other stuff (shovelled on by the evil Mathologer), we’re back. There’s a big backlog, and in particular we’re working hard to find an ounce of sense in Gonski, Version N. But, first, there’s a competition to finalise, and an associated educational authority to whack.

It appears that no one pays any attention to Western Australian maths education. This, as we’ll see, is a good thing. (Alternatively, no one gave a stuff about the prize, in which case, fair enough.) So, congratulations to Number 8, who wins by default. We’ll be in touch.

A reminder, the competition was to point out the nonsense in Part 1 and Part 2 of the 2017 West Australian Mathematics Applications Exam. As with our previous challenge, this competition was inspired by one specifically awful question. The particular Applications question, however, should not distract from the Exam’s very general clunkiness. The entire Exam is amateurish, as one rabble rouser expressed it, plagued by clumsy mathematics and ambiguous phrasing.

The heavy lifting in the critique below is due to the semi-anonymous Charlie. So, a very big thanks to Charlie, specifically for his detailed remarks on the Exam, and more generally for not being willing to accept that a third rate exam is simply par for WA’s course. (Hello, Victorians? Anyone there? Hello?)

We’ll get to the singularly awful question, and the singularly awful formal response, below.  First, however, we’ll provide a sample of some of the examiners’ lesser crimes. None of these other crimes are hanging offences, though some slapping wouldn’t go astray, and a couple questions probably warrant a whipping. We won’t go into much detail; clarification can be gained by referring to the Exam papers. We also don’t address the Exam as a whole in terms of the adequacy of its coverage of the Applications curriculum, though there are apparently significant issues in this regard.

Question 1, the phrasing is confusing in parts, as was noted by Number 8. It would have been worthwhile for the examiners to explicitly state that the first term Tn corresponds to n = 1. Also, when asking for the first term ( i.e. the first Tn) less than 500, it would have helped to have specifically asked for the corresponding index n (which is naturally obtained as a first step), and then for Tn.

Question 2(b)(ii), it is a little slack to claim that “an allocation of delivery drivers cannot me made yet”.

Question 5 deals with a survey, a table of answers to a yes-or-no question. It grates to have the responses to the question recorded as “agree” or “disagree”. In part (b), students are asked to identify the explanatory variable; the answer, however, depends upon what one is seeking to explain.

Question 6(a) is utterly ridiculous. The choice for the student is either to embark upon a laborious and calculator-free and who-gives-a-damn process of guess-and-check-and-cross-your-fingers, or to solve the travelling salesman problem.

Question 8(b) is clumsily and critically ambiguous, since it is not stated whether the payments are to be made at the beginning or the end of each quarter.

Question 10 involves some pretty clunky modelling. In particular, starting with 400 bacteria in a dish is out by an order of magnitude, or six.

Question 11(d) is worded appallingly. We are told that one of two projects will require an extra three hours to compete. Then we have to choose which project “for the completion time to be at a minimum”. Yes, one can make sense of the question, but it requires a monster of an effort.

Question 14 is fundamentally ambiguous, in the same manner as Question 8(b); it is not indicated whether the repayments are to be made at the beginning or end of each period.

 

That was good fun, especially the slapping. But now it’s time for the main event:

QUESTION 3

Question 3(a) concerns a planar graph with five faces and five vertices, A, B, C, D and E:

What is wrong with this question? As evinced by the graphs pictured above, pretty much everything.

As pointed out by Number 8, Part (i) can only be answered (by Euler’s formula) if the graph is assumed to be connected. In Part (ii), it is weird and it turns out to be seriously misleading to refer to “the” planar graph. Next, the Hamiltonian cycle requested in Part (iii) is only guaranteed to exist if the graph is assumed to be both connected and simple. Finally, in Part (iv) any answer is possible, and the answer is not uniquely determined even if we restrict to simple connected graphs.

It is evident that the entire question is a mess. Most of the question, though not Part (iv), is rescued by assuming that any graph should be connected and simple. There is also no reason, however, why students should feel free or obliged to make that assumption. Moreover, any such reading of 3(a) would implicitly conflict with 3(b), which explicitly refers to a “simple connected graph” three times.

So, how has WA’s Schools Curriculum and Standards Authority subsequently addressed their mess? This is where things get ridiculous, and seriously annoying. The only publicly available document discussing the Exam is the summary report, which is an accomplished exercise in saying nothing. Specifically, this report makes no mention of the many issues with the Exam. More generally, the summary report says little of substance or of interest to anyone, amounting to little more than admin box-ticking.

The first document that addresses Question 3 in detail is the non-public graders’ Marking Key. The Key begins with the declaration that it is “an explicit statement about [sic] what the examining panel expect of candidates when they respond to particular examination items.” [emphasis added].

What, then, are the explicit expectations in the Marking Key for Question 3(a)? In Part (i) Euler’s formula is applied without comment. For Part (ii) a sample graph is drawn, which happens to be simple, connected and semi-Eulerian; no indication is given that other, fundamentally different graphs are also possible. For Part (iii), a Hamiltonian cycle is indicated for the sample graph, with no indication that non-Hamiltonian graphs are also possible. In Part (iv), it is declared that “the” graph is semi-Eulerian, with no indication that the graph may non-Eulerian (even if simple and connected) or Eulerian.

In summary, the Marking Key makes not a single mention of graphs being simple or connected, nor what can happen if they are not. If the writers of the Key were properly aware of these issues they have given no such indication. The Key merely confirms and compounds the errors in the Exam.

Question 3 is also addressed, absurdly, in the non-public Examination Report. The Report notes that Question 3(a) failed to explicitly state “the” graph was assumed to be connected, but that “candidates made this assumption [but not the assumption of simplicity?]; particularly as they were required to determine a Hamiltonian cycle for the graph in part (iii)”. That’s it.

Well, yes, it’s obviously the students’ responsibility to look ahead at later parts of a question to determine what they should assume in earlier parts. Moreover, if they do so, they may, unlike the examiners, make proper and sufficient assumptions. Moreover, they may observe that no such assumptions are sufficient for the final part of the question.

Of course what almost certainly happened is that the students constructed the simplest graph they could, which in the vast majority of cases would have been simple and connected and Hamiltonian. But we simply cannot tell how many students were puzzled, or for how long, or whether they had to start from scratch after drawing a “wrong” graph.

In any case, the presumed fact that most (but not all) students were unaffected does not alter the other facts: that the examiners bollocksed the question; that they then bollocksed the Marking Key; that they then bollocksed the explanation of both. And, that SCSA‘s disingenuous and incompetent ass-covering is conveniently hidden from public view.

The SCSA is not the most dishonest or inept educational authority in Australia, and their Applications Exam is not the worst of 2017. But one has to hand it to them, they’ve given it the old college try.

Don’t Go West, Young Man

No, Burkard’s and my new book has nothing to do with going West. A signed copy of our book is, however, first prize in our new Spot the Exam Error(s) Competition. (Some information on our previous exam competition can be found here.)

We spend a fair amount of our blog time hammering Victoria’s school curriculum authority and their silly exams. Earlier this year, a colleague indicated that there were perhaps similar issues out West. We then had a long email exchange with the semi-anonymous Charlie, who pointed out many issues with the 2017 West Australian Mathematics Applications Exam. (Here is part 1 and part 2. WA’s Applications corresponds to Victoria’s Further Mathematics.)

Following our discussion with Charlie, we sent a short but strong letter to WA’s School Curriculum Standards Authority, criticising one specific question and suggesting our (and some others’) general concerns. Their polite fobbing off indicated that our comments regarding the particular question “will be looked into”. Generally on the exam, they responded: “Feedback from teachers and candidates indicates the examination was well received and that the examination was fair, valid and based on the syllabus.” The reader can make of that what they will.

The Competition

Determine the errors, ambiguities and sillinesses in the 2017 WA Applications Exam, Part 1 and Part 2(Here, also, is the Summary Exam Report. Unfortunately, and ridiculously, the full report and the grading scheme are not made public, and so cannot be part of the competition.)

Post any identified issues in the comments below (anonymously, if you wish). You may post more than once, particularly on different questions, but please don’t edit on the run with post updates and comments to your own posts. You may (politely) comment on and seek to clarify others’ comments.

This post will be updated below, as the issues (or lack thereof) with particular questions are sorted out.

The Rules

  • Entry is of course free (though you could always donate to Tenderfeet).
  • First prize, a signed copy of A Dingo Ate My Math Book, goes to the person who makes the most original and most valuable contributions.
  • Consolation prizes of Burkard’s QED will be awarded as deemed appropriate.
  • Rushed and self-appended contributions will be marked down!
  • This is obviously subjective as all Hell, and Marty’s decision will be final.
  • Charlie, Paul, Burkard, Anthony, Joseph, David and other fellow travellers are ineligible to enter.
  • Employees of SCSA are eligible to enter, since there’s no indication they have any chance of winning.
  • All correspondence will be entered into.

Good Luck!

Updates:

Well that worked well. Congratulations to Number 8, who wins by default. Details are here. We’ll attempt another competition, of hopefully broader interest, in the near future.