We’re not actively looking for WitCHes right now, since we have a huge backlog to update. This one, however, came up in another context and, after chatting about it with commenter Red Five, there seemed no choice.

We have a short Specialist post coming, and we’ll have more to write on the 2019 VCE exams once they’re online. But, for now, one more Mathematical Methods WitCH, from the 2019 (calculator-free) Exam 1:

This one is double-barrelled. A strange multiple choice question appeared in the 2019 NHT Mathematical Methods Exam 2 (CAS). We had thought to let it pass, but a similar question appeared in last’s weeks Methods exam (no link yet, but the Study Design is here). So, here we go.

We haven’t yet had a chance to go through the 2019 VCE exams, but this question was flagged to me independently by two colleagues: let’s call them Dr. Death and Simon the Likeable. It’s from Mathematical Methods Exam 2 (CAS). (No link yet.)

Tons of nonsense to post on, and the Evil Mathologer is breathing down our neck. We’ll have (at least) three posts on last week’s Mathematical Methods exams. This one is by no means the worst to come, but it fits in with our previous WitCH, so let’s quickly get it going. It is from Exam 1. (No link yet, but the Study Design is here.)

The following WitCH is pretty old, but it came up in a tutorial yesterday, so what the Hell. (It’s also a good warm-up for another WitCH, to appear in the next day or so.) It comes from the 2011 Mathematical Methods Exam 1:

For part (a), the Examination Report indicates that f(g)(x) =√([x+2][x+8]), leading to c = 2 and d = 8, or vice versa. The Report indicates that three quarters of students scored 2/2, “However, many [students] did not state a value for c and d”.

For Part (b), the Report indicates that 84% of students scored 0/2. After indicating the intended answer, (-∞,-8) U (-2,∞) (-∞,-8] U [-2,∞) or R(-8,-2), the Report goes on to comment:

“This question was very poorly done. Common incorrect responses included [-3,3] (the domain of f(x); x ≥ -2 (as the ‘intersection’ of x ≥ -8 with x ≥ -2); or x ≥ -8 (as the ‘union’ of x ≥ -8 with x ≥ -2). Those who attempted to use the properties of composite functions tended to get confused. Students needed to look for a domain that would make the square root function work.”

The Report does not indicate how students got “confused”, although the composition of functions is briefly discussed in the Study Design (page 72).

We’ve finally found some time to take a look at VCAA’s 2019 NHT exams. They’re generally bad in the predictable ways, and they include some specific and seemingly now standard weirdness that we’ll try to address soon in a more systematic manner. WitCHwise, we were tempted by a number of questions, but we’ve decided to keep it to two or three.

Our first NHT WitCH is from the final question on Exam 2 (CAS) of Mathematical Methods:

As usual, the NHT “Report” indicates nothing of how students went, and little of what was expected. In regard to part f, the Report writes,

p(x) = q(x) = x, p'(x) = q'(x) = 1, k = 1/e

For part g, all that the Report provides is the answer, k = 1.

The VCAA also provides sample Mathematica solutions to schools trialling Methods CBE. For the questions above, these solutions are as follows:

One type of educational horror that we haven’t yet written about are SACs, those internal assignmenty-examinationy things that make every second week of Year 12 studies a living hell. It is a tricky topic since SACs are school-based, often teacher-specific, and our primary goal is to attack inept authority. In that regard, schools and beleaguered teachers are in a weird middle ground, part victim and part villain, and they already have plenty of critics. Nonetheless, SACs are the sea in which students and teachers swim (or sink), and mathematics SACs are typically appalling; the overwhelming majority of mathematics SACs that we see are pointless, anti-mathematical, error-strewn blivits. So, something has to be written about such SACs of shit. And, we have a plan.

Our hand has been forced a little, however, by an email we received from a VCE student. The student is taking Mathematical Methods CBE, the trial version of Methods that uses Mathematica instead of CAS, and the student wrote about a recent Mathematica-based SAC at their school. We then asked a teacher at the school about the SAC, and they confirmed the students’ report.

This then is the students’ story, exactly as written to me.

I’m not sure of how many other students you know that are doing CBE methods but my sac today served pretty well to show how awful things can go, so a new perspective is always welcome right?

Starting from the top, we have school-provided laptops with Mathematica preinstalled. So we go in, and we have to utilise this thing called a palette which takes control of Mathematica (I have many complaints against the palette) and downloads the SAC from some remote server. No problems here right? Well, I’d imagine 200 people simultaneously downloading an item from a server would MAYBE just MAYBE cause some congestion in the network. Hell breaks loose here, a class has their file downloaded and enters reading time while the other 4 or so classes are in utter chaos. The downloader is failing over and over while also saying it succeeded. This goes on for a good half an hour before the teachers collectively decided that the sac would be rescheduled to Thursday. The class that began reading? Oh, they just stop. God knows what they could have done, taken photos of the sac with a snipping tool, copied the files over, the possibilities are endless. This whole thing is almost appalling yet terrifying because this is what I’ll have to do at the end of the year. I’ve got a load of other concerns, among the unending variety of methods to do a question with Mathematica and how an assessors report would assign marks, to which our official VCAA quiz provided pissant “solutions” that were often wrong.

Anyway, my slightly irritated take on the abhorrent state of the CBE system, which I thought may be interesting to you.

To that, the teacher at the school added the following:

[The former Head of mathematics at the school] made a deal with the devil and agreed to the school doing Methods CBE. I don’t feel the consultation process valued the feedback from myself and other teachers – it was always going to happen despite the misgivings of other teachers. I can’t help but think that my feelings on the issue is the reason I’m not teaching Maths Methods this year (for the first time in 9 years). There are many problems with this deal – it makes my blood boil. The current head of maths is a very decent guy and has done a fantastic job dealing with the mess he inherited.

I heard that the SAC was a disaster and actually saw events unfolding from afar – like watching a car crash in slow motion. Blind Freddy could have seen what was going to happen. As I left school, I saw the VCE coordinator and the current Head of Maths running around grim faced.

All of the student’s concerns are legitimate. Furthermore, the SAC was meant to run until 4.45 pm, so many students will have made alternative and inconvenient arrangements to accommodate this and now they have to do it all over again. Not to mention what it’s done to the stress levels of many students. Not to mention the time and resources that had to be expended re-writing the SAC. At every stage VCAA have washed their hands of CBE problems and left the school to do its dirty work, using the students as the guinea pigs.

Further,

1. The palette provided by VCAA had a bug.

2. The VCAA server failed. VCAA are trying to blame the school for both errors and no apology has been given. Re: The server fail. VCAA said that the school should have downloaded from the server prior to the SAC starting (which is not practical). VCAA are saying everything worked fine at the other CBE schools (which all have small student cohorts as opposed to our school’s cohort of over 200, which makes a big difference).

That’s it. Our own point of view is that SACs are all but guaranteed to be awful and Mathematica in the classroom is all but guaranteed to be awful. Here, however, those predictable awfulnesses are beside the point. The point here is VCAA’s Trumplike level of incompetence combined with VCAA’s Trumplike unwillingness to accept responsibility.

The following WitCH is from VCE Mathematical Methods Exam 2, 2009. (Yeah, it’s a bit old, but the question was raised recently in a tutorial, so it’s obviously not too old.) It is a multiple choice question: The Examiners’ Report indicates that just over half of the students gave the correct answer of B. The Report also gives a brief indication of how the problem was to be approached:

Have fun.

Update (02/09/19)

Though undeniably weird and clunky, this question clearly annoys commenters less than me. And, it’s true that I am probably more annoyed by what the question symbolises than the question itself. In any case, the discussion below, and John’s final comment/question in particular, clarified things for me somewhat. So, as a rounding off of the post, here is an extended answer to John’s question.

Underlying my concern with the exam question is the use of “solve” to describe guessing/buttoning the solution to the (transcendental) equation . John then questions whether I would similarly object to the “solving” of a quintic equation that happens to have nice roots. It is a very good question.

First of all, to strengthen John’s point, the same argument can also be made for the school “solving” of cubic and quartic equations. Yes, there are formulae for these (as the Evil Mathologer covered in his latest video), but school students never use these formulae and typically don’t know they exist. So, the existence of these formulae is irrelevant for the issue at hand.

I’m not a fan of polynomial guessing games, but I accept that such games are standard and that“solve” is used to describe such games. Underlying these games, however, are the integer/rational root theorems (which the EM has also covered), which promise that an integer/rational coefficient polynomial has only finitely many candidate roots, and that these roots are easily enumerated. (Yes, these theorems may be a less or more explicit part of the game, but they are there and they affect the game, if only semi-consciously.) By contrast, there is typically no expectation that a transcendental equation will have somehow simple solutions, nor is there typically any method of determining candidate solutions.

I find something generally unnerving about the exam question and, in particular, the Report. It exemplifies a dilution of language which is at least confusing, and I’d suggest is actively destructive. At its weakest, “solve” means “find the solutions to”, and anything is fair game. This usage, however, loses any connotation of “solve” meaning to somehow figure out the way the equation works, to determine why the solutions are what they are. This is a huge loss.

True, the investigation of equations can continue independent of the cheapening of a particular word, but the reality is that it does not. Of course, in this manner the Solve button on CAS is the nuclear bomb that wipes out all intelligent life. The end result is a double-barrelled destruction of the way students are taught to approach an equation. First, students are taught that all that matters about an equation are the solutions.They are trained to give the barest lip service to analysing an equation, to investigating if the equation can be attacked in a meaningful mathematical manner. Secondly, the students are taught that that there is no distinction between a precise solution and an approximation, a bunch of meaningless decimals spat out by a machine.

So, yes, the exam question above can be considered just another poorly constructed question. But the weird and “What the Hell” incorporation of a transcendental equation with an exact solution that students were supposedly meant to “solve” is emblematic of a an impoverishment of language and of mathematics that the CAS-infatuated VCAA has turned into an art form.

Reflecting on the comments below, it was a mistake to characterise this exercise as a PoSWW; the exercise had a point that we had missed. The point was to reinforce the Magrittesque lunacy inherent in Methods, and the exercise has done so admirably. The fact that the suggested tangents to the pictured graphs are not parallel adds a special Methodsy charm.