Today’s Times Higher Education carried a report on completion rates in MOOCs, which it estimated at under 7 per cent. Like other products of cheap and rapid digitisation, MOOCs are often seen as a game-changer, threatening to send traditional universities the way of Borders and HMV, and forcing the rest to review their fundamental approach to learning and teaching. It is easy to see, then, why we might think that MOOC drop-out matters.
In fact, I think MOOC drop-out matters. But I’m not going to draw firm conclusions from the THE article, for two reasons. The first is that it is based on what is clearly a small and limited study. Katy Jordan, the researcher whose work is reported, found completion data for 29 MOOCs, which she took from quite different sources (including news reports, university data, and academic presentations). She found completion rates varied widely, between under 1% to almost 19%.
The first thing to say is that this is a small sample, and it may or may not be representative. The different sources may or may not report completion in the same ways. And where did the ‘average’ of under 7% come from? THE doesn’t say, but it looks to me as though someone – I guess THE – has taken the sum of 29 completion rates and divided it by 29. So the second thing to say is that the student cohorts will vary widely in size, and unless you weight for that, then you can’t really reach a meaningful average.
Katy Jordan’s findings are interesting pointers, but do not yet provide a firm basis for judging completion rates. And this is no criticism – she has been entirely open about her sources and analysis, and is presenting her findings as part of a very interesting series of reflections based on her experiences as a MOOC participant. As usual, the question is how the findings are reported, and what use other people will then make of a half-remembered headline.
And even if MOOC completion rates did average out at 7% or less, so what? My answer is that we have no idea whether it matters or not. MOOCs are still very new, and we have only the haziest idea of what learners are doing, and what they have in mind when they click to register on a MOOC . While we do have some ideas from earlier research on drop-out which should make us cautious about drawing firm conclusions, MOOCs are new enough to make me cautious about extrapolating from earlier studies.
What we can say pretty confidently is that open and distance learning tend to show lower completion rates than face to face learning, often dramatically so. This is why the Open University invests so much time and trouble in working out how to engage and support its students. We also know that headline completion rates are lower in part-time than full-time higher education; but any researcher would be careful about drawing conclusions, as we don’t know what learner intentions were when enrolling.
When it comes to MOOCs, entirely new considerations come into play. The clue to why is in the word ‘Open’: anyone can enrol, but we don’t have a clue as to why they have done so. They might be potential learners shopping around, or they might be academics wondering what MOOCs are about. They might want to look at one bit of the MOOC and not others, or lurk and browse rather than complete the whole course. We don’t know whether the ‘drop-outs’ are actually people who register for several courses and end up completing the one that interests them. They might be bored schoolchildren looking for help with a project, or prisoners in one of our more luxurious gaols wanting to pass the time.
So until we know far more about learner aspirations and behaviour – and indeed whether all those who enrol are learners – we don’t know whether drop-out matters. Turbulent completion rates may be annoying for institutions, who would no doubt prefer as much predictability and routine as possible, but I think they are probably inherent in the very open-ness of a MOOC. They could probably be reduced through charging higher fees.
One final thought: why don’t institutions who provide MOOCs publish their completion rates?
Katy Jordan’s blog is at: http://moocmoocher.wordpress.com
The THE article is at: http://www.timeshighereducation.co.uk/news/mooc-completion-rates-below-7/2003710.article