The truthiness of MOOC completion rates

One of the arguments that we are trying to make in our recent HarvardX and MITx research is that there are some real pitfalls in using completion rates to judge and compare open online courses like MOOCs, Education Week reports.

It’s well documented now that about 5% of folks who register for a MOOC, finish one. If you can raise that rate by getting more people who show up to pass a course, that can be a good thing. If you raise that rate by making the course easier, that may not be a good thing. If you raise the rate by making the course more compelling or more supportive that’s assuredly a good thing.

There are also some things that you can do to lower the completion rate of a course that are actually pretty good for students and learning. The best example we have of this is the story of when HarvardX got hit by the Colbert Bump, as my colleague Andrew Ho and I exaplin in an article at The Atlantic today:

On July 24, 2013, Stephen Colbert, of Comedy Central’s Colbert Report, welcomed Anant Agarwal, the president of edX, a MOOC platform that hosts courses from HarvardX and MITx.  Overnight, edX certification rates for daily registrants in Harvard MOOCs dropped noticeably, from a five-day average of 3.2 percent to an average of 2.5 percent.

How do we know that the Colbert Bump was responsible?  Daily registrations in HarvardX MOOCs more than tripled that summer night, from 406 on Wednesday to 1,356 on Thursday.  The number of certificates earned by these students doubled from an average of 12 to an average of 24 per day.

Read more