Mozilla Foundation continues to lead the way in developing the infrastructure to support earning and displaying badges. We are likely to see first the wider implementation of badging pilots along with other forms of alternative credentialing. The promise of badges remains great but whether they will be accepted as valid recognition of learning remains to be seen. Thus far, adoption of badge accreditation has been limited and understanding their motivational status for students remains a challenge.
The recent SURF Trend Report identified research that suggests MOOCs can make use of learning analytics to give instructors a better sense of whether learning objectives are being met. However, most informal assessments taking place within MOOCs are arguably optimistic with respect to the efficacy of multiple choice questioning or peer-assessed writing exercises. While learning analytics can be effective they risk providing learners with feedback that is less balanced than a human tutor and thus requires learning to be self regulated (Nicol & Macfarlane-Dick, 2006). One blended approach to integrating is set out in the Innovating Pedagogy report published by The Open University. The key challenge is to ensure that provided support does not overwhelm either student or tutor. Confidence based marking (which integrates game mechanics) and the OpenMentor assistance system (which provides benchmarks for feedback) illustrate ways in which assessment is becoming more formative, and shaping the learning process.
It remains to be seen whether approaches like these will be adopted by MOOC platforms but there is some evidence to suggest that they are increasingly seeking to embrace formal assessment through partnership with examination bodies for assessment or through remote monitoring which enforces exam conditions. At present, there may be reason to think that existing assessment within MOOC is suboptimal. According to a report in the Chronicle of Higher Education many students are using plagiarism to get through assessments in their MOOC rather than using them for evaluating their own learning or to self-motivate. This appears to be the case even when there are no credits associated with passing although in Brazil possession of MOOC certificates of participation have been shown to have value on the job market (Inamorato dos Santos, 2011).
The Phonar and PicBod open courses in Photography at Coventry University offer a different perspective on assessment. All class content is licensed CC-BY-SA and this enables opportunity for collaborative learning, repurposing, building narratives and understanding, and having feedback in the open from both tutors and peers. The courses have been popular, with many thousands of students. The organisers have indicated a willingness to participate in OERRH research and although future activities have yet to be agreed it is likely that it will be possible to get some data from students on these courses.
Next steps for OER Research Hub will include further desk research into badging as well as inviting Doug Belshaw, Badges and Skills Lead at Mozilla Foundation, to write a guest blog post on motivating informal learners through soft accreditation following his OER13 keynote presentation. A question on motivation for OER study use is included in the our survey bank, and may yield insights into learner motivation.
Thanks Robert! I may defer to one of my colleagues, but thanks for the invitation. 🙂
I should also note that HASTAC has a wealth of articles on badge-related things: http://www.hastac.org/digital-badges-bibliography
Hi Doug, thanks for the link. It looks like there could be some useful leads for us to follow there. We’d love to have you or a colleague write a guest post for us on the subject of soft accreditation and the extent to which it can act as a motivating factor for informal learners. It would be great to get a sense of the Mozilla perspective on the issues. Any ideas for next steps? And is there anything we might do for you?
Hi Robert,
Nice piece; thanks for writing about our work on Open Badges. We’re excited to see the movement spreading.
I’m Carla Casilli, a colleague of the amazing Doug Belshaw. My work focuses on badge system design and I’d be happy to write a guest blog post on the idea of soft accreditation. As you may be aware, the fantastic Erin Knight, Mozilla’s Sr. Director of Learning and Badges, has written a white paper (with an RFC) on badge validation that touches upon this idea, “An Open, Distributed System for Badge Validation.” It can be found here: https://docs.google.com/file/d/0BwJ_PQhV0lJTSnYtQzV5Q0FxNDA/edit We’d love your and your readers’ feedback on the thinking found there, too.
All this is to say, of course we’d love to continue the conversation that you’ve begun here.
Thanks!
Carla
Hi Robert,
Nice piece; thanks for writing about our work on Open Badges. We’re excited to see the movement spreading.
I’m Carla Casilli, a colleague of the amazing Doug Belshaw. My work focuses on badge system design and I’d be happy to write a guest blog post on the idea of soft accreditation. As you may be aware, the fantastic Erin Knight, Mozilla’s Sr. Director of Learning and Badges, has written a white paper (with an RFC) on badge validation that touches upon this idea, “An Open, Distributed System for Badge Validation.” It can be found here: https://docs.google.com/file/d/0BwJ_PQhV0lJTSnYtQzV5Q0FxNDA/edit We’d love your and your readers’ feedback on the thinking found there, too.
All this is to say, of course we’d love to continue the conversation that you’ve begun here.
Thanks!
Carla
That sounds great, Carla, many thanks for the offer. I’ve added the paper to our curated materials and will give feedback once I’ve shared with the team. In the meantime, we’d really like to hear your thoughts on soft accreditation. Our research hypothesis (http://oerresearchhub.org/collaborative-research/hypotheses/) associated with this area is phrased as follows:
“Informal means of assessment are motivators to learning with OER”
So if you were able to structure something around this that would be ideal. We’re interested in any evidence you might have in support of this claim but also in information that might help us to refine our framework. You could email us the copy or we may be able to enable your blog ID as a guest contributor… but we can worry about that later! Looking forward to hearing your views!
Best,
Rob