Commentary

The Top 10 Bad Practices in Mobile Learning

Students in the classroom with an iPadI was recently asked to adapt/update the EduTech list of worst practices in Information and Communication Technology (ICT) use in education so that it would be ‘relevant for the new age of mobile learning’. For those not familiar with the term, or  who are confused by it, ‘mobile learning’ usually refers to the use of small(er), hand(s)held technology devices that learners can take with them — think mobile phones, for example, or small tablets.

To be honest, I suspect the person making this request hadn’t really fully internalized lessons from that earlier list of worst practices, which were meant to reflect many things that had been learned from educational technology initiatives of all sorts. With that said, however, and in the spirit of giving people what they want, here is a list of ‘bad’ practices in mobile learning, based on my familiarity with many projects which fit into this category that have emerged in the past few years.

In the interest of trying to keep things new and fresh, I have tried to avoid simply re-casting the more general list of worst practices related to technology use in education (all of which I would maintain are still valid, as well as many of the insightful examples and perspectives offered in the comments section to the original blog post) with a small ‘mobile twist’.

Given the paucity of reliable data about actual mobile learning practices in middle and low income countries, to say nothing of evidence of impact, this list is a sort of first draft based on observing lots of people and groups doing, and trying to do, things in this area; talking with people who have advised, supported, criticized, evaluated or funded them; and with learners and teachers who have benefited from (or suffered as a result of using) related products and services.

I concede that what doesn’t work today, and so might constitute a ‘bad practice’ now, might not be so in the future. (The Apple Newton flopped in its time, the iPad has been a runaway success since it was released.)

Acknowledging the tentative or draft nature of this list, I have labelled these ‘bad’, not ‘worst’, practices. As with the previous list of ‘worst practices’, the criteria for inclusion in this somewhat idiosyncratic, non-comprehensive list aimed at educational policymakers and planners were that these practices have been observed in multiple initiatives and in multiple places, and seem to repeat over time with only slight variations. Specific names and places have been omitted (feel free to add them in yourself).

In no particular order, then, and with specific reference to common realities in middle and low income countries, here are some:

Bad practices in mobile learning

1. Simply port over content or applications already developed for PCs

The impulse behind this common course of action is quite understandable. “We have already paid a lot to develop this stuff, and we think what we already have is pretty good.” Just because something is understandable doesn’t mean it is advisable, however. One still hears similar sentiments from certain educational publishers who consider the fact that they have made their materials available as PDFs means that their content has now been (magically?) transformed into ‘digital textbooks,’ but the results of such ‘porting’ are usually quite underwhelming. This is not to recommend that all previous content simply be discarded or ignored. However, a mobile first approach to developing mobile learning products and services which approaches design and development afresh and aims to capitalize on the particular affordances offered by mobile devices may yield better results.

2. Introduce a totally new device to facilitate ‘mobile learning’

The allure of a new educational technology device is hard to ignore. That said, history has shown that purpose-built educational technology devices designed for specific educational purposes often fail to gain traction and find users — and they can be very difficult to build! (There are exceptions to this, of course, with handheld graphing calculators being one prominent example. For the purpose of this discussion, ‘ruggedizing’ an existing tablet for use in schools does not make it ‘new’, it just means that a potentially useful feature or attribute has been added to an existing device.)

It is worth asking: Is it more likely that a totally brand new device aimed at the education market will succeed, or might a more prudent course of action be to take advantage of the fact that there is already a base level of technology available to your users upon which you can build? In other words: Is there really a need to develop a new, ideal educational technology device in order for mobile learning to take place, or can you build off what is already available in the market and in widespread use? A better principle to follow, especially when seeking to impact learners and teachers in low income communities, might be to develop for devices that your potential users already have, know how to use, and can afford.

3. Don’t spend time with your target user groups – assume you already understand their needs

What may well be considered a ‘good practice’ or an ‘appropriate solution’ for learners in schools in Silicon Valley or Helsinki, Cambridge or Seoul may not be so good or appropriate when transferred to educational contexts in (e.g.) rural Africa. Thinking you understand the needs of user groups unlike those with which you currently work can have some rather unfortunate consequences once your mobile learning product or service is actually available ‘on the ground.’

It is just possible that many of the real usability challenges inhibiting the adoption of ‘mobile learning’ at scale in developing countries won’t be overcome by people or groups from other places — no matter how brilliant or well-intentioned or successful they may have already been proven to be — but rather by people living and working in such environments themselves, or at least who come from such places (and whose families may still live there), and/or who are themselves users of the mobile devices they help design or the learning applications that run on them. Adopting user-centered design techniques or approaches can be quite helpful here.

related to this, two additional ‘bad’ practices come to mind …

4. Consider that all ‘mobile learners’ are ‘digital natives’

As the ‘digital native’ hypothesis (that all young people are somehow different than their elders because they instinctively ‘get’ technology) enters its second decade, this widely used term continues to exert a strong influence over many educational policymakers, educators and vendors alike. Quickly learning and demonstrating a mastery of the mechanics of a particular process or application on a mobile device (posting to Facebook, for example, or playing a video game one has never seen before) shouldn’t be confused with a mastery of how to successfully use such a device for learning. Design exclusively for the ‘digital native’ and you may well ignore the needs of many of learners, potentially needlessly confusing and complicating their efforts as they engage in ‘mobile learning.’

and …

5. Discount the notion that a device will be used by more than one person

Around the world, mobile devices are often personal devices, owned and used by a single person. This is largely true … except when it isn’t.  While the notion that “regardless of social class, almost everyone [in Africa] has a mobile phone, or two or three,” is conventional wisdom in some circles, data don’t support this contention. The phenomenon of shared use of mobile phones in developing countries has been long remarked upon and studied. Especially in school settings in developing countries, and within families, device sharing can be the norm, not the exception. Mobile learning initiatives that don’t consider this scenario may stumble upon complications, small and large, as a result.

6. Target in-school ‘mobile learning’ exclusively

“We have a fantastic educational app that would be really valuable for use in schools in developing countries – how can we get this into schools in such places?” This is, in some communities, a common question (there are *lots* of makers of educational apps out there!).  Even if the app itself would be quite useful it may be worth considering: Are schools really the best place for the app to be used, especially in cases where the app is meant to run on a mobile phone? After all, many education systems ban the use, or even possession, of mobile phones by students when in school altogether.

Teachers may struggle with trying to control a class where each student’s attention is directed not at them, but rather at a small screen (on which a student may be texting or engaged in some other ‘undesirable activity’). Even where the mechanics of such supervision or oversight is possible, attempting to figure out how using a specific app corresponds to the particular curricular objective to be explored during a given class period can be quite difficult. Targeting learners outside of school hours, and off school property, might well be more practical.

7. Make it all about smart phones

When technology seers predict that, “in the future everyone will have a smart phone”, they may well be correct. However, most of today’s learners and teachers don’t live in the future. Develop content and applications exclusively for smart phones and you’ll miss the majority of potential users in developing countries who still have so-called ‘feature’ phones, simple ‘dumb’ phones … or who have no phones at all. It is too difficult to develop for lower end phones, companies may say, as they don’t allow us to do everything we want to do. Fair enough, that’s probably true. But if you want to reach a large market and hope to achieve broad scale and wide impact, developing for devices that people don’t have may not be the optimal course of action.

8. Plan for digital distribution of content to ‘connected’ mobile devices to be easy

Many groups believe that targeting mobile phones as a potentially relevant device to enable and facilitate various types of mobile learning activities in developing countries is compelling for many reasons. No argument there! That said, assuming that it will be easy to get content onto such devices because they can be connected (to mobile networks, to local wireless networks) can be complicated by the messy reality that what is true in the abstract might in fact be much more difficult once you get ‘on the ground.’

Connectivity in general can be spotty. Data connections can be expensive – and, in an educational context who should pay for these costs, and how? Physical distribution of educational content onto mobile devices – as well as updating existing content and applications — can certainly be done instead, but the logistics of planning for this can be nontrivial, and related costs can be considerable.

9. Assume that you need to do ‘mobile learning’

Many groups planning for mobile learning initiatives are driven by a compulsion to “do something in the mobile learning space”. A recognition that ‘mobile learning is the future’, however, needn’t inexorably lead to the development of anything that is, in end effect, terribly useful. If your criterion for success is to ‘to something’, it’s is probably not too difficult to ‘succeed’. If the goal, on the other hand, is to do something to benefit teaching and learning practices, proposing a ‘mobile solution’ without understanding the problem that needs solving is a recipe for disappointment.  It may well be, after all, that the ‘problem’ identified can be addressed through other, ‘non-mobile’ means.

10. ___

[#10 is left deliberately blank here, as an acknowledgement that there is still much we have to learn in this regard.]
There are no doubt lots more, but I’ll end there. Please feel free to add you your own worst practices, or disagree with me on Twitter (@trucano or @WBedutech).

Editor’s Note: This piece originally ran as part of a longer entry at the World Bank’s EduTech Blog and is republished here with permission.

Tags: , , , ,

Michael Turcano

Michael Trucano Michael Trucano is the World Bank's Senior ICT and Education Policy Specialist, serving as the organization's focal point on issues at the intersection of technology use and education in middle- and low-income countries and emerging markets around the world. At a practical working level, Mike provides policy advice, research and technical assistance to governments seeking to utilize new information and communication technologies (ICTs) in their education systems.