People have been enriching written text with pictures as long as writing has existed. In other words, emoji have been around a very long time. This was not necessarily because the picture served a specific purpose, but just for the fun of it, and to make the reader smile. Take the marginalia that medieval monks put in the margins of their manuscripts (hence the academic Latin name) for example. As you can see in the image below, these depictions were often light-hearted, comical depictions.
Fast forward to the early 1990s. The WWW was still in its infancy, but chat services like Internet Relay Chat (IRC) were already hugely popular. In my previous life in Academia I did a study on the use of language in IRC, which was interesting because chat services combine some elements of verbal communication (e.g. the synchronicity) with the use of written language in a way no other medium had ever done before (Nils Lenke & Peter Schmitz: “Geschwätz im ‘Globalen Dorf’ – Kommunikation im Internet”, in: Osnabrücker Beiträge zur Sprachtheorie 50 (1995), pp. 117-141). But written language lacks some elements of spoken language, like paralinguistic features that signal irony or other “emotional” components of communication. Because these are not visible in plain, written words, people used a lot of emoticons like J or L to make up for this. So, these pictorial elements were not just fun to look at, they actually served an important purpose in communication.
Now in 2017, today’s emoji are not just in the margins of texts, but are everywhere – in chats, text messages, emails, tweets, posts, etc. And they combine the two elements we have previously discussed: on the one hand they are silly and fun to look at like the medieval marginalia– somebody even compiled a highly entertaining list of marginalia that look like emojis. On the other hand they serve an important function in conveying emotion and tone like emoticons. But there are many, many different emoji to choose from and today’s world is moving fast – searching from menus can just be too slow.
And now, modern keyboards like uggest emoji automatically. Even better, the keyboard has just been updated to proactively offer emoji suggestions with the help of Machine Learning. Previously this feature had been simply keyword based, which we felt wasn’t good enough. Often you need an emoji that captures the meaning of a whole phrase or sentence, so a keyword might not be good enough to make an appropriate suggestion.
Contemplating this challenge, my colleague Claes-Fredrik Mannby found that Machine Learning was the solution we needed, as is often the case these days. Rather than tediously mapping specific words to emoji by hand, he simply fed the Machine Learning algorithms lots and lots of examples of how people combine words and emoji. In the end, it all works quite nicely. If you want to see an example, just type or Swype something like “winter vacation” or “let’s hit the slopes” and the top choice emoji will be a pair of skis – and so on. Prepare yourself for smarter, contextually relevant emoji that will enrich communications everywhere with enjoyable, meaningful and easy to read text. This capability is now in Swype for Android (on Google Play) and available as part of the Swype SDK, which will hit devices soon.