Chapter 2. The rise of deceptive patterns

When I started working on deceptive patterns, I was a little naive. I thought they might be eradicated if we could name and shame the companies that use these practices. Or at the very least, perhaps we could encourage UI and UX designers to use a code of ethics that would reduce the number of deceptive patterns in existence.

This approach didn’t work. In fact, things have become a lot worse since then. Deceptive patterns are everywhere now – there’s even a tip line that takes reports from concerned users and relays them to policymakers and enforcers around the world.1 The fact that we need a tip line at all means there’s clearly more to do.

To be fair though, deceptive patterns didn’t appear overnight. Deception is part of being human – in fact, it’s so common in the animal kingdom that we can even think of deception as a feature of life itself.2 The cover of this book features a Venus flytrap (Dionaea muscipula). This plant releases a scent that mimics the bouquet of fruits and flowers. Insects are attracted, and when they touch its sensory hairs inside the jaws, it snaps shut and traps the prey. This image is intended to be emblematic of unscrupulous tech companies who trick and trap their users using deceptive patterns.

Many historical stories and myths revolve around deception, such as ‘taking the King’s shilling’. In the 18th and 19th centuries, Britain spent a lot of time at war. But a career in the army or navy during wartime was not very attractive. With volunteers short on the ground, press gangs emerged to aggressively encourage recruitment, offering a shilling for every man who joined up. As the story goes, the act of receiving the coin was seen as a binding agreement, so unscrupulous recruiters would slip the coin into a sailor’s pocket or tankard of beer. When it entered their possession, the deal was done, and the men would be forced into naval servitude. Myth or not, the analogy with deceptive patterns is a strong one. Whether it’s clicking an ambiguously labelled button in a user interface or receiving a drink containing a hidden coin, it’s obvious that there’s a problem with the definition of consent if a person has no recourse after such a small, unintentional act.

It’s useful to think about what makes commercial deception and manipulation different today versus the pre-internet era. There are some aspects of modern technology that have acted as an accelerant or a catalyst, intensifying and spreading these practices.

The rise of metrics-driven culture

The idea of being driven by metrics dates back a long way: there’s archeological evidence of accounting records from Mesopotamia, 7,000 years ago. Crude as it may have been then, human beings have got better at measuring things over time, and we’re now fanatical about measuring things accurately.

What’s changed is that the barrier to measuring things is now much, much lower. You don’t need to be particularly clever or have a lot of capital to start measuring anything and everything you do in a business environment, and to start using data analysis to inform your business decisions.

In fact, metrics-driven management can be quite easy. You work out what metrics matter to your business, then you reward your teams for pursuing them using management techniques like performance-related pay, target metrics, bonuses and promotions. Of course, rewarding people for meeting a goal is almost the same as punishing them for not meeting it. In countries with less stringent labour standards, some companies use a management technique called ‘stack ranking’. This involves rating employees according to their performance on various measures, arranging them in rank order and then getting rid of the lowest performers. If an employee’s healthcare or immigration status is tied to their continued employment, this creates an enormous pressure on employees to do anything they can to hit their targets.

The web has also made it much easier to build and optimise deceptive patterns. With that in mind, I’d attribute the rise of deceptive patterns in software to the following general factors.

Easier tracking

Before the internet, it wasn’t easy to observe people without them being painfully aware of being watched. The traditional observation method was to send researchers to a store and have them stand there with a clipboard.3

But field researchers are costly and can only look at one thing at a time. Today, all you need to do is add a snippet of JavaScript4 to your website to get in-depth tracking that observes every conceivable behaviour of every user of your product simultaneously, and have it recorded into a huge database in the cloud. Business owners have also noticed another advantage to online tracking. Despite it being more invasive than ever before, people don’t feel anywhere near as worried about their privacy being invaded – because they don’t feel human eyes on them. All that tracking happens behind the scenes, out of sight and out of mind.

Then you’ve got the data processing. Before the internet, it was paperwork. Thousands of pieces of paper. Getting all the clipboards together, transcribing notes and recording them in a ledger. Doing calculations by hand to work out how many people did what, when, and how that impacted the company’s net income. Today, all of that calculation happens in the blink of an eye. Anyone can do it, using web-based software products like Google Analytics, Adobe Analytics, Mixpanel, Hotjar, or Amplitude.

These tools can give a wide manner of different insights: which ads or channels are driving traffic online, which pages are most effective at persuading users to take actions, the step in a series of pages at which users give up because they’re confused or frustrated, and more. All of these insights are then looped back into the...

Buy the book to read more...

Since 2010, Harry Brignull has dedicated his career to understanding and exposing the techniques that are employed to exploit users online, known as “deceptive patterns” or “dark patterns”. He is credited with coining a number of the terms that are now popularly used in this research area, and is the founder of the website deceptive.design. He has worked as an expert witness on a number of cases, including Nichols v. Noom Inc. ($56 million settlement), and FTC v. Publishers Clearing House LLC ($18.5 million settlement). Harry is also an accomplished user experience practitioner, having worked for organisations that include Smart Pension, Spotify, Pearson, HMRC, and the Telegraph newspaper.