Users take our technologies with them to bed. When they wake up, they check for notifications, tweets, and updates before saying “good morning” to their loved ones. Ian Bogost, the famed game creator and professor, calls the wave of habit-forming technologies the “cigarette of this century” and warns of equally addictive and potentially destructive side-effects.
When Is Manipulation Wrong?
Manipulation is a designed experience crafted to change behavior — we all know what it feels like. We’re uncomfortable when we sense someone is trying to make us do something we wouldn’t do otherwise, like when at a car dealership or a timeshare presentation, or when an app asks us to share our contacts.
Yet, manipulation can’t be all bad. If it were, what explains the numerous multi-billion dollar industries that rely heavily on users willfully submitting to manipulation? If manipulation is a designed experience crafted to change behavior, then Weight Watchers, one of the most successful mass-manipulation products in history, fits the definition.
Much like in the consumer web industry, Weight Watchers customers’ decisions are programed by the designer of the system. Yet few question the morality of Weight Watchers. But what’s the difference? Why is manipulating users through flashy advertising or addictive video games thought to be distasteful while a strict system of food rationing is considered laudable?
A More Addictive World
Unfortunately, our moral compass has not caught-up with what technology now makes possible. Ubiquitous access to the web, transferring greater amounts of personal data at faster speeds than ever before, has created a more addictive world. Addictiveness is accelerating and according to Paul Graham of Y Combinator, we haven’t had time to develop societal “antibodies to addictive new things.” Graham puts responsibility on the user: “Unless we want to be canaries in the coal mine of each new addiction—the people whose sad example becomes a lesson to future generations—we’ll have to figure out for ourselves what to avoid and how.”
But what of the people who make these manipulative experiences? The corporations who unleash these addictive technologies are, after all, made up of human beings with a moral sense of right and wrong. We too have families and kids who are susceptible to addiction and manipulation. What shared responsibilities do we code slingers and behavior designers have to our users, to future generations, and to ourselves?
The Manipulation Matrix
I offer a simple decision support tool for entrepreneurs, employees, and investors to be used long before product is shipped or code is written; even before customer development has begun. The Manipulation Matrix does not try and answer which businesses are moral or which will succeed. Nor does it describe what can and cannot become a habit-forming technology. The matrix seeks to help you answer not, “Can I hook users?” but “Should I attempt to?”
To use the Manipulation Matrix, the maker needs to ask two questions. First, “Will I use the product myself?” and second, “Will the product help users materially improve their lives?”
When you create something that you will use and believe makes the user’s life better, you’re facilitating a healthful habit. It’s important to note that only you can decide if you would actually use the service and what “materially improving the life of the user” really means.
If you find yourself squirming as you ask yourself those questions or needing to create a preamble starting with, “If I were a…” STOP! You failed. You have to actually want to use the product and believe it materially benefits your life as well as the lives of your users. The one exception is if you would have been a user in your younger years. For example, in the case of an education company, you may not need to use the service right now, but are positive you would have used it in your not so distant past. Note however that the further you are from your former self, the lower your odds of success.
While I don’t know Mark Zuckerberg or the Twitter founders personally, I believe from their well-documented stories that they would see themselves as making products in this quadrant. There is also a long list of companies creating new products to improve lives by facilitating healthful habits. Whether getting users to exercise more, creating a habit of journaling, or improving back posture, these companies are run by authentic entrepreneurs who desperately want their products to exist, firstly to satisfy their own needs.
But what about when an addiction to a well-intended product becomes extreme, even harmful? For a product in this quadrant, I agree with Paul Graham in saying the responsibility falls to the user. In any normal distribution, a small percentage of people will be on the extremes. If the designers make a product that they would use themselves, and they believe it improves the lives of their users, they have fulfilled their moral obligation. To take liberties with Mahatma Gandhi, facilitators “build the change they want to see in the world.”
But heady altruistic ambitions can at times, get ahead of reality. Too often, designers of manipulative technology have a strong motivation to improve the lives of their users, but when pressed, they admit they would not actually use their own creations. Their holier-than-thou products often try to “gamify” some task no one actually wants to do by inserting hackneyed incentives like badges or points that don’t actually hold value for the user.
Fitness apps, charity websites, and products that claim to suddenly turn hard work into fun often fall in this quadrant. But possibly the most common example is in peddler advertising. Countless companies convince themselves they’re making ad campaigns users will love. They expect their videos to go viral and their branded apps to be used daily. Their reality distortion fields keep them from asking the critical question of, “Would I actually find this useful?” The answer to this uncomfortable question is nearly always “No,” so they bend their brain into the mind of a user they believe might find the ad valuable.
Materially improving users’ lives is a tall order. But attempting to create a persuasive technology which you don’t find valuable enough to use yourself is nearly impossible. There’s nothing immoral about peddling; it’s just the odds of success are depressingly low. You’ll lack the empathy and insights needed to create something users actually want. The peddler’s project tends to end up a time-wasting failure because fundamentally, no one finds it useful or fun. If it were, the peddler would be using it instead of hawking it.
In fact, sometimes makers just want to have fun. If a creator of a potentially addictive technology makes something that they would use but can’t in good conscience claim improves the lives of their users, they’re making entertainment.
Entertainment is art and is important for its own sake. Art provides joy, helps us see the world differently, and connects us with the human condition. These are all important and age old pursuits. Entertainment, however, has particular attributes which the entrepreneur, employee, and investor should be aware of when using the Manipulation Matrix.
Art is often fleeting; products that form addictions around entertainment tend to fade quickly from users’ lives. A hit song, repeated over and over again in the mind, becomes nostalgia after it is replaced by the next single. A blog article like this one is read, shared, and thought about for a few minutes until the next interesting piece of brain candy comes along. Games like Farmville and Angry Birds engross users for a while, but then are relegated to the gaming dustbin along other hyper-addictive has-beens like Pac Man and Tetris.
Entertainment is a hits-driven business because the brain adapts to stimulus. Art is about creating continuous novelty and building an enterprise on ephemeral desires is a constantly running treadmill. In this quadrant, the sustainable business isn’t the game, the song, or the book — it’s the distribution system for getting those goods to market while they’re still hot.
Creating a product that the designer does not believe improves the user’s life and which the maker would not use is exploitation. In the absence of these two criteria, presumably the only reason you’re hooking users is to make a buck. Certainly there is money to be made addicting users to behaviors that do little more than extract cash; and where there is cash, there will be someone willing to take it.
The question is: Is that someone you? Casinos and drug dealers offer users a good time, but when the addiction takes hold, the fun stops.
In a satirical take on Zynga’s Farmville franchise Ian Bogost created Cow Clicker, a Facebook app where users did nothing but incessantly click on virtual cows to hear a satisfying “moo.” Bogost intended to lampoon Farmville by blatantly implementing the same game mechanics and viral hacks he thought would be laughably obvious to users. But after the app’s usage exploded and some people became frighteningly obsessed with the game, Bogost shut it down, bringing on what he called, “The Cowpocalypse.”
Judging for Yourself
Bogost was right in comparing addictive technology to the cigarette. Certainly, the incessant need for a smoke in what was once the majority of the adult population has been replaced by a nearly equal compulsion to constantly check our devices. But unlike the addiction to nicotine, new technologies offer an opportunity to dramatically improve the lives of users. It’s clear that like all technologies, recent advances in the habit-forming potential of web innovation have both positive and negative effects.
But if the innovator has a clear conscience that the product materially improves people’s lives — first among them, the creator’s — then the only path is to push forward. Users bear ultimate responsibility for their actions and makers should not be blamed for the misuse or overuse of their products.
However, as the march of technology makes the world a more addictive place, innovators need to consider their role. It will be years, perhaps generations, before society develops the antibodies to new addictions. In the meantime, users will have to judge the yet unknown consequences for themselves, while creators will have to live with the moral repercussions of how they spend their professional lives.
My hope is that Manipulation Matrix helps innovators consider the implications of the products they create. Perhaps after reading this, you’ll start a new business. Maybe you’ll join an existing company with a mission you believe in. Or, perhaps after reading this you’ll decide it’s time to quit your job, which you now come to realize no longer agrees with your moral compass.
Top Consumer Psychology Articles
- The New Norms of Business: Interview with Nathalie Nahai
- Can We Regulate Social Networks To Curb Addiction—Without Making Them Suck?
- So, You Want To Become a Great Product Manager? [Q&A with Jackie Bavaro]
- Will Clubhouse be a Habit or Has-Been?
- The One Fitness App That Hooked Me For Good
- Here’s How Fortnite ‘Hooked’ Millions
- How Apps Can Shape Your Future Self
- How Netflix’s Customer Obsession Created a Customer Obsession
- Want to Design User Behavior? Pass the ‘Regret Test’ First
- How to Trigger Product Usage that Sticks
- Avoiding Bystander Effect: Getting People to Help Each Other
- Here’s How Amazon’s Alexa Hooks You
- How to Use Psychology to Make Persuasive Video
- How to Use Personality Science to Drive Online Conversions
- The Unbelievable Future of Habit-Forming Technology
- The Secret Marketing Power of Evolutionary Psychology
- Don’t Ask People What They Want, Watch What They Do
- How Cognitive Biases Can Help (and Hurt) Your Business
- What Most People Don’t Know About Behavioral Design
- How to Start a Career in Behavioral Design
- Your World is Full of Placebo Buttons (and That’s a Good Thing)
- How to Build Technology that Feels Like a Friend
- 3 Pillars of the Most Successful Tech Products
- Here’s How to Ethically Manipulate Other People
- How Two Companies Hooked Customers On Products They Rarely Use
- How to Hook Users in 3 Steps: An Intro to Habit Testing
- Die Dashboards, Die! Why Conversations Will Reinvent Software
- The Secret to Sending Emails and Notifications That Work
- How to Win Your Competition’s Customers
- Hooked for Good: How Habit-Forming Products Improve Lives
- Good Products Start With Good Questions
- Human + A.I. = Your Digital Future
- Why ‘Assistant-As-App’ Might Be the Next Big Tech Trend
- People Don’t Want Something Truly New, They Want the Familiar Done Differently.
- 4 Ways to Win Your Competitor’s Customer Habits (Slides)
- Here’s Why You’ll Hate the Apple Watch (and the Important Business Lesson You Need to Know)
- The Secret Psychology of Snapchat
- The Psychology of Notifications: How to Send Triggers that Work
- How Technology Tricks You Into Tipping More
- Building Community Starts with Understanding People
- When Persuasion Becomes Deception
- Mastering Pricing Principles
- A Handy Behavioral Design Toolkit
- Onboarding Matters – Getting Users Engaged in your Product
- The Limits of Loyalty: When Habits Change, You’re Toast
- Dual Process Theory: Is Your Product the Elephant or the Rider?
- 4 Ways to Use Psychology to Win Your Competition’s Customers
- Web Psychology – The Science of Online Persuasion
- Developing User Empathy with Design Sprints
- The Real Reason “Stupid” Startups Raise So Much Money
- Want To Be A Game Psychologist? What You Need to Know
- The Psychology Behind Why We Can’t Stop Messaging
- How to Do Effective User Research
- Context Driven Design (The “Context Effect”)
- The Psychology of a Billion-Dollar Enterprise App: Why is Slack so Habit-Forming?
- Writing Copy for Your Reader’s Brain
- Designing Habit-Forming Products
- Framing Reward is as Important as Reward Itself
- Games, Play, and Motivation
- How Scarcity & Impatience Drive Irrational User Behavior
- Should You Listen To Your Users or Your Data?
- Emotional Engagement – Designing with the Heart in Mind
- A Free Course on User Behavior
- It’s Not All Fun And Games: The Pros and Cons of Gamification at Work
- Product Psychology: The 3 Things Everyone Should Know About
- Getting Traction: How to Hook New Users
- Designing for Behavior Change Book Review
- The Sneaky Trick Behind the Explosive Growth of the Kardashian Game
- How Successful Companies Design for Users’ Multi-Device Lives
- The Link Between Habits and User Satisfaction
- What Triggers The Best Word of Mouth Marketing?
- What Tech Companies Can Learn from Rehab
- The Secrets of Addictive Online Auctions
- Teach or Hook? What’s the Real Goal of Online Education?
- Using Mind Control to Raise Startup Cash
- How To Build Habits In A Multi-Device World
- How To Cope with Your Insane Jealousy Of The WhatsApp Deal
- Why Do Fads Fade? The Inevitable Death Of Flappy Bird
- You’d Be Surprised By What Really Motivates Users
- Nostalgia: A Product Designer’s Secret Weapon
- How You Can Help Users Change Habits
- Is “Lean Startup” Right for Your Idea?
- Hunting for Habits: Keying in on smart design to make a product irresistible
- Are Companies Too Obsessed With Growth? How to Measure Habits
- Refresh: The App a Secret Agent Would Love
- Angel or Devil: Who’s Really Investing In Your Start-Up?
- In 10 Years, We Won’t Use Personal Technology
- 4 Simple Things I Did to Control My Bad Tech Habits
- “Yes, And”: The Two Words that Created a #1 App
- From Laid to Paid: How Tinder Set Fire to Online Dating
- What if In-App Purchases Came to Real Life?
- Hooking Users One Snapchat at a Time
- How To Save Your Startup From The “Spotlight Effect”
- Bible App: Getting 100M Downloads is Psychology, Not a Miracle
- How to Boost Desire Using the Psychology of Scarcity
- Marketplaces & The Curse of the Network Effect
- Today’s Behaviors, Tomorrow’s Startups
- Venture Capital and The Superstitious Investor
- The Future is Driven by Interface Changes
- Why Business is Addicted to Habits
- Viral Loops Or Viral ‘Oops’?
- Making a Marketplace
- What Killed Turntable.fm?
- What You Don’t Know About Human Intuition Can Hurt You
- Designing to Reward our Tribal Sides
- New Video – “Hooked: Building Habit-Forming Products”
- How Technology is Like Bug Sex
- Ways To Get People To Do Things They Don’t Want To Do
- The Network Effect Isn’t Good Enough
- Mass Persuasion, One User At A Time
- How Investment Drives Engagement (Slides)
- Getting Your Product Into the Habit Zone
- Where Have The Users Gone?
- Infinite Scroll: The Web’s Slot Machine
- Designing User Habits Video
- Psychology of Sports: How Sports Infect Your Brain
- This is Your Brain On Boarding: How to Turn Visitors Into Users
- User Investment: Make Your Users Do the Work
- Behavior by Design Video
- When Designing for Good Is Bad
- Stop Building Apps, Start Building User Behaviors
- The Next Secrets of the Internet
- User Growth and Engagement: A Hacker Metric
- Spotting the Next Facebook: Why Emotions are Big Business
- The Billion Dollar Mind Trick: An Intro to Triggers
- Why Everyone Hates I.T. People
- Hooking Users In 3 Steps: An Intro to Habit Testing
- Abolish The Reference Check
- Variable Rewards: Want To Hook Users? Drive Them Crazy
- How to Design Behavior (The Behavior Change Matrix)
- How To Design For “Normals”
- The Hook Model: How to Manufacture Desire in 4 Steps
- User Habits: Why Startups Must Be Behavior Experts
- What Is, and Is Not, Your Product’s Job
- Pinterest’s Obvious Secret
- Personalized eCommerce Is Already Here, You Just Don’t Recognize It
- Where is the Web Going?
- The Developer Divide: When Great Companies Can’t Hire
- Being a Quitter Makes You a Good Entrepreneur
- Behavior by Design
- Why You Should Run Your Business Barefoot
- Are you a Startup Star, Wacko, or Wannabe?