Business Daily Media

Humans learn from mistakes — so why do we hide our failures?

  • Written by Ben Newell, Professor of Cognitive Psychology, UNSW

A few years ago I had the pleasure of listening to the highly-influential legal scholar Cass Sunstein speak in the flesh. Cass wrote the best-selling book Nudge[1], along with his long-time collaborator Richard Thaler.

Thaler subsequently won the Nobel Prize in Economics[2] and Cass went to the White House to head up a team advising the Obama administration[3].

It was among the first of what came to be hundreds[4] of government[5] teams[6] around the world using their insights into human behaviour to improve what governments did.

Cass was speaking in Canberra[7] and I asked whether he could talk about nudges that hadn’t worked. His initial answer surprised me – he said none came to mind.

So what is nudging?

To backtrack, it’s important to understand what a nudge is. The concept is based on the idea that people often act “irrationally”.

By itself this isn’t a particularly useful insight. What is a useful is the insight that they behave irrationally in ways we can predict.

Here’s one. We are lazy, so when placed with a plethora of offers about what to buy or sign up to we often stick with what we’ve got, the “don’t need to think about it option”, even when there are better deals on the table.

Read more: The psychology of Christmas shopping: how marketers nudge you to buy[8]

And we tend to value the present over the future – so while we know we shouldn’t eat junk food, we often prioritise short-term satisfaction over long-term health.

These insights into behavioural regularities allow us to tailor government programs to get better outcomes.

For example, in Britain 80% of people say they are willing to donate an organ when they die, but only 37% put their names on the register.

To bridge this gap the government is changing the system[9] so that the default option is to be a donor.

Read more: An opt-out system isn't the solution to Australia's low rate of organ donation[10]

People can still opt-out if they want to – but the simple switch is likely to save as many as 700 lives per year.

We like to behave like those around us, so here in Australia to help combat the rise of drug-resistant superbugs, the chief medical officer wrote to the highest prescribers of antibiotics[11] pointing out they weren’t in line with their peers.

It cut the prescribing rate of the highest prescribers by 12% in six months.

Then why was Cass’ answer surprising?

I was surprised because nudging promotes rigorous trials, evidence and testing – so it’s hard to believe every proposal would be found to have worked.

Humans learn from mistakes — so why do we hide our failures? Cass Sunstein at the BETA conference. BETA[12]

In science, experiments frequently throw up unexpected results.

Only publishing the results of successful trials would lead to bulging cabinets of failures from which we would never learn.

Given that failure is one of our most effective teachers, it would be a huge missed opportunity.

And the false positives[13] that would be published along with any genuine positives would inflate the belief that the intervention worked.

Any experiment involving an element of randomness (in the subjects selected or conditions in which it was conduced) will occasionally report a positive effect that wasn’t there.

This “replication crisis[14]” has been recognised as big problem in psychology and economics, with many previously results being thrown into doubt[15].

Thankfully things are changing for the better. There are a range of initiatives encouraging the publication of both positive and negative results, along with a far greater awareness of these questionable research practices.

Read more: The replication crisis has engulfed economics[16]

And they are embraced by the Australian government’s own Behavioural Economics Team, BETA[17], with whom I work.

To guard against the publishing of only results that fit a narrative, BETA pre-registers its analysis plan, which means it can’t decide to pick out only the results that fit a particular story once the trial is done.

BETA has also set up an external advisory panel of academics[18] (on which I sit) to give independent advice on transparency, trial design and analysis.

It has had some very[19] successful[20] trials[21], but also some with surprising results.

When it set out to discover whether a fact sheet enabling households to compare electricity plans would encourage them to switch to better ones it discovered (at least in the experiment conducted) it did not[22].

When it set out to discover whether removing identifying information from public service job applications would increase the proportion of women and minorities shortlisted for interviews it discovered (at least in the experiment conducted) it did not[23].

These findings give us just as much useful information as the trials that were “successful”. They can help the government design better programs.

There’s a happy ending to this story

Back at the conference, after his initial answer Cass reflected further. He did recall some failures, and he talked about the lessons learned.

Since then, he has even published a paper, Nudges that Fail[24] that provides insights every bit as good as those from nudges that succeed.

Feel free to check out BETA’s list[25], the good and the bad.

It’s important to embrace mistakes, and to make more than a few. It’s the only way to be sure we are really learning.


  1. ^ Nudge (
  2. ^ Nobel Prize in Economics (
  3. ^ Obama administration (
  4. ^ hundreds (
  5. ^ government (
  6. ^ teams (
  7. ^ in Canberra (
  8. ^ The psychology of Christmas shopping: how marketers nudge you to buy (
  9. ^ changing the system (
  10. ^ An opt-out system isn't the solution to Australia's low rate of organ donation (
  11. ^ highest prescribers of antibiotics (
  12. ^ BETA (
  13. ^ false positives (
  14. ^ replication crisis (
  15. ^ thrown into doubt (
  16. ^ The replication crisis has engulfed economics (
  17. ^ BETA (
  18. ^ external advisory panel of academics (
  19. ^ very (
  20. ^ successful (
  21. ^ trials (
  22. ^ it did not (
  23. ^ it did not (
  24. ^ Nudges that Fail (
  25. ^ BETA’s list (

Authors: Ben Newell, Professor of Cognitive Psychology, UNSW

Read more

Business Reports

How to Deal With An HMRC Enquiry?

If you get that morning call or letter from the HMRC that they would like to investigate your tax position, you will most likely panic. You will not know what awaits you if this is your first time facing a tax investigation by H...

Why some are rich, others are poor – and what it means for future prosperity

What makes a nation wealthy?Getty ImagesWhy are some nations rich and others poor? Can the governments of poor nations do something to ensure that their nations become rich? These sorts of questions have long fascinated public off...

Creating my own space in the start-up tech industry

When I ventured out to launch a start-up targeting mums, I knew it wasn’t going to be easy. In a field that is heavily male-dominated, the gender funding gap is ever-present, with some suggesting the issue stems from bias that...

Australian CEO reaches record breaking donation goal

Leading Australian entrepreneur and philanthropist Chris Christofi has achieved his ambitious record-breaking goal to raise $250,000 for people experiencing homelessness, following the Vinnies CEO Sleepout which took place at th...

Biden says it will provide ‘a little bit of relief’ – but experts say even that may be a stretch

Gas prices are at record highs. AP Photo/Gene J. PuskarPresident Joe Biden called on Congress to suspend the federal gas tax to “bring families just a little bit of relief” as average gasoline prices exceed US$5 a gall...

Yes, fireworks prices are skyrocketing, but there should be plenty of bottle rockets and sparklers for you and your family this Fourth of July

Many cities, such as New York, returned to hosting big public displays in 2021 after skipping 2020 due to the pandemic. AP Photo/John MinchilloIf you’re looking forward to shooting off bottle rockets and Roman candles this F...

Content & Technology Connecting Global Audiences

More Information - Less Opinion