Distorted visions 3

Brian Josephson's arguments are scientifically and statistically correct.

In contrast, the statement of Richard Wiseman - "I don't see how you could argue there's anything wrong with having to get five out of seven when (Natasha) agrees with the target in advance" - demonstrates a lack of understanding of how experimental data should be interpreted statistically.

The experiment is woefully inadequate. The chance of the observed four successes in seven subjects by pure guessing is 1 in 78. But suppose Natasha had a diagnosis rate of 1 in 2, compared with the chance rate of 1 in 7: then there is equal chance of getting 4 or more from 7, or 3 or less from 7. That is, the probability of detecting a true 50 per cent diagnosis rate on 7 subjects using a 0.01 significance level is only 50 per cent. There should have been at least 21 subjects to ensure a 90 per cent probability of detecting a true diagnosis rate of 50 per cent (using a 0.01 significance level test). Only if Natasha had a true diagnosis rate as high as 72 per cent would there have been a 90 per cent chance of detecting the effect using a 0.01 test on 7 subjects.

The experiment had high chances of failing to detect important effects, but this may have been due merely to no statistician being involved.

Keith Rennolls
Professor of applied statistics
University of Greenwich

Already registered?

Sign in now if you are already registered or a current subscriber. Or subscribe for unrestricted access to our digital editions and iPad and iPhone app.

Register to continue  

You've enjoyed reading five THE articles this month. Register now to get five more, or subscribe for unrestricted access.

Most Commented

  • Man measuring bar graphs with tape measure

An Elsevier analysis explores the viability of a ‘smarter and cheaper’ model

  • David Willetts

The former universities minister discusses the reforms that reshaped higher education and his first steps into academia

  • Man holding a box filled with work-related items

Refusal by John Allen to obey instruction from manager at Queen Mary University of London led to his sacking, tribunal rules

  • A black and white crowd scene with a few people highlighted

What are the key issues local union branches are dealing with, and how do they manage relationships with institutions in what many activists argue is an increasingly confrontational environment?

  • Muslim woman at graduation ceremony, Barbican, London

Sector called on to embrace faith-related concerns in intellectual debates