Statistics Done Wrong

Book description

Scientific progress depends on good research, and good research needs good statistics. But statistical analysis is tricky to get right, even for the best and brightest of us. You'd be surprised how many scientists are doing it wrong.

Statistics Done Wrong is a pithy, essential guide to statistical blunders in modern science that will show you how to keep your research blunder-free. You'll examine embarrassing errors and omissions in recent research, learn about the misconceptions and scientific politics that allow these mistakes to happen, and begin your quest to reform the way you and your peers do statistics.

You'll find advice on:

  • Asking the right question, designing the right experiment, choosing the right statistical analysis, and sticking to the plan
  • How to think about p values, significance, insignificance, confidence intervals, and regression
  • Choosing the right sample size and avoiding false positives
  • Reporting your analysis and publishing your data and source code
  • Procedures to follow, precautions to take, and analytical software that can help

Scientists: Read this concise, powerful guide to help you produce statistically sound research. Statisticians: Give this book to everyone you know.

The first step toward statistics done right is Statistics Done Wrong.

Publisher resources

View/Submit Errata

Table of contents

  1. Cover
  2. Praise for Statistics Done Wrong
  3. Statistics Done Wrong: The Woefully Complete Guide
  4. Copyright
  5. Contents
  6. About the Author
  7. Preface
    1. Acknowledgments
  8. Introduction
  9. 1. An Introduction to Statistical Significance
    1. The Power of p Values
      1. Psychic Statistics
      2. Neyman-Pearson Testing
    2. Have Confidence in Intervals
  10. 2. Statistical Power and Underpowered Statistics
    1. The Power Curve
    2. The Perils of Being Underpowered
      1. Wherefore Poor Power?
      2. Wrong Turns on Red
    3. Confidence Intervals and Empowerment
    4. Truth Inflation
      1. Little Extremes
  11. 3. Pseudoreplication: Choose Your Data Wisely
    1. Pseudoreplication in Action
    2. Accounting for Pseudoreplication
    3. Batch Biology
    4. Synchronized Pseudoreplication
  12. 4. The P Value and the Base Rate Fallacy
    1. The Base Rate Fallacy
      1. A Quick Quiz
      2. The Base Rate Fallacy in Medical Testing
      3. How to Lie with Smoking Statistics
      4. Taking Up Arms Against the Base Rate Fallacy
    2. If At First You Don’t Succeed, Try, Try Again
    3. Red Herrings in Brain Imaging
    4. Controlling the False Discovery Rate
  13. 5. Bad Judges of Significance
    1. Insignificant Differences in Significance
    2. Ogling for Significance
  14. 6. Double-Dipping in the Data
    1. Circular Analysis
    2. Regression to the Mean
    3. Stopping Rules
  15. 7. Continuity Errors
    1. Needless Dichotomization
    2. Statistical Brownout
    3. Confounded Confounding
  16. 8. Model Abuse
    1. Fitting Data to Watermelons
    2. Correlation and Causation
    3. Simpson’s Paradox
  17. 9. Researcher Freedom: Good Vibrations?
    1. A Little Freedom Is a Dangerous Thing
    2. Avoiding Bias
  18. 10. Everybody Makes Mistakes
    1. Irreproducible Genetics
    2. Making Reproducibility Easy
    3. Experiment, Rinse, Repeat
  19. 11. Hiding the Data
    1. Captive Data
      1. Obstacles to Sharing
      2. Data Decay
    2. Just Leave Out the Details
      1. Known Unknowns
      2. Outcome Reporting Bias
    3. Science in a Filing Cabinet
      1. Unpublished Clinical Trials
      2. Spotting Reporting Bias
      3. Forced Disclosure
  20. 12. What Can Be Done?
    1. Statistical Education
    2. Scientific Publishing
    3. Your Job
  21. A. Notes
    1. Introduction
    2. Chapter 1
    3. Chapter 2
    4. Chapter 3
    5. Chapter 4
    6. Chapter 5
    7. Chapter 6
    8. Chapter 7
    9. Chapter 8
    10. Chapter 9
    11. Chapter 10
    12. Chapter 11
    13. Chapter 12
  22. B. Colophon
  23. Index

Product information

  • Title: Statistics Done Wrong
  • Author(s): Alex Reinhart
  • Release date: March 2015
  • Publisher(s): No Starch Press
  • ISBN: 9781593276201