Statistics for experimenters: design, innovation, and discovery
The DOI matches its Crossref record.
Abstract
Preface to the Second Edition. Chapter 1. Catalizing the Generation of Knowledge. 1.1. The Learning Process. 1.2. Important Considerations. 1.3. The Experimenter's Problem and Statistical Methods. 1.4. A Typical Investigation. 1.5. How to Use Statistical Techniques. References and Further Reading. Chapter 2. Basics: Probability, Parameters and Statistics. 2.1. Experimental Error. 2.2. Distributions. 2.3. Statistics and Parameters. 2.4. Measures of Location and Spread. 2.5. The Normal Distribution. 2.6. Normal Probability Plots. 2.7. Randomness and Random Variables. 2.8. Covariance and Correlation as Measures of Linear Dependence. 2.9. Student's t Distribution. 2.10. Estimates of Parameters. 2.11. Random Sampling from a Normal Population. 2.12. The Chi-Square and F Distributions. 2.13. The Binomial Distribution. 2.14. The Poisson Distribution. Appendix 2A. Mean and Variance of Linear Combinations of Observations. References and Further Reading. Chapter 3. Comparing Two Entities: Relevant Reference Distributions, Tests and Confidence Intervals. 3.1. Relevant Reference Sets and Distributions. 3.2. Randomized Paired Comparison Design: Boys' Shoes Example. 3.3. Blocking and Randomization. 3.4. Reprise: Comparison, Replication, Randomization, and Blocking in Simple Experiments. 3.5. More on Significance Tests. 3.6. Inferences About Data that are Discrete: Binomial Distribution. 3.7. Inferences about Frequencies (Counts Per Unit): The Poisson Distribution. 3.8. Contingency Tables and Tests of Association. Appendix 3A. Comparison of the Robustness of Tests to Compare Two Entities. Appendix 3B. Calculation of reference distribution from past data. References and Further Reading. Chapter 4. Comparing a Number of Entities: Randomized Blocks and Latin Squares. 4.1. Comparing k Treatments in a Fully Randomized Design. 4.2. Randomized Block Designs. 4.3. A Preliminary Note on Split-Plot Experiments and their Relationship to Randomized Blocks. 4.4. More than one blocking component: Latin Squares. 4.5. Balanced Incomplete Block Designs. Appendix 4A. The Rationale for the Graphical ANOVA. Appendix 4B. Some Useful Latin Square, Graeco-Latin Square, and Hyper-Graeco-Latin Square Designs. References and Further Reading. Chapter 5. Factorial Designs at Two Levels: Advantages of Experimental Design. 5.1. Introduction. 5.2. Example 1: The Effects of Three Factors (Variables) on Clarity of Film. 5.3. Example 2: The Effects of Three Factors on Three Physical Properties of a Polymer Solution. 5.4. A 23 Factorial Design: Pilot Plant Investigation. 5.5. Calculation of Main Effects. 5.6. Interaction Effects. 5.7. Genuine Replicate Runs. 5.8. Interpretation of Results. 5.9. The Table of Contrasts. 5.10. Misuse of the ANOVA for 2k Factorial Experiments. 5.11. Eyeing the Data. 5.12. Dealing with More Than One Response: A Pet Food Experiment. 5.13. A 24 Factorial Design: Process Development Study. 5.14. Analysis Using Normal and Lenth Plots. 5.15. Other Models for Factorial Data. 5.16. Blocking the 2k Factorial Designs. 5.17. Learning by Doing. 5.18. Summary. Appendix 5A. Blocking Larger Factorial Designs. Appendix 5B. Partial Confounding. References and Further Reading. Chapter 6. Fraction Factorial Designs: Economy in Experimentation. 6.1. Effects of Five Factors on Six Properties of Films in Eight Runs. 6.2. Stability of New Product, Four Factors in Eight Runs, a 24 1 Design. 6.3. A Half-Fraction Example: The Modification of a Bearing. 6.4. The Anatomy of the Half Fraction. 6.5. The 27 4III Design: A Bicycle Example. 6.6. Eight-Run Designs. 6.7. Using Table 6.6: An Illustration. 6.8. Sign Switching, Foldover, and Sequential Assembly. 6.9. An Investigation Using Multiple-Column Foldover. 6.10. Increasing Design Resolution from III to IV by Foldover. 6.11. Sixteen-Run Designs. 6.12. The 25 1 Nodal Half Replicate of the 25 Factorial: Reactor Example. 6.13. The 28 4 IV Nodal Sixteenth Fraction of a 28 Factorial. 6.14. The 215 11 III Nodal Design: The Sixty-Fourth Fraction of the 215 Factorial. 6.15. Constructing Other Two-Level Fractions. 6.16. Elimination of Block Effects. References and Further Reading. Chapter 7. Other Fractionals, Analysis and Choosing Follow-up Runs. 7.1. Plackett and Burman Designs. 7.2. Choosing Follow-Up Runs. 7.3. Justifications for the Use of Fractionals. Appendix 7A. Technical Details. Appendix 7B. An Approximate Partial Analysis for PB Designs. Appendix 7C. Hall's Orthogonal Designs. References and Further Reading. Chapter 8. Factorial Designs and Data Transformation. 8.1. A Two-Way (Factorial) Design. 8.2. Simplification and Increased Sensitivity from Transformation. Appendix 8A. Rationale for Data Transformation. Appendix 8B. Bartlett's chi2nu for Testing Inhomogeneity of Variance. References and Further Reading. Chapter 9. Multiple Sources of Variation: Split Plot Designs, Variance Components and Error Transmission. 9.1. Split-Plot Designs, Variance Components, and Error Transmission. 9.2. Split-Plot Designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Artificial intelligence and statistics
Yu, B., & Kumbier, K. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700813 · Cited by 2,329
A compound event framework for understanding extreme impacts
Leonard, M., Westra, S., Phatak, A., Lambert, M., van den Hurk, B., McInnes, K., Risbey, J., Schuster, S., Jakob, D., & Stafford‐Smith, M. (2014) · WIREs Climate Change · doi:10.1002/wcc.252 · Cited by 869
Saltelli, A., Aleksankina, K., Becker, W., Fennell, P., Ferretti, F., Holst, N., Li, S., & Wu, Q. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.01.012 · Cited by 813
In Pursuit of Balance: Randomization in Practice in Development Field Experiments
Bruhn, M., & McKenzie, D. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.4.200 · Cited by 788
Statistical practice in high-throughput screening data analysis
Malo, N., Hanley, J. A., Cerquozzi, S., Pelletier, J., & Nadon, R. (2006) · Nature Biotechnology · doi:10.1038/nbt1186 · Cited by 721
Controlled experiments on the web: survey and practical guide
Kohavi, R., Longbotham, R., Sommerfield, D., & Henne, R. M. (2009) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-008-0114-1 · Cited by 690
Fundamentals of Emulsion Polymerization
Lovell, P. A., & Schork, F. J. (2020) · Biomacromolecules · doi:10.1021/acs.biomac.0c00769 · Cited by 579
The Econometrics of Randomized Experiments
(2017) · Handbook of Economic Field Experiments · doi:10.1016/bs.hefe.2016.10.003 · Cited by 562
Nanoparticle synthesis assisted by machine learning
Tao, H., Wu, T., Aldeghi, M., Wu, T. C., Aspuru-Guzik, A., & Kumacheva, E. (2021) · Nature Reviews Materials · doi:10.1038/s41578-021-00337-5 · Cited by 545
Experimental design in chromatography: A tutorial review
Hibbert, D. B. (2012) · Journal of Chromatography B · doi:10.1016/j.jchromb.2012.01.020 · Cited by 449
Trajectory Design for Completion Time Minimization in UAV-Enabled Multicasting
Zeng, Y., Xu, X., & Zhang, R. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2018.2790401 · Cited by 440
Online controlled experiments at large scale
Kohavi, R., Deng, A., Frasca, B., Walker, T., Xu, Y., & Pohlmann, N. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488217 · Cited by 433
Chan, K. Y., Dillon, T. S., Singh, J., & Chang, E. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2174051 · Cited by 430
An overview of experimental designs in HPLC method development and validation
Sahu, P. K., Ramisetti, N. R., Cecchi, T., Swain, S., Patro, C. S., & Panda, J. (2018) · Journal of Pharmaceutical and Biomedical Analysis · doi:10.1016/j.jpba.2017.05.006 · Cited by 392
Sakkas, V. A., Islam, M. A., Stalikas, C., & Albanis, T. A. (2010) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2009.10.050 · Cited by 381
Practical guide to controlled experiments on the web: listen to your customers not to the hippo
Kohavi, R., Henne, R. M., & Sommerfield, D. (2007) · Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1281192.1281295 · Cited by 377
Faith, J. J., Ahern, P. P., Ridaura, V. K., Cheng, J., & Gordon, J. I. (2014) · Science Translational Medicine · doi:10.1126/scitranslmed.3008051 · Cited by 373
Lan, L., & Lian, Z. (2010) · Building and Environment · doi:10.1016/j.buildenv.2009.11.002 · Cited by 360
Experimental design of supercritical fluid extraction – A review
Sharif, K. M., Rahman, M. M., Azmir, J., Mohamed, A., Jahurul, M. H. A., Sahena, F., & Zaidul, I. S. M. (2014) · Journal of Food Engineering · doi:10.1016/j.jfoodeng.2013.10.003 · Cited by 311
Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
Kohavi, R., Tang, D., & Xu, Y. (2020) · doi:10.1017/9781108653985 · Cited by 297
Recent trends on hybrid modeling for Industry 4.0
Sansana, J., Joswiak, M. N., Castillo, I., Wang, Z., Rendall, R., Chiang, L. H., & Reis, M. S. (2021) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2021.107365 · Cited by 296
Woo, Y. H., Ansari, H., Otto, T. D., Klinger, C. M., Kolisko, M., Michálek, J., Saxena, A., Shanmugam, D., Tayyrov, A., Veluchamy, A., et al. (2015) · eLife · doi:10.7554/elife.06974 · Cited by 295
What exactly is ‘N’ in cell culture and animal experiments?
Lazic, S. E., Clarke-Williams, C. J., & Munafò, M. R. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2005282 · Cited by 291
Immobilised enzymes in biorenewables production
Franssen, M. C. R., Steunenberg, P., Scott, E. L., Zuilhof, H., & Sanders, J. P. M. (2013) · Chemical Society Reviews · doi:10.1039/c3cs00004d · Cited by 289
Tang, L., Zhao, Y., & Liu, J. (2014) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2250977 · Cited by 287
Gunay, H. B., O'Brien, W., & Beausoleil-Morrison, I. (2013) · Building and Environment · doi:10.1016/j.buildenv.2013.07.020 · Cited by 285
An evaluation of adaptive surrogate modeling based optimization with two benchmark problems
Wang, C., Duan, Q., Gong, W., Ye, A., Di, Z., & Miao, C. (2014) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2014.05.026 · Cited by 271
Microplastic accumulation in benthic invertebrates in Terra Nova Bay (Ross Sea, Antarctica)
Sfriso, A. A., Tomio, Y., Rosso, B., Gambaro, A., Sfriso, A., Corami, F., Rastelli, E., Corinaldesi, C., Mistri, M., & Munari, C. (2020) · Environment International · doi:10.1016/j.envint.2020.105587 · Cited by 267
Split-Plot Designs: What, Why, and How
Jones, B., & Nachtsheim, C. J. (2009) · Journal of Quality Technology · doi:10.1080/00224065.2009.11917790 · Cited by 242
Improving the sensitivity of online controlled experiments by utilizing pre-experiment data
Deng, A., Xu, Y., Kohavi, R., & Walker, T. (2013) · Proceedings of the sixth ACM international conference on Web search and data mining · doi:10.1145/2433396.2433413 · Cited by 223
Ruggedness and robustness testing
Dejaegher, B., & Heyden, Y. V. (2007) · Journal of Chromatography A · doi:10.1016/j.chroma.2007.02.086 · Cited by 221
Kawa, A. B., Bentzley, B. S., & Robinson, T. E. (2016) · Psychopharmacology · doi:10.1007/s00213-016-4393-8 · Cited by 208
Nanoemulsions of β-carotene using a high-energy emulsification–evaporation technique
Silva, H. D., Cerqueira, M. A., Souza, B. W. S., Ribeiro, C., Avides, M. C., Quintas, M. A. C., Coimbra, J. S. R., Carneiro-da-Cunha, M. G., & Vicente, A. A. (2011) · Journal of Food Engineering · doi:10.1016/j.jfoodeng.2010.08.005 · Cited by 184
Heleno, S. A., Diz, P., Prieto, M. A., Barros, L., Rodrigues, A., Barreiro, M. F., & Ferreira, I. C. F. R. (2016) · Food Chemistry · doi:10.1016/j.foodchem.2015.11.108 · Cited by 184
Designing and deploying online field experiments
Bakshy, E., Eckles, D., & Bernstein, M. S. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2567967 · Cited by 178
Ranc, B., Faure, P., Croze, V., & Simonnot, M. O. (2016) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2016.03.068 · Cited by 174
Davies, K. W. (2011) · Oecologia · doi:10.1007/s00442-011-1992-2 · Cited by 158
Albuquerque, B. R., Prieto, M. A., Barreiro, M. F., Rodrigues, A., Curran, T. P., Barros, L., & Ferreira, I. C. F. R. (2017) · Industrial Crops and Products · doi:10.1016/j.indcrop.2016.10.050 · Cited by 154
Mining the human gut microbiota for effector strains that shape the immune system
Ahern, P. P., Faith, J. J., & Gordon, J. I. (2014) · Immunity · doi:10.1016/j.immuni.2014.05.012 · Cited by 123
Kelders, S. M., Bohlmeijer, E. T., Pots, W. T. M., & van Gemert-Pijnen, J. E. W. C. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.014 · Cited by 105
An Efficient Bandit Algorithm for Realtime Multivariate Optimization
Hill, D. N., Nassif, H., Liu, Y., Iyer, A., & Vishwanathan, S. V. N. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098184 · Cited by 113
Huang, M., Luo, J., Fang, Z., & Li, H. (2016) · Applied Catalysis B: Environmental · doi:10.1016/j.apcatb.2016.02.069 · Cited by 112
Pinela, J., Prieto, M. A., Barreiro, M. F., Carvalho, A. M., Oliveira, M. B. P. P., Curran, T. P., & Ferreira, I. C. F. R. (2017) · Innovative Food Science & Emerging Technologies · doi:10.1016/j.ifset.2017.02.004 · Cited by 77
Roriz, C. L., Barros, L., Prieto, M. A., Morales, P., & Ferreira, I. C. F. R. (2017) · Food Chemistry · doi:10.1016/j.foodchem.2017.02.073 · Cited by 66
Pinela, J., Prieto, M. A., Barreiro, M. F., Carvalho, A. M., Oliveira, M. B. P. P., Vázquez, J. A., & Ferreira, I. C. F. R. (2016) · Food and Bioproducts Processing · doi:10.1016/j.fbp.2016.02.002 · Cited by 44
APF and dentifrice effect on root dentin demineralization and biofilm
Vale, G. C., Tabchoury, C. P. M., Del Bel Cury, A. A., Tenuta, L. M. A., ten Cate, J. M., & Cury, J. A. (2011) · Journal of Dental Research · doi:10.1177/0022034510383428 · Cited by 36
Siebert, M., Krennrich, G., Seibicke, M., Siegle, A. F., & Trapp, O. (2019) · Chemical Science · doi:10.1039/c9sc04591k · Cited by 32
Understanding adherence to web-based interventions
Kelders, S. M. (2012) · doi:10.3990/1.9789036534178 · Cited by 29
The effect of iron on Streptococcus mutans biofilm and on enamel demineralization
Ribeiro, C. C. C., Ccahuana-Vásquez, R. A., Carmo, C. D. S. D., Alves, C. M. C., Leitão, T. J., Vidotti, L. R., & Cury, J. A. (2012) · Brazilian Oral Research · doi:10.1590/s1806-83242012000400003 · Cited by 27
Metadata
- Venue
- Choice Reviews Online
- Publisher
- American Library Association
- Published
- 2006-02-01
- Volume
- 43
- Issue
- 06
- Pages
- 43-3429-43-3429
- ISSN
- 0009-4978 (ISSN-L)
- 1523-8253
- OpenAlex
- W1553296127
- Cited by
- 1,644
- References
- 0
- Type
- book review
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.