Cited by 2,184Optimal Experimental Design MethodsProbability and Statistical ResearchStatistical Methods in Clinical Trials

Some aspects of the sequential design of experiments

Open access
Robbins, Herbert·1952·Bulletin of the American Mathematical Society

Abstract

Introduction.Until recently, statistical theory has been restricted to the design and analysis of sampling experiments in which the size and composition of the samples are completely determined before the experimentation begins.The reasons for this are partly historical, dating back to the time when the statistician was consulted, if at all, only after the experiment was over, and partly intrinsic in the mathematical difficulty of working with anything but a fixed number of independent random variables.A major advance now appears to be in the making with the creation of a theory of the sequential design of experiments, in which the size and composition of the samples are not fixed in advance but are functions of the observations themselves.The first important departure from fixed sample size came in the field of industrial quality control, with the double sampling inspection method of Dodge and Romig [l].Here there is only one population to be sampled, and the question at issue is whether the proportion of defectives in a lot exceeds a given level.A preliminary sample of n\ objects is drawn from the lot and the number x of defectives noted.If x is less than a fixed value a the lot is accepted without further sampling, if x is greater than a fixed value b (a<b) the lot is rejected without further sampling, but if aSxSb then a second sample, of size w 2 , is drawn, and the decision to accept or reject the lot is made on the basis of the number of defectives in the total sample of Wi+n 2 objects.The total sample size n is thus a random variable with two values, n\ and ni+n2, and the value of n is stochastically dependent on the observations.A logical extension of the idea of double sampling came during World War II with the development, chiefly by Wald, of sequential analysis [2], in which the observations are made one by one and the decision to terminate sampling and to accept or reject the lot (or, more generally, to accept or reject whatever statistical "null hypothesis" is being tested) can come at any stage.The total sample size n now becomes a random variable capable in principle of assuming infinitely many values, although in practice a finite upper limit on n is usually set.The advantage of sequential An address delivered before the Auburn, Alabama, meeting of the Society,

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1090/s0002-9904-1952-09620-8

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The multi-armed bandit problem provides a well-studied theoretical framework for optimizing the selection of notification templates.

    “The multi-armed bandit problem provides a well-studied theoretical framework for optimizing the selection of templates in this context.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 9

  1. H. F. Dodge and H. G. Romig, A method of sampling inspection. Bell System Technical Journal vol. 8 (1929) pp. 613-631, and Single sampling and double sampling inspection tables, ibid. vol. 20 (1941) pp. 1-61.
  2. A. Wald, Sequential analysis, New York, Wiley, 1947.
  3. P. C. Mahalanobis, A sample survey of the acreage under jute in Bengal with dis- cussion of planning of experiments, Snakhyâ vol. 4 (1940) pp. 511-531.
  4. On large-scale sample surveys, Philos. Trans. Roy. Soc. London, Ser. B vol. 231 (1944) pp. 329-451.
  5. A. Wald, Statistical decision functions, New York, Wiley, 1950.
  6. H. Hotelling, Experimental determination of the maximum of a function, Ann. of Math. Statist, vol. 12 (1941) pp. 20-45.
  7. M. Friedman and L. J. Savage, Planning experiments seeking maxima, Chap. 3 of Selected techniques of statistical analysis, New York, McGraw-Hill, 1947.
  8. H. Robbins and S. Monro, A stochastic approximation method, Ann. of Math. Statist, vol. 22 (1951) pp. 400-407.
  9. W. Feller, Statistical aspects of ESP, Journal of Parapsychology vol. 4 (1940) pp. 271-298.

Cited by

Sorted by citations

Authors
Robbins, H.
Corresponding author
Robbins, Herbert
Venue
Bulletin of the American Mathematical Society
Published
1952
Volume
58
Issue
5
Pages
527-535
ISSN
  • 0002-9904 (ISSN-L)
  • 1088-9485
  • 0273-0979
OpenAlex
W1998498767
Cited by
2,184
References
0
Citations by year
2026: 48 · 2025: 70 · 2024: 90 · 2023: 86 · 2022: 102 · 2021: 167 · 2020: 176 · 2019: 139 · 2018: 110 · 2017: 112 · 2016: 100 · 2015: 122 · 2014: 97 · 2013: 88 · 2012: 96
FWCI
3.93
Type
journal article
Language
en
Open access
Locations
  • Bulletin of the American Mathematical Society (publishedVersion)
  • Project Euclid (Cornell University) (submittedVersion)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
  • Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords
sequential design of experiments, sequential sampling, manufacturing quality control, sample size determination, acceptance sampling

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review