Some aspects of the sequential design of experiments
Open accessAbstract
Introduction.Until recently, statistical theory has been restricted to the design and analysis of sampling experiments in which the size and composition of the samples are completely determined before the experimentation begins.The reasons for this are partly historical, dating back to the time when the statistician was consulted, if at all, only after the experiment was over, and partly intrinsic in the mathematical difficulty of working with anything but a fixed number of independent random variables.A major advance now appears to be in the making with the creation of a theory of the sequential design of experiments, in which the size and composition of the samples are not fixed in advance but are functions of the observations themselves.The first important departure from fixed sample size came in the field of industrial quality control, with the double sampling inspection method of Dodge and Romig [l].Here there is only one population to be sampled, and the question at issue is whether the proportion of defectives in a lot exceeds a given level.A preliminary sample of n\ objects is drawn from the lot and the number x of defectives noted.If x is less than a fixed value a the lot is accepted without further sampling, if x is greater than a fixed value b (a<b) the lot is rejected without further sampling, but if aSxSb then a second sample, of size w 2 , is drawn, and the decision to accept or reject the lot is made on the basis of the number of defectives in the total sample of Wi+n 2 objects.The total sample size n is thus a random variable with two values, n\ and ni+n2, and the value of n is stochastically dependent on the observations.A logical extension of the idea of double sampling came during World War II with the development, chiefly by Wald, of sequential analysis [2], in which the observations are made one by one and the decision to terminate sampling and to accept or reject the lot (or, more generally, to accept or reject whatever statistical "null hypothesis" is being tested) can come at any stage.The total sample size n now becomes a random variable capable in principle of assuming infinitely many values, although in practice a finite upper limit on n is usually set.The advantage of sequential An address delivered before the Auburn, Alabama, meeting of the Society,
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The multi-armed bandit problem provides a well-studied theoretical framework for optimizing the selection of notification templates.
“The multi-armed bandit problem provides a well-studied theoretical framework for optimizing the selection of templates in this context.”
From A Sleeping, Recovering Bandit Algorithm for Optimizing Recurring Notifications (2020) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 9
- H. F. Dodge and H. G. Romig, A method of sampling inspection. Bell System Technical Journal vol. 8 (1929) pp. 613-631, and Single sampling and double sampling inspection tables, ibid. vol. 20 (1941) pp. 1-61.
- A. Wald, Sequential analysis, New York, Wiley, 1947.
- P. C. Mahalanobis, A sample survey of the acreage under jute in Bengal with dis- cussion of planning of experiments, Snakhyâ vol. 4 (1940) pp. 511-531.
- On large-scale sample surveys, Philos. Trans. Roy. Soc. London, Ser. B vol. 231 (1944) pp. 329-451.
- A. Wald, Statistical decision functions, New York, Wiley, 1950.
- H. Hotelling, Experimental determination of the maximum of a function, Ann. of Math. Statist, vol. 12 (1941) pp. 20-45.
- M. Friedman and L. J. Savage, Planning experiments seeking maxima, Chap. 3 of Selected techniques of statistical analysis, New York, McGraw-Hill, 1947.
- H. Robbins and S. Monro, A stochastic approximation method, Ann. of Math. Statist, vol. 22 (1951) pp. 400-407.
- W. Feller, Statistical aspects of ESP, Journal of Parapsychology vol. 4 (1940) pp. 271-298.
Cited by
Sorted by citations
A contextual-bandit approach to personalized news article recommendation
Li, L., Chu, W., Langford, J., & Schapire, R. E. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772758 · Cited by 2,562 · see citing works
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995 · see citing works
Self-Driving Laboratories for Chemistry and Materials Science
Tom, G., Schmid, S. P., Baird, S. G., Cao, Y., Darvish, K., Hao, H., Lo, S., Pablo-García, S., Rajaonson, E. M., Skreta, M., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00055 · Cited by 707 · see citing works
Bayesian just-so stories in psychology and neuroscience.
Bowers, J. S., & Davis, C. J. (2012) · Psychological Bulletin · doi:10.1037/a0026450 · Cited by 436 · see citing works
Panel Experiments and Dynamic Causal Effects: A Finite Population Perspective
Bojinov, I., Rambachan, A., & Shephard, N. (2021) · Quantitative Economics · doi:10.3982/qe1744 · Cited by 60 · see citing works
A Sleeping, Recovering Bandit Algorithm for Optimizing Recurring Notifications
Yancey, K. P., & Settles, B. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403351 · Cited by 5 · see citing works
“The multi-armed bandit problem [13] is an optimization problem in which an agent repeatedly chooses from among a fixed set of arms over some number of rounds.”
Background
- Authors
- Robbins, H.
- Corresponding author
- Robbins, Herbert
- Venue
- Bulletin of the American Mathematical Society
- Publisher
- American Mathematical Society (AMS)
- Published
- 1952
- Volume
- 58
- Issue
- 5
- Pages
- 527-535
- ISSN
- 0002-9904 (ISSN-L)
- 1088-9485
- 0273-0979
- OpenAlex
- W1998498767
- Cited by
- 2,184
- References
- 0
- Citations by year
- 2026: 48 · 2025: 70 · 2024: 90 · 2023: 86 · 2022: 102 · 2021: 167 · 2020: 176 · 2019: 139 · 2018: 110 · 2017: 112 · 2016: 100 · 2015: 122 · 2014: 97 · 2013: 88 · 2012: 96
- FWCI
- 3.93
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Bulletin of the American Mathematical Society (publishedVersion)
- Project Euclid (Cornell University) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- sequential design of experiments, sequential sampling, manufacturing quality control, sample size determination, acceptance sampling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review