The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Steady-state simulation of queueing processes: survey of problems and solutions
Open accessAbstract
For years computer-based stochastic simulation has been a commonly used tool in the performance evaluation of various systems. Unfortunately, the results of simulation studies quite often have little credibility, since they are presented without regard to their random nature and the need for proper statistical analysis of simulation output data. This paper discusses the main factors that can affect the accuracy of stochastic simulations designed to give insight into the steady-state behavior of queuing processes. The problems of correctly starting and stopping such simulation experiments to obtain the required statistical accuracy of the results are addressed. In this survey of possible solutions, the emphasis is put on possible applications in the sequential analysis of output data, which adaptively decides about continuing a simulation experiment until the required accuracy of results is reached. A suitable solution for deciding upon the starting point of a steady-state analysis and two techniques for obtaining the final simulation results to a required level of accuracy are presented, together with pseudocode implementations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An analysis of variance test for normality (complete samples)
SHAPIRO, S. S., & WILK, M. B. (1965) · Biometrika · doi:10.1093/biomet/52.3-4.591 · Cited by 23,480
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
Convergence of Probability Measures
Billingsley, P. (1999) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316962 · Cited by 13,910
Numerical Recipes, The Art of Scientific Computing
Press, W. H., Flannery, B. P., Teukolsky, S. A., Vetterling, W. T., & Gould, H. (1987) · American Journal of Physics · doi:10.1119/1.14981 · Cited by 10,024
Simulation Modeling and Analysis.
Schervish, M. J., Law, A. M., & Kelton, W. D. (1983) · Journal of the American Statistical Association · doi:10.2307/2288169 · Cited by 8,697
Time Series: Theory and Methods
Ziegel, E. R., Brockwell, P., & Davis, R. (1992) · Technometrics · doi:10.2307/1270070 · Cited by 5,012
Spectral Analysis and its Applications.
Freiberger, W. F., Jenkins, G. M., & Watts, D. G. (1969) · Journal of the American Statistical Association · doi:10.2307/2286100 · Cited by 4,981
Discrete-Event System Simulation
Morgan, C. B. (1984) · Technometrics · doi:10.1080/00401706.1984.10487955 · Cited by 3,593
Fundamentals of Queueing Theory.
Moore, R. H., Gross, D., & Harris, C. M. (1977) · Journal of the American Statistical Association · doi:10.2307/2286953 · Cited by 2,930
Time Series: Data Analysis and Theory.
Koopmans, L. H., & Brillinger, D. R. (1976) · Journal of the American Statistical Association · doi:10.2307/2285347 · Cited by 2,637
Probability and Statistics With Reliability, Queuing, and Computer Science Applications.
Thompson, W. A., & Trivedi, K. S. (1983) · Journal of the American Statistical Association · doi:10.2307/2288237 · Cited by 2,601
Time series analysis forecasting and control
Janacek, G. (2010) · Journal of Time Series Analysis · doi:10.1111/j.1467-9892.2009.00643.x · Cited by 2,584
Hannan, E. J. (1970) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316429 · Cited by 2,369
Numerical Methods for Scientists and Engineers
Hamming, R. W. (1962) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,677
Bratley, P., Fox, B. L., & Schrage, L. E. (1987) · Springer eBooks · doi:10.1007/978-1-4419-8724-2 · Cited by 1,468
MILLER, R. G. (1974) · Biometrika · doi:10.1093/biomet/61.1.1 · Cited by 1,467
Simulation Run Length Control in the Presence of an Initial Transient
Heidelberger, P., & Welch, P. D. (1983) · Operations Research · doi:10.1287/opre.31.6.1109 · Cited by 1,297
Random number generators: good ones are hard to find
Park, S. K., & Miller, K. W. (1988) · Communications of the ACM · doi:10.1145/63039.63042 · Cited by 1,262
Time Series: Theory and Methods
Brockwell, P. J., & Davis, R. A. (1987) · Springer Series in Statistics · doi:10.1007/978-1-4899-0004-3 · Cited by 1,072
The Measurement Of Power Spectra: From The Point Of View Of Communications Engineering
Blackman, R. B., & Tukey, J. W. (2012) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,071
Distributed discrete-event simulation
Misra, J. (1986) · ACM Computing Surveys · doi:10.1145/6462.6485 · Cited by 998
Proceedings of the 2004 Winter Simulation Conference
(2004) · Proceedings of the 2004 Winter Simulation Conference, 2004. · doi:10.1109/wsc.2004.1371428 · Cited by 998
Distribution of the Ratio of the Mean Square Successive Difference to the Variance
von Neumann, J. (1941) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731677 · Cited by 932
On the Theoretical Specification and Sampling Properties of Autocorrelated Time-Series
Bartlett, M. S. (1946) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.2307/2983611 · Cited by 908
Marshall, C. W., & Cohen, J. W. (1983) · Technometrics · doi:10.2307/1267734 · Cited by 844
Numerical Methods for Scientists and Engineers
S., J., & Hamming, R. W. (1975) · Mathematics of Computation · doi:10.2307/2005584 · Cited by 825
Proceedings of the 1987 winter simulation conference
Thesen, A., Grant, H., & Kelton, W. D. (1988) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 742
Computer simulation in management science
Pidd, M. (1984) · Cited by 715
Watson, G. (1988) · Cited by 616
Principles of Discrete Event Simulation.
Johnson, M. E., & Fishman, G. S. (1980) · Journal of the American Statistical Association · doi:10.2307/2287424 · Cited by 538
Statistical tools for simulation practitioners
(1990) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(90)90147-b · Cited by 528
Probability and Statistics with Reliability, Queueing and Computer Science Applications
Williams, T. (1983) · Journal of the Operational Research Society · doi:10.1057/jors.1983.197 · Cited by 527
A guide to simulation (2nd ed.)
Bratley, P., Fox, B. L., & Schrage, L. E. (1986) · Springer eBooks · Cited by 500
A spectral method for confidence interval generation and run length control in simulations
Heidelberger, P., & Welch, P. D. (1981) · Communications of the ACM · doi:10.1145/358598.358630 · Cited by 436
Batch Size Effects in the Analysis of Simulation Output
Schmeiser, B. (1982) · Operations Research · doi:10.1287/opre.30.3.556 · Cited by 365
Applications of Queueing Theory
Hannan, E. L., & Newell, G. F. (1985) · Technometrics · doi:10.1080/00401706.1985.10488064 · Cited by 329
Tocher, K. D. (1964) · Internet Archive (Internet Archive) · Cited by 318
Confidence Interval Estimation Using Standardized Time Series
Schruben, L. (1983) · Operations Research · doi:10.1287/opre.31.6.1090 · Cited by 317
On the theory of queues with many servers
Kiefer, J., & Wolfowitz, J. (1955) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1955-0066587-3 · Cited by 312
Mathematical Considerations in the Estimation of Spectra
Parzen, E. (1961) · Technometrics · doi:10.1080/00401706.1961.10489939 · Cited by 306
Detecting Initialization Bias in Simulation Output
Schruben, L. W. (1982) · Operations Research · doi:10.1287/opre.30.3.569 · Cited by 235
Automatic Smoothing of the Log Periodogram
Wahba, G. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477441 · Cited by 230
Perturbation Analysis Gives Strongly Consistent Sensitivity Estimates for the M/G/1 Queue
Suri, R., & Zazanis, M. A. (1988) · Management Science · doi:10.1287/mnsc.34.1.39 · Cited by 226
Proceedings of the 1985 winter simulation conference
Gantz, D. T., Blais, G. C., & Solomon, S. (1985) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 189
Sensitivity Analysis and Performance Extrapolation for Computer Simulation Models
Rubinstein, R. Y. (1989) · Operations Research · doi:10.1287/opre.37.1.72 · Cited by 179
Shannon, R. E., Mayer, R., & Adelsberger, H. H. (1985) · SIMULATION · doi:10.1177/003754978504400603 · Cited by 161
An Empirical Investigation of the Transient Behavior of Stationary Queueing Systems
Odoni, A. R., & Roth, E. (1983) · Operations Research · doi:10.1287/opre.31.3.432 · Cited by 144
Evaluation of commonly used rules for detecting “steady state” in computer simulation
Gafarian, A. V., Ancker, C. J., & Morisaku, T. (1978) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800250312 · Cited by 126
Transient behavior of the M/M/l queue: Starting at the origin
Abate, J., & Whitt, W. (1987) · Queueing Systems · doi:10.1007/bf01182933 · Cited by 124
Methodology in systems modelling and simulation.
(1980) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(80)90062-2 · Cited by 122
Efficiency of Multivariate Control Variates in Monte Carlo Simulation
Rubinstein, R. Y., & Marcus, R. (1985) · Operations Research · doi:10.1287/opre.33.3.661 · Cited by 120
Variance Reduction Techniques for Digital Simulation
Wilson, J. R. (1984) · American Journal of Mathematical and Management Sciences · doi:10.1080/01966324.1984.10737147 · Cited by 114
Confidence intervals in discrete event simulation: A comparison of replication and batch means
Law, A. M. (1977) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800240414 · Cited by 113
Transient behavior of regulated Brownian motion, I: Starting at the origin
Abate, J., & Whitt, W. (1987) · Advances in Applied Probability · doi:10.1017/s0001867800016773 · Cited by 104
Quantile Estimation in Dependent Sequences
Heidelberger, P., & Lewis, P. (1984) · Operations Research · doi:10.1287/opre.32.1.185 · Cited by 99
Statistical design and analysis
Kelton, W. D. (1986) · Winter Simulation Conference · doi:10.1145/318242.318259 · Cited by 97
Confidence Intervals for Steady-State Simulations II: A Survey of Sequential Procedures
Law, A. M., & Kelton, W. D. (1982) · Management Science · doi:10.1287/mnsc.28.5.550 · Cited by 96
Feature Article—Statistical Analysis of Simulation Output Data
Law, A. M. (1983) · Operations Research · doi:10.1287/opre.31.6.983 · Cited by 94
Estimation of the mean of a stationary time series by sampling
Brillinger, D. R. (1973) · Journal of Applied Probability · doi:10.1017/s0021900200095413 · Cited by 56
Adaptive Spectral Methods for Simulation Output Analysis
Heidelberger, P., & Welch, P. D. (1981) · IBM Journal of Research and Development · doi:10.1147/rd.256.0860 · Cited by 55
An Analytical Evaluation of Alternative Strategies in Steady-State Simulation
Kelton, W. D., & Law, A. M. (1984) · Operations Research · doi:10.1287/opre.32.1.169 · Cited by 52
A Coverage Function for Interval Estimators of Simulation Response
Schruben, L. W. (1980) · Management Science · doi:10.1287/mnsc.26.1.18 · Cited by 49
Computer-aided modeling, analysis, and design of communication networks
Kurose, J., & Mouftah, H. T. (1988) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.192737 · Cited by 47
Statistical analysis of the output data from terminating simulations
Law, A. M. (1980) · Naval Research Logistics Quarterly · doi:10.1002/nav.3800270112 · Cited by 42
Achieving specific accuracy in simulation output analysis
Fishman, G. S. (1977) · Communications of the ACM · doi:10.1145/359581.359589 · Cited by 34
Decomposition of some weil-known variance reduction techniques
Nelson, B. L., & Schmeiser, B. W. (1986) · Journal of Statistical Computation and Simulation · doi:10.1080/00949658608810871 · Cited by 33
Regression-adjusted estimates for regenerative simulations, with graphics
Heidelberger, P., & Lewis, P. (1981) · Communications of the ACM · doi:10.1145/358598.358641 · Cited by 25
Cited by
On credibility of simulation studies of telecommunication networks
Pawlikowski, K., Jeong, H.-D. J., & Lee, J.-S. R. (2002) · IEEE Communications Magazine · doi:10.1109/35.978060 · Cited by 413
Self-citation
Metadata
- Authors
- Pawlikowski, K.
- Venue
- ACM Computing Surveys
- Published
- 1990-06
- Volume
- 22
- Issue
- 2
- Pages
- 123-170
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W1972316579
- Cited by
- 256
- References
- 67
- FWCI
- 7.78
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.