The DOI matches its Crossref record.
Analysis of serial measurements in medical research.
Open accessAbstract
In medical research data are often collected serially on subjects. The statistical analysis of such data is often inadequate in two ways: it may fail to settle clinically relevant questions and it may be statistically invalid. A commonly used method which compares groups at a series of time points, possibly with t tests, is flawed on both counts. There may, however, be a remedy, which takes the form of a two stage method that uses summary measures. In the first stage a suitable summary of the response in an individual, such as a rate of change or an area under a curve, is identified and calculated for each subject. In the second stage these summary measures are analysed by simple statistical techniques as though they were raw data. The method is statistically valid and likely to be more relevant to the study questions. If this method is borne in mind when the experiment is being planned it should promote studies with enough subjects and sufficient observations at critical times to enable useful conclusions to be drawn. Use of summary measures to analyse serial measurements, though not new, is potentially a useful and simple tool in medical research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 12
- Illingworth PJ, Jung RT, Howie I'W, Isles TE. Reduction in postprandial energy expenditure during pregnancy. BrMedj 1987;294:1573-6.
- Bradley JR, Esans DB, Gore SM, Cowley AJ. Is dialysis hypotension caused by an abnormality of senous tone? Br MedJ 1988;2%:1634-7.
- Fikri MM, Ghalioungui P. Ancylostoma anaemia. Lancet 1937;i:800-2. · DOI
- Wishart J. Growth rate determination in nutrition studies with the bacon pig, and their analysis. Biometrika 1938;30:16-28.
- Oldham PD. A note on the analysis of repeated measurements of the same subjects. J Chronic Dis 1962;15:969-77. · DOI · Paper page
- Rowell JG, Walters DE. Analysing data with repeated observations on each experimental unit. Journal ofAgricultural Science (Camb) 1976;87:423-32.
- Healy MJR. Some problems of repeated measurements. In: Bithell JF, Coppi R, eds. Perspectives tn medical statistics. London: Academic Press, 1981: 155-7.
- De Klerk NH. Repeated warnings re repeated measures. Aust N Z 7lMed 1986;16:637-8.
- Armitage P, Berrt G. Statistical methods in medical research. Oxford: Blackwell Scientific, 1987:355,360,411.
- Gardner MJ, Altman DG. Confidence intervals rather than P values: estimation rather than hypothesis testing. BrMted_7 1986;292:746-50.
- Tsai K-T, Koziol JA. VARCOV 11: a computer program for the multivariate analysis of growth and response curves. Comput Methods Programs Bismed 1988;27:69-74. · DOI
- Kenward MG. A method for comparing profiles of repeated measurements. Applied Statistics 1987;36:296-308. · DOI · Paper page
Cited by
Staessen, J. A. (1999) · JAMA · doi:10.1001/jama.282.6.539 · Cited by 1,592
Forette, F., Seux, M.-L., Staessen, J. A., Thijs, L., Birkenhäger, W. H., Babarskiene, M.-R., Babeanu, S., Bossini, A., Gil-Extremera, B., Girerd, X., et al. (1998) · The Lancet · doi:10.1016/s0140-6736(98)03086-4 · Cited by 1,441
Lack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
Guidelines for the Design and Statistical Analysis of Experiments Using Laboratory Animals
Festing, M. F. W., & Altman, D. G. (2002) · ILAR Journal · doi:10.1093/ilar.43.4.244 · Cited by 1,110
Self-citationAsnicar, F., Berry, S. E., Valdes, A. M., Nguyen, L. H., Piccinno, G., Drew, D. A., Leeming, E., Gibson, R., Le Roy, C., Khatib, H. A., et al. (2021) · Nature Medicine · doi:10.1038/s41591-020-01183-8 · Cited by 995
Manca, A., Hawkins, N., & Sculpher, M. J. (2005) · Health Economics · doi:10.1002/hec.944 · Cited by 1,024
Fichtlscherer, S., Rosenberger, G., Walter, D. H., Breuer, S., Dimmeler, S., & Zeiher, A. M. (2000) · Circulation · doi:10.1161/01.cir.102.9.1000 · Cited by 665
Frison, L., & Pocock, S. J. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111304 · Cited by 593
Bisset, L., Beller, E., Jull, G., Brooks, P., Darnell, R., & Vicenzino, B. (2006) · BMJ · doi:10.1136/bmj.38961.584653.ae · Cited by 554
Fromme, E. K., Eilers, K. M., Mori, M., Hsieh, Y.-C., & Beer, T. M. (2004) · Journal of Clinical Oncology · doi:10.1200/jco.2004.03.025 · Cited by 555
Cao, G., Russell, R. M., Lischner, N., & Prior, R. L. (1998) · The Journal of Nutrition · doi:10.1093/jn/128.12.2383 · Cited by 502
Clinical evidence for the regression of liver fibrosis
Ellis, E. L., & Mann, D. A. (2012) · Journal of Hepatology · doi:10.1016/j.jhep.2011.09.024 · Cited by 411
The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis?
Lazic, S. E. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-5 · Cited by 381
Caffeine Induces Dopamine and Glutamate Release in the Shell of the Nucleus Accumbens
Solinas, M., Ferré, S., You, Z.-B., Karcz-Kubicha, M., Popoli, P., & Goldberg, S. R. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-15-06321.2002 · Cited by 338
Pereira, M. A. (2004) · JAMA · doi:10.1001/jama.292.20.2482 · Cited by 324
What exactly is ‘N’ in cell culture and animal experiments?
Lazic, S. E., Clarke-Williams, C. J., & Munafò, M. R. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2005282 · Cited by 291
Staessen, J. A. (2004) · JAMA · doi:10.1001/jama.291.8.955 · Cited by 288
Tumor Necrosis Factor: A Putative Mediator of the Sick Euthyroid Syndrome in Man*
POLL, T. V. D., ROMIJN, J. A., WIERSINGA, W. M., & SAUERWEIN, H. P. (1990) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem-71-6-1567 · Cited by 270
Werner, M. E., Cummings, N. D., Sethi, M., Wang, E. C., Sukumar, R., Moore, D. T., & Wang, A. Z. (2013) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2013.02.009 · Cited by 267
Moloney, F., Yeow, T.-P., Mullen, A., Nolan, J. J., & Roche, H. M. (2004) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/80.4.887 · Cited by 247
Alemtuzumab treatment of multiple sclerosis: long-term safety and efficacy
Tuohy, O., Costelloe, L., Hill-Cawthorne, G., Bjornson, I., Harding, K., Robertson, N., May, K., Button, T., Azzopardi, L., Kousin-Ezewu, O., et al. (2015) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp-2014-307721 · Cited by 238
Bicanic, T., Muzoora, C., Brouwer, A. E., Meintjes, G., Longley, N., Taseera, K., Rebe, K., Loyse, A., Jarvis, J., Bekker, L., et al. (2009) · Clinical Infectious Diseases · doi:10.1086/604716 · Cited by 227
Reeves, D., Blickem, C., Vassilev, I., Brooks, H., Kennedy, A., Richardson, G., & Rogers, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098340 · Cited by 213
Influence of raised plasma osmolality on clinical outcome after acute stroke
Bhalla, A., Sankaralingam, S., Dundas, R., Swaminathan, R., Wolfe, C. D. A., & Rudd, A. G. (2000) · Stroke · doi:10.1161/01.str.31.9.2043 · Cited by 219
Critchley, D. J., Ratcliffe, J., Noonan, S., Jones, R. H., & Hurley, M. V. (2007) · Spine · doi:10.1097/brs.0b013e318067dc26 · Cited by 188
Frayn, K. N., Shadid, S., Hamlani, R., Humphreys, S. M., Clark, M. L., Fielding, B. A., Boland, O., & Coppack, S. W. (1994) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.1994.266.3.e308 · Cited by 188
(2000) · PubMed · Cited by 181
Pharmacokinetics of Oral and Intravenous Melatonin in Healthy Volunteers
Andersen, L. P. H., Werner, M. U., Rosenkilde, M. M., Harpsøe, N. G., Fuglsang, H., Rosenberg, J., & Gögenur, I. (2016) · BMC Pharmacology and Toxicology · doi:10.1186/s40360-016-0052-2 · Cited by 181
Reducing the glycemic index of short dough biscuits by using apple pomace as a functional ingredient
Alongi, M., Melchior, S., & Anese, M. (2019) · LWT · doi:10.1016/j.lwt.2018.10.068 · Cited by 166
Impaired serum cortisol stress response is a predictor of early relapse
Junghanns, K. (2003) · Alcohol and Alcoholism · doi:10.1093/alcalc/agg052 · Cited by 166
Nordwall, M., Abrahamsson, M., Dhir, M., Fredrikson, M., Ludvigsson, J., & Arnqvist, H. J. (2015) · Diabetes Care · doi:10.2337/dc14-1203 · Cited by 161
Thavasothy, M., Broadhead, M., Elwell, C., Peters, M., & Smith, M. (2002) · Anaesthesia · doi:10.1046/j.1365-2044.2002.02826.x · Cited by 165
Effects of reduced energy availability on bone metabolism in women and men
Papageorgiou, M., Elliott-Sale, K. J., Parsons, A., Tang, J. C. Y., Greeves, J. P., Fraser, W. D., & Sale, C. (2017) · Bone · doi:10.1016/j.bone.2017.08.019 · Cited by 159
Walker, J., Hansen, C. H., Martin, P., Symeonides, S., Gourley, C., Wall, L., Weller, D., Murray, G., & Sharpe, M. (2014) · The Lancet Oncology · doi:10.1016/s1470-2045(14)70343-2 · Cited by 155
Analysis of a trial randomised in clusters: Table 1
Kerry, S. M., & Bland, J. M. (1998) · BMJ · doi:10.1136/bmj.316.7124.54 · Cited by 153
Thomas, S. A., Walker, M. F., Macniven, J. A., Haworth, H., & Lincoln, N. B. (2013) · Clinical Rehabilitation · doi:10.1177/0269215512462227 · Cited by 149
Glycemic Characteristics in Continuously Monitored Patients With Type 1 and Type 2 Diabetes
Bode, B. W., Schwartz, S., Stubbs, H. A., & Block, J. E. (2005) · Diabetes Care · doi:10.2337/diacare.28.10.2361 · Cited by 137
Hypothalamic pituitary adrenal axis functioning in reactive and proactive aggression in children
Lopez-Duran, N. L., Olson, S. L., Hajal, N. J., Felt, B. T., & Vazquez, D. M. (2009) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-008-9263-3 · Cited by 134
Walhin, J., Richardson, J. D., Betts, J. A., & Thompson, D. (2013) · The Journal of Physiology · doi:10.1113/jphysiol.2013.262709 · Cited by 129
Samra, J. S., Clark, M. L., Humphreys, S. M., MacDonald, I. A., Bannister, P. A., & Frayn, K. N. (1998) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jcem.83.2.4547 · Cited by 123
van Vliet, P. M. (2005) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2004.040436 · Cited by 115
Wood, A. R., Jonsson, A., Jackson, A. U., Wang, N., van Leewen, N., Palmer, N. D., Kobes, S., Deelen, J., Boquete-Vilarino, L., Paananen, J., et al. (2017) · Diabetes · doi:10.2337/db16-1452 · Cited by 117
Cross-sex pattern of bone mineral density in early onset gender identity disorder
Haraldsen, I. R., Haug, E., Falch, J., Egeland, T., & Opjordsmoen, S. (2007) · Hormones and Behavior · doi:10.1016/j.yhbeh.2007.05.012 · Cited by 113
The effect of eating behavior on weight loss and maintenance during a lifestyle intervention
Keränen, A.-M., Savolainen, M. J., Reponen, A. H., Kujari, M.-L., Lindeman, S. M., Bloigu, R. S., & Laitinen, J. H. (2009) · Preventive Medicine · doi:10.1016/j.ypmed.2009.04.011 · Cited by 109
Wardlaw, J. M., Farrall, A., Armitage, P. A., Carpenter, T., Chappell, F., Doubal, F., Chowdhury, D., Cvoro, V., & Dennis, M. S. (2008) · Stroke · doi:10.1161/strokeaha.107.500124 · Cited by 87
Lopez-Duran, N. L., Mayer, S. E., & Abelson, J. L. (2014) · Stress · doi:10.3109/10253890.2014.915517 · Cited by 85
Goss, A. M., Chandler-Laney, P. C., Ovalle, F., Goree, L. L., Azziz, R., Desmond, R. A., Wright Bates, G., & Gower, B. A. (2014) · Metabolism · doi:10.1016/j.metabol.2014.07.007 · Cited by 85
Effect of the pattern of food intake on human energy metabolism
Verboeket-Van De Venne, W. P. H. G., Westerterp, K. R., & Kester, A. D. M. (1993) · British Journal of Nutrition · doi:10.1079/bjn19930108 · Cited by 79
A short-term ketogenic diet impairs markers of bone health in response to exercise
Heikura, I. A., Burke, L. M., Hawley, J. A., Ross, M. L., Garvican-Lewis, L., Sharma, A. P., McKay, A. K. A., Leckey, J. J., Welvaert, M., McCall, L., et al. (2020) · Frontiers in Endocrinology · doi:10.3389/fendo.2019.00880 · Cited by 78
Retracted: Effects of Whey Peptides on Cardiovascular Disease Risk Factors
Pins, J. J., & Keenan, J. M. (2006) · The Journal of Clinical Hypertension · doi:10.1111/j.1524-6175.2006.05667.x · Cited by 71
RetractedAshina, S., Lipton, R. B., Bendtsen, L., Hajiyeva, N., Buse, D. C., Lyngberg, A. C., & Jensen, R. (2018) · European Journal of Pain · doi:10.1002/ejp.1176 · Cited by 56
Forman, A., & Lincoln, N. (2010) · Clinical Rehabilitation · doi:10.1177/0269215509343492 · Cited by 54
Nielsen, M. F., Caumo, A., Chandramouli, V., Schumann, W. C., Cobelli, C., Landau, B. R., Vilstrup, H., Rizza, R. A., & Schmitz, O. (2004) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.00566.2002 · Cited by 53
Green, C., Richards, D. A., Hill, J. J., Gask, L., Lovell, K., Chew-Graham, C., Bower, P., Cape, J., Pilling, S., Araya, R., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0104225 · Cited by 52
Clinical recommendations for the use of the ambulatory glucose profile in diabetes care
Kröger, J., Reichel, A., Siegmund, T., & Ziegler, R. (2020) · Journal of Diabetes Science and Technology · doi:10.1177/1932296819883032 · Cited by 51
Regulation of Tissue Iodothyronine Deiodinase Activity in a Model of Prolonged Critical Illness
Debaveye, Y., Ellger, B., Mebis, L., Darras, V. M., & Van den Berghe, G. (2008) · Thyroid · doi:10.1089/thy.2007.0287 · Cited by 50
Central and peripheral effects of sustained caffeine use: tolerance is incomplete
Watson, J., Deary, I., & Kerr, D. (2002) · British Journal of Clinical Pharmacology · doi:10.1046/j.1365-2125.2002.01681.x · Cited by 47
Nobis, S., Ebert, D. D., Lehr, D., Smit, F., Buntrock, C., Berking, M., Baumeister, H., Snoek, F., Funk, B., & Riper, H. (2018) · The British Journal of Psychiatry · doi:10.1192/bjp.2018.10 · Cited by 43
Aerobic Exercise and Postprandial Lipemia in Men with the Metabolic Syndrome
MESTEK, M. L., PLAISANCE, E. P., RATCLIFF, L. A., TAYLOR, J. K., WEE, S.-O., & GRANDJEAN, P. W. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3181822ebd · Cited by 47
Romijn, G., Batelaan, N., Koning, J., van Balkom, A., de Leeuw, A., Benning, F., Hakkaart van Roijen, L., & Riper, H. (2021) · PLOS ONE · doi:10.1371/journal.pone.0259493 · Cited by 46
Lagerpusch, M., Bosy-Westphal, A., Kehden, B., Peters, A., & Müller, M. J. (2012) · International Journal of Obesity · doi:10.1038/ijo.2011.211 · Cited by 45
Premenopausal Advantages in Postprandial Lipid Metabolism Are Lost in Women With Type 2 Diabetes
Masding, M. G., Stears, A. J., Burdge, G. C., Wootton, S. A., & Sandeman, D. D. (2003) · Diabetes Care · doi:10.2337/diacare.26.12.3243 · Cited by 42
A cluster-randomized trial of insecticide-treated curtains for dengue vector control in Thailand
Lenhart, A., Trongtokit, Y., Alexander, N., Apiwathnasorn, C., Satimai, W., Vanlerberghe, V., Van der Stuyft, P., & McCall, P. J. (2013) · The American Society of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2012.12-0423 · Cited by 42
Toloza, F. J. K., Mantilla-Rivas, J. O., Pérez-Matos, M. C., Ricardo-Silgado, M. L., Morales-Alvarez, M. C., Pinzón-Cortés, J. A., Pérez-Mayorga, M., Arévalo-Garcia, M. L., Tolosa-González, G., & Mendivil, C. O. (2018) · Frontiers in Endocrinology · doi:10.3389/fendo.2018.00005 · Cited by 42
Aspvall, K., Sampaio, F., Lenhard, F., Melin, K., Norlin, L., Serlachius, E., Mataix-Cols, D., & Andersson, E. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.18516 · Cited by 39
Kuhlman, K. R., Olson, S. L., & Lopez‐Duran, N. L. (2014) · Developmental Psychobiology · doi:10.1002/dev.21166 · Cited by 32
Paganini, S., Lin, J., Kählke, F., Buntrock, C., Leiding, D., Ebert, D. D., & Baumeister, H. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-023390 · Cited by 31
Duarte, A., Walker, S., Littlewood, E., Brabyn, S., Hewitt, C., Gilbody, S., & Palmer, S. (2017) · Psychological Medicine · doi:10.1017/s0033291717000289 · Cited by 30
Cheong, J. N., Cuffe, J. S. M., Jefferies, A. J., Anevska, K., Moritz, K. M., & Wlodek, M. E. (2016) · Endocrinology · doi:10.1210/en.2016-1335 · Cited by 28
Bartels, S. L., Johnsson, S. I., Boersma, K., Flink, I., McCracken, L. M., Petersson, S., Christie, H. L., Feldman, I., Simons, L. E., Onghena, P., et al. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059152 · Cited by 23
Cost-utility of collaborative care for major depressive disorder in primary care in the Netherlands
Goorden, M., Huijbregts, K. M. L., van Marwijk, H. W. J., Beekman, A. T. F., van der Feltz-Cornelis, C. M., & Hakkaart-van Roijen, L. (2015) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2015.06.006 · Cited by 26
Haverinen, A., Kangasniemi, M., Luiro, K., Piltonen, T., Heikinheimo, O., & Tapanainen, J. S. (2021) · Contraception · doi:10.1016/j.contraception.2020.10.014 · Cited by 17
Mecs, L., Tuboly, G., Toth, K., Nagy, E., Nyari, T., Benedek, G., & Horvath, G. (2010) · Clinical and Experimental Pharmacology and Physiology · doi:10.1111/j.1440-1681.2010.05346.x · Cited by 16
Effect Sizes in Single-Case Aphasia Studies: A Comparative, Autocorrelation-Oriented Analysis
Archer, B., Azios, J. H., Müller, N., & Macatangay, L. (2019) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2019_jslhr-l-18-0186 · Cited by 13
Comparison of aspartame- and sugar-sweetened soft drinks on postprandial metabolism
Pearson, R. C., Green, E. S., Olenick, A. A., & Jenkins, N. T. (2023) · Nutrition and Health · doi:10.1177/02601060211057415 · Cited by 12
Frecska, E., Perenyi, A., & Arato, M. (2003) · Psychiatry Research · doi:10.1016/s0165-1781(03)00072-6 · Cited by 3
An algorithm to simulate missing data for mixed meal tolerance test response curves
LaPorte, G. J., Chauff, S., Cammack, J., Burton-Freeman, B., Krakoff, J., Stinson, E. J., Gower, B., Redman, L. M., & Thomas, D. M. (2024) · The American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2024.04.024 · Cited by 2
Meta-analysis: formulating, evaluating, combining, and reporting
Normand, S.-L. T. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990215)18:3<321::aid-sim28>3.0.co;2-p
Caraceni (1998) · doi:10.1002/(sici)1097-0142(19980801)83:3
Metadata
- Authors
- Matthews, J. N., Altman, D. G., Campbell, M. J., & Royston, P.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 1990-01-27
- Volume
- 300
- Issue
- 6719
- Pages
- 230-235
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W2028067695
- Cited by
- 3,136
- References
- 0
- FWCI
- 78.73
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.