Using flawed, uncertain, proximate and sparse (FUPS) data in the context of complexity: learning from the case of child mental health
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The use of routinely collected data that are flawed and limited to inform service development in healthcare systems needs to be considered, both theoretically and practically, given the reality in many areas of healthcare that only poor-quality data are available for use in complex adaptive systems. Data may be compromised in a range of ways. They may be flawed, due to missing or erroneously recorded entries; uncertain, due to differences in how data items are rated or conceptualised; proximate, in that data items are a proxy for key issues of concern; and sparse, in that a low volume of cases within key subgroups may limit the possibility of statistical inference. The term 'FUPS' is proposed to describe these flawed, uncertain, proximate and sparse datasets. Many of the systems that seek to use FUPS data may be characterised as dynamic and complex, involving a wide range of agents whose actions impact on each other in reverberating ways, leading to feedback and adaptation. The literature on the use of routinely collected data in healthcare is often implicitly premised on the availability of high-quality data to be used in complicated but not necessarily complex systems. This paper presents an example of the use of a FUPS dataset in the complex system of child mental healthcare. The dataset comprised routinely collected data from services that were part of a national service transformation initiative in child mental health from 2011 to 2015. The paper explores the use of this FUPS dataset to support meaningful dialogue between key stakeholders, including service providers, funders and users, in relation to outcomes of services. There is a particular focus on the potential for service improvement and learning. The issues raised and principles for practice suggested have relevance for other health communities that similarly face the dilemma of how to address the gap between the ideal of comprehensive clear data used in complicated, but not complex, contexts, and the reality of FUPS data in the context of complexity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Big data analytics in healthcare: promise and potential
Raghupathi, W., & Raghupathi, V. (2014) · Health Information Science and Systems · doi:10.1186/2047-2501-2-3 · Cited by 3,034
The challenge of complexity in health care
Plsek, P. E., & Greenhalgh, T. (2001) · BMJ · doi:10.1136/bmj.323.7313.625 · Cited by 2,578
Kim-Cohen, J., Caspi, A., Moffitt, T. E., Harrington, H., Milne, B. J., & Poulton, R. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.7.709 · Cited by 2,025
The need for a complex systems model of evidence for public health
Rutter, H., Savona, N., Glonti, K., Bibby, J., Cummins, S., Finegood, D. T., Greaves, F., Harper, L., Hawe, P., Moore, L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31267-9 · Cited by 1,260 · cited 1×
“There are increasing calls for a greater consideration of the implications of the complexity of the healthcare system in relation to both research and practice [12, 13].”
BackgroundSelf-citationMental Health of Children and Young People in Great Britain, 2004: (557702010-001)
Green, H., McGinnity, A., Meltzer, H., Ford, T., & Goodman, R. (2005) · PsycEXTRA Dataset · doi:10.1037/e557702010-001 · Cited by 1,216
League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance
Goldstein, H., & Spiegelhalter, D. J. (1996) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983325 · Cited by 1,069
Estimating remission from untreated major depression: a systematic review and meta-analysis
Whiteford, H. A., Harris, M. G., McKeon, G., Baxter, A., Pennell, C., Barendregt, J. J., & Wang, J. (2013) · Psychological Medicine · doi:10.1017/s0033291712001717 · Cited by 375 · cited 1×
“The rates of non-professionally mediated improvement for key difficulties may be as high as 60% for adolescent depression [25].”
BackgroundStockings, E. A., Degenhardt, L., Dobbins, T., Lee, Y. Y., Erskine, H. E., Whiteford, H. A., & Patton, G. (2016) · Psychological Medicine · doi:10.1017/s0033291715001725 · Cited by 345
Merry, S. N., McDowell, H. H., Hetrick, S. E., Bir, J. J., & Muller, N. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003380.pub2 · Cited by 284 · cited 1×
“Whilst a number of systematic reviews have identified effective prevention interventions for mental ill health in children, with moderate effect sizes across diverse populations [26–28], there is still a need for further evidence of the best ways forward in terms of early intervention or prevention and how to ensure t…”
Background
Cited by
Treasure, J., Duarte, T. A., & Schmidt, U. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30059-3 · Cited by 1,026
Studying complexity in health services research: desperately seeking an overdue paradigm shift
Greenhalgh, T., & Papoutsi, C. (2018) · BMC Medicine · doi:10.1186/s12916-018-1089-4 · Cited by 962
Richards, K. L., Hyam, L., Allen, K. L., Glennon, D., Di Clemente, G., Semple, A., Jackson, A., Belli, S. R., Dodge, E., Kilonzo, C., et al. (2023) · Early Intervention in Psychiatry · doi:10.1111/eip.13317 · Cited by 40
King, D., & Said, G. (2019) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x18000260 · Cited by 31
“Unfortunately, outcome data was at times incomplete, which is reflective of some of the challenges of using measures to evaluate outcomes within routine CAMHS practice (Wolpert and Rutter, 2018).”
BackgroundPredictors of child and adolescent mental health treatment outcome
Edbrooke-Childs, J., Rashid, A., Ritchie, B., & Deighton, J. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-03837-y · Cited by 13
“More general limitations of using administrative data are also relevant to the present research [21].”
Background
Metadata
- Authors
- Wolpert, M., & Rutter, H.
- Venue
- BMC Medicine
- Published
- 2018-06-18
- Volume
- 16
- Issue
- 1
- Pages
- 82-82
- ISSN
- 1741-7015 (ISSN-L)
- OpenAlex
- W2806432350
- Cited by
- 88
- References
- 11
- FWCI
- 10.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using flawed, uncertain, proximate and sparse (FUPS) data in the context of complexity: learning from the case of child mental health. https://app.cochat.ai/papers/10.1186/s12916-018-1079-6
- The paper
- Wolpert, M., & Rutter, H. (2018). Using flawed, uncertain, proximate and sparse (FUPS) data in the context of complexity: learning from the case of child mental health. BMC Medicine. https://doi.org/10.1186/s12916-018-1079-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.