Adaptation and Validation of the Program Sustainability Assessment Tool (PSAT) for Use in the Elementary School Setting
Open accessAbstract
There is a lack of valid and reliable measures of determinants of sustainability specific to public health interventions in the elementary school setting. This study aimed to adapt and evaluate the Program Sustainability Assessment Tool (PSAT) for use in this setting. An expert reference group adapted the PSAT to ensure face validity. Elementary school teachers participating in a multi-component implementation intervention to increase their scheduling of physical activity completed the adapted PSAT. Structural validity was assessed via confirmatory factor analysis. Convergent validity was assessed using linear mixed regression evaluating the associations between scheduling of physical activity and adapted PSAT scores. Cronbach’s alpha was used to evaluate internal consistency and intracluster correlation coefficients for interrater reliability. Floor and ceiling effects were also evaluated. Following adaptation and psychometric evaluation, the final measure contained 26 items. Domain Cronbach’s alpha ranged from 0.77 to 0.92. Only one domain illustrated acceptable interrater reliability. Evidence for structural validity was mixed and was lacking for convergent validity. There were no floor and ceiling effects. Efforts to adapt and validate the PSAT for the elementary school setting were mixed. Future work to develop and improve measures specific to public health program sustainment that are relevant and psychometrically robust for elementary school settings are needed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The PSAT remains valid in its entirety, even when assessed in a larger and more diverse sample.
“While some work has adapted the PSAT for specific areas, this work suggests that the PSAT remains valid in its entirety, even when assessed in a larger and more diverse sample (31).”
From Assessing the sustainability capacity of evidence-based programs in community and health settings (2022) · cites this paper as [31]
Results §3.1 says the elementary-school PSAT required substantial adaptation: one of eight domains and several original items were removed, so this study did not validate the PSAT in its entirety. The Discussion says larger samples are still needed to establish the adapted measure’s structural validity; Results §3.5 also reports a lack of evidence for convergent validity. No page numbers are available in our copy. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 41 · Cited by 20
- Authors
- Hall, A., Shoesmith, A., Shelton, R. C., Lane, C., Wolfenden, L., & Nathan, N.
- Affiliations
- Hunter Medical Research Institute (AU)
- Columbia University (US)
- Corresponding author
- Hall, Alix
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2021-10-29
- Volume
- 18
- Issue
- 21
- Pages
- 11414
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC8582873
- OpenAlex
- W3210966657
- Cited by
- 20
- References
- 41
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 2 · 2023: 6 · 2022: 8
- FWCI
- 4.49
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- NOVA (University of Newcastle Australia) (submittedVersion, cc-by)
- Funders
- National Health and Medical Research Council (APP1133013)
- Hunter Medical Research Institute (NA)
- Hunter Children's Researh Foundation (NA)
- Hunter New England Population Health (NA)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › School Health and Nursing Education
- Keywords
- program sustainability, elementary school, school-based physical activity, psychometric validation, scale adaptation, structural validity, convergent validity, inter-rater reliability, floor and ceiling effects, public health interventions
- MeSH terms
- Psychometrics, Surveys and Questionnaires, Schools, Reproducibility of Results, Program Evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
