A proposed adaptation of the European Foundation for Quality Management Excellence Model to physical activity programmes for the elderly - development of a quality self-assessment tool using a modified Delphi process
Open accessAbstract
BACKGROUND: There has been a growing concern in designing physical activity (PA) programmes for elderly people, since evidence suggests that such health promotion interventions may reduce the deleterious effects of the ageing process. Complete programme evaluations are a necessary prerequisite to continuous quality improvements. Being able to refine, adapt and create tools that are suited to the realities and contexts of PA programmes for the elderly in order to support its continuous improvement is, therefore, crucial. Thus, the aim of this study was to develop a self-assessment tool for PA programmes for the elderly. METHODS: A 3-round Delphi process was conducted via the Internet with 43 national experts in PA for the elderly, management and delivery of PA programmes for the elderly, sports management, quality management and gerontology, asking experts to identify the propositions that they considered relevant for inclusion in the self-assessment tool. Experts reviewed a list of proposed statements, based on the criteria and sub-criteria from the European Foundation for Quality Management Excellence Model (EFQM) and PA guidelines for older adults and rated each proposition from 1 to 8 (disagree to agree) and modified and/or added propositions. Propositions receiving either bottom or top scores of greater than 70% were considered to have achieved consensus to drop or retain, respectively. RESULTS: In round 1, of the 196 originally-proposed statements (best practice principles), the experts modified 41, added 1 and achieved consensus on 93. In round 2, a total of 104 propositions were presented, of which experts modified 39 and achieved consensus on 53. In the last round, of 51 proposed statements, the experts achieved consensus on 19. After 3 rounds of rating, experts had not achieved consensus on 32 propositions. The resulting tool consisted of 165 statements that assess nine management areas involved in the development of PA programmes for the elderly. CONCLUSION: Based on experts' opinions, a self-assessment tool was found in order to access quality of PA programmes for the elderly. Information obtained with evaluations would be useful to organizations seeking to improve their services, customer satisfaction and, consequently, adherence to PA programmes, targeting the ageing population.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Evidence shows that the involvement of all relevant stakeholders-children, families, teaching staff and management-in the planning of an intervention increases the likelihood of its success.
“For example, evidence shows that the involvement of all relevant stakeholders—children, families, teaching staff and management—in the planning of an intervention increases the likelihood of its success (102–108).”
From How can physical activity be promoted among children and adolescents? A systematic review of reviews across settings (2019) · cites this paper as [105]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951 · see citing works
the delphi method: techniques and applications
Linstone, H. A., & Turoff, M. (1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 5,236 · see citing works
Leadership : Theory and Practice
Northouse, P. G. (2015) · Cited by 5,227 · see citing works
Exercise and Physical Activity for Older Adults
Chodzko-Zajko, W. J., Proctor, D. N., Fiatarone Singh, M. A., Minson, C. T., Nigg, C. R., Salem, G. J., & Skinner, J. S. (2009) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3181a0c95c · Cited by 5,153 · see citing works
The Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500 · cited 3× · see citing works
“The results of previous iterations can be modified by participants in later iterations, as they are able to review comments and feedbacks provided by other experts in earlier rounds [31].”
BackgroundAmerican College of Sports Medicine position stand
Otis, C. L. (1997) · Medical Entomology and Zoology · Cited by 4,407 · see citing works
Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1994) · Journal of Marketing · doi:10.1177/002224299405800109 · Cited by 3,322 · see citing works
Physical Activity and Public Health in Older Adults
Nelson, M. E., Rejeski, W. J., Blair, S. N., Duncan, P. W., Judge, J. O., King, A. C., Macera, C. A., & Castaneda‐Sceppa, C. (2007) · Circulation · doi:10.1161/circulationaha.107.185650 · Cited by 2,991 · see citing works
The Delphi technique: myths and realities
Powell, C. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02537.x · Cited by 2,611 · see citing works
Dawes, J. G. (2008) · International Journal of Market Research · doi:10.1177/147078530805000106 · Cited by 2,245 · see citing works
NELSON, M. E., REJESKI, W. J., BLAIR, S. N., DUNCAN, P. W., JUDGE, J. O., KING, A. C., MACERA, C. A., & CASTANEDA-SCEPPA, C. (2007) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3180616aa2 · Cited by 2,089 · see citing works
Consensus methods: characteristics and guidelines for use
Fink, A., Kosecoff, J., Chassin, M., & Brook, R. H. (1984) · American Journal of Public Health · doi:10.2105/ajph.74.9.979 · Cited by 2,089 · see citing works
Consensus development methods, and their use in clinical guideline development.
Murphy, M., Black, Lamping, McKee, M., Sanderson, Askham, & Marteau (1998) · Health Technology Assessment · doi:10.3310/hta2030 · Cited by 2,042 · see citing works
Taylor, S. A., & Baker, T. L. (1994) · Journal of Retailing · doi:10.1016/0022-4359(94)90013-2 · Cited by 1,999 · see citing works
Active Ageing: A Policy Framework
Kalache, A., & Gatti, A. (2002) · The Aging Male · doi:10.1080/713604647 · Cited by 1,764 · see citing works
Crisp, J., Pelletier, D., Duffield, C. M., Adams, A. M. N., & Nagy, S. A. (1997) · Nursing Research · doi:10.1097/00006199-199703000-00010 · Cited by 1,388 · see citing works
Current validity of the Delphi method in social sciences
Landeta, J. (2006) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2005.09.002 · Cited by 1,353 · see citing works
Kotter, J. P. (2009) · IEEE Engineering Management Review · doi:10.1109/emr.2009.5235494 · Cited by 1,134 · see citing works
Barriers and motivations to exercise in older adults
SCHUTZER, K. (2004) · Preventive Medicine · doi:10.1016/j.ypmed.2004.04.003 · Cited by 1,038 · see citing works
The Delphi technique in health sciences education research
de Villiers, M., Villiers, P. J. T. D., & Kent, A. (2005) · Medical Teacher · doi:10.1080/13611260500069947 · Cited by 1,007 · see citing works
Consensus development methods, and their use in clinical guideline development.
Murphy, M. P., Black, N. A., Lamping, D. L., et al. (1998) · PubMed · Cited by 965 · see citing works
Theory and applications of the Delphi technique: A bibliography (1975–1994)
Gupta, U. G., & Clarke, R. E. (1996) · Technological Forecasting and Social Change · doi:10.1016/s0040-1625(96)00094-7 · Cited by 577 · see citing works
The Delphi Technique: An Adaptive Research Tool
Sumsion, T. (1998) · British Journal of Occupational Therapy · doi:10.1177/030802269806100403 · Cited by 522 · see citing works
Intervention mapping : designing theory- and evidence-based health promotion programs
Kok, G. J., & Parcel, G. S. (2000) · Cited by 396 · see citing works
Guidelines for Cardiac Rehabilitation and Secondary Prevention Programs
Lalonde, F. (2012) · The Journal of the American Osteopathic Association · doi:10.7556/jaoa.2012.112.11.753 · Cited by 349 · see citing works
Balady, G. J., CHAITMAN, B. R., Driscoll, D., Foster, C., Froelicher, E. S., Gordon, N. F., Pate, R. R., Rippe, J. M., & Bazzarre, T. L. (1998) · Circulation · doi:10.1161/01.cir.97.22.2283 · Cited by 320 · see citing works
Effectiveness of exercise-referral schemes to promote physical activity in adults: systematic review
Williams, N. H., Hendry, M., France, B., Lewis, R. A., & Wilkinson, C. (2007) · British Journal of General Practice · doi:10.3399/096016407782604866 · Cited by 320 · see citing works
Report of the World Health Organization. Active ageing: a policy framework.
(2002) · PubMed · Cited by 316 · see citing works
STUDIES IN THE QUALITY OF LIFE; DELPHI AND DECISION-MAKING.
Dalkey, N. C. (1972) · Lexington Books · Cited by 300 · see citing works
Physical Activity Outcomes of CHAMPS II: A Physical Activity Promotion Program for Older Adults
Stewart, A. L., Verboncoeur, C. J., McLellan, B. Y., Gillis, D., Rush, S., Mills, K. M., King, A. C., Ritter, P. L., Brown, B. W., & Bortz, W. M. (2001) · The Journals of Gerontology Series A · doi:10.1093/gerona/56.8.m465 · Cited by 296 · see citing works
Theory and practice of leadership
Gill, R. C. (2006) · Cited by 261 · see citing works
Delphi Technique: Expanding Applications.
Brooks, K. W. (1979) · The North Central Association quarterly · Cited by 166 · see citing works
Physical Activity Programs and Behavior Counseling in Older Adult Populations
Cress, M. E., Büchner, D. M., PROHASKA, T. R., Rimmer, J. H., Brown, M., Macera, C., DePietro, L., & Chodzko-Zajko, W. J. (2004) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000145451.08166.97 · Cited by 165 · see citing works
American Association of Cardiovascular and Pulmonary Rehabilitation
Wilson, P. K. (1985) · Journal of Cardiopulmonary Rehabilitation · doi:10.1097/00008483-198507000-00001 · Cited by 161 · see citing works
Minkman, M. M. N., Ahaus, K., & Huijsman, R. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzl071 · Cited by 146 · see citing works
Thurston, M., & Green, K. (2004) · Health Promotion International · doi:10.1093/heapro/dah311 · Cited by 103 · see citing works
Exercise Referral Systems: a National Quality Assurance Framework
Craig, A., Dinan, S., Smith, A., Taylor, A. W., & Webborn, N. (2001) · UCL Discovery (University College London) · Cited by 99 · see citing works
A qualitative analysis of leadership and quality improvement
Waldman, D. A., Lituchy, T. R., Gopalakrishnan, M., Laframboise, K., Galperin, B. L., & Kaltsounakis, Z. (1998) · The Leadership Quarterly · doi:10.1016/s1048-9843(98)90004-2 · Cited by 98 · see citing works
Kelly, C., Jorm, A. F., & Kitchener, B. A. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-49 · Cited by 93 · see citing works
Experimental Assessment of Delphi Procedures with Group Value Judgments
Dalkey, N. C., & Rourke, D. (1971) · Cited by 92 · see citing works
van Stralen, M. M., Lechner, L., Mudde, A. N., de Vries, H., & Bolman, C. A. W. (2008) · Health Education Research · doi:10.1093/her/cyn045 · Cited by 91 · see citing works
Assessment of Factors Associated with Exercise Enjoyment
Wininger, S. R., & Pargman, D. (2003) · Journal of Music Therapy · doi:10.1093/jmt/40.1.57 · Cited by 87 · see citing works
Sadeh, E. (2010) · Siti Hasmah Digital Library-MMU Institutiona Repository (Multimedia University) · Cited by 84 · see citing works
Anti-aging therapy through fitness enhancement
Castillo-Garzón, M. J., Ruiz, J. R., Ortega, F. B., & Gutiérrez, Á. (2006) · Clinical Interventions in Aging · doi:10.2147/ciia.2006.1.3.213 · Cited by 83 · see citing works
Bigelow, B. E., & Cornish, E. (1978) · The American Historical Review · doi:10.2307/1861858 · Cited by 75 · see citing works
The Fundamental Concepts of Excellence
Vuković, A., Ikonić, M., & Pavletić, D. (2007) · Cited by 64 · see citing works
Enjoyment: a link to physical activity, leisure, and health.
Henderson, K. A., & Ainsworth, B. E. (2002) · NCSU Libraries Repository (North Carolina State University Libraries) · Cited by 61 · see citing works
Committed to quality: the use of quality schemes in UK public leisure services
Robinson, L. (2003) · Managing Service Quality · doi:10.1108/09604520310476508 · Cited by 57 · see citing works
Snyder‐Halpern, R., Thompson, C. B., & Schaffer, J. (2000) · PubMed · Cited by 53 · see citing works
Best practice in business excellence
Oakland, J. S., Tanner, S. J., & Gadd, K. W. (2002) · Total Quality Management · doi:10.1080/09544120200000008 · Cited by 52 · see citing works
Tran, D. T. T., Hall, L. M., Davis, A. M., Landry, M. D., Burnett, D., Berg, K., & Jaglal, S. B. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-249 · Cited by 42 · see citing works
The development of an internet-based outpatient cardiac rehabilitation intervention: a Delphi study
Vandelanotte, C., Dwyer, T., Itallie, A. K. V., Hanley, C., & Mummery, W. K. (2010) · BMC Cardiovascular Disorders · doi:10.1186/1471-2261-10-27 · Cited by 37 · see citing works
Lieff, S. (2008) · Academic Medicine · doi:10.1097/acm.0b013e3181900f4b · Cited by 36 · see citing works
Best practice customer service
Oakland, J. S. (1995) · Total Quality Management · doi:10.1080/09544129550035486 · Cited by 31 · see citing works
Kelly, C. M., Hoehner, C. M., Baker, E. A., Ramirez, L. K. B., & Brownson, R. C. (2006) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2005.11.007 · Cited by 30 · see citing works
Evaluating treatment process redesign by applying the EFQM Excellence Model
Nabitz, U. W., Schramade, M., & Schippers, G. M. (2006) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzl033 · Cited by 30 · see citing works
Implementing Quality Management in the University: The Role of Leadership in Finnish Universities
Anyamele, S. (2005) · Higher Education in Europe · doi:10.1080/03797720600624799 · Cited by 29 · see citing works
The new leaders: Achieving corporate transformation through dynamic leadership
(1996) · Long Range Planning · doi:10.1016/s0024-6301(96)90307-6 · Cited by 26 · see citing works
Expert consensus for discharge referral decisions using online delphi.
Bowles, K. H., Holmes, J. H., Naylor, M. D., et al. (2003) · PubMed · Cited by 19 · see citing works
A framework for evaluating community-based physical activity promotion programmes in Latin America
Schmid, T. L., Librett, J. J., Neiman, A. B., et al. (2006) · Promotion & Education · doi:10.1177/10253823060130020105 · Cited by 14 · see citing works
Establishing public health benchmarks for physical activity programs.
Martin, S. L., & Vehige, T. (2006) · PubMed · Cited by 11 · see citing works
Community Health Program Evaluation Using Accreditation as a Framework
Severance, J. H. (2008) · Evaluation & the Health Professions · doi:10.1177/0163278708328742 · Cited by 8 · see citing works
Quality Management in Long-Term Care
Pieper, R., Frommelt, M., Heislbetz, C., et al. (2007) · Springer eBooks · doi:10.1007/978-0-387-72169-9_6 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Eccles J Gootman J Quality: building the evidence base Forum Focus 2003 1 Washington, DC: The Forum for Youth Investment, Impact Strategies, Inc 1 7 http://www.forumforyouthinvestment.org July/August edition [Accessed 10 May 2010]
Cited by
Sorted by citations
Messing, S., Rütten, A., Abu-Omar, K., Ungerer-Röhrich, U., Goodwin, L., Burlacu, I., & Gediga, G. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00055 · Cited by 259 · see citing works
- Authors
- Marques, A. I., Santos, L., Soares, P., Santos, R., Oliveira-Tavares, A., Mota, J., & Carvalho, J.
- Affiliations
- Universidade do Porto (PT)
- University of Minho (PT)
- University of Aveiro (PT)
- Corresponding author
- Marques, Ana I
- Venue
- International Journal of Behavioral Nutrition and Physical Activity
- Published
- 2011
- Volume
- 8
- Issue
- 1
- Pages
- 104
- ISSN
- 1479-5868 (ISSN-L)
- PMC
- PMC3278362
- OpenAlex
- W2116392054
- Cited by
- 24
- References
- 64
- Citations by year
- 2024: 2 · 2023: 3 · 2022: 1 · 2020: 1 · 2019: 4 · 2018: 2 · 2016: 2 · 2015: 3 · 2014: 1 · 2013: 4 · 2012: 1
- FWCI
- 6.41
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- International Journal of Behavioral Nutrition and Physical Activity (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Online (University of Wollongong) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion)
- Funders
- Fundação para a Ciência e a Tecnologia
- Topics
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Physiology › Physical Activity and Health
- Health Sciences › Health Professions › Health Information Management › Healthcare Quality and Management
- Keywords
- quality management, EFQM excellence model, self-assessment tool, good practice principles, Delphi consensus, health promotion interventions, quality improvement, population aging
- MeSH terms
- Aged, Aging, Delivery of Health Care, Delphi Technique, Europe, Geriatrics, Health Promotion, Humans, Quality Control, Sports, Program Evaluation, Exercise, Practice Guidelines as Topic, Internet, Consensus
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
