Construct validity of a revised version of the Occupational Balance Questionnaire
Open accessThe DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index; 2 of the 25 sources its claims cite were checked for support.
Abstract
Rasch measurement analyses suggested a revised OBQ11 with good reliability, model fit, and measurement invariance across age and gender groups.
Overview
CoChat Summary
TL;DR
Using Rasch measurement theory on two Swedish general population samples, the 13-item Occupational Balance Questionnaire (OBQ) was revised to the OBQ11, with 11 items and four response categories. The OBQ11 showed good reliability (PSI 0.92), acceptable model fit, and no disordered thresholds, but further validation in other samples is needed.
Key findings
- The original 13-item OBQ with six response categories had disordered thresholds in items 2, 4, 6, and 7; collapsing response categories from six to four (0 = completely disagree to 3 = completely agree) made the rating scale work as intended.
- Items 3 (“Perceiving one’s occupations as meaningful”) and 6 (“Balance between doing things alone and with others”) showed misfit due to multidimensionality (fit residuals 4.034 and 2.902, respectively); removing both yielded the OBQ11, with all residuals nonsignificant and within −2.5 to 2.5.
- The OBQ11 had a Person Separation Index reliability of 0.92, total item chi-square 18.21 (df 22, p = 0.693), no floor effects, and a 3% (n = 6) ceiling effect; mean person location was 0.3 (1.83) logits.
- Hierarchical item ordering was supported relative to previous research: item 4 (“Time for doing things wanted”) represented the lower end (−1.022 logits), while item 5 (“Balance between work, home, family, leisure, rest, and sleep”) represented the highest level (0.378 logits); one item (number 11) showed a different location in the OBQ11 compared with the original OBQ.
Methods
- Rasch measurement theory using RUMM2030 and the unrestricted polytomous (“partial credit”) Rasch model; analyses assessed item fit, reliability (PSI), response category thresholds, differential item functioning (DIF) by gender and age (younger 20–49 vs older 50–89, median split), targeting, and hierarchical item ordering.
- Two purposive general population samples from Southern Sweden: Sample 1 (n = 168, aged 21–64, mean age 53 [SD 12], 68% women) completed the original 13-item/6-category OBQ; Sample 2 (n = 207, aged 20–89, mean age 50 [SD 13], 64% women) completed the revised 13-item/4-category version, leading to the OBQ11.
- Bonferroni adjustments were applied with alpha set at 0.05; DIF was examined via 2-way ANOVAs of residuals, and local dependence was assessed through relative correlations between standardized item residuals.
Limitations
- The paper states that mean age was around 50 and about two thirds were women, which may have affected results; the OBQ11 needs testing in additional samples of other ages, a more even gender distribution, patient groups, and across countries and cultures.
- The paper states that sample sizes were somewhat limited, particularly Sample 1; it notes that about 150 can be acceptable for initial issue detection and that Sample 2’s size represents a fair balance for Rasch fit assessment using RUMM2030.
- The paper reports targeting gaps: person locations were not optimally represented by item locations, with gaps between approximately −0.2 and −1.8 logits and between about 1 and 2 logits, plus non-coverage at extreme levels of occupational balance, meaning less precision at those intervals.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
2 Valid · 0 Not valid · 14 Not checked · 61 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“However, CTT approaches to assessing the measurement properties of scales have limitations [11 -13].”
What the sources say
- Not checked — no full text of the sourcecites [11] [11] Hobart JC, Cano SJ, Zajicek JP, et al. Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007;6(12):1094 -1105. - source
- Supportedcites [12] [12] Hobart J, Cano S. Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods. Health Technol Assess. 2009;13(12):1 -200. - source
The Overview (p. 9) explicitly identifies limitations of approaches underpinned by Classical Test Theory, including the inability to verify the theory in data and problems treating total scores as measurements. The Results section also identifies sample-dependent scale performance as a limitation of traditional psychometric methods. (LLM, conf=0.94)
- Not checked — no full text of the sourcecites [13] [13] Hagell P. Measuring activities of daily living in Parkinson ' s disease: on a road to nowhere and back again? Measurement. 2019;132:109 -124. - source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“a revised version, the OBQ11, was suggested and exhibited response categories that worked properly, good reliability (0.92), model fit and measurement invariance across age and gender groups.”
plainn = 2- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“Other reasons may also include multidimensionality [19], which appeared to be the case for three items, or local response dependence [23,29], which was indicated for four items (Table 3).”
What the sources say
- Not checked — no full text of the sourcecites [23] [23] Marais I. Local dependence. In KB Christensen, S Kreiner, M Mesbah (Eds.). Rasch models in health. Croydon, Surrey, UK: John Wiley & Sons, 2013. pp. 111 -130. - source
- Not checked — no full text of the sourcecites [29] [29] Hagqvist C. Evaluating composite health measures using Rasch modelling: an illustrative example. Soz Praventivmed. 2001;46:369 -378. - source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Other reasons may also include multidimensionality [19], which appeared to be the case for three items, or local response dependence [23,29], which was indicated for four items (Table 3).”
What the sources say
- Not checked — no full text of the sourcecites [19] [19] Wolfe EW, Smith EV. Instrument development tools and activities for measure validation using Rasch models: part II -validation activities. J Appl Meas. 2007;8(2):204 -234. -
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Following this, the rating scale worked as intended (data not shown).”
plainstates a causen = 168- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
39 more claims
Create a free account to see all 77 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 14
- It may state two separate claims as one. 21
Citations
Cites
Multiple significance tests: the Bonferroni method
Bland, J. M., & Altman, D. G. (1995) · BMJ · doi:10.1136/bmj.310.6973.170 · Cited by 3,341
Probabilistic Models for some Intelligence and Attainment Tests.
Wolins, L., Wright, B. D., & Rasch, G. (1982) · Journal of the American Statistical Association · doi:10.2307/2287805 · Cited by 1,979
Andrich, D. (1988) · doi:10.4135/9781412985598 · Cited by 1,345
Christensen, K. B., Makransky, G., & Horton, M. (2017) · Applied Psychological Measurement · doi:10.1177/0146621616677520 · Cited by 691
Hobart, J., & Cano, S. (2009) · Health Technology Assessment · doi:10.3310/hta13120 · Cited by 621
Hobart, J. C., Cano, S. J., Zajicek, J. P., & Thompson, A. J. (2007) · The Lancet Neurology · doi:10.1016/s1474-4422(07)70290-9 · Cited by 495
(2007) · PubMed · Cited by 339
Occupational balance as used in occupational therapy: A concept analysis
Wagman, P., Håkansson, C., & Björklund, A. (2012) · Scandinavian Journal of Occupational Therapy · doi:10.3109/11038128.2011.596219 · Cited by 334
Self-citationWilson, M. (2004) · doi:10.4324/9781410611697 · Cited by 277 · cited 1×
“Furthermore, the Rasch model determines empirically how items (and persons) are ordered on a latent continuum from less to more of the target variable, which allows for an investigation of the coherence between the instrument and its underpinning theory [18,19].”
BackgroundRating scales and Rasch measurement
Andrich, D. (2011) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.11.59 · Cited by 262 · cited 2×
“Taken together, these analyses provide evidence of potential anomalies between any particular item which may over- or under discriminate relative to the summary discrimination of all items [22].”
BackgroundA proposed model of lifestyle balance
Matuska, K. M., & Christiansen, C. H. (2008) · Journal of Occupational Science · doi:10.1080/14427591.2008.9686602 · Cited by 254 · cited 1×
“ance model [3] and defines it as ‘a satisfying pattern of”
BackgroundHagquist, C., & Andrich, D. (2017) · Health and Quality of Life Outcomes · doi:10.1186/s12955-017-0755-0 · Cited by 206 · cited 1×
“Here we addressed uniform (subgroup main effect) and non-uniformed (subgroup location interaction effect) DIF by 2-way ANOVAs of residuals [25].”
MethodIntroducing the Occupational Balance Questionnaire (OBQ)
Wagman, P., & Håkansson, C. (2014) · Scandinavian Journal of Occupational Therapy · doi:10.3109/11038128.2014.900571 · Cited by 190 · cited 3×
“Therefore, we developed the Occupational Balance Questionnaire (OBQ) [7].”
MethodResultInfluentialSelf-citation(2016) · PubMed · Cited by 115
Self-citationAchieving Balance In Everyday Life
Håkansson, C., Dahlin‐Ivanoff, S., & Sonn, U. (2006) · Journal of Occupational Science · doi:10.1080/14427591.2006.9686572 · Cited by 114
Self-citationMarais, I. (2012) · Rasch Models in Health · doi:10.1002/9781118574454.ch7 · Cited by 95
Exploring occupational balance in adults in Sweden
Wagman, P., & Håkansson, C. (2014) · Scandinavian Journal of Occupational Therapy · doi:10.3109/11038128.2014.934917 · Cited by 90 · cited 1×
“out children [37] and probably between people with disabilities and without them.”
BackgroundSelf-citationMan as a Measurement Instrument
Pendrill, L. (2014) · NCSLI Measure · doi:10.1080/19315775.2014.11721702 · Cited by 88 · cited 1×
“The Rasch model is a general unidimensional measurement model for latent variables that is based on the same principles as measurements in physical sciences; the model states that the probability of a certain item response depends on the level of the measured construct represented by the item and the person, respectiv…”
BackgroundAn introduction to the Rasch measurement approach for metrologists
Mari, L., & Wilson, M. (2014) · Measurement · doi:10.1016/j.measurement.2014.02.014 · Cited by 84 · cited 1×
“The Rasch model is a general unidimensional measurement model for latent variables that is based on the same principles as measurements in physical sciences; the model states that the probability of a certain item response depends on the level of the measured construct represented by the item and the person, respectiv…”
BackgroundDescription and Development of the Life Balance Inventory
Matuska, K. (2012) · OTJR: Occupational Therapy Journal of Research · doi:10.3928/15394492-20110610-01 · Cited by 74 · cited 4×
“LBI consists of 53 predefined activities and people rate how satisfied they are with how much time they spent doing the activity in the last month.”
BackgroundInfluentialEklund, M., Erlandsson, L.-K., Persson, D., & Hagell, P. (2009) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038120802596253 · Cited by 65 · cited 1×
“Also, combining the OBQ11 with measures of occupational meaning or value, such as the Occupational Value Assessment with predefined items (OVal-pd) [35], and measures of the social environment [36] is likely a feasible approach to capture a wider array of”
MethodSelf-citationPerceptions of employment, domestic work, and leisure as predictors of health among women and men
Håkansson, C., & Ahlborg, G. (2010) · Journal of Occupational Science · doi:10.1080/14427591.2010.9686689 · Cited by 64 · cited 3×
“have shown that occupational balance differs between men and women [31] between people with and with-”
BackgroundMethodResultSelf-citationDür, M., Steiner, G., Fialka-Moser, V., Kautzky-Willer, A., Dejaco, C., Prodinger, B., Stoffer, M. A., Binder, A., Smolen, J., & Stamm, T. A. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-45 · Cited by 59 · cited 2×
“and types of occupation [5], as described below.”
MethodHåkansson, C., Björkelund, C., & Eklund, M. (2011) · Australian Occupational Therapy Journal · doi:10.1111/j.1440-1630.2011.00976.x · Cited by 55 · cited 2×
“As illustrated in Table 3, there was support for the logic of the hierarchical item ordering relative to previous research [31,32].”
MethodResultSelf-citationPerceptions of Life Balance Among a Working Population in Sweden
Wagman, P., Björklund, A., Håkansson, C., Jacobsson, C., & Falkmer, T. (2011) · Qualitative Health Research · doi:10.1177/1049732310379240 · Cited by 52
Self-citationTheoretical perspectives of balance and the influence of gender ideologies
Wada, M., Backman, C. L., & Forwell, S. J. (2010) · Journal of Occupational Science · doi:10.1080/14427591.2010.9686680 · Cited by 47 · cited 1×
“Furthermore, in a previous literature review [33] one of four identified perspectives of occupational balance was congruence between values and occupations.”
BackgroundWagman, P., Håkansson, C., Jacobsson, C., Falkmer, T., & Björklund, A. (2012) · Scandinavian Journal of Occupational Therapy · doi:10.3109/11038128.2011.645552 · Cited by 46
Self-citationEvaluating composite health measures using Rasch modelling: An illustrative example
Hagquist, C. (2001) · Sozial- und Präventivmedizin SPM · doi:10.1007/bf01321663 · Cited by 34 · cited 1×
“[23,29], which was indicated for four items (Table 3).”
BackgroundThe Meaningful Activity Wants and Needs Assessment: A Perspective on Life Balance
Eakman, A. M. (2015) · Journal of Occupational Science · doi:10.1080/14427591.2013.769405 · Cited by 23 · cited 2×
“need satisfaction [2–3], levels of meaningfulness [4],”
BackgroundMeasuring activities of daily living in Parkinson’s disease: On a road to nowhere and back again?
Hagell, P. (2019) · Measurement · doi:10.1016/j.measurement.2018.09.050 · Cited by 23
Self-citationUtilization of the Swedish version of the Assessment of Communication and Interaction Skills
Kjellberg, A., & Haglund, L. (2015) · British Journal of Occupational Therapy · doi:10.1177/0308022615580328 · Cited by 3 · cited 1×
“Also, combining the OBQ11 with measures of occupational meaning or value, such as the Occupational Value Assessment with predefined items (OVal-pd) [35], and measures of the social environment [36] is likely a feasible approach to capture a wider array of”
Method
Research works printed but not linked: 7
- [1] Meyer A. The philosophy of occupation therapy. Am J Occup Ther. 1977;31(10):639 -642. (Reprinted from Arch Occup Ther 1922;1:1-10). - · doi:10.5014/ajot.2009.31.10.639
- [20] Andrich D. An index of person separation in latent trait theory, the traditional KR-20 index, and the Guttman scale response pattern. Educ Psychol Res. 1982;9:95 -104. -
- [21] Andrich D, Luo G, Sheridan B. Interpreting RUMM 2030. Perth: WA: RUMM Laboratory, 2013. -
- [26] Andrich D, Sheridan B, Luo G. RUMM2030: Rasch unidimensional models for measurement. Perth, Australia: RUMM Laboratory; 1997. -
- [30] Hudgens S, Dieneen K, Webster K, et al. Assessing statistically and clinically meaningful construct deficiency/saturation: recommended criteria for content coverage and item writing. Rasch Meas Trans. 2004; 17:954 -955. -
- [34] Backman C. Occupational balance and well-being. In CH Christiansen, EA Townsend. Introduction to occupation. The arts and science of living. Upper Saddle River, NJ; Pearson Education Inc. 2010. -
- [38] Regnault A. A mixed methods framework for the development of patient-centered outcome measures. Paper presented at the 7th International Conference on Probabilistic Models for Measurements. Perth, Australia 17-19 January, 2017.
Cited by
Validity and reliability of the Turkish Occupational Balance Questionnaire (OBQ11-T)
Günal, A., Pekçetin, S., Demirtürk, F., Şenol, H., Håkansson, C., & Wagman, P. (2019) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2019.1673479 · Cited by 102
Self-citationTennant, A., & Küçükdeveci, A. A. (2023) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2023.1208670 · Cited by 104
“Increasingly, the term “Rasch measurement theory” (RMT) is applied as the framework for such analysis, originally expiated in Part B of Rasch’s book (4, 121).”
MethodHåkansson, C., Leo, U., Oudin, A., Arvidsson, I., Nilsson, K., Österberg, K., & Persson, R. (2021) · BMC Public Health · doi:10.1186/s12889-021-10809-6 · Cited by 48
Self-citationOccupational Health among Swedish Occupational Therapists: A Cross-Sectional Study
Lexén, A., Kåhlin, I., Erlandsson, L., & Håkansson, C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17103379 · Cited by 33
“Occupational Balance Occupational balance was assessed using the Occupational Balance Questionnaire (OBQ11) [32,33].”
BackgroundMethodInfluentialSelf-citationOccupational balance and quality of life in mothers of children with cerebral palsy
Günal, A., Pekçetin, S., Wagman, P., Håkansson, C., & Kayıhan, H. (2021) · British Journal of Occupational Therapy · doi:10.1177/0308022621995112 · Cited by 43
“Spearman correlation analysis was used to evaluate correlations between the OBQ11-T and NHP. Spearman’s correlation coefficient (r) values were classified as indicating very weak (0.00–0.19), weak (0.20–0.39), moderate (0.40–0.59), moderately strong (0.60–0.79), and strong (0.80–1.0) relations between variables (Alpar…”
MethodInfluentialSelf-citation
Metadata
- Authors
- Håkansson, C., Wagman, P., & Hagell, P.
- Affiliations
- Lund University (SE)
- Jönköping University (SE)
- Kristianstad University (SE)
- Corresponding author
- Håkansson, Carita
- Venue
- Scandinavian Journal of Occupational Therapy
- Published
- 2019-09-14
- Volume
- 27
- Issue
- 6
- Pages
- 441-449
- ISSN
- 1103-8128 (ISSN-L)
- 1651-2014
- OpenAlex
- W2972448699
- Cited by
- 115
- References
- 30
- Citations by year
- 2026: 15 · 2025: 28 · 2024: 14 · 2023: 24 · 2022: 10 · 2021: 18 · 2020: 5 · 2019: 1
- FWCI
- 18.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Scandinavian Journal of Occupational Therapy (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Högskolan Kristianstad Publikationer (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Lund University Publications (Lund University) (submittedVersion)
- Topics
- Health Sciences › Health Professions › Occupational Therapy › Occupational Therapy Practice and Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Keywords
- occupational balance, construct validity, Rasch measurement theory, questionnaire revision, measurement invariance, multidimensionality, response scales, occupational therapy assessment
- MeSH terms
- Adult, Aged, Aged, 80 and over, Female, Humans, Male, Middle Aged, Occupational Therapy, Psychometrics, Surveys and Questionnaires, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.