An Examination of the Factor Structure of the Multidimensional Psychological Flexibility Inventory.
The DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index.
Abstract
The Multidimensional Psychological Flexibility Inventory (MPFI), a 60-item self-report measure, assesses the Acceptance and Commitment Therapy Hexaflex. The factor structure of the MPFI was examined in this study. In a community sample of adults (N = 827), four models (correlated six-factor, one-factor, higher order, and bifactor) were tested for each of the constructs of interest (i.e., psychological flexibility and psychological inflexibility). All models, with the exception of the one-factor, provided adequate fit to the data. Differences between the three adequate fitting models were trivial in magnitude. Additional statistical indices from the bifactor models indicated that the general factors accounted for the large majority of reliable variance. The majority of the domain-specific factors evidenced redundancy with their respective general factors. Results from a series of structural regressions indicated that the domain-specific factors did not provide additional incremental utility above and beyond the general factors in predicting two relevant clinical constructs (i.e., health anxiety and depression). These results provide support for the use of the MPFI Flexibility and Inflexibility total scores, but not subscale scores. The MPFI may require further refinement to either greatly reduce the length of the measure, or to ensure that subscales have incremental utility.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent bifactor analyses suggest that the general flexibility and inflexibility scales are preferable to subscale scores, given that they are more stable and account for the most reliable item variance [68].”
From Trajectories of Maternal and Paternal Internalizing Symptoms from Pregnancy to 2 Years Postpartum: Identifying Modifiable Risk and Protective Factors (2024) · cites this paper as [68]
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Principles and Practice of Structural Equation Modeling
Tabri, N., & Elliott, C. M. (2012) · Canadian Graduate Journal of Sociology and Criminology · doi:10.15353/cgjsc-rcessc.v1i1.25 · Cited by 38,891
null (2016) · Philosophy Study · doi:10.17265/2159-5313/2016.09.003 · Cited by 28,317
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Confirmatory factor analysis for applied research
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,614
Power analysis and determination of sample size for covariance structure modeling.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.130 · Cited by 10,418
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Acceptance and commitment therapy: model, processes and outcomes
Hayes, S. C., Luoma, J. B., Bond, F. W., Masuda, A., & Lillis, J. (2006) · Behaviour Research and Therapy · doi:10.1016/j.brat.2005.06.006 · Cited by 6,587 · cited 2×
“While empirical evidence supports the use of ACT for treating individuals with a number of psychological disorders (e.g., Arch et al., 2012; Bai et al., 2020; Hayes et al., 2006), research related to the measurement of the domains of psychological flexibility has moved more slowly (Hayes et al.”
Background(1999) · Cited by 5,934
Sample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.03.007 · Cited by 3,950 · cited 2×
“The most common self-report measures of psychological flexibility are the Acceptance and Action Questionnaire–II (AAQ-II; Bond et al., 2011) and the Multidimensional Experiential Avoidance Scale (MEAQ; Gámez et al., 2011).”
BackgroundRunning experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Psychological flexibility as a fundamental aspect of health
Kashdan, T. B., & Rottenberg, J. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.03.001 · Cited by 3,054
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Evaluating Bifactor Models: Calculating and Interpreting Statistical Indices
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016) · Psychological Methods · doi:10.1037/met0000045 · Cited by 1,599
Reise, S. P., Moore, T. M., & Haviland, M. G. (2010) · Journal of Personality Assessment · doi:10.1080/00223891.2010.496477 · Cited by 1,187
Conducting Clinical Research Using Crowdsourced Convenience Samples
Chandler, J., & Shapiro, D. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093623 · Cited by 1,072
Scoring and Modeling Psychological Measures in the Presence of Multidimensionality
Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013) · Journal of Personality Assessment · doi:10.1080/00223891.2012.725437 · Cited by 1,069
The viability of crowdsourcing for survey research
Behrend, T. S., Sharek, D. J., Meade, A. W., & Wiebe, E. N. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0081-0 · Cited by 1,018
A Comparison of Bifactor and Second-Order Models of Quality of Life
Chen, F. F., West, S., & Sousa, K. (2006) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4102_5 · Cited by 955 · cited 1×
“Because the MPFI was designed for use with total and subscale scores, it is important to use an analytic approach that can simultaneously address both of these assumptions (i.e., bifactor analysis; Chen et al., 2006).”
MethodOn structural equation modeling with data that are not missing completely at random
Muthén, B., Kaplan, D., & Hollis, M. (1987) · Psychometrika · doi:10.1007/bf02294365 · Cited by 883
Pilowsky, I. (1967) · British Journal of Psychiatry · doi:10.1192/bjp.113.494.89 · Cited by 865
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., & Watson, D. (2011) · Psychological Assessment · doi:10.1037/a0023242 · Cited by 524 · cited 2×
“The most common self-report measures of psychological flexibility are the Acceptance and Action Questionnaire–II (AAQ-II; Bond et al., 2011) and the Multidimensional Experiential Avoidance Scale (MEAQ; Gámez et al., 2011).”
Rolffs, J. L., Rogge, R. D., & Wilson, K. G. (2018) · Assessment · doi:10.1177/1073191116645905 · Cited by 504
The brief experiential avoidance questionnaire: Development and initial validation
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., Suzuki, N., & Watson, D. (2014) · Psychological Assessment · doi:10.1037/a0034473 · Cited by 450 · cited 2×
“The MEAQ and its shorter counterpart, the Brief Experiential Avoidance Questionnaire (Gámez et al., 2014), were developed to provide sufficient coverage of different manifestations of experiential avoidance and to address concerns regarding the construct validity of the AAQ-II (Rochefort et al., 2018; Wolgast, 2014).”
BackgroundArch, J. J., Eifert, G. H., Davies, C., Vilardaga, J. C. P., Rose, R. D., & Craske, M. G. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028310 · Cited by 443
What Does the Acceptance and Action Questionnaire (AAQ-II) Really Measure?
Wolgast, M. (2014) · Behavior Therapy · doi:10.1016/j.beth.2014.07.002 · Cited by 421 · cited 8×
“Specifically, some evidence indicates that the AAQ-II is 1Auburn University, Auburn, AL, USA Corresponding Author: Joseph R. Bardeen, Department of Psychological Sciences, Auburn University, 226 Thach Hall, Auburn, AL 36849, USA.”
BackgroundInfluentialThree Concerns With Applying a Bifactor Model as a Structure of Psychopathology
Bonifay, W., Lane, S. P., & Reise, S. P. (2017) · Clinical Psychological Science · doi:10.1177/2167702616657069 · Cited by 390
Acceptance and Commitment Therapy (ACT) to reduce depression: a systematic review and meta-analysis
Bai, Z., Luo, S., Zhang, L., Wu, S., & Chi, I. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.09.040 · Cited by 321 · cited 1×
“While empirical evidence supports the use of ACT for treating individuals with a number of psychological disorders (e.g., Arch et al., 2012; Bai et al., 2020; Hayes et al., 2006), research related to the measurement of the domains of psychological flexibility has moved more slowly (Hayes et al.”
BackgroundExperiential Avoidance: An Examination of the Construct Validity of the AAQ-II and MEAQ
Rochefort, C., Baldwin, A. S., & Chmielewski, M. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.08.008 · Cited by 247 · cited 8×
“Specifically, some evidence indicates that the AAQ-II is 1Auburn University, Auburn, AL, USA Corresponding Author: Joseph R. Bardeen, Department of Psychological Sciences, Auburn University, 226 Thach Hall, Auburn, AL 36849, USA.”
BackgroundInfluentialReise, S. P., Kim, D. S., Mansolf, M., & Widaman, K. F. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1243461 · Cited by 181
Landi, G., Pakenham, K. I., Boccolini, G., Grandi, S., & Tossani, E. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.02195 · Cited by 146 · cited 1×
“Health anxiety has also recently been a focus of ACT outcome research, with several recently published studies examining moderators of treatment outcome with respect to health anxiety, especially within the context of the COVID pandemic (Landi et al., 2020; Leonidou et al., 2019).”
Bardeen, J. R., Fergus, T. A., Hannan, S. M., & Orcutt, H. K. (2016) · Journal of Personality Assessment · doi:10.1080/00223891.2015.1091774 · Cited by 110
Self-citationRogge, R. D., Daks, J. S., Dubler, B. A., & Saint, K. J. (2019) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2019.10.001 · Cited by 109 · cited 2×
“While it has not been used extensively in research, some studies have started to use the measure to capture the components of psychological flexibility (Rogge et al., 2019; Stabbe et al., 2019).”
BackgroundWang, M., & Russell, S. S. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404272494 · Cited by 97
Moroz, M., & Dunkley, D. M. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.11.006 · Cited by 89
Fonseca, S., Trindade, I. A., Mendes, A. L., & Ferreira, C. (2020) · Clinical Psychologist · doi:10.1111/cp.12194 · Cited by 89 · cited 1×
“Similarly, a clear relationship between depression and psychological inflexibility has been established in a number of empirical studies (Fonseca et al., 2020; Kashdan & Rottenberg, 2010; Yasinski et al., 2020).”
BackgroundMeasuring health anxiety: Moving past the dichotomous response option of the original Whiteley Index
Welch, P. G., Carleton, R. N., & Asmundson, G. J. G. (2009) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2009.05.006 · Cited by 88
Stabbe, O. K., Rolffs, J. L., & Rogge, R. D. (2019) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2019.03.003 · Cited by 78 · cited 3×
“While it has not been used extensively in research, some studies have started to use the measure to capture the components of psychological flexibility (Rogge et al., 2019; Stabbe et al., 2019).”
BackgroundLeonidou, C., Panayiotou, G., Bati, A., & Karekla, M. (2019) · Journal of Health Psychology · doi:10.1177/1359105316666657 · Cited by 71
Fergus, T. A., Valentiner, D. P., Gillen, M. J., Hiraoka, R., Twohig, M. P., Abramowitz, J. S., & McGrath, P. B. (2012) · Psychological Assessment · doi:10.1037/a0025776 · Cited by 68 · cited 1×
“The former and similar measures (e.g., Avoidance and Fusion Questionnaire; Fergus et al., 2012) serve as global measures of psychological inflexibility.”
BackgroundYasinski, C., Hayes, A. M., Ready, C. B., Abel, A., Görg, N., & Kuyken, W. (2020) · Psychotherapy Research · doi:10.1080/10503307.2019.1699972 · Cited by 55
Preliminary Proactive Sample Size Determination for Confirmatory Factor Analysis Models
Koran, J. (2016) · Measurement and Evaluation in Counseling and Development · doi:10.1177/0748175616664012 · Cited by 50
Asmundson, G. J. R., Carleton, N. R., Bovell, C. V., & Taylor, S. (2008) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.22.2.87 · Cited by 41
Repetitive Thought and Health Anxiety: Tests of Specificity
Fergus, T. A. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-013-9340-y · Cited by 40
Acceptance and Commitment Therapy
Hayes, S. C., & Pierson, H. (2006) · Encyclopedia of Cognitive Behavior Therapy · doi:10.1007/0-306-48581-8_1 · Cited by 35
Wheaton, M. G., Berman, N. C., & Abramowitz, J. S. (2010) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.24.3.229 · Cited by 33
Kelly, M. M., DeBeer, B. B., Meyer, E. C., Kimbrel, N. A., Gulliver, S. B., & Morissette, S. B. (2019) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/tra0000375 · Cited by 33
Veddegjærde, K.-E. F., Sivertsen, B., Wilhelmsen, I., & Skogen, J. C. (2014) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2014.06.011 · Cited by 31
Fergus, T. A. (2015) · Journal of Clinical Psychology · doi:10.1002/jclp.22194 · Cited by 29 · cited 1×
“Although health anxiety is just one of many variables that is theoretically relevant to both flexibility and inflexibility, it has been shown to be related to ACT-related constructs such as cognitive fusion and experiential avoidance in several studies (Fergus, 2015; Wheaton et al., 2010).”
BackgroundMeaning in life buffers the impact of experiential avoidance on anxiety
Kelso, K. C., Kashdan, T. B., Imamoğlu, A., & Ashraf, A. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.04.009 · Cited by 29
Factor Structure and Incremental Utility of the Distress Tolerance Scale: A Bifactor Analysis
Rogers, T. A., Bardeen, J. R., Fergus, T. A., & Benfer, N. (2018) · Assessment · doi:10.1177/1073191118789496 · Cited by 28
Self-citationBenfer, N., Rogers, T. A., & Bardeen, J. R. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.06.003 · Cited by 24
Self-citationPsychometric properties of acceptance measures: A systematic review
McAndrews, Z., Richardson, J., & Stopa, L. (2019) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2018.08.006 · Cited by 19
The buffering effect of attentional control on the relationship between cognitive fusion and anxiety
Thomas, K. N., & Bardeen, J. R. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103653 · Cited by 19
Self-citationMomeniarbat, F., Karimi, J., Erfani, N., & Kiani, J. (2017) · Romanian Journal of Diabetes Nutrition and Metabolic Diseases · doi:10.1515/rjdnmd-2017-0018 · Cited by 18
Fergus, T. A., Kelley, L. P., & Griggs, J. O. (2016) · Assessment · doi:10.1177/1073191116645908 · Cited by 16
Bardeen, J. R., & Michel, J. S. (2017) · Psychology of Religion and Spirituality · doi:10.1037/rel0000123 · Cited by 15
Self-citation(2012) · doi:10.1037/17335-004 · Cited by 2
Research works printed but not linked: 5
- Gorsuch R. L., 1983, Factor analysis
- Hancock G. R., 2001, Structural equation modeling: Present and future, 195
- Muthén L. K., 2015, Mplus
- Stucky B. D., 2015, Handbook of item response theory modeling: Applications to typical performance assessment, 183
- Yarrish C., Groshon L., Mitchell J. D., Appelbaum A., Klock S., Winternitz T., Friedman-Wheeler D. G. (2019). Finding the signal in the noise: Minimizing responses from bots and inattentive humans in online research. The Behavior Therapist, 42, 235-242. https://www.researchgate.net/publication/336564144_Finding_the_Signal_in_the_Noise_Minimizing_Responses_From_Bots_and_Inattentive_Humans_in_Online_Research
Cited by
Azadfar, Z., Abdollahi, A., Patra, I., Chang, Y.-P., Alghazali, T., & Talib, S. G. (2022) · Psicologia: Reflexao e Critica · doi:10.1186/s41155-022-00236-w · Cited by 20
“These results are in line with findings from previous research on the MPFI-60 (Landi, Pakenham, Giovannetti, et al., 2021; Lin et al., 2020; Rogge et al., 2019; Rolffs et al., 2018; Stabbe et al., 2019; Thomas et al., 2021).”
ResultPsychometric evaluation of the Swedish Multidimensional Psychological Flexibility Inventory (MPFI)
Tabrizi, F. F., Larsson, A. B., Grönvall, H., Söderstrand, L., Hallén, E., Champoux-Larsson, M.-F., Lundgren, T., Sundström, F., Lavefjord, A., Buhrman, M., et al. (2023) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2022.2153077 · Cited by 18
“Thus, the AAQ has served as a useful self-assessment tool in laboratory experiments, clinical trials and crosssectional surveys (Branstetter-Rost et al., 2009; Levin et al., 2013; Twohig et al., 2018).”
MethodHekmati, I., Abdollahpour Ranjbar, H., Ciarrochi, J., Laghaei, M., Rezaei Golezani, H., & Eskin, M. (2024) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.100717 · Cited by 17
Identification of psychological flexibility and inflexibility profiles during the COVID‐19 pandemic
Pakenham, K. I., Landi, G., Cattivelli, R., Grandi, S., & Tossani, E. (2023) · Journal of Clinical Psychology · doi:10.1002/jclp.23536 · Cited by 20
Fang, S., Huang, M., & Ding, D. (2024) · Current Psychology · doi:10.1007/s12144-023-05255-z · Cited by 12
“These results were consistent with previous studies (Landi et al., 2021; Lin et al., 2020; Thomas et al., 2021) and indicated that the scale had good content validity and convergent validity.”
Metadata
- Authors
- Thomas, K. N., Bardeen, J. R., Witte, T. K., Rogers, T. A., Benfer, N., & Clauss, K.
- Affiliations
- Auburn University (US)
- Corresponding author
- Bardeen, Joseph R.
- Venue
- Assessment
- Publisher
- SAGE Publications
- Published
- 2021-07-07
- Volume
- 29
- Issue
- 8
- Pages
- 1714-1729
- ISSN
- 1073-1911 (ISSN-L)
- 1552-3489
- OpenAlex
- W3182303804
- Cited by
- 24
- References
- 65
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 5 · 2023: 7 · 2022: 1
- FWCI
- 2.21
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Assessment (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- factor structure, psychological flexibility, psychological inflexibility, acceptance and commitment therapy, bifactor model, higher-order factor model, health anxiety, depression
- MeSH terms
- Adult, Anxiety, Factor Analysis, Statistical, Humans, Psychometrics, Reproducibility of Results, Self Report, Acceptance and Commitment Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.