New English and Spanish social health measures will facilitate evaluating health determinants

Borderline on S4 (based): unclear from the text.

There was no evidence of DIF by language.

“There was no evidence of DIF by language.”

May combine two claims.

The validation sample comprised 2,208 English-speaking and 644 Spanish-speaking participants and was diverse in gender, age, education, and ethnicity/race.

“Validation testing participants (n=2,208 English; n=644 Spanish) were diverse in terms of gender, age, education and ethnicity/race.”

• AssumptionRests on an assumption: The convenience samples of English- and Spanish-speaking respondents are adequate for establishing measures applicable across chronic illnesses.

May combine two claims.

After removing those items, EFA identified one factor and CFA had good model fit and no local dependence for Companionship.

“EFA and CFA were then repeated with the reduced item set. EFA identified one factor; CFA had good model fit and no local dependence (see Table 2).”

May combine two claims.

All Spanish Ability and Satisfaction items fit the IRT models with slopes greater than 2.0 for all but one item and a small mean SEM.

“All Ability and Satisfaction items fit the IRT models with slopes greater than 2.0 for all but one item and a small mean SEM.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The item banks can be administered as a CAT, or users can select a fixed-item short form of 4, 6, or 8 items if internet administration is not feasible.

“The item banks can be administered as a CAT, or users can select a fixed-item short form (4, 6, or 8 items) if internet administration is not feasible.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For each domain or sub-domain, all response categories were used, so no category collapsing was needed.

“For each domain or sub-domain, all of the response categories were used; thus, no category collapsing was needed.”

May combine two claims.

All Ability and Satisfaction items fit the IRT models, with slopes greater than 2.0 for all but one item and a small mean SEM.

“All Ability and Satisfaction items fit the IRT models, with slopes greater than 2.0 for all but one item and a small mean SEM (see Table 2).”

May combine two claims.

The Social Health Workgroup efforts resulted in 136 items measuring seven aspects of social health, each producing a unidimensional item bank that enables users to select subsets of items or CATs.

“The Social Health Workgroup efforts were reported here, resulting in 136 items measuring seven aspects of social health, each producing a unidimensional item bank that enables users to select subsets of items or CATs from each bank to create efficient measures.”

May combine two claims.

All Companionship, Emotional Support, Informational Support, Instrumental Support, and Social Isolation items fit the IRT models, with slopes greater than 2.0 for most items.

“All Companionship, Emotional Support, Informational Support, Instrumental Support and Social Isolation items fit the IRT models, with slopes greater than 2.0 for most items.”

May combine two claims.

Two items had category inversions in Spanish Satisfaction; the average measure was lower for the highest category (Muchísimo) than for the adjacent category (Mucho).

“Two items had category inversions in Satisfaction; specifically, the average measure was lower for respondents selecting the highest category (Muchísimo) compared to the average measure for the adjacent category (Mucho).”

May combine two claims.

For Emotional Support, Informational Support, Instrumental Support, and Social Isolation, EFA identified one factor, and each CFA had good model fit and no local dependence.

“For Emotional Support, Informational Support, Instrumental Support and Social Isolation, one factor was identified by EFA. Each CFA had good model fit and no local dependence.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Patient feedback and expert review led to deleting and modifying some items and to dropping the use of a timeframe for the items.

“Patient feedback, along with expert review by the Social Health Workgroup, resulted in the deletion of a few items, modification of a few items, and the decision to drop the use of a timeframe (“past seven days” or “lately”) for the items.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Spanish translations were modified for a small number of items based on cognitive interviews with native Spanish speakers.

“Spanish translations were modified for a small number of items as a result of the cognitive interviews with native Spanish speakers.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The formality level of the Spanish word for "close" was lowered by adding an alternative word while keeping the item universally understandable.

“The register (formality) of the word used for “close” (“I feel that I am no longer close to anyone”), had to be lowered by adding an alternative word, while still maintaining a universal understanding of the item.”

May combine two claims.

For Satisfaction and Social Isolation, five and two items respectively exhibited some DIF by administration method only.

“For Satisfaction and Social Isolation, five and two items, respectively, exhibited some DIF by administration method only (data not shown).”

Probably not a substantial claim: may not pass S3 (load-bearing).

The Spanish translation of "leisure activities" was changed from "actividades de ocio" to "actividades de tiempo livre" because several participants did not understand "ocio."

“The translation of “leisure activities” was revised from “actividades de ocio” to “actividades de tiempo livre” since several participants did not understand the word “ocio.””

The quote only partly states this claim.

The proportion of respondents with an SEM ≤ 3.0 ranged from 59.0% to 84.3% for the Social Relationships domains.

“The proportion of respondents with an SEM ≤ 3.0 ranged from 59.0% to 84.3%.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Participants in the item testing studies were fairly diverse in gender, age, and education.

“Participants in the item testing studies were fairly diverse in terms of gender, age and education (Table 1).”

May combine two claims.

For each Spanish Social Function domain, there were no missing data and all response categories were used, so no category collapsing was needed.

“For each Social Function domain, there were no missing data and all of the response categories were used; thus, no category collapsing was needed.”

May combine two claims.

The initial EFA for Social Support included 54 items and identified five factors with eigenvalues greater than 1.0.

“The initial EFA for Social Support included a total of 54 items (not shown). EFA identified five factors with eigenvalues greater than 1.0.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Missing data ranged from zero to 5% across items.

“Missing data ranged from zero to 5% across items.”

May combine two claims.

Only cross-sectional testing has been performed to date, so there are no data on change or responsiveness.

“Only cross-sectional testing has been performed to date, so there are no data on change or responsiveness.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The Spanish word for "holidays" ("festividades") was ambiguous and was revised to "dias festivos."

“The Spanish word used for “holidays” (“Do you have someone with whom you can celebrate holidays?”), “festividades”, proved to be ambiguous, so it was revised to “dias festivos.””

May combine two claims.

Focus groups indicated that a negative aspect of Social Relationships (Social Isolation) should be included and supported including different types of Social Support.

“The focus groups highlighted the need to include a negative aspect of Social Relationships (Social Isolation) while corroborating the need to include different kinds of Social Support (e.g., instrumental and emotional).”

May combine two claims.

The Spanish CFA for Satisfaction had acceptable model fit, and one item pair exhibited local dependence.

“The CFA for Satisfaction had acceptable model fit; one item pair exhibited local dependence.”

May combine two claims.

Cognitive interview responses supported a framework in which Social Function consists of Ability to Participate and Satisfaction with Social Roles and Activities domains, each covering family, friends, work, and leisure.

“Cognitive interview responses supported a framework in which Social Function is comprised of Ability to Participate in Social Roles and Activities and Satisfaction with Social Roles and Activities domains, with both including the contexts of family, friends, work and leisure.”

May combine two claims.

Several items were considered too long and confusing, and some participants read items more than once to understand them.

“Several items were considered too long and confusing, and a few participants reported having to read some items more than once to understand them.”

May combine two claims.

After removing nine cross-loading items, EFA identified four factors (Companionship, Emotional Support, Informational Support, Instrumental Support), and all items loaded on their hypothesized factors with loadings from 0.53 to 0.91.

“After removing nine items that cross-loaded on multiple factors, the EFA was repeated. Four factors were identified (Companionship, Emotional Support, Informational Support, Instrumental Support) and all items loaded on their hypothesized factors (item loadings, 0.53 to 0.91; see supplemental Table B).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Items for Social Relationships have been translated into Spanish but not yet tested or evaluated for criterion and construct validity.

“Items for Social Relationships have been translated into Spanish but not yet tested or evaluated for criterion and construct validity.”

May combine two claims.

Each CFA for the two Social Function domains had good model fit and no local dependence, with all residual correlations below 0.20.

“Each CFA had good model fit and no local dependence (all residual correlations <0.20).”

May combine two claims.

Respondents without comorbidities had higher Ability and Satisfaction scores than those with comorbidities, with English effect sizes 0.94 and 0.85 and Spanish effect sizes 0.79 and 0.50.

“As hypothesized, respondents without comorbidities had higher Ability and Satisfaction scores compared to those with comorbidities (English effect sizes, 0.94 and 0.85, respectively; Spanish effect sizes, 0.79 and 0.50, respectively; Table 4).”

May combine two claims.

The CFA for Companionship had good model fit (CFI 0.99) and no local dependence.

“The CFA for Companionship had good model fit (CFI, 0.99) and no local dependence.”

May combine two claims.

When asked about missing relevant questions, no participants mentioned missing Social Health content; they mentioned content in other PROMIS domains or outside PROMIS.

“When asked what relevant questions were not included, none of the participants mentioned any missing content in Social Health. Instead, they mentioned content covered in other PROMIS domains (e.g., Emotional Health) or currently outside of the PROMIS framework (e.g., patient-provider communication).”

May combine two claims.

Newly developed English Social Relationships versions showed good model fit and discrimination parameters, and good precision for estimating respondent measures.

“Likewise, the newly developed English language versions for Social Relationships showed good model fit and discrimination parameters, and good precision for estimating respondent measures.”

May combine two claims.

Social Support scores for the online panel were lower than the clinical samples, with effect sizes from −0.31 to −0.47.

“Interestingly, Social Support scores for the online panel were lower than the clinical samples (effect sizes, −0.31 to −0.47).”

May combine two claims.

No items were considered irrelevant or offensive, and no participants suggested adding new items.

“No items were considered irrelevant or offensive and none of the participants suggested the need to add new items.”

May combine two claims.

The English language samples were mainly non-Hispanic Whites, while the Spanish language sample was Hispanic/Latino by design.

“The English language samples were primarily non-Hispanic Whites; by design, the Spanish language sample was Hispanic/Latino.”

May combine two claims.

The Spanish CFA for Ability had good model fit and no local dependence.

“The CFA for Ability had good model fit and no local dependence (see Table 2).”

May combine two claims.

PROMIS first created two v1.0 Social Function item sets-Ability to Participate and Satisfaction with Participation-and evaluated them with English-speaking general population respondents.

“PROMIS initially developed two sets of Social Function items (Ability to Participate and Satisfaction with Participation, v1.0) and tested them in a general population English-speaking sample (Hahn et al., 2010).”

• cites Hahn et al., 2010Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

The WHO three-component health framework is congruent with the biopsychosocial approach used by many health psychologists.

“This is congruent with the biopsychosocial approach adopted by many health psychologists (Engel, 1977, 1980).”

• cites Engel, 1977, 1980Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S2 (checkable).

Social health measures will be important in applications using ecologic or determinants-of-health models that emphasize how patients' social environments affect health.

“Measures of social health will play a key role in applications that use ecologic (or determinants of health) models that emphasize how patients’ social environments influence their health”

• cites Institute of Medicine, 2003Not checked yet

  Not checked in the free run.

• cites Institute of Medicine. Committee on Public Health Strategies to Improve Health, 2011Not checked yet

  Not checked in the free run.

• cites Whitehead, 1995Not checked yet

  Not checked in the free run.

• AssumptionRests on an assumption: The PROMIS Social Health conceptual model is comprehensive enough to guide development of measures applicable across chronic illnesses.

Probably not a substantial claim: may not pass S3 (load-bearing).

The PROMIS Social Health domain framework v2.0 has two primary sub-components: Social Function and Social Relationships.

“The PROMIS domain framework for Social Health (v2.0) includes two primary sub-components: Social Function and Social Relationships (McDowell, 2006)”

• cites McDowell, 2006Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The ICF uses "participation" to describe social health and functioning and merges activities and participation into a single taxonomy with multiple domains.

“The World Health Organization’s International Classification of Functioning, Disability and Health (ICF) uses the term “participation” to describe social health and functioning, and merges activities and participation into a single taxonomy with multiple domains, including learning, communication, mobility, self-care, interpersonal relationships and social life (World Health Organization, 2001).”

• cites World Health Organization, 2001Not checked yet

  Not checked in the free run.

May combine two claims.

Seven English and Spanish language item banks (v2.0) achieve broad representation of Social Health and are available for public use.

“Nonetheless, we believe that the fruits of the PROMIS efforts are significant, namely, seven English and Spanish language item banks (v2.0) that achieve broad representation of Social Health and are available for public use (www.assessmentcenter.net), specifically: Social Function (Ability to Participate in Social Roles and Activities, and Satisfaction with Social Roles and Activities) and Social”

May combine two claims.

Calibrated IRT item banks support CAT and several short forms of different lengths, giving accurate measurement while reducing respondent burden.

“These calibrated item banks are comprised of numerous items that allow for computerized adaptive testing (CAT) and development of multiple short forms of varying length that provide accurate measurement with low response burden (Cella, Gershon, Lai, & Choi, 2007).”

• cites Cella, Gershon, Lai, & Choi, 2007Not checked yet

  Not checked in the free run.

May combine two claims.

Both English and Spanish versions revealed highly acceptable psychometric properties providing evidence of reliability and validity.

“Both the English and Spanish versions revealed highly acceptable psychometric properties providing evidence of reliability and validity.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

CAT will provide the most precise estimate; short forms use the same IRT calibrations as CAT but are slightly less precise because they are not targeted to an individual respondent.

“CAT will provide the most precise estimate (score); short forms are based on the same IRT calibrations as a CAT, but will be slightly less precise because they are not targeted to an individual respondent.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A standard error of measurement at or below 3.0 is widely viewed as indicating good precision, roughly matching reliability 0.9, and is commonly a CAT stopping criterion.

“An SEM of 3.0 or less is generally considered a good indicator of precision because it is roughly equivalent to a reliability of 0.9 and is often used as a cut point for stopping rules in CAT (Babcock & Weiss, 2012).”

• cites Babcock & Weiss, 2012Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Social Health includes item content with universal applicability along with comprehensive coverage of social relationships and function.

“Social Health includes item content with universal applicability along with comprehensive coverage of social relationships and function.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Instruments are diverse in their theoretical approach, format, psychometric properties, and targeted use.

“Instruments are also diverse in their theoretical approach, format, psychometric properties and targeted use (Anatchkova & Bjorner, 2010).”

• cites Anatchkova & Bjorner, 2010Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Three raters independently examined every interview response.

“All interview responses were independently reviewed by three raters.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The Spanish translation used a multi-step forward-backward process.

“The items were translated into Spanish with a multi-step forward-backward process (Eremenco, Cella, & Arnold, 2005; Wild et al., 2005).”

• cites Eremenco, Cella, & Arnold, 2005Not checked yet

  Not checked in the free run.

• cites Wild et al., 2005Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

The psychometric analysis methods implemented by PROMIS are working, practical tools, and so might be limited in representing the multidimensional space of social health optimally.

“The psychometric analysis methods implemented by PROMIS are working, practical tools, and so might be limited in representing the multidimensional space of social health optimally.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

A key distinction between PROMIS and the role functioning item bank is that the latter includes health attribution in each item, which the investigators acknowledge narrowed the construct definition and made items longer and more cumbersome.

“A key distinction between PROMIS and this role functioning item bank is that the latter includes health attribution in each item, e.g., because of health [I] have to stop work. These investigators acknowledge that this decision narrowed the definition of the construct and also made the items longer and more cumbersome.”

May combine two claims.

The decision to create Spanish versions was driven by the growing number of Hispanics/Latinos in the U.S., most of whom are Spanish-dominant or bilingual, and by the need for translated measures for global research.

“The decision to create Spanish language versions for self-reported Social Health was driven by the growing number of Hispanics/Latinos (50.5 million) in the U.S., the majority (76%) of whom are Spanish-dominant or bilingual (Pew Hispanic Center, 2011), as well as by the need to have translated measures for use in global research.”

• cites Pew Hispanic Center, 2011Not checked yet

  Not checked in the free run.

• AssumptionRests on an assumption: There is a need for translated patient-reported measures for use in global research.

Classified as probably not a substantial claim. May combine two claims.

Accurate Spanish language measures will be useful in helping to unravel whether the Hispanic/Latino epidemiologic paradox is substantiated and whether social support contributes to health outcomes among Hispanics/Latinos.

“In particular, accurate Spanish language measures will be useful in helping to unravel whether the Hispanic/Latino epidemiologic paradox is substantiated, and whether social support contributes to the health outcomes among Hispanics/Latinos that are often found to be comparable to or better than that of other racial/ethnic groups in the U.S despite their low levels of average income and education”

• cites Eschbach, Ostir, Patel, Markides, & Goodwin, 2004Not checked yet

  Not checked in the free run.

• cites Franzini, Ribble, & Keddie, 2001Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

PROMIS's primary aim was to create patient-reported outcome measures that are publicly accessible, efficient, and flexible.

“The main goal of PROMIS was to develop a set of publicly available, efficient and flexible measurements of patient-reported outcomes (Cella et al., 2010).”

• cites Cella et al., 2010Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

During the first PROMIS general population test, all 112 items were answered by 956 people.

“In initial PROMIS testing with a general population sample, 956 respondents answered all 112 items (Hahn, Devellis, et al., 2010).”

• cites Hahn, Devellis, et al., 2010Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Semi-structured cognitive interviews were conducted with 21 English-speaking adults with various cancer diagnoses.

“Semi-structured cognitive interviews were conducted on the revised pool of items with 21 English-speaking adults with a variety of cancer diagnoses (mean age, 56 years; 57% Female; 52% White and 33% African-American).”

Classified as probably not a substantial claim. May combine two claims.

Initial testing of PROMIS Social Function items showed that certain items required refinement and that later testing needed clinical samples to assess the conceptual models and create measures usable across chronic illnesses.

“Results showed that some item refinement was necessary, and that clinical samples should be included in future testing to evaluate our conceptual models and produce measures for use across chronic illnesses.”

• cites Hahn et al., 2010Not checked yet

  Not checked in the free run.

Classified as probably not a substantial claim. May combine two claims.

Psychometric analyses followed PROMIS guidelines and were conducted separately by language.

“Analyses followed the PROMIS guidelines (Reeve et al., 2007), separately by language.”

• cites Reeve et al., 2007Not checked yet

  Not checked in the free run.

May combine two claims.

By using a comprehensive translation methodology and finding no DIF by language, the Spanish language versions are culturally responsive.

“By using a comprehensive translation methodology and in finding no DIF by language, the Spanish language versions are culturally responsive.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Although convenience sampling was used, purposeful enrollment of diverse samples helped to better understand the item bank properties.

“Although convenience sampling was used, purposeful enrollment of diverse samples helped to better understand the item bank properties.”

May combine two claims.

The study expanded previous work by developing Social Relationships item banks in addition to Social Function, translating all items, and testing them in English- and Spanish-speaking clinical populations.

“The study presented in this article significantly expanded our previous work (Hahn, Devellis, et al., 2010) by developing item banks of Social Relationships in addition to Social Function, comprehensively translating all items, and testing them in English- and Spanish-speaking clinical populations.”

• cites Hahn, Devellis, et al., 2010Not checked yet

  Not checked in the free run.

May combine two claims.

A recent review identified eight contemporary participation measures linked to the ICF, but these instruments are not equivalent because items represent different aspects of a dimension even when linked to a single ICF code.

“A recent review identified eight contemporary participation measures with linkages to the ICF, yet these instruments are not equivalent because, even when linked to a single ICF code, items represent different aspects of a dimension (Magasi & Post, 2010).”

• cites Magasi & Post, 2010Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S3 (load-bearing).

Social Relationships items could not be added to the Spanish testing because of respondent burden.

“Due to respondent burden, it was not possible to add the Social Relationships items.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Other researchers applied the PROMIS IRT-based item banking approach to develop a generic role functioning item bank in English.

“Other researchers applied the PROMIS IRT-based item banking approach to develop a generic role functioning item bank in English (Anatchkova, Ware, & Bjorner, 2011).”

• cites Anatchkova, Ware, & Bjorner, 2011Not checked yet

  Not checked in the free run.

May combine two claims.

Among minority groups, Latinos/Hispanics are growing fastest and are often underserved in health care and left out of research.

“who constitute the fastest growing group among minority populations that are often underserved in health care settings and excluded from research studies (Garber & Arnold, 2006; Yancey, Ortega, & Kumanyika, 2006).”

• cites Garber & Arnold, 2006Not checked yet

  Not checked in the free run.

• cites Yancey, Ortega, & Kumanyika, 2006Not checked yet

  Not checked in the free run.

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

The use of common indicators of Social Health will facilitate measurement consistency and comparison across studies and populations, and should enhance understanding of how these variables relate to other aspects of health.

“The use of common indicators of Social Health will facilitate measurement consistency and comparison across studies and populations, and should enhance understanding of how these variables relate to other aspects of health.”

Classified as probably not a substantial claim.

The availability of these item banks represents a substantial resource for investigators and clinicians who wish to accurately assess social function and social relationships using CATs and short form measures.

“Collectively, the availability of these item banks represents a substantial resource that is now available to investigators and clinicians who wish to accurately assess social function and social relationships using CATs and short form measures.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

These item banks have undergone extensive and rigorous qualitative and psychometric assessment, and demonstrate strong properties.

“These item banks have undergone extensive and rigorous qualitative and psychometric assessment, and demonstrate strong properties.”