Rating versus ranking: What is the best way to reduce response and language bias in cross-national research?
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations across Nations
Bhagat, R. S., & Hofstede, G. (2002) · The Academy of Management Review · doi:10.2307/4134391 · Cited by 21,664
Culture's Consequences: International Differences in Work-Related Values.
Sorge, A., & Hofstede, G. (1983) · Administrative Science Quarterly · doi:10.2307/2393017 · Cited by 15,062
(1973) · DigitalGeorgetown (Georgetown University Library) · Cited by 10,144
Culture, leadership, and organizations: the GLOBE study of 62 societies
(2005) · Choice Reviews Online · doi:10.5860/choice.42-4132 · Cited by 5,058
Pundt, A. (2006) · Zeitschrift für Arbeits- und Organisationspsychologie A&O · doi:10.1026/0932-4089.50.3.167 · Cited by 3,745
A Theory of Cultural Values and Some Implications for Work
Schwartz, S. H. (1999) · Applied Psychology · doi:10.1111/j.1464-0597.1999.tb00047.x · Cited by 3,102 · cited 1×
“However, the cultural values that this study taps into have been argued to change only very slowly (see, e.g. Hofstede, 1980, 2001; Schwartz, 1999) and hence we consider it very unlikely that this short passage of time would compromise our comparisons.”
BackgroundCULTURES CONSEQUENCES: INTERNATIONAL DIFFERENCES IN WORK RELATED VALUES
Hofestede, G. (1980) · Cited by 1,983
Clustering countries on attitudinal dimensions: A review and synthesis
Ronen, S., & Shenkar, O. (1985) · The Academy of Management Review · doi:10.5465/amr.1985.4278955 · Cited by 1,552
Response Styles in Marketing Research: A Cross-National Investigation
Baumgartner, H., & Steenkamp, J.-B. E. M. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.2.143.18840 · Cited by 1,255
Cross-National, Cross-Cultural Organizational Behavior Research: Advances, Gaps, and Recommendations
Tsui, A. S., Nifadkar, S. S., & Ou, A. Y. (2007) · Journal of Management · doi:10.1177/0149206307300818 · Cited by 980
Chen, C., Lee, S.-Y., & Stevenson, H. W. (1995) · Psychological Science · doi:10.1111/j.1467-9280.1995.tb00327.x · Cited by 873
Response Styles in Cross-national Survey Research: A 26-country Study
Harzing, A.-W. (2006) · International Journal of Cross Cultural Management · doi:10.1177/1470595806066332 · Cited by 738 · cited 23×
“Important differences between countries are obscured through a reduced variance in responses between countries, caused either by cultural accommodation or by a lack of the respondent’s confidence in responding in a non-native language (see, e.g. Harzing et al., 2005; Harzing, 2006).”
BackgroundResultInfluentialSelf-citationEffects of Culture and Response Format on Extreme Response Style
Hui, C. H., & Triandis, H. C. (1989) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022189203004 · Cited by 644 · cited 4×
“Our results showed that even though changing from a 5-point Likert scale to a 7-point Likert scale reduced MRS and ERS – confirming the earlier studies by Hui and Triandis (1989) and Clarke (2001) with regard to ERS for a much larger and varied group of countries – it did not fully eliminate the problem of differences…”
BackgroundMethodResultInfluentialToward a Geography of Personality Traits: Patterns of Profiles across 36 Cultures
Allik, J., & McCrae, R. R. (2004) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022103260382 · Cited by 635 · cited 1×
“However, this does mean that any cross-country differences might be attenuated, so that in fact our study provides a more stringent test of these differences (Allik & McCrae, 2004).”
ResultAcquiescent Response Bias as an Aspect of Cultural Communication Style
Smith, P. B. (2004) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022103260380 · Cited by 516 · cited 5×
“A large number of studies have confirmed that there are substantial and systematic differences in response styles between countries (for recent reviews see Baumgartner & Steenkamp, 2001; Harzing, 2006; Smith, 2004).”
BackgroundInfluentialMeasurement Issues in Cross-National Research
Singh, J. (1995) · Journal of International Business Studies · doi:10.1057/palgrave.jibs.8490188 · Cited by 515
Methodological Issues in Psychological Research on Culture
van de Vijver, F. J. R., & Leung, K. (2000) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022100031001004 · Cited by 410 · cited 1×
“However, crossnational survey research is plagued by many problems (for an overview see for instance Singh, 1995; Usunier, 1998; Van de Vijver & Leung, 2000; Tsui, Nifadkar, & Ou, 2007).”
BackgroundValidity problems comparing values across cultures and possible solutions.
Peng, K., Nisbett, R. E., & Wong, N. Y. C. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.4.329 · Cited by 408
On the Empirical Identification of Dimensions for Cross-Cultural Comparisons
Leung, K., & Bond, M. H. (1989) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022189202002 · Cited by 403 · cited 2×
“Of course researchers can always try to remove response bias after the fact by using standardisation (Leung & Bond, 1989; Smith, 2004).”
BackgroundFischer, R. (2004) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022104264122 · Cited by 394 · cited 3×
“This procedure has become increasingly popular in cross-cultural studies (Fischer, 2004).”
BackgroundInfluentialThe Measurement of Values in Surveys: A Comparison of Ratings and Rankings
Alwin, D. F., & Krosnick, J. A. (1985) · Public Opinion Quarterly · doi:10.1086/268949 · Cited by 373 · cited 1×
“As a result ranking might lead to higher data quality (Alwin & Krosnick, 1985).”
BackgroundExtreme Response Style and Acquiescence among Hispanics: The Role of Acculturation and Education
Marin, G., Gamba, R. J., & Marin, B. V. (1992) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022192234006 · Cited by 370
Latham, G. P., Saari, L. M., Pursell, E. D., & Campion, M. A. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.4.422 · Cited by 365
Lenartowicz, T., & Roth, K. (2001) · Journal of International Business Studies · doi:10.1057/palgrave.jibs.8490954 · Cited by 288 · cited 2×
“This technique has been used in some studies comparing cultural values across countries (e.g. Lenartowicz & Roth, 2001) and studies using Rokeach value statements.”
BackgroundMethodA culture general assimilator: Preparation for various types of sojourns
Brislin, R. W. (1986) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(86)90007-6 · Cited by 250 · cited 1×
“Another context in which the ranking approach may be more useful than the traditional Likert-scale approach is that of cultural assimilator training (e.g., Brislin, 1989; Cushner, 1989).”
BackgroundInternational and Cross-cultural Management Research
Usunier, J.-C. (1999) · International Marketing Review · doi:10.1108/02651339910371000 · Cited by 211
Developing Practical Procedures for the Measurement of Personal Values in Cross-Cultural Marketing
Munson, J. M., & McIntyre, S. H. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600107 · Cited by 191 · cited 1×
“Hence a very fruitful avenue for further research could be to apply a technique developed in the Marketing literature (Munson & McIntyre, 1979; McCarty & Shrum, 1997, 2000): the most-least rating procedure.”
MethodHarzing, A.-W. (2005) · International Journal of Cross Cultural Management · doi:10.1177/1470595805054494 · Cited by 175
Self-citationThe Measurement of Personal Values in Survey Research
McCarty, J. A., & Shrum, L. J. (2000) · Public Opinion Quarterly · doi:10.1086/317989 · Cited by 170
Bond, M. H., & Yang, K.-S. (1982) · Journal of Cross-Cultural Psychology · doi:10.1177/0022002182013002003 · Cited by 163
Ralston, D. A., Cunniff, M. K., & Gustafson, D. J. (1995) · Journal of Cross-Cultural Psychology · doi:10.1177/002202219502600612 · Cited by 129
Extreme response style in cross‐cultural research
Clarke, I. (2001) · International Marketing Review · doi:10.1108/02651330110396488 · Cited by 114
Takahashi, K., Ohara, N., Antonucci, T. C., & Akiyama, H. (2002) · International Journal of Behavioral Development · doi:10.1080/01650250143000418 · Cited by 113
Assessing the impact of a culture-general assimilator
Cushner, K. (1989) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(89)90002-3 · Cited by 98 · cited 2×
“Another context in which the ranking approach may be more useful than the traditional likertscale approach is that of cultural assimilator training (e.g., Brislin; 1986; Cushner, 1989).”
BackgroundMeasuring the Importance of Positive Constructs: A Test of Alternative Rating Procedures
McCarty, J. A., & Shrum, L. J. (1997) · Marketing Letters · doi:10.1023/a:1007918705434 · Cited by 30 · cited 2×
“Research has shown that this technique reduces acquiescence (called end-piling in these studies) and increases differentiation between items (McCarty & Shrum, 1997, 2000), hence enabling the use of popular statistical analysis techniques such as factor analysis and regression, whilst not increasing…”
MethodVoss, K. E., Stem, D. E., Johnson, L. W., & Arce, C. (1996) · International Marketing Review · doi:10.1108/02651339610131388 · Cited by 26
Cited by
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2023) · arXiv · doi:10.48550/arxiv.2305.03514 · Cited by 839
Can Large Language Models Transform Computational Social Science?
Ziems, C., Held, W., Shaikh, O., Chen, J., Zhang, Z., & Yang, D. (2024) · Computational Linguistics · doi:10.1162/coli_a_00502 · Cited by 585
Metadata
- Authors
- Harzing, A.-W., Baldueza, J., Barner-Rasmussen, W., Barzantny, C., Canabal, A., Davila, A., Espejo, A., Ferreira, R., Giroud, A., Koester, K., Liang, Y.-K., Mockaitis, A., Morley, M. J., Myloni, B., Odusanya, J. O. T., O'Sullivan, S. L., Palaniappan, A. K., Prochno, P., Choudhury, S. R., Saka-Helmhout, A., Siengthai, S., Viswat, L., Soydas, A. U., & Zander, L.
- Venue
- International Business Review
- Publisher
- Elsevier BV
- Published
- 2009-08
- Volume
- 18
- Issue
- 4
- Pages
- 417-432
- ISSN
- 0969-5931 (ISSN-L)
- OpenAlex
- W2070736469
- Cited by
- 160
- References
- 36
- FWCI
- 9.47
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.