Estimating Nonresponse Bias in Mail Surveys
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Valid predictions for the direction of nonresponse bias were obtained from subjective estimates and extrapolations in an analysis of mail survey data from published studies. For estimates of the magnitude of bias, the use of extrapolations led to substantial improvements over a strategy of not using extrapolations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The t -test results did not find significant differences between the two respondent groups, suggesting an absence of non-response bias (Armstrong and Overton, 1977).”
From Understanding managers’ attitudes and behavioral intentions towards using artificial intelligence for organizational decision-making (2021) · cites this paper as Armstrong and Overton, 1977
In the citing paper
“Prior to data analysis, non-response bias was assessed through wave analysis, comparing the responses of the early respondent wave (first quartile) to those of the late respondent wave (fourth quartile) using two tailed tstatistics (Armstrong and Overton, 1977; Rogelberg and Stanton, 2007).”
From Examining the antecedents of the technology acceptance model within e-procurement (2018) · cites this paper as Armstrong and Overton, 1977
In the citing paper
“Non-response bias was estimated using the method suggested by Armstrong and Overton (1977). We compared early respondents with late respondents for all the constructs, including the control variables. None of the t-statistics for difference in means were statistically significant, suggesting that non-response bias was not an issue.”
From Trust, Satisfaction, and Online Repurchase Intention: The Moderating Role of Perceived Effectiveness of E-Commerce Institutional Mechanisms1 (2014) · cites this paper as Armstrong and Overton (1977)
In the citing paper
“We examined for the potential for non-response bias by comparing the data collected in two waves, following Armstrong and Overton's (1977) guidelines.”
From Big data analytics and artificial intelligence pathway to operational performance under the effects of entrepreneurial orientation and environmental dynamism: A study of manufacturing organisations (2020) · cites this paper as Armstrong and Overton's (1977)
Citations
Cites
Mail Surveys and Response Rates: A Literature Review
Kanuk, L., & Berenson, C. (1975) · Journal of Marketing Research · doi:10.2307/3151093 · Cited by 855
The Problem of Non-Response in Sample Surveys
Hansen, M. H., & Hurwitz, W. N. (1946) · Journal of the American Statistical Association · doi:10.1080/01621459.1946.10501894 · Cited by 599
A Critical Comparison of Three Strategies of Collecting Data from Households
Hochstim, J. R. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10500909 · Cited by 418
Stimulating Responses to Mailed Questionnaires: A Review
Linsky, A. S. (1975) · Public Opinion Quarterly · doi:10.1086/268201 · Cited by 398 · cited 1×
“Nonresponse can be kept under 30% in most situations if appropriate procedures are followed [25, 32, 44].”
BackgroundScott, C. (1961) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2984129 · Cited by 258 · cited 4×
“Nonresponse can be kept under 30% in most situations if appropriate procedures are followed [25, 32, 44].”
BackgroundInfluentialMail Surveys and Response Rates: A Literature Review
Kanuk, L., & Berenson, C. (1975) · Journal of Marketing Research · doi:10.1177/002224377501200408 · Cited by 248 · cited 1×
“Nonresponse can be kept under 30% in most situations if appropriate procedures are followed [25, 32, 44].”
BackgroundRosenthal, R. (1965) · Human Relations · doi:10.1177/001872676501800407 · Cited by 200 · cited 2×
“Rosenthal, Robert, “The volunteer subject,” Human Relations, 18 (1965), 389-406.”
BackgroundAgricultural Economics Research
Bolton, B. (1964) · Cited by 199
Social psychology : an experimental approach
Zajonc, R. B. (1966) · Cited by 156
Methodological Bias in Public Opinion Surveys
Wiseman, F. (1972) · Public Opinion Quarterly · doi:10.1086/267981 · Cited by 154 · cited 1×
“However, as the known values come from a different source instrument, differences may occur as a result of response bias [17, 50] rather than nonresponse bias.”
Background
Research works printed but not linked: 9
- 10.1086/265785 · doi:10.1086/265785
- Finkner A. L., 1950, North Carolina Agricultural Experiment Station Technical Bulletin, 91, 374
- Hyman Herbert, 1972, A Secondary Analysis of Sample Surveys.
- Kish Leslie, 1965, Survey Sampling.
- Kivlin Joseph E., 1965, Rural Sociology, 30, 332
- Lehman Edward C., 1963, Rural Sociology, 28, 284
- NewmanSheldon W. “Differences Between Early and Late Respondents to a Mailed Survey,” Journal of Advertising Research, 2 (June 1962), 37–9. · doi:10.1080/00218499.1962.12519677
- Reid Seerley, 1942, Educational Research Bulletin, 21, 87
- Stephan Frederick F., 1958, Sampling Opinions.
Cited by
Chaudhuri, A., & Holbrook, M. B. (2001) · Journal of Marketing · doi:10.1509/jmkg.65.2.81.18255 · Cited by 6,674
“Finally, the sample was split into early and late respondents (Armstrong and Overton 1977).”
BackgroundComputer Self-Efficacy: Development of a Measure and Initial Test
Compeau, D. R., & Higgins, C. A. (1995) · MIS Quarterly · doi:10.2307/249688 · Cited by 6,553
(2003) · International Journal of Electronic Commerce · doi:10.1080/10864415.2003.11044275 · Cited by 5,715
“html), and the early (65%) and late respondents (35%) [5].”
BackgroundIndex Construction with Formative Indicators: An Alternative to Scale Development
Diamantopoulos, A., & Winklhofer, H. M. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.2.269.18845 · Cited by 3,748
Consumer trust, value, and loyalty in relational exchanges
Sirdeshmukh, D., Singh, J., & Sabol, B. (2002) · Journal of Marketing · doi:10.1509/jmkg.66.1.15.18449 · Cited by 4,196
Do formal contracts and relational governance function as substitutes or complements?
Poppo, L., & Zenger, T. (2002) · Strategic Management Journal · doi:10.1002/smj.249 · Cited by 3,652
“We also used a procedure suggested by Armstrong and Overton (1977) to further test for a nonresponse bias.”
MethodMohr, J., & Spekman, R. (1994) · Strategic Management Journal · doi:10.1002/smj.4250150205 · Cited by 3,475
Diamantopoulos, A., & Siguaw, J. A. (2006) · British Journal of Management · doi:10.1111/j.1467-8551.2006.00500.x · Cited by 3,410
“To further investigate potential non-response bias, a comparison of early and late respondents was undertaken (Armstrong and Overton, 1977).”
The impact of supply chain integration on performance: A contingency and configuration approach
Flynn, B. B., Huo, B., & Zhao, X. (2010) · Journal of Operations Management · doi:10.1016/j.jom.2009.06.001 · Cited by 3,310
“To assess potential late response bias, we compared early and late responses on their physical assets, annual sales and number of employees (Armstrong and Overton, 1977), with a t-test showing no significant differences.”
MethodInnovation, organizational capabilities, and the born-global firm
Knight, G. A., & Cavusgil, S. T. (2004) · Journal of International Business Studies · doi:10.1057/palgrave.jibs.8400071 · Cited by 3,013
“earliest responding to those of a sample of the latest responding firms (Armstrong and Overton, 1977).”
BackgroundResultIndustry 4.0 technologies: Implementation patterns in manufacturing companies
Frank, A. G., Dalenogare, L. S., & Ayala, N. F. (2019) · International Journal of Production Economics · doi:10.1016/j.ijpe.2019.01.004 · Cited by 2,958
Pavlou, P. A., & Fygenson, M. (2006) · MIS Quarterly · doi:10.2307/25148720 · Cited by 2,685
“1/March 2006 129 late respondents were not significantly different (Armstrong and Overton 1977).”
BackgroundPavlou, P. A., Liang, H., & Xue, Y. (2007) · MIS Quarterly · doi:10.2307/25148783 · Cited by 2,646
“Nonresponse bias was assessed by verifying that (1) the respondents’ demographics are similar to those of typical Internet consumers as reported by online commercial sites,(9) and (2) by verifying that early and late respondents were not significantly different (Armstrong and Overton 1976).”
Strategic Orientation of the Firm and New Product Performance
Gatignon, H., & Xuereb, J.-M. (1997) · Journal of Marketing Research · doi:10.1177/002224379703400107 · Cited by 2,264
Building Effective Online Marketplaces with Institution-Based Trust
Pavlou, P. A., & Gefen, D. (2004) · Information Systems Research · doi:10.1287/isre.1040.0015 · Cited by 2,516
“html), and (2) between the early and late respondents (Armstrong and Overton 1976).”
Towards a theory of supply chain management: the constructs and measurements
Chen, I. J., & Paulraj, A. (2004) · Journal of Operations Management · doi:10.1016/j.jom.2003.12.007 · Cited by 2,419
“As a convention , the responses of early and late waves of returned surveys were compared to provide support of non-response bias (Krause et al., 2001; Narasimhan and Das, 2001; Stanley and Wisner, 2001; Lambert and Harrington, 1990; Armstrong and Overton, 1977).”
ResultSingh, S. K., Giudice, M. D., Chierici, R., & Graziano, D. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2019.119762 · Cited by 2,100
“Therefore, the dataset of this study was free from non-response biases and we can generalize the results of this study to the larger population (Becker and Ismail, 2016; Cochran, 1977; Armstrong and Overton, 1977).”
ResultEllis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Park, C. W., Macinnis, D. J., Priester, J., Eisingerich, A. B., & Iacobucci, D. (2010) · Journal of Marketing · doi:10.1509/jmkg.74.6.1 · Cited by 2,290
Do Norms Matter in Marketing Relationships?
Heide, J. B., & John, G. (1992) · Journal of Marketing · doi:10.1177/002224299205600203 · Cited by 2,411
Li, S., Ragu-Nathan, B., Ragu-Nathan, T. S., & Subba Rao, S. (2006) · Omega · doi:10.1016/j.omega.2004.08.002 · Cited by 2,136
“Hence, a comparison was made between those subjects who responded after the initial mailing and those who responded to the second/third wave[103,104].”
BackgroundAlliances in Industrial Purchasing: The Determinants of Joint Action in Buyer-Supplier Relationships
Heide, J. B., & John, G. (1990) · Journal of Marketing Research · doi:10.1177/002224379002700103 · Cited by 2,110
An empirical assessment of the SERVQUAL scale
Babakus, E., & Boller, G. W. (1992) · Journal of Business Research · doi:10.1016/0148-2963(92)90022-4 · Cited by 2,122
Innovativeness: Its antecedents and impact on business performance
Hult, G. T. M., Hurley, R. F., & Knight, G. A. (2004) · Industrial Marketing Management · doi:10.1016/j.indmarman.2003.08.015 · Cited by 2,053
The Synergistic Effect of Market Orientation and Learning Orientation on Organizational Performance
Baker, W. E., & Sinkula, J. M. (1999) · Journal of the Academy of Marketing Science · doi:10.1177/0092070399274002 · Cited by 1,967
Bulgurcu, B., Cavusoglu, H., & Benbasat, I. (2010) · MIS Quarterly · doi:10.2307/25750690 · Cited by 1,870
The relationship between total quality management practices and their effects on firm performance
Kaynak, H. (2003) · Journal of Operations Management · doi:10.1016/s0272-6963(03)00004-4 · Cited by 1,893
“By testing the difference of the interest variables between early and late respondents, an estimate of non-response bias was calculated ( Armstrong and Overton, 1977).”
BackgroundThe Management of Customer-Contact Service Employees: An Empirical Investigation
Hartline, M. D., & Ferrell, O. C. (1996) · Journal of Marketing · doi:10.1177/002224299606000406 · Cited by 1,920
The Effects of Perceived Interdependence on Dealer Attitudes
Kumar, N., Scheer, L. K., & Steenkamp, J.-B. E. M. (1995) · Journal of Marketing Research · doi:10.1177/002224379503200309 · Cited by 1,843
Diamantopoulos, A., Schlegelmilch, B. B., Sinkovics, R. R., & Bohlen, G. M. (2003) · Journal of Business Research · doi:10.1016/s0148-2963(01)00241-7 · Cited by 1,692
“To further investigate non-response bias, as recommended by Armstrong and Overton (1977), early and late respondents were compared in terms of their responses to the issues inves- tigated in the analysis; no significant differences were found between the two groups, providing no evidence indicating…”
MethodHIGH-INVOLVEMENT WORK PRACTICES, TURNOVER, AND PRODUCTIVITY: EVIDENCE FROM NEW ZEALAND.
Guthrie, J. P. (2001) · Academy of Management Journal · doi:10.2307/3069345 · Cited by 1,737
Benchmarking Marketing Capabilities for Sustainable Competitive Advantage
Vorhies, D. W., & Morgan, N. A. (2005) · Journal of Marketing · doi:10.1509/jmkg.69.1.80.55505 · Cited by 1,624
A Framework for Market-Based Organizational Learning: Linking Values, Knowledge, and Behavior
Sinkula, J. M., Baker, W. E., & Noordewier, T. (1997) · Journal of the Academy of Marketing Science · doi:10.1177/0092070397254003 · Cited by 1,682
An Integrated Model of Information Systems Adoption in Small Businesses
Thong, J. Y. L. (1999) · Journal of Management Information Systems · doi:10.1080/07421222.1999.11518227 · Cited by 1,727
Service loyalty: The effects of service quality and the mediating role of customer satisfaction
Caruana, A. (2002) · European Journal of Marketing · doi:10.1108/03090560210430818 · Cited by 1,528
“To test for non-response bias use was made of the technique suggested by Armstrong and Overton (1977).”
MethodMarket orientation, marketing capabilities, and firm performance
Morgan, N. A., Vorhies, D. W., & Mason, C. H. (2009) · Strategic Management Journal · doi:10.1002/smj.764 · Cited by 1,540
Assessing the Validity of IS Success Models: An Empirical Test and Theoretical Analysis
Rai, A., Lang, S. S., & Welker, R. B. (2002) · Information Systems Research · doi:10.1287/isre.13.1.50.96 · Cited by 1,611
Green consumers in the 1990s: Profile and implications for advertising
Roberts, J. A. (1996) · Journal of Business Research · doi:10.1016/0148-2963(95)00150-6 · Cited by 1,603
Green supply chain management practices: impact on performance
Green, K. W., Zelbst, P. J., Meacham, J., & Bhadauria, V. S. (2012) · Supply Chain Management: An International Journal · doi:10.1108/13598541211227126 · Cited by 1,476
“Because non-respondents have been found to descriptively resemble late respondents (Armstrong and Overton, 1977; Lambert and Harrington, 1990), this finding of general equality between early and late respondents indicates that non-response bias has not negatively impacted the assembled data set.”
ResultGefen (2011) · doi:10.2307/23044042 · Cited by 1,596
Organizational responses to environmental demands: opening the black box
Delmas, M. A., & Toffel, M. W. (2008) · Strategic Management Journal · doi:10.1002/smj.701 · Cited by 1,467
Switching barriers and repurchase intentions in services
Jones, M. A., Mothersbaugh, D. L., & Beatty, S. E. (2000) · Journal of Retailing · doi:10.1016/s0022-4359(00)00024-5 · Cited by 1,571
Zaheer, A., & Venkatraman, N. (1995) · Strategic Management Journal · doi:10.1002/smj.4250160504 · Cited by 1,543
A Contingent Resource‐Based Perspective of Supply Chain Resilience and Robustness
Brandon‐Jones, E., Squire, B., Autry, C. W., & Petersen, K. J. (2014) · Journal of Supply Chain Management · doi:10.1111/jscm.12050 · Cited by 1,361
“…(questionnaires received in the first two weeks), late respondents (questionnaires received in the third week or later) and non-respondents (a sub-sample of 25 non-respondents was selected at random from the initial contact list) (Armstrong and Overton 1977; Lambert and Harrington 1990).”
BackgroundHeide, J. B., & John, G. (1988) · Journal of Marketing · doi:10.1177/002224298805200103 · Cited by 1,501
Malär, L., Krohmer, H., Hoyer, W. D., & Nyffenegger, B. (2011) · Journal of Marketing · doi:10.1509/jmkg.75.4.35 · Cited by 1,324
Thompson, E. R. (2009) · Entrepreneurship Theory and Practice · doi:10.1111/j.1540-6520.2009.00321.x · Cited by 1,306
“Tests for unit nonresponse bias following Armstrong and Overton (1977) found no differences between first- and second-administration respondents by either gender (c(2) = 1.61; p = .21), by language (native or non-native English-speaker, c(2) = 1.88; p = .17), or by occupation (student or non-student, c(2) = 0.06; p =…”
MethodInfluentialThe four levels of loyalty and the pivotal role of trust: a study of online service dynamics
Harris, L. C., & Goode, M. M. H. (2004) · Journal of Retailing · doi:10.1016/j.jretai.2004.04.002 · Cited by 1,425
The Effects of Supplier Fairness on Vulnerable Resellers
Kumar, N., Scheer, L. K., & Steenkamp, J.-B. E. M. (1995) · Journal of Marketing Research · doi:10.1177/002224379503200107 · Cited by 1,396
Zheng, W., Yang, B., & McLean, G. N. (2010) · Journal of Business Research · doi:10.1016/j.jbusres.2009.06.005 · Cited by 1,269
Firm's resilience to supply chain disruptions: Scale development and empirical examination
Ambulkar, S., Blackhurst, J., & Grawe, S. (2015) · Journal of Operations Management · doi:10.1016/j.jom.2014.11.002 · Cited by 1,400
Investigating the factors that diminish the barriers to university–industry collaboration
Bruneel, J., D’Este, P., & Salter, A. (2010) · Research Policy · doi:10.1016/j.respol.2010.03.006 · Cited by 1,400
“significant differences in terms of structural features, such as size, sector or R&D intensity or attitudes to collaboration (Armstrong and Overton, 1977).”
BackgroundMaterialism and Well-Being: A Conflicting Values Perspective
Burroughs, J. E., & Rindfleisch, A. (2002) · Journal of Consumer Research · doi:10.1086/344429 · Cited by 1,313
Human Resource Management and Labor Productivity: Does Industry Matter?
Datta, D. K., Guthrie, J. P., & Wright, P. M. (2005) · Academy of Management Journal · doi:10.5465/amj.2005.15993158 · Cited by 1,317
“The assumption behind this “time trend extrapolation test” ( Armstrong & Overton, 1977 ) is that those providing responses late—after a second mailing and follow-up telephone call—are very similar to nonrespondents, given that they would have fallen into that category had not the second set of questionnaires been mail…”
BackgroundLi, T., & Calantone, R. J. (1998) · Journal of Marketing · doi:10.1177/002224299806200402 · Cited by 1,348
Consumer e-shopping acceptance: Antecedents in a technology acceptance model
Ha, S., & Stoel, L. (2009) · Journal of Business Research · doi:10.1016/j.jbusres.2008.06.016 · Cited by 1,353
Vickery, S. K., Jayaram, J., Droge, C., & Calantone, R. (2003) · Journal of Operations Management · doi:10.1016/j.jom.2003.02.002 · Cited by 1,310
An assessment of survey research in POM: from constructs to theory
Malhotra, M. K., & Grover, V. (1998) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00021-7 · Cited by 1,313
“Non-response bias can then be estiŽmated by sampling a group of non-respondents or .obtaining data on them through secondary sources and comparing them with respondents on key characŽ .teristics Armstrong and Overton, 1977 .”
BackgroundBig data and predictive analytics for supply chain and organizational performance
Gunasekaran, A., Papadopoulos, T., Dubey, R., Wamba, S. F., Childe, S. J., Hazen, B., & Akter, S. (2017) · Journal of Business Research · doi:10.1016/j.jbusres.2016.08.004 · Cited by 1,138
“…weeks), late respondents (respondents who have returned their response in the fourth week or later), and nonrespondents (a subsample of 20 respondents was selected at random from the initial contact list) took place (Armstrong & Overton, 1977; Chen & Paulraj, 2004; Lambert & Harrington, 1990).”
BackgroundHomburg, C., & Pflesser, C. (2000) · Journal of Marketing Research · doi:10.1509/jmkr.37.4.449.18786 · Cited by 1,282
Cross-Sectional versus longitudinal survey research: concepts, findings, and guidelines
Rindfleisch, A., Malter, A. J., Ganesan, S., & Moorman, C. (2008) · Journal of Marketing Research · doi:10.1509/jmkr.45.3.261 · Cited by 1,305
The effects of trust and interdependence on relationship commitment: A trans-Atlantic study
Geyskens, I., Steenkamp, J.-B. E. M., Scheer, L. K., & Kumar, N. (1996) · International Journal of Research in Marketing · doi:10.1016/s0167-8116(96)00006-7 · Cited by 1,271
MNE competence‐creating subsidiary mandates
Cantwell, J., & Mudambi, R. (2005) · Strategic Management Journal · doi:10.1002/smj.497 · Cited by 1,295
“Non-response bias was investigated with the widely used method suggested by Armstrong and Overton (1977).”
MethodCorporate Citizenship: Cultural Antecedents and Business Benefits
Maignan, I., Ferrell, O. C., & Hult, G. T. M. (1999) · Journal of the Academy of Marketing Science · doi:10.1177/0092070399274005 · Cited by 1,227
Steenkamp, J.-B. E. M., ter Hofstede, F., & Wedel, M. (1999) · Journal of Marketing · doi:10.2307/1251945 · Cited by 1,282
Wang, C. L., & Ahmed, P. K. (2004) · European Journal of Innovation Management · doi:10.1108/14601060410565056 · Cited by 1,153
“It was assumed that the last group who responded to the second follow-up were most similar to non-respondents (Armstrong and Overton, 1977).”
BackgroundMethodSchilke, O. (2014) · Strategic Management Journal · doi:10.1002/smj.2099 · Cited by 1,264
Knowledge sharing, innovation and firm performance
Wang, Z., & Wang, N. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.02.017 · Cited by 1,123
“We assessed non-response bias by following Armstrong and Overton (1977). Chi-square tests and T-test were used to compare the earliest 52 respondents and the last 52 respondents on context variables.”
MethodGarcía-Morales, V. J., Jiménez-Barrionuevo, M. M., & Gutiérrez-Gutiérrez, L. (2012) · Journal of Business Research · doi:10.1016/j.jbusres.2011.03.005 · Cited by 1,067
“To eliminate the possibility of non-response bias, the authors compared the characteristics of the respondents and of early and late responders in the sample (Armstrong and Overton, 1977).”
ResultAntoncic, B., & Hisrich, R. D. (2001) · Journal of Business Venturing · doi:10.1016/s0883-9026(99)00054-3 · Cited by 1,235
“Nonresponse bias was assessed on the basis that later respondents could be more like nonrespondents (Armstrong and Overton 1977).”
BackgroundZhu, Q., & Sarkis, J. (2007) · International Journal of Production Research · doi:10.1080/00207540701440345 · Cited by 1,235
“We evaluated non-response bias using t-tests to determine if there were significant differences in the mean values of the five GSCM practice factors between the two groups (Armstrong and Overton 1977).”
MethodD'Arcy, J., Hovav, A., & Galletta, D. (2009) · Information Systems Research · doi:10.1287/isre.1070.0160 · Cited by 1,168
“…se nd an y qu es tio ns re ga rd in g th is po lic y to pe rm is si on s@ in fo rm Table 6 Results for High and Low Moral Commitment Subgroups Path coefficients Paths High moral commitment Low moral commitment PC→ INT −0#233∗ 0#043 PS→ INT 0#103 −0#379∗∗ R2 of INT 0#27 0#18 ∗p 0#05, ∗∗p 0#01.”
BackgroundPetersen, K. J., Handfield, R. B., & Ragatz, G. L. (2005) · Journal of Operations Management · doi:10.1016/j.jom.2004.07.009 · Cited by 1,181
“First, a ‘‘wave analysis’’ approach was used to compare early responders versus late responders (Armstrong and Overton, 1977).”
MethodQueiroz, M. M., & Fosso Wamba, S. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.11.021 · Cited by 1,079
Experiential Knowledge and Costs in the Internationalization Process
Eriksson, K., Johanson, J., Majkgård, A., & Sharma, D. D. (1997) · Journal of International Business Studies · doi:10.1057/palgrave.jibs.8490104 · Cited by 1,162
Interorganizational Routines and Performance in Strategic Alliances
Zollo, M., Reuer, J. J., & Singh, H. (2002) · Organization Science · doi:10.1287/orsc.13.6.701.503 · Cited by 1,180
“To further explore the possibility of nonresponse bias, we assessed possible differences in all of the variables across early and late respondents under the assumption that late respondents are more similar to nonrespondents than early respondents are to nonrespondents (Armstrong and Overton 1977). Two-sample t-tests…”
MethodInfluentialThe influence of relational competencies on supply chain resilience: a relational view
Wieland, A., & Wallenburg, C. M. (2013) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/ijpdlm-08-2012-0243 · Cited by 1,060
“We followed approaches suggested by Armstrong and Overton (1977) to test for a late-response bias, Mentzer and Flint (1997) to test for a non-response bias, and Williams et al. (2010) to test for the presence of a common-method variance.”
MethodSocial presence, trust, and social commerce purchase intention: An empirical research
Lu, B., Fan, W., & Zhou, M. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2015.11.057 · Cited by 1,061
“Following Armstrong and Overton (1977), nonresponse bias was assessed by verifying that respondent demographics (age, gender and education) were not significantly distinct from current Chinese Internet consumers (iClick 2014; iResearch 2013).”
Cenamor, J., Parida, V., & Wincent, J. (2019) · Journal of Business Research · doi:10.1016/j.jbusres.2019.03.035 · Cited by 965
“A multi-group analysis was conducted to investigate potential nonresponse bias (Armstrong & Overton, 1977).”
MethodComparing Response Rates from Web and Mail Surveys: A Meta-Analysis
Shih, T.-H., & Fan, X. (2008) · Field Methods · doi:10.1177/1525822x08317085 · Cited by 1,159
“…Claycomb, Porter, and Martin 2000; Dillman 2000) and how to estimate and/or correct for nonresponse bias (e.g., Baur 1947; Ferber 1948; Donald 1960; Armstrong and Overton 1977; Stinchcombe, Jones, and Sheatsley 1981; Pearl and Fairley 1985; McBroom 1988; Bickart and Schmittlein 1999; Groves 2002).”
BackgroundRelationship between cooperation networks and innovation performance of SMEs
Zeng, S. X., Xie, X. M., & Tam, C. M. (2010) · Technovation · doi:10.1016/j.technovation.2009.08.003 · Cited by 1,110
Hughes, M., & Morgan, R. E. (2007) · Industrial Marketing Management · doi:10.1016/j.indmarman.2006.04.003 · Cited by 1,147
“To test for non-response bias, the Armstrong and Overton (1977) extrapolation method was employed, which is the accepted method for such a test.”
MethodThe paradox of openness: Appropriability, external search and collaboration
Laursen, K., & Salter, A. J. (2014) · Research Policy · doi:10.1016/j.respol.2013.10.004 · Cited by 1,083
“A high response rate is commonly acknowledged o avoid non-response bias (Armstrong and Overton, 1977: 396): n this context, a 58%response rate can be considered excellent.”
BackgroundWong, C. Y., Boon‐itt, S., & Wong, C. W. Y. (2011) · Journal of Operations Management · doi:10.1016/j.jom.2011.01.003 · Cited by 1,083
“Non-response bias was first tested by using the extrapolation method suggested by Armstrong and Overton (1977).”
MethodOnline customer experience in e-retailing: An empirical model of antecedents and outcomes
Rose, S., Clark, M., Samouel, P., & Hair, N. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.03.001 · Cited by 1,131
Organizational culture, innovation, and performance: A test of Schein's model
Hogan, S. J., & Coote, L. V. (2014) · Journal of Business Research · doi:10.1016/j.jbusres.2013.09.007 · Cited by 935
Spanos, Y. E., & Lioukas, S. (2001) · Strategic Management Journal · doi:10.1002/smj.174 · Cited by 1,113
“, sample firms in the second wave) are more similar to the general population than the early respondents (Armstrong and Overton, 1977).”
BackgroundMarket Orientation, Creativity, and New Product Performance in High-Technology Firms
Im, S., & Workman, J. P. (2004) · Journal of Marketing · doi:10.1509/jmkg.68.2.114.27788 · Cited by 1,084
Tan, J., & Peng, M. W. (2003) · Strategic Management Journal · doi:10.1002/smj.351 · Cited by 1,088
Antecedents and consequences of trust and satisfaction in buyer‐seller relationships
Selnes, F. (1998) · European Journal of Marketing · doi:10.1108/03090569810204580 · Cited by 1,088
Nyaga, G. N., Whipple, J. M., & Lynch, D. F. (2010) · Journal of Operations Management · doi:10.1016/j.jom.2009.07.005 · Cited by 1,043
The link between green purchasing decisions and measures of environmental consciousness
Schlegelmilch, B. B., Bohlen, G. M., & Diamantopoulos, A. (1996) · European Journal of Marketing · doi:10.1108/03090569610118740 · Cited by 1,035
“In order to investigate non-response bias, a comparison of responses to questionnaires received from the initial mailing to those received after the follow-up was conducted, as recommended by Armstrong and Overton (1977).”
MethodHult, G. T. M., & Ketchen, D. J. (2001) · Strategic Management Journal · doi:10.1002/smj.197 · Cited by 1,055
“The extrapolation procedure suggested by Armstrong and Overton (1977) was used to assess non-response bias.”
MethodPie-Expansion Efforts: Collaboration Processes in Buyer–Supplier Relationships
Jap, S. D. (1999) · Journal of Marketing Research · doi:10.1177/002224379903600405 · Cited by 1,069
Paulraj, A., Lado, A. A., & Chen, I. J. (2008) · Journal of Operations Management · doi:10.1016/j.jom.2007.04.001 · Cited by 1,028
“Additionally, the responses of early and late waves of returned surveys were compared to provide additional support of non-response bias (Armstrong and Overton, 1977; Lambert and Harrington, 1990).”
ResultHulland, J., Baumgartner, H., & Smith, K. M. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0532-y · Cited by 1,067
“The most commonly used test (reported in 62.6% of the papers describing at least one non-response test) compared early versus late respondents, as suggested by Armstrong and Overton (1977).”
BackgroundMethodInfluentialEntrepreneurial Orientation, Learning Orientation, and Firm Performance
Wang, C. L. (2008) · Entrepreneurship Theory and Practice · doi:10.1111/j.1540-6520.2008.00246.x · Cited by 1,056
When Does Trust Matter to Alliance Performance?
Krishnan, R., Martin, X., & Noorderhaven, N. G. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.22798171 · Cited by 1,036
“Armstrong and Overton (1977) argued that late respondents are representative of nonrespondents.”
BackgroundKuckertz, A., & Wagner, M. (2010) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2009.09.001 · Cited by 944
“Such a bias is a frequent problem of surveys based on written questionnaires (Armstrong and Overton, 1977), and similar issues could be expected for web-based surveys.”
Against the Green: A Multi-method Examination of the Barriers to Green Consumption
Gleim, M. R., Smith, J. S., Andrews, D., & Cronin, J. J. (2013) · Journal of Retailing · doi:10.1016/j.jretai.2012.10.001 · Cited by 1,048
Metadata
- Authors
- Armstrong, J. S., & Overton, T. S.
- Affiliations
- University of Pennsylvania (US)
- ORCID
- Armstrong, J. Scott
- Venue
- Journal of Marketing Research
- Publisher
- SAGE Publications
- Published
- 1977-08
- Volume
- 14
- Issue
- 3
- Pages
- 396-402
- ISSN
- 0022-2437 (ISSN-L)
- 1547-7193
- OpenAlex
- W2134884007
- Cited by
- 10,390
- References
- 45
- Citations by year
- 2026: 848 · 2025: 736 · 2024: 723 · 2023: 876 · 2022: 889 · 2021: 894 · 2020: 766 · 2019: 704 · 2018: 518 · 2017: 394 · 2016: 315 · 2015: 299 · 2014: 264 · 2013: 229 · 2012: 274
- FWCI
- 5.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Marketing Research (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Census and Population Estimation
- Keywords
- nonresponse bias, mail surveys, extrapolation, survey data quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.