Marketing survey research best practices: evidence and recommendations from a review of JAMS articles
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In Study 1, procedural remedies were adopted to minimize common method variance.
“We adopted procedural remedies to minimize common method variance (Hulland et al. 2018; see Web Appendix B for detailed descriptions of the procedural remedies).”
From Unintended reward costs: the effectiveness of customer referral reward programs for innovative products and services (2019) · cites this paper as Hulland et al. 2018
The study adopted several remedies to mitigate common method bias according to Hulland et al.'s method.
“This study adopted several remedies to mitigate common method bias according to Hulland et al.’s [143] method.”
From Consumers purchase intention in live-streaming e-commerce: A consumption value perspective and the role of streamer popularity (2024) · cites this paper as [143]
Cites
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314 · see citing works
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190 · see citing works
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194 · see citing works
A new criterion for assessing discriminant validity in variance-based structural equation modeling
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0403-8 · Cited by 38,459 · see citing works
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779 · see citing works
Self-Reports in Organizational Research: Problems and Prospects
Podsakoff, P. M., & Organ, D. W. (1986) · Journal of Management · doi:10.1177/014920638601200408 · Cited by 17,102 · see citing works
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744 · see citing works
Estimating Nonresponse Bias in Mail Surveys
Armstrong, J. S., & Overton, T. S. (1977) · Journal of Marketing Research · doi:10.2307/3150783 · Cited by 12,222 · see citing works
Accounting for common method variance in cross-sectional research designs
Lindell, M. K., & Whitney, D. J. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.1.114 · Cited by 8,490 · see citing works
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163 · see citing works
Jarvis, C. B., MACKENZIE, S. B., & Podsakoff, P. M. (2003) · Journal of Consumer Research · doi:10.1086/376806 · Cited by 5,910 · see citing works
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884 · see citing works
Harman, H. H. (1960) · Cited by 5,148 · see citing works
Reliability and Validity Assessment
Kurian, G. T. (2011) · The Encyclopedia of Political Science · doi:10.4135/9781608712434.n1341 · Cited by 5,045 · see citing works
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3182 · Cited by 4,740 · see citing works
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734 · see citing works
Identifying careless responses in survey data.
Meade, A. W., & Craig, S. B. (2012) · Psychological Methods · doi:10.1037/a0028085 · Cited by 3,865 · see citing works
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767 · see citing works
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493 · see citing works
A Review of Scale Development Practices in the Study of Organizations
Hinkin, T. R. (1995) · Journal of Management · doi:10.1177/014920639502100509 · Cited by 3,193 · see citing works
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165 · see citing works
The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs
Bergkvist, L., & Rossiter, J. R. (2007) · Journal of Marketing Research · doi:10.1509/jmkr.44.2.175 · Cited by 3,107 · see citing works
The C-OAR-SE procedure for scale development in marketing
Rossiter, J. R. (2002) · International Journal of Research in Marketing · doi:10.1016/s0167-8116(02)00097-6 · Cited by 2,477 · see citing works
Ziegel, E. R., & Lohr, S. L. (2000) · Technometrics · doi:10.2307/1271491 · Cited by 2,450 · see citing works
Nonresponse rates and nonresponse bias in household surveys
Groves, R. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl033 · Cited by 2,420 · see citing works
Data collection in a flat world: the strengths and weaknesses of Mechanical Turk samples
Goodman, J. K., Cryder, C. E., & Cheema, A. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1753 · Cited by 2,242 · see citing works
Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies
Voorhees, C. M., Brady, M. K., Calantone, R., & Ramirez, E. (2016) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-015-0455-4 · Cited by 2,111 · see citing works
Richardson, H. A., Simmering, M. J., & Sturman, M. C. (2009) · Organizational Research Methods · doi:10.1177/1094428109332834 · Cited by 1,721 · see citing works
MACKENZIE, S. B., Podsakoff, P. M., & Jarvis, C. B. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.4.710 · Cited by 1,685 · see citing works
Method Variance and Marker Variables: A Review and Comprehensive CFA Marker Technique
Williams, L. J., Hartman, N. S., & Cavazotte, F. (2010) · Organizational Research Methods · doi:10.1177/1094428110366036 · Cited by 1,682 · see citing works
Thinking About Answers: The Application of Cognitive Processes to Survey Methodology
Sudman, S., Bradburn, N. M., & Schwarz, N. (1995) · Cited by 1,586 · see citing works
Advancing formative measurement models
Diamantopoulos, A., Riefler, P., & Zeugner‐Roth, K. P. (2008) · Journal of Business Research · doi:10.1016/j.jbusres.2008.01.009 · Cited by 1,469 · see citing works
Common methods bias: does common methods variance really bias results?
Doty, D. H., & Glick, W. H. (1998) · Organizational Research Methods · doi:10.1177/109442819814002 · Cited by 1,380 · see citing works
Cross-Sectional versus longitudinal survey research: concepts, findings, and guidelines
Rindfleisch, A., Malter, A. J., Ganesan, S., & Moorman, C. (2008) · Journal of Marketing Research · doi:10.1509/jmkr.45.3.261 · Cited by 1,305 · see citing works
Nonresponse In Household Interview Surveys
Ziegel, E., Groves, R., & Couper, M. (1998) · Technometrics · doi:10.2307/1271375 · Cited by 1,283 · see citing works
Phillips, L. W. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800401 · Cited by 1,263 · see citing works
Response Styles in Marketing Research: A Cross-National Investigation
Baumgartner, H., & Steenkamp, J.-B. E. M. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.2.143.18840 · Cited by 1,261 · see citing works
Self-citationMorrison, D. F., & Harman, H. H. (1961) · Journal of the American Statistical Association · doi:10.2307/2282293 · Cited by 1,182 · see citing works
On the validity of subjective measures of company performance
WALL, T. D., MICHIE, J., PATTERSON, M., WOOD, S. J., SHEEHAN, M., CLEGG, C. W., & WEST, M. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.tb02485.x · Cited by 1,121 · see citing works
Changes in Telephone Survey Nonresponse over the Past Quarter Century
Curtin, R. T., Presser, S., & Singer, E. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi002 · Cited by 936 · see citing works
Customer betrayal and retaliation: when your best customers become your worst enemies
Grégoire, Y., & Fisher, R. J. (2007) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-007-0054-0 · Cited by 828 · see citing works
Models for Sample Selection Bias
Winship, C., & Mare, R. D. (1992) · Annual Review of Sociology · doi:10.1146/annurev.so.18.080192.001551 · Cited by 812 · see citing works
Thinking about Answers: The Application of Cognitive Process to Survey Methodology
Aalbaum, G., Sudman, S., Bradburn, N. M., & Schwarz, N. (1996) · Journal of Marketing Research · doi:10.2307/3152133 · Cited by 783 · see citing works
Questions and Answers in Attitude Surveys.
Robinson, J. P., Schuman, H., & Presser, S. (1983) · Social Forces · doi:10.2307/2578327 · Cited by 781 · see citing works
Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies
Cote, J. A., & Buckley, M. R. (1987) · Journal of Marketing Research · doi:10.2307/3151642 · Cited by 750 · see citing works
Simmering, M. J., Fuller, C. M., Richardson, H. A., Ocal, Y., & Atinc, G. M. (2015) · Organizational Research Methods · doi:10.1177/1094428114560023 · Cited by 734 · see citing works
Bagozzi, R. P., & Yi, Y. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.5.547 · Cited by 612 · see citing works
Research synthesis: AAPOR report on online panels
Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, W. M. I., Baker, R., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D., Frankel, M. R., Garland, P., et al. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq048 · Cited by 584 · see citing works
Web Survey Methods: Introduction
Couper, M. P., & Miller, P. G. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn066 · Cited by 567 · see citing works
Phillips, L. W. (1981) · Journal of Marketing Research · doi:10.2307/3151333 · Cited by 517 · see citing works
Questions and Answers in Attitude Surveys
Albaum, G., Schuman, H., & Presser, S. (1982) · Journal of Marketing Research · doi:10.2307/3151742 · Cited by 512 · see citing works
Reversed item bias: An integrative model.
Weijters, B., Baumgartner, H., & Schillewaert, N. (2013) · Psychological Methods · doi:10.1037/a0032121 · Cited by 409 · see citing works
Self-citationDiscovery-Oriented Consumer Research
Wells, W. D. (1993) · Journal of Consumer Research · doi:10.1086/209318 · Cited by 400 · see citing works
Method Effects, Measurement Error, and Substantive Conclusions
Lance, C. E., Dawson, B. L., Birkelbach, D. B., & Hoffman, B. J. (2010) · Organizational Research Methods · doi:10.1177/1094428109352528 · Cited by 358 · see citing works
Capabilities and financial performance: the moderating effect of strategic type
Song, M., Benedetto, C. A. D., & Nason, R. W. (2007) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-006-0005-1 · Cited by 315 · see citing works
Ostroff, C. L., Kinicki, A. J., & Clark, M. A. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.2.355 · Cited by 310 · see citing works
The Total Survey Error Approach: A Guide to the New Science of Survey Research
Weisberg, H. F. (2005) · Cited by 282 · see citing works
The Total Survey Error Approach
Weisberg, H. F. (2005) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226891293.001.0001 · Cited by 271 · see citing works
Summers, J. O. (2001) · Journal of the Academy of Marketing Science · doi:10.1177/03079450094243 · Cited by 234 · see citing works
The Similarity of Individual Directed and Group Directed Leader Behavior Descriptions.
Schriesheim, C. A. (1979) · Academy of Management Journal · doi:10.2307/255594 · Cited by 197 · see citing works
Hughes, D. E., Bon, J. L., & Rapp, A. A. (2012) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-012-0311-8 · Cited by 192 · see citing works
Patterns and performance outcomes of innovation orientation
Stock, R., & Zacharias, N. A. (2011) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-010-0225-2 · Cited by 189 · see citing works
Arnold, T. J., Fang, E., & Palmatier, R. W. (2010) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-010-0203-8 · Cited by 185 · see citing works
Cognitive burden of survey questions and response times: A psycholinguistic experiment
Lenzner, T., Kaczmirek, L., & Lenzner, A. (2009) · Applied Cognitive Psychology · doi:10.1002/acp.1602 · Cited by 185 · see citing works
Wei, Y. S., Samiee, S., & Lee, R. P. (2013) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-013-0337-6 · Cited by 184 · see citing works
Question Understanding Aid (QUAID): A Web Facility that Tests Question Comprehensibility
Graesser, A. C. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfj012 · Cited by 170 · see citing works
An Evaluation of Causal Models Linking the Received Role with Job Satisfaction
Greene, C. N., & Organ, D. W. (1973) · Administrative Science Quarterly · doi:10.2307/2391931 · Cited by 165 · see citing works
The role of brand communications on front line service employee beliefs, behaviors, and performance
Baker, T. L., Rapp, A. A., Meyer, T., & Mullins, R. R. (2014) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0376-7 · Cited by 158 · see citing works
Professional respondents in nonprobability online panels
Hillygus, D. S., Jackson, N., & Young, M. (2014) · doi:10.1002/9781118763520.ch10 · Cited by 143 · see citing works
Assessing Marketing Strategy Performance
Moorman, C., & Lehmann, D. R. (2004) · Cited by 142 · see citing works
Questions and answers in attitude surveys
Reid, M. I. (1983) · Social Science Information Studies · doi:10.1016/0143-6236(83)90052-2 · Cited by 110 · see citing works
Alternative Techniques for Assessing Common Method Variance
Schaller, T. K., Patil, A., & Malhotra, N. K. (2014) · Organizational Research Methods · doi:10.1177/1094428114554398 · Cited by 109 · see citing works
Salesperson learning, organizational learning, and retail store performance
Bell, S. J., Mengüç, B., & Widing, R. E. (2009) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-009-0149-x · Cited by 103 · see citing works
Partialling Factor Scores Does Not Control Method Variance: A Reply to Podsakoff and Todor
Kemery, E. R., & Dunlap, W. P. (1986) · Journal of Management · doi:10.1177/014920638601200407 · Cited by 98 · see citing works
Ahearne, M., Haumann, T., Kraus, F., & Wieseke, J. (2013) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-013-0333-x · Cited by 94 · see citing works
Brewer, M. B., Campbell, D. T., & Crano, W. D. (1970) · Sociometry · doi:10.2307/2786268 · Cited by 82 · see citing works
Effects of Survey Question Comprehensibility on Response Quality
Lenzner, T. (2012) · Field Methods · doi:10.1177/1525822x12448166 · Cited by 78 · see citing works
Seeing Through the Eyes of the Respondent: An Eye-tracking Study on Survey Question Comprehension
Lenzner, T., Kaczmirek, L., & Galešić, M. (2011) · International Journal of Public Opinion Research · doi:10.1093/ijpor/edq053 · Cited by 74 · see citing works
Linking Employee Confidence to Performance: A Study of Self-Managing Service Teams
de Jong, A. (2006) · Journal of the Academy of Marketing Science · doi:10.1177/0092070306287126 · Cited by 64 · see citing works
Berinsky, A. J. (2008) · SAGE Publications Ltd eBooks · doi:10.4135/9781848607910.n29 · Cited by 59 · see citing works
QUAID: A questionnaire evaluation aid for survey methodologists
Graesser, A. C., Wiemer-Hastings, K., Kreuz, R. J., Hastings, P., & Marquis, K. H. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207792 · Cited by 56 · see citing works
Huber, J. C., Kamakura, W. A., & Mela, C. F. (2014) · Journal of Marketing Research · doi:10.1509/jmr.51.1.02 · Cited by 45 · see citing works
The Other Side of Method Bias: The Perils of Distinct Source Research Designs
Kammeyer‐Mueller, J. D., Steel, P., & Rubenstein, A. L. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171003680278 · Cited by 43 · see citing works
Journal of Marketing Research: 2 Ps
Wittink, D. R. (2004) · Journal of Marketing Research · doi:10.1509/jmkr.41.1.1.25089 · Cited by 35 · see citing works
From the Editor: Research Traditions and Patterns in Marketing Scholarship
Zinkhan, G. M. (2006) · Journal of the Academy of Marketing Science · doi:10.1177/0092070306287921 · Cited by 18 · see citing works
Measurement Models for Marketing Constructs
Baumgartner, H., & Weijters, B. (2017) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-3-319-56941-3_9 · Cited by 17 · see citing works
Self-citationSurvey Research in B2B Marketing: Current Challenges and Emerging Opportunities
Rindfleisch, A., & Antia, K. D. (2012) · Edward Elgar Publishing eBooks · doi:10.4337/9781781002445.00050 · Cited by 15 · see citing works
Kamakura, W. A. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.1.1.18824 · Cited by 13 · see citing works
Use of partial least squares (PLS) in strategic management research: a review of four recent studies
Hulland, J. (1999) · Strategic Management Journal · doi:10.1002/(sici)1097-0266(199902)20:2
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Understanding and managing the threat of common method bias: Detection, prevention and control
Kock, F., Berbekova, A., & Assaf, A. G. (2021) · Tourism Management · doi:10.1016/j.tourman.2021.104330 · Cited by 1,692 · see citing works
Review articles: purpose, process, and structure
Palmatier, R. W., Houston, M. B., & Hulland, J. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0563-4 · Cited by 1,051 · see citing works
Self-citationDeveloping and validating a service robot integration willingness scale
Lu, L., Cai, R., & Gursoy, D. (2019) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2019.01.005 · Cited by 1,013 · see citing works
Rahman, M. S., Bag, S., Hossain, M. A., Abdel Fattah, F. A. M., Gani, M. O., & Rana, N. P. (2023) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2023.103273 · Cited by 170 · see citing works
Qian, T. Y., Matz, R., Luo, L., & Xu, C. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.02.082 · Cited by 92 · see citing works
Rahman, M. S., Hossain, M. A., & Abdel Fattah, F. A. M. (2022) · Journal of Enterprise Information Management · doi:10.1108/jeim-05-2020-0185 · Cited by 74 · see citing works
Power imbalance and the dark side of the captive agri-food supplier–buyer relationship
Glavee-Geo, R., Engelseth, P., & Buvik, A. (2022) · Journal of Business Ethics · doi:10.1007/s10551-021-04791-7 · Cited by 64 · see citing works
Dose, D. B., Walsh, G., Beatty, S. E., & Elsner, R. (2019) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00635-z · Cited by 60 · see citing works
Seeking empathy or suggesting a solution? Effects of chatbot messages on service failure recovery
Haupt, M., Rozumowski, A., Freidank, J., & Haas, A. (2023) · Electronic Markets · doi:10.1007/s12525-023-00673-0 · Cited by 57 · see citing works
Zhang, Q., Wang, Y., & Ariffin, S. K. (2024) · PLoS ONE · doi:10.1371/journal.pone.0296339 · Cited by 50 · see citing works
Employee mindfulness and creativity: when emotions and national culture matter
Gip, H., The Khoa, D., Guchait, P., Fernando Garcia, R. L., & Pasamehmetoglu, A. (2022) · The Service Industries Journal · doi:10.1080/02642069.2022.2037570 · Cited by 45 · see citing works
Salah, M., Abdelfattah, F., Alhalbusi, H., & Mukhaini, M. A. (2023) · doi:10.21203/rs.3.rs-3508563/v1 · Cited by 12 · see citing works
- Authors
- Hulland, J., Baumgartner, H., & Smith, K. M.
- Affiliations
- University of Georgia (US)
- Pennsylvania State University (US)
- Northeastern University (US)
- Corresponding author
- Hulland, John
- Venue
- Journal of the Academy of Marketing Science
- Published
- 2017-04-10
- Volume
- 46
- Issue
- 1
- Pages
- 92-108
- ISSN
- 0092-0703 (ISSN-L)
- 1552-7824
- OpenAlex
- W2606700149
- Cited by
- 1,067
- References
- 89
- Citations by year
- 2026: 118 · 2025: 161 · 2024: 170 · 2023: 175 · 2022: 180 · 2021: 125 · 2020: 74 · 2019: 44 · 2018: 16 · 2017: 3 · 2013: 1
- FWCI
- 95.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the Academy of Marketing Science (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Business Strategies and Management Research
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Keywords
- survey methodology, best practices, market analysis, survey design, survey administration, survey data analysis, Journal of Marketing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review