CoChat
Sign Up
PreprintCited by 17Qualitative Comparative Analysis ResearchBusiness Strategies and Management ResearchPolitical Science Research and Education

The DOI matches its DataCite record.

Where the Model Frequently Meets the Road: Combining Statistical, Formal, and Case Study Methods

Open access
Bennett, Andrew, Braumoeller, Bear F.·2022·arXiv
DOI 10.48550/arxiv.2202.08062arXiv 2202.08062
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper analyzes the working or default assumptions researchers in the formal, statistical, and case study traditions typically hold regarding the sources of unexplained variance, the meaning of outliers, parameter values, human motivation, functional forms, time, and external validity. We argue that these working assumptions are often not essential to each method, and that these assumptions can be relaxed in ways that allow multimethod work to proceed. We then analyze the comparative advantages of different combinations of formal, statistical, and case study methods for various theory-building and theory-testing research objectives. We illustrate these advantages and offer methodological advice on how to combine different methods, through analysis and critique of prominent examples of multimethod research.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2202.08062

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The alleged limitation of PT case studies' inability to generalize or achieve external validity has often been misunderstood.

    “One alleged limitation of PT case studies is their supposed inability to generalize from their results, or to achieve external validity. This issue has often been misunderstood, however (George and Bennett, 2005; Bennett, 2022).”

    From Causal Inference and Policy Evaluation from Case Studies Using Bayesian Process Tracing (2023) · cites this paper as Bennett, 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 50

  1. Back, Hanna, and Patrick Dumont, 'Combining large-N and small-n strategies: the way forward in coalition research,' West European Politics , vol. 30, no. 3 (2007) 467-501. Bartels, Larry. 1997. 'Specification Uncertainty and Model Averaging.' American Journal of Political Science 41(2), 641-74.
  2. Beck, Nathaniel, Gary King and Langche Zeng. 2000. Improving Quantitative Studies of International Relations: A Conjecture. American Political Science Review 94(1):21-35.
  3. Beck, Nathaniel, Gary King and Langche Zeng. 2004. Theory and Evidence in International Conflict: A Reponse to De Marchi, Gelpi, and Grynaviski. American Political Science Review 98(2):379-89.
  4. Bennett, Andrew, Joseph Lepgold and Danny Unger. 1994. 'Burden Sharing in the Persian Gulf War. International Organization 48 (1):39-75.
  5. Bennett, Andrew, Aharon Barth, and Kenneth Rutherford. 2003. 'Do We Preach What We Practice? A Survey of Methods in Political Science Journals and Curricula.' PS: Political Science and Politics 36 (3): 373-8.
  6. Braumoeller, Bear. 2003. Causal Complexity and the Study of Politics. Political Analysis 11 (3): 209-33.
  7. Braumoeller, Bear. 2008. Systemic Politics and the Origins of Great Power Conflicts. American Political Science Review 102(1):77-93.
  8. Cederman, Lars-Erik. 2001. 'Agent-Based Modeling in Political Science.' The Political Methodologist 10 (1): 16-22.
  9. Clarke, Kevin. 2007. 'A Simple Distribution-Free Test for Nonnested Hypotheses. Political Analysis 15 (3):1-17.
  10. Collier, David, and Steven Levitsky, 'Democracy with Adjectives: Conceptual Innovation in Comparative Research,' World Politics , Vol. 49, no. 3 (April 1997) pp. 430-451.
  11. De Marchi, Scott, Christopher Gelpi, and Jeffrey Grynaviski. 2004. Untangling Neural Nets. American Political Science Review 98 (2): 371-8.
  12. Downs, George, David Rocke and Peter Barsoom. 1998. 'Managing the Evolution of Multilateralism.' International Organization 52(2): 397-420.
  13. Eckstein, Harry. 1975. 'Case Studies and Theory in Political Science.' In Fred Greenstein and Nelson Polsby, eds., Handboook of Political Science , Vol. 7. Reading, MA: Addison-Wesley.
  14. Elster, Jon. 1985. Sour Grapes: Studies in the Subversion of Rationality . Cambridge: Cambridge University Press.
  15. Epstein, David, and Sharyn O'Halloran. 1996. 'Partisanship and the U.S. Tariff.' International Organization 50 (2): 301-324.
  16. Fearon, James, and David Laitin. 2008. Integrating Qualitative and Quantitative Methods. In Janet Box-Steffensmeier, Henry Brady, and David Collier, eds., The Oxford Handbook of Political Methodology (Oxford University Press).
  17. Feaver, Peter, and Emerson M.S. Niou. 1996. 'Managing Nuclear Proliferation: Condemn, Strike, or Assist?,' International Studies Quarterly 40 (2): 209-234.
  18. Gerring, John, and Jason Seawright. 2007. 'Techniques for Choosing Cases,' in Gerring, Case Study Research: Principles and Practices (Cambridge University Press).
  19. Goemans, Hein. 2000. War and Punishment: The Causes of War Termination and the First World War. Princeton: Princeton University Press.
  20. Hafner-Burton, Emilie, and James Ron, 'Seeing Double: Human Rights Impact through Qualitative and Quantitative Eyes,' World Politics vol. 61 (2009), 360-401.
  21. Hall, Peter. 2003. 'Aligning Ontology and Methodology in Comparative Research.' In James Mahoney and Dietrick Reuschemeyer, eds., Comparative Historical Research in the Social Sciences. Cambridge: Cambridge University Press.
  22. Hathaway, Oona. 1998. 'The Impact of Trade Liberalization on Industry Demands for Protection.' International Organization 52 (3): 575-612.
  23. Huth, Paul. 1996. Standing Your Ground: Territorial Disputes and International Conflict. University of Michigan Press.
  24. Iversen, Torben. 1998. 'Wage Bargaining and Central Bank Independence.' International Organization 52 (3): 469-504.
  25. Kennedy, Peter. 2002. 'Sinning in the Basement: What are the Rules? The Ten Commandments of Applied Econometrics.' Journal of Economic Surveys 16 (4): 569589.
  26. King, Gary, Robert Keohane and Sidney Verba. 1994. Designing Social Inquiry . Princeton University Press.
  27. Lieberman, Evan. 2005. Nested Analysis as a Mixed-method Strategy for Comparative Research. Amercan Political Science Review Vol. 99, 435-52.
  28. Lijphart, Arend. 1971. 'Comparative Politics and the Comparative Method. American Political Science Review 64 (4): 1033-53.
  29. Lohmann, Suzanne. 1994. 'Dynamics of Informational Cascades: The Monday Demonstrations in Leipzig, East Germany, 1989-1991.' World Politics 47 (1): 42-101.
  30. Lohmann, Suzanne. 1998. 'Federalism and Central Bank Independence: The Politics of German Monetary Policy, 1957-92.' World Politics 50 (3): 401-446 .
  31. Lohmann, Suzanne, and Sharyn O'Halloran. 1994. 'Divided Government and U.S. Trade Policy.' International Organization 48 (4): 595-632.
  32. Martin, Lisa. 1992. Coercive Cooperation: Explaining Multilateral Economic Sanctions. Princeton University Press.
  33. Moravcsik, Andrew. 1997. 'Taking Preferences Seriously: A Liberal Theory of International Politics.' International Organization 51 (4): 513-553.
  34. Morgan, T. Clifton, and Sally Howard Campbell. 1991. 'Domestic Structure, Decisional Constraints, and War-So Why Kant Democracies Fight?' Journal of Conflict Resolution 35 (2): 187-211.
  35. Morton, Rebecca. 1999. Methods and Models: A Guide to the Empirical Analysis of Formal Models in Political Science . Cambridge University Press.
  36. Papyoanou, Paul. 1997. 'Intra-Alliance Bargaining and U.S. Bosnia Policy,' The Journal of Conflict Resolution 41 (1): 91-116.
  37. Pierson, Paul. 2004. Politics in Time (Princeton University Press).
  38. Ragin, Charles. 2000. Fuzzy Set Social Science . University of Chicago Press.
  39. Reiter, Dan. 1996. Crucible of Beliefs: Learning, Alliances, and World Wars. Cornell University Press, 1996.
  40. Reiter, Dan, and Allan Stam. 2002. Democracies at War . Princeton University Press.
  41. Rosecrance, Richard, and Chih-Cheng Lo. 1996. 'Balancing, Stability, and War: The Mysterious Case of the Napoleonic International System.' International Studies Quarterly 40 (4): 479-500.
  42. Rubin, Donald. 1973. 'Matching to Remove Bias in Observational Studies.' Biometrics 29 (1): 159-83.
  43. Sambanis, Nicholas, 'Using Case Studies to Expand Economic Models of Civil War,' Perspectives on Politics , vol. 2, no. 2 (2004), 259-279.
  44. Shambaugh, George. 1999. States, Firms, and Power: Successful Sanctions in United States Foreign Policy. State University of New York Press.
  45. Signorino, Curt. 1999. Strategic Interaction and the Statistical Analysis of International Conflict. American Political Science Review 93(2):279-97.
  46. Simmons, Beth. 1994. Who Adjusts? Domestic Sources of Foreign Economic Policy During the Interwar Years. Princeton University Press.
  47. Simon, Herbert. 1957. 'A Behavioral Model of Rational Choice.' In Models of Man, Social and Rational: Mathematical Essays on Rational Human Behavior in a Social Setting . New York: Wiley.
  48. Schultz, Kenneth. 2001. Democracy and Coercive Diplomacy . Cambridge University Press. Smith, Alastair. 1999. 'Testing Theories of Strategic Choice: The Example of Crisis Escalation.' American Journal of Political Science 43 (4): 1254-83.
  49. Weibull, Jorgen W. 2002. Evolutionary Game Theory . MIT Press.
  50. Wendt, Alexander. 1999. Social Theory of International Politics . Cambridge University Press.

Cited by

Sorted by citations

Metadata

Authors
Bennett, A., & Braumoeller, B. F.
Affiliations
The Ohio State University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2022
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2202.08062
arXiv
2202.08062
OpenAlex
W4226263627
Cited by
17
References
0
Citations by year
2026: 1 · 2023: 2 · 2022: 1
Type
posted content
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Topics
  • Social Sciences › Sociology and Political Science › Qualitative Comparative Analysis Research
  • Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
  • Social Sciences › Political Science and International Relations › Political Science Research and Education
Keywords
multi-method research, mixed methods, unexplained variance, outliers, parameter values, motives, functional form, time, generalizability, theory development, theory testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review