CoChat

An Update for Taxonomy Designers: Methodological Guidance from Information Systems Research

Open access
Kundisch, Dennis, Muntermann, Jan, Oberländer, Anna Maria, Rau, Daniel, Röglinger, Maximilian, Schoormann, Thorsten, Szopinski, Daniel · 2022 · Business & Information Systems Engineering
Cited by 166

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

Taxonomies are classification systems that help researchers conceptualize phenomena based on their dimensions and characteristics. To address the problem of ‘ad-hoc’ taxonomy building, Nickerson et al. (2013) proposed a rigorous taxonomy development method for information systems researchers. Eight years on, however, the status quo of taxonomy research shows that the application of this method lacks consistency and transparency and that further guidance on taxonomy evaluation is needed. To fill these gaps, this study (1) advances existing methodological guidance and (2) extends this guidance with regards to taxonomy evaluation. Informed by insights gained from an analysis of 164 taxonomy articles published in information systems outlets, this study presents an extended taxonomy design process together with 26 operational taxonomy design recommendations. Representing an update for taxonomy designers, it contributes to the prescriptive knowledge on taxonomy design and seeks to augment both rigorous taxonomy building and evaluation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s12599-021-00723-x

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Research works printed but not linked: 109

  1. Addas S, Pinsonneault A (2015) The many faces of information technology interruptions: a taxonomy and preliminary investigation of their performance effects. Inf Syst J 25(3):231–273 · DOI · Paper page
  2. Alrige M, Chatterjee S (2015) Toward a taxonomy of wearable technologies in healthcare. In: Proceedings of the 10th International Conference on Design Science Research in Information Systems and Technology (DESRIST 2015), Dublin · DOI
  3. Bailey KD (1994) Typologies and taxonomies: an introduction to classification techniques. Sage, Thousand Oaks · DOI · Paper page
  4. Bapna R, Goes P, Gupta A, Jin Y (2004) User heterogeneity and its impact on electronic auction market design: an empirical exploration. MIS Q 28(1):21–43 · DOI · Paper page
  5. Barn R, Barn B (2016) An ontological representation of a taxonomy for cybercrime. In: Proceedings of the 24th European Conference on Information Systems, Istanbul
  6. Baskerville RL, Kaul M, Storey VC (2015) Genres of inquiry in design-science research. MIS Q 39(3):541–564 · DOI · Paper page
  7. Baskerville RL, Pries-Heje J (2019) Projectability in design science research. J Inf Technol Theor Appl 20(1):53–76
  8. Becker J, Niehaves B (2007) Epistemological perspectives on IS research: a framework for analysing and systematizing epistemological assumptions. Inf Syst J 17(2):197–214 · DOI
  9. Bayona-Oré S, Calvo-Manzano JA, Cuevas G, San-Feliu T (2014) Critical success factors taxonomy for software process deployment. Softw Qual J 22(1):21–48 · DOI
  10. Beinke JH, Nguyen D, Teuteberg F (2018) Towards a business model taxonomy of startups in the finance sector using blockchain. In: Proceedings of the 39th International Conference on Information Systems, San Francisco
  11. Brennan RL, Prediger DJ (1981) Coefficient kappa: some uses, misuses, and alternatives. Educ Psychol Meas 41(3):687–699 · DOI · Paper page
  12. Chasin F, von Hoffen M, Cramer M, Matzner M (2018) Peer-to-peer sharing and collaborative consumption platforms: a taxonomy and a reproducible analysis. Inf Syst E-Bus Manag 16(2):293–325 · DOI
  13. Cledou G, Estevez E, Soares Barbosa L (2018) A taxonomy for planning and designing smart mobility services. Gov Inf Q 35(1):61–76 · DOI
  14. Daniel S, Midha V, Bhattacherhjee A, Sing SP (2018) Sourcing knowledge in open source software projects: the impacts of internal and external social capital on project success. J Strateg Inf Syst 27(3):237–256 · DOI
  15. Degrossi LC, Porto de Albuquerque J, dos Santos RR, Zipf A (2018) A taxonomy of quality assessment methods for volunteered and crowdsourced geographic information. Trans GIS 22(2):542–560 · DOI
  16. De Langhe B, Fernbach P (2019) The dangers of categorical thinking. Harv Bus Rev 97(5):80–92
  17. Domínguez E, Pérez B, Rubio AL, Zapata MA (2019) A taxonomy for key performance indicators management. Comput Stand Interfaces 64:24–40 · DOI
  18. Dremel C, Stöckli E, Wulf J, Herrmann A (2018) Archetypes of data analytics providers in the big data era. In: Proceedings of the 24th Americas Conference on Information Systems, New Orleans
  19. Eickhoff M, Muntermann J, Weinrich T (2017) What do FinTechs actually do? A taxonomy of FinTech business models. In: Proceedings of the 38th International Conference on Information Systems, Seoul
  20. Eldredge N, Cracraft J (1980) Phylogenetic patterns and the evolutionary process: method and theory in comparative biology. Columbia University Press, New york
  21. Fazal-Baqaie M, Engels G (2016) Software processes management by method engineering with MESP. In: Kuhrmann M, et al (eds) Managing software process evolution: traditional, agile and beyond – how to handle process change. Springer, Cham · doi:10.1007/978-3-319-31545-4_10
  22. Fellmann M, Robert S, Büttner S, Mucha H, Röcker C (2017) Towards a framework for assistance systems to support work processes in smart factories. In: Proceedings of the IFIP International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Reggio di Calabria · DOI
  23. Frank U (2006) Towards a pluralistic conception of research methods in information systems research, ICB-Research Report, 7. Universität Duisburg-Essen, Institut für Informatik und Wirtschaftsinformatik, Essen
  24. Gao F, Thiebes S, Sunyaev A (2018) Rethinking the meaning of cloud computing for health care: a taxonomic perspective and future research directions. J Med Internet Res 20(7):1–27 · DOI
  25. Gimpel H, Rau D, Röglinger M (2018) Understanding FinTech start-ups: a taxonomy of consumer-oriented service offerings. Electron Mark 28(3):245–264 · DOI · Paper page
  26. Goldkuhl G (2004) Design theories in information systems: a need for multi-grounding. J Inf Technol Theor Appl 6(2):59–72
  27. Goldkuhl G (2016) Separation or unity? Behavioral science vs. design science. In: Proceedings of the AIS SIGPRAG Pre-ICIS Workshop of the 37th International Conference on Information Systems, Dublin
  28. Gomber P, Koch JA, Siering M (2017) Digital finance and FinTech: current research and future research directions. J Bus Econ 87(5):537–580
  29. Goo J, Kishore R, Rao HR (2000) A content-analytic longitudinal study of the drivers for information technology and systems outsourcing. In: Proceedings of the 21st International Conference on Information Systems, Brisbane
  30. Gregor S, Hevner AR (2013) Positioning and presenting design science research for maximum impact. MIS Q 37(2):337–356 · DOI · Paper page
  31. Gregor S, Chandra Kruse L, Seidel S (2020) Research perspectives: the anatomy of a design principle. J Assoc Inf Syst 21(6):1622–1652
  32. Gregory RW, Muntermann J (2011) Theorizing in design science research: inductive versus deductive approaches. In: Proceedings of the 32nd International Conference on Information Systems, Shanghai
  33. Gregory RW, Muntermann J (2014) Heuristic theorizing: proactively generating design theories. Inf Syst Res 25(3):639–653 · DOI
  34. Hambrick DC (1984) Taxonomic approaches to studying strategy: some conceptual and methodological issues. J Manag Inf Syst 10(1):27–41
  35. Hanelt A, Hildebrandt B, Polier J (2015) Uncovering the role of IS in business model innovation: a taxonomy-driven approach to structure the field. In: Proceedings of the 23rd European Conference on Information Systems, Münster
  36. Hempel CG (1966) Philosophy of natural science. Prentice-Hall, Upper Saddle River
  37. Herterich MM, Buehnen T, Uebernickel F, Brenner W (2016) A taxonomy of industrial service systems enabled by digital product innovation. In: Proceedings of the 49th Hawaii International Conference on System Sciences, Koloa · DOI
  38. Hevner AR, Chatterjee S (2010) Design research in information systems. Springer, Boston · DOI · Paper page
  39. Holler M, Uebernickel F, Brenner W (2017) Defining archetypes of e-collaboration for product development in the automotive industry. In: Proceedings of the 25th European Conference on Information Systems, Guimarães
  40. Iivari J (2007) A paradigmatic analysis of information systems as a design science. Scand J Inf Syst 19(2):39–64
  41. Janssen A, Passlick J, Cardona DR, Breitner MH (2020) Virtual assistance in any context. Bus Inf Syst Eng 62(3):211–225 · DOI
  42. Jöhnk J, Röglinger M, Thimmel M, Urbach N (2017) How to implement agile IT setups: a taxonomy of design options. In: Proceedings of the 25th European Conference on Information Systems, Guimarães
  43. Kazan E, Tan C-W, Lim ET, Sørensen C, Damsgaard J (2018) Disentangling digital platform competition: the case of UK mobile payment platforms. J Manag Inf Syst 35(1):180–219 · DOI · Paper page
  44. Keller R, König C (2014) A reference model to support risk identification in cloud networks. In: Proceedings of the 35th International Conference on Information Systems, Auckland
  45. Krieger F, Drews P (2018) Leveraging big data and analytics for auditing: towards a taxonomy. In: Proceedings of the 39th International Conference on Information Systems, San Francisco
  46. Kuechler B, Vaishnavi V (2008) On theory development in design science research: Anatomy of a research project. Eur J Inf Syst 17(5):489–504 · DOI · Paper page
  47. Kunst K, Vatrapu R (2014) Towards a theory of socially shared consumption: literature review, taxonomy, and research agenda. In: Proceedings of the 22rd European Conference on Information Systems, Tel Aviv
  48. Küpper T, Jung R, Lehmkuhl T, Wieneke A (2014) Features for social CRM technology: an organizational perspective. In: Proceedings of the 20th Americas Conference on Information Systems, Savannah
  49. Kutzner K, Schoormann T, Knackstedt R (2018) Digital transformation in information systems research: a taxonomy-based approach to structure the field. In: Proceedings of the 26th European Conference on Information Systems, Portsmouth
  50. Lakoff G (1987) Women, fire, and dangerous things: what categories reveal about the mind. University of Chicago, Chicago · DOI · Paper page
  51. Lakoff G, Johnson M (1999) Philosophy in the flesh: the embodied mind and its challenge to western thought. Basic Books, New York
  52. Land L, Smith S, Pang V (2013) Building a taxonomy for cybercrimes. In: Proceedings of the 17th Pacific Asia Conference on Information Systems, Jeju Island
  53. Land L, Smith S, Winchester D, Pang V (2014) The construction of identity offences taxonomy: an Australian context. In: Proceedings of the 25th Australasian Conference on Information Systems, Auckland
  54. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biom 33(1):159–174 · DOI · Paper page
  55. Maedche A, Gregor S, Morana S, Feine J (2019) Conceptualization of the problem space in design science research. In: Proceedings of the 14th International Conference on Design Science Research in Information Systems and Technology, Worcester · DOI
  56. March ST, Smith GF (1995) Design and natural science research on information technology. Decis Support Syst 15(4):251–266 · DOI · Paper page
  57. Martin J (1983) Managing the data base environment. Prentice-Hall, Upper Saddle River
  58. Mayer P (2017) A taxonomy of cross-language linking mechanisms in open source frameworks. Comput 99:701–724 · DOI
  59. McKay J, Marshall P, Hirschheim R (2012) The design construct in information systems design science. J Inf Technol 27(2):125–139 · DOI
  60. McKelvey B (1975) Guidelines for the empirical classification of organizations. Admin Sci Q 20(4):509–525 · DOI · Paper page
  61. McKelvey B (1982) Organizational systematics: taxonomy, evolution, classification. University of California Press, Berkeley · DOI · Paper page
  62. McKelvey B (1987) Organizational systematics: taxonomic lessons from biology. Manag Sci 24(13):1428–1440 · DOI · Paper page
  63. Moeini M, Rahrovani Y, Chan YE (2019) A review of the practical relevance of IS strategy scholarly research. J Strateg Inf Syst 28(2):196–217 · DOI
  64. Morana S, Pfeiffer J, Adam MTP (2020) User assistance for intelligent systems. Bus Inf Syst Eng 62(3):189–192 · DOI
  65. Mwilu OS, Prat N, Comyn-Wattiau I (2015) Taxonomy development for complex emerging technologies: the case of business intelligence and analytics on the cloud. In: Proceedings of the 19th Pacific Asia Conference on Information Systems, Singapore
  66. Nakatsu RT, Grossman EB, Iacovou CL (2014) A taxonomy of crowdsourcing based on task complexity. J Inf Sci 40(6):823–834 · DOI
  67. Niehaves B (2007) On epistemological pluralism in design science. Scand J Inf Syst 19(2):93–104
  68. Notheisen B, Willrich S, Diez M, Weinhardt C (2019) Requirement-driven taxonomy development: a classification of blockchain technologies for securities post-trading. In: Proceedings of the 52th Hawaii International Conference on System Sciences, Wailea · DOI
  69. Oberländer AM, Röglinger M, Rosemann M, Kees A (2018) Conceptualizing business-to-thing interactions: a sociomaterial perspective on the internet of things. Eur J Inf Syst 27(4):486–502 · DOI · Paper page
  70. Offermann P, Blom S, Schönherr M, Bub U (2010) Artifact types in information systems design science: a literature review. In: Proceedings of the 5th International Conference on Design Science Research in Information Systems and Technology, St. Gallen · DOI
  71. Ojala H, Penttinen E, Collis J, Virtanen TH (2018) Design principles for standard business reporting (sbr)taxonomy development: evidence from Finland. Nord J Bus 67(1):4–26
  72. Posey C, Raja U, Crossler RE, Burns AJ (2017) Taking stock of organisations’ protection of privacy: categorising and assessing threats to personally identifiable information in the USA. Eur J Inf Syst 26(7):585–604 · DOI
  73. Posey C, Roberts TL, Lowry PB, Bennett RJ, Courtney JF (2013) Insiders’ protection of organizational information assets: development of a systematics-based taxonomy and theory of diversity for protection-motivated behaviors. MIS Q 37(4):1189–1210 · DOI · Paper page
  74. Püschel L, Röglinger M, Schlott H (2016) What’s in a smart thing? Development of a multi-layer taxonomy. In: Proceedings of the 37th International Conference on Information Systems, Dublin
  75. Raza U, Ahmad W, Khan A (2018) Transformation from manufacturing process taxonomy to repair process taxonomy: a phenetic approach. J Ind Eng Int 14(2):415–428 · DOI
  76. Recker J (2013) Scientific research in information systems. Springer, Heidelberg · DOI · Paper page
  77. Sangupamba OM, Prat N, Comyn-Wattiau I (2014) Business intelligence and big data in the cloud: opportunities for design-science researchers. In: Indulska M and Purao S (eds) Advances in Conceptual Modeling. ER 2014. Springer, Cham, pp 75–84 · DOI
  78. Sarkintudu SM, Ibrahim HH, Abdwahab AB (2018) Taxonomy development of blockchain platforms: information systems perspectives. In: Proceedings of the 3rd International Conference on Applied Science and Technology, Georgetown · DOI
  79. Schäffer T, Stelzer D (2017) Towards a taxonomy for coordinating quality of master data in product information sharing. In: Proceedings of the 22nd MIT International Conference on Information Quality, Little Rock
  80. Schoormann T, Behrens D, Knackstedt R (2017) Sustainability in business process models: a taxonomy-driven approach to synthesize knowledge and structure the field. In: Proceedings of the 38th International Conference on Information Systems, Seoul
  81. Schöbel SM, Janson A, Söllner M (2020) Capturing the complexity of gamification elements: a holistic approach for analysing existing and deriving novel gamification designs. Eur J Inf Syst 29(6):641–668 · DOI
  82. Siering M, Clapham B, Engel O, Gomber P (2017) A taxonomy of financial market manipulations: establishing trust and market integrity in the financialized economy through automated fraud detection. J Inf Technol 32(3):251–269 · DOI
  83. Simon HA (1996) The sciences of the artificial. MIT Press, Cambridge
  84. Snow NM, Reck JL (2016) Developing a government reporting taxonomy. J Inf Syst 30(2):49–81
  85. Sokal RR, Sneath P (1963) Principles of numerical taxonomy. Freeman, San Francisco
  86. Sonnenberg C, vom Brocke J (2012) Evaluations in the science of the artificial: reconsidering the build-evaluate pattern in design science research. In: Proceedings of the 7th International Conference on Design Science Research in Information Systems and Technology, Las Vegas · DOI · Paper page
  87. Stachowiak H (1973) Allgemeine Modelltheorie. Springer, Wien · DOI · Paper page
  88. Sun Y, Kantor PB (2006) Cross-evaluation: a new model for information system evaluation. J Am Soc Inf Sci Technol 57(5):614–628 · DOI
  89. Szopinski D, Schoormann T, John T, Knackstedt R, Kundisch D (2019a) Software tools for business model innovation: current state and future challenges. Electron Mark 30:469–494 · DOI
  90. Szopinski D, Schoormann T, Kundisch D (2019b) Because your taxonomy is worth it: towards a framework for taxonomy evaluation. In: Proceedings of the 27th European Conference on Information Systems, Stockholm-Uppsala
  91. Szopinski D, Schoormann T, Kundisch D (2020) Visualize different: towards researching the fit between taxonomy visualizations and taxonomy tasks. In: Proceedings of the 15th International Conference on Wirtschaftsinformatik, Potsdam · DOI
  92. Terrenghi N, Schwarz N, Legner C (2018) Towards design elements to represent business models for cyber physical systems. In: Proceedings of the 26th European Conference on Information Systems, Portsmouth
  93. Thiebes S, Kleiber G, Sunyaev A (2017) Cancer genomics research in the cloud: a taxonomy of genome data sets. In: Proceedings of the 4th International Workshop on Genome Privacy and Security, Orlando
  94. Tilly R, Posegga O, Fischbach K, Schoder D (2017) Towards a conceptualization of data and information quality in social information systems. Bus Inf Syst Eng 59(1):3–21 · DOI
  95. Tönnissen S, Teuteberg F (2018) Towards a taxonomy for smart contracts. In: Proceedings of the 26th European Conference on Information Systems, Portsmouth
  96. Usman M, Britto R, Börstler J, Mendes E (2017) Taxonomies in software engineering: a systematic mapping study and a revised taxonomy development method. Inf Softw Technol 85:43–59 · DOI · Paper page
  97. Van de Ven AH, Johnson PE (2006) Knowledge for theory and practice. The Acad Manag Rev 31(4):802–821 · DOI · Paper page
  98. Varshney U (2014) Mobile health: four emerging themes of research. Decis Support Syst 66:20–35 · DOI · Paper page
  99. Varshney U, Nickerson RC, Muntermann J (2015) Towards the development of a taxonomic theory. In: Proceedings of the 21st Americas Conference on Information Systems, Fajardo
  100. Varshney U, Nickerson RC, Muntermann J (2017) Of taxonomies and taxonomic theories. In: Proceedings of the 23rd Americas Conference on Information Systems, Boston
  101. Venable J, Pries-Heje J, Baskerville R (2016) FEDS: a framework for evaluation in design science research. Eur J Inf Syst 25(1):77–89 · DOI · Paper page
  102. vom Brocke J, Maedche A (2019) The DSR grid: Six core dimensions for effectively planning and communicating design science research projects. Electron Mark 29(3):379–385 · DOI
  103. vom Brocke J, Winter R, Hevner A, Maedche A (2020) Accumulation and evolution of design knowledge knowledge in design science research: a journey through time and space. J Assoc Inf Syst 21(3):9–24
  104. Weking J, Hein A, Böhm M, Krcmar H (2018a) A hierarchical taxonomy of business model patterns. Electron Mark 30:447–468 · DOI
  105. Weking J, Stöcker M, Kowalkiewicz M, Böhm M, Krcmar H (2018b) Archetypes for Industry 4.0 business model innovations. In: Proceedings of the 24th Americas Conference on Information Systems, New Orleans
  106. Werder K, Wang H-Y (2016) Towards a software product industry classification. In: Proceedings of the 15th International Conference on Intelligent Software Methodologies, Tools and Techniques, Larnaca
  107. Whetten DA (1989) What constitutes a theoretical contribution? Acad Manag Rev 14(4):490–495 · DOI · Paper page
  108. Yang AT, Varshney U (2017) Categorizing mobile health project evaluation techniques. In: Proceedings of the 23rd Americas Conference on Information Systems, Boston
  109. Zrenner J, Hassan AP, Otto B, Marx Gómez JC (2017) Data source taxonomy for supply network structure visibility. In: Proceedings of the Hamburg International Conference of Logistics, Hamburg

Metadata

Authors
Kundisch, D., Muntermann, J., Oberländer, A. M., Rau, D., Röglinger, M., Schoormann, T., & Szopinski, D.
Venue
Business & Information Systems Engineering
Published
2021-10-22
Volume
64
Issue
4
Pages
421-439
ISSN
  • 1867-0202 (ISSN-L)
  • 2363-7005
OpenAlex
W3210313117
Cited by
166
References
15
FWCI
25.69
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
Universität Paderborn

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: An Update for Taxonomy Designers: Methodological Guidance from Information Systems Research. https://app.cochat.ai/papers/10.1007/s12599-021-00723-x
The paper
Kundisch, D., Muntermann, J., Oberländer, A. M., Rau, D., Röglinger, M., Schoormann, T., & Szopinski, D. (2022). An Update for Taxonomy Designers: Methodological Guidance from Information Systems Research. Business & Information Systems Engineering. https://doi.org/10.1007/s12599-021-00723-x

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.