Towards a NeuroIS Research Methodology: Intensifying the Discussion on Methods, Tools, and Measurement
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The genesis of the Neuro-Information Systems (NeuroIS) field took place in 2007. Since then, a considerable number of IS scholars and academics from related disciplines have started to use theories, methods, and tools from neuroscience and psychophysiology to better understand human cognition, emotion, and behavior in IS contexts, and to develop neuro-adaptive information systems (i.e., systems that recognize the physiological state of the user and that adapt, based on that information, in real-time). However, because the NeuroIS field is still in a nascent stage, IS scholars need to become familiar with the methods, tools, and measurements that are used in neuroscience and psychophysiology. Against the background of the increased importance of methodological discussions in the NeuroIS field, the Journal of the Association for Information Systems published a special issue call for papers entitled “Methods, tools, and measurement in NeuroIS research” in 2012. We, the special issue’s guest editors, accepted three papers after a stringent review process, which appear in this special issue. In addition to these three papers, we hope to intensify the discussion on NeuroIS research methodology, and to this end we present the current paper. Importantly, our observations during the review process (particularly with respect to methodology) and our own reading of the literature and the scientific discourse during conferences served as input for this paper. Specifically, we argue that six factors, among others that will become evident in future discussions, are critical for a rigorous NeuroIS research methodology; namely, reliability, validity, sensitivity, diagnosticity, objectivity, and intrusiveness of a measurement instrument. NeuroIS researchers—independent from whether their role is editor, reviewer, or author—should carefully give thought to these factors. We hope that the discussion in this paper instigates future contributions to a growing understanding towards a NeuroIS research methodology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A QUANTITATIVE APPROACH TO CONTENT VALIDITY1
LAWSHE, C. H. (1975) · Personnel Psychology · doi:10.1111/j.1744-6570.1975.tb01393.x · Cited by 7,313
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
(2001) · doi:10.1017/cbo9780511546396 · Cited by 4,482
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165 · cited 3×
“In a paper on construct measurement, MacKenzie et al. (2011) write: [T] he definition should specify whether the construct refers to a thought (e.g., cognition …), a feeling (e.g., … emotion …), a perception (e.g., perceived ease of use of technology …), an action (e.g., behavior …), an outcome…”
BackgroundInfluentialValidation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
Organizational Theories: Some Criteria for Evaluation
Bacharach, S. B. (1989) · The Academy of Management Review · doi:10.5465/amr.1989.4308374 · Cited by 2,305
Combining IS Research Methods: Towards a Pluralist Methodology
Mingers, J. (2001) · Information Systems Research · doi:10.1287/isre.12.3.240.9709 · Cited by 1,380
Foley, P., & Kirschbaum, C. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2010.01.010 · Cited by 455 · cited 1×
“With respect to measuring the stress hormone cortisol, it is a well-established fact that cortisol levels measured in saliva are similar to free cortisol levels measured in blood and cortisol levels in the brain (e.g., r > 0.90 between saliva and blood, Foley & Kirschbaum, 2010).”
BackgroundInfluentialProblems with measuring peripheral oxytocin: can the data on oxytocin and human behavior be trusted?
McCullough, M. E., Churchland, P. S., & Mendez, A. J. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.04.018 · Cited by 416
Oxytocin: Behavioral Associations and Potential as a Salivary Biomarker
SUE CARTER, C., POURNAJAFI‐NAZARLOO, H., KRAMER, K. M., ZIEGLER, T. E., WHITE‐TRAUT, R., BELLO, D., & SCHWERTZ, D. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1384.006 · Cited by 323 · cited 1×
“As an example, oxytocin, a neuroactive substance related to trust (for a review, see Riedl & Javor, 2012), cannot be measured reliably in saliva (e.g., Carter et al., 2007; Horvat-Gordon, Granger, Schwartz, Nelson, & Kivlighan, 2005; McCullough, Churchland, & Mendez, 2013).”
Background
Cited by
The state of online impulse-buying research: A literature analysis
Chan, T. K. H., Cheung, C. M. K., & Lee, Z. W. Y. (2017) · Information & Management · doi:10.1016/j.im.2016.06.001 · Cited by 686
“…to assess the degree of impulsivity using neurophysiological methods such as electrodermal activity (a measure of the conducting properties of the skin), pulse plethysmography (a measure of blood flow used to infer heart rate), and electromyography (an electrical measure of muscle activation)[39].”
MethodTechnostress Research: A Nurturing Ground for Measurement Pluralism?
University of Applied Sciences Upper Austria, Fischer, T., Riedl, R., & University of Applied Sciences Upper Austria and University of Linz (2017) · Communications of the Association for Information Systems · doi:10.17705/1cais.04017 · Cited by 127
“This finding is, at least from an IS perspective, surprising due to the practical challenges related to collecting and analyzing the involved measures (e.g., high data-collection costs or required expertise to analyze data; Dimoka et al., 2012; Riedl et al., 2010; Riedl et al., 2014).”
Self-citationDesign Blueprint for Stress-Sensitive Adaptive Enterprise Systems
Adam, M. T. P., Gimpel, H., Maedche, A., & Riedl, R. (2017) · Business & Information Systems Engineering · doi:10.1007/s12599-016-0451-3 · Cited by 78
Self-citation
Metadata
- Authors
- University of Arkansas, Davis, F., Riedl, R., University of Applied Sciences Upper Austria, University of Linz, Hevner, A., & University of South Florida
- Venue
- Journal of the Association for Information Systems
- Publisher
- Association for Information Systems
- Published
- 2014-10
- Volume
- 15
- Issue
- 10
- Pages
- I-XXXV
- ISSN
- 1536-9323 (ISSN-L)
- OpenAlex
- W2789438204
- Cited by
- 169
- References
- 12
- FWCI
- 24.39
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.