How affordances of chatbots cross the chasm between social and traditional enterprise systems
Open accessThe DOI matches its Crossref record; the references it cites are not checked yet; 5 of the 122 sources its claims cite were checked for support.
Abstract
Digital and agile companies widely use chatbots in the form of integrations into enterprise messengers such as Slack and Microsoft Teams. However, there is a lack of empirical evidence about their action possibilities (i.e., affordances), for example, to link social interactions with third-party systems and processes. Therefore, we adopt a three-stage process. Grounded in a preliminary study and a qualitative study with 29 interviews from 17 organizations, we inductively derive rich contextual insights of 14 affordances and constraints, which serve as input for a Q-Methodology study that highlights five perceptional differences. We find that actualizing these affordances leads to higher-level affordances of chatbots that augment social information systems with affordances of traditional enterprise systems. Crossing the chasm between these, so far, detached systems contributes a novel perspective on how to balance novel digital with traditional systems, flexibility and malleability with stability and control, exploration with exploitation, and agility with discipline.
Overview
CoChat Summary
TL;DR
The paper inductively identifies 14 lower-level affordances and 14 constraints of chatbots in enterprise messengers and shows that actualizing them yields higher-level affordances that augment social information systems with traditional enterprise-system affordances. A Q-methodology study of 28 participants reveals five distinct viewpoints on chatbots, ranging from operational assistants to spammy process-enforcing burdens.
Key findings
- Across 29 interviews from 17 organizations, the authors derive 14 lower-level affordances and 14 constraints in four categories: receiving messages, getting/setting triggers, queries and invocations, and enriching messages.
- Actualizing these affordances produces higher-level affordances—such as consolidating communication flows, increasing ambient awareness, automating information/workflows, enforcing discipline, and relieving application switching—that let chatbots augment social information systems with traditional enterprise-system affordances: alignment, control, interoperability, and efficiency.
- The Q-methodology study yields five factors/viewpoints with eigenvalues greater than 1.00 and 67% cumulative variance: (1) operational assistant, (2) central information hub, (3) difficult-to-use black box and worse alternative to dedicated tools, (4) shadow IT in restrictive and closed legacy environments, and (5) spammy and process-enforcing burden.
- A preliminary crawl of the Slack App Directory collected 722 Slack apps and integrations in 2016; most were assigned to productivity (n = 223), social and fun (n = 188), communication (n = 157), developer tools (n = 146), and bots (n = 130).
Methods
- Three-stage design: a preliminary study crawled the Slack App Directory in October 2016 and again in December 2018 to examine material features and app categories.
- A qualitative study conducted 29 semi-structured interviews with employees from 17 organizations between May 2016–January 2017 and October–November 2018; analysis used open, axial, and selective coding, resulting in 1,613 codes.
- A Q-methodology study had 28 participants sort 28 statements (14 affordances and 14 constraints); analysis used principal components analysis with Varimax rotation and extracted five factors.
Limitations
- Stated: the qualitative and interpretive design means exhaustiveness cannot be guaranteed and no verified theory is provided; the focus on Slack may bias the identified affordances and constraints; interviewees were mainly based in Germany and Switzerland; and the use of theoretical sensitivity/affordance theory risks forcing the data and confirmation bias.
- Stated: Q-methodology uses non-random purposeful sampling, so inferences are only made about the viewpoints of the participating groups, not about the wider population or the distribution of viewpoints among respondents.
- Evident: the Q-study sample is 79% male and 21% female, and 96% of participants engage in digital work, which may limit transferability; the paper does not frame these sample characteristics as limitations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
















Verification
Claims the paper makes
4 Valid · 3 Not valid · 70 Not checked · 161 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In consequence, the interrelationship and the entanglement of traditional enterprise systems and social information systems remains, until now, unclear due to their complex dynamics (Limaj et al. 2016).”
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Introduction
What the sources say
- Partly supportedcites Limaj et al. 2016 sourceExperimental — accuracy not yet measured
The Introduction (p. 1) does support the 'unclear because of complex dynamics' element: it states that 'the impact of these technologies on organizations is rather unclear' and that 'a key aspect is the complex dynamics that arise from the combination of new features that these technologies bring and existing firm resources and capabilities'. However, the source frames the unclearness as the value/impact of SIS for absorptive capacity and innovation in SMEs, and the entanglement as being between new technological features and existing firm resources/capabilities — not, as the citing sentence puts it, the interrelationship of traditional enterprise systems with SIS (the paper only notes that SIS 'contribute differently to firm value creation than to traditional business information systems'). Additionally, the 'rather unclear' assessment is hedged and credited to Kane and Alavi (2014), whereas the citing sentence states it as the paper's own settled conclusion. (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In particular, when exploring affordances which technological artifacts provide, it proved a useful tool to systematically analyze the subjective perception of these artifacts (cf.Mettler et al. 2017;Mettler and Wulf 2018).”
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Phase 3: Q-methodology study
What the sources say
- Supportedcites Mettler et al. 2017 source
Section 4 (Method) states Q-methodology 'seeks to systematically explore subjectivity by measuring a person's viewpoints, opinions, attitudes' and is 'particularly suited to niche construction and the determination of perceived affordances related to service robots'. Section 6.1 (Implications for Research) reinforces this: 'We found Q-methodology to be a particularly suitable instrument for studying niche evolution ... allows for in-depth analyses of shared beliefs and perspectives in a specific technology and use domain', and the Introduction calls it 'specifically designed for studying the subjectivity of individuals'. The source's artefact is service robots, an instance of the claim's generalized 'technological artifacts', which the paper itself generalizes to IS research on technology affordances. (LLM, conf=0.90)
- Supportedcites Mettler and Wulf 2018 source
Our copy is a study that applies Q-methodology exactly in the way the citing sentence describes: the article's keywords (p. 1) pair 'Affordance theory' with 'Q-methodology' and 'user research', and the Research method table (p. 15, Step 1) sets out how the quantitative Q-sort data are interpreted systematically — reading each identified user group's statement scores and their distances to neighbouring factors — to derive the affordances and constraints users perceive. The Appendix 'Detailed Q-methodology results' (pp. 45-46) shows the full machinery behind it (concourse and Q-sample experts, 38 sorted statements, forced quasi-normal distribution, factor loadings, most/least agreeing and discordant items), i.e. a systematic analysis of employees' subjective viewpoints on a technological artifact (wearables/physiolytics). The paper does not utter an explicit meta-judgement that the method 'proved useful' and its application is to wearables rather than artifacts in general, but as an identifying/exemplifying citation the source is that thing. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“we have chosen to apply a mixed-method approach called Q-methodology, as it offers a rigorous and systematic way for capturing human subjectivity (Mettler and Wulf 2018;Stephenson 1935Stephenson , 1986)).”
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Phase 3: Q-methodology study
What the sources say
- Supportedcites Mettler and Wulf 2018 source
Our copy is itself a Q-methodology study of employees' perspectives, and its Research method section treats the approach as a defined, step-by-step procedure for capturing subjective viewpoints: the methodological-steps table (Section 3, pp. 14–15) lays out each step with a formal definition and its implementation (consensus-derived sample of statements, Q-sorting on cards, then interpretation of factor variance/statement scores of each identified user group), and p. 12 cites prior Q-methodology applications as the way to investigate users' attitudes and resistance. The Appendix (pp. 45–46) shows the statistical apparatus applied (standard error, correlations judged significant at the 0.05 level, fitted quasi-normal distribution). No sentence uses the exact words 'rigorous' or 'human subjectivity', so support rests on how the paper treats the method rather than a verbatim statement — appropriate for a background/identification citation. (LLM, conf=0.82)
- Not checked yetcites Stephenson 1935 source
- Not checked yetcites Stephenson 1986 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We find that a large share of available integrations is targeted at software developers.”
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Phase 1: Preliminary study
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“That is, different higher-level affordances and constraints emerge for members of a group channel as a consequence of the actualization of a lower-level affordance in this channel by a (potentially other) user.”
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Qualitative data analysis
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
99 more claims
Create a free account to see all 238 claims and to verify the 117 references still open.
- Probably not a substantial claim. 110
- It may state two separate claims as one. 52
- The quote only partly states this claim. 4
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Data collection
“In Phase 2b, we additionally employed card sorting of the emergent list of identified affordances (Fincher and Tenenberg 2005).Specifically, each identified affordance (i.e., 14 affordances across 4 categories) was printed on card”
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Having messages processed and replaced (AFF-13)
“Added after Phase 2b.0.86 avg.Q-Sort ranking (from +2 to -2) in Phase 3.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Conclusion and future research
“how the actualization of an affordance by one user may affect the affordance perception of other users (Fig. 8)”
§ How affordances of chatbots cross the chasm between social and traditional enterprise systems > Implications for theory
“Fig. 17 The actualization of an affordance by one user may facilitate its perception by another user”
Citations
The citation lists haven’t been fetched yet
References 201 · Cited by 55
Research works printed but not linked: 5
- Brouwer, M. (1999). Q is accounting for tastes. Journal of Advertising Research, 39(2), 35–35.
- Faulkner, P., & Runde, J. (2010). The social, the material, and the ontology of non-material technological objects. Working Paper. Retrieved March 22, 2018, from https://pdfs.semanticscholar.org/003b/e307e113faefcd74db9347cee6d4d3751a12.pdf
- Knight, W. (2016). Conversational Interfaces. MIT Technol. Rev., 119(2), 42–45.
- Schatsky, D., & Gratzke, P. (2016). The conversational enterprise - how chatbots can answer questions for both customers and employees. Deloitte: University Press.
- Van Exel, J., & De Graaf, G. (2005). Q methodology: A sneak preview. Retrieved November 11, 2018, from https://www.researchgate.net/publication/228574836_Q_Methodology_A_Sneak_Preview
Metadata
- Authors
- Stoeckli, E., Dremel, C., Uebernickel, F., & Brenner, W.
- Affiliations
- University of St.Gallen (CH)
- Corresponding author
- Stoeckli, Emanuel
- Venue
- Electronic Markets
- Published
- 2019-08-08
- Volume
- 30
- Issue
- 2
- Pages
- 369-403
- ISSN
- 1019-6781 (ISSN-L)
- 1422-8890
- OpenAlex
- W2967943711
- Cited by
- 55
- References
- 201
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 10 · 2023: 14 · 2022: 8 · 2021: 8 · 2020: 3 · 2019: 1
- FWCI
- 10.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Electronic Markets (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Alexandria (UniSG) (University of St.Gallen) (submittedVersion)
- Alexandria (UniSG) (University of St.Gallen) (submittedVersion, cc-by)
- Topics
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Business, Management and Accounting › Management Information Systems › Robotic Process Automation Applications
- Keywords
- chatbots, affordances, enterprise messaging, Slack, Microsoft Teams, social information systems, enterprise systems, system integration, Q methodology, perceptual differences, digital transformation, exploration and exploitation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How affordances of chatbots cross the chasm between social and traditional enterprise systems. https://app.cochat.ai/papers/10.1007/s12525-019-00359-6
- The paper
- Stoeckli, E., Dremel, C., Uebernickel, F., & Brenner, W. (2020). How affordances of chatbots cross the chasm between social and traditional enterprise systems. Electronic Markets. https://doi.org/10.1007/s12525-019-00359-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.