Cited by 185Context-Aware Activity Recognition SystemsHuman-Automation Interaction and SafetyUsability and User Interface Design

Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction

Duric, Z., Gray, W.D., Heishman, R., Fayin Li, Rosenfeld, A., Schoelles, M.J., Schunn, C., Wechsler, H.·2002·Proceedings of the IEEE

Abstract

This paper describes technology and tools for intelligent human-computer interaction (IHCI) in which human cognitive, perceptual, motor and affective factors are modeled and used to adapt the H-C interface. IHCI emphasizes that human behavior encompasses both apparent human behavior and the hidden mental state behind behavioral performance. IHCI expands on the interpretation of human activities, known as W4 (what, where, when, who). While W4 only addresses the apparent perceptual aspect of human behavior the W5+ technology for IHCI described in this paper addresses also the why and how questions, whose solution requires recognizing specific cognitive states. IHCI integrates parsing and interpretation of nonverbal information with a computational cognitive model of the user which, in turn, feeds into processes that adapt the interface to enhance operator performance and provide for rational decision-making. The technology proposed is based on a general four-stage interactive framework, which moves from parsing the raw sensory-motor input, to interpreting the user's motions and emotions, to building an understanding of the user's current cognitive state. It then diagnoses various problems in the situation and adapts the interface appropriately. The interactive component of the system improves processing at each stage. Examples of perceptual, behavioral, and cognitive tools are described throughout the paper Adaptive and intelligent HCI are important for novel applications of computing, including ubiquitous and human-centered computing.

Integrity signals

Registry

Crossref · 10.1109/jproc.2002.801449

Cites

106 of 106 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Duric, Z., Gray, W. D., Heishman, R., Li, F., Rosenfeld, A., Schoelles, M. J., Schunn, C., & Wechsler, H.
Affiliations
  • George Mason University (US)
  • Rensselaer Polytechnic Institute (US)
  • University of Maryland, College Park (US)
  • University of Pittsburgh (US)
Venue
Proceedings of the IEEE
Published
2002-07
Volume
90
Issue
7
Pages
1272-1289
ISSN
0018-9219 (ISSN-L)
OpenAlex
W2096214539
Cited by
185
References
106
Citations by year
2026: 9 · 2025: 12 · 2024: 13 · 2023: 11 · 2022: 8 · 2021: 17 · 2020: 10 · 2019: 5 · 2018: 3 · 2017: 8 · 2016: 7 · 2015: 11 · 2014: 10 · 2013: 5 · 2012: 4
FWCI
2.63
Type
journal article
Language
en
Open access
closed
Locations
  • Proceedings of the IEEE (publishedVersion)
  • D-Scholarship@Pitt (University of Pittsburgh) (acceptedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
  • Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
intelligent human-computer interaction, adaptive user interfaces, cognitive modeling, perceptual modeling, emotion recognition, cognitive state recognition, user modeling, interface adaptation, operator performance, ubiquitous computing, human-centered computing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review