Methods of AI for Multimodal Sensing and Action for Complex Situations
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) seeks to emulate human reasoning, but is still far from achieving such results for actionable sensing in complex situations. Instead of emulating human situation understanding, machines can amplify intelligence by accessing large amounts of data, filtering unimportant information, computing relevant context, and prioritizing results (for example, answers to human queries) to provide human‐machine shared context. Intelligence support can come from many contextual sources that augment data reasoning through physical, environmental, and social knowledge. We propose a decisions‐to‐data multimodal sensor and action through contextual agents (human or machine) that seek, combine, and make sense of relevant data. Decisions‐to‐data combines AI computational capabilities with human reasoning to manage data collections, perform data fusion, and assess complex situations (that is, context reasoning). Five areas of AI developments for context‐based AI that cover decisions‐to‐data include: (1) situation modeling (data at rest), (2) measurement control (data in motion), (3) statistical algorithms (data in collect), (4) software computing (data in transit), and (5) human‐machine AI (data in use). A decisions‐to‐data example is presented of a command‐guided swarm requiring contextual data analysis, systems‐level design, and user interaction for effective and efficient multimodal sensing and action.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084
Context-Enhanced Information Fusion: Boosting Real-World Performance with Domain Knowledge
(2016) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-28971-7 · Cited by 124
Self-citation
Cited by
The emergence of AI-based wearable sensors for digital health technology: a review
Shajari, S., Kuruvinashetti, K., Komeili, A., & Sundararaj, U. (2023) · Sensors · doi:10.3390/s23239498 · Cited by 535
“In addition, advanced signal processing techniques, coupled with AI models, can be applied to separate and extract relevant information from mixed signals [22].”
MethodMachine Learning/Artificial Intelligence for Sensor Data Fusion–Opportunities and Challenges
Blasch, E., Pham, T., Chong, C.-Y., Koch, W., Leung, H., Braines, D., & Abdelzaher, T. (2021) · IEEE Aerospace and Electronic Systems Magazine · doi:10.1109/maes.2020.3049030 · Cited by 207
Self-citationJoksimovic, S., Ifenthaler, D., Marrone, R., De Laat, M., & Siemens, G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100138 · Cited by 152
Artificial Intelligence and Data Fusion at the Edge
Munir, A., Blasch, E., Kwon, J., Kong, J., & Aved, A. (2021) · IEEE Aerospace and Electronic Systems Magazine · doi:10.1109/maes.2020.3043072 · Cited by 110
“The confluence of AI and data (e.g., image) fusion in CGS requires support from models, methods, and control [21].”
MethodSelf-citationWehrle, M., Birkel, H., von der Gracht, H. A., & Hartmann, E. (2022) · Journal of Purchasing and Supply Management · doi:10.1016/j.pursup.2021.100732 · Cited by 49
Wei, J., Qi, S., Wang, W., Jiang, L., Gao, H., Zhao, F., Al-Bukhaiti, K., & Wan, A. (2025) · Contemporary Mathematics · doi:10.37256/cm.6220256459 · Cited by 15
“Researchers commonly acknowledge that AI can gather large volumes of evidence regarding varied resources, streamline data allocation, in addition to it assist in construal, enhancing knowledge management in terms of efficiency and speed [88, 90, 95, 104].”
Influential
Metadata
- Authors
- Blasch, E., Cruise, R., Aved, A., Majumder, U., & Rovito, T.
- Venue
- AI Magazine
- Publisher
- Wiley
- Published
- 2019-12
- Volume
- 40
- Issue
- 4
- Pages
- 50-65
- ISSN
- 0738-4602 (ISSN-L)
- 2371-9621
- OpenAlex
- W2997584541
- Cited by
- 60
- References
- 2
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.