CoChat

Reactive Environments for Active Inference Agents with RxEnvironments.jl

Open access
Nuijten, Wouter W. L., de Vries, Bert · 2025 · Communications in computer and information science

The DOI matches its Crossref record; 26 of the 27 references it cites were found in a registry or an index; 12 of the 17 sources its claims cite were checked for support.

Abstract

Active Inference is a framework that emphasizes the interaction between agents and their environment. While the framework has seen significant advancements in the development of agents, the environmental models are often borrowed from reinforcement learning problems, which may not fully capture the complexity of multi-agent interactions or allow complex, conditional communication. This paper introduces Reactive Environments, a comprehensive paradigm that facilitates complex multi-agent communication. In this paradigm, both agents and environments are defined as entities encapsulated by boundaries with interfaces. This setup facilitates a robust framework for communication in nonequilibrium-Steady-State systems, allowing for complex interactions and information exchange. We present a Julia package RxEnvironments.jl, which is a specific implementation of Reactive Environments, where we utilize a Reactive Programming style for efficient implementation. The flexibility of this paradigm is demonstrated through its application to several complex, multi-agent environments. These case studies highlight the potential of Reactive Environments in modeling sophisticated systems of interacting agents.

Overview

CoChat Summary

TL;DR

The paper introduces Reactive Environments, a paradigm in which agents and environments are Entities with actuator/sensor boundaries and mutable subscriptions, and presents RxEnvironments.jl, a Julia implementation using reactive programming. It demonstrates the framework on Mountain Car, a 22-player football simulation, and a hearing-aid multi-entity setting.

Key findings

  • A Reactive Environment is defined as a pair \(E=(A,S)\), where \(A\) is a set of Entities and \(S\) is a mutable set of subscriptions \((A_1,A_2)\); each Entity responds reactively to sensory impulses and can emit data through actuators.
  • RxEnvironments.jl splits the classical transition function into `receive!` and `update!`, and exposes `emits` and `what_to_send` to control when and what an Entity emits; this natively supports multi-agent, multi-sensor, and conditional communication.
  • Case studies show: Mountain Car emits sensor information at 2 Hz and proprioceptive feedback on action; football models 22 player Entities plus a world Entity, with random run commands sent to a random player every 0.1 seconds; the hearing aid communicates with three subscribed entities—outside world, user, and phone agent.
  • Classical reinforcement learning environments can be written as particular cases of Reactive Environments.

Methods

  • Conceptual and implementation paper: defines Entity, boundary, subscriptions, and Reactive Environment, then implements the paradigm in the Julia package RxEnvironments.jl, based on the Rocket.jl reactive programming library.
  • No empirical dataset or benchmark is used; the framework is demonstrated through three case studies: Mountain Car, a football match simulation, and a hearing-aid environment.
  • Main analysis is implementation-level, describing functions such as `receive!`, `update!`, `emits`, and `what_to_send`, plus internal triggers for regular emission; an appendix gives a Bayesian Thermostat example.

Limitations

  • The paper states that the design of agents able to interact with a Reactive Environment still needs investigation, because fewer communication constraints require agents to have an internal clock, and the authors are not aware of any agent implementation built for this flexibility.
  • The paper states that the football case models only running and on-ball actions, not a comprehensive football environment with full rules and dynamics.
  • Evident from the text: evaluation is demonstrative case studies without quantitative performance metrics, benchmarks, or empirical comparisons of agent behavior.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/978-3-031-77138-5_10

Cites

26 of 27 references verified1 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

5 Valid · 7 Not valid · 2 Not checked · 21 Own results and interpretations

7 more claims

Create a free account to see all 35 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 20
  • It may state two separate claims as one. 7
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Citations

Cites

Show all 27 references

Research works printed but not linked: 1

  1. Hewitt, C., Bishop, P., Steiger, R.: Session 8 formalisms for artificial intelligence a universal modular actor formalism for artificial intelligence. In: Advance Papers of the Conference, vol. 3, p. 235. Stanford Research Institute, Menlo Park, CA (1973)

Metadata

Authors
Nuijten, W. W. L., & de Vries, B.
Affiliations
Eindhoven University of Technology (NL)
Corresponding author
Nuijten, Wouter W. L.
Venue
Communications in computer and information science
Published
2024-12-31
Pages
147-161
ISSN
  • 1865-0929 (ISSN-L)
  • 1865-0937
OpenAlex
W4405888531
Cited by
0
References
25
FWCI
0.00
Type
conference paper
Language
en
Open access
Licence
Locations
  • Communications in computer and information science (publishedVersion)
  • TU/e Research Portal (publishedVersion, other-oa)
  • arXiv (Cornell University) (submittedVersion)
  • TU/e Research Portal (submittedVersion, other-oa)
  • arXiv (Cornell University)
Funders
  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek
  • Ministerie van Economische Zaken en Klimaat
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords
active inference, reactive environments, multi-agent communication, agent-environment interaction, reactive programming, Julia package, nonequilibrium steady states

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-27, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-27 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Reactive Environments for Active Inference Agents with RxEnvironments.jl. https://app.cochat.ai/papers/10.1007/978-3-031-77138-5_10
The paper
Nuijten, W. W. L., & de Vries, B. (2025). Reactive Environments for Active Inference Agents with RxEnvironments.jl. Communications in computer and information science. https://doi.org/10.1007/978-3-031-77138-5_10

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.