Attention schema in neural agents

“Attention modules are implemented as multi-head attention layers similar to the kind implemented by Transformers (Vaswani et al., 2017); they dynamically select information from the observation space or, in the case of hypotheses 2 and 4, from the output of the internal control module.”

“Transformers have particularly demonstrated how attention may be all we need , from sequence learning (Vaswani et al., 2017) to visual processing (Dosovitskiy et al., 2020) and time series forecasting (Lim et al., 2021).”

“In the last decade, the scope of attention mechanisms has grown from the first implementation in RNNSearch (Bahdanau et al., 2014) to the recent large-scale models currently dominating natural language processing and text-to-image generation (Santana & Colombini, 2021).”

“…of a representation, which makes it impossible for the representation of a stimulus to be bound to the information contained in its internal control (Treisman & Gelade, 1980) b) without attention, the representation of a stimulus has lower signal strength and is less likely to have an influence on…”

“The mask is generated from a pair of MLPs inspired by a neural activator and suppressor and followed by a Gumbel softmax to binarize the value pairs (Jang et al., 2017), where the activator and suppressor work together to generate a binary mask on attention scores, in which a ”1” indicates that the…”

“Transformers have particularly demonstrated how attention may be all we need , from sequence learning (Vaswani et al., 2017) to visual processing (Dosovitskiy et al., 2020) and time series forecasting (Lim et al., 2021).”

“…the state of other agents’ attention will also be useful for settings in which modeling opponents (Albrecht et al., 2017; He et al., 2016), value alignment (Fisac et al., 2020; Hadfield-Menell et al., 2016) and communication (OroojlooyJadid & Hajinezhad, 2021; Foerster et al., 2016) play a key role.”

“Shared central critics (Iqbal & Sha, 2019) and joint attention (Lee et al., 2021) have been shown to promote robust and scalable learning in complex environments.”

“…the state of other agents’ attention will also be useful for settings in which modeling opponents (Albrecht et al., 2017; He et al., 2016), value alignment (Fisac et al., 2020; Hadfield-Menell et al., 2016) and communication (OroojlooyJadid & Hajinezhad, 2021; Foerster et al., 2016) play a key role.”

“The five hypotheses were implemented using PyTorch (Paszke et al., 2019), and tested on two tasks from two different MARL benchmarks: the GhostRun environment (Jiang, 2019) and the Multi-Agent Particle environment (Mordatch & Abbeel, 2017).”

“…the state of other agents’ attention will also be useful for settings in which modeling opponents (Albrecht et al., 2017; He et al., 2016), value alignment (Fisac et al., 2020; Hadfield-Menell et al., 2016) and communication (OroojlooyJadid & Hajinezhad, 2021; Foerster et al., 2016) play a key role.”

“With the theory of mind, the agent generically attributes mental states to other agents, including their desires, beliefs, and intentions (Rabinowitz et al., 2018).”

“In humans, there is evidence of cases where attention unfolds without its internal control being active, but this seems to correlate with poorer performance (Graziano & Webb, 2015b).”

“…attention schema to infer the state of other agents’ attention will also be useful for settings in which modeling opponents (Albrecht et al., 2017; He et al., 2016), value alignment (Fisac et al., 2020; Hadfield-Menell et al., 2016) and communication (OroojlooyJadid & Hajinezhad, 2021; Foerster et…”

“…a descriptive and predictive model of attention (referred to as ”Internal Control” in Figure 1) could help the dynamical control of attention and therefore maximize the efficiency with which resources are strategically devoted to different elements of an ever-changing environment (Graziano, 2017).”

“In deep learning, attention can be understood as a dynamical control of information flow (Mittal et al., 2020).”

“Learning a rich and schematic model of one’s own attention will lead to better decision making, especially in contexts where there are many distractions and deep focus is hard to achieve (Stone et al., 2021).”

“The long-term plan is to test those architectures in richer environments, from simple 3D environments to photorealistic video game engines, and finally with robots (Bolotta & Dumas, 2022).”

“In fact, the performance of an artificial agent in solving a simple sensorimotor task has been shown to be greatly enhanced by a simple model of attention, but greatly reduced when such a model was not available (Wilterson & Graziano, 2021).”

“Using an attention schema to infer the state of other agents’ attention will also be useful for settings in which modeling opponents (Albrecht et al., 2017; He et al., 2016), value alignment (Fisac et al., 2020; Hadfield-Menell et al., 2016) and communication (OroojlooyJadid & Hajinezhad, 2021;…”

“Shared central critics (Iqbal & Sha, 2019) and joint attention (Lee et al., 2021) have been shown to promote robust and scalable learning in complex environments.”

“The second prediction is that an attention schema is also useful to model the attention of other agents —since the machinery that computes information about the attention of other people is the same machinery that computes information about our own attention (Graziano & Kastner, 2011).”