The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index; 7 of the 56 sources its claims cite were checked for support.
Study of Multimodal Interfaces and the Improvements on Teleoperation
Open accessAbstract
Research in multimodal interfaces aims to provide immersive solutions and to increase overall human performance. A promising direction is to combine auditory, visual and haptic interaction between the user and the simulated environment. However, no extensive comparison exists to show how combining audiovisuohaptic interfaces would affect human perception and by extent reflected on task performance. Our paper explores this idea and presents a thorough, full-factorial comparison of how all combinations of audio, visual and haptic interfaces affect performance during manipulation. We evaluated how each combination affects the performance in a study (N=25 ) consisting of manipulation tasks with various difficulties. The overall performance was assessed using both subjective measures, by assessing cognitive workload and system usability, and objective measurements, by incorporating time and spatial accuracy-based metrics. The results showed that regardless of task complexity, the combination of stereoscopic-vision with the virtual reality headset increased performance across all measurements by 40%, compared to monocular-vision from a generic display monitor. Besides, using haptic feedback improved outcomes by 10% and auditory feedback accounted for approximately 5% improvement.
Overview
CoChat Summary
## TL;DR
This paper reports a full-factorial study of 8 multimodal teleoperation interface conditions across 25 participants performing pick-and-place manipulation tasks of varying difficulty. The strongest performance gains came from stereoscopic VRHMD vision, with additional benefits from haptic feedback and only limited effects from auditory feedback.
## Key findings
- Across subjective and objective measures, stereoscopic VRHMD vision outperformed the monocular monitor; the paper reports an overall performance increase of around 40% with VRHMD compared to the monitor.
- Adding somatosensory (haptic) feedback improved outcomes by a further 10% overall, but this benefit was significant mainly when paired with stereoscopic vision.
- Auditory feedback had no significant effect on most measures; the paper reports only an approximately 5% improvement in spatial accuracy.
- For task success rate, the stereoscopic conditions (C5–C8) achieved 96.22%, 99.11%, 96.22%, and 97.55%, versus 39.33%, 47.55%, 51.33%, and 48.22% for the monocular conditions (C1–C4).
- For workload and usability, the paper reports strong condition effects: perceived workload F(2.393, 57.437)=70.473, p<0.001, ηp²=0.746 and SUS usability F(3.930, 94.310)=97.064, p<0.001, ηp²=0.802.
## Methods
- Full-factorial repeated-measures experiment with 8 interface conditions combining vision (monitor vs VRHMD), audio (off/on), and haptics (off/on), tested on a pick-and-place task in a virtual environment.
- Sample: 25 participants from the University of Edinburgh, ages 21–44 (mean 26.36, SD 4.829), with 6 females and 19 males.
- Main analyses used RM-ANOVA for normally distributed data, ART + RM-ANOVA for ordinal questionnaire data, Friedman/Wilcoxon for nonparametric time metrics, and a three-sigma rule for Bernoulli success proportions.
## Limitations
- The paper states it did not test how auditory or somatosensory feedback might compensate for overloaded visual information.
- The paper states it did not explicitly and strictly investigate monocular vs stereoscopic visual feedback by themselves.
- Evident from the text: the study uses a static scenario and the authors note that conclusions about vection and motion sickness cannot be fully drawn from it, which may limit generalization to navigation or more dynamic teleoperation tasks.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

















Verification
Claims the paper makes
6 Valid · 2 Not valid · 33 Not checked · 57 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“constantly providing feedback can be counterproductive both in user preference and time ef ciency, compared to the feedback at the end of a task [23].”
What the sources say
- Supportedcites [23] [23] X. Shang, M. Kallmann, and A. S. Arif, ''Effects of correctness and suggestive feedback on learning with an autonomous virtual trainer,'' in Proc. 24th Int. Conf. Intell. User Interface Companion (IUI) , New York, NY, USA, 2019, pp. 93 94, doi: 10.1145/3308557.3308675. - source
The paper defines SF as continuously providing clues/suggestions during the task and CF as informing users about performance only at the end of a task (Introduction, Sec. 1). Its Results (Sec. 3) report SF took 559 s vs 339 s for CF (65% longer) with no significant learning-outcome difference, and that more participants cited CF as preferable and more effective; the Abstract and Conclusions state CF 'received higher preference and led to shorter task completion time'. This matches the hedged claim that continuous feedback can be less preferable and less time-efficient than end-of-task feedback. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Supplementing vision with auditory information can increase operator's awareness, especially during high visual load [2], [26].”
What the sources say
- Partly supportedcites [2] [2] R. Sigrist, G. Rauter, R. Riener, and P. Wolf, ''Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review,'' Psychonomic Bull. Rev. , vol. 20, no. 1, pp. 21 53, Feb. 2013, doi: 10.3758/s13423012-0333-8. - sourceExperimental — accuracy not yet measured
In “Audiovisual feedback enhances perception,” the review says distributing information across vision and hearing is appropriate in navigation tasks where vision is highly loaded, and reports improved flight or driving performance. It does not establish increased operator awareness; it also reports that audiovisual feedback can be detrimental in tasks with high overall workload. (LLM, conf=0.84)
- Not matchedcites [26] [26] R. D. Shilling and B. Shinn-Cunningham, ''Virtual auditory displays,'' in Handbook Virtual Environments . Boca Raton, FL, USA: CRC Press, 2002, pp. 105 132. <!-- image --> IEEEAccess" -
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“These results provide evidence to the untested hypothesis of [2].”
What the sources say
- Supportedcites [2] [2] R. Sigrist, G. Rauter, R. Riener, and P. Wolf, ''Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review,'' Psychonomic Bull. Rev. , vol. 20, no. 1, pp. 21 53, Feb. 2013, doi: 10.3758/s13423012-0333-8. - source
In “Multimodal feedback is promising” (page unavailable), Sigrist et al. explicitly hypothesize that augmented multimodal feedback is more efficient than unimodal feedback for motor learning. They also state that some multimodal combinations had not yet been investigated. The citing authors’ assessment of their own results is not a claim the cited review can verify. (LLM, conf=0.89)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“point-based haptic devices and moreover auditory feedback did not signi cantly contribute to the improvement of task performance.”
What the sources say
- Supportedcites [45] [45] E. Frid, J. Moll, R. Bresin, and E.-L. Salln s Pysander, ''Haptic feedback combined with movement soni cation using a friction sound improves task performance in a virtual throwing task,'' J. Multimodal User Interface , vol. 13, no. 4, pp. 279 290, Dec. 2019, doi: 10.1007/s12193-0180264-4. - source
The Conclusions (p. 7) state the two attributed points directly for a virtual throwing task performed with a point-based haptic device: haptic feedback in general could not be concluded to significantly improve task performance, and 'moreover, the addition of auditory feedback alone could not be shown to significantly improve task performance.' The Discussion (Sect. 6) and Sect. 5.2 corroborate this (hypothesis H2 rejected; quantitative results did not confirm that haptic feedback improved performance), and the Abstract/Experimental design confirm the point-based device and the throwing-task population/setting. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Preliminary ndings indicate that force feedback is only more bene cial than vibrotactile stimulation when presented at a high-resolution [42], [56].”
What the sources say
- Not checked — no full text of the sourcecites [42] [42] C. C. Berger, M. Gonzalez-Franco, E. Ofek, and K. Hinckley, ''The uncanny valley of haptics,'' Sci. Robot. , vol. 3, no. 17, Apr. 2018, Art. no. eaar7010. - source
- Supportedcites [56] [56] B. Weber, M. Sagardia, T. Hulin, and C. Preusche, ''Visual, vibrotactile, and force feedback of collisions in virtual environments: Effects on performance, mental workload and spatial orientation,'' in Virtual Augmented Mixed Reality. Designing Developing Augmented Virtual Environments , R. Shumaker, Ed. Berlin, Germany: Springer, 2013, pp. 241 250. - source
The Discussion (Section 5) states that 'the force feedback system with a light weight robot as input device and high resolution 6 DoF force feedback is superior in terms of precision compared to the vibrotactile and visual feedback systems,' explicitly binding the advantage to a high-resolution force-feedback implementation. The same section adds the converse condition: 'Vibrotactile devices could be a reasonable alternative if high resolution of haptic information is not critical,' which supports the claim's 'only ... at high resolution' framing. Subjective data in the Discussion likewise rate mental workload lower and usability/spatial orientation higher for force feedback, so 'more beneficial' is a fair paraphrase of the paper's precision-plus-workload result; the paper's own superiority statement is scoped to its assembly (peg-in-hole / narrow passage) paradigm, consistent with the citing sentence's 'preliminary findings' hedge. (LLM, conf=0.80)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
60 more claims
Create a free account to see all 98 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 20
- Probably not a substantial claim. 17
- The quote only partly states this claim. 1
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · cited 3×
“We first measured cognitive workload for each interface condition through the use of the multidimensional assessment tool questionnaire NASA-Task Load Index, simply known as NASA-TLX [62].”
MethodSUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
The use of ranks to avoid the assumption of normality implicit in the analysis of variance
Friedman, M. (1937) · Journal of the American Statistical Association · doi:10.1080/01621459.1937.10503522 · Cited by 7,005 · cited 1×
“For nonparametric continuous data, a Friedman’s test, similar to the RM-ANOVA, was used to test for significance across the eight interface conditions [66], and Wilcoxon signedrank tests for post-hoc analysis for the pairwise comparison across the interface conditions.”
MethodThe Uncanny Valley [From the Field]
Mori, M., MacDorman, K., & Kageki, N. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2192811 · Cited by 3,542 · cited 1×
“called ‘‘Uncanny Valley’’ – a break in immersion when an artificial being appears too realistic, causing negative responses towards it [49].”
BackgroundThe aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854 · cited 5×
“For the perceived system usability, an ART was used to allow the use of parametric tests on ordinal data.”
MethodInfluentialMeasuring and defining the experience of immersion in games
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., & Walton, A. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.04.004 · Cited by 2,065 · cited 1×
“This can lead to improved performance when controlling another body in a remote environment [2], [3], and increasing immersion is known to increase the performance [4]–[6].”
BackgroundIs neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463 · cited 1×
“Neuroimaging studies support this concept, showing that visual and haptic activation overlaps in the occipital lobe [50]–[53].”
BackgroundAugmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
Depth of Presence in Virtual Environments
Slater, M., Usoh, M., & Steed, A. (1994) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.1994.3.2.130 · Cited by 1,342 · cited 1×
“We implemented both measurements to compensate for the inherent drawbacks of exclusively using questionnaires [60], [61].”
MethodPukelsheim, F. (1994) · The American Statistician · doi:10.2307/2684253 · Cited by 1,242
Research works printed but not linked: 3
- simpson, 2013, Spatial audio display concepts supporting situation awareness for operators of unmanned aerial vehicles, Human Performance Situation Awareness and Automation Current Research and Trends, 2, 61
- richard, 1994, A comparison of haptic, visual and auditive force feedback for deformable virtual objects, Proc Internation Conf Autom Technol (ICAT), 49, 62
- aleotti, 2002, A Multi-modal User Interface for Remote Object Exploration in Teleopera-tion Systems
Cited by
Teleoperation methods and enhancement techniques for mobile robots: A comprehensive survey
Moniruzzaman, M., Rassau, A., Chai, D., & Islam, S. M. S. (2022) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2021.103973 · Cited by 177
A Review of Human–Machine Cooperation in the Robotics Domain
Yang, C., Zhu, Y., & Chen, Y. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3131684 · Cited by 128
A review on manipulation skill acquisition through teleoperation‐based learning from demonstration
Si, W., Wang, N., & Yang, C. (2021) · Cognitive Computation and Systems · doi:10.1049/ccs2.12005 · Cited by 140
“Extensive comparisons [30] have been done to show that regardless of task complexity, using multimodal interface could improve the performance.”
BackgroundInfluentialTechnologies for Multimodal Interaction in Extended Reality—A Scoping Review
Rakkolainen, I., Farooq, A., Kangas, J. A., Hakulinen, J., Rantala, J., Turunen, M., & Raisamo, R. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti5120081 · Cited by 136
“Finally, multimodal solutions can increase the level of immersion [228,229] and sometimes also task performance [229,230].”
BackgroundVibrotactile feedback in virtual motor learning: A systematic review
Islam, M. S., & Lim, S. I. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103694 · Cited by 119
Multimodal Interaction, Interfaces, and Communication: A Survey
Dritsas, E., Τρίγκα, Μ., Troussas, C., & Phivos Mylonas, B. (2025) · Multimodal Technologies and Interaction · doi:10.3390/mti9010006 · Cited by 126
“Haptic feedback, often in the form of vibrations or force resistance, enhances the physicality of interaction, especially in AR/VR systems [38–40].”
Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays
Shen, V., Rae-Grant, T., Mullenbach, J., Harrison, C., & Shultz, C. D. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606771 · Cited by 120
Su, Y., Chen, X., Zhou, C., Pearson, L. H., Pretty, C. G., & Chase, J. G. (2023) · Applied Sciences · doi:10.3390/app132212129 · Cited by 63
The Challenges in Modeling Human Performance in 3D Space with Fitts’ Law
Triantafyllidis, E., & Li, Z. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3443442 · Cited by 59
“However, use cases encompassing teleoperation and in general simulation training of operators, heavily depend upon as close to real physics as possible [45, 82].”
BackgroundResultInfluentialSelf-citationHuman-Multirobot Collaborative Mobile Manipulation: The Omnid Mocobots
Elwin, M. L., Strong, B., Freeman, R. A., & Lynch, K. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3226366 · Cited by 43
Su, Y., Chen, X., Zhou, T., Pretty, C. G., & Chase, J. G. (2022) · Applied Sciences · doi:10.3390/app12094740 · Cited by 49
Triantafyllidis, E., Acero, F., Liu, Z., & Li, Z. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00709-2 · Cited by 67
“Essentially, successful sequential manipulation is achieved when (1) high-level skills are satisfied, (2) sensory events are predicted, (3) the end goals are known and (4) the sequences of different skills are conceptualized in our minds and more broadly by our nervous system(3,9).”
BackgroundMethodSelf-citationSu, Y., Chen, X., Zhou, T., et al. (2021) · Applied Sciences · doi:10.3390/app112311280 · Cited by 39
“The Greenhouse–Geisser correction was applied to assess the difference in the welder reports of the baseline, MRnoVF, and MRVF modules as within-subject variables [51].”
Robotic disassembly of electric vehicle batteries: Technologies and opportunities
Zang, Y., Qu, M., Pham, D. T., Dixon, R., Goli, F., Zhang, Y., & Wang, Y. (2024) · Computers & Industrial Engineering · doi:10.1016/j.cie.2024.110727 · Cited by 36
Wolf, C. D., Byers, B. S., Raghu, D., Gordon, M., Schwarzkopf, V., & Triantafyllidis, E. (2024) · npj Materials Sustainability · doi:10.1038/s44296-024-00034-8 · Cited by 49
“The case studies are described in Table 3 and the integrated learnings from each implemented action are synthesised in “ Results ” .”
BackgroundSelf-citationLazaro, M. J., Lee, J., Chun, J., Yun, M. H., & Kim, S. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103842 · Cited by 29
Vizcay, S., Kourtesis, P., Argelaguet, F., Pacchierotti, C., & Marchal, M. (2023) · Computers & Graphics · doi:10.1016/j.cag.2023.01.013 · Cited by 29
“4 Visual feedback is particularly important for contact accuracy 5 and precision [3].”
InfluentialLenz, C., Schwarz, M., Rochow, A., et al. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01050-9 · Cited by 21
“The benefits of stereoscopic vision itself for teleoperation have been shown before, e.g. by Triantafyllidis et al. [53].”
Tao, K., Lei, J., & Huang, J. (2024) · Wireless Personal Communications · doi:10.1007/s11277-024-11108-0 · Cited by 20
RetractedMahmud, M. R., Cordova, A., & Quarles, J. P. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3320244 · Cited by 27
“Moreover, different feedback modalities (audio, visual, and haptic) provided different results in VR [59].”
BackgroundVanichvoranun, N., Lee, H., Kim, S., & Yoon, S. H. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678567 · Cited by 21
Performance evaluation of a tactile and kinesthetic finger feedback system for teleoperation
Park, S., Park, Y., & Bae, J. (2022) · Mechatronics · doi:10.1016/j.mechatronics.2022.102898 · Cited by 18
Brain functional connectivity under teleoperation latency: a fNIRS study
Yang, Y., Zhou, T., Zhu, Q., Vann, W., & Du, J. (2024) · Frontiers in Neuroscience · doi:10.3389/fnins.2024.1416719 · Cited by 17
“Unlike other methods that rely on automation and adaptive algorithms, multi-sensory control leverages sensory information to enhance the operator’s subjective experience (Triantafyllidis et al., 2020; Toet et al., 2020), thus facilitating human adaptation to time-delayed teleoperation.”
Lin, T.-C., Krishnan, A. U., & Li, Z. (2023) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2023.3287039 · Cited by 13
“These motion tracking interfaces include various motion capture systems (vision-based [5] vs IMU-based [6]), stylus/joysticks [7], exoskeletons (soft [8] and rigid [9], passive [10] vs actuated [11]), virtual reality systems (hand-held controllers [2]), and the custom integration of multimodal control interfaces [12].”
BackgroundSelf-citationRodrigues, P. B., Becerik-Gerber, B., Soibelman, L., Lucas, G., & Roll, S. C. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105876 · Cited by 13
Kim, S., Hernandez, I., Nussbaum, M. A., & Lim, S. I. (2024) · IISE Transactions on Occupational Ergonomics and Human Factors · doi:10.1080/24725838.2024.2310301 · Cited by 19
“…these and related challenges, resulting in substantial advances in areas such as human-robot interfaces (Pacchierotti et al., 2014; Rastogi, 1997; Triantafyllidis et al., 2020), control algorithms (Kebria et al., 2020; Liu & Chopra, 2013; Polushin et al., 2007), and robot learning mechanisms…”
BackgroundThe human-factors’ challenges of (tele)drivers of Autonomous Vehicles
Meir, A., Grimberg, E., & Musicant, O. (2024) · Ergonomics · doi:10.1080/00140139.2024.2346552 · Cited by 18
“Multimodal and multisensory interfaces may improve performance in complex manipulation tasks (Triantafyllidis et al. 2020).”
Effects of interface design and spatial ability on teleoperation cognitive load and task performance
Fang, H., Hu, Y., Chen, S., Yang, X., Zhao, Y., Niu, H., & Cai, C. (2025) · Displays · doi:10.1016/j.displa.2025.102977 · Cited by 16
Chilo, N. O. M., Ccari, L. F. C., Supo, E., Espinoza, E. S., Vidal, Y. S., & Pari, L. (2023) · IEEE Access · doi:10.1109/access.2023.3240973 · Cited by 11
“in the manner of an avatar to complete various tasks [1].”
BackgroundMethodLou, X., Song, X., Hu, X., Ma, M., Fu, L., Zhuang, X., & Fan, X. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2443708 · Cited by 10
“However, in both real and virtual environments, rotation plays a crucial role in pointing and manipulation tasks (Batmaz et al., 2023; Kulik et al., 2020; Triantafyllidis et al., 2020; Ullah et al., 2023).”
A Review of Multimodal Interaction in Intelligent Systems
Lazaro, M. J., Kim, S., Lee, J. Y., Chun, J., Kim, G., Yang, E.-J., Bilyalova, A., & Yun, M. H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78462-1_15 · Cited by 9
Do multimodal search cues help or hinder teleoperated search and rescue missions?
Arend, M. G., Benz, T., Mertens, A., Brandl, C., & Nitsch, V. (2022) · Ergonomics · doi:10.1080/00140139.2022.2144646 · Cited by 10
“To account for potential outliers, minimal truncation of 0.1% on the left and right tail was applied (based on Ulrich and Miller 1994), resulting in a final sample of N T ¼ 5,815 cornering times, whose distribution was positively skewed ( SK ¼ 2.57).”
MethodInfluentialThe impact of data sonification in virtual reality robot teleoperation
Bremner, P., Mitchell, T. J., & McIntosh, V. (2022) · Frontiers in Virtual Reality · doi:10.3389/frvir.2022.904720 · Cited by 14
Envisioning Telepresence Robots for Long Covid: A Critical Disability Lens
Ghosh, P., Haripriyan, A., Chow, A., Redfield, S., & Riek, L. D. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3758101 · Cited by 8
Evaluating Visual-Spatiotemporal Co-Registration of a Physics-Based Virtual Reality Haptic Interface
Chowdhury, S., Mubarrat, S. T., Fernandes, A., & Binkley, K. (2024) · IEEE Access · doi:10.1109/access.2024.3391186 · Cited by 8
“…felt by a human when they interact with their environment—has been shown to enhance the experience, motor performance, and motor learning of the users in both industrial [9], [10], [11], [12] and rehabilitation applications, improving motor skills performance and motor rehabilitation [13].”
BackgroundLin, Z., & Chen, C. (2023) · Displays · doi:10.1016/j.displa.2023.102516 · Cited by 11
System Usability Scale: A Meta-Analysis of How SUS Relates to Workload, Task Time, and Error Rate
Hertzum, M. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2625260 · Cited by 19
“For example, Triantafyllidis et al. (2020) compared a virtual reality head-mounted display (extended with audio and haptic feedback) with a computer monitor (extended with audio but not haptic feedback) for teleoperating a robotic hand.”
Hossain, S., Yin, A., & Ferris, T. K. (2025) · Safety · doi:10.3390/safety11010026 · Cited by 7
Triantafyllidis, E., Hu, W., McGreavy, C., & Li, Z. (2021) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2021.3090070 · Cited by 11
“The re-targeting approach was similar to the work in [14], where the joint positions of the user’s fingers were obtained by calculating the angle θ between a joint −−→ bi−1 and its parent joint − → bi .”
BackgroundMethodResultInfluentialSelf-citationWolf, C. D., Byers, B. S., Raghu, D., Gordon, M., Schwarzkopf, V., & Triantafyllidis, E. (2024) · Research Square · doi:10.21203/rs.3.rs-4349460/v1 · Cited by 6
Self-citationImmersive Robot Teleoperation Based on User Gestures in Mixed Reality Space
Esaki, H., & Sekiyama, K. (2024) · Italian National Conference on Sensors · doi:10.3390/s24155073 · Cited by 6
“Triantafyllidis et al., also researched multimodal interfaces for teleoperation, contributing to improved operability [22].”
BackgroundHaptic Bimanual System for Teleoperation of Time-Delayed Tasks
Sena, A., Rouxel, Q., Ivanova, E., Burdet, E., & Li, Z. (2021) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio54168.2021.9739628 · Cited by 5
“More recent research on teleoperated systems, especially for space missions, have further developed in the core areas of intuitive interfaces [5], autonomy, force control [6] and stability of control systems [7], [8].”
BackgroundSelf-citationPractical Considerations for Deploying Robot Teleoperation in Therapy and Telehealth
Elbeleidy, S., Mott, T., Liu, D., & Williams, T. (2022) · IEEE RO-MAN · doi:10.1109/ro-man53752.2022.9900526 · Cited by 6
“Modern teleoperation tools include Virtual and Augmented Reality interfaces [34]–[36], interfaces that rely on haptics [37], and wearable interfaces [38].”
BackgroundA Haptic Multimodal Interface with Abstract Controls for Semi-Autonomous Manipulation
Stoddard, B., Cravetz, M., Player, T. R., & Knight, H. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889349 · Cited by 5
“Another study found that the inclusion of audio and haptic cues improved performance on a low-level telemanipulation task [7].”
BackgroundInvestor decision making: an investigation of the modality effect
McAvoy, J. M., Creed, A., Cotter, A., Merriman, L., O’Reilly, P., Dempsey, M., & Brennan, A. (2022) · Journal of Decision System · doi:10.1080/12460125.2021.2023256 · Cited by 6
“(2002) suggest that multimodal humancomputer interaction can improve the flow of information between the user and computer systems, with some arguing that reliance on a single modality is a disadvantage(Triantafyllidis et al., 2020).”
BackgroundDuan, S., Pace, F. D., Sanches, F. P., Jiang, H., & Liarokapis, M. V. (2024) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids58906.2024.10769787 · Cited by 4
Lazaro, M. J., & Kim, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650874 · Cited by 3
“Some studies suggest that MMI may not always outperform unimodal interactions [32, 33] and may even increase workload or the likelihood of error if not properly implemented [7, 19, 20].”
Effects of Augmented Feedback and Motor Learning Adaptation on Human–Automation Interaction Factors
O’Meara, S., Karasinski, J. A., Miller, C. L., Joshi, S. S., & Robinson, S. K. (2021) · Journal of Aerospace Information Systems · doi:10.2514/1.i010915 · Cited by 4
Blank, A., Kosar, E., Karlidag, E., Guo, Q., Kohn, S., Sommer, O., Wälter, J., Herbert, M., Seßner, J., Querfurth, F., et al. (2021) · Procedia Manufacturing · doi:10.1016/j.promfg.2021.10.007 · Cited by 4
Kuitert, S., Hofland, J., Heemskerk, C. J. M., Abbink, D. A., & Peternel, L. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341733 · Cited by 7
Enhancing Emergency Response: The Critical Role of Interface Design in Mining Emergency Robots
Bakzadeh, R., Joao, K. M., Androulakis, V., Khaniani, H., Shao, S., Hassanalian, M., & Roghanchi, P. (2025) · Robotics · doi:10.3390/robotics14110148 · Cited by 8
“Some may respond more effectively to visual signals, while others benefit from auditory or haptic cues [62].”
Bolarinwa, J., Eimontaite, I., Mitchell, T., Dogramadzi, S., & Caleb-Solly, P. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.578596 · Cited by 3
“Triantafyllidis et al. (2020) assessed how multimodal interfaces (audio, haptic, and visual feedback) can improve teleoperation by subjectively measuring the cognitive workload across the different feedback modalities.”
BackgroundExploring the impact of feedback timing on student performance in online testing
Ding, G., Li, M., Li, S., & Wu, H. (2024) · Asia Pacific Education Review · doi:10.1007/s12564-024-10024-z · Cited by 4
“Additionally, Triantafyllidis et al. (2020) found that continuous feedback tends to be less effective than feedback provided at the end of a task, especially for tasks of diverse difficulty levels, which may influence user preferences and time efficiency.”
Robot Teleoperation via Virtual Reality: A Unity and ROS Approach
Hernandez, M. N., Ramos, B. H., Simoni, R., et al. (2024) · International Conference on Automation, Robotics and Computer Engineering (ICARCE) · doi:10.1109/icarce63054.2024.00012 · Cited by 3
“While VR represents a significant advancement in bringing operations closer to reality and achieving the necessary precision for some tasks, there are still gaps that limit its application, such as delays, inconsistent movements, sensory discrepancies, and other issues [8, 9].”
Analysis of the Intuitive Teleoperated System of the TxRob Multimodal Robot
Jeyson Carpio, A., Samuel Luque, C., Juan Chambi, C., & Suarez, J. T. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0131093 · Cited by 3
“According to [11], the combination of different tools such as stereo vision, haptic feedback and auditory feedback increases the manipulation performance of a robotic system.”
BackgroundThe Role of Audio Feedback and Gamification Elements for Remote Boom Operation
Burova, A., Mäkelä, J., Keskinen, T., Kallioniemi, P., Ronkainen, K., & Turunen, M. (2024) · Multimodal Technologies and Interaction · doi:10.3390/mti8080069 · Cited by 8
Tracked Inspection Robot: Teleoperation based on ROS and Unity 3D
Du, R., Wang, X., & Tian, M. (2024) · International Conference on Big Data and Internet of Things (BDIOT) · doi:10.1145/3697355.3697410 · Cited by 3
“Existing studies have shown that VR stereoscopic vision fetches improved operation efficiency compared to monocular vision [6].”
Gill, A. S., Irwin, D. S., Mareta, S., Towey, D., Wang, A., & Zhang, Y. (2022) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale54877.2022.00029 · Cited by 4
Triantafyllidis, E., & Li, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.12702 · Cited by 5
“While objective metrics are almost always the chosen tools for assessing operator performance in VEs, including subjective responses are fundamental when attempting to assess user experience and increase generalization [9, 29, 40, 56, 58].”
BackgroundInfluentialSelf-citationExploration of interaction modality for civil aircraft flying task: A laboratory study
Yu, R., Sun, Y., & Guo, C. (2025) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2025.103823 · Cited by 2
A Holistic Evaluation of Teleoperation Interfaces for Robotic Manipulation
Hasan, S., Yasar, M. S., & Iqbal, T. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3785141 · Cited by 3
“However, these taxonomies primarily focus on either the mechanical aspects of manipulation or domain-specific requirements, leaving crucial gaps in understanding teleoperation-specific challenges.”
InfluentialAchanccaray, D., & Sumioka, H. (2023) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc40787.2023.10340007 · Cited by 2
“The remote environment perception by the teleoperator influences the teleoperation workload of robots (or virtual models) [1].”
BackgroundTowards Characterizing Feasibility of Edge Driven Split-Control in Bilateral Teleoperation of Robots
Ahmed, M., Daksha, L., Kahar, V., et al. (2024) · Wireless Personal Communications · doi:10.1007/s11277-024-10872-3 · Cited by 2
“A plethora of multimedia is used in environment sensing such as tactile sensing [7–9], vision [10, 11], haptics [12], and hybrid sensing [13] for developing robust control algorithms.”
Multimodal Interactive Evaluation and Optimization Design of Intelligent Helmet
Jian, P., Xuepeng, W., Ji, T., & Junchun, C. (2023) · Journal of Mechanical Engineering · doi:10.3901/jme.2023.11.117 · Cited by 2
Prinz, T., & Bengler, K. J. (2024) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3610978.3640552 · Cited by 3
“NASA-TLX remains popular in human-robot interaction (HRI) research due to its extensive validation in a variety of research felds [1, 4, 10, 31, 35].”
BackgroundAhmed, M., Qari, K., Kumar, R., et al. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.04.028 · Cited by 2
Simmons, J., Bremner, P., Mitchell, T. J., Bown, A., & McIntosh, V. (2024) · Frontiers in Virtual Reality · doi:10.3389/frvir.2024.1404865 · Cited by 3
Implementation of a Robotic Arm Control for EOD Applications Using an Immersive Multimodal Interface
Aguilar, W., Pari, L., Vidal, Y. S., Espinoza, E. S., Ccari, L. F. C., Peña, R., & Chilo, N. O. M. (2024) · IEEE Access · doi:10.1109/access.2024.3432401 · Cited by 2
“In [17], a thorough study of multimodal interfaces and the effect of their application in teleoperated robotics is conducted.”
BackgroundMethodInfluentialNeurotechnology for enhancing human operation of robotic and semi-autonomous systems
Tyler, W. J., Adavikottu, A., Blanco, C. L., Mysore, A. S., Blais, C., Santello, M., & Unnikrishnan, A. (2025) · Frontiers in Robotics and AI · doi:10.3389/frobt.2025.1491494 · Cited by 5
Electrotactile Feedback in Virtual Reality For Precise and Accurate Contact RenderingPreprint
Vizcay, S., Kourtesis, P., Argelaguet, F., Pacchierotti, C., & Marchal, M. (2021) · doi:10.36227/techrxiv.13856051.v1 · Cited by 6
“Visual feedback is important for contact accuracy and precision [3].”
BackgroundResultMetrics for 3D Object Pointing and Manipulation in Virtual RealityPreprint
Triantafyllidis, E., Hu, W., McGreavy, C., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.06655 · Cited by 2
“The re-targeting approach was similar to the work in [14], where the joint positions of the user’s fingers were obtained by calculating the angle θ between a joint −−→ bi−1 and its parent joint − → bi .”
BackgroundMethodResultInfluentialSelf-citationElectrotactile Feedback For Enhancing Contact Information in Virtual RealityPreprint
Vizcay, S., Kourtesis, P., Argelaguet, F., Pacchierotti, C., & Marchal, M. (2021) · arXiv (Cornell University) · doi:10.2312/egve.20211331 · Cited by 27
“Visual feedback is important for contact accuracy and precision [TMGL20].”
BackgroundResultImproving Low-Cost Teleoperation: Augmenting GELLO with Force
Sujit, S., Nunziante, L., Lillrank, D. O., Dossa, R. F. J., & Arulkumaran, K. (2025) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii59315.2025.10871050 · Cited by 5
“Although it is possible to perform teleoperation without feedback to the user, as in the original GELLO, it has been shown in prior work that providing haptic feedback improves task performance [17], [18], [19].”
Remote control desk in Industry 4.0 for train driver: an ergonomics perspective
Michel, E., Richard, P., & Berdal, Q. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.01.166 · Cited by 2
Yu, R., Sun, Y., Zhang, X., & Guo, C. (2025) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-025-00466-z · Cited by 1
“Our results are similar to previous studies [ 63 ], where the error rates generated by multimodal interactions are within an acceptable range.”
Gkoumas, C., Triantafyllidis, E., & Rouchitsas, A. (2025) · IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) · doi:10.1109/ismar-adjunct68609.2025.00100 · Cited by 1
Self-citationDuan, S., Pace, F. D., & Liarokapis, M. V. (2026) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2026.3653274 · Cited by 1
“Traditional telemanipulation interfaces typically rely on RGB videofeeds,whichprovidevisualfeedbackbutlackcrucialdepth information[2],[3],[4].”
Kacem, A. H., Zbiss, K., Watta, P. B., et al. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15385-y · Cited by 1
“…which is afforded by a high-dimensional scalar sound field defined on the dihedral angle space of protein conformations human-robot interaction (HRI) problems [22, 48, 58], the problem of sonification of joint space trajectories for robots with many degrees-of-freedom has remained unaddressed.”
Goswami, C., Vaishnavi, T., Sarma, P., et al. (2023) · Optical and Quantum Electronics · doi:10.1007/s11082-023-05860-z · Cited by 1
RetractedA Comparison of NUI Interfaces as Control Interfaces for Robotic Arms in EOD Applications
Chilo, N. O. M., Ccari, L. F. C., Supo, E., et al. (2023) · International Conference on Control, Mechatronics and Automation (ICCMA) · doi:10.1109/iccma59762.2023.10374835 · Cited by 1
“…and Place tasks, 3 different objects with different manipulation difficulty were used, using different objects requires the operator to use different movements for each one [15], object A has the characteristic of being deformable and having a wide grasping area, being the simplest to manipulate.”
MethodRodrigues, P. B., Becerik-Gerber, B., Soibelman, L., et al. (2024) · ASCE International Conference on Computing in Civil Engineering (i3CE) · doi:10.1061/9780784485231.007 · Cited by 1
Nachtalb: A multisensory Neurofeedback VR-Interface
Morat, P., Schwerdtfeger, A., & Heidmann, F. (2021) · SIGGRAPH Asia XR · doi:10.1145/3478514.3487621 · Cited by 1
“Recent work, therefore, explores other sensory modalities also in VR environments and hypothesizes that multisensory stimulation may improve the quality of performance [Triantafyllidis et al. 2020].”
BackgroundElectrotactile Feedback in Virtual Reality For Precise and Accurate Contact RenderingPreprint
Vizcay, S., Kourtesis, P., Argelaguet, F., Pacchierotti, C., & Marchal, M. (2021) · doi:10.36227/techrxiv.13856051 · Cited by 2
Kumar, R., Gandotra, P., Lall, B., Kherani, A. A., & Mukherjee, S. (2021) · arXiv (Cornell University) · Cited by 1
A Review on Robot Hand/Arm That Is Controlled by Teleportation System
Sengaphone, P. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.18513639
Evaluating Visual-Spatiotemporal Coregistration of a Physics-based Virtual Reality Haptic InterfacePreprint
Chowdhury, S. K., Mubarrat, S. T., Fernandes, A. S., et al. (2022) · doi:10.36227/techrxiv.19242951
Nachtalb: A multisensory Neurofeedback VR-Interface
Morat, P., Schwerdtfeger, A., & Heidmann, F. (2022) · doi:10.1145/3532834.3536207
“Recent work, therefore, explores other sensory modalities also in VR environments and hypothesizes that multisensory stimulation may improve the quality of performance [Triantafyllidis et al. 2020].”
BackgroundYang, C., Luo, J., & Wang, N. (2023) · Elsevier eBooks · doi:10.1016/b978-0-32-395143-2.00005-x
Application of Virtual Reality in Human-Swarm InteractionPreprint
Ghofrani, J., & Schiller, V. (2023) · Preprints.org · doi:10.20944/preprints202306.2110.v1
Towards characterizing feasibility of Edge driven split-control in Bilateral Teleoperation of Robots
Ahmed, M., Mahavar, N., Abbas, Q., et al. (2022) · IEEE International Conference on Advanced Networks and Telecommunications Systems · doi:10.1109/ants56424.2022.10227768
Study of Traffic Characteristics for Haptic Signals in split AI/ML control
Ahmed, M., Kherani, A. A., Lall, B., et al. (2022) · IEEE International Conference on Advanced Networks and Telecommunications Systems · doi:10.1109/ants56424.2022.10227781
“The advances in literature suggest environment sensing using multi-modal data such as video [10], [11], tactile sensing [12]–[14], haptics [15], and hybrid sensing [16] for achieving a better control at the edge of human-computer interaction.”
BackgroundAssessment of Force Feedback Models in a Haptic Device Using Alignment Accuracy and Brain Activity
Nagai, H., & Miura, S. (2024) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc53108.2024.10781934
“In addition to the noticeable effect of visual feedback, force feedback from the interface contributes to improved task performance and immersion in the teleoperation environment [1][2].”
Vibrotactile Information Coding Strategies for a Body-Worn Vest to Aid Robot-Human Collaboration
Tercero, A. V., & Caleb-Solly, P. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-3525-2_39
Research on Evaluation Method for Multimodal Information Interface Complexity
Zhang, J., Zhang, N., Zhang, Y., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93845-0_31
A Depth-Assisted Teleoperation System: Automatic Alignment for Precision Assembly Tasks
Kim, D., Lee, H., & Yang, G.-H. (2025) · IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/ro-man63969.2025.11217841 · Cited by 1
“Various methods have been explored in teleoperation systems to support the operator [6], [7], [8].”
Thorslund, B., Babel, F., & Rosberg, T. (2025) · Frontiers in Organizational Psychology · doi:10.3389/forgp.2025.1662134
“This aligns with research advocating for ergonomic, user-centered design that reduces cognitive load and supports efficient task execution (Wickens, 2008; Triantafyllidis et al., 2020).”
Ding, L., Yuan, M., & Yu, R. (2026) · Work · doi:10.1177/10519815251410547
“29 Aloise et al. employed subjective scales to evaluate fl ight performance, human – machine ef fi ciency, and comfort during pilot operations, thereby identifying main factors in fl uencing mental workload and effectiveness.”
RGB-D Fusion for Wide Field of View User Feedback in Teleoperation Context
D’Orfani, R., André, A. N., Benallegue, M., et al. (2026) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii64115.2026.11404633
“Teleoperated robots play a key role in hazardous or remote tasks, but their effectiveness hinges on the operator’s visual immersion [1].”
A Puppeteering Interface for Teleoperating High Degree-of-Freedom Social Robots
Laar, R. V. D., & Baraka, K. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3776734.3794508
Contributions to the use of Electrotactile Feedback in Hand-based Interactions in Virtual Reality
Vizcay, S. (2022) · theses.fr (ABES) · doi:10.70675/53d0ebc9z71e2z46a0zbee7zbc74ab71b8b1 · Cited by 1
Metadata
- Authors
- Triantafyllidis, E., Mcgreavy, C., Gu, J., & Li, Z.
- Affiliations
- University of Edinburgh (GB)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 78213-78227
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3019814707
- Cited by
- 105
- References
- 72
- Citations by year
- 2026: 10 · 2025: 17 · 2024: 25 · 2023: 17 · 2022: 16 · 2021: 20
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- EPSRC Future AI and Robotics for Space (EP/R026092/1)
- Topics
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Virtual Reality Applications and Impacts
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Keywords
- multimodal interfaces, teleoperation, haptic feedback, auditory feedback, stereo vision, virtual reality headsets, manipulation tasks, mental workload, system usability, task performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.