Wearables in the wet lab: a laboratory system for capturing and guiding experiments
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Wet Laboratories are highly dynamic, shared environments full of tubes, racks, compounds, and dedicated machinery. The recording of experiments, despite the fact that several ubiquitous computing systems have been suggested in the past decades, still relies predominantly on hand-written notes. Similarly, the information retrieval capabilities inside a laboratory are limited to traditional computing interfaces, which due to safety regulations are sometimes not usable at all. In this paper, Google Glass is combined with a wrist-worn gesture sensor to support Wetlab experimenters. Taking "in-situ" documentation while an experiment is performed, as well as contextualizing the protocol at hand can be implemented on top of the proposed system. After an analysis of current practices and needs through a series of explorative deployments in wet labs, we motivate the need for a wearable hands-free system, and introduce our specific design to guide experimenters. Finally, using a study with 22 participants evaluating the system on a benchmark DNA extraction experiment, we explore the use of gesture recognition for enabling the system to track where the user might be in the experiment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, the Wetlab dataset contains laboratory experiments, which are typically not performed in day-to-day living.”
From Assessing the State of Self-Supervised Human Activity Recognition Using Wearables (2022) · cites this paper as [66]
In the citing paper
“and the Wetlab activity dataset covers 13 hours of sensor data from 22 users [30].”
From Complex Deep Neural Networks from Large Scale Virtual IMU Data for Effective Human Activity Recognition Using Wearables (2021) · cites this paper as [30]
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
MyLifeBits: fulfilling the Memex vision
Gemmell, J., Bell, G., Lueder, R., Drucker, S., & Wong, C. (2002) · Proceedings of the tenth ACM international conference on Multimedia · doi:10.1145/641007.641053 · Cited by 487
Wearable Activity Tracking in Car Manufacturing
Stiefmeier, T., Roggen, D., Ogris, G., Lukowicz, P., & Tr, G. (2008) · IEEE Pervasive Computing · doi:10.1109/mprv.2008.40 · Cited by 367 · cited 1×
“The concepts of wearable workflow monitoring, documentation access, and assistance have been thoroughly explored by research in other domains [20], especially in maintenance [21], manufacturing [22] and inspection tasks [23].”
BackgroundSwiglo, B. A., Murad, M. H., Schünemann, H. J., Kunz, R., Vigersky, R. A., Guyatt, G. H., & Montori, V. M. (2008) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2007-1907 · Cited by 302
ButterflyNet: a mobile capture and access system for field biology research
Yeh, R., Liao, C., Klemmer, S., Guimbretière, F., Lee, B., Kakaradov, B., Stamberger, J., & Paepcke, A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124859 · Cited by 204 · cited 1×
“A system to support biologists in the field was presented in the ButterflyNet [10] project.”
The missing link: augmenting biology laboratory notebooks
Mackay, W. E., Pothier, G., Letondal, C., Bøegh, K., & Sørensen, H. E. (2002) · Proceedings of the 15th annual ACM symposium on User interface software and technology · doi:10.1145/571985.571992 · Cited by 150
Information scraps: How and why information eludes our personal information management tools
Bernstein, M. S., Kleek, M. G. V., Karger, D. R., & schraefel, M. C. (2008) · ACM Transactions on Information Systems · doi:10.1145/1402256.1402263 · Cited by 150
WearIT@work: Toward Real-World Industrial Wearable Computing
Lukowicz, P., Timm-Giel, A., Lawo, M., & Herzog, O. (2007) · IEEE Pervasive Computing · doi:10.1109/mprv.2007.89 · Cited by 86
Labscape: a smart environment for the cell biology laboratory
Arnstein, L., Hung, C.-Y., Franza, R. B., Zhou, Q. H., Borriello, G., Consolvo, S., & Su, J. (2002) · IEEE Pervasive Computing · doi:10.1109/mprv.2002.1037717 · Cited by 83 · cited 1×
“The LabScape [12] project was an early investigation in a ubiquitous computing platform to help scientists and students to access and capture information in the laboratory.”
BackgroundRecognizing and Discovering Human Actions from On-Body Sensor Data
Minnen, D. C., Starner, T. E., Ward, J. A., Lukowicz, P., & Tröster, G. (2005) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2005.1521728 · Cited by 81 · cited 1×
“This concept of automated journal building has been introduced previously, where activities were extracted in an unsupervised fashion [19].”
MethodBird, C., Willoughby, C., & Frey, J. G. (2013) · Chemical Society Reviews · doi:10.1039/c3cs60122f · Cited by 78
From individual to collaborative: the evolution of prism, a hybrid laboratory notebook
Tabard, A., Mackay, W. E., & Eastmond, E. (2008) · Proceedings of the 2008 ACM conference on Computer supported cooperative work · doi:10.1145/1460563.1460653 · Cited by 72 · cited 2×
“The Prism [1] project reports on a study of biologists’ work practices and presents a hybrid system using hand-written notes as well as digital content to capture, visualise and interact with activity streams in the laboratory.”
BackgroundPreliminary investigation of wearable computers for task guidance in aircraft inspection
Ockerman, J. J., & Pritchett, A. R. (2002) · International Symposium on Wearable Computers · doi:10.1109/iswc.1998.729527 · Cited by 72 · cited 1×
“The concepts of wearable workflow monitoring, documentation access, and assistance have been thoroughly explored by research in other domains [20], especially in maintenance [21], manufacturing [22] and inspection tasks [23].”
BackgroundDetecting leisure activities with dense motif discovery
Berlin, E., & Van Laerhoven, K. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370257 · Cited by 67
The semantic smart laboratory: a system for supporting the chemical eScientist
Hughes, G. V., Mills, H. R., Roure, D. D., Frey, J. G., Moreau, L., schraefel, M. C., SMITH, G. M., & Zaluska, E. (2004) · Organic & Biomolecular Chemistry · doi:10.1039/b410075a · Cited by 63 · cited 2×
“During the Combechem project the idea of a digitized flowchart was enhanced to a Semantic Smart Laboratory [14], a system for supporting chemistry experiments focusing on providing a flexible ontology for describing experiments and storing them for later retrieval.”
MethodComing to grips with the objects we grasp: detecting interactions with efficient wrist-worn sensors
Berlin, E., Liu, J., Laerhoven, K. V., & Schiele, B. (2010) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/1709886.1709898 · Cited by 39 · cited 1×
“One example is the use of object identification, for instance via RFID tags on the objects that are read out by a wrist-worn RFID reader [27] or by instrumented objects like a Bluetooth-enabled pipette.”
Going paperless: The digital lab
Giles, J. (2012) · Nature · doi:10.1038/481430a · Cited by 30 · cited 1×
“Even when offering clear advantages, like searchability of records, direct addition of multimedia , eased collaboration [1–3], edit-ability [4] and capturing of instrument measurements [5], their usage is still limited.”
BackgroundFirst steps towards semantic descriptions of electronic laboratory notebook records
Coles, S. J., Frey, J. G., Bird, C., Whitby, R. J., & Day, A. (2013) · Journal of Cheminformatics · doi:10.1186/1758-2946-5-52 · Cited by 29 · cited 1×
“A formal definition of chemical experiments is presented as part of the Labtrove project [15] as well.”
BackgroundMyers, J. D. (2003) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 26
Wearable Computing for Aircraft Maintenance: Simplifying the User Interface
Nicolai, T., Sindt, T., Witt, H., Reimerdes, J., & Kenn, H. (2006) · Cited by 25
The status of electronic laboratory notebooks for chemistry and biology.
Taylor, K. T. (2006) · PubMed · Cited by 23
Rethinking Laboratory Notebooks
Klokmose, C. N., & Zander, P.-O. M. (2010) · Springer eBooks · doi:10.1007/978-1-84996-211-7_8 · Cited by 22
The eLabBench in the wild: supporting exploration in a molecular biology lab
Tabard, A., Hincapié-Ramos, J. D., & Bardram, J. E. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208718 · Cited by 20 · cited 1×
“The eLabBench [16] and Biotisch [17] takes the integration in the laboratory further by replacing the traditional workbench with a tabletop system that presents information on the bench’s surface, also allowing interaction, sensing of augmented objects (e.”
MethodBioTISCH: the interactive molecular biology lab bench
Echtler, F., Haeussler, M., & Klinker, G. (2010) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1753846.1753998 · Cited by 9 · cited 1×
“The eLabBench [16] and Bi-otisch [17] takes the integration in the laboratory further by replacing the traditional workbench with a tabletop system that presents information on the bench’s surface, also allowing interaction, sensing of augmented objects (e.g, racks of test tubes) and taking…”
MethodWearable digitization of life science experiments
Scholl, P., & Laerhoven, K. V. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2638728.2641719 · Cited by 7 · cited 1×
“We argue that this approach of augmenting the researchers instead of the laboratory, has many advantages, not in the least the fact that every user in existing laboratories can still opt to keep on documenting their experiments with the traditional methods alone [18].”
BackgroundSelf-citationInvisible computing: automatically using the many bits of data we create
Borriello, G. (2008) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2008.0128 · Cited by 6 · cited 1×
“It uses interactive flowchart diagrams to visualize and annotate ongoing procedures that are accessed via a touch-tablet, barcode scanner, RFID tags [13], numeric keypad and wireless keyboard.”
MethodBioTISCH: the interactive molecular biology lab bench
Echtler, F. ;. (n.d.) · mediaTUM (Technical University of Munich) · Cited by 1
Research works printed but not linked: 1
- Roubert , F. , and Perry , M . Putting the Lab in the Lab Book: Supporting Coordination in Large , Multi-site Research. Proc. 27th Int. BCS Hum. Comput. Interact. Conf. 2002: 1--10 . Roubert, F., and Perry, M. Putting the Lab in the Lab Book: Supporting Coordination in Large, Multi-site Research. Proc. 27th Int. BCS Hum. Comput. Interact. Conf. 2002: 1--10.
Cited by
Kwon, H., Tong, C., Haresamudram, H., Gao, Y., Abowd, G. D., Lane, N. D., & Plötz, T. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3411841 · Cited by 152
“Tong, et al. 1 INTRODUCTION On-body sensor-based human activity recognition (HAR) is widely utilized for behavioral analysis, such as user authentication, healthcare, and tracking everyday activities [5, 14, 50, 78, 97]. Regardless of its utility, the HAR field has yet to experience significant improvements in recogni…”
Assessing the State of Self-Supervised Human Activity Recognition Using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3550299 · Cited by 107
“A similar trend is observed for the lab-based gestures in Wetlab as well, with > 10% increase shown by CPC, Autoencoder, SimSiam, and BYOL.”
MethodInfluentialExploring User Expectations of Proactive AI Systems
Meurisch, C., Mihale-Wilson, C., Hawlitschek, A., Giger, F., Müller, F., Hinz, O. F., & Mühlhäuser, M. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432193 · Cited by 112
“Other AI systems can also support specific professional activities, such as conducting experiments in a laboratory [67], or detecting nurse activities in a hospital [26].”
BackgroundData Protection in AI Services: A Survey
Meurisch, C., & Mühlhäuser, M. (2021) · ACM Computing Surveys · doi:10.1145/3440754 · Cited by 119
“——————————————————————————————————————————————————————————————————————————— Guiding experiments [160] physical experiment execution / mic, camera, acc.”
BackgroundImproving Deep Learning for HAR with Shallow LSTMs
Bock, M., Hölzemann, A., Moeller, M., & Van Laerhoven, K. (2021) · 2021 International Symposium on Wearable Computers · doi:10.1145/3460421.3480419 · Cited by 74
“Our paper’s contributions are threefold: (1) We show that an altered DeepConvLSTM architecture with a one-layered LSTM overall outperforms architectures employing a two-layered LSTM, by validating our claim using the Opportunity dataset [29] as seen in [26], as well as 4 other popular HAR datasets [28, 32, 33, 36].”
Method
Metadata
- Authors
- Scholl, P. M., Wille, M., & Van Laerhoven, K.
- Affiliations
- University of Freiburg (DE)
- Federal Institute for Occupational Safety and Health (DE)
- Albert-Ludwigs-Universität Freiburg
- Venue
- Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing
- Publisher
- ACM
- Published
- 2015-09-07
- Pages
- 589-599
- OpenAlex
- W2089242851
- Cited by
- 45
- References
- 27
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 9 · 2023: 4 · 2022: 3 · 2021: 7 · 2020: 3 · 2019: 3 · 2018: 3 · 2017: 3 · 2016: 2 · 2015: 1
- FWCI
- 2.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Funders
- Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Interactive and Immersive Displays
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Augmented Reality Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Keywords
- wearable computing, Google Glass, gesture recognition, touchless interaction, DNA extraction, user tracking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.