Simple, Transparent, and Flexible Automated Quality Assessment Procedures for Ambulatory Electrodermal Activity Data
Open accessAbstract
OBJECTIVE: Electrodermal activity (EDA) is a noninvasive measure of sympathetic activation often used to study emotions, decision making, and health. The use of "ambulatory" EDA in everyday life presents novel challenges-frequent artifacts and long recordings-with inconsistent methods available for efficiently and accurately assessing data quality. We developed and validated a simple, transparent, flexible, and automated quality assessment procedure for ambulatory EDA data. METHODS: A total of 20 individuals with autism (5 females, 5-13 years) provided a combined 181 h of EDA data in their home using the Affectiva Q Sensor across 8 weeks. Our procedure identified invalid data using four rules: First, EDA out of range; second, EDA changes too quickly; third, temperature suggests the sensor is not being worn; and fourth, transitional data surrounding segments identified as invalid via the preceding rules. We identified invalid portions of a pseudorandom subset of our data (32.8 h, 18%) using our automated procedure and independent visual inspection by five EDA experts. RESULTS: Our automated procedure identified 420 min (21%) of invalid data. The five experts agreed strongly with each other (agreement: 98%, Cohen's κ: 0.87) and, thus, were averaged into a "consensus" rating. Our procedure exhibited excellent agreement with the consensus rating (sensitivity: 91%, specificity: 99%, accuracy: 92%, κ: 0.739 [95% CI = 0.738, 0.740]). CONCLUSION: We developed a simple, transparent, flexible, and automated quality assessment procedure for ambulatory EDA data. SIGNIFICANCE: Our procedure can be used beyond this study to enhance efficiency, transparency, and reproducibility of EDA analyses, with free software available at http://www.cbslab.org/EDAQA.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The quality of data can be expressed in many different ways, and data quality measures may also depend on the aims of the related analysis and project.
“the quality of data can be expressed in many different ways, and data quality measures may also depend on the aims of the related analysis and project8–13”
From Data quality evaluation in wearable monitoring (2022) · cites this paper as [12]
Artifacts in the EDA signal are often caused by connection loss of the electrodes to the skin due to body motion, and present as a sharp decrease or increase, or fall to a zero-line value altogether.
“Artifacts in the EDA signal are thus often caused by connection loss of the electrodes to the skin due to, e.g., body motion, and present as a sharp decrease or increase, or fall to a zero-line value altogether12.”
From Data quality evaluation in wearable monitoring (2022) · cites this paper as [12]
These kinds of artifacts can be detected by simple thresholding as well as analysis of the rate of amplitude change, similar to the artifacts seen in the temperature signal.
“These kinds of artifacts can be detected by simple thresholding as well as analysis of the rate of amplitude change9,12, similar to the artifacts seen in the temperature signal.”
From Data quality evaluation in wearable monitoring (2022) · cites this paper as [12]
Biosignal recordings may be of overall lesser quality in ultra-long-term monitoring.
“Therefore, biosignal recordings may be of overall lesser quality12.”
From Data quality evaluation in wearable monitoring (2022) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · see citing works
Boucsein, W. (2012) · doi:10.1007/978-1-4614-1126-0 · Cited by 2,526 · see citing works
Dawson, M., Schell, A., & Filion, D. L. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546396.007 · Cited by 2,425 · see citing works
Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Bechara, A., Damasio, H., Damasio, A. R., & Lee, G. P. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-13-05473.1999 · Cited by 2,001 · see citing works
Publication Recommendations for Electrodermal Measurements
Fowles, D. C., Christie, M. J., Edelberg, R., Grings, W. W., Lykken, D. T., & Venables, P. H. (1981) · Psychophysiology · doi:10.1111/j.1469-8986.1981.tb03024.x · Cited by 1,700 · see citing works
Publication recommendations for electrodermal measurements
Society for Psychophysiological Research Ad Hoc Committee on Electrodermal Measures (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01384.x · Cited by 1,288 · see citing works
Bradley, M. M., & Lang, P. J. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511546396.025 · Cited by 1,047 · see citing works
Natural selective attention: Orienting and emotion
Bradley, M. M. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2008.00702.x · Cited by 976 · see citing works
Emotional sweating across the body: Comparing 16 different skin conductance measurement locations
van Dooren, M., de Vries, G.-J., & Janssen, J. H. (2012) · Physiology & Behavior · doi:10.1016/j.physbeh.2012.01.020 · Cited by 413 · see citing works
Differential control of sympathetic outflow
Morrison, S. F. (2001) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.2001.281.3.r683 · Cited by 385 · see citing works
Wilhelm, F. H., & Grossman, P. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.01.017 · Cited by 311 · see citing works
Automatic identification of artifacts in electrodermal activity data
Taylor, S., Jaques, N., Chen, W., Fedor, S., Sano, A., & Picard, R. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318762 · Cited by 279 · see citing works
Estimating Activity and Sedentary Behavior from an Accelerometer on the Hip or Wrist
Rosenberger, M. E., Haskell, W. L., Albinali, F., Mota, S., Nawyn, J., & Intille, S. S. (2013) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31827f0d9c · Cited by 242 · see citing works
Modelling event-related skin conductance responses
Bach, D. R., Flandin, G., Friston, K. J., & Dolan, R. J. (2010) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2010.01.005 · Cited by 215 · see citing works
Reinhardt, T., Schmahl, C. G., Wüst, S., & Bohus, M. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2011.12.009 · Cited by 191 · see citing works
Smart technologies for long-term stress monitoring at work
Kocielnik, R., Sidorova, N., Maggi, F. M., Ouwerkerk, M., & Westerink, J. H. D. M. (2013) · Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2013.6627764 · Cited by 154 · see citing works
An improved algorithm for model-based analysis of evoked skin conductance responses
Bach, D. R., Friston, K. J., & Dolan, R. J. (2013) · Biological Psychology · doi:10.1016/j.biopsycho.2013.09.010 · Cited by 122 · see citing works
Wilhelm, F. H., & Roth, W. T. (1998) · Psychophysiology · doi:10.1017/s0048577298970196 · Cited by 118 · see citing works
ANSLAB: Integrated multichannel peripheral biosignal processing in psychophysiological science
Blechert, J., Peyk, P., Liedlgruber, M., & Wilhelm, F. H. (2015) · Behavior Research Methods · doi:10.3758/s13428-015-0665-1 · Cited by 113 · see citing works
A study on electrode gels for skin conductance measurements
Tronstad, C., Johnsen, G. K., Grimnes, S., & Martinsen, Ø. G. (2010) · Physiological Measurement · doi:10.1088/0967-3334/31/10/008 · Cited by 93 · see citing works
Do Unexpected Panic Attacks Occur Spontaneously?
Meuret, A. E., Rosenfield, D., Wilhelm, F. H., Zhou, E., Conrad, A., Ritz, T., & Roth, W. T. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.05.027 · Cited by 92 · see citing works
Telemetric monitoring in the behavior sciences
Goodwin, M. S., Velicer, W. F., & Intille, S. S. (2008) · Behavior Research Methods · doi:10.3758/brm.40.1.328 · Cited by 90 · see citing works
Self-citationWavelet-based motion artifact removal for electrodermal activity
Chen, W. '., Jaques, N., Taylor, S., Sano, A., Fedor, S., & Picard, R. W. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7319814 · Cited by 75 · see citing works
O’Connell, R. G., Bellgrove, M. A., Dockree, P. M., & Robertson, I. H. (2004) · NeuroReport · doi:10.1097/00001756-200411150-00021 · Cited by 73 · see citing works
Storm, H., Fremming, A., Ødegaard, S., et al. (2000) · Clinical Neurophysiology · doi:10.1016/s1388-2457(00)00421-1 · Cited by 70 · see citing works
Parametric trial-by-trial prediction of pain by easily available physiological measures
Geuter, S., Gamer, M., Onat, S., & Büchel, C. (2014) · Pain · doi:10.1016/j.pain.2014.02.005 · Cited by 63 · see citing works
Prince, E. B., Kim, E. S., Wall, C. A., Gisin, E., Goodwin, M. S., Simmons, E. S., Chawarska, K., & Shic, F. (2016) · Autism · doi:10.1177/1362361316648816 · Cited by 60 · see citing works
Self-citationSavard, M., Savard, J., Caplette‐Gingras, A., Ivers, H., & Bastien, C. (2013) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0b013e3182885e31 · Cited by 45 · see citing works
Active learning for electrodermal activity classification
Xia, V., Jaques, N., Taylor, S., Fedor, S., & Picard, R. W. (2015) · IEEE Signal Processing in Medicine and Biology Symposium · doi:10.1109/spmb.2015.7405467 · Cited by 30 · see citing works
Kelsey, M., Akçakaya, M., Kleckner, I. R., Palumbo, R. V., Barrett, L. F., Quigley, K. S., & Goodwin, M. S. (2017) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2017.08.024 · Cited by 23 · see citing works
Self-citationAmbulatory assessment of clinical anxiety
Wilhelm, F. H., & Roth, W. T. (1996) · Cited by 22 · see citing works
Tronstad, C., Staal, O. M., Sælid, S., & Martinsen, Ø. G. (2015) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318961 · Cited by 18 · see citing works
Dictionary learning and sparse recovery for electrodermal activity analysis
Kelsey, M., Dallal, A. H., Eldeeb, S. M., et al. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2227142 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Innovations in Electrodermal Activity Data Collection and Signal Processing: A Systematic Review
Posada-Quintero, H. F., & Chon, K. H. (2020) · Sensors · doi:10.3390/s20020479 · Cited by 525 · see citing works
Data quality evaluation in wearable monitoring
Böttcher, S., Vieluf, S., Bruno, E., Joseph, B., Epitashvili, N., Biondi, A., Zabler, N., Glasstetter, M., Dümpelmann, M., Van Laerhoven, K., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-25949-x · Cited by 91 · see citing works
Smith, K. E., Mason, T. B., Juarascio, A., Schaefer, L. M., Crosby, R. D., Engel, S. G., & Wonderlich, S. A. (2019) · International Journal of Eating Disorders · doi:10.1002/eat.23124 · Cited by 34 · see citing works
Emotion assessment using Machine Learning and low-cost wearable devices
Laureanti, R., Bilucaglia, M., Zito, M., Circi, R., Fici, A., Rivetti, F., Valesi, R., Oldrini, C., Mainardi, L. T., & Russo, V. (2020) · 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) · doi:10.1109/embc44109.2020.9175221 · Cited by 33 · see citing works
Comparison of Wearable and Clinical Devices for Acquisition of Peripheral Nervous System Signals
Bizzego, A., Gabrieli, G., Furlanello, C., & Esposito, G. (2020) · Sensors · doi:10.3390/s20236778 · Cited by 25 · see citing works
Atypical Emotional Electrodermal Activity in Toddlers with Autism Spectrum Disorder
Vernetti, A., Shic, F., Boccanfuso, L., Macari, S., Kane‐Grade, F., Milgramm, A., Hilton, E., Heymann, P., Goodwin, M. S., & Chawarska, K. (2020) · Autism Research · doi:10.1002/aur.2374 · Cited by 20 · see citing works
Self-citation
- Authors
- Kleckner, I. R., Jones, R. M., Wilder-Smith, O., Wormwood, J. B., Akcakaya, M., Quigley, K. S., Lord, C., & Goodwin, M. S.
- Affiliations
- University of Rochester Medicine (US)
- Weill Cornell Medicine (US)
- Northeastern University (US)
- University of Pittsburgh, USA
- ORCID
- Venue
- IEEE Transactions on Biomedical Engineering
- Published
- 2018-07
- Volume
- 65
- Issue
- 7
- Pages
- 1460-1467
- ISSN
- 0018-9294 (ISSN-L)
- 1558-2531
- PMC
- PMC5880745
- OpenAlex
- W2764271683
- Cited by
- 121
- References
- 33
- Citations by year
- 2026: 19 · 2025: 14 · 2024: 19 · 2023: 18 · 2022: 16 · 2021: 13 · 2020: 11 · 2019: 8 · 2018: 3
- FWCI
- 7.78
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- IEEE Transactions on Biomedical Engineering (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Simons Foundation (336363, 391635)
- National Cancer Institute (R25 CA102618, UG1 CA189961)
- National Institute of Mental Health (F32MH096533)
- Army Research Institute for the Behavioral and Social Sciences (W911NF-16-1-0191)
- National Institute of Nursing Research (NR013500)
- National Institute on Deafness and Other Communication Disorders (P50 DC013027)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Rate Variability and Autonomic Control
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- electrodermal activity, data quality assessment, sensor temperature, autism spectrum disorder, sympathetic activation, reproducibility
- MeSH terms
- Data Accuracy, Adolescent, Algorithms, Autistic Disorder, Child, Female, Galvanic Skin Response, Humans, Quality Control, Signal Processing, Computer-Assisted, Reproducibility of Results, Monitoring, Ambulatory
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review