Development of a protocol for objectively measuring digital device use in youth.
Abstract
Introduction Screen time is predominantly measured using questionnaires assessing a limited range of activities. This project aimed to develop a coding protocol that reliably identified screen time, including device type and specific screen behaviors, from video-camera footage.Methods Screen use was captured from wearable and stationary PatrolEyes video cameras in 43 participants (aged 10-14 years) within the home environment (May-December 2021, coding in 2022, statistical analysis in 2023). After extensive piloting, the inter-rater reliability of the final protocol was determined in 4 coders using 600 minutes of footage from 18 participants who spent unstructured time on digital devices. Coders independently annotated all footage to determine 8 device types (e.g., phone, TV) and 9 screen activities (e.g., social media, video gaming) using Observer XT (behavioral coding software). Reliability was calculated using weighted Cohen's κ for duration per sequence (meets criteria for total time in each category) and frequency per sequence (meets criteria for total time in each category and order of use) for every coder pair on a per-participant and footage type basis.Results Overall reliability of the full protocol was excellent (≥0.8) for both duration per sequence (κ=0.89-0.93) and the more conservative frequency per sequence (κ=0.83-0.86) analyses. This protocol reliably differentiates between different device types (κ=0.92-0.94) and screen behaviors (κ=0.81-0.87). Coder agreement ranged from 91.7% to 98.8% across 28.6-107.3 different instances of screen use.Conclusions This protocol reliably codes screen activities in adolescents, offering promise for improving the understanding of the impact of different screen activities on health.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
Screen time and sleep among school-aged children and adolescents: a systematic literature review
Hale, L., & Guan, S. (2015) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2014.07.007 · Cited by 1,468 · see citing works
Stiglic, N., & Viner, R. M. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-023191 · Cited by 1,259 · see citing works
The common sense census: media use by tweens and teens
Rideout, V. (2015) · Cited by 901 · see citing works
Parry, D. A., Davidson, B. I., Sewall, C. J. R., Fisher, J. T., Mieczkowski, H., & Quintana, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01117-5 · Cited by 793 · see citing works
Carter, B., Rees, P., Hale, L., Bhattacharjee, D., & Paradkar, M. S. (2016) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2016.2341 · Cited by 718 · see citing works
Beyond self-report: tools to compare estimated and real-world smartphone use
Andrews, S., Ellis, D. A., Shaw, H., & Piwek, L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0139004 · Cited by 408 · see citing works
Noldus, L. P. J. J., Trienes, R. J. H., Hendriksen, A. H. M., Jansen, H., & Jansen, R. G. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200802 · Cited by 343 · see citing works
The Conceptual and Methodological Mayhem of “Screen Time”
K. Kaye, L., Orben, A., A. Ellis, D., C. Hunter, S., & Houghton, S. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17103661 · Cited by 304 · see citing works
Sleep in the modern family: protective family routines for child and adolescent sleep
Buxton, O. M., Chang, A., Spilsbury, J. C., Bos, T., Emsellem, H. A., & Knutson, K. L. (2015) · Sleep Health · doi:10.1016/j.sleh.2014.12.002 · Cited by 291 · see citing works
Causes, effects, and practicalities of everyday multitasking
Carrier, L. M., Rosen, L. D., Cheever, N. A., & Lim, A. F. (2015) · Developmental Review · doi:10.1016/j.dr.2014.12.005 · Cited by 284 · see citing works
An ethical framework for automated, wearable cameras in health behavior research.
Kelly, P., Marshall, S. J., Badland, H., Kerr, J., Oliver, M., Doherty, A. R., & Foster, C. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.11.006 · Cited by 244 · see citing works
Yeykelis, L., Cummings, J. J., & Reeves, B. (2014) · Journal of Communication · doi:10.1111/jcom.12070 · Cited by 216 · see citing works
Excessive use of mobile devices and children's physical health
Domoff, S. E., Borgen, A. L., Foley, R. P., & Maffett, A. J. (2019) · Human Behavior and Emerging Technologies · doi:10.1002/hbe2.145 · Cited by 137 · see citing works
Mobile youth culture: A conceptual development
Abeele, M. V. (2015) · Mobile Media & Communication · doi:10.1177/2050157915601455 · Cited by 83 · see citing works
Screenomics: a new approach for observing and studying individuals’ digital lives.
Ram, N., Yang, X., Cho, M.-J., Brinberg, M., Muirhead, F., Reeves, B., & Robinson, T. N. (2020) · Journal of Adolescent Research · doi:10.1177/0743558419883362 · Cited by 83 · see citing works
Browne, D. T., May, S. S., Colucci, L., Pietra, P. H.-D., Christakis, D., Asamoah, T., Hale, L. E., Howlett, K. D., Emond, J. A., Fiks, A. G., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-046367 · Cited by 76 · see citing works
Brinberg, M., Ram, N., Yang, X., Cho, M.-J., Sundar, S. S., Robinson, T. N., & Reeves, B. B. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106570 · Cited by 58 · see citing works
Can Wearable Cameras Be Used to Validate School-Aged Children’s Lifestyle Behaviours?
Everson, B., Mackintosh, K. A., McNarry, M. A., Todd, C., & Stratton, G. (2019) · Children · doi:10.3390/children6020020 · Cited by 43 · see citing works
Smith, C. P., de Wilde, T., Taylor, R. W., & Galland, B. C. (2020) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2019.12.007 · Cited by 40 · see citing works
Self-citationFeasibility of automated cameras to measure screen use in adolescents.
Smith, C., Galland, B. C., de Bruin, W. E., & Taylor, R. W. (2019) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2019.04.012 · Cited by 34 · see citing works
Self-citationThe Frequency and Context of Snacking among Children: An Objective Analysis Using Wearable Cameras
Gage, R., Girling‐Butcher, M., Joe, E., Smith, M., Mhurchú, C. N., McKerchar, C., Puloka, V., McLean, R. M., & Signal, L. N. (2020) · Nutrients · doi:10.3390/nu13010103 · Cited by 34 · see citing works
Yeykelis, L., Cummings, J. J., & Reeves, B. B. (2017) · Media Psychology · doi:10.1080/15213269.2017.1406805 · Cited by 31 · see citing works
Thomas, G., Bennie, J. A., De Cocker, K., Dwi Andriyani, F., Booker, B., & Biddle, S. J. H. (2022) · JMIR Pediatrics and Parenting · doi:10.2196/28208 · Cited by 26 · see citing works
Using wearable cameras to monitor eating and drinking behaviours during transport journeys
Davies, A. J., Chan, V., Bauman, A. E., Signal, L. N., Hosking, C., Gemming, L., & Allman-Farinelli, M. A. (2020) · European Journal of Nutrition · doi:10.1007/s00394-020-02380-4 · Cited by 25 · see citing works
Validation of Youth Oriented Activity Trackers: Comprehensive Laboratory- and Field-Based Validation
Sirard, J. R., Masteller, B. R., Freedson, P. S., Mendoza, A., & Hickey, A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6360 · Cited by 15 · see citing works
Sedentary behavior in children by wearable cameras: development of an annotation protocol.
Hänggi, J. M., Spinnler, S., Christodoulides, E., Gramespacher, E., Taube, W., & Doherty, A. (2020) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2020.06.033 · Cited by 14 · see citing works
Validation of the SenseWear Mini activity monitor in 5−12-year-old children
van Loo, C. M. T., Okely, A. D., Batterham, M. J., Hinkley, T., Ekelund, U., Brage, S., Reilly, J. J., Peoples, G. E., Jones, R. A., Janssen, X., et al. (2016) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2016.04.010 · Cited by 8 · see citing works
Assessing the nature and extent of children's screen time
Lowe, B. (2017) · Otago University Research Archive (University of Otago) · Cited by 5 · see citing works
Adebowale, T. O., Taylor, B. J., Gray, A. R., Galland, B. C., Heath, A. M., Fortune, S. A., Meredith-Jones, K. A., Sullivan, T. A., McIntosh, D. R., Brosnan, B. J., et al. (2020) · JMIR Research Protocols · doi:10.2196/24968 · Cited by 5 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Screen Use at Bedtime and Sleep Duration and Quality Among Youths
Brosnan, B., Haszard, J. J., Meredith-Jones, K. A., Wickham, S.-R., Galland, B. C., & Taylor, R. W. (2024) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2024.2914 · Cited by 69 · see citing works
Self-citationBrosnan, B. J., Meredith-Jones, K. A., Haszard, J. J., Wickham, S.-R., Galland, B. C., Russell‐Camp, T., & Taylor, R. W. (2025) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-024-01698-0 · Cited by 13 · see citing works
Self-citationPrebed Screen Use, Activity, and Food in Relation to Sleep in Youth: A Repeated Measures Study
Gu, C., Jackson, R. F., Meredith-Jones, K. A., Wickham, S.-R., Brosnan, B. J., Haszard, J. J., Galland, B. C., & Taylor, R. W. (2025) · Pediatrics Open Science · doi:10.1542/pedsos.2025-000765 · Cited by 2 · see citing works
Self-citationMeredith-Jones, K. A., Haszard, J. J., Galland, B. C., Wickham, S.-R., Brosnan, B. J., Russell‐Camp, T., & Taylor, R. W. (2026) · Journal of Sleep Research · doi:10.1111/jsr.70288 · Cited by 2 · see citing works
Self-citationJackson, R., Gu, C., Haszard, J. J., Meredith-Jones, K. A., Galland, B. C., Camp, J., Brown, D. A., & Taylor, R. W. (2024) · JMIR Research Protocols · doi:10.2196/63692
Self-citationJackson, R., Meredith-Jones, K. A., Haszard, J. J., Galland, B. C., Morrison, S., Jaques, M., & Taylor, R. W. (2026) · Journal of Activity Sedentary and Sleep Behaviors · doi:10.1186/s44167-026-00095-1
Self-citationRasmussen, C. L., Sanders, T., Howie, E. K., Beynon, A. M., Hendry, D., Zabatiero, J. G., Campbell, A., & Straker, L. M. (2026) · Journal of Medical Internet Research · doi:10.2196/100559
- Authors
- Brosnan, B. J., Wickham, S.-R., Meredith-Jones, K. A., Galland, B. C., Haszard, J. J., & Taylor, R. W.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- Taylor, Rachael W.
- ORCID
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2023-11
- Volume
- 65
- Issue
- 5
- Pages
- 923-931
- ISSN
- 0749-3797 (ISSN-L)
- OpenAlex
- W4372342559
- Cited by
- 7
- References
- 30
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 2
- FWCI
- 5.19
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Child Development and Digital Technology
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Health Sciences › Medicine › Physiology › Physical Activity and Health
- Keywords
- screen time, digital device use, adolescents, coding protocol, inter-rater reliability, device type, family environment
- MeSH terms
- Wearable Electronic Devices, Screen Time, Adolescent, Child, Female, Humans, Male, Surveys and Questionnaires, Television, Video Recording, Reproducibility of Results, Video Games, Social Media
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
