Cited by 23Digital Economy and Work TransformationLegal and Labor StudiesInformation Systems Theories and Implementation

Everything We Do, Everything We Press: Data-Driven Remote Performance Management in a Mobile Workplace

Open access
Bakewell, Lyndsey L., Vasileiou, Konstantina, Long, Kiel S., Atkinson, Mark, Rice, Helen, Barreto, Manuela, Barnett, Julie, Wilson, Michael +2 more·2018·Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Abstract

This paper examines how data-driven performance monitoring technologies affect the work of telecommunications field engineers. As a mobile workforce, this occupational group rely on an array of smartphone applications to plan, manage and report on their jobs, and to liaise remotely with managers and colleagues. These technologies intend to help field engineers be more productive and have greater control over their work; however they also gather data related to the quantity and effectiveness of their labor. We conducted a qualitative study examining engineers' experiences of these systems. Our findings suggest they simultaneously enhance worker autonomy, support co-ordination with and monitoring of colleagues, but promote anxieties around productivity and the interpretation of data by management. We discuss the implications of data-driven performance management technologies on worker agency, and examine the consequences of such systems in an era of quantified workplaces.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3173574.3173945

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Use of top performers' scores as an ever-increasing standard of performance is likely to result in perpetually higher expectations and work intensification.

    “According to Bakewell et al. (2018) and Guendelsberger (2019), the use of top performers' scores as the ever-increasing standard of performance is likely to result in perpetually higher expectations and work intensification.”

    From Algorithms as work designers: How algorithmic management influences the design of jobs (2022) · cites this paper as Bakewell et al., 2018

    In “Being Monitored and Monitoring Others” (page not provided), the paper reports that engineers compared their performance with colleagues and that the apps encouraged competition. In “Flexibility, Accountability, and Intensification of Work” (page not provided), it describes intensified work. It does not say that top performers’ scores became an ever-rising standard or that expectations rose perpetually. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Evidence shows advantages of providing employees with a staff application to modify algorithmic scheduling or task assignment decisions, to pick a better task assignment or to swap shifts with coworkers without penalties.

    “Evidence shows the advantages of providing employees with a staff application to modify algorithmic scheduling or task assignment decisions, to pick a better task assignment or to swap shifts with coworkers without penalties (Bakewell et al., 2018;Williams, 2017).”

    From Algorithms as work designers: How algorithmic management influences the design of jobs (2022) · cites this paper as Bakewell et al., 2018

    In “Independence and (not) Being in Control” (page unavailable), engineers viewed the ability to reorder assigned jobs through the Your Jobs app positively. But they could not change which jobs were assigned or move jobs between morning and afternoon; the section also reports concern that poor scheduling decisions would be held against them. The paper does not establish an ability to choose a better assignment or swap shifts with coworkers without penalties. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Algorithmic metrics can play a central role in the performance management process of traditional workers.

    “Some studies have described how these metrics can play a central role (if not the entire role) in the performance management process of both traditional workers (Bakewell et al., 2018;Dhir & Chhabra, 2019;Evans & Kitchin, 2018;Kirven, 2018;Levy & Barocas, 2018) and gig workers (Gerber & Krzywdzinski, 2019).”
  • Algorithmic performance management is positively associated with workload.

    “Workload (+)”

    From Algorithms as work designers: How algorithmic management influences the design of jobs (2022) · cites this paper as Bakewell et al. (2018)

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 65

  1. Pav Akhtar and Phoebe Moore. 2016. The psychosocial impacts of technological change in contemporary workplaces, and trade union responses. International Journal of Labour Research 8, 1/2: 101-131.
  2. Kristina Andersen. 2013. Making magic machines. In Proceedings of 10 th European Academy of Design Conference-Crafting the Future. DOI: https://doi.org/10.13140/2.1.1280.1285 · DOI
  3. Kirstie Ball. 2010. Workplace surveillance: An overview. Labor Hist 51, 1: 87-106. DOI: http://dx.doi.org/10.1080/00236561003654776 · DOI
  4. Eric P.S. Baumer. 2015. Usees. In Proceedings of the 33 rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 3295-3298. DOI: http://dx.doi.org/10.1145/2702123.2702147 · DOI
  5. Eric P.S. Baumer, Morgan G. Ames, Jenna Burrell, Jed R. Brubaker, and Paul Dourish. 2015. Why study technology non-use?. First Monday 20, 11. DOI: http://dx.doi.org/10.5210/fm.v20i11.6310 · DOI
  6. Ethan S. Bernstein. 2012. The transparency paradox: A role for privacy in organizational learning and operational control. Adm Sci Q 57, 2: 181-216. DOI: https://doi.org/10.1177/0001839212453028 · DOI
  7. Jacob T. Biehl, Thea Turner, William van Melle, and Andreas Girgensohn. 2011. myUnity: A new platform to support communication in the modern workplace. In Proceedings of the 19 th ACM international conference on Multimedia (MM '11), 801-802. DOI: http://dx.doi.org/10.1145/2072298.2072465 · DOI
  8. Mark Blythe, Kristina Andersen, Rachel Clarke, and Peter Wright. 2016. Anti-solutionist strategies: Seriously silly design fiction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 4968-4978. DOI: http://dx.doi.org/10.1145/2858036.2858482 · DOI
  9. Kristina A. Bourne and Pamela J. Forman. 2014. Living in a culture of overwork: An ethnographic study of flexibility. J Manag Inq 23, 1: 68-79. DOI: https://doi.org/10.1177/1056492613481245 · DOI
  10. Jacqueline Brodie and Mark Perry. 2001. Designing for mobility, collaboration and information use by bluecollar workers. SIGGROUP Bull. 22, 3: 22-27. DOI: http://dx.doi.org/10.1145/567352.567356 · DOI
  11. Graham Button and Wes Sharrock. 1997. The production of order and the order of production: Possibilities for distributed organisations, work and technology in the print industry. In Proceedings of the Fifth European Conference on Computer Supported Cooperative Work (ECSCW '97), 1-16. ISBN:0-7923-4638-6
  12. Chris Caplice and Yossi Sheffi. 1995. A review and evaluation of logistics performance measurement systems. The International Journal of Logistics Management, 6, 1: 61-74. DOI: https://doi.org/10.1108/09574099510805279 · DOI
  13. Goutam Challagalla, Tasadduq Shervani, and George Huber. 2000. Supervisory orientations and salesperson work outcomes: The moderating effect of salesperson location. Journal of Personal Selling & Sales Management 20, 3: 161-171. DOI: http://dx.doi.org/10.1080/08853134.2000.10754236 · DOI
  14. Adrian K. Clear, Sam Mitchell Finnigan, Patrick Olivier, and Rob Comber. 2017. "I'd want to burn the data or at least nobble the numbers": Towards data- mediated building management for comfort and energy use. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17), 2448-2461. DOI: https://doi.org/10.1145/2998181.2998188 · DOI
  15. Joanne O. Crawford, Laura MacCalman, and Craig Jackson. 2011. The health and well-being of remote and mobile workers. Occup Med 61, 6: 385-394. DOI: https://doi.org/10.1093/occmed/kqr071 · DOI
  16. Kurt T. Dirks and Donald L. Ferrin. 2002. Trust in leadership: Meta-analytic findings and implications for research and practice. J Appl Psychol 87, 4: 611-628. DOI: http://psycnet.apa.org/doi/10.1037/0021- 9010.87.4.611 · DOI · Paper page
  17. Katia Dupret. 2017. Working around technologies- invisible professionalism?. New Technology, Work and Employment 32, 2: 174-187. DOI: http://dx.doi.org/10.1111/ntwe.12093 · DOI
  18. Chris Elsden, Sebastian Mellor, Patrick Olivier, Pete Wheldon, David Kirk, and Rob Comber. 2016. ResViz: Politics and design issues in visualizing academic metrics. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 5015-5027. DOI: https://doi.org/10.1145/2858036.2858181 · DOI
  19. Ben N. Fairweather. 1999. Surveillance in employment: The case of teleworking. J Bus Ethics 22, 1: 39-49. DOI: https://doi.org/10.1023/A:1006104017646 · DOI
  20. Thomas Fritz, Elaine M. Huang, Gail C. Murphy, and Thomas Zimmermann. 2014. Persuasive technology in the real world: A study of long-term use of activity sensing devices for fitness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 487-496. DOI: https://doi.org/10.1145/2556288.2557383 · DOI
  21. Eva Ganglbauer, Geraldine Fitzpatrick, and Florian Güldenpfennig. 2015. Why and what did we throw out?: Probing on Reflection through the Food Waste Diary. In Proceedings of the 33 rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 1105-1114. DOI: https://doi.org/10.1145/2702123.2702284 · DOI
  22. Bill Gaver, Tony Dunne, and Elena Pacenti. 1999. Design: Cultural probes. Interactions 6, 1: 21-29. DOI: http://dx.doi.org/10.1145/291224.291235 · DOI
  23. Nitesh Goyal and Susan R. Fussell. 2017. Intelligent interruption management using electro dermal activity based physiological sensor for collaborative sensemaking. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1, 3: Article 52. DOI: http://doi.org/10.1145/3130917 · DOI · Paper page
  24. Nitesh Goyal, Gilly Leshed, Dan Cosley and Susan R. Fussell. 2014. Effects of implicit sharing in collaborative analysis. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 129-138. DOI:10.1145/2556288.2557229 · DOI
  25. Alicia Grandey. 2000. Emotion regulation in the workplace: A new way to conceptualize emotional labor. J Occup Health Psychol 5, 1: 95-110. DOI: http://psycnet.apa.org/doi/10.1037/1076-8998.5.1.95 · DOI
  26. Samantha J. Holland, Kaila M. Simpson, Reeshad S. Dalal, and Ronald P. Vega. 2016. I can't steal from a coworker if I work from home: Conceptual and measurement-related issues associated with studying counterproductive work behavior in a telework setting. Human Performance 29, 3: 172-190. DOI: http://dx.doi.org/10.1080/08959285.2016.1160094 · DOI
  27. Robert A. Karasek. 1979. Job demands, job decision latitude, and mental strain: Implications for job redesign. Adm Sci Q 24: 285-308. DOI: http://dx.doi.org/10.2307/2392498 · DOI · Paper page
  28. Matthew Kay, Eun Kyoung Choe, Jesse Shepherd, Benjamin Greenstein, Nathaniel Watson, Sunny Consolvo, and Julie A. Kientz. 2012. Lullaby: A capture & access system for understanding the sleep environment. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12), 226-234. DOI: http://dx.doi.org/10.1145/2370216.2370253 · DOI
  29. Steinar Kristoffersen and Fredrik Ljungberg. 1999. "Making place" to make IT work: Empirical explorations of HCI for mobile CSCW. In Proceedings of the International ACM SIGGROUP Conference on Supporting Group Work (GROUP '99), 276-285. DOI: https://doi.org/10.1145/320297.320330 · DOI
  30. Min Kyung Lee, Daniel Kusbit, Evan Metsky, and Laura Dabbish. 2015. Working with machines: The Impact of algorithmic and data-driven management on human workers. In Proceedings of the 33 rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 1603-1612. DOI: https://doi.org/10.1145/2702123.2702548 · DOI · Paper page
  31. Samantha Lee and Brian Kleiner. 2003. Electronic surveillance in the workplace. Management Research News 26, 2/3/4: 72-81. DOI: https://doi.org/10.1108/01409170310784014 · DOI
  32. Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage- based model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), 557-566. DOI: http://dx.doi.org/10.1145/1753326.1753409 · DOI
  33. Deborah Lupton. 2014. Self-tracking cultures: Towards a sociology of personal informatics. In Proceedings of the 26 th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design (OzCHI '14), 77-86. DOI: http://dx.doi.org/10.1145/2686612.2686623 · DOI
  34. Deborah Lupton. 2016. The diverse domains of quantified selves: Self-tracking modes and dataveillance. Econ Soc 45, 1: 101-122. DOI: http://dx.doi.org/10.1080/03085147.2016.1143726 · DOI
  35. Deborah Lupton. 2016. The quantified self. John Wiley & Sons.
  36. Robert MacKenzie, Abigail Marks, and Kate Morgan. 2017. Technology, affordances and occupational identity amongst older telecommunications engineers: From living machines to black-boxes. Sociology 51, 4: 732-748. DOI: https://doi.org/10.1177/0038038515616352 · DOI
  37. Gloria Mark, Shamsi Iqbal, Mary Czerwinski, and Paul Johns. 2015. Focused, aroused, but so distractible: A temporal perspective on multitasking and communications. In Proceedings of the 18 th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15), 903-916. DOI: 10.1145/2675133.2675221 · DOI
  38. Afra Mashhadi, Fahim Kawsar, Akhil Mathur, Casey Dugan, and N. Sadat Shami. 2016. Let's talk about the quantified workplace. In Proceedings of the 19 th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (CSCW '16 Companion), 522-528. DOI: http://dx.doi.org/10.1145/2818052.2855514 · DOI
  39. Akhil Mathur, Marc Van den Broeck, Geert Vanderhulst, Afra Mashhadi, and Fahim Kawsar. 2015. Quantified workplace: Opportunities and challenges. In Proceedings of the 2 nd workshop on Workshop on Physical Analytics (WPA '15), 37-41. DOI: http://dx.doi.org/10.1145/2753497.2753500 · DOI
  40. Laurel McNall and Jeffrey M. Stanton. 2011. Private eyes are watching you: Reactions to location sensing technologies. J Bus Psychol 26, 3: 299-309. DOI: https://doi.org/10.1007/s10869-010-9189-y · DOI
  41. Mareike Möhlmann and Lior Zalmanson. 2017. Hands on the wheel: Navigating algorithmic management and Uber drivers' autonomy. In Proceedings of the 38 th International Conference on Information Systems (ICIS 2017). December 10-13, Seoul, South Korea.
  42. Phoebe Moore and Andrew Robinson. 2016. The quantified self: What counts in the neoliberal workplace. New Media Soc 18, 11: 2774-2792. DOI: https://doi.org/10.1177/1461444815604328 · DOI · Paper page
  43. Phoebe Moore. 2018. The quantified self in precarity: Work, technology and what counts. Routledge.
  44. Andrew J. Morris and Daniel C. Feldman. 2010. The dimensions, antecedents, and consequences of emotional labor. Acad Manag Rev 21, 4: 986-1010. DOI: http://www.jstor.org/stable/259161
  45. Jay Prakash Mulki, William B. Locander, Greg W. Marshall, Eric G. Harris, and James Hensel. 2008. Workplace isolation, salesperson commitment, and job performance. Journal of Personal Selling & Sales Management 28, 1: 67-78. DOI: https://doi.org/10.2753/PSS0885-3134280105 · DOI
  46. Tadashi Okoshi, Julian Ramos, Hiroki Nozaki, Jin Nakazawa, Anind K. Dey and Hideyuki Tokuda. 2015. Reducing users' perceived mental effort due to interruptive notifications in multi-device mobile environments. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15), 475-486. DOI: 10.1145/2750858.2807517 · DOI
  47. Julian Orr. 1996. Talking about machines: An ethnography of a modern job. Cornell University Press.
  48. Sharoda A. Paul and Joe W. Bolinger. 2015. Ask an Expert: Mobile workspaces for collaborative troubleshooting. In 48 th Hawaii International Conference on System Sciences (HICSS '15), 442-451. DOI:10.1109/HICSS.2015.60 · DOI
  49. Jun-jie Peng. 2008. A survey of location based service for Galileo system. In Proceedings of International Symposium on Computer Science and Computational Technology (ISCSCT '08), 737-741. DOI: 10.1109/ISCSCT.2008.33 · DOI
  50. Elpida Prasopoulou, Athanasia Pouloudi, and Niki Panteli. 2006. Enacting new temporal boundaries: The role of mobile phones. Eur J Inf Syst 15, 3: 277-284. DOI: https://doi.org/10.1057/palgrave.ejis.3000617 · DOI
  51. Gary W. Pritchard, John Vines, Pam Briggs, Lisa Thomas, and Patrick Olivier. 2014. Digitally driven: How location based services impact the work practices of London bus drivers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 3617-3626. DOI: https://doi.org/10.1145/2556288.2557156 · DOI · Paper page
  52. Gary W. Pritchard, Pam Briggs, John Vines, and Patrick Olivier. 2015. How to drive a London bus: Measuring performance in a mobile and remote workplace. In Proceedings of the 33 rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 1885-1894. DOI: https://doi.org/10.1145/2702123.2702307 · DOI
  53. Aare Puussaar, Adrian K. Clear, and Peter Wright. 2017. Enhancing personal informatics through social sensemaking. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17), 6936-6942. DOI: https://doi.org/10.1145/3025453.3025804 · DOI
  54. Gudbjörg Linda Rafnsdóttir and Margrét Lilja Gudmundsdottir. 2011. EPM technology and the psychosocial work environment. New Technology, Work and Employment 26, 3: 210-221. DOI: http://dx.doi.org/10.1111/j.1468-005X.2011.00270.x · DOI
  55. John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers Chalmers. 2014. Personal tracking as lived informatics. In Proceedings of the 32 nd annual ACM conference on Human Factors in Computing Systems (CHI '14), 1163-1172. DOI: http://doi.acm.org/10.1145/2556288.2557039 · DOI
  56. Benjamin Schneider and David E. Bowen. 1985. Employee and customer perceptions of service in banks: Replication and extension. J. Appl. Psycho 70, 3: 423-433. DOI: 10.1037/0021-9010.70.3.423 · DOI
  57. Abigail Sellen, Rachel Eardley, Shahram Izadi, and Richard Harper. 2006. The whereabouts clock: Early testing of a situated awareness device. In CHI '06 Extended Abstracts on Human Factors in Computing Systems (CHI EA '06), 1307-1312. DOI: http://dx.doi.org/10.1145/1125451.1125694 · DOI
  58. Johannes Siegrist. 1996. Adverse health effects of high-effort/low-reward conditions. J Occup Health Psychol 1, 1: 27-41. DOI: http://dx.doi.org/10.1037/1076-8998.1.1.27 · DOI · Paper page
  59. Baris Şimşek, Fatma Pakdil, Berna Dengiz, and Murat Caner Testik. 2013. Driver performance appraisal using GPS terminal measurements: A conceptual framework. Transportation Research Part C: Emerging Technologies 26: 49-60. DOI: https://doi.org/10.1016/j.trc.2012.07.006 · DOI
  60. M. J. Smith, Pascale Carayon, Katherine J. Sanders, S. Y. Lim, and David LeGrande. 1992. Employee stress and health complaints in jobs with and without electronic performance monitoring. Appl Ergon 23, 1: 17-27. DOI: https://doi.org/10.1016/0003- 6870(92)90006-H 72. Rannie Teodoro, Pinar Ozturk, Mor Naaman, Winter Mason, and Janne Lindqvist. 2014. The motivations and experiences of the on-demand mobile workforce. In Proceedings of the 17 th ACM conference on Computer Supported Cooperative Work & Social Computing (CSCW'14), 236-247. DOI: 10.1145/2531602.2531680 · DOI
  61. Anja Thieme, Rob Comber, Julia Miebach, Jack Weeden, Nicole Kraemer, Shaun Lawson, and Patrick Olivier. 2012. "We've bin watching you": Designing for reflection and social persuasion to promote sustainable lifestyles. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 2337-2346. DOI: http://dx.doi.org/10.1145/2207676.2208394 · DOI
  62. Ian Towers, Linda Duxbury, Christopher Higgins, and John Thomas. 2006. Time thieves and space invaders: Technology, work and the organization. Journal of Organizational Change Management 19, 5: 593-618. DOI: https://doi.org/10.1108/09534810610686076 · DOI
  63. John Vines, Mark Blythe, Stephen Lindsay, Paul Dunphy, Andrew Monk, and Patrick Olivier. 2012. Questionable concepts: critique as resource for designing with eighty somethings. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 1169-1178. DOI: http://dx.doi.org/10.1145/2207676.2208567 · DOI
  64. Tao Zhou. 2011. The impact of privacy concern on user adoption of location-based services. Ind Manage Data Syst 11, 2: 212-226. DOI: https://doi.org/10.1108/02635571111115146 · DOI · Paper page
  65. David Zweig and Jane Webster. 2002. Where is the line between benign and invasive? An examination of psychological barriers to the acceptance of awareness monitoring systems. J Organ Behav 23, 5: 605-633. DOI: http://dx.doi.org/10.1002/job.157 · DOI

Cited by

Sorted by citations

Authors
Bakewell, L. L., Vasileiou, K., Long, K. S., Atkinson, M., Rice, H., Barreto, M., Barnett, J., Wilson, M., Lawson, S., & Vines, J.
Affiliations
  • Loughborough University (GB)
  • University of Bath (GB)
  • Northumbria University (GB)
  • University of Exeter (GB)
  • Independent Researcher, Newcastle upon Tyne, United Kingdom
Venue
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2018-04-21
Pages
1-14
OpenAlex
W2796424995
Cited by
23
References
3
Citations by year
2026: 3 · 2025: 1 · 2024: 6 · 2023: 4 · 2021: 5 · 2020: 1 · 2019: 3
FWCI
6.86
Type
conference paper
Language
en
Open access
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
  • Northumbria Research Link (Northumbria University) (submittedVersion)
  • Open Research Exeter (University of Exeter) (submittedVersion)
  • DMU Open Research Archive (De Montfort University) (submittedVersion)
  • Loughborough University Institutional Repository (Loughborough University) (submittedVersion, cc-by-nc-nd)
Funders
ESRC (ES/M003558/1)
Topics
  • Social Sciences › Sociology and Political Science › Digital Economy and Work Transformation
  • Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
  • Social Sciences › Sociology and Political Science › Information Systems Theories and Implementation
Keywords
mobile workforce, mobile application, employee autonomy, worker agency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review