Development of the Electronic Social Network Assessment Program Using the Center for eHealth and Wellbeing Research Roadmap
Open accessAbstract
BACKGROUND: The number of Web-based psychological and behavioral interventions is growing. Beyond their theoretical underpinnings, a key factor to the success of these interventions is how they are designed and developed to ensure usability over a new method of delivery. Our team has adapted ecomapping, a tool for visualizing family caregiver social network resources, for the Web. Here, we describe how we designed and developed the electronic Social Network Assessment Program (eSNAP) Web-based tool using a framework of the Center for eHealth and Wellbeing Research (CeHRes) Roadmap for Web-based intervention development. The CeHRes Roadmap is still new in terms of tool development and we showcase an example of its application. OBJECTIVE: The aim of our study was to provide an example of the application of the Web-based intervention development process using the CeHRes Roadmap for other research teams to follow. In doing so, we are also sharing our pilot work to enhance eSNAP's acceptance and usability for users and the feasibility of its implementation. METHODS: We describe the development of the eSNAP app to support family caregivers of neuro-oncology patients. This development is based on the 5 iterative stages of the CeHRes Roadmap: contextual inquiry, value specification, design, operationalization, and summative evaluation. Research activities to support eSNAP development prior to implementation included literature review, focus groups, and iterative rounds of interviews. RESULTS: Key lessons learned in developing the eSNAP app broadly fell under a theme of translating theoretical needs and ideas to the real world. This included how to prioritize needs to be addressed at one time, how the modality of delivery may change design requirements, and how to develop a tool to fit within the context it will be used. CONCLUSIONS: Using the CeHRes Roadmap to develop Web-based interventions such as eSNAP helps to address potential issues by outlining important intervention development milestones. In addition, by encouraging inclusion of users and other stakeholders in the process, Web-based intervention developers using the Roadmap can identify what will work in the real world and increase feasibility and effectiveness.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Because major changes might be made to prototypes in an iterative development process, changes to the requirements might also be necessary to ensure that they remain in line with the prototype of the eHealth technology.
“Third, because major changes might be made to prototypes in an iterative development process, changes to the requirements might also be necessary to ensure that they remain in line with the prototype of the eHealth technology.”
From Methods for Human-Centered eHealth Development: Narrative Scoping Review (2022) · cites this paper as [55]
The included studies showed that there is not 1 single way to create a prototype.
“First, the included studies showed that there is not 1 single way to create a prototype.”
From Methods for Human-Centered eHealth Development: Narrative Scoping Review (2022) · cites this paper as [55]
When shaping a multi-method or mixed methods development process, an iterative and flexible development approach is key.
“the lessons learned illustrated that when shaping a multi-method or mixed methods development process, an iterative and flexible development approach is key [33,54,55,64,113,115].”
From Methods for Human-Centered eHealth Development: Narrative Scoping Review (2022) · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Caregiving and the stress process: an overview of concepts and their measures
Pearlin, L. I., Mullan, J. T., Semple, S. J., & Skaff, M. M. (1990) · The Gerontologist · doi:10.1093/geront/30.5.583 · Cited by 4,810 · see citing works
A Holistic Framework to Improve the Uptake and Impact of eHealth Technologies
van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G., & Seydel, E. R. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1672 · Cited by 1,126 · see citing works
Wantland, D. J., Portillo, C. J., Holzemer, W. L., Slaughter, R., & McGhee, E. M. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.4.e40 · Cited by 966 · see citing works
The Delivery of Public Health Interventions via the Internet: Actualizing Their Potential
Bennett, G. G., & Glasgow, R. E. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100235 · Cited by 800 · see citing works
The elements of user experience: user-centered design for the Web and beyond
(2011) · Choice Reviews Online · doi:10.5860/choice.49-0321 · Cited by 757 · see citing works
Caregiving Burden, Stress, and Health Effects Among Family Caregivers of Adult Cancer Patients
Bevans, M., & Sternberg, E. M. (2012) · JAMA · doi:10.1001/jama.2012.29 · Cited by 620 · see citing works
Psychosocial Care for Family Caregivers of Patients With Cancer
Northouse, L., Williams, A.-L., Given, B., & McCorkle, R. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.39.5798 · Cited by 527 · see citing works
A systematic review of telehealth tools and interventions to support family caregivers
Chi, N.-C., & Demiris, G. (2015) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x14562734 · Cited by 409 · see citing works
Samoocha, D., Bruinvels, D. J., Elbers, N. A., Anema, J. R., & van der Beek, A. J. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1286 · Cited by 369 · see citing works
Robison, J., Fortinsky, R., Kleppinger, A., Shugrue, N., & Porter, M. (2009) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/gbp015 · Cited by 306 · see citing works
Web-Based Interventions for Behavior Change and Self-Management: Potential, Pitfalls, and Progress
Murray, E. (2012) · Medicine 2.0 · doi:10.2196/med20.1741 · Cited by 219 · see citing works
Social support and immune function among spouses of cancer patients.
Baron, R. S., Cutrona, C. E., Hicklin, D. J., Russell, D. W., & al, E. (1990) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.59.2.344 · Cited by 219 · see citing works
Reeves, D., Blickem, C., Vassilev, I., Brooks, H., Kennedy, A., Richardson, G., & Rogers, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098340 · Cited by 213 · see citing works
Psychological Adjustment to Sudden and Anticipated Spousal Loss Among Older Widowed Persons
Carr, D., House, J. S., Wortman, C. B., Nesse, R. M., & Kessler, R. C. (2001) · The Journals of Gerontology Series B · doi:10.1093/geronb/56.4.s237 · Cited by 196 · see citing works
Social support and immune function among spouses of cancer patients.
Baron, R. S., Cutrona, C. E., Hicklin, D. J., et al. (1990) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.59.2.344 · Cited by 158 · see citing works
Implementation science approaches for integrating eHealth research into practice and policy
Glasgow, R. E., Phillips, S. M., & Sanchez, M. A. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2013.07.002 · Cited by 155 · see citing works
Kim, Y., Carver, C. S., Shaffer, K. M., Gansler, T. S., & Cannady, R. (2014) · Cancer · doi:10.1002/cncr.29040 · Cited by 145 · see citing works
The Promise and Challenge of eHealth Interventions
Atkinson, N. L., & Gold, R. S. (2002) · American Journal of Health Behavior · doi:10.5993/ajhb.26.6.10 · Cited by 140 · see citing works
A Tailored Web-Based Psycho-Educational Intervention for Cancer Patients and Their Family Caregivers
Northouse, L., Schafenacker, A. M., Barr, K. L. C., Katapodi, M., Yoon, H., Brittain, K., Song, L.-X., Ronis, D., & An, L. C. (2014) · Cancer Nursing · doi:10.1097/ncc.0000000000000159 · Cited by 140 · see citing works
Predictors of caregiver burden following traumatic brain injury
Nabors, N. A., Seacat, J. P., & Rosenthal, M. (2002) · Brain Injury · doi:10.1080/02699050210155285 · Cited by 131 · see citing works
Interactive Use of Genograms and Ecomaps in Family Caregiving Research
Rempel, G. R., Neufeld, A., & Kushner, K. E. (2007) · Journal of Family Nursing · doi:10.1177/1074840707307917 · Cited by 122 · see citing works
The impact of age, treatment, and symptoms on the physical and mental health of cancer patients
Given, C. W., Given, B. A., & Stommel, M. (1994) · Cancer · doi:10.1002/1097-0142(19941001)74:7+ · Cited by 112 · see citing works
The Science of Internet Interventions
Ritterband, L. M., & Tate, D. F. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9132-5 · Cited by 111 · see citing works
Caregivers of persons with a brain tumor: a conceptual model
Sherwood, P. R., Given, B. A., Given, C. W., Schiffman, R. F., Murman, D. L., & Lovely, M. (2004) · Nursing Inquiry · doi:10.1111/j.1440-1800.2004.00200.x · Cited by 111 · see citing works
Burton-Chase, A. M., Sautter, J. M., Tulsky, J. A., Lindquist, J. H., Hays, J. C., Olsen, M. K., Zimmerman, S. I., & Steinhauser, K. E. (2012) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2011.09.018 · Cited by 107 · see citing works
Devine, D., Parker, P. A., Fouladi, R. T., & Cohen, L. (2003) · Psycho-Oncology · doi:10.1002/pon.656 · Cited by 105 · see citing works
The value of theory for enhancing and understanding e-health interventions
Pingree, S., Hawkins, R., Baker, T., DuBenske, L., Roberts, L. J., & Gustafson, D. H. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.09.035 · Cited by 103 · see citing works
Aoun, S. M., Deas, K., Toye, C. M., Ewing, G., Grande, G., & Stajduhar, K. (2015) · Palliative Medicine · doi:10.1177/0269216314566061 · Cited by 102 · see citing works
Patient and family caregiver reaction to new and recurrent breast cancer.
Given, B. A., & Given, C. W. (1993) · PubMed · Cited by 99 · see citing works
Evaluation of an integrated graphical display to promote acute change detection in ICU patients
Anders, S. H., Albert, R., Miller, A., Weinger, M. B., Doig, A. K., Behrens, M., & AGUTTER, J. A. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.04.004 · Cited by 97 · see citing works
Self-citationEcomapping: an innovative research tool for nurses
Ray, R., & Street, A. F. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03434.x · Cited by 97 · see citing works
Benefit finding through caring: The cancer caregiver experience
Cassidy, T. (2012) · Psychology and Health · doi:10.1080/08870446.2012.717623 · Cited by 85 · see citing works
McKeown, C. (2010) · Ergonomics · doi:10.1080/00140130903458285 · Cited by 84 · see citing works
The effects of bereavement after family caregiving
Schulz, R., Newsom, J. T., Fleissner, K., DECAMP, A. R., & Nieboer, A. P. (1997) · Aging & Mental Health · doi:10.1080/13607869757173 · Cited by 83 · see citing works
The multidimensional burden of informal caregivers in primary malignant brain tumor
Bayen, E., Laigle-Donadey, F., Prouté, M., Hoang-Xuan, K., Joël, M.-E., & Delattre, J.-Y. (2017) · Supportive Care in Cancer · doi:10.1007/s00520-016-3397-6 · Cited by 82 · see citing works
Uncovering an invisible network of direct caregivers at the end of life: A population study
Burns, C. M., Abernethy, A. P., Grande, E. D., & Currow, D. C. (2013) · Palliative Medicine · doi:10.1177/0269216313483664 · Cited by 76 · see citing works
The influence of end‐of‐life cancer care on caregivers
Doorenbos, A. Z., Given, B. A., Given, C. W., Wyatt, G. K., Gift, A. G., Rahbar, M. H., & Jeon, S. (2007) · Research in Nursing & Health · doi:10.1002/nur.20217 · Cited by 71 · see citing works
Kim, Y., Shaffer, K. M., Carver, C. S., & Cannady, R. S. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0035116 · Cited by 70 · see citing works
Zebrack, B., Kayser, K., Padgett, L., Sundstrom, L., Jobin, C., Nelson, K., & Fineberg, I. C. (2016) · Cancer · doi:10.1002/cncr.30016 · Cited by 54 · see citing works
Mediating burden and stress over time: Caregivers of patients with primary brain tumor
Reblin, M., Small, B. J., Jim, H., Weimer, J. M., & Sherwood, P. R. (2017) · Psycho-Oncology · doi:10.1002/pon.4527 · Cited by 47 · see citing works
Self-citationWeb-based interventions for caregivers of cancer patients: A review of literatures
Tang, W. P., Chan, C. W., So, W. K., & Leung, D. Y. (2014) · Asia-Pacific Journal of Oncology Nursing · doi:10.4103/2347-5625.135811 · Cited by 45 · cited 1× · see citing works
“Other teams focused on providing Web-based information or support groups, which can provide benefit [28,29] but do not address or leverage the existing social network.”
Institute of Medicine Report on Delivery of High-Quality Cancer Care
Ganz, P. A. (2014) · Journal of Oncology Practice · doi:10.1200/jop.2013.001369 · Cited by 38 · see citing works
Wallace, A. S., Driessnack, M., Bohr, N. L., & Tripp‐Reimer, T. (2015) · Nursing Research · doi:10.1097/nnr.0000000000000074 · Cited by 29 · see citing works
Newberry, A., Kuo, J., Donovan, H. S., Given, B. A., Given, C. W., Schulz, R., & Sherwood, P. R. (2012) · Oncology nursing forum · doi:10.1188/12.onf.e226-e232 · Cited by 20 · see citing works
Syroid, N., Liu, D., Albert, R., Agutter, J. A., Egan, T. D., Pace, N. L., Johnson, K. B., Dowdle, M. R., Pulsipher, D., & Westenskow, D. R. (2012) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e31826b46bc · Cited by 15 · see citing works
Self-citationGraphical Arterial Blood Gas Visualization Tool Supports Rapid and Accurate Data Interpretation
Doig, A. K., Albert, R., Syroid, N. D., MOON, S., & AGUTTER, J. A. (2010) · CIN Computers Informatics Nursing · doi:10.1097/ncn.0b013e3181fc4041 · Cited by 12 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- Given, B, 1992, J Am Med Womens Assoc (1972), 47, 201
- Kennedy, V, 2010, MAI Review, 3, 1
- Baron, RS, 1990, J Pers Soc Psychol, 59, 344, 10.1037/0022-3514.59.2.344 · DOI
Cited by
Sorted by citations
Digital Health Interventions for Adolescent and Young Adult Cancer Survivors
Devine, K. A., Viola, A., Coups, E. J., & Wu, Y. P. (2018) · JCO Clinical Cancer Informatics · doi:10.1200/cci.17.00138 · Cited by 174 · see citing works
Self-citationMolina‐Recio, G., Molina‐Luque, R., Jiménez-García, A. M., Ventura-Puertos, P. E., Hernández-Reyes, A., & Romero‐Saldaña, M. (2020) · JMIR mhealth and uhealth · doi:10.2196/14376 · Cited by 89 · see citing works
Methods for Human-Centered eHealth Development: Narrative Scoping Review
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2022) · Journal of Medical Internet Research · doi:10.2196/31858 · Cited by 67 · see citing works
Methods for Human-Centered eHealth Development: Narrative Scoping Review (Preprint)
Kip, H., Keizer, J., da Silva, M. C., Beerlage-de Jong, N., Köhle, N., & Kelders, S. M. (2021) · doi:10.2196/preprints.31858 · Cited by 67 · see citing works
Outcomes of an electronic social network intervention with neuro-oncology patient family caregivers
Reblin, M., Ketcher, D., Forsyth, P. A., Mendivil, E., Kane, L., Pok, J., Meyer, M., Wu, Y. P., & AGUTTER, J. A. (2018) · Journal of Neuro-Oncology · doi:10.1007/s11060-018-2909-2 · Cited by 37 · see citing works
Self-citationKent, E. E., Mollica, M. A., Dionne-Odom, J. N., Ferrer, R. A., Jensen, R. E., Ornstein, K. A., & Smith, A. W. (2020) · Palliative & Supportive Care · doi:10.1017/s1478951520000036 · Cited by 35 · see citing works
Reblin, M., Ketcher, D., Forsyth, P. A., Mendivil, E., Kane, L., Pok, J., Meyer, M., Wu, Y. P., & AGUTTER, J. A. (2018) · Supportive Care in Cancer · doi:10.1007/s00520-018-4293-z · Cited by 30 · see citing works
Self-citationThe Use of Technology to Support Precision Health in Nursing Science
Starkweather, A. R., Jacelon, C. S., Henry, S. B., Barton, D. L., Dabbs, A. D., Dorsey, S. G., Guthrie, B. J., Heitkemper, M. M., Hickey, K. T., Kelechi, T. J., et al. (2019) · Journal of Nursing Scholarship · doi:10.1111/jnu.12518 · Cited by 26 · see citing works
Reblin, M., Ketcher, D., McCormick, R., Barrios‐Monroy, V., Sutton, S. K., Zebrack, B., Wells, K. J., Sahebjam, S., Forsyth, P. A., & Byrne, M. M. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06372-w · Cited by 20 · see citing works
Self-citationUse of Ecomaps in Qualitative Health Research
Manja, V., Nrusimha, A., MacMillan, H. L., Schwartz, L. J., & Jack, S. M. (2021) · The Qualitative Report · doi:10.46743/2160-3715/2021.4565 · Cited by 19 · see citing works
Kim, Y., Lee, J., Moon, Y., Kim, H. J., Shin, J., Park, J. M., Uhm, K. E., Kim, K. J., Yoo, J. A., Oh, Y. K., et al. (2020) · BMC Geriatrics · doi:10.1186/s12877-019-1397-3 · Cited by 15 · see citing works
Social networks of caregivers of patients with primary malignant brain tumor
Ketcher, D., & Reblin, M. (2019) · Psychology Health & Medicine · doi:10.1080/13548506.2019.1619787 · Cited by 14 · see citing works
Self-citationReblin, M., D'Almeida, H., Barrios‐Monroy, V., McCormick, R., Rodriguez, L., Walters, K., Sutton, S. K., Zebrack, B., Forsyth, P. A., Byrne, M. M., et al. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-022-07394-8 · Cited by 11 · see citing works
Self-citationReblin, M., Wells, K. J., Otto, A. K., McCormick, R., Rodriguez, L., Walters, K., Sutton, S. K., Zebrack, B., Forsyth, P. A., & Byrne, M. M. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-022-06977-9 · Cited by 10 · see citing works
Self-citationAddressing Brazilian diversity in personal computing systems with a tailoring-based approach
Néris, V. P. D. A., Fortuna, F. J., Bonacin, R., de Alencar, T. S., Neris, L. D. O., & Baranauskas, M. C. C. (2020) · Personal and Ubiquitous Computing · doi:10.1007/s00779-020-01444-w · Cited by 9 · see citing works
Gudenkauf, L. M., Li, X., Hoogland, A. I., Oswald, L. B., lmanirad, I., Permuth, J. B., Small, B. J., Jim, H., Rodriguez, Y., Bryant, C. A., et al. (2024) · Supportive Care in Cancer · doi:10.1007/s00520-024-08395-5 · Cited by 6 · see citing works
Self-citationAlshehri, F., & Alshaikh, F. (2021) · JMIR Formative Research · doi:10.2196/22968 · Cited by 6 · see citing works
Exploring the Landscape of Eco‐Mapping in Health Services Research: A Comprehensive Review
Saragosa, M., Singh, H., Gray, C. S., Tang, T., Orchanian‐Cheff, A., & Nelson, M. L. A. (2024) · Health & Social Care in the Community · doi:10.1155/2024/9503785 · Cited by 4 · see citing works
Iwata, Y., & Tadaka, E. (2022) · PLoS ONE · doi:10.1371/journal.pone.0273278 · Cited by 3 · see citing works
Kent, E. E., Tan, K., Nakamura, Z. M., Kovacs, J., Gellin, M., Deal, A. M., Park, E. M., & Reblin, M. (2024) · Cancer Medicine · doi:10.1002/cam4.70187 · Cited by 3 · see citing works
Self-citationChoi, H., Sutton, S. K., Witte, D., Pastore, N., Wells, K. J., Zebrack, B., Forsyth, P. A., Byrne, M. M., & Reblin, M. (2025) · Neuro-Oncology Practice · doi:10.1093/nop/npaf048 · Cited by 3 · see citing works
Self-citationReblin, M., Sutton, S. K., Choi, H., Witte, D., Wells, K. J., Zebrack, B., Forsyth, P. A., & Byrne, M. M. (2025) · Neuro-Oncology Practice · doi:10.1093/nop/npaf074 · Cited by 2 · see citing works
Self-citationvan Calis, J. F. E., van Cooten, V. J., Smeets, O., Naaldenberg, J., Boon, B. J. F., Leusink, G. L., & Bevelander, K. E. (2024) · Digital Health · doi:10.1177/20552076241290399 · Cited by 2 · see citing works
Kent, E. E., Deal, A. M., Sperry, S. S., Nakamura, Z. M., Gellin, M., Kovacs, J., Martin, C., & Reblin, M. (2025) · Psycho-Oncology · doi:10.1002/pon.70341 · Cited by 1 · see citing works
Self-citationBrowser-based Infographic Tailoring Self-service Interface (BITSI)
Arcia, A., Chen, D., & South, K. (2022) · Workshop on Visual Analytics in Healthcare (VAHC) · doi:10.1109/vahc57815.2022.10108526 · Cited by 1 · see citing works
Tönis, K. J. M., Drossaert, C. H. C., ten Klooster, P. M., Segers, J., Keren, N., Staal, W., & Bohlmeijer, E. T. (2026) · Research in Neurodiversity · doi:10.1016/j.rin.2026.100050
- Authors
- Reblin, M., Wu, Y. P., Pok, J., Kane, L., Colman, H., Cohen, A. L., Mendivil, E., Warner, E. L., Meyer, M., & Agutter, J.
- Affiliations
- Moffitt Cancer Center (US)
- University of Utah (US)
- Huntsman Cancer Institute (US)
- Corresponding author
- Reblin, Maija
- ORCID
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2017-08-30
- Volume
- 4
- Issue
- 3
- Pages
- e23
- ISSN
- 2292-9495 (ISSN-L)
- PMC
- PMC5597796
- OpenAlex
- W2750859936
- Semantic Scholar
- 6d828c5e23eda6006b8b149f266b94f2de430dfd
- Cited by
- 25
- References
- 46
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 4 · 2022: 4 · 2021: 4 · 2020: 4 · 2019: 2 · 2018: 3
- FWCI
- 2.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Human Factors (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (R03CA201684, K07CA196985)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- family caregivers, usability, contextual inquiry, stakeholder engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
