Examiner alignment and assessment in clinical periodontal research
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Periodontal research typically relies on clinical examiners to assess variables such as gingival inflammation, plaque scores or probing depths as a means of determining treatment outcomes or for performing group comparisons. The quality of the gathered information is dependent, to a large extent, on the skills of the examiner(s) and on the validity of the assessment methods that are used. Attempts have been made to increase the objectivity of periodontal assessments, for example by introducing scoring systems for gingival inflammation, but within these systems there is often considerable scope for variation when interpreting the scoring criteria, leading to subjectivity when assigning scores to individual periodontal sites. This has led to an awareness of the importance of examiner alignment and assessment to improve the data quality by standardizing techniques and improving examiner reliability. Examiner alignment and assessment is used in preference to the term ‘examiner calibration’ because calibration implies comparison with an accurate or ‘gold’ standard, which is not available in periodontal research. In this review, we consider the historical perspective that led to the development of clinical scoring systems for periodontal research using gingival inflammation as an example. A clinical protocol for undertaking examiner alignment and assessment is presented, and we review the common sources of error and bias that can lead to difficulties in aligning examiners, and consider how they can be eliminated. It is particularly important that subjects who are recruited to the examiner alignment and assessment study present with a comparable level of disease to the subjects who will ultimately be recruited to the planned clinical trial. Another challenge in examiner alignment and assessment is applying appropriate statistical tests to assess the outcome of the alignment exercise. In the periodontal literature, the statistic kappa is frequently used to confirm an adequate degree of examiner agreement, but kappa is bound to significant restrictions when applied for this purpose. Through the use of case studies, we present different approaches to data analysis from calibration studies, focusing on continuous variables (such as probing depths and attachment levels) or ordinal data (such as gingival or plaque indices), to enable a correct, although frequently conservative, interpretation of data generated during examiner alignment and assessment studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Periodontal Disease in Pregnancy II. Correlation Between Oral Hygiene and Periodontal Condition
Silness, J., & Löe, H. (1964) · Acta Odontologica Scandinavica · doi:10.3109/00016356408993968 · Cited by 7,932
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
The kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163
Reduced plaque formation by the chloromethyl analogue of victamine C
Turesky, S., Gilmore, N. D., & Glickman, I. (1970) · Journal of Periodontology · doi:10.1902/jop.1970.41.1.41 · Cited by 1,450
Moher, D., Schulz, K. F., Altman, D. G., & for the CONSORT Group* (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00011 · Cited by 1,426
Cited by
Tooth brushing for oral prophylaxis
Hayasaki, H., Saitoh, I., Nakakura-Ohshima, K., Hanasaki, M., Nogami, Y., Nakajima, T., Inada, E., Iwasaki, T., Iwase, Y., Sawami, T., et al. (2014) · Japanese Dental Science Review · doi:10.1016/j.jdsr.2014.04.001 · Cited by 81
“Therefore, much attention has to be paid to the common sources of error and bias that can lead to difficulties in standardizing examiners [68].”
BackgroundRamsay, C. R., Clarkson, J. E., Duncan, A., Lamont, T. J., Heasman, P. A., Boyers, D., Goulão, B., Bonetti, D., Bruce, R., Gouick, J., et al. (2018) · Health Technology Assessment · doi:10.3310/hta22380 · Cited by 57
Risk-based, 6-monthly and 24-monthly dental check-ups for adults: the INTERVAL three-arm RCT
Clarkson, J. E., Pitts, N. B., Goulao, B., Boyers, D., Ramsay, C. R., Floate, R., Braid, H. J., Fee, P. A., Ord, F. S., Worthington, H. V., et al. (2020) · Health Technology Assessment · doi:10.3310/hta24600 · Cited by 35
Interdental hygiene index – A proposal of dual-purpose tool for patient assessment and motivation
Subramanya, A., & Prabhuji, M. V. (2021) · Journal of Indian Society of Periodontology · doi:10.4103/jisp.jisp_852_20 · Cited by 3
Metadata
- Authors
- Hefti, A. F., & Preshaw, P. M.
- Venue
- Periodontology 2000
- Publisher
- Wiley
- Published
- 2012-04-17
- Volume
- 59
- Issue
- 1
- Pages
- 41-60
- ISSN
- 0906-6713 (ISSN-L)
- 1600-0757
- OpenAlex
- W1940142545
- Cited by
- 97
- References
- 13
- FWCI
- 4.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Examiner alignment and assessment in clinical periodontal research. https://app.cochat.ai/papers/10.1111/j.1600-0757.2011.00436.x
- The paper
- Hefti, A. F., & Preshaw, P. M. (2012). Examiner alignment and assessment in clinical periodontal research. Periodontology 2000. https://doi.org/10.1111/j.1600-0757.2011.00436.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.