CoChat
Sign Up
Cited by 72Reliability and Agreement in MeasurementEarly Childhood Education and DevelopmentPsychometric Methodologies and Testing

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Rater calibration when observational assessment occurs at large scale: Degree of calibration and characteristics of raters associated with calibration

Cash, Anne H., Hamre, Bridget K., Pianta, Robert C., Myers, Sonya S.·2012·Early Childhood Research Quarterly
DOI 10.1016/j.ecresq.2011.12.006
Open this paper in CoChat — free account

Overview

Integrity signals

Registry

Crossref · 10.1016/j.ecresq.2011.12.006

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 25

  1. Arnett, 1989, Caregivers in day-care centers: Does training matter, Journal of Applied Developmental Psychology, 10, 541, 10.1016/0193-3973(89)90026-9 · DOI
  2. Burchinal, 2008, Predicting child outcomes at the end of kindergarten from the quality of pre-kindergarten teacher–child interactions and instruction, Applied Developmental Science, 12, 140, 10.1080/10888690802199418 · DOI
  3. Burchinal, 2010, Threshold analysis of association between child care quality and child outcomes for low-income children in pre-kindergarten programs, Early Childhood Research Quarterly, 25, 166, 10.1016/j.ecresq.2009.10.004 · DOI
  4. Clifford, 2005, What is pre-kindergarten? Characteristics of public pre-kindergarten programs, Applied Developmental Science, 9, 126, 10.1207/s1532480xads0903_1 · DOI
  5. Cohen, 1968, Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit, Psychological Bulletin, 70, 213, 10.1037/h0026256 · DOI · Paper page
  6. Colvin, 2009, Using observational data to provide performance feedback to teachers: A high school case study, Preventing School Failure, 53, 95, 10.3200/PSFL.53.2.95-104 · DOI
  7. Curby, 2009, The relations of observed pre-K classroom quality profiles to children's achievement and social competence, Early Education & Development, 20, 346, 10.1080/10409280802581284 · DOI
  8. Dickinson, 2007, Building support for language and early literacy in preschool classrooms through in-service professional development: Effects of the Literacy Environment Enrichment Program (LEEP), Early Childhood Research Quarterly, 22, 243, 10.1016/j.ecresq.2007.03.001 · DOI
  9. Fleiss, 1973, The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability, Educational and Pyschological Measurement, 33, 613, 10.1177/001316447303300309 · DOI · Paper page
  10. Graham, 2009, Missing data analysis: Making it work in the real world, Annual Review of Psychology, 60, 6.1, 10.1146/annurev.psych.58.110405.085530 · DOI · Paper page
  11. Hamre, 2005, Can instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure?, Child Development, 76, 949, 10.1111/j.1467-8624.2005.00889.x · DOI · Paper page
  12. Hintze, 2005, Psychometrics of direct observation, School Psychology Review, 34, 507, 10.1080/02796015.2005.12088012 · DOI
  13. Howes, 2008, Ready to learn? Children's pre-academic achievement in pre-Kindergarten programs, Early Childhood Research Quarterly, 23, 27, 10.1016/j.ecresq.2007.05.002 · DOI
  14. Landis, 1977, The measurement of observer agreement for categorical data, Biometrics, 33, 159, 10.2307/2529310 · DOI · Paper page
  15. LoCasale-Crouch, 2007, Observed classroom quality profiles in state-funded pre-kindergarten programs and associations with teacher, program, and classroom characteristics, Early Childhood Research Quarterly, 22, 3, 10.1016/j.ecresq.2006.05.001 · DOI
  16. Mashburn, 2008, Measures of classroom quality in prekindergarten and children's development of academic, language, and social skills, Child Development, 79, 732, 10.1111/j.1467-8624.2008.01154.x · DOI
  17. Moon, 2005, Training and scoring issues involved in large-scale writing assessments, Educational Measurement: Issues and Practice, 21, 15, 10.1111/j.1745-3992.2002.tb00088.x · DOI
  18. NICHD ECCRN, 2005, A day in third grade: A large-scale study of classroom quality and teacher and student behavior, Elementary School Journal, 105, 305, 10.1086/428746 · DOI
  19. NICHD ECCRN, 2006, Child-care effect sizes for the NICHD Study of Early Child Care and Youth Development, American Psychologist, 61, 99, 10.1037/0003-066X.61.2.99 · DOI
  20. Penny, 2003, Reading high stakes writing samples: My life as a reader, Assessing Writing, 8, 192, 10.1016/j.asw.2003.08.001 · DOI
  21. Pianta, 2009, Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity, Educational Researcher, 38, 109, 10.3102/0013189X09332374 · DOI · Paper page
  22. Pianta, 2005, Features of pre-kindergarten programs, classrooms, and teachers: Do they predict observed classroom quality and child-teacher interactions?, Applied Developmental Science, 9, 144, 10.1207/s1532480xads0903_2 · DOI
  23. Raudenbush, 2008, Statistical inference when classroom quality is measured with error, Journal of Research on Educational Effectiveness, 1, 138, 10.1080/19345740801982104 · DOI
  24. Rimm-Kaufman, 2009, The contribution of children's self-regulation and classroom quality to children's adaptive behaviors in the kindergarten classroom, Developmental Psychology, 45, 958, 10.1037/a0015861 · DOI
  25. Schafer, 2005, Resistance to confounding style and content in scoring constructed-response items, Educational Measurement: Issues and Practice, 24, 22, 10.1111/j.1745-3992.2005.00008.x · DOI

Cited by

Sorted by citations

Metadata

Authors
Cash, A. H., Hamre, B. K., Pianta, R. C., & Myers, S. S.
Affiliations
  • University of Virginia (US)
  • Vanderbilt University (US)
Corresponding author
Cash, Anne H.
ORCID
Venue
Early Childhood Research Quarterly
Publisher
Elsevier BV
Published
2012-07
Volume
27
Issue
3
Pages
529-542
ISSN
0885-2006 (ISSN-L)
DOI
10.1016/j.ecresq.2011.12.006
OpenAlex
W2080938179
Cited by
72
References
1
Citations by year
2026: 3 · 2025: 6 · 2024: 3 · 2023: 3 · 2022: 4 · 2021: 8 · 2020: 10 · 2019: 5 · 2018: 7 · 2017: 3 · 2016: 3 · 2015: 5 · 2014: 7 · 2013: 3 · 2012: 2
FWCI
5.73
Type
journal article
Language
en
Open access
closed
Licence
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations
Early Childhood Research Quarterly (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
  • Social Sciences › Education › Early Childhood Education and Development
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords
rater calibration, observational assessment, Classroom Assessment Scoring System, rater training, teacher effectiveness, early childhood education, Head Start, large-scale assessment, rater characteristics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review