The DOI matches its Crossref record; 40 of the 44 references it cites were found in a registry or an index.
The Effectiveness of Distance Education across Virginia's Community Colleges: Evidence from Introductory College-Level Math and English Courses
Abstract
Although online learning is rapidly expanding in the community college setting, there is little evidence regarding its effectiveness among community college students. In the current study, the authors used a statewide administrative data set to estimate the effects of taking one's first college-level math or English course online rather than face to face, in terms of both course retention and course performance. Several empirical strategies were used to minimize the effects of student self-selection, including multilevel propensity score. The findings indicate a robust negative impact of online course taking for both subjects. Furthermore, by comparing the results of two matching methods, the authors conclude that within-school matching on the basis of a multilevel model addresses concerns regarding selection issues more effectively than does traditional propensity score matching across schools.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In some large-scale multi-institution studies (Jaggars & Xu, 2010; Xu & Jaggars, 2011a, 2011b), results suggest that online coursework may hinder subsequent semester re-enrollment and students who took a higher proportion of online courses were less likely to graduate or transfer to a senior college.”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Xu & Jaggars, 2011b
In the citing paper
“Xu and Jaggars (2011b) report lower grades for online English and Math “gatekeeper” courses”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Xu and Jaggars (2011b)
In the citing paper
“Xu and Jaggars (2011) found online and face-to-face modalities for introductory math and English indicated a negative correlation between online modality and both retention and course performance.”
From Online or Face to Face? The Modality of a Learning Strategies Course and Impacts on Grades, GPA, Retention and Persistence for Developmental Students (2026) · cites this paper as Xu and Jaggars (2011)
In the citing paper
“Research also suggests that taking online developmental courses may negatively impact future online enrollment (Xu & Jaggars, 2011b*).”
From Post-secondary online learning in the U.S.: an integrative review of the literature on undergraduate student characteristics (2022) · cites this paper as Xu & Jaggars, 2011b*
In the citing paper
“Since some research indicate developmental students may be more vulnerable (Xu & Jaggers, 2011), this population is particularly worthy of examination.”
From Online or Face to Face? The Modality of a Learning Strategies Course and Impacts on Grades, GPA, Retention and Persistence for Developmental Students (2026) · cites this paper as Xu & Jaggers, 2011
Citations
Cites
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 6,472
Propensity Score-Matching Methods for Nonexperimental Causal Studies
Dehejia, R., & Wahba, S. (2002) · The Review of Economics and Statistics · doi:10.1162/003465302317331982 · Cited by 4,864
Quarterly Review of Distance Education
Clark, R. E. (2002) · TechTrends · doi:10.1007/bf03651763 · Cited by 1,631
Bias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. W. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2009.07333 · Cited by 1,416
A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003
Austin, P. C. (2007) · Statistics in Medicine · doi:10.1002/sim.3150 · Cited by 1,249
Journal of Computing Sciences in Colleges
(2019) · Journal of computing sciences in colleges · doi:10.36614/jcsc · Cited by 1,035
The American Community College
Martorana, S. V., Cohen, A. M., & Brawer, F. B. (1983) · The Journal of Higher Education · doi:10.2307/1981815 · Cited by 1,008
Referral, enrollment, and completion in developmental education sequences in community colleges
Bailey, T., Jeong, D. W., & Cho, S.-W. (2010) · Economics of Education Review · doi:10.1016/j.econedurev.2009.09.002 · Cited by 845
New Evidence on College Remediation
Attewell, P. A., Lavin, D. E., Domina, T., & Levey, T. G. (2006) · The Journal of Higher Education · doi:10.1353/jhe.2006.0037 · Cited by 732
(2010) · Cited by 695
Combining Propensity Score Matching with Additional Adjustments for Prognostic Covariates
Rubin, D. B., & Thomas, N. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474233 · Cited by 568
Combining Propensity Score Matching with Additional Adjustments for Prognostic Covariates
Thomas, N. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725.025 · Cited by 508
Covariance Adjustment in Randomized Experiments and Observational Studies
Rosenbaum, P. R. (2002) · Statistical Science · doi:10.1214/ss/1042727942 · Cited by 479
Growing by Degrees: Online Education in the United States, 2005.
Allen, I. E., & Seaman, J. (2005) · Cited by 418
Simple and Bias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. W. (2002) · National Bureau of Economic Research · doi:10.3386/t0283 · Cited by 348
Defending the Community College Equity Agenda
Bailey, T. (2006) · Johns Hopkins University Press eBooks · doi:10.1353/book.3282 · Cited by 331
Moving into Town--and Moving On: The Community College in the Lives of Traditional-Age Students.
Adelman, C. (2005) · US Department of Education · Cited by 293
Nontraditional Undergraduates: Findings from the Condition of Education 2002. NCES 2002-012.
Choy, S. P. (2002) · National Center for Education Statistics · Cited by 248
Calcagno, J. C., Crosta, P. M., Bailey, T., & Jenkins, D. (2007) · Research in Higher Education · doi:10.1007/s11162-007-9053-8 · Cited by 222
The American Community College
Schmidtke, C. (2011) · Springer eBooks · doi:10.1007/978-94-007-2272-9_4 · Cited by 182
Teaching and Learning On-Line: Issues in Computer-Mediated Graduate Courses
Harasim, L. M. (2009) · Canadian Journal of Learning and Technology · doi:10.21432/t2tk6k · Cited by 175
Figlio, D., Rush, M., & Yin, L. (2010) · National Bureau of Economic Research · doi:10.3386/w16089 · Cited by 174
Çavuş, N., Uzunboylu, H., & İbrahim, D. (2007) · Journal of Educational Computing Research · doi:10.2190/t728-g676-4n18-6871 · Cited by 139
Hill, J. (2008) · Statistics in Medicine · doi:10.1002/sim.3245 · Cited by 131
Online Learning in the Virginia Community College System
Jaggars, S., & Xu, D. (2010) · PubMed · doi:10.7916/d80v89vm · Cited by 123
Self-citationStuart, E. A. (2008) · Statistics in Medicine · doi:10.1002/sim.3207 · Cited by 119
Online Compared to Face-to-Face Teacher Preparation for Learning Standards-Based Planning Skills
Peterson, C. L., & Bond, N. (2004) · Journal of Research on Technology in Education · doi:10.1080/15391523.2004.10782419 · Cited by 79
Success in Cyberspace: Student Retention in Online Courses
Moore, K., Bartkovich, J. P., Fetzner, M. J., & Ison, S. (2003) · Journal of applied research in the community college · Cited by 78
Howell, S. L., Laws, R. D., & Lindsay, N. (2004) · ScholarsArchive (Brigham Young University) · Cited by 52
Kurmey, W. J. (1982) · Cataloging & Classification Quarterly · doi:10.1300/j104v02n01_04 · Cited by 44
Influences of Online Delivery on Developmental Writing Outcomes
Carpenter, T. G., Brown, W. L., & Hickman, R. C. (2004) · Journal of developmental education · Cited by 41
Levin, B. B., & Caldwell, E. R. (2006) · Cited by 33
Adding Up the Distance: Can Developmental Studies Work in a Distance Learning Environment?.
Perez, S., & Foshay, R. (2002) · The journal · Cited by 33
Why do students leave online courses? Attrition in community college distance learning courses
Hyllegard, D., Deng, H., & Hunter, C. D. (2008) · International journal of instructional media · Cited by 28
Improving the Feedback Cycle to Improve Learning in Introductory Biology Using the Digital Dashboard
Brown, W. E., Lovett, M. C., Bajzek, D., & Burnette, J. M. (2006) · E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education · Cited by 16
Studying Distance Education at Community Colleges.
Beatty-Guenter, P. (2003) · Journal of applied research in the community college · Cited by 11
The specification of the propensity score in multilevel observational studies
Arpino, B., & Mealli, F. (2010) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.11.008 · Cited by 9
Bendickson, M. M. (2004) · Digital Commons - University of South Florida (University of South Florida) · Cited by 8
Flagged first, then by citations
4 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 15
- Attewell P., 2006, Journal of Higher Education, 77, 886, 10.1080/00221546.2006.11778948 · DOI
- Beatty-Guenter P., 2003, Journal of Applied Research in the Community College, 10, 119
- Brown W. E., 2006, Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2006, 1030
- Carpenter T. G., 2004, Journal of Developmental Education, 28, 14
- Harasim L., 1987, Canadian Journal of Educational Communications, 16, 117
- Hyllegard D., 2008, International Journal of Instructional Media, 35, 429
- Imel S., 1998, Myths and realities: Distance learning.
- Kim J., 2006, Causal inference in multilevel settings: Estimating and using propensity scores when treatment is implemented in nested settings.
- Moore K., 2003, Journal of Applied Research in the Community College, 10, 107
- Parsad B., 2008, Distance education at degree-granting postsecondary institutions: 2006-07
- Perez S., 2002, THE Journal, 29, 16
- Rosenbaum P. R., 1985, American Statistician, 39, 33, 10.1080/00031305.1985.10479383 · DOI
- Russell Thomas L., 2001, The no significant difference phenomenon: A comparative research annotated bibliography on technology for distance education.
- Summerlin J. A., 2003, A comparison of the effectiveness of off-line Internet and traditional classroom remediation of mathematical skills.
- Vargo D., 2002, A comparison of student success and retention rates from an intermediate algebra class presented via the internet and via a conventional classroom.
Cited by
Sorted by citations
Khalil, R., Mansour, A. E., Fadda, W. A., Almisnid, K., Aldamegh, M., Al-Nafeesah, A., Alkhalifah, A., & Al-Wutayd, O. (2020) · BMC Medical Education · doi:10.1186/s12909-020-02208-z · Cited by 893
“…was adopted in a study that involved utilizing a dataset of hundreds of courses being taught at 23 colleges of Virginia ’ s community college system; the authors found that students ’ performance was worse in online courses with respect to both course persistence and end-of-course grades [7].”
MethodXu, D., & Jaggars, S. S. (2014) · The Journal of Higher Education · doi:10.1080/00221546.2014.11777343 · Cited by 568
Self-citationHow do online course design features influence student performance?
Jaggars, S. S., & Xu, D. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.01.014 · Cited by 557
Self-citationChoosing Between Online and Face-to-Face Courses: Community College Student Voices
Jaggars, S. S. (2014) · American Journal of Distance Education · doi:10.1080/08923647.2014.867697 · Cited by 382
Self-citationXu, D., & Jaggars, S. S. (2013) · Economics of Education Review · doi:10.1016/j.econedurev.2013.08.001 · Cited by 359
Self-citation
Metadata
- Authors
- Xu, D., & Jaggars, S. S.
- Affiliations
- Columbia University (US)
- Venue
- Educational Evaluation and Policy Analysis
- Published
- 2011-09
- Volume
- 33
- Issue
- 3
- Pages
- 360-377
- ISSN
- 0162-3737 (ISSN-L)
- 1935-1062
- OpenAlex
- W1974590415
- Cited by
- 239
- References
- 44
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 18 · 2023: 15 · 2022: 24 · 2021: 24 · 2020: 19 · 2019: 26 · 2018: 18 · 2017: 9 · 2016: 20 · 2015: 22 · 2014: 10 · 2013: 18 · 2012: 5
- FWCI
- 50.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational Evaluation and Policy Analysis (publishedVersion)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Education › Higher Education Research Studies
- Keywords
- distance education, online learning, community colleges, course retention, course performance, student self-selection, Virginia community colleges
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review