Comparing Student Learning, Satisfaction, and Experiences Between Hybrid and In-Person Course Modalities: A Comprehensive, Mixed-Methods Evaluation of Five Public Health Courses
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Schools and programs of public health are expanding online course offerings, particularly in response to the transition to remote learning due to COVID-19. While previous research in the health professions suggests that online and in-person modalities are equally effective in supporting student learning, there is minimal evidence of this in public health education. This evaluation examines the effectiveness of newly developed online or hybrid course sections offered to Master of Public Health (MPH) and Master of Science in Public Health (MSPH) students enrolled in on-campus programs. We compared the effectiveness of these new offerings with that of the on-campus in-person courses and hybrid courses in the Executive MPH program. The purposes of this mixed-methods evaluation were to (1) assess student learning across the three course modalities and (2) examine student, instructor, and staff experiences with the modalities. The data included pre- and postcourse student surveys on 17 sections of five courses (precourse response rate: 51% to 98%; postcourse response rate: 12% to 57%), the participating students’ grades, five student focus groups, one focus group with academic advisors, and 11 instructor interviews. The findings indicate that the new online modality was equivalent to the in-person sections for student learning, satisfaction, and engagement. Mean student ratings of confidence in meeting the course learning objectives increased from the beginning to the end of the semester in all sections for all courses. Regardless of the modality, the students reported that the course improved their understanding of key concepts and that they were satisfied with their course. We discuss the lessons learned and recommendations for ensuring high-quality online learning experiences.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Overall, these studies highlight that student performance varies depending on the discipline, course design, and delivery mode with no consistent advantage for either online or in-person formats.”
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 1×
“Qualitative data were analyzed using thematic analysis, which is a flexible method for identifying, analyzing, and describing patterns or themes within the data (Braun & Clarke, 2006).”
MethodInternet-Based Learning in the Health Professions: A Meta-analysis
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008) · JAMA · doi:10.1001/jama.300.10.1181 · Cited by 1,498 · cited 3×
“Meta-analyses suggest the equivalency in learning outcomes between online/hybrid instruction and in-person instruction in the health professions (Cook et al., 2008; Liu et al., 2016; McCutcheon et al., 2015).”
BackgroundResultThe Effectiveness of Blended Learning in Health Professions: Systematic Review and Meta-Analysis
Liu, Q., Peng, W., Zhang, F., Hu, R., Li, Y., & Yan, W. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4807 · Cited by 691 · cited 3×
“Meta-analyses suggest the equivalency in learning outcomes between online/hybrid instruction and in-person instruction in the health professions (Cook et al., 2008; Liu et al., 2016; McCutcheon et al., 2015).”
BackgroundResultMcCutcheon, K., Lohan, M., Traynor, M., & Martin, D. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12509 · Cited by 615 · cited 2×
“Meta-analyses suggest the equivalency in learning outcomes between online/hybrid instruction and in-person instruction in the health professions (Cook et al., 2008; Liu et al., 2016; McCutcheon et al., 2015).”
BackgroundResultOnline Learning: Adoption, Continuance, and Learning Outcome—A Review of Literature
Panigrahi, R., Srivastava, P. R., & Sharma, D. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.05.005 · Cited by 607 · cited 1×
“Online learning can be provided in synchronous (real time) or asynchronous (self-paced) environments, which have different implications for access to materials, compatibility with students’ schedules and learning paces, and uniformity of content (Panigrahi et al., 2018).”
BackgroundGinns, P., & Ellis, R. (2007) · The Internet and Higher Education · doi:10.1016/j.iheduc.2006.10.003 · Cited by 461 · cited 1×
“Existing literature shows that students’ perceptions about online learning environments (Ginns & Ellis, 2007) and the degree of students’ activity in an online course (Campbell et al., 2008) are associated with their learning outcomes.”
BackgroundStudent perceptions and achievement in a university blended learning strategic initiative
Owston, R., York, D., & Murtha, S. (2013) · The Internet and Higher Education · doi:10.1016/j.iheduc.2012.12.003 · Cited by 456 · cited 1×
“Allowing students a choice of multiple modalities is supported by research showing differential outcomes for low- and high-achieving students, whereby high-achieving students may be better equipped to adapt to online/hybrid modalities (Owston et al., 2013).”
BackgroundSoffer, T., & Nachmias, R. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12258 · Cited by 174 · cited 1×
“In recent years, course delivery modalities have rapidly diversified in higher education institutions, as new technologies offer more dependable learning platforms for online courses and tools for online communication and interaction (Soffer & Nachmias, 2018).”
BackgroundCampbell, M., Gibson, W., Hall, A., Richards, D., & Callery, P. (2008) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2006.12.011 · Cited by 168 · cited 2×
“Existing literature shows that students’ perceptions about online learning environments (Ginns & Ellis, 2007) and the degree of students’ activity in an online course (Campbell et al., 2008) are associated with their learning outcomes.”
BackgroundResultEffects of a blended learning approach on student outcomes in a graduate-level public health course
Kiviniemi, M. T. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-47 · Cited by 151 · cited 3×
“In the limited existing literature, hybrid learning approaches appear to be associated with enhanced student learning (Kiviniemi, 2014) and high student satisfaction (So, 2009).”
BackgroundResult
Research works printed but not linked: 1
- Rivera J. C., 2002, Online Journal of Distance Learning Administration, 5, 151
Cited by
(2021) · Digital Education Resource Archive (University College London) · Cited by 30
Triggering STEM interest with Minecraft in a hybrid summer camp.
Lane, H. C., Gadbury, M., Ginger, J., Yi, S., Comins, N. F., Henhapl, J., & Rivera-Rogers, A. (2022) · Technology Mind and Behavior · doi:10.1037/tmb0000077 · Cited by 30
Academic integrity in the HyFlex learning environment
Eshet, Y., Dickman, N., & Ben-Zion, Y. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e13301 · Cited by 27
Zamora, A. N., August, E. T., Fossee, E., & Anderson, O. S. (2022) · Pedagogy in Health Promotion · doi:10.1177/23733799221101539 · Cited by 25
Cunnington, S., Codner, A., Nelson, E., McGrath, D., & Greece, J. A. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20042867 · Cited by 23
“Evaluations of learning delivered through different in-person and virtual mechanisms have shown equally effective learning outcomes [18], and as such, SPH accreditation guidelines have proposed updates to reflect virtual learning opportunities [15].”
BackgroundBurbage, A. K., Jia, Y., & Hoang, T. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04382-2 · Cited by 20
“Favorability and satisfaction as a perceived health professions student outcome warrants investigation, not only for its positive links to student attitudes and outcomes [51] but also for its accessibility and practical implications for faculty and course designers [52], particularly those considering CoI strategies t…”
BackgroundGreece, J. A., Bangham, C., Wolff, J., Bryant, M., Gupte, G., & McGrath, D. (2022) · Public Health Reports · doi:10.1177/00333549211070768 · Cited by 14
Blackford, K., Birney, K., Sharma, S., Crawford, G., Tilley, M., Winter, S., & Hendriks, J. (2021) · Pedagogy in Health Promotion · doi:10.1177/23733799211037374 · Cited by 9
Miller, O. K., & Newnam, S. (2024) · BMC Emergency Medicine · doi:10.1186/s12873-024-01036-4 · Cited by 6
“Both online and face-to-face modalities tend to receive similar satisfaction ratings though online learning is appreciated for its flexibility [20, 21].”
BackgroundDoes Instructional Mode Alter the Effectiveness of a Curricular Response to Campus Sexual Violence?
Johnson, K. M., Liddell, J. L., Lederer, A. M., & Sheffield, S. M. (2021) · Pedagogy in Health Promotion · doi:10.1177/23733799211057531 · Cited by 6
“Similar to other studies (Means et al., 2013, 2014; Walker et al., 2021), we found minimal differences in student outcomes between the course modes.”
BackgroundResultWeishaar, H. B., Pozo-Martin, F., Geurts, B., de Abechuco, E. L., Montt-Maray, E., Cristea, F., Abrokwa, S. K., Bahr, T., Al-Awlaqi, S., & Bcheraoui, C. E. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1197729 · Cited by 6
Battista, S., Furri, L., de Biagi, G., Depedri, L., Broggi, V., & Testa, M. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04528-2 · Cited by 6
Ling, Y.-L., & Chua, W. (2023) · JESS (Journal of Education on Social Science) · doi:10.24036/jess.v7i1.435 · Cited by 5
“According to Wang and Chui (2016), Student motivation is found to be associated with student learning satisfaction in the field education context.”
BackgroundObuobisa‐Darko, T. (2025) · Facilities · doi:10.1108/f-02-2024-0030 · Cited by 5
Kavuran, E., Hamdan‐Mansour, A. M., & Fawaz, M. A. (2025) · Contemporary Nurse · doi:10.1080/10376178.2025.2461541 · Cited by 4
“Although it is expected to find an association between satisfaction, motivation, and engagement, this does emphasize the influence of and the differences between the type of education among students whether it is online only or hybrid (Chan et al., 2021; Walker et al., 2021).”
Donald, K. J., Cochrane, A. L., Byrne, S. J., Cheshire, L., Stander, J., Clements, T., Finch, S. J., Hill, N., Kefalianos, E., Lees, J., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07909-x · Cited by 4
“Indeed, since COVID-19, an explosion of innovative teaching models has arisen, showing that students are often just as satisfied and learn just as well with newer hybrid teaching models than traditional in-person teaching formats [24–26].”
Petäistö, S., Mikkonen, K., Kuivila, H., Juntunen, J., Jarva, E., & Pramila‐Savukoski, S. (2025) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2025.2516448 · Cited by 4
Zamora, A. N., August, E. T., & Anderson, O. S. (2023) · Pedagogy in Health Promotion · doi:10.1177/23733799221143379 · Cited by 4
Ferrara, M., Langiano, E., Esposito, M., Moro, G. L., Lombardi, R., Vuolanto, P. H., & Vito, E. D. (2024) · Health Education Research · doi:10.1093/her/cyae027 · Cited by 4
Hybrid Education and Institutional Readiness
Malik, N. K., Al-Hattami, A. A., Elmahdi, I., & Abusin, A. (2023) · International Conference on IT Innovation and Knowledge Discovery (ITIKD) · doi:10.1109/itikd56332.2023.10100289 · Cited by 4
“This led to a greater than ever openness in higher education and opened a wide range of developed teaching opportunities such as hybrid education [28, 29].”
BackgroundBlack, K., Bullis, A., Marcotte, J., McGuire, P., Wagoner, J., Wiley, J., Wrobel, R., & Weiss, D. J. (2025) · Journal of Chemical Education · doi:10.1021/acs.jchemed.4c01139 · Cited by 3
Turkiewicz, J., Bęczkowska, A., & Skrobacki, R. (2023) · Przegląd Badań Edukacyjnych · doi:10.12775/pbe.2023.010 · Cited by 2
Romero, V. F., Tovar, Á. E., Montoya, A. L., Flores-Coronado, M. A., Ferrer-Reyes, S. I., Chainé, S. M., & Serrano, M. M. (2023) · Acta de Investigación Psicológica · doi:10.22201/fpsi.20074719e.2023.2.486 · Cited by 2
“Moreover, the current times have promoted a fast technological development to extend the regional scope of training, education and evaluation through online and distance interactions without losing reliable measures of both knowledge and practical implementations (Walker et al., 2021).”
BackgroundKhofi, M. B. (2025) · International Conference on Humanity Education and Society (ICHES) · Cited by 2
de Santana, C. A., de Souza, A. C., & Zukowsky-Tavares, C. (2023) · Conhecimento & Diversidade · doi:10.18316/rcd.v15i36.10685 · Cited by 2
Walker, E. R., Comeau, D. L., McBride, C. M., & Lang, D. L. (2021) · American Journal of Public Health · doi:10.2105/ajph.2021.306423 · Cited by 2
Self-citationThe Road to a New Normal: Reflecting on Pedagogy During a Pandemic
Merzel, C. R. (2021) · Pedagogy in Health Promotion · doi:10.1177/2373379920988266 · Cited by 1
“Remote education is likely here to stay, and now is the time to begin reflecting on the effectiveness and benefits of online learning (Walker et al., 2021).”
BackgroundBayron, R. M. J., & Garcia, N. P. (2025) · European Journal of Education Studies · doi:10.46827/ejes.v12i8.6147 · Cited by 1
Moshiri, G., Farhadian, G., Alsaleh, R., & Alsaleh, Y. T. (2026) · Frontiers in Education · doi:10.3389/feduc.2025.1677636 · Cited by 1
Cho, H. (2023) · Asia-pacific Journal of Convergent Research Interchange · doi:10.47116/apjcri.2023.01.29 · Cited by 1
“하이브리드와 강의실 수업에 대한 만족감과 성취를 비교한 연구에서는 방식에 상관없이 학생들은 주요 개념을 이해하였고, 수업 방식에 만족하는 것으로 나타났다[11].”
Gonzalez, E. E. (2023) · International Journal for Innovation Education and Research · doi:10.31686/ijier.vol11.iss3.4102 · Cited by 1
“This modality allows for flexibility in delivering instruction using remote learning technologies while also providing the in person component desired and or needed in some disciplines (Walker, et al., 2021).”
BackgroundDescription and Evaluation of a Pharmacy Graduate Health Services Research Methods Course
Axon, D. R. (2024) · Pharmacy · doi:10.3390/pharmacy12040127
“Regardless of approach, the literature suggests students gain a high level of understanding the course content, experience good grades, and are equally satisfied [20,21].”
BackgroundHathaway, T., Jones, L., Glover, A., Ayres, J., & Jones, M. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2423624
“Engagement and use of educational technology such as Virtual Learning Environments (VLEs) are commonplace with many ITE providers, with these more often used to support face-to-face learning (Walker et al., 2021).”
Varrasso, M., Cunnington, S., Nelson, E., Codner, A., Hurley, M., Mitchell, A., Flanagan, A., McGrath, D., & Greece, J. A. (2025) · Health · doi:10.4236/health.2025.171003
Veenstra, R. L. (2025) · Natural sciences education · doi:10.1002/nse2.70011
Grading Classroom Participation in Higher Education: A Review and Proposed Taxonomy
Goyette, T. (2025) · Journal of Higher Education Theory and Practice · doi:10.33423/jhetp.v25i4.7842
Miller, O. K., & Newnam, S. (2024) · Figshare · doi:10.6084/m9.figshare.26755507
Online Planning History Pedagogy Using Place-Based Immersive Virtual Reality
Retzlaff, R., Slatton, M., & LaFrombois, M. E. H. (2026) · Journal of Planning Education and Research · doi:10.1177/0739456x261443915
Yefremenko, A., Lebediev, S., Коваль, С., Дейнеко, А., & Кофанов, І. (2026) · Acta Paedagogica Vilnensia · doi:10.15388/actpaed.2026.56.14
“EL is the most common method of distance learning for PE (Ariski, Wahyuri, Khairuddin, & Chaeroni, 2024), compared to MOOCs (Zeide & Nissenbaum, 2018), while BL can combine online (synchronous and asynchronous) and face-to-face sessions (Walker et al., 2021).”
Ritonga, A. A., Nurmawati, N., & Yurmaini, Y. (2026) · Jurnal Ilmiah Ilmu Terapan Universitas Jambi|JIITUJ| · doi:10.22437/jiituj.v10i4.57912
Metadata
- Authors
- Walker, E. R., Lang, D. L., Alperin, M., Vu, M., Barry, C. M., & Gaydos, L. M.
- Affiliations
- Emory University (US)
- Corresponding author
- Walker, Elizabeth Reisinger
- ORCID
- Venue
- Pedagogy in Health Promotion
- Publisher
- SAGE Publications
- Published
- 2020-10-14
- Volume
- 7
- Issue
- 1
- Pages
- 29-37
- ISSN
- 2373-3799 (ISSN-L)
- 2373-3802
- OpenAlex
- W3092994288
- Cited by
- 36
- References
- 14
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 6 · 2023: 11 · 2022: 3 · 2021: 4
- FWCI
- 6.82
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Pedagogy in Health Promotion (publishedVersion)
- Funders
- rollins school of public health
- Topics
- Social Sciences › Education › Online and Blended Learning
- Social Sciences › Education › Education during COVID-19 pandemic
- Social Sciences › Education › Innovations in Medical Education
- Keywords
- hybrid courses, online learning, public health education, Master of Public Health, student learning, student satisfaction, student engagement, COVID-19 remote learning, online course quality, instructor experience, academic advising
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.