Web-Based Virtual Learning Environments: A Research Framework and a Preliminary Assessment of Effectiveness in Basic it Skills Training1
The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Abstract
Internet technologies are having a significant impact on the learning industry. For-profit organizations and traditional institutions of higher education have developed and are using web-based courses, but little is known about their effectiveness compared to traditional classroom education. Our work focuses on the effectiveness of a web-based virtual learning environment (VLE) in the context of basic information technology skills training. This article provides three main contributions. First, it introduces and defines the concept of VLE, discussing how a VLE differs from the traditional classroom and differentiating it from the related, but narrower, concept of computer aided instruction (CAI). Second, it presents a framework of VLE effectiveness, grounded in the technology-mediated learning literature, which frames the VLE research domain, and addresses the relationship between the main constructs. Finally, it focuses on one essential VLE design variable, learner control, and compares a web-based VLE to a traditional classroom through a longitudinal experimental design. Our results indicate that, in the context of IT basic skills training in undergraduate education, there are no significant differences in performance between students enrolled in the two environments. However, the VLE leads to higher reported computer self-efficacy, while participants report being less satisfied with the learning process.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“On the whole, poor quality technology yields no satisfaction by users and therefore the quality of technology significantly affects satisfaction (Piccoli, Ahmad, & Ives, 2001).”
From Blended learning effectiveness: the relationship between student characteristics, design features and outcomes (2017) · cites this paper as Piccoli, Ahmad, & Ives, 2001
In the citing paper
“These studies empirically tested a framework developed and proposed by Lee et al. (2010), which incorporates constructs that are relevant for learning in desktop VR based upon several previously proposed media technology models (e.g., Alavi and Leidner 2001;Piccoli et al. 2001;Salzman et al. 1999;Wan et al. 2007).”
From The Cognitive Affective Model of Immersive Learning (CAMIL): a Theoretical Research-Based Model of Learning in Immersive Virtual Reality (2021) · cites this paper as Piccoli et al. 2001
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Chakravarti, D., Eagly, A. H., & Chaiken, S. (1997) · Journal of Marketing Research · doi:10.2307/3151869 · Cited by 7,141
Computer Self-Efficacy: Development of a Measure and Initial Test
Compeau, D. R., & Higgins, C. A. (1995) · MIS Quarterly · doi:10.2307/249688 · Cited by 6,553
Amick, D. J., Cooley, W. W., & Lohnes, P. R. (1972) · Contemporary Sociology · doi:10.2307/2062821 · Cited by 2,915
Interpersonal Effects in Computer-Mediated Interaction: A Relational Perspective
WALTHER, J. B. (1992) · Communication Research · doi:10.1177/009365092019001003 · Cited by 2,490
Gefen, D., & Straub, D. W. (1997) · MIS Quarterly · doi:10.2307/249720 · Cited by 2,223
Instructional Design Theories and Models
(1983) · doi:10.4324/9780203824283 · Cited by 2,192
Media will never influence learning
Clark, R. E. (1994) · Educational Technology Research and Development · doi:10.1007/bf02299088 · Cited by 1,893
(1985) · Cited by 1,625
Application of Social Cognitive Theory to Training for Computer Skills
Compeau, D. R., & Higgins, C. A. (1995) · Information Systems Research · doi:10.1287/isre.6.2.118 · Cited by 1,501
Constructivist Learning Environments: Case Studies in Instructional Design
Wilson, B. (1995) · Cited by 1,340
Motivational Design of Instruction
Keller, J. M. (1983) · Medical Entomology and Zoology · Cited by 1,241
The Use of Information Technology to Enhance Management School Education: A Theoretical View
Leidner, D. E., & Jarvenpaa, S. L. (1995) · MIS Quarterly · doi:10.2307/249596 · Cited by 1,190
Computer-Mediated Collaborative Learning: An Empirical Evaluation
Alavi, M. (1994) · MIS Quarterly · doi:10.2307/249763 · Cited by 1,148
Microcomputer Playfulness: Development of a Measure With Workplace Implications
Webster, J., & Martocchio, J. J. (1992) · MIS Quarterly · doi:10.2307/249576 · Cited by 1,106
Gist, M. E., Schwoerer, C. E., & Rosen, B. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.6.884 · Cited by 910
TEACHING EFFECTIVENESS IN TECHNOLOGY-MEDIATED DISTANCE LEARNING.
WEBSTER, J., & HACKLEY, P. (1997) · Academy of Management Journal · doi:10.2307/257034 · Cited by 886
Hill, T., Smith, N. D., & Mann, M. F. (1987) · Journal of Applied Psychology · doi:10.1037//0021-9010.72.2.307 · Cited by 806
The Virtual Classroom: Learning without Limits via Computer Networks
(1999) · Work Study · doi:10.1108/ws.1999.07948bae.004 · Cited by 775
Research Commentary: Technology-Mediated Learning—A Call for Greater Depth and Breadth of Research
Alavi, M., & Leidner, D. E. (2001) · Information Systems Research · doi:10.1287/isre.12.1.1.9720 · Cited by 689
An Assessment of Group Support Systems Experimental Research: Methodology and Results
Fjermestad, J., & Hiltz, S. R. (1998) · Journal of Management Information Systems · doi:10.1080/07421222.1998.11518216 · Cited by 686
Strategy and the new economics of information
Evans, P. B., & Wurster, T. S. (1999) · Harvard Business School Press eBooks · Cited by 671
STUDENT DISTRESS IN A WEB-BASED DISTANCE EDUCATION COURSE
Hara, N. (2000) · Information, Communication & Society · doi:10.1080/13691180010002297 · Cited by 507
Cognitive Apprenticeship and Instructional Technology
Collins, A. (1988) · doi:10.21236/ada203609 · Cited by 483
Alavi, M., Wheeler, B. C., & Valacich, J. S. (1995) · MIS Quarterly · doi:10.2307/249597 · Cited by 473
Jacobson, M. J., & Spiro, R. J. (1995) · Journal of Educational Computing Research · doi:10.2190/4t1b-hbp0-3f7e-j4pn · Cited by 432
Microcomputers in education: Motivational and social issues.
Lepper, M. R. (1985) · American Psychologist · doi:10.1037//0003-066x.40.1.1 · Cited by 418
O'loughlin, M. (1992) · Journal of Research in Science Teaching · doi:10.1002/tea.3660290805 · Cited by 382
MATHIEU, J. E., MARTINEAU, J. W., & TANNENBAUM, S. I. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00870.x · Cited by 368
The “Virtual Classroom”: Using Computer-Mediated Communication for University Teaching
Hiltz, S. R. (1986) · Journal of Communication · doi:10.1111/j.1460-2466.1986.tb01427.x · Cited by 339
The Content of Physics Self-Explanations
Chi, M. T. H., & VanLehn, K. A. (1991) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0101_4 · Cited by 306
The effects of three social decision schemes on decision group process
Green, S. G., & Taber, T. D. (1980) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(80)90027-6 · Cited by 306
The Information Age Confronts Education: Case Studies on Electronic Classrooms
Leidner, D. E., & Jarvenpaa, S. L. (1993) · Information Systems Research · doi:10.1287/isre.4.1.24 · Cited by 287
Maki, R. H., Maki, W. S., Patterson, M., & Whittaker, P. D. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207788 · Cited by 279
Cognition and learner control: a literature review, 1977–1988
Steinberg, E. R. (1989) · The Journal of Computer Based Instruction · doi:10.5555/70831.70832 · Cited by 231
Merrill, M., & Twitchell, D. (1971) · Cited by 201
The affective and cognitive domains : integration for instruction and research
Martín, B. L., & Briggs, L. J. (1986) · Cited by 197
Pseudoscience in Computer-Based Instruction: The Case of Learner Control Research.
Reeves, T. C. (1993) · The Journal of Computer Based Instruction · Cited by 184
Teaching and Learning On-Line: Issues in Computer-Mediated Graduate Courses
Harasim, L. (2009) · Canadian Journal of Learning and Technology / La revue canadienne de l’apprentissage et de la technologie · doi:10.21432/t2tk6k · Cited by 175
Tennyson, R. D. (1980) · Journal of Educational Psychology · doi:10.1037/0022-0663.72.4.525 · Cited by 154
Strykowski, W., & Kąkolewicz, M. (1997) · Repozytorium Uniwersytetu im. Adama Mickiewicza (Adam Mickiewicz University in Poznań) · Cited by 147
Simon, S. J., Grover, V., Teng, J. T. C., & Whitcomb, K. M. (1996) · Information Systems Research · doi:10.1287/isre.7.4.466 · Cited by 146
Theoretical bases for the use of learner control: Three different perspectives.
Milheim, W. D., & Martín, B. L. (1991) · The Journal of Computer Based Instruction · Cited by 142
Teaching in the Virtual Classroom
Rogers, S. (2014) · Bloomsbury Publishing Plc eBooks · doi:10.5040/9781472552730.ch-024 · Cited by 136
Will the Internet Revolutionize Business Education and Research?
Ives, B. (2000) · Elsevier eBooks · doi:10.1016/b978-0-7506-7111-8.50008-1 · Cited by 134
Self-citationThe role of internal and external factors in the discontinuation of off‐campus students
Brown, K. M. (1996) · Distance Education · doi:10.1080/0158791960170105 · Cited by 124
A framework for the study of hypertext
Gall, J. E., & Hannafin, M. J. (1994) · Instructional Science · doi:10.1007/bf00892243 · Cited by 108
Judo strategy. The competitive dynamics of Internet time.
Yoffie, D. B., & Cusumano, M. A. (1999) · PubMed · Cited by 104
Tennyson, R. D. (1981) · American Educational Research Journal · doi:10.3102/00028312018004425 · Cited by 93
Beller, M., & Or, E. (2006) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.1998.tb00094.x · Cited by 78
Anticipating the impact of multimedia in education : lessons from literature
Collis, B. A. (1991) · University of Twente Research Information · Cited by 63
Lee, S., & Lee, Y. H. (1991) · Journal of Educational Psychology · doi:10.1037/0022-0663.83.4.491 · Cited by 54
Learning Strategies: A New Educational Technology
Jonassen, D. H. (1985) · PLET Programmed Learning & Educational Technology · doi:10.1080/1355800850220104 · Cited by 47
Knowledge management in academia: A proposed framework
Piccoli, G., Ahmad, R., & Ives, B. (2000) · Information Technology and Management · doi:10.1023/a:1019129226227 · Cited by 46
Self-citation10 Things We Know So Far about Online Training.
Kiser, K. (1999) · Cited by 44
The educational technology handbook: a comprehensive guide: process and products for learning
(1996) · Choice Reviews Online · doi:10.5860/choice.34-2284 · Cited by 37
The trouble with learning environments
Jonassen, D. H. (1993) · Educational Technology archive · doi:10.5555/154396.154401 · Cited by 34
Intelligent Computer Assisted Instruction Systems: The Nature of Learner Control
Duchastel, P. C. (1986) · Journal of Educational Computing Research · doi:10.2190/d4jw-nr13-adta-mr8a · Cited by 30
A Comparison of Learner Control and Machine Control Strategies for Computer‐Assisted Instruction
Newkirk, R. L. (1973) · Programmed Learning and Educational Technology · doi:10.1080/1355800730100205 · Cited by 28
Learner control in computer‐assisted learning*
Holmes, N., Robson, E. H., & Steward, A. P. (1985) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.1985.tb00017.x · Cited by 19
Lee, S., & Wong, S. C.-H. (1989) · Journal of Research on Computing in Education · doi:10.1080/08886504.1989.10781886 · Cited by 16
Computerspeak: Message Content and Perceived Appropriateness in an Educational Setting
Vaverek, K. A., & Saunders, C. (1993) · Journal of Educational Technology Systems · doi:10.2190/keuc-xg9h-up04-heyn · Cited by 15
Learner Control Over Feedback as a Variable in Computer Assisted Instruction
Schloss, P. J., Sindelar, P. T., Cartwright, G. P., & Smith, M. A. (1988) · Journal of Research on Computing in Education · doi:10.1080/08886504.1988.10781845 · Cited by 11
Virtual Learning Environments: An Information Technology Basic Skills Course on the Web
Ahmad, R., & Piccoli, G. (1998) · Journal of the Association for Information Systems · Cited by 9
Self-citationAudiographics for Distance Education: A Case Study in Student Attitudes and Perceptions
Wolfram, D. (1994) · Journal of Education for Library and Information Science · doi:10.2307/40323071 · Cited by 8
Research works printed but not linked: 17
- Bandura, 1986, Social Foundation for Thought and Action
- Cavanaugh, 2000, The Human and Technical Dimensions of Multimedia Distance Learning (MDL): A Study of MDL Effectiveness in a Global Human Resource Management Class
- Cradler, 1997, Summary of Current Research and Evaluation of Findings on Technology in Education
- De Vaney, 1996, Voices of the Founders: Early Discourse in Technology
- Grint, 1989, Accounting for Failure: Participation and Non-Participation in CMC
- Hackbarth, 1996, The Educational Technology Handbook: A Comprehensive Guide
- Hiltz, 1995, Teaching in a Virtual Classroom, International Journal of Educational Telecommunications, 1, 185
- Jonassen, 1993, Thinking Technology, Educational Technology, 33, 35
- Lenzner, 1997, Seeing Things as They Really Are, Forbes Magazine, 159, 122
- Massy, 1995, Using Information Technology to Enhance Academic Productivity
- McCormick, 2000, The New School, Newsweek, 135, 60
- Merrill, 1983, Component Display Theory
- Romiszowski, 1996, Computer-Mediated Communication
- Russell, 1999, The No Significance Difference Phenomenon
- Wells, 1990, Computer-Mediated Communication for Distance Education and Training: Literature review and International Resources
- Wetzel, 1994, Instructional Effectiveness of Video Media
- Williams, 1996, Learner-Control and Instructional Technologies
Cited by
Buhalis, D., & Law, R. (2008) · Tourism Management · doi:10.1016/j.tourman.2008.01.005 · Cited by 3,823
Sun, P.-C., Tsai, R. J., Finger, G., Chen, Y.-Y., & Yeh, D. (2008) · Computers & Education · doi:10.1016/j.compedu.2006.11.007 · Cited by 2,726
Bernard, R. M., Abrami, P. C., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., Wallet, P. A., Fiset, M., & Huang, B. (2004) · Review of Educational Research · doi:10.3102/00346543074003379 · Cited by 1,761
Makransky, G., & Petersen, G. B. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09586-2 · Cited by 1,438
Evaluating E-learning systems success: An empirical study
Al-Fraihat, D., Joy, M., Masa'deh, R., & Sinclair, J. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2019.08.004 · Cited by 1,350
Metadata
- Authors
- Piccoli, G., Ahmad, R., & Ives, B.
- Affiliations
- Cornell University (US)
- Louisiana State University (US)
- University of Houston (US)
- ORCID
- Ives, Blake
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2001-12-01
- Volume
- 25
- Issue
- 4
- Pages
- 401-426
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W1488542496
- Cited by
- 1,587
- References
- 65
- Citations by year
- 2026: 22 · 2025: 28 · 2024: 53 · 2023: 65 · 2022: 104 · 2021: 84 · 2020: 74 · 2019: 56 · 2018: 60 · 2017: 69 · 2016: 82 · 2015: 73 · 2014: 93 · 2013: 89 · 2012: 98
- FWCI
- 149.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- MIS Quarterly (publishedVersion)
- Journal of the Association for Information Systems (submittedVersion)
- UnissResearch (Università degli Studi di Sassari) (submittedVersion)
- Topics
- Social Sciences › Education › Online and Blended Learning
- Physical Sciences › Computer Science › Information Systems › Educational Technology and E-Learning
- Social Sciences › Education › Technology-Enhanced Education Studies
- Keywords
- virtual learning environments, web-based learning, computer self-efficacy, learner control, computer-assisted instruction, technology-mediated learning, undergraduate education, learning effectiveness, student satisfaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.