The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Creating a Framework for Research on Systemic Technology Innovations
Abstract
This article examines why cognitively oriented technology innovations, designed to foster deep thinking and learning, have not become widespread in K−12 schools. We argue a key reason is that most design-based research does not explicitly address systemic issues of usability, scalability and sustainability. This limitation must be overcome if research is to create usable knowledge that addresses the challenges confronting technology innovations when implemented in real-world school contexts. This is especially important in an era when political forces push schools away from the cognitively rich, inquiry-oriented approaches espoused by the Learning Sciences. We suggest expanding our conception of design-based research to include research on innovations in the context of systemic reform as a potential solution to the problem. To that end, we introduce research questions and issues arising from our own experiences with a technology-rich innovation in the context of a systemic reform initiative as a starting point in the creation of an expanded design-based research agenda. These questions and issues have important implications for both the continued viability of research on technologies for learning and on the future of technology use in schools that stems from such research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Knowledge and teaching: Foundations of the new reform
Shulman, L. (1987) · Harvard Educational Review · doi:10.17763/haer.57.1.j463w79r56455411 · Cited by 16,787
Situated Cognition and the Culture of Learning
Brown, J. S., Collins, A., & Duguid, P. (1989) · Educational Researcher · doi:10.3102/0013189x018001032 · Cited by 13,645 · cited 1×
“These innovations include technology as a core component, but are rooted in cognitive and constructivist learning theories (Bransford et al., 1999; J. S. Brown, Collins, & Duguid, 1989).”
Background(1999) · Cited by 12,812
(1993) · Cited by 9,879
National Council of Teachers of Mathematics
(1979) · The Mathematics Teacher · doi:10.5951/mt.72.8.0637 · Cited by 8,499
Anderson, J. R. (2013) · doi:10.4324/9781315799438 · Cited by 6,761
Educational Organizations as Loosely Coupled Systems
Weick, K. E. (1976) · Administrative Science Quarterly · doi:10.2307/2391875 · Cited by 5,142
What Makes Professional Development Effective? Results From a National Sample of Teachers
Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. (2001) · American Educational Research Journal · doi:10.3102/00028312038004915 · Cited by 5,047
Brown, A. L. (1992) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0202_2 · Cited by 4,000
Motivating Project-Based Learning: Sustaining the Doing, Supporting the Learning
Blumenfeld, P. C., Soloway, E., Marx, R. W., Krajcik, J. S., Guzdial, M., & Palincsar, A. (1991) · Educational Psychologist · doi:10.1080/00461520.1991.9653139 · Cited by 3,594 · cited 1×
“Cognitivelyorientedusesof technologyoftenemploychallenging pedagogical approaches, such as project-based learning (Blumenfeld et al., 1991).”
BackgroundSelf-citationDesign Experiments in Educational Research
Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003) · Educational Researcher · doi:10.3102/0013189x032001009 · Cited by 3,548
The National Science Education Standards
McComas, W. F. (2014) · The Language of Science Education · doi:10.1007/978-94-6209-497-0_58 · Cited by 2,877
Design-Based Research: An Emerging Paradigm for Educational Inquiry
Collective, T. D.-B. R. (2003) · Educational Researcher · doi:10.3102/0013189x032001005 · Cited by 2,681
The Usability Engineering Lifecycle
NIELSEN, J. (1993) · Usability Engineering · doi:10.1016/b978-0-08-052029-2.50007-3 · Cited by 2,657
(2010) · Encyclopedia of Curriculum Studies · doi:10.4135/9781412958806.n175 · Cited by 2,556
Knowing What Students Know: The Science and Design of Educational Assessment
Pellegrino, J. W., Chudowsky, N., & Glaser, R. A. (2013) · Cited by 2,402
The Role of Assessment in a Learning Culture
Shepard, L. A. (2000) · Educational Researcher · doi:10.3102/0013189x029007004 · Cited by 2,161 · cited 4×
“…major methodology within the Learning Sciences, has the advantage of grounding the lessons of research on cognitively oriented innovations firmly in dilemmas of practice (Shepard, 2000), but in a specialized way that does not necessarily lead to the sustainability or scalability of the innovations.”
BackgroundMethodInfluentialCognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 1×
“range from intelligent tutoring systems that help students learn mathematics (e.g., J. R. Anderson, Corbett, Koedinger, & Pelletier, 1995 ) to environments that foster communal knowledge-building and support for writing (e.g., Scardamalia & Bereiter, 1991) to tools that scaffold deep explorations in science (e.g., Lin…”
BackgroundNational Science Education Standards
(1996) · Choice Reviews Online · doi:10.5860/choice.33-5683 · Cited by 1,835
Building a New Structure for School Leadership.
Elmore, R. F. (1999) · Cited by 1,812
Teachers and Machines: The Classroom Use of Technology since 1920
Provenzo, E. F., & Cuban, L. (1986) · History of Education Quarterly · doi:10.2307/369036 · Cited by 1,696
Investigating School Leadership Practice: A Distributed Perspective
Spillane, J. P., Halverson, R., & Diamond, J. B. (2001) · Educational Researcher · doi:10.3102/0013189x030003023 · Cited by 1,690
High Access and Low Use of Technologies in High School Classrooms: Explaining an Apparent Paradox
Cuban, L., Kirkpatrick, H., & Peck, C. (2001) · American Educational Research Journal · doi:10.3102/00028312038004813 · Cited by 1,232
WILSON, S. M., & BERNE, J. (1999) · Review of Research in Education · doi:10.3102/0091732x024001173 · Cited by 1,195
Ball, D. L., & Cohen, D. K. (1996) · Educational Researcher · doi:10.2307/1177151 · Cited by 1,167
Scardamalia, M., & Bereiter, C. (1991) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0101_3 · Cited by 1,017
Changing How and What Children Learn in School with Computer-Based Technologies
Roschelle, J. M., Pea, R. D., Hoadley, C. M., Gordin, D. N., & Means, B. M. (2000) · The Future of Children · doi:10.2307/1602690 · Cited by 830
Linking teacher and student learning to improve professional development in systemic reform
Fishman, B. J., Marx, R. W., Best, S., & Tal, R. T. (2003) · Teaching and Teacher Education · doi:10.1016/s0742-051x(03)00059-3 · Cited by 748
Self-citationFederal Programs Supporting Educational Change
Berman, P. S., & McLaughlin, M. W. (1975) · Cited by 722
Getting Reform Right: What Works and What Doesn't.
Fullan, M. G., & Miles, M. B. (1992) · Phi Delta Kappan · Cited by 702
Inquiry in Project-Based Science Classrooms: Initial Attempts by Middle School Students
Krajcik, J., Blumenfeld, P. C., Marx, R. W., Bass, K. M., Fredricks, J., & Soloway, E. (1998) · Journal of the Learning Sciences · doi:10.1080/10508406.1998.9672057 · Cited by 688
Self-citationThe Rand Change Agent Study Revisited: Macro Perspectives and Micro Realities
McLaughlin, M. W. (1990) · Educational Researcher · doi:10.2307/1176973 · Cited by 647
Sternberg, R. J. (2003) · Educational Researcher · doi:10.3102/0013189x032008005 · Cited by 620
Smith, M. S., & O'Day, J. (1990) · Journal of Education Policy · doi:10.1080/02680939008549074 · Cited by 591
A Collaborative Model for Helping Middle Grade Science Teachers Learn Project-Based Instruction
Krajcik, J. S., Blumenfeld, P. C., Marx, R. W., & Soloway, E. (1994) · The Elementary School Journal · doi:10.1086/461779 · Cited by 524
Self-citationBlumenfeld, P., Fishman, B. J., Krajcik, J., Marx, R. W., & Soloway, E. (2000) · Educational Psychologist · doi:10.1207/s15326985ep3503_2 · Cited by 485
Self-citationLearner-centered design: the challenge for HCI in the 21st century
Soloway, E., Guzdial, M., & Hay, K. E. (1994) · Interactions · doi:10.1145/174809.174813 · Cited by 478
Self-citationWISE design for knowledge integration
Linn, M. C., Clark, D., & Slotta, J. D. (2003) · Science Education · doi:10.1002/sce.10086 · Cited by 417
Wilson, S. M., & Berne, J. (1999) · Review of Research in Education · doi:10.2307/1167270 · Cited by 391
Instruction, Capacity, and Improvement
Cohen, D. K., & Ball, D. L. (1999) · PsycEXTRA Dataset · doi:10.1037/e382692004-001 · Cited by 384
“Maestro, what is ‘quality’?”: Language, literacy, and discourse in project‐based science
Moje, E. B., Collazo, T., Carrillo, R., & Marx, R. W. (2001) · Journal of Research in Science Teaching · doi:10.1002/tea.1014 · Cited by 381
Self-citationFindings from the Teaching, Learning, and Computing Survey: Is Larry Cuban Right?
Becker, H. J. (2000) · Digital Commons - University of South Florida (University of South Florida) · Cited by 295
Linn, M. C., & Hsi, S. (2000) · Routledge eBooks · doi:10.4324/9781410605917 · Cited by 291
Constructing Extended Inquiry Projects: Curriculum Materials for Science Education Reform
Singer, J., Marx, R. W., Krajcik, J., & Clay Chambers, J. (2000) · Educational Psychologist · doi:10.1207/s15326985ep3503_3 · Cited by 288
Self-citationThe Politics of curriculum and testing
Fuhrman, S. H., & Malen, B. (1991) · Cited by 255
On the evaluation of systemic science education reform: Searching for instructional sensitivity
Ruiz‐Primo, M. A., Shavelson, R. J., Hamilton, L., & Klein, S. (2002) · Journal of Research in Science Teaching · doi:10.1002/tea.10027 · Cited by 244
Knapp, M. S. (1997) · Review of Educational Research · doi:10.2307/1170627 · Cited by 233
Supovitz, J. A., Mayer, D. P., & Kahle, J. B. (2000) · Educational Policy · doi:10.1177/0895904800014003001 · Cited by 219
Findings from the Teaching, Learning, and Computing Survey
Becker, H. J. (2000) · Education Policy Analysis Archives · doi:10.14507/epaa.v8n51.2000 · Cited by 213
Designed curriculum and local culture: Acknowledging the primacy of classroom culture
Squire, K. D., MaKinster, J. G., Barnett, M., Luehmann, A. L., & Barab, S. L. (2003) · Science Education · doi:10.1002/sce.10084 · Cited by 196
Using Technology To Support Education Reform.
Means, B., & Improvement (1993) · Cited by 185
Technology Refusal and the Organizational Culture of Schools
Hodas, S. (1996) · Computerization and Controversy · doi:10.1016/b978-0-12-415040-9.50106-8 · Cited by 173
New technologies for teacher professional development
Marx, R. W., Blumenfeld, P. C., Krajcik, J. S., & Soloway, E. M. (1998) · Teaching and Teacher Education · doi:10.1016/s0742-051x(98)00059-6 · Cited by 158
Self-citationMaking Dynamic Modeling Accessible to Precollege Science Students
Jackson, S. L., Stratford, S. J., Krajcik, J. S., & Soloway, E. M. (1994) · Interactive Learning Environments · doi:10.1080/1049482940040305 · Cited by 157
Self-citation(2001) · Cited by 144
Form and Substance in Mathematics and Science Professional Development.
Kennedy, M. M. (1999) · Cited by 139
The knowledge integration environment: theory and design
Bell, P., Davis, E. A., & Linn, M. C. (1995) · Computer-supported collaborative learning/The Computer-Supported Collaborative Learning Conference · doi:10.3115/222020.222043 · Cited by 103
Cognitive Tutors: From the Research Classroom to All Classrooms
Corbett, A. T., Koedinger, K. R., & Hadley, W. S. (2001) · Routledge eBooks · doi:10.4324/9781410601933-19 · Cited by 98
Bringing the Internet to school: lessons from an urban district
(2002) · Choice Reviews Online · doi:10.5860/choice.40-1686 · Cited by 75
Are Content Standards Being Implemented in the Classroom? A Methodology and Some Tentative Answers
Porter, A. C., & Smithson, J. (2001) · Teachers College Record The Voice of Scholarship in Education · Cited by 71
The Presence of Computers in American Schools
Anderson, R. E., & Ronnkvist, A. (1999) · Cited by 62
The Connected School: Technology and Learning in High School
Means, B., Penuel, W. R., & Padilla, C. (2001) · Medical Entomology and Zoology · Cited by 56
The CoVis Project: Building a Large-Scale Science Education Testbed*
Gomez, L. M., Fishman, J. B., & Pea, R. D. (1998) · Interactive Learning Environments · doi:10.1076/ilee.6.1.59.3608 · Cited by 56
Bringing Urban Schools into the Information Age: Planning for Technology vs. Technology Planning
Fishman, B., & Pinkard, N. (2001) · Journal of Educational Computing Research · doi:10.2190/6hdy-88wm-2qhx-qy3d · Cited by 53
Self-citationComponent-Based Construction of a Science Learning Space
Koedinger, K. R., Suthers, D. D., & Forbus, K. D. (1998) · Defense Technical Information Center (DTIC) · doi:10.21236/ada638366 · Cited by 47
8. LINKING ON-LINE VIDEO AND CURRICULUM TO LEVERAGE COMMUNITY KNOWLEDGE
Fishman, B. (2005) · Advances in research on teaching · doi:10.1016/s1479-3687(03)10008-9 · Cited by 40
Self-citationThe Role of Educative Curriculum Materials in Reforming Science Education.
Schneider, R. M., & Krajcik, J. S. (1999) · Cited by 37
Self-citationA clubhouse is a clubhouse is a clubhouse
Zhao, Y., Mishra, P., & Girod, M. (2000) · Computers in Human Behavior · doi:10.1016/s0747-5632(00)00007-8 · Cited by 11
What Can I Do? Voices of Advocacy.
Backus, D., Olson, K. K., Delehant, A., Richardson, J., DuFour, R., & Goodbread, M. (2000) · The Journal of staff development · Cited by 10
Research works printed but not linked: 13
- American Association for the Advancement of Science. (1993). Benchmarks for science literacy, Project 2061. New York: Oxford University Press.
- Cohen, D. K. (1988). Educational technology and school organization. In R. S. Nickerson & P. Zodhiates (Eds.), Technology in education: Looking toward 2020 (pp. 231-264). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
- Fishman, B. & Gomez, L. (2000). New technologies and the challenge for school leadership. In M. Honey & C. Shookhoff (Eds.), The Wingspread Conference on Technology's Role in Urban School Reform: Achieving Equity and Quality (pp. 13-21). Racine, WI: The Joyce Foundation, The Johnson Foundation, and the EDC Center for Children and Technology.
- Honey, M., Carrigg, F. & Hawkins, J. (1998). Union City Online: An architecture for networking and reform. In C. Dede (Ed.), Association for Supervision and Curriculum Development 1998 Yearbook: Learning and Technology (pp. 121-139). Alexandria, VA: ASCD.
- Honey, M. & McMillan-Culp, K. (2000). Scale and localization: The challenge of implementing what works. In M. Honey & C. Shookhoff (Eds.), The Wingspread Conference on Technology's Role in Urban School Reform: Achieving Equity and Quality (pp. 41-46). Racine, WI: The Joyce Foundation, The Johnson Foundation, and the EDC Center for Children and Technology.
- Koedinger K. R., 1999, International Journal of Artificial Intelligence in Education, 10, 292
- McLaughlin M. W., 1990, Educational Researcher, 19, 11, 10.3102/0013189X019009011 · doi:10.3102/0013189x019009011 · Paper page
- Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press.
- Shrader, G., Fishman, B., Barab, S. A., O'Neill, K., Oden, G. & Suthers, D. D. (2002). Video cases for teacher learning: Issues of social and organizational design for use. In G. Stahl (Ed.), Computer Support for Collaborative Learning: Foundations for a CSCL Community (pp. 708-709). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc. · doi:10.3115/1658616.1658799
- Snyder, J., Bolin, F. & Zumwalt, K. (1996). Curriculum implementation. In P. W. Jackson (Ed.), Handbook of research on curriculum (pp. 402-435). New York: Macmillan.
- Supovitz J. A., 2000, Journal of Staff Development, 21, 24
- Williams, S. M., Burgess, K. L., Bray, M. H., Bransford, J. D., Goldman, S. R. & The Cognition and Technology Group at Vanderbilt. (1998). Technology and learning in Schools For Thought classrooms. In C. Dede (Ed.), Association for Supervision and Curriculum Development 1998 Yearbook: Learning and Technology (pp. 97-119). Alexandria, VA: ASCD.
- Zucker, A. & Marder, C. (1998). A case study of Montana's SSI (SIMMS), 1991-1996. In A. Zucker & P. Shields (Eds.), SSI case studies: Cohort 1: Connecticut, Delaware, Louisiana, and Montana (pp. 125-163). Menlo Park, CA: SRI International.
Cited by
Design-based research and technology-enhanced learning environments
Wang, F., & Hannafin, M. J. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504682 · Cited by 2,230
Krajcik, J. S., & Shin, N. (2014) · The Cambridge Handbook of the Learning Sciences · doi:10.1017/cbo9781139519526.018 · Cited by 920
Self-citationKrajcik, J. S., & Blumenfeld, P. C. (2005) · The Cambridge Handbook of the Learning Sciences · doi:10.1017/cbo9780511816833.020 · Cited by 608
Self-citationTechnology in Support of Collaborative Learning
Resta, P., & Laferrière, T. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9042-7 · Cited by 501
Geier, R., Blumenfeld, P. C., Marx, R. W., Krajcik, J. S., Fishman, B., Soloway, E., & Clay‐Chambers, J. (2008) · Journal of Research in Science Teaching · doi:10.1002/tea.20248 · Cited by 423
Self-citation
Metadata
- Authors
- Fishman, B., Marx, R. W., Blumenfeld, P., Krajcik, J., & Soloway, E.
- Venue
- Journal of the Learning Sciences
- Publisher
- Informa UK Limited
- Published
- 2004-01
- Volume
- 13
- Issue
- 1
- Pages
- 43-76
- ISSN
- 1050-8406 (ISSN-L)
- 1532-7809
- OpenAlex
- W2001469931
- Cited by
- 273
- References
- 69
- FWCI
- 33.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.