The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
A systematic review of living lab literature
Open accessAbstract
A living lab is a physical or virtual space in which to solve societal challenges, especially for urban areas, by bringing together various stakeholders for collaboration and collective ideation. Although the notion has received increasing attention from scholars, practitioners and policy makers, its essence remains unclear to many. We therefore performed a systematic literature review of a sample of 114 scholarly articles about living labs to understand the central facets discussed in the nascent literature. In particular, we explored the origin of the living lab concept and its key paradigms and characteristics, including stakeholder roles, contexts, challenges, main outcomes, and sustainability. While doing this, we discovered that the number of publications about living labs has increased significantly since 2015, and several journals are very active in publishing articles on the topic. The living lab is considered a multidisciplinary phenomenon and it encompasses various research domains despite typically being discussed under open and user innovation paradigms. What is more, the existing literature views living labs simultaneously as landscapes, real-life environments, and methodologies, and it suggests that they include heterogeneous stakeholders and apply various business models, methods, tools and approaches. Finally, living labs face some challenges, such as temporality, governance, efficiency, user recruitment, sustainability, scalability and unpredictable outcomes. In contrast, the benefits include tangible and intangible innovation and a broader diversity of innovation. Based on our analysis, we provide some implications and suggestions for future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
(2003) · Cited by 9,368
Business model design: An activity system perspective
Zott, C., & Amit, R. (2010) · Long Range Planning · doi:10.1016/j.lrp.2009.07.004 · Cited by 3,164
Open Innovation: The New Imperative For Creating and Profiting From Technology
Mazzocchi, S. (2004) · Innovation · doi:10.5172/impp.2004.6.3.474 · Cited by 2,652
Dahlander, L., & Gann, D. M. (2010) · Research Policy · doi:10.1016/j.respol.2010.01.013 · Cited by 2,435
A Smart City Initiative: the Case of Barcelona
Bakıcı, T., Almirall, E., & Wareham, J. (2013) · Journal of the Knowledge Economy · doi:10.1007/s13132-012-0084-9 · Cited by 1,163
Social innovation research: An emerging area of innovation studies?
van der Have, R. P., & Rubalcaba, L. (2016) · Research Policy · doi:10.1016/j.respol.2016.06.010 · Cited by 796
Urban Transition Labs: co-creating transformative action for sustainable cities
Nevens, F., Frantzeskaki, N., Gorissen, L., & Loorbach, D. (2013) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2012.12.001 · Cited by 762
Urban living labs for sustainability and low carbon cities in Europe: towards a research agenda
Voytenko, Y., McCormick, K., Evans, J., & Schliwa, G. (2016) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2015.08.053 · Cited by 747
Living Labs as Open-Innovation Networks
Leminen, S., Westerlund, M., & Nyström, A. (2012) · Technology Innovation Management Review · doi:10.22215/timreview/602 · Cited by 623
Self-citationHorizontal innovation networks--by and for users
von Hippel, E. (2007) · Industrial and Corporate Change · doi:10.1093/icc/dtm005 · Cited by 568
Urban living labs: governing urban sustainability transitions
Bulkeley, H., Coenen, L., Frantzeskaki, N., Hartmann, C., Kronsell, A., Mai, L., Marvin, S., McCormick, K., van Steenbergen, F., & Voytenko Palgan, Y. (2016) · Current Opinion in Environmental Sustainability · doi:10.1016/j.cosust.2017.02.003 · Cited by 522
Følstad, A. (2008) · BIBSYS Brage (BIBSYS (Norway)) · Cited by 520
Living labs and co-production: university campuses as platforms for sustainability science
Evans, J., Jones, R., Karvonen, A., Millard, L., & Wendler, J. (2015) · Current Opinion in Environmental Sustainability · doi:10.1016/j.cosust.2015.06.005 · Cited by 459
Living Lab: an open and citizen-centric approach for innovation
Kareborn, B. B., & Stahlbrost, A. (2009) · International Journal of Innovation and Regional Development · doi:10.1504/ijird.2009.022727 · Cited by 448
Living Lab: A Methodology between User‐Centred Design and Participatory Design
Dell'Era, C., & Landoni, P. (2014) · Creativity and Innovation Management · doi:10.1111/caim.12061 · Cited by 356
Mapping Living Labs in the Landscape of Innovation Methodologies
Almirall, E., Lee, M., & Wareham, J. D. (2012) · Technology Innovation Management Review · doi:10.22215/timreview/603 · Cited by 296
Fostering Quality of Life through Social Innovation: A Living Lab Methodology Study Case
Edwards‐Schachter, M. E., Matti, C. E., & Alcántara, E. (2012) · Review of Policy Research · doi:10.1111/j.1541-1338.2012.00588.x · Cited by 295
Actor roles and role patterns influencing innovation in living labs
Nyström, A.-G., Leminen, S., Westerlund, M., & Kortelainen, M. (2014) · Industrial Marketing Management · doi:10.1016/j.indmarman.2013.12.016 · Cited by 254
Self-citationFrugal approach to innovation: State of the art and future perspectives
Pisoni, A., Michelini, L., & Martignoni, G. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2017.09.248 · Cited by 249
A milieu for innovation : defining living labs
Bergvall‐Kåreborn, B., Eriksson, C. I., Ståhlbröst, A., & Svensson, J. (2009) · DiVA (Luleå University of Technology) · Cited by 248
Managing the Challenges of Becoming an Open Innovation Company: Experiences from Living Labs
Westerlund, M., & Leminen, S. (2011) · Technology Innovation Management Review · doi:10.22215/timreview/489 · Cited by 247
Self-citationEdvardsson, B., Kristensson, P., Magnusson, P., & Sundström, E. (2012) · Technovation · doi:10.1016/j.technovation.2011.04.006 · Cited by 245
Grassroots innovation: A systematic review of two decades of research
Hossain, M. (2016) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.07.140 · Cited by 228
Self-citationLiving Labs: arbiters of mid- and ground-level innovation
Almirall, E., & Wareham, J. (2011) · Technology Analysis & Strategic Management · doi:10.1080/09537325.2011.537110 · Cited by 201
Test and Experimentation Platforms for Broadband Innovation: Examining European Practice
Ballon, P., Pierson, J., & Delaere, S. (2005) · SSRN Electronic Journal · doi:10.2139/ssrn.1331557 · Cited by 195
Forming future IT : the living lab way of user involvement
Ståhlbröst, A. (2008) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 184
Coordination and Participation in Living Lab Networks
Leminen, S. (2013) · Technology Innovation Management Review · doi:10.22215/timreview/740 · Cited by 169
Self-citationAnalysis of sustainable urban development approaches in China
Liu, H., Zhou, G., Wennersten, R., & Frostell, B. M. (2013) · Habitat International · doi:10.1016/j.habitatint.2013.06.005 · Cited by 166
González‐Albo, B., & Bordons, M. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2011.01.011 · Cited by 150
Living Labbing the Rotterdam Way: Co-Creation as an Enabler for Urban Innovation
Mulder, I. J. (2012) · Technology Innovation Management Review · doi:10.22215/timreview/607 · Cited by 145
A set of key principles to assess the impact of Living Labs
Ståhlbröst, A. (2012) · International Journal of Product Development · doi:10.1504/ijpd.2012.051154 · Cited by 137
Towards innovation in Living Labs networks
Leminen, S., & Westerlund, M. (2012) · International Journal of Product Development · doi:10.1504/ijpd.2012.051161 · Cited by 128
Self-citationTowards Third-Generation Living Lab Networks in Cities
Leminen, S., Rajahonka, M., & Westerlund, M. (2017) · Technology Innovation Management Review · doi:10.22215/timreview/1118 · Cited by 127
Self-citationDeveloping the Helsinki Smart City: The Role of Competitions for Open Data Applications
Hielkema, H., & Hongisto, P. (2013) · Journal of the Knowledge Economy · doi:10.1007/s13132-012-0087-6 · Cited by 119
The City as Living Laboratory: Empowering Citizens with the Citadel Toolkit
Veeckman, C. M., & van der Graaf, S. (2015) · Technology Innovation Management Review · doi:10.22215/timreview/877 · Cited by 107
Living Labs: Arbiters of Mid- and Ground-Level Innovation
Almirall, E., & Wareham, J. D. (2010) · Lecture notes in business information processing · doi:10.1007/978-3-642-15417-1_13 · Cited by 107
A typology of creative consumers in living labs
Leminen, S., Nyström, A., & Westerlund, M. (2015) · Journal of Engineering and Technology Management · doi:10.1016/j.jengtecman.2015.08.008 · Cited by 102
Self-citationExploring users motivation in innovation communities
Ståhlbröst, A., & Bergvall‐Kåreborn, B. (2011) · International Journal of Entrepreneurship and Innovation Management · doi:10.1504/ijeim.2011.043051 · Cited by 97
A Living Lab research approach for mobile TV
Schuurman, D., Moor, K. D., Marez, L. D., & Evens, T. (2010) · Telematics and Informatics · doi:10.1016/j.tele.2010.11.004 · Cited by 95
The Evolution of Intermediary Activities: Broadening the Concept of Facilitation in Living Labs
Hakkarainen, L., & Hyysalo, S. (2016) · Technology Innovation Management Review · doi:10.22215/timreview/960 · Cited by 93
The effect of network structure on radical innovation in living labs
Leminen, S., Nyström, A., Westerlund, M., & Kortelainen, M. J. (2016) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-10-2012-0179 · Cited by 93
Self-citationCategorization of Innovation Tools in Living Labs
Leminen, S., & Westerlund, M. (2017) · Technology Innovation Management Review · doi:10.22215/timreview/1046 · Cited by 91
Self-citationLiving Labs for User-Driven Innovation: A Process Reference Model
Guzmán, J. G., Carpio, Á. F. D., Colomo‐Palacios, R., & de Diego, M. V. (2013) · Research-Technology Management · doi:10.5437/08956308x5603087 · Cited by 83
On becoming creative consumers - user roles in living labs networks
Leminen, S., Westerlund, M., & Nyström, A. (2013) · International Journal of Technology Marketing · doi:10.1504/ijtmkt.2014.058082 · Cited by 78
Self-citationA Topic Modelling Analysis of Living Labs Research
Westerlund, M., Leminen, S., & Rajahonka, M. (2018) · Technology Innovation Management Review · doi:10.22215/timreview/1170 · Cited by 78
Self-citationImportance of living labs in urban Entrepreneurship:A Portuguese case study
Rodrigues, M. M. M., & Franco, M. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.01.150 · Cited by 70
Living Labs: a systematic literature review
Schuurman, D., Marez, L. D., & Ballon, P. (2015) · Ghent University Academic Bibliography (Ghent University) · Cited by 67
Towards a Living Lab For Development of Online Community Services
Følstad, A. (2008) · BIBSYS Brage (BIBSYS (Norway)) · Cited by 67
What difference does a living lab make? Comparing two health technology innovation projects
Hyysalo, S., & Hakkarainen, L. (2014) · CoDesign · doi:10.1080/15710882.2014.983936 · Cited by 62
Buhl, J., von Geibler, J., Echternacht, L., & Linder, M. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2017.03.001 · Cited by 61
Dvarionienė, J., Gurauskienė, I., Gecevičius, G., Trummer, D. R., Selada, C., Marques, I., & Cosmi, C. (2014) · Renewable Energy · doi:10.1016/j.renene.2014.10.017 · Cited by 57
Innovate dementia: the development of a living lab protocol to evaluate interventions in context
Brankaert, R., den Ouden, E., & Brombacher, A. (2015) · Info · doi:10.1108/info-01-2015-0010 · Cited by 49
Enhancing collaboration in communities of professionals using a Living Lab approach
Budweg, S., Schaffers, H., Ruland, R., Kristensen, K., & Prinz, W. (2011) · Production Planning & Control · doi:10.1080/09537287.2010.536630 · Cited by 46
From Ivory Tower to Living Lab: Accelerating the Use of University Knowledge
van GEENHUIZEN, M. (2013) · Environment and Planning C Government and Policy · doi:10.1068/c1175b · Cited by 42
Exploring the Benefits of Integrating Business Model Research within Living Lab Projects
Rits, O., Schuurman, D., & Ballon, P. (2015) · Technology Innovation Management Review · doi:10.22215/timreview/949 · Cited by 31
The Mobile Territorial Lab: a multilayered and dynamic view on parents’ daily lives
Centellegher, S., Nadai, M. D., Caraviello, M., Leonardi, C., Vescovi, M., Ramadian, Y., Oliver, N., Pianesi, F., Pentland, A., Antonelli, F., et al. (2016) · EPJ Data Science · doi:10.1140/epjds/s13688-016-0064-6 · Cited by 25
Living Labs as Tools for Open Innovation
Kviselius, N. Z., Andersson, P. M., Ozan, H., & Edenius, M. (2009) · RePEc: Research Papers in Economics · Cited by 24
Living Labs: A Bibliometric Analysis
McLoughlin, S., Maccani, G., Prendergast, D. K., & Donnellan, B. (2018) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2018.563 · Cited by 20
Open Innovation Networks: The Evolution of Bureaucratic Control
Järvenpää, S. L., & Wernick, A. (2011) · Information and organisation design series · doi:10.1007/978-1-4614-1284-7_2 · Cited by 13
Cited by
Making the UN Decade on Ecosystem Restoration a Social-Ecological Endeavour
Fischer, J., Riechers, M., Loos, J., Martin-Lopez, B., & Temperton, V. M. (2021) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2020.08.018 · Cited by 462
Metadata
- Authors
- Hossain, M., Leminen, S., & Westerlund, M.
- Venue
- Journal of Cleaner Production
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 213
- Pages
- 976-988
- ISSN
- 0959-6526 (ISSN-L)
- OpenAlex
- W2907673184
- Cited by
- 568
- References
- 60
- FWCI
- 6.97
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.