The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index; 7 of the 151 sources its claims cite were checked for support.
An empirically based model of software prototyping: a mapping study and a multi-case study
Open accessAbstract
Context: Prototyping is an established practice within product and user interface design that is also used as a requirements engineering (RE) practice within agile development. Even so, there is a lack of theory on prototyping. Aims: Our main research objective is to support practitioners in improving on their prototyping practices. Method: We have designed a model that describes key aspects of the practice of prototyping. The model is based on a systematic mapping study consisting of thirty-three primary studies and on empirical data from twelve case companies. We validate and demonstrate the applicability of our model through a focus group at one company and through semi-structured interviews at eleven (other) startup companies. Results: Our prototyping aspects model (PAM) consists of five aspects of prototyping, namely purpose, prototype scope, prototype media, prototype use, and exploration strategy. This model has enabled practitioners to discuss their prototyping practices in terms of the concepts provided by our model. Conclusions: The model can be used to categorise prototyping instances and can thereby support practitioners in reflecting and improving on their prototyping practices.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper presents the Prototyping Aspects Model (PAM), a five-aspect model of software prototyping—purpose, prototype scope, prototype media, prototype use, and exploration strategy—built from a systematic mapping study and refined through empirical validation. PAM was used to categorize 43 prototyping instances from 11 startups and revised to add prototype media and refine purpose, use, and exploration strategy.
Key findings
- PAM consists of five aspects: purpose of prototyping, prototype scope, prototype media, prototype use, and exploration strategy; purpose includes exploration, communication, incremental development, quality improvement, and validation & testing of problem-solution fit, product-market fit, technical feasibility, and usability.
- The systematic mapping study included 33 primary studies published 1988–2018: 17 in software engineering, 11 in human factors & design, and 5 in requirements engineering; research types were 14 evaluation, 3 experience, 5 philosophical, 9 solution proposal, and 2 validation.
- The multi-case study covered 11 startups (Companies A–K) through 12 interviews with 13 interviewees and identified 43 prototyping instances; the model was revised by adding prototype media as a fifth aspect, changing Communication & Alignment to Communication: Sales, Alignment, replacing market/business viability with Problem-Solution fit and Product-Market fit, and restructuring prototype use and exploration strategy.
- The focus group at Telavox with five practitioners validated the relevance of the initial model, and practitioners agreed that the scenarios corresponded to typical agile prototyping practice.
Methods
- The study iteratively designed PAM using a systematic mapping study, a focus group at one case company (Telavox), and a multi-case study of eleven additional startup companies, addressing RQ1–RQ4.
- The mapping study searched LUBsearch and ACM in February 2020, yielding 4,671 articles, 146 after title scan, 54 after abstract scan, and 33 included primary studies; the multi-case study used semi-structured interviews with 11 startups, 12 interviews, and 13 interviewees.
- Data were analyzed with open coding and thematic coding in NVivo; the model was validated through reanalysis of primary studies, the focus group, categorization of 43 prototyping instances, and interviewee validation of company-specific descriptions.
Limitations
- Paper-stated: theoretical validity risks include possibly missing relevant previous research, the model not fully aligning with current industry practice, and the modified aspects (prototype media, prototype use, exploration strategy) not being presented to interviewees; generalizability is believed to be medium, and further research is needed with large established software product companies.
- Paper-stated: empirical data lacked support for some aspects and facets, particularly exploration strategy and quality improvement; focus group and interview data are confidential and not publicly available, and the single first researcher’s interpretation of interview material was only partly mitigated by interviewee validation.
- Evident from the text: validation relied on one initial case company (Telavox) and eleven startups, mostly in inception or stabilisation phases, recruited through convenience sampling from local incubators, so the findings may not extend to other organizational contexts.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
7 of 151 cited sources checked · 4 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Software startups typically perform light-weight, informal and ad-hoc requirements engineering, in particular during the early stages of the startup venture due to limited resources.
“Software startups typically perform light-weight, informal and ad-hoc requirements engineering, in particular during the early stages of the startup venture due to limited resources (Giardino et al. 2014;Klotins et al. 2019;Nguyen-Duc et al. 2017;Terho et al. 2016).”
Quote in the paperNot a substantial claim2 of 3 sources checked- cites Giardino et al. 2014 source
The section “Software development is driven by customers, who act as designers” says startups define a minimal set of functional requirements while learning the needs of their first customers. “Practical takeaways” describes ad-hoc agile and lean methods, and “Lack of resources” says resources are extremely limited. The paper does not specifically say that requirements engineering is informal or ad hoc because of limited resources, particularly in the venture’s early stages. (LLM, conf=0.84)
Experimental — accuracy not yet measured - cites Klotins et al. 2019 source
Section 3.1 describes start-ups gathering requirements through interviews, brainstorming and customer feedback, while the Introduction notes their limited resources. The paper does not establish that requirements engineering is typically lightweight, informal and ad hoc, or that resource constraints cause this approach particularly in early stages. Page numbers were not available in our copy. (LLM, conf=0.82)
Experimental — accuracy not yet measured - cites Nguyen-Duc et al. 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
The preference for certain types of prototype media is often due to the skills and previous experiences of prototyping technologies and tools of those involved in the startup, which play an important role when selecting the media used for prototyping.
“This preference for certain types of prototype media is often due to the skills and previous experiences of prototyping technologies and tools of those involved in the startup, which play an important role when selecting the media used for prototyping (Gupta et al. 2021;Nguyen-Duc et al. 2017).”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites Gupta et al. 2021 source
The Evaluation of Prototyping Tools section says startups selected tools based on familiarity from previous work and that competence affected their use of Adobe XD. It supports the role of skills and experience in tool choice, but does not establish that those factors determine a preference for particular types of prototype media. The supplied passages do not give a page number for this section. (LLM, conf=0.85)
Experimental — accuracy not yet measured - cites Nguyen-Duc et al. 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data
PAM consists of five aspects of prototyping: purpose, prototype scope, prototype media, prototype use, and exploration strategy.
“Our prototyping aspects model (PAM) consists of five aspects of prototyping, namely purpose, prototype scope, prototype media, prototype use, and exploration strategy.”
Quote in the paperSubstantial claim- Rests on an assumption: The five aspects of PAM are sufficient to characterise prototyping practices.
- Findingnone given
PAM has enabled practitioners to discuss their prototyping practices in terms of the concepts provided by the model.
“This model has enabled practitioners to discuss their prototyping practices in terms of the concepts provided by our model.”
Quote in the paperSubstantial claim - Findingown data
The previous structure of the Prototype use aspect was less aligned with how the interviewees described their use of prototypes.
“This is the aspect where the previous structure was less aligned with how the interviewees described their use of prototypes.”
Quote in the paperSubstantial claim
- Findingown data
Beta release C3 to 2-3 customers is used to tune the implementation further and thus improve the problem-solution fit.
“while the beta release C3 “to 2-3 [customers] is used to tune [the implementation] further” (Company C) and thus improve the problem-solution fit.”
Quote in the paperNot a substantial claim - Findingnone given
When demoing sketches or early mock-ups, there is no reviewer interaction with the prototype.
“When demoing, e.g. of sketches or early mock-ups, there is no reviewer interaction with the prototype.”
Quote in the paperNot a substantial claim - Findingown data
There are examples of choosing not to allow reviewer interaction with the prototype because customer awareness is too low and the market is still not aware of their needs to have the level of understanding to be active in giving constructive feedback on premature mock-ups.
“There are also examples of choosing not to allow reviewer interaction with the prototype since “[customer] awareness is too low” (Company A) and “the market is still not that aware of their needs…to have the level of understanding to be active [in giving constructive feedback on premature mock-ups]” (Company E).”
Quote in the paperNot a substantial claim - Findingown data
Prototyping is used in communicating about sales to make customers understand that there is a need.
“is thus used in communicating “about sales… to make them understand that there is a need” (Company A).”
Quote in the paperSubstantial claim - Findingown data
When discussing the scope of a prototype, the degree of refinement of visual appearance, interactive behaviour, and functionality worked well.
“When discussing the scope of a prototype, the degree of refinement of the visual appearance, interactive behaviour, and functionality worked well.”
Quote in the paperSubstantial claim - Findingown data
Prototyping in these startups ranges from simple sketches through mock-ups to using source code to explore and obtain feedback on early software versions.
“Prototyping in these startups ranges from using simple sketches through mock-ups, to using source code to explore and to obtain feedback on early software versions.”
Quote in the paperNot a substantial claim - Findingown data
Prototyping is not directly used within our startups for the purpose of improving quality.
“while we observe that prototyping is not directly used within our startups for the purpose of improving quality”
Quote in the paperSubstantial claim - Findingown data
Initially, startups often iterate at the level of the product, as described by Company E: we have an idea and want to see if it works.
“Initially, startups often iterate at the level of the product, as was described by the interviewee from Company E: “we have an idea and want to see if it works.””
Quote in the paperNot a substantial claim - Findingown data
The previous dimension of review method is not fine-grained enough to categorise the identified prototyping instances.
“We find that the (previous) dimension of review method is not fine-grained enough to categories the identified prototyping instances.”
Quote in the paperSubstantial claim - Findingown data
Several of the startups included in our multi-case study described showing prototypes to family-friends-and-foes (FFF) before going to potential customers, as a means to obtain friendly feedback.
“Several of the startups included in our multi-case study described showing prototypes to family-friends-and-foes (FFF) before going to potential customers, as a means to obtain friendly feedback.”
Quote in the paperNot a substantial claim - Findingown data
There were variations in how reviewers could interact with the prototype.
“There were also variations in how these reviewers could interact with the prototype.”
Quote in the paperSubstantial claim - Findingown data
The focus group participants described several purposes for prototyping.
“The participants described several purposes for prototyping.”
Quote in the paperNot a substantial claim - Findingown data
The media used to represent a prototype (e.g. paper or PowerPoint sketches, computer-generated mock-ups, or source code software) was an important aspect to consider.
“When discussing and analysing the prototyping in the startups it became clear that the media used to represent a prototype, e.g.paper or PowerPoint sketches, computergenerated mock-ups, or source code software, was an important aspect to consider.”
Quote in the paperSubstantial claim - Findingown data
We identified forty-three prototyping instances among our startups.
“In total, we identified forty-three prototyping instances among our startups, see Table 7.”
Quote in the paperNot a substantial claim - Findingown data
This connection between skill set and prototype media is also found in our interview material.
“This connection between skill set and prototype media also found in our interview material.”
Quote in the paperNot a substantial claim - Findingown data
There is roughly the same amount of in-vivo and in-vitro research on prototyping methodology.
“and that there is roughly the same amount of in-vivo and in-vitro research on this topic (RQ3)”
Quote in the paperSubstantial claim - Findingown data
The increase in articles is mainly within the areas of HF & Design and RE.
“The increase is mainly within the areas of HF & Design and RE.”
Quote in the paperNot a substantial claim - Findingown data
The systematic map consists of thirty-three primary studies published between 1988 and 2018.
“Our systematic map consists of thirty-three primary studies published between 1988 and 2018, see Table4.”
Quote in the paperSubstantial claim - Findingown data
There is only some research on the use of prototyping as a requirement engineering (RE) practice.
“While there is a host of research on prototyping within user interaction design, software engineering and agile development, we find only some research on the use of prototyping as a requirement engineering (RE) practice.”
Quote in the paperSubstantial claim - Findingown data
Several startups describe using scenarios both when demonstrating a prototype and when asking users to interact with it as a means to enhance understandability and communicating how their product solution can address user problems.
“Several startups also describe using scenarios both when demonstrating a prototype and when asking users to interact with it as a means to enhance understandability and communicating how their product solution can address user problems.”
Quote in the paperNot a substantial claim - Findingown data
The focus group participants described using solution-agnostic questions to focus a prototype demonstration on the problem description, rather than on details in the solution.
“For example, the focus group participants described using solution-agnostic questions to focus a prototype demonstration on the problem description, rather than on details in the solution.”
Quote in the paperNot a substantial claim - Findingnone given
Most research on the methodological aspects of the practice of prototyping concerns the scope of a prototype rather than considering the overall practice of prototyping.
“Also, most of the research on the methodological aspects of the practice of prototyping concerns the scope of a prototype (e.g.horizontal vs. vertical, hi-vs lo-fidelity, paper prototyping, sketching, mockups etc.) rather than considering the overall practice of prototyping (that also includes how and with whom a prototype is used and for what purposes).”
Quote in the paperSubstantial claim - Findingown data
Research on prototyping methodology has mainly been performed within software engineering (in general) and within human factors & design.
“We conclude that research on prototyping methodology has mainly been performed within software engineering (in general) and within human factors & design (RQ2)”
Quote in the paperSubstantial claim - Findingown data
At our initial case company, prototypes are frequently used internally to try out new ideas.
“At our initial case company, prototypes are frequently used internally to try out new ideas.”
Quote in the paperNot a substantial claim - Findingown data
The interviewees that did mention using a parallel exploration approach tended to have a background in user-interaction design.
“The interviewees that did mention using a parallel exploration approach tended to have a background in user-interaction design.”
Quote in the paperNot a substantial claim - Findingown data
In general, our startup companies describe using prototypes primarily internally in the early stages of their business venture, and gradually extending the use to family-friends-and-foes and then to external stakeholders such as potential customers and investors.
“In general, our startup companies describe using prototypes primarily internally in the early stages of their business venture, and gradually extending the use to family-friends-and-foes and then to external stakeholders such as potential customers and investors.”
Quote in the paperSubstantial claim - Findingown data
When categorising the prototyping instances described in the interviews of the multi-case study, a fifth aspect emerged, namely the kind of prototype media used, e.g. sketch, mock-up, or source code software.
“When categorising the prototyping instances described in the interviews of the multi-case study, a fifth aspect emerged, namely the kind of prototype media used, e.g.sketch, mock-up, or source code software.”
Quote in the paperSubstantial claim - Findingown data
The four aspects included in the initial version of our model-purpose, prototype scope, prototype use, and exploration strategy-were covered at our focus group and in the twelve interviews of our multi-case study.
“This was the case at our focus group and in the twelve interviews of our multi-case study where the four aspects included in the initial version of our model were covered, namely purpose, prototype scope, prototype use, and exploration strategy.”
Quote in the paperNot a substantial claim - Findingown data
We identified five main aspects of prototyping included in PAM: purpose, scope, media, method of use, and exploration strategy.
“We have identified five main aspects of prototyping (RQ1) that are included in our model, namely the purpose of prototyping, the scope of a prototype, the prototype media, the method of prototype use, and the exploration strategy used to explore the solution space.”
Quote in the paperSubstantial claim - Findingown data
The re-analysis only led to minor modifications and improvements of the presented model.
“We interpret the fact that this re-analysis only led to minor modifications and improvements of the presented model (see Section 3.3) as an indication of high descriptive validity although further research is required to further strengthen the evidence for our model.”
Quote in the paperSubstantial claim - Findingown data
Our research identifies five main aspects of prototyping (RQ1) that cover the Why? and How? and What? of prototyping.
“Our research identifies five main aspects of prototyping (RQ1) that cover the Why? and How? and What? of prototyping.”
Quote in the paperSubstantial claim - Premisecitation
Only one related literature review of prototyping concerning the definition of MVP exists.
“and only one related literature review of prototyping concerning the definition of MVP (Lenarduzzi et al. 2016).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lenarduzzi et al. 2016 source
- Premisecitation
There is a lack of theory on prototyping.
“Even so, there is a lack of theory on prototyping.”
- Also stated in: § 1 Introduction · plain
“While there is more recent research on prototyping, we find no comprehensive theory of the practice or its methodology, e.g.overarching principles or procedures for achieving a certain outcome, and only one related literature review of prototyping concerning the definition of MVP (Lenarduzzi et al. 2016).”
Quote in the paperSubstantial claim0 of 2 sources checked - Also stated in: § 1 Introduction · plain
- Premisecitation
Prototyping instances tend to be gradually refined from sketches and interactive mock-ups to fully functioning software versions, often MVPs.
“Prototyping instances tend to be gradually refined from sketches and interactive mock-ups to fully functioning software versions, often MVPs.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
- Premisecitation
Many startups prefer using more refined prototypes instead of prototyping using simpler media such as paper sketches or mock-ups.
“Despite this, our case study found that many startups prefer using these more refined prototypes instead of prototyping using simpler media such as paper sketches or mock-ups.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
- Premisecitation
Within startups, an early version of the final product is often used to validate product ideas with users, e.g. by demonstrating mock-ups to customers, as a cost-effective way to obtain market feedback.
“Within startups, an early version of the final product is often used to validate product ideas with users (Alves et al. 2020;Tripathi et al. 2018), e.g. by demonstrating mock-ups to customers, as a cost-effective way to obtain market feedback.”
Quote in the paperNot a substantial claim0 of 2 sources checked - Study design and conductown data
The model and its practical applicability and usefulness were further validated through semi-structured interviews at the other eleven case companies by using the model with practitioners to discuss and describe their prototyping practices.
“The model and its practical applicability and usefulness were further validated through semi-structured interviews at the other eleven case companies by using the model with practitioners to discuss and describe their prototyping practices.”
Quote in the paperSubstantial claim- Rests on an assumption: The case companies' prototyping practices are representative enough to validate and improve PAM.
- Premisecitation
Illustrating and communicating product requirements through a prototype reduces risks related to low requirements specification quality.
“Illustrating and communicating product requirements through a prototype reduces risks related to low requirements specification quality (Ramesh et al. 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ramesh et al. 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
A prototype may convey an overly positive impression of the current status that can lead to unrealistic customer expectations and subsequent requests to evolve the prototype into the final system.
“However, a prototype may convey an overly positive impression of the current status that can lead to unrealistic customer expectations and subsequent requests to evolve the prototype into the final system (Lichter et al. 1994).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lichter et al. 1994 source
- Premisecitation
Exploration of multiple solutions can mitigate the risk of overinvesting in a single concept.
“Such exploration of multiple solutions can mitigate the risk of overinvesting in a single concept (Dow et al. 2011).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dow et al. 2011 source
- Premisecitation
One of the main purposes of prototyping is to validate requirements by testing a solution option with internal and/or external stakeholders for perspectives such as problem-solution fit, product-market fit, technical feasibility, and usability.
“One of the main purposes of prototyping is to validate requirements by testing a solution option with internal and/or external stakeholders (Ciriello et al. 2017;Tronvoll et al. 2017) for perspectives, such as problem-solution fit, product-market fit, technical feasibility, and usability.”
Quote in the paperSubstantial claim0 of 2 sources checked - Study design and conductown data
The focus group with practitioners provided an initial validation of our model.
“The focus group with practitioners provided an initial validation of our model.”
Quote in the paperSubstantial claim - Premisecitation
Prototypes can support requirements elicitation by clarifying problems early on.
“Ciriello et al. note that prototypes can support requirements elicitation by clarifying problems early on (Ciriello et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ciriello et al. 2017 source
- Study design and conductown data
The design of our model was further refined after subsequent validation with practitioners at Telavox and through a multi-case study of ten software startup companies.
“The design of our model was further refined after subsequent validation with practitioners at Telavox and through a multi-case study of ten software startup companies.”
Quote in the paperSubstantial claim - Interpretationreasoning
Prototype scope relates to the purpose of prototyping.
“Thus, prototype scope relates to the purpose of prototyping.”
Quote in the paperSubstantial claim - Premisecitation
A project's purpose of prototyping often evolves from exploration and communication to validation & testing.
“A project's purpose of prototyping often evolves from exploration and communication to validation & testing (Ratcliff 1988).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ratcliff 1988
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Requirements are initially elicited and prioritised mainly based on internal sources and on problems experienced by founders.
“Requirements are initially elicited and prioritised mainly based on internal sources and on problems experienced by founders.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Nguyen-Duc et al. 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Terho et al. 2016 source
- Premisecitation
One purpose of prototyping may be to evolve the prototype into a final product based on user feedback and priorities.
“One purpose of prototyping may be to evolve the prototype into a final product based on user feedback and priorities (Budde and Zullighoven 1990;Lichter et al. 1994;Schneider 1996;Toffolon and Dakhli 2008).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Budde and Zullighoven 1990
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Lichter et al. 1994 source
- cites Schneider 1996
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductnone given
The initial draft of the prototyping aspects model was validated through a focus group at Telavox.
“The initial draft of the prototyping aspects model was validated through a focus group at Telavox.”
Quote in the paperNot a substantial claim - Study design and conductown data
The first published version of the model was further validated through a multi-case study of eleven software startup companies where twelve practitioners were interviewed about their use of prototyping.
“The first published version of the model was then further validated through the multi-case study of eleven software startup companies where twelve practitioners were interviewed about their use of prototyping.”
Quote in the paperSubstantial claim - Premisecitation
The use of production software in prototyping (rather than throw-away prototypes) incurs risks related to product quality such as scalability, security, and robustness.
“In particular, research shows that the use of production software in prototyping (rather than throw-away prototypes) incurs risks related to product quality such as scalability, security, and robustness (Ramesh et al. 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ramesh et al. 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The dimension of iteration size replaces the other three exploration options of the initial version of the model, namely point-based, optimisation, and flexible exploration.
“The dimension of iteration size replaces the other three exploration options (of the initial version of our model), namely point-based, optimisation, and flexible exploration.”
Quote in the paperSubstantial claim - Premisecitation
Tronvoll's flexible exploration strategy corresponds to a single exploration strategy where the solution options are based on best-guesses and on facilitating the change of quality requirements as the work progresses.
“Finally, Tronvoll's flexible exploration strategy corresponds to a single exploration strategy where the solution options are based on best-guesses and on facilitating the change of quality requirements as the work progresses.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tronvoll et al. 2017 source
- Study design and conductown data
The focus group participants confirmed all four review methods included in the first version of the model: internal use, demonstrations, scenario-based, and free testing.
“The participants confirmed all four review methods included in the first version of our model, i.e., internal use, demonstrations, scenario-based, and free testing.”
Quote in the paperNot a substantial claim - Premisecitation
When iterating over multiple parallel prototyping instances, the length of the iterations may impact the extent and quality of the prototyped solution option and thus the prototyping effectiveness.
“When iterating over multiple parallel prototyping instances, the length of the iterations may impact the extent and quality of the prototyped solution option and thus the prototyping effectiveness (Tronvoll et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tronvoll et al. 2017 source
- Interpretationown data
Challenges in accessing the actual usage environment partly explain why many startups only tested prototypes in meeting settings.
“In part, this is due to challenges in accessing the actual usage environment.”
Quote in the paperNot a substantial claim - Study design and conductown data
The focus group provided validation for the prototype scope aspect of the model.
“The focus group provided validation for this aspect of our model.”
Quote in the paperNot a substantial claim - Interpretationown data
The three replacement dimensions correspond better to how the interviewees describe their use of prototypes.
“This corresponds better to how the interviewees describe their use of prototypes.”
Quote in the paperSubstantial claim - Interpretationreasoning
The environment of use may result in some future users being underrepresented in the prototyping, further limiting the feedback.
“Thus, the environment of use may result in some future users being underrepresented in the prototyping, further limiting the feedback.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The purpose of Quality Improvement is retained in the model despite lack of support in the case study.
“we retain the purpose of Quality Improvement in our model.”
Quote in the paperNot a substantial claim - Interpretationown data
A dimension of Interactivity is added to the model to cover how reviewers interact with prototypes.
“We have added a dimension of Interactivity to our model to cover this dimension.”
Quote in the paperSubstantial claim - Interpretationreasoning
The difference between the previous exploration strategies mainly connects to the size of the change between prototype versions.
“The difference between these previous strategies mainly connects to the size of the change between prototype versions.”
Quote in the paperSubstantial claim - Interpretationreasoning
The review method dimension is replaced with three dimensions: reviewers, prototype interaction, and review approach.
“Instead, we replace this dimension in our model with the three dimensions reviewers (who receives or gives feedback on the prototype), prototype interaction (directly with prototype or not, e.g. when demoing), and review approach (scenario-based or free).”
Quote in the paperSubstantial claim - Premisecitation
Using a prototype in conditions similar to that of the final product increases the chance of uncovering new setting-specific requirements.
“Using a prototype in conditions similar to that of the final product increases the chance of uncovering new setting-specific requirements (Lichter et al. 1994).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lichter et al. 1994 source
- Interpretationcitation
With these four facets of prototype use the main uses of prototype identified in our literature review can be represented, namely internal prototype use without any user presentation, prototype demonstrations, scenario testing, and free testing.
“With these four facets of prototype use the main uses of prototype identified in our literature review can be represented, namely internal prototype use without any user presentation (Budde and Zullighoven 1990;Dow et al. 2011;Schneider 1996), prototype demonstrations (Bellomo et al. 2013;Heisler et al. 1989), scenario testing (Tronvoll et al. 2017), and free testing (Heisler et al. 1989;Tronvoll”
Quote in the paperSubstantial claim0 of 3 sources checked - Interpretationown data
Different prototyping instances may be used for each dimension of Problem-Solution fit and Product-Market fit.
“Different prototyping instances may be used for each dimension.”
Quote in the paperSubstantial claim - Study design and conductown data
Eleven software startups (Company A-K) were investigated in our multi-case study.
“Eleven software startups (Company A-K) were investigated in our multi-case study, see Table 1.”
Quote in the paperSubstantial claim - Study design and conductown data
We validated the prototyping aspects model through our multi-case study with eleven startups.
“We validated the prototyping aspects model through our multi-case study with eleven startups.”
Quote in the paperSubstantial claim - Interpretationreasoning
These aspects can be used to characterize prototyping instances and thereby provide practitioners and researchers with a model that can help them to reflect on, analyse, and improve their prototyping practices.
“These aspects can be used to characterize prototyping instances and thereby provide practitioners and researchers with a model (see Section 5) that can help them to reflect on, analyse, and improve their prototyping practices.”
Quote in the paperSubstantial claim - Premisecitation
Our previous research indicates that some startups tend to prefer and strive to use source code software for prototyping since they believe this enables them to demonstrate ability and build trust with customers and investors.
“However, our previous research indicates that some startups tend to prefer and strive to use source code software for prototyping since they believe this enables them to demonstrate ability and build trust with customers and investors (Bjarnason 2021).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
- Interpretationnone given
Exploring multiple options in parallel enables optimising, e.g. a detail in the design, or different parameters in a revenue model.
“Exploring multiple options in parallel enables optimising, e.g. a detail in the design, or different parameters in a revenue model.”
Quote in the paperNot a substantial claim - Study design and conductown data
PAM is based on a systematic mapping study of previous research.
“Our prototyping aspects model (PAM) is based on a systematic mapping study of previous research and has been iteratively validated and improved upon through a focus group at one case company and through interviews at eleven startup companies (RQ4).”
Quote in the paperSubstantial claim - Premisecitation
Moving too quickly to production source code comes with a risk of having to cancel the project later on.
“While there may be stakeholders, e.g.sponsors, that are eager to quickly move on to realising and delivering a novel idea, moving too quickly to production source code comes with a risk of having to cancel the project later on (Ciriello et al. 2017).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Ciriello et al. 2017 source
- Interpretationnone given
Exploring one solution path or quality aspect at a time through prototyping allows for freely selecting solution options based on current knowledge and as requirements changes.
“Exploring one solution path or quality aspect at a time through prototyping allows for freely selecting solution options based on current knowledge and as requirements changes.”
Quote in the paperNot a substantial claim - Study design and conductown data
PAM has been iteratively validated and improved upon through a focus group at one case company and through interviews at eleven startup companies.
“Our prototyping aspects model (PAM) is based on a systematic mapping study of previous research and has been iteratively validated and improved upon through a focus group at one case company and through interviews at eleven startup companies (RQ4).”
Quote in the paperSubstantial claim - Study design and conductnone given
The risk of misinterpreting the focus group participants was mitigated using the same kind of independent re-analysis of the transcript.
“The risk of misinterpreting the focus group participants was mitigated using the same kind of independent re-analysis of the transcript.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Since our model is based on previous research within HF, RE and agile software development, we believe that our model may be valid and relevant beyond the case companies involved in our study.
“Since our model is based on previous research within HF, RE and agile software development, we believe that our model may be valid and relevant beyond the case companies involved in our study.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The obtained feedback can be steered to specific aspects by structuring the prototype demo sessions.
“The obtained feedback can be steered to specific aspects by structuring the prototype demo sessions.”
Quote in the paperNot a substantial claim - Interpretationown data
The omission of mentioning data richness at the focus group and among the remaining seven interviewees is interpreted as an indication of low awareness of the importance of the facet of data for prototyping.
“We interpret the omission of mentioning this facet at the focus group and among the remaining seven interviewees as an indication of low awareness of the importance of the facet of data for prototyping.”
Quote in the paperSubstantial claim - Interpretationnone given
Who and how a prototype is used affects the type of knowledge that can be obtained through the interactions that take place both with the actual prototype and between the people involved in, e.g. a prototype demonstration.
“Who and how a prototype is used affects the type of knowledge that can be obtained through the interactions that takes place both with the actual prototype and between the people involved in, e.g. a prototype demonstration.”
Quote in the paperSubstantial claim - Interpretationcitation
The environment in which a prototype is used is another facet of use that affects the feedback that can be obtained.
“The environment in which a prototype is used is another facet of use that affects the feedback that can be obtained.”
Quote in the paperSubstantial claim
- Probably not a substantial claim. 189
- It may state two separate claims as one. 138
- The quote only partly states this claim. 1
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationPrototyping is used as a means to learn about the user and the market, and to increase the chances of business success.
“Thus, prototyping is used as a means to learn about the user and the market (Giardino et al. 2015;Paternoster et al. 2014), and to increase the chances of business success.”
Quote in the paperNot a substantial claim1 of 2 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThis cost-benefit aspects is especially important to software startups who operate under very uncertain and resource-constraint conditions with the aim of exploring new business opportunities and develop innovative products.
“This cost-benefit aspects is especially important to software startups who operate under very uncertain and resource-constraint conditions with the aim of exploring new business opportunities and develop innovative products (Giardino et al. 2014;Paternoster et al. 2014).”
Quote in the paperNot a substantial claim2 of 2 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThis complexity in managing quality requirements has also been observed in the context of another agile RE practice, namely the one of using test cases as requirements.
“This complexity in managing quality requirements has also been observed in the context of another agile RE practice, namely the one of using test cases as requirements (Bjarnason et al. 2016).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Bjarnason et al. 2016 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataInterviewees responded mainly by agreeing to the descriptions and highlighting minor misunderstandings and additional information, after which the manuscript was revised.
“The interviewees responded, mainly by agreeing to the descriptions and by highlighting some minor misunderstandings and additional information, after which the manuscript was revised accordingly.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataAfter the first two interviews, it became clear that the terms prototyping and prototype are not uniformly understood, which caused some initial confusions at these interviews.
“After the first two interviews, it became clear that the terms prototyping and prototype are not uniformly understood, which caused some initial confusions at these interviews.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataA similar fifth aspect of prototype media was added in the second version of our model based on the insights gained from our multi-case study.
“However, a similar fifth aspect of prototype media was added in the second version of our model based on the insights gained from our multi-case study.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
FindingreasoningThe aspect of strategy was renamed exploration strategy and the aspect of review method was renamed prototype use to more clearly reflect what these aspects represent.
“The aspect of strategy was renamed exploration strategy and the aspect of review method was renamed prototype use to more clearly reflect what these aspects represent.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningThe facets related to validation & testing were grouped to provide a better overview of the purposes of prototyping.
“The facets related to validation & testing were grouped to provide a better overview of the purposes of prototyping.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
FindingreasoningFinally, the facet of usage environment was added to prototype use since the feedback that can be obtained from demonstrating or testing a prototype may vary for, e.g., a loud or a dark environment compared to in a meeting setting.
“Finally, the facet of usage environment was added to prototype use since the feedback that can be obtained from demonstrating or testing a prototype may vary for, e.g., a loud or a dark environment compared to in a meeting setting.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataTwo additional facets were added to prototype scope, namely interactive & haptic behaviour, and realistic data, both of which were observed in the original analysis, but initially not included.
“Two additional facets were added to prototype scope, namely interactive & haptic behaviour, and realistic data, both of which were observed in the original analysis, but initially not included.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataThis internal validation mainly led to renaming aspects, adding, and restructuring some facets.
“This internal validation mainly led to renaming aspects, adding, and restructuring some facets.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataTwo focus group participants said that early prototyping, e.g., through sketching, can be useful in understanding the problem.
“In contrast, two participants said that early prototyping, e.g., through sketching, can be useful in understanding the problem.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataThe Exploration strategy aspect was the hardest to discuss with interviewees and the one with the least number of responses with the exception of parallel exploration.
“This final aspect was the hardest to discuss with our interviewees, and the one with the least number of responses with the exception of parallel exploration.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataReviewers are often internal within the startups and development team, as well as external such as customers, funders, or product users.
“Thus, reviewers are often internal within the startups and development team, as well as, external such as customers, funders, or product users.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataA third interviewee said they focus one thing at a time and learn about, but in some cases parallel exploration is useful, e.g. for a pricing model.
“A third interviewee said: “focus one thing at a time and learn about.But, in some cases [parallel exploration is useful] … e.g. for a pricing model” (Company I).”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataThe focus group participants recognised the relevance of considering breadth and depth of functionality, and refinement of all identified facets except for data richness, which was not mentioned.
“They recognised the relevance of considering breadth and depth of functionality, and refinement of all our identified facets (of the first version of our model) except for data richness, which was not mentioned during the focus group.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataOne interviewee described videos as a way to present products far before they are ready.
“One interviewee described videos as a way “to present products far before they are ready” (Company I).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataSeveral focus group participants said that prototyping is time consuming and difficult, and rarely used during early phases and at the first meetings with customers.
“Several participants said that prototyping is time consuming and difficult, and rarely used during early phases and at the first meetings with customers.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataPrototyping instance I3 and interviews are a means of prototyping even without anything to show by talking to people about how they solve this problem today.
“This interviewee also described prototyping instance I3 and interviews as a means of prototyping “even without anything to show” by “talking to people about how they solve this problem today” (Company I).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataThe later more refined mockup A2 becomes a blueprint for the product to be built by developers.
“The later more refined “mockup [A2] then becomes a blueprint for the product to be built by developers” (Company A).”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataSome startups find cheaper and easier prototype media such as videos and interviewing very useful.
“which some of our startups find very useful.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataIn early prototyping instance J1, Company J asked users and that became an important signal that their solution idea was viable.
“In the early prototyping instance J1, they “asked people [users]… [and] that became an important signal” that their solution idea was viable”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence.
Findingown dataFor more refined prototypes with respect to functionality, visual appearance, and interactivity, users may be encouraged to try the prototypes out for themselves.
“For more refined prototypes w.r.t.functionality, visual appearance, and interactivity, the users may be encouraged to try the prototypes out for themselves.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataIn prototyping instances H1, J6, I1 and I2, videos are used for sales & marketing (communication) and for validating product-market fit.
“For example, in prototyping instances H1, J6, I1 and I2, videos are used for sales & marketing (communication) and for validating product-market fit.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataFor Company J, prototyping instance J3 used FFF when they made something new and asked what they think.
“For example, for Company J, the prototyping instance J3 used “FFF when we have made something new.What do they think?””
Quote in the paperNot a substantial claimProbably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
Findingown dataOne interviewee believed that environment is an important aspect of mobile solutions, to test them in their correct context.
“One interviewee believed that “[environment] is an important aspect of mobile solutions, to test them in their correct context” (Company I).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataThe two facets related to prototyping iterations were indicated by a few interviewees.
“The two facets related to prototyping iterations were indicated by a few of our interviewees.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataA startup that provides a technical solution uses scenarios to help non-techie customers see the value in the solution through presenting cases to them and avoid just clicking them through.
“Similarly, a startup that provides a technical solution uses scenarios to help non-techie customers “see the value [in the solution] …[through] presenting these cases to them… and avoid just clicking us through” (Company G).”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataThe dimension of usage environment worked well, even though many startups only tested their prototypes in meeting settings.
“The dimension of usage environment worked well, even though many of our startups only tested their prototypes in meeting settings.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataSome startups described using family and friends (FFF, Family, Friends, and Foes) for obtaining feedback on prototypes.
“In addition, some startups described using family and friends (so called FFF, Family, Friends, and Foes) for obtaining feedback on prototypes.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataOne interviewed technical lead advocated the need to iterate slowly to ensure what the stakeholder originally wished for.
“For example, one interviewed technical lead advocated the “need to iterate slowly… [to ensure] what the stakeholder originally wished for” (Company D).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataMock-up C2 was used to explore what is required by the market, i.e. product-market fit.
“For example, the mock-up C2 was used to “explore what is required [by the market]”, i.e. product-market fit”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataProduct-Market Fit is especially important for startups that must produce a prototype to confirm that they have buyers and thus revenue before incurring more costs without knowing that it is sellable.
“Product-Market Fit is especially important for startups that “must produce a prototype to be able to confirm that you have buyers, and thus revenue… [before] incurring more costs without knowing that it is sellable” (Company A).”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataUsing multiple prototype versions in parallel was a clear and understandable strategy, though most startups stated that due to resource constraints they tend to focus on one version at a time.
“Using multiple prototype versions in parallel was a clear and understandable strategy, though most of our startups stated that due to resource constraints they tend to focus on one version at a time.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataAll interviewees described with whom prototypes were used, i.e. Reviewers, and often the same prototype is used with multiple kinds of reviewers.
“All interviewees described with whom prototypes were used, i.e.Reviewers, and often the same prototype is used with multiple kinds of reviewers.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Findingown dataOne of the main purposes of prototyping is as a tool for selling products to customers.
“One of the main purposes of prototyping is “as a tool for selling products to customers” (Company B)”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingown dataThe aggregated dimension of broad vs narrow functional scope was harder to convey, though examples of both broad and narrow prototypes covering many vs a few features were seen.
“The aggregated dimension of broad vs narrow functional scope was harder to convey, though we saw examples of both broad and narrow prototypes covering many vs a few features.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataOne interviewee described that they do not focus that much on interactivity at the beginning.
“For example, one interviewee described that “we do not focus that much on interactivity at the beginning” (Company F).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataA startup that markets advanced AI algorithms described that they need accurate data to back up their algorithm and thus demonstrate their solution by using actual customer data.
“Another startup that markets advanced AI algorithms described that they “need accurate data to back up [our algorithm]”, and thus demonstrate their solution by using “actual [customer] data” (Company H).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataThere was some disagreement about prototyping in early project stages.
“There was some disagreement about prototyping in early project stages.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenA similar aspect related to paper prototyping was discussed during the original design of the model but discarded because prototype scope appeared sufficient.
“A similar aspect, related to paper prototyping, was discussed by the authors during our original design of the model, but discarded at that point in time since the aspect of prototype scope appeared to be sufficient.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataWhen demonstrating paper mock-ups of prototyping instance F1, the startup would try to get customers to think about what they do then in that scenario.
“For example, when demonstrating the paper mock-ups of prototyping instance F1, the startup would “try to get them [customers] to think about what they do then [in that scenario] (Company F).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataCompany J used videos in social media channels for sales & marketing purposes; funny videos became a bit viral.
“Similarly, the now growing startup Company J used videos in social media channels for sales & marketing purposes; “funny videos that became a bit viral” (Company J).”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataWhile scenario testing was included in the initial version of the model, interviewees primarily described the use of scenarios as an approach that could be applied both when demoing a prototype or when allowing users to interact directly with the prototype.
“Finally, while scenario testing was included in our initial version of the model, our interviewees primarily described the use of scenarios as an approach that could be applied both when demoing a prototype, or when allowing users to interact directly with the prototype.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataCompany A invested quite a lot of work in building a high-fidelity interactive mockup (A2) that is fake but good, communicates that they know and builds trust, and based on that they get investors.
“Company A had invested “quite a lot of work” in building a high-fidelity interactive mockup (prototyping instance A2) which “is fake, but quite good… communicates that we know and builds trust… Based on that we get investors.”(Company A).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataUsers are encouraged to interact directly with the mock-up of prototyping instance F2 to see reactions, how they reason, how they select and react to things, which provides the startup with rich feedback.
“Similarly, users are encouraged to interact directly with the mock-up of prototyping instance F2 “to see reactions….how they reason, how they select and react to things” (Company F), which provides the startup with rich feedback.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it.
Findingown dataWhen data is fairly realistic it can be shown to customers without any problems.
“and that when “the data is fairly realistic… [it] can be shown to customer without any problems” (Company G).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataIn total, we interviewed thirteen practitioners at the case companies, mostly founders and co-founders, but also some product owners and technical leads.
“In total, we interviewed thirteen practitioners at the case companies, mostly founders and co-founders, but also some product owners and technical leads.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataFor prototyping instances K4 and K5, the startup goes through a simple scenario, explains the challenges, and shows the solution.
“A similar approach is seen for prototyping instances K4 and K5, where the startup “goes through a simple scenario, explains the challenges, and shows the solution” (Company K).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataThe sketches of prototyping instance A1 were tried out on themselves and on people in their proximity, then they started developing.
“For example, the sketches of prototyping instance A1 were “tried out on ourselves and on people in our proximity, then we started developing” (Company A).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataThese participants preferred stakeholder interviews and competitor analysis to understand the problem domain.
“Instead, these participants preferred stakeholder interviews and competitor analysis to understand the problem domain.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataCompany J uses interviewing for exploring the problem domain.
“This startup also uses interviewing for exploring the problem domain.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingnone givenFor Validation & Testing, the boundaries between Market viability and Business viability were hard to determine for the prototyping instances, and the difference between these two is unclear.
“For Validation & Testing, the boundaries between Market viability and Business viability were hard to determine for the prototyping instances, and the difference between these two is unclear.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
FindingcitationMost of these companies were in the inception or stabilisation phase of their business ventures, while Companies E and J were in the growth stage.
“Most of these companies were in the inception or stabilisation phase (Klotins et al. 2019) of their business ventures, while Companies E and J were in the growth stage (Klotins et al. 2019).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Klotins et al. 2019
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataFor Company F, testing in a live environment is difficult since their product targets clinics and it varies a lot how open they are with this.
“For example, for Company F where testing in a live environment is “difficult since our product targets clinics… varies a lot how open they are with this.””
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataThe fully functioning product prototype of B3 was available to the general public and customers get to use their stuff, allowing the startup to follow up how they are used in the field.
“For example, the fully functioning product prototype of B3 was available to the general public and “customers get to use our stuff… [allowing the startup to] follow up how they are used in the field” (Company B).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataThey had used simple prototypes in the form of sketches, which helped designers and users understand what they were discussing and assisted in framing the role of the system.
“They had used simple prototypes in the form of sketches, which helped designers and users understand what they were discussing and assisted in framing the role of the system.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataInterviewees described that they have chosen to produce a mock-up due to cost and time aspects.
“Our interviewees described that they “have chosen to produce a mock-up due to cost and time aspects” (Company A).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataAnother interviewee mentioned that they always try to sketch different options, though without giving any concrete example of this.
“Another interviewee mentioned that “we always try to sketch different [options]” (Company F) though without giving any concrete example of this (and therefor not seen in any of the reported prototyping instances.)”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataOne interviewee said they go with one option first since they are a small team.
“As one interviewee said: “we go with one [option] first since we are a small team” (Company H).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The authors may not put it forward as true. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
Findingown dataIt is important to use realistic data otherwise customers probably get stuck on that.
“Also, “it is really important to use that [realistic data] otherwise your [customers] probably get stuck on that” (Company F)”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataThe Purpose aspect mostly worked well in discussing and categorising how the startups use prototyping, with only two minor revisions for Communication and Validation.
“This aspect mostly worked well in discussing and categorising how the startups use prototyping, and only two minor revisions are made to this aspect, namely for the purposes Communication and Validation.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataFor J4, Company J grabbed people in the corridors and asked them what they think, and then realised that they had missed several things.
“and for J4 they “grabbed people in the corridors and ask them what they think… [and then] realised that we had missed several things”(Company J).”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Findingown dataIn general, the focus group participants agreed to the scenarios, that they correspond to a typical way of working and to their prototyping practices, which they see as a good way of working with agile software development.
“In general, the participants agreed to the scenarios, that they correspond to a typical way of working and to their prototyping practices, which they see as a good way of working with agile software development.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataCompany J later used a similar approach in prototyping instance J5 to validate their revenue model.
“and later used a similar approach in prototyping instance J5 to validate their revenue model.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataFive interviewees expressed the importance of realistic data, e.g. to capture behaviour around errors and bad data.
“In addition, five interviewees expressed the importance of realistic data, e.g. to capture behaviour around “errors and bad data” (Company I).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataStartups then move towards more gradual development and more structured feature growth from the very basic experimental ideas up to the ready-for-market products.
“And, then move towards “more gradual development … and more structured feature growth from the very basic experimental ideas up to the ready-formarket products” (Company E).”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
FindingreasoningSingle option exploration is the most common approach among our startups since it is more cost-effective.
“Single option exploration is the most common approach among our startups since it is more cost-effective.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataThe multi-case study described 43 prototyping instances.
“Overview of the 43 prototyping instances (Nn) described by case companies (N = A-K), categorized by our prototyping aspects model.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingnone givenOur research indicates a number of potential relationships within the entities of the model, e.g. between prototype scope and prototyping purpose, that appear to affect the learnings that can be obtained.
“Furthermore, our research indicates a number of potential relationships within the entities of the model, e.g. between prototype scope and prototyping purpose, that appear to affect the learnings that can be obtained.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Findingown dataThe feedback from the interviewees mainly concerned additions, e.g. mentioning more prototyping instances, which were then incorporated in the paper.
“The feedback from the interviewees mainly concerned additions, e.g.mentioning more prototyping instances, which were then incorporated in the paper.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingnone givenWe have investigated the current body of knowledge regarding prototyping methodology through a systematic mapping study and a multi-case study of eleven startups.
“We have investigated the current body of knowledge regarding prototyping methodology through a systematic mapping study and a multi-case study of eleven startups.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingown dataWhile UX designers can quickly produce mock-ups using tools, e.g. Figma, software developers often prefer sketching and exploring their ideas directly in source code software.
“For example, while UX designers can quickly produce mock-ups using tools, e.g.Figma, software developers often prefer sketching and exploring their ideas directly in source code software.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataWe observe an increase in publication rate during the past decade and of empirically based research (RQ3).
“We observe an increase in publication rate during the past decade and of empirically based research (RQ3).”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataThis is similar to our focus group participants who described only using single exploration in later development stages, while preferring a strategy of parallel exploration in early stages to keep an open mind to alternative solutions and avoid getting locked into one solution option at an early stage.
“This is similar to our focus group participants who described only using single exploration in later development stages, while preferring a strategy of parallel exploration in early stages to keep an open mind to alternative solutions and avoid getting locked into one solution option at an early stage.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Findingown dataThe number of articles appear to have increased somewhat over the years from on average 1 to 2 articles a year, except around the year 2000.
“The number of articles appear to have increased somewhat over the years from on average 1 to 2 articles a year, except around the year 2000.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataOur focus group participants described using prototypes with customers either through a demonstration without any direct user interaction, or as free testing of a beta version of the software.
“Our focus group participants described using prototypes with customers either through a demonstration without any direct user interaction, or as free testing of a beta version of the software.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataFive interviewees in the startups could relate to the importance of using realistic data, mainly to convey realistic scenarios and trust to customers, but also for validating error cases connected to missing or badly formatted data.
“However, five of our interviewees in the startups could relate to the importance of using realistic data, mainly to convey realistic scenarios and trust to customers, but also for validating error cases connected to missing or badly formatted data.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingown dataFocus group participants actively related to three facets of refinement, namely functionality, visual appearance and interactive behaviour, but did not mention data richness.
“While our focus group participants actively related to three of the facets of refinement, namely functionality, visual appearance and interactive behaviour, they did not mention data richness.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingown dataThe systematic map on which our model is based consists of thirty-three primary studies and represents a wide set of papers from the past thirty years from the areas of human factors and design, requirements engineering, and agile software development (RQ2).
“The systematic map on which our model is based consists of thirty-three primary studies and represents a wide set of papers from the past thirty years from the areas of human factors and design, requirements engineering, and agile software development (RQ2).”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingown dataWhile all these strategies are relevant to prototyping, we found that when discussing exploration strategy with practitioners a different set of facets is more suitable.
“While all these strategies are relevant to prototyping, we found that when discussing exploration strategy with practitioners a different set of facets is more suitable.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Findingown dataThe majority of the primary studies (17) were within software engineering (in general), 11 within human factors (HF) & design, and 5 within requirements engineering (RE).
“The majority of these (17) were within software engineering (in general), 11 within human factors (HF) & design, and 5 within requirements engineering (RE), see Table5.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingnone givenDirect interaction with prototypes is common for internal use and when the prototype is slightly more refined.
“Direct interaction with prototypes is common for internal use and when the prototype is slightly more refined.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Findingnone givenThere appears to be an increase of in-vivo research on prototyping methodology during the past decade.
“although there appears to be an increase of in-vivo research during the past decade.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Findingown dataAn additional purpose of prototyping is to specify requirements and to act as a requirements specification, as was mentioned by several of our case companies.
“An additional purpose of prototyping is to specify requirements and to act as a requirements specification, as was mentioned by several of our case companies.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Study design and conductown dataPAM is based on a systematic mapping study of thirty-three primary studies and empirical data from twelve case companies.
“The model is based on a systematic mapping study consisting of thirty-three primary studies and on empirical data from twelve case companies.”
Quote in the paperSubstantial claim- Rests on an assumption: The systematic mapping study's primary studies cover the relevant body of knowledge on prototyping methodology.
Probably not a substantial claim.
InterpretationreasoningSoftware startups face the challenge of balancing the cost of prototype scope and media against the gains and value that can be obtained from more refined prototypes.
“Thus, software startups face the challenge of balancing the cost of prototype scope and media against the gains and value that can be obtained from more refined prototypes.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
InterpretationreasoningPAM can be used to categorise prototyping instances and can thereby support practitioners in reflecting and improving on their prototyping practices.
“The model can be used to categorise prototyping instances and can thereby support practitioners in reflecting and improving on their prototyping practices.”
Quote in the paperSubstantial claim- Rests on an assumption: The five aspects of PAM are sufficient to characterise prototyping practices.
It may state two separate claims as one.
PremisecitationInternally, prototyping is used to explore and communicate detailed product requirements, while prototypes are used externally to communicate and validate product-market fit.
“Internally, prototyping is used to explore and communicate detailed product requirements, while prototypes are used externally to communicate and validate product-market fit.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Bjarnason 2021 source
It may state two separate claims as one.
PremisecitationFor startups, prototyping plays a vital role in market validation and in obtaining paying customers.
“Thus, for startups, prototyping plays a vital role in market validation and in obtaining paying customers.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationHigh-fidelity prototypes are more expensive to build but can be used to test and evaluate further details of the design, and even serve as a basis for development of the product under design.
“while high-fidelity prototypes are more expensive to build they can be used to test and evaluate further details of the design, and even serve as a basis for development of the product under design (Rudd et al. 1996).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Rudd et al. 1996 source
It may state two separate claims as one.
PremisecitationThe more refined prototype versions (realistic mock-ups and early versions of production software) are more costly to produce and require software engineering expertise.
“The more refined prototype versions (realistic mock-ups and early versions of production software) are more costly to produce and require software engineering expertise.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationLow-fidelity prototypes can convey a general look of an interface and are often used to communicate, educate and inform.
“Low-fidelity prototypes can convey a general look of an interface and are often used to communicate, educate and inform, while high-fidelity prototypes are more expensive to build they can be used to test and evaluate further details of the design, and even serve as a basis for development of the product under design (Rudd et al. 1996).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Rudd et al. 1996 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationIn an earlier publication, prototyping is commonly used within early-stage startups as a natural part of developing and validating a product, but also that prototyping is implicitly required to ensure funding of the startup venture.
“In that study (Bjarnason 2021), we found that prototyping is commonly used within early-stage startups as a natural part of developing and validating a product, but also that prototyping is implicitly required to ensure funding of the startup venture.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrototyping can facilitate communication of design ideas by providing a concrete basis for discussions between developers, designers, and users.
“Prototypes can facilitate communication of design ideas by providing “a concrete basis for discussions” between developers, designers, and users (Budde and Zullighoven 1990).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Budde and Zullighoven 1990
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisereasoningThe use of prototypes can stimulate user involvement, and support marketing and selling new product ideas to customers and to (internal) management.
“Thus, the use of prototypes can stimulate user involvement, and support marketing and selling new product ideas to customers and to (internal) management.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Study design and conductown dataPAM was validated and its applicability demonstrated through a focus group at one company and through semistructured interviews at eleven startup companies.
“We validate and demonstrate the applicability of our model through a focus group at one company and through semistructured interviews at eleven (other) startup companies.”
Quote in the paperSubstantial claim- Rests on an assumption: The case companies' prototyping practices are representative enough to validate and improve PAM.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrototyping enables validating a solution proposal before developing the full product through cost effective testing with real users.
“Thus, prototyping enables validating a solution proposal before developing the full product through cost effective testing with real users (Nielsen 1993).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Nielsen 1993 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrototypes serve as a vehicle that enables users and designers to develop a common language.
“As such, prototypes “serve as a vehicle that enables users and designers to develop a common language” (Hakim and Spitzer 2000).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hakim and Spitzer 2000
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationSoftware startups were selected as our object of study due to these companies frequent use of prototyping to explore and shape their business models and product offerings, as part of the Lean startup method where new products are designed through continuously building, measuring, and learning what the customers want and are willing to pay for.
“Software startups were selected as our object of study due to these companies frequent use of prototyping to explore and shape their business models and product offerings, as part of the Lean startup method (Ries 2011) where new products are designed through continuously building, measuring, and learning what the customers want and are willing to pay for (Olsen 2015).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Ries 2011
- cites Olsen 2015 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductown dataWe performed an initial validation of the draft version of the prototyping aspects model by re-analysing the articles in our systematic map.
“We performed an initial validation of the draft version of the prototyping aspects model by re-analysing the articles in our systematic map (see below).”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationPrototyping is often used within agile development to detail and validate requirements, and to reduce uncertainty.
“Thus, prototyping is often used within agile development to detail and validate requirements, and to reduce uncertainty (Bellomo et al. 2013).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bellomo et al. 2013 source
It may state two separate claims as one.
PremisecitationUser interface design can be validated through prototyping and uncover various usability issues.
“User interface design can be validated through prototyping (Derboven et al. 2010;Hakim and Spitzer 2000;Zink et al. 2017) and uncover various usability issues (Lim et al. 2008).”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites Derboven et al. 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Hakim and Spitzer 2000
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Lim et al. 2008 source
Probably not a substantial claim.
Study design and conductnone givenThe mapping study provided a broad base of scientific knowledge that supported our design of the model.
“The mapping study provided a broad base of scientific knowledge that supported our design of the model.”
Quote in the paperSubstantial claim- Rests on an assumption: The systematic mapping study's primary studies cover the relevant body of knowledge on prototyping methodology.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationSefelin et al. reports that the number of suggestions and critiques do not significantly differ between prototypes with a high vs. low degree of refinement.
“Sefelin et al. reports on a study on usability testing with prototypes where the number of suggestions and critiques do not significantly differ between prototypes with a high vs. low degree of refinement, i.e. between deep or shallow prototypes.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sefelin et al. 2003 source
Probably not a substantial claim. The authors may not put it forward as true. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationYasar reports that simpler prototypes with narrow functionality scope and a low degree of refinement are cost effective and useful for validation purposes and to capture major issues.
“Yasar even reports that simpler prototypes with narrow functionality scope and a low degree of refinement are cost effective and useful for validation purposes and to capture major issues (Yasar 207”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Yasar 2007 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationPrototyping has been identified as a practice commonly applied within agile software development to manage rapidly evolving requirements by the practices' ability to support customer communication, and for validating and refining requirements.
“Prototyping has been identified as a practice commonly applied within agile software development to manage rapidly evolving requirements by the practices' ability to support customer communication, and for validating and refining requirements (Ramesh et al. 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ramesh et al. 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductnone givenTo ensure equal airtime, the participants were given turns to initiate the discussion for each talking point.
“To ensure equal airtime, the participants were given turns to initiate the discussion for each talking point.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationThe source of requirements gradually shifts as potential customers are identified, and prototypes are produced that can be used to elicit new ideas and priorities also from customers and other external parties.
“The source of requirements gradually shifts as potential customers are identified, and prototypes are produced that can be used to elicit new ideas and priorities also from customers and other external parties (Nguyen-Duc et al. 2017;Terho et al. 2016).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Nguyen-Duc et al. 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Terho et al. 2016 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductnone givenData extraction, data analysis and classification of general and specific items of the primary studies was performed by the last two authors, and then validated by the first author.
“Data extraction, data analysis and classification of general and specific items of the primary studies was performed by the last two authors, and then validated by the first author.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductnone givenThe two last authors each performed this selection on the set from ACM and LUBsearch respectively. They aligned their selection by comparing and reaching consensus on inclusion and exclusion for a random set of 10 publications.
“The two last authors each performed this selection on the set from ACM and LUBsearch respectively.They aligned their selection by comparing and reaching consensus on inclusion and exclusion for a random set of 10 publications.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductown dataSearches were defined iteratively in-line with RQ1 through test searches and by consulting with two experts in prototyping.
“Searches were defined iteratively in-line with RQ1 through test searches and by consulting with two experts in prototyping.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationVery few startups work with parallel exploration and prototyping, and those who did work with parallel prototypes tended to have a background in usability and human-interaction design.
“In our previous research on the use of prototyping in startups, we found that very few startups work with parallel exploration and prototyping, and that those who did work with parallel prototypes tended to have a background in usability and human-interaction design (Bjarnason 2021).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
Probably not a substantial claim. It may state two separate claims as one.
Study design and conductown dataThrough the case study, we explored the practical applicability of our model by using it to discuss and categorise prototyping instances, thereby validating the model further and identifying improvements to it (RQ4).
“Through the case study, we explored the practical applicability of our model by using it to discuss and categorise prototyping instances, thereby validating the model further and identifying improvements to it (RQ4).”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationProblems and new solution directions can be discovered and explored through prototyping and can lead to new ideas and direct further exploration.
“Problems and new solution directions can be discovered and explored through prototyping and can lead to new ideas and direct further exploration (Lim et al. 2008).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lim et al. 2008 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductnone givenEach participant was sent a draft of the resulting articles for the parts derived from their interview for validation purposes.
“Furthermore, each participant was sent a draft of the resulting articles for the parts derived from their interview for validation purposes.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Study design and conductown dataIn the validation stage, interviewees were asked to validate descriptions related to their companies and the co-authors discussed and agreed to the revised version of the prototyping aspects model.
“Finally, in the validation stage of our case study, the interviewees were asked to validate the descriptions related to their companies and the co-authors discussed and agreed to the revised version of the prototyping aspects model.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationStartups struggle to define solutions for which there is product-market fit and risk wasting time and resources on developing unsuccessful features.
“While availability of open-source software and pay-as-you-go services provide software-based business opportunities, startups struggle to define solutions for which there is product-market fit and risk wasting time and resources on developing unsuccessful features (Giardino et al. 2015).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Giardino et al. 2015 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationSeveral researchers report that some usability issues can not be discovered unless the prototype provides a broad functional scope with a high degree of refinement, in particular for visual appearance and interactive behaviour.
“Several researchers report that some usability issues can not be discovered unless the prototype provides a broad functional scope with a high degree of refinement, in particular for visual appearance and interactive behaviour (Liu and Khooshabeh 2003;McCurdy et al. 2006).”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationAn executable prototype provides a rich means of communicating requirements details, and reduces the risk of ambiguity, incompleteness and inconsistency in the requirements communication.
“In particular, an executable prototype provides a rich means of communicating requirements details, and reduces the risk of ambiguity, incompleteness and inconsistency in the requirements communication (Acosta et al. 1994).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Acosta et al. 1994
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductnone givenThe description of the case company and the case-specific results have been reviewed by the case company.
“Furthermore, the description of the case company and the case-specific results have been reviewed by the case company.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Study design and conductown dataInterviewees were provided with the prototyping instances identified for their startup, memos including quotes from transcripts, and company and interviewee characteristics.
“The interviewees were provided with the prototyping instances identified for their startup, the memos related to these including the quotes extracted from the transcripts, and the company and interviewee characteristics reported in Section 4.2.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationBreadboard prototypes are used to investigate technical aspects and to support system specification and coding.
“Similarly, breadboard prototypes are used to investigate technical aspects, e.g. in circuit design, and to support system specification and coding (Budde and Zullighoven 1990;Ciriello et al. 2017;Lichter et al. 1994;Lim et al. 2008).”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThe use of a live product version as a prototype poses conflicts between the need for quick feedback and a focus on product quality.
“However, the use of a live product version as a prototype poses conflicts between the need for quick feedback and a focus on product quality (Ciriello et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ciriello et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrototyping helped with challenges related to managing with very little requirements documentation, such as intangible and unaligned views and plans on what to develop.
“They observed that prototyping helped with challenges related to managing with very little requirements documentation, such as intangible and unaligned views and plans on what to develop.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Käpyaho and Kauppinen 2015 source
It may state two separate claims as one.
PremisecitationPrototyping is commonly used to explore the solution space and learn by experimenting with ideas, and is a foundational purpose for any prototyping.
“Prototyping is commonly used to explore the solution space (Dow et al. 2011;Lim et al. 2008;Rahman et al. 2017;Wiberg and Stolterman 2014) and learn by experimenting with ideas (Budde and Zullighoven 1990;Chen et al. 1994;Tronvoll et al. 2017), and is a foundational purpose for any prototyping.”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
InterpretationreasoningThe facet of realistic data relates to look & feel, but primarily to the perspective of role since the degree to which provided data simulates actual use affects the user's ability to relate to their situation.
“The facet of realistic data relates to look & feel, but primarily to the perspective of role since the degree to which provided data simulates actual use affects the user's ability to relate to their situation.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Interpretationown dataWe have identified eight purposes of prototyping: exploration, communication, incremental development, quality improvement, and validation & testing of problem-solution fit, product-market fit, technical feasibility, and usability.
“We have identified eight purposes, namely exploration, communication, incremental development, quality improvement, and validation & testing of problem-solution fit, product-market fit, technical feasibility, and usability.”
Quote in the paperSubstantial claimProbably not a substantial claim.
InterpretationcitationOur model characterizes the methodology of prototyping by five aspects: purpose of prototyping, prototype scope, prototype media, use of prototype, and exploration strategy.
“Our model characterizes the methodology of prototyping by five aspects: purpose of prototyping, prototype scope, prototype media, use of prototype, and exploration strategy, and is here described based on related work.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationPrototyping facilitates presenting, discussing, and evaluating a product with external parties and internally within a project, thereby supporting decision making.
“Prototyping thus facilitates presenting, discussing, and evaluating a product with external parties, such as customers and investors, and internally within a project, thereby supporting decision making (Budde and Zullighoven 1990;Raja 2009).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Budde and Zullighoven 1990
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Raja 2009 source
Probably not a substantial claim.
Study design and conductcitationThe systematic mapping study was based on guidelines by Petersen et al. (Petersen et al. 2015) to explore and draw from current body of knowledge on prototyping to compile and provide an overarching view of prototyping methodology based on current knowledge.
“We performed a systematic mapping study based on guidelines by Petersen et al. (Petersen et al. 2015) to explore and draw from the current body of knowledge on prototyping to compile and provide an overarching view of prototyping methodology based on current knowledge.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Petersen et al. 2015 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationYasar describes three perspectives to consider when prototyping: role, look & feel, and implementation.
“Yasar describes three perspective to consider when prototyping: role (of product in a user's life), look & feel, and implementation (Yasar 2007).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Yasar 2007 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationPrototyping addresses several challenges within agile but also identify a need to complement prototyping with additional practices.
“Their findings indicate that prototyping addresses several challenges within agile but also identify a need to complement prototyping with additional practices.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Käpyaho and Kauppinen 2015 source
It may state two separate claims as one.
PremisecitationVisions and ideas about a product can be communicated through prototyping, which provides a common language between developers and stakeholders and acts as an anchor for group communication.
“Visions and ideas about a product can be communicated through prototyping, which provides a common language between developers and stakeholders (Budde and Zullighoven 1990;Ciriello et al. 2017;Rahman et al. 2017;Zink et al. 2017) and acts as an anchor for group communication (Dow et al. 2011).”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim. It may state two separate claims as one.
InterpretationcitationThe scope of a prototype describes the extent to which a prototype resembles the final product and is represented by breadth of functionality, functional refinement, and data realism.
“The scope of a prototype describes the extent to which a prototype resembles the final product and is, in our model, represented by the breadth of the prototype's functionality (Bruegger et al. 2009;Budde and Zullighoven 1990;Goldman and Narayanaswamy 1992;Hakim and Spitzer 2000;Lim et al. 2008;McCurdy et al. 2006;Tronvoll et al. 2017), and the facets of functional refinement (Bruegger et al. 2009”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationOne case study of prototyping in twenty Norwegian startups identified factors that affect the speed of prototyping, including the choice of prototype tools and components, varying competences, and the communication and involvement of customers and external stakeholders in the prototyping.
“One case study of prototyping in twenty Norwegian startups, by Nguyen-Duc et al., identified factors that affect the speed of prototyping, including the choice of prototype tools and components, varying competences, and the communication and involvement of customers and external stakeholders in the prototyping.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Nguyen-Duc et al. 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThe purpose of prototyping and how the prototype is used regarding customer involvement are factors that need to be considered when selecting prototyping practices.
“They observed that the purpose of prototyping and how the prototype is used regarding customer involvement are factors that need to be considered when selecting prototyping practices (Nguyen-Duc et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Nguyen-Duc et al. 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrototyping multiple design in parallel and sharing these led to more creative and better final designs.
“Research on the use of prototyping in generating new user interaction designs found that prototyping multiple design in parallel and sharing these led to more creative and better final designs (Dow et al. 2011).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dow et al. 2011 source
Probably not a substantial claim. It may state two separate claims as one.
Study design and conductnone givenThe reanalysis was performed to improve reliability and internal validation of our prototyping aspects model, while the focus group was performed to validate the relevance and usefulness of our model with practitioners.
“The reanalysis was performed to improve reliability and internal validation of our prototyping aspects model, while the focus group was performed to validate the relevance and usefulness of our model with practitioners.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper may give no reason why it holds.
Interpretationnone givenIn our model, look & feel is captured by the facets of visual and interactive & haptic behaviour.
“In our model, look & feel is captured by the facets of visual and interactive & haptic behaviour.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Study design and conductown dataThe initial draft version of our prototyping aspects model was validated through reanalysis of the primary studies of our systematic map and through a focus group at a case company.
“The initial draft version of our prototyping aspects model was validated through reanalysis of the primary studies of our systematic map and through a focus group at a case company.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationPrototyping can be used to investigate customer needs, validate and clarify customer requirements and tasks, and thus support a company in designing a solution to address customer problems.
“Prototyping can be used to investigate customer needs, validate and clarify customer requirements and tasks (Budde and Zullighoven 1990;Ciriello et al. 2017), and thus support a company in designing a solution to address customer problems.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Budde and Zullighoven 1990
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Ciriello et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrototyping enables cost effective testing with users.
“and thus, enables cost effective testing with users (Shepherd and Gruber 2020).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Shepherd and Gruber 2020 source
It may state two separate claims as one.
PremisecitationDemonstrating a fully functioning (but early) version of production software may convey an overly positive view of development status to customers and other stakeholders, that in turn may lead to a push to release software prematurely, before sufficient quality has been achieved.
“In this case, demonstrating a fully functioning (but early) version of production software may convey an overly positive view of development status to customers and other stakeholders, that in turn may lead to a push to release software prematurely, before sufficient quality has been achieved.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ramesh et al. 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
PremisecitationPrototyping can be used to explore a product's business potential from the customer perspective, and to assess the value of the product and likeliness of purchase and the product's ability to fit within time and budget constraints.
“Prototyping can be used to explores a product's business potential from the customer perspective, and to assess the value of the product and likeliness of purchase (McCurdy et al. 2006;Zink et al. 2017) and the product's ability to fit within time and budget constraints (Zink et al. 2017).”
Quote in the paperNot a substantial claim0 of 2 sources checkedIt may state two separate claims as one.
PremisecitationThe scope affects the cost of producing a prototype and the feedback that can be obtained.
“The scope affects the cost of producing a prototype and the feedback that can be obtained (Derboven et al. 2010;Lim et al. 2008;Liu and Khooshabeh 2003;McCurdy et al. 2006;Tronvoll et al. 2017).”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationA prototype built to demonstrate feasibility can also support project acquisition.
“Furthermore, Lichter et al. found that a prototype built to demonstrate feasibility can also support project acquisition (Lichter et al. 1994).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lichter et al. 1994 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThe insights gained from such prototyping can be used to support business-related decision making.
“The insights gained from such prototyping can be used to support business-related decision making (Ciriello et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ciriello et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationFeasibility testing requires a high share of the time invested in a project.
“Finally, Zink et al. found that feasibility testing requires a high share of the time invested in a project (Zink et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zink et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationThe quality of stakeholder communication at the case company was increased through prototyping and mutual understanding between the development team and the customers was reached faster.
“Furthermore, the quality of stakeholder communication at the case company was increased through prototyping and mutual understanding between the development team and the customers was reached faster.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Käpyaho and Kauppinen 2015 source
Probably not a substantial claim.
Study design and conductown dataThe first author performed triangulation of the model through an independent re-analysis of the primary studies of our systematic map including (re)coding the full text of the articles in NVivo.
“The first author performed triangulation of the model through an independent re-analysis of the primary studies of our systematic map including (re)coding the full text of the articles in NVivo.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrototyping also increased the motivation for requirements work since updating a prototype was considered more motivating than writing requirements documents.
“Prototyping also increased the motivation for requirements work since updating a prototype was considered more motivating than writing requirements documents (Käpyaho and Kauppinen 2015).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Käpyaho and Kauppinen 2015 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationUsers preferred testing with a prototype with a high degree of interactive refinement since this provided freedom to explore the system by themselves.
“However, the users preferred testing with a prototype with a high degree of interactive refinement since this provided freedom to explore the system by themselves (Sefelin et al. 2003).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sefelin et al. 2003 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationIn agile development, prototyping is often an integral part of the development process with regular feedback from users and other stakeholders.
“In agile development, prototyping is often an integral part of the development process with regular feedback from users and other stakeholders (Fairley and Willshire 2005), e.g. through validation of software at end-of-sprint demonstrations.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Fairley and Willshire 2005 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationOne important success factor is to test the business idea early on to validate its viability in the market.
“One important success factor is to test the business idea early on to validate its viability in the market (Block and MacMillan 1985).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Block and MacMillan 1985
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductown dataAll interviewees were contacted and asked to validate information relevant to their companies and to indicate whether they wished their company name included.
“All interviewees were contacted and asked to validate the information relevant to their companies, and to indicate if they wished their company name to be included in the article or not.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductnone givenFor the first version of the model, an additional design iteration was performed to increase internal validity of our model.
“For the first version of the model, an additional design iteration was performed to increase internal validity of our model.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Study design and conductown dataStudy selection was performed through a gradually extended scan of title, abstract, and full text using inclusion and exclusion criteria to guide the selection decisions, which resulted in identifying 33 primary studies.
“Study selection was performed through a gradually extended scan of title, abstract, and full text using inclusion and exclusion criteria to guide the selection decisions (see below), which resulted in identifying 33 primary studies.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationUsability testing was reported as the least common singular purpose for prototyping though it is often combined with other purposes.
“Usability testing was reported by Zink et al. as the least common singular purpose for prototyping though it is often combined with other purposes (Zink et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zink et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationAs the prototype representation of the (future) product becomes more concrete with each iteration, the product requirements thereby gradually become more specific.
“As the prototype representation of the (future) product becomes more concrete with each iteration, the product requirements thereby gradually become more specific (Zink et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zink et al. 2017 source
It may state two separate claims as one.
PremisecitationProof-of-concept prototypes are built for technical feasibility and can be used to evaluate novel technical approaches.
“Proof-of-concept prototypes are built for this purpose (Tronvoll et al. 2017) and can be used to evaluate novel technical approaches (Fern and Donaldson 1989).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Tronvoll et al. 2017 source
- cites Fern and Donaldson 1989
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
It may state two separate claims as one.
Study design and conductown dataOur participants validated the four exploration strategies included in the first version model and described that the strategy is varied throughout development stages and for different prototyping purposes.
“Our participants validated the four exploration strategies included in the first version model and described that the strategy is varied throughout development stages and for different prototyping purposes.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationTronvoll's optimisation exploration uses parallel exploration with a focus on feature or product level, and with gradually decreasing iteration sizes.
“Tronvoll's optimisation exploration uses parallel exploration with a focus on feature or product level, and with gradually decreasing iteration sizes.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tronvoll et al. 2017 source
Probably not a substantial claim.
InterpretationcitationOur facet of single exploration corresponds to Tronvoll's point-based strategy where resources are focused on one single solution path and where alternatives are considered before being cemented.
“Our facet of single exploration corresponds to Tronvoll's point-based strategy where resources are focused on one single solution path and where alternatives are considered before being cemented.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Tronvoll et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
InterpretationreasoningThe difference between point-based and flexible exploration could be deferred to the size of changes and connected to the stage and maturity of a product or an idea.
“Similarly, the difference between point-based and flexible could also be deferred to the size of changes and connected to the stage and maturity of a product or an idea.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationSefelin et al. compared paper sketches to computer-based prototypes of identical breadth and level of refinement, and the results showed no major differences in obtained feedback depending on prototype media.
“These prototypes were used for usability testing, and the results showed no major differences in the obtained feedback depending on prototype media.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sefelin et al. 2003 source
Probably not a substantial claim.
InterpretationreasoningThe lack of support for Quality Improvement in the case study is likely due to the nature of early startups, rather than lack of relevance in general of this purpose.
“The lack of support for this prototyping option in our case study is likely due to the nature of early startups, rather than lack of relevance in general of this purpose.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenThe exploration strategy determines which instances to pursue, how resources and decisions are organised, and how uncertainties are managed.
“The exploration strategy determines which instances to pursue, how resources and decisions are organised, and how uncertainties are managed.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Interpretationown dataA Review approach dimension is added with options scenario-based or free, where free covers both free testing, e.g. for beta releases, and demos without any clear scenarios.
“Thus, we added Review approach as a dimension with the options scenario-based or free, where free, covers both free testing, e.g. for beta releases, and demos without any clear scenarios.”
Quote in the paperSubstantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenOur terminology is more fine-grained and provides a more precise way of categorising prototypes by their breadth and degree of refinement with respect to different facets.
“Our terminology is more fine-grained and provides a more precise way of categorising prototypes by their breadth and degree of refinement w.r.t.different facets.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenOther reasons for only testing in meeting settings are likely cost and awareness of when testing in a live environment is important.
“Other reasons for this, are likely cost and awareness of when testing in a live environment is important.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Interpretationnone givenThis aspect concerns strategies used to traverse the solution space over time.
“This aspect concerns strategies used to traverse the solution space over time.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Interpretationown dataThe prototype media aspect is reintroduced in the model because the multi-case study indicates that the choice of prototype media affects the costs and benefits of prototyping.
“However, we reintroduce this aspect in our model since the multi-case study indicates that the choice of prototype media affects the costs and benefits of prototyping.”
Quote in the paperSubstantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
Interpretationnone givenEven a video or a physical model is included in our definition of a prototype, and can be used to validate product-market fit, or to communicate with stakeholders.
“Even a video or a physical model is included in our definition of a prototype, and can be used to, e.g., validate product-market fit, or to communicate with stakeholders.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationA prototype can be constructed using a range of techniques and media, including sketching on paper or in PowerPoint, using a prototyping tool to produce a wireframe or a mock-up, or using an early version of product software as your prototype.
“A prototype can be constructed using a range of techniques and media, including sketching on paper (Hendry et al. 2005) or in PowerPoint, using a prototyping tool to produce a wireframe or a mock-up (Liu and Khooshabeh 2003), or using an early version of product software as your prototype (McCurdy et al. 2006;Sefelin et al. 2003).”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationJaskiewicz et al. found that while longer iterations promote focusing on certain aspects, multiple short iterations can lead to a more diverse but superficial set of solution options.
“Jaskiewicz et al. found that while longer iterations promote focusing on certain aspects, multiple short iterations can lead to a more diverse but superficial set of solution options (Jaskiewicz and Helm 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Jaskiewicz and Helm 2018 source
Probably not a substantial claim.
InterpretationreasoningProblem-Solution fit and Product-Market fit more clearly separate prototyping to ensure the product matches user and customer needs by addressing their problem from prototyping to validate that customers are willing to pay and thus a viable market and business opportunity exists.
“This will more clearly separate between prototyping to ensure that the product matches the needs of users and customers by provides a solution that addressing their problem, and prototyping to validate that customers are willing to pay for your product and thus the existence of a viable market and business opportunities.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationSefelin et al. suggest selecting prototype media based on factors including the competence of those constructing the prototype, the abilities of the available prototyping tools, and the envisioned continuation of the prototyping.
“While paper sketches are often cheaper and faster to construct, Sefelin et al. suggest selecting prototype media based on a number of factors, including the competence of those constructing the prototype, the abilities of the available prototyping tools, and the envisioned continuation of the prototyping.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sefelin et al. 2003 source
It may state two separate claims as one.
PremisecitationThe cost of producing prototypes, the gains and types of learning that can be obtained from these varies with the media.
“While there is a correspondence between different kinds of prototype media and the scope of these, the cost of producing prototypes, the gains and types of learning that can be obtain from these varies with the media (McCurdy et al. 2006;Zainuddin and Liu 2012).”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim.
Interpretationown dataThe prototype scope aspect is revised to include Breadth as a stand-alone dimension, alongside functionality, visual appearance, interactive & haptic behaviour, and data realism.
“For this reason, we revise this aspect to include Breadth as a stand-alone dimension, alongside the dimensions that can be refined, i.e. functionality, visual appearance, interactive & haptic behaviour, and data realism.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationHendry et al. concluded that using a prototype in the streets enabled them to reach otherwise inaccessible user segments.
“Hendry et al. performed usability testing among home-less people and concluded that using a prototype in the streets enabled them to reach otherwise inaccessible user segments (Hendry et al. 2005).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hendry et al. 2005
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationPaper sketches provide more flexibility for designers in early stages, but require more effort to use with larger sets of users.
“They found that while paper sketches provide more flexibility for designers in early stages, this kind of prototype media requires more effort to use with larger sets of users, e.g., to manually simulate interaction.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zainuddin and Liu 2012 source
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
Interpretationnone givenOur model can support informed decisions of which prototype scope is required to meet the desired purposes of prototyping.
“We believe that our model can support informed decisions of which prototype scope that is required to meet the desired purposes of prototyping.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Interpretationnone givenThis aspect concerns how a prototype is used to achieve a purpose and covers who the reviewers are, if direct prototype interact is used, what review approach is used, and in what environment the prototype is presented and reviewed.
“This aspect concerns how a prototype is used to achieve a purpose and covers who the reviewers are (internal, external, or with family-friends-and-foes FFF), if direct prototype interact is used (or not), what review approach that is used (scenario based or free), and in what environment the prototype is presented and reviewed.”
Quote in the paperSubstantial claimProbably not a substantial claim.
Interpretationown dataThe exploration strategy aspect is modified to include three facets: single or parallel exploration, iteration focus (business, product, feature or optimisation level), and iteration size.
“Thus, we have modified the aspect of exploration strategy to include three facets: single or parallel exploration, iteration focus (business, product, feature or optimisation level), and iteration size.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Interpretationown dataThe Purpose aspect is adjusted to highlight that communication includes sales and marketing, changing Communication & Alignment to Communication: Sales, Alignment.
“For these reasons, we adjust the detailing of the aspect of Purpose in our model to highlight that communication includes sales and marketing, thus Communication & Alignment is changed to Communication: Sales, Alignment.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
InterpretationreasoningPrototyping in startups is primarily used for sales & marketing (Communication), internal exploration of the solution domain, feasibility testing of technical aspects of the solution design, and to validate the product-solution and product-market fit of their business model.
“Thus, prototyping is primarily used for sales & marketing (Communication), internal exploration of the solution domain, feasibility testing of technical aspects of the solution design, and to validate the product-solution and product-market fit of their business model.”
Quote in the paperSubstantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
InterpretationreasoningPrototyping with an optimisation strategy, and thus with small changes between versions, could be conveyed through giving the Purpose of Quality improvement.
“Prototyping with an optimisation strategy, and thus with small changes between versions, could be conveyed through giving the Purpose of Quality improvement.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Study design and conductown dataThe model was presented to practitioners in the interviews and used in the analysis.
“The model was presented to practitioners in the interviews and used in the analysis of”
Quote in the paperSubstantial claimIt may state two separate claims as one.
PremisecitationThe usage environment for a prototype can affect the outcome both in the possible feedback and the representation of subjects in the review.
“The usage environment for a prototype can affect the outcome (Grevet and Gilbert 2015;Lichter et al. 1994;Tronvoll et al. 2017) both in the possible feedback and the representation of subjects in the review.”
Quote in the paperSubstantial claim0 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationComputer-based prototypes tended to yield more comments on graphical details, while paper sketches stimulated participants to a greater willingness to draw their suggestions.
“However, the computerbased prototypes tended to yield more comments on graphical details, while the paper sketches stimulated participant to”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Sefelin et al. 2003 source
Probably not a substantial claim.
InterpretationreasoningMarket viability and Business viability are replaced with Problem-Solution fit and Product-Market fit.
“Instead, we replace these with the terms Problem-Solution fit and Product-Market fit (Osterwalder et al. 2014).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Osterwalder et al. 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence.
InterpretationreasoningThe revised scope model provides a clearer and more easily comprehensible model for describing the scope of a prototype.
“We believe this provides a clearer and more easily comprehensible model for describing the scope of a prototype.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
PremisecitationWithin one iteration, several concurrent solution paths can be pursued in parallel, which can stimulate innovation and avoid imposing unnecessary limitations, but also cause contradictions between prototypes and complicate decision making.
“Within one iteration, several concurrent solution paths can be pursued in parallel, which can stimulate innovation (Dow et al. 2011) and avoid imposing unnecessary limitations (Budde and Zullighoven 1990), but also cause contradictions between prototypes and complicate decision making (Jaskiewicz and Helm 2018).”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationInteractive computer-based mock-ups yielded more feedback when used for user testing.
“Furthermore, Liu and Khooshabeh also found that interactive computer-based mock-ups yielded more feedback when used for user testing.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Zainuddin and Liu 2012 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThe choice of media may affect the ease with which the prototype can be evaluated in some environments.
“The choice of media may also affect the ease with which the prototype can be evaluated in some environments (Hendry et al. 2005).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hendry et al. 2005
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim.
InterpretationcitationWe model the exploration strategy aspect using the three facets: single vs parallel exploration, iteration focus, and iteration size.
“We model this aspect using the three facets: single vs parallel exploration, iteration focus, and iteration size These facets are partly based on the four strategies identified by Tronvoll et al., namely point-based, parallel (or set-based solution arrays), optimisation (or performance set investigations), and flexible exploration (Tronvoll et al. 2017).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Tronvoll et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationHendry et al. found that paper sketches were a good media for eliciting and validating requirements in actual environments and with some stakeholder groups.
“Finally, Hendry et al. found that paper sketches were a good media for eliciting and validating requirements in actual environments and with some stakeholder groups, such as in public locations where people of all age categories can be accessed (Hendry et al. 2005).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hendry et al. 2005
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationBellomo et al. describe how a company consciously selects the breadth and degree of refinement of prototype scope to match the prototyping purpose, and to validate the concept in focus.
“Similarly, Bellomo et al. describe how a company consciously selects the breadth and degree of refinement of prototype scope to match the prototyping purpose, and to validate the concept in focus (Bellomo et al. 2013).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bellomo et al. 2013 source
Probably not a substantial claim. It may state two separate claims as one.
Study design and conductown dataThe model was initially designed based on previous literature, then validated and adjusted through the empirical data of the focus group and the multi-case study.
“The model was initially designed based on previous literature, then validated and adjusted through the empirical data of the focus group and the multi-case study.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper may give no reason why it holds.
InterpretationreasoningAs a startup and their solution approach matures, they are more likely to want to explore more fine-grained variations, e.g. in what features or what user-interface design to implement, in which case point-based exploration, or even optimisation exploration is more relevant.
“As a startup and their solution approach matures, they are more likely to want to explore more fine-grained variations, e.g. in what features or what user-interface design to implement, in which case point-based exploration, or even optimisation exploration is more relevant.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Interpretationnone givenIn startups, the main focus is on establishing a viable business model with a product solution that matches customer needs and problems, and developing initial product version to realise their solution ideas.
“In startups, the main focus is on establishing a viable business model with a product solution that matches customer needs and problems, and developing initial product version to realise their solution ideas.”
Quote in the paperSubstantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
InterpretationreasoningIn early stages of a startup, prototyping could be used for broad exploration of a suitable solution approach, in which case flexible exploration appears suitable.
“For example, in the early stages of a startup prototyping could be used for broad exploration of a suitable solution approach, in which case flexible exploration appears suitable.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
InterpretationreasoningWe suggest that the digital environment also may play an important role here and is a facet to consider for use of a prototype.
“We suggest that the digital environment also may play an important role here and is a facet to consider for use of a prototype.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Interpretationnone givenA high-quality mock-up that covers all the features of a future system with toy examples has a broad prototype scope covering all major features but with a low degree of functional refinement, high visual appearance and interactive behaviour refinement, and low realistic data refinement.
“For example, a high-quality mock-up that covers all the features of a future system with toy examples, has a broad prototype scope covering all major features but with a low degree of functional refinement of these, but with a high degree of refinement for their visual appearance and interactive behaviour, while it provides a low degree of refinement for realistic data (only toy examples).”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may state two separate claims as one.
Study design and conductnone givenThe modified aspects (Prototype media, Prototype use, and Exploration strategy) were used in our analysis of the interview material but were not presented to the interviewees.
“While these modified aspects were used in our analysis of the interview material, they were not presented to the interviewees.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
InterpretationreasoningChoosing source code as the prototype media enables quickly getting started with actual development, but this also comes with risks related to product quality and to cementing solution ideas too early on.
“While choosing source code as the prototype media enables quickly getting started with actual development, this also comes with risks related to product quality and to cementing solution ideas too early on.”
Quote in the paperNot a substantial claimProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
InterpretationreasoningThe lack of evidence for exploration strategy and quality improvement in our case studies may be due to contextual difference in how the practice of prototyping is used, but may also be an indication of areas for which increased insight may support practitioners in improving their prototyping practices.
“The lack of evidence for these in our case studies may be due to contextual difference in how the practice of prototyping is used, but may also be an indication of areas for which increased insight may support practitioners in improving their prototyping practices.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationSimpler and cheaper media such as paper or interviewing, or computer-based mock-ups can be used with good benefits, especially in the early stages of ideation and product design and development, such as in software startups.
“Simpler and cheaper media such as paper or interviewing, or computer-based mock-ups can be used with good benefits, especially in the early stages of ideation and product design and development, such as in software startups (Nguyen-Duc et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Nguyen-Duc et al. 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationFor startups, prototypes play a vital role in sales & marketing and in obtaining funding for their venture.
“In addition, for startups prototypes play a vital role in sales & marketing and in obtaining funding for their venture (Bjarnason 2021).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Bjarnason 2021 source
It may state two separate claims as one.
Interpretationnone givenThe kind of prototype media used affects the cost of constructing it, but also the learnings and benefits that can be obtained from using it.
“The kind of prototype media used affects the cost of constructing it, but also the learnings and benefits that can obtained from using it.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductnone givenThere is a risk that we have missed relevant previous research and that there are additional primary studies relevant to the topic of our systematic mapping study.
“While we believe our model provides a good representation of the existing research on prototyping methodology, there is a risk that we have missed relevant previous research and that there are additional primary studies relevant to the topic of our systematic mapping study.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Interpretationnone givenThe prototype scope affects the cost of prototyping and the type of feedback that can be obtained.
“The prototype scope also affects the cost of prototyping and the type of feedback that can be obtained.”
Quote in the paperNot a substantial claimProbably not a substantial claim.
Interpretationown dataSince data richness is also the facet with the least number of supporting references in our mapping study, this is interpreted as an indication that further knowledge and research on the role of data richness in prototyping is needed.
“Since it is also the facet with the least number of supporting references in our mapping study, we interpret this as an indication that further knowledge and research on the role of data richness in prototyping is needed.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductnone givenThe aspect of prototype media was not included in the model at this stage of the study and thus not covered in the focus group.
“The aspect of prototype media was not included in the model at this stage of our study and thus not covered in the focus group.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrevious research identifies four main strategies, namely point-based, parallel, optimisation and flexible exploration.
“Previous research identifies four main strategies, namely point-based, parallel, optimisation and flexible exploration (Tronvoll et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tronvoll et al. 2017 source
Probably not a substantial claim.
Interpretationnone givenThe breadth of a prototype and its degree of refinement for functionality, visual appearance, interactive behaviour, and data realism can be varied.
“The breadth of a prototype and its degree of refinement for functionality, visual appearance, interactive behaviour, and data realism, can be varied.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThis corresponds to previous research that found that parallel exploration stimulates innovation.
“This corresponds to previous research that found that parallel exploration stimulates innovation (Dow et al. 2011).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dow et al. 2011 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
InterpretationreasoningThrow-away prototyping is often advocated since companies are then forced to separate between identifying the 'right' requirements (through prototyping) and implementing the requirements 'right'.
“For these reasons, throw-away prototyping is often advocated since companies are then forced to separate between identifying the 'right' requirements (through prototyping) and implementing the requirements 'right'.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Interpretationnone givenCompared to previous literature, our model also distinguishes between the type of facet that is refined, e.g. visuals or functionality, and provides a more fine-grained terminology for describing the scope of a prototype.
“Compared to previous literature, our model also distinguishes between the type of facet that is refined, e.g.visuals or functionality, and provides a more fine-grained terminology for describing the scope of a prototype.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationPrototyping provides a powerful tool for communicating with customers and for creating a good communication climate within a development team by showing rather than just telling.
“Prototyping also provides a powerful tool for communicating with customers and for creating a good communication climate within a development team (Dow et al. 2011) by showing rather than just telling.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Dow et al. 2011 source
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
Study design and conductreasoningGeneralizability of our model beyond our case companies and the area of RE is believed to be medium.
“Generalizability of our model beyond our case companies and the area of RE is believed to be medium.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationThere is a risk that prototypes can convey an inaccurate perception of development status and create unrealistic expectations.
“However, there is also a risk that prototypes can convey an inaccurate perception of development status and create unrealistic expectations (Lichter et al. 1994).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lichter et al. 1994 source
Probably not a substantial claim. It may state two separate claims as one.
Interpretationnone givenAt the heart of prototyping lies exploration of the solution space through experimenting with ideas, gathering feedback, and iteratively detailing, validating, and communicating product requirements.
“At the heart of prototyping, lies exploration of the solution space through experimenting with ideas, gathering feedback, and iteratively detailing, validating, and communicating product requirements.”
Quote in the paperSubstantial claimIt may state two separate claims as one.
Interpretationnone givenWhile parallel exploration requires more resources, it also allows for delaying decisions on alternative requirement options until more knowledge has been obtained for these.
“While this approach requires more resources, it also allows for delaying decisions on alternative requirement options until more knowledge has been obtained for these.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Study design and conductreasoningWe judge that descriptive and theoretical validity are high for our study.
“We judge that both these aspects are high for our study.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductown dataThe results from the literature study and the focus group were presented at the case company, who also reviewed an earlier version of this paper describing the first version of our model without raising any concerns about misinterpretation.
“In addition, the results from the literature study and the focus group were presented at the case company, who also reviewed an earlier version of this paper describing the first version of our model without raising any concerns about misinterpretation.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Interpretationnone givenThe strategy used to explore the solution space affects which prototyping instances are pursued and how resources are utilised.
“The strategy used to explore the solution space affects which prototyping instances that are pursued and how resources are utilised.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationStudies report contradicting results on the relationship between prototype scope and the feedback that can be obtained, and thus the purpose that can be fulfilled.
“Furthermore, we note that studies report contradicting results on the relationship between prototype scope and the feedback that can be obtained, and thus the purpose that can be fulfilled.”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Study design and conductreasoningThere is a risk that our model is not complete and that there are additional aspects of prototyping, and in particular additional facets, that should be included in our model.
“Thus, there is a risk that our model is not complete and that there are additional aspects of prototyping, and in particular additional facets, that should be included in our model.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductown dataThe risk of the single first researcher mis-interpreting the interview material was partly mitigated by asking the interviewees to read through the summarising memos with selected quotes from the material and the set of identified prototyping instances.
“the interview material was partly mitigated by asking the interviewees to read through the summarising memos with selected quotes from the material and the set of identified prototyping instances.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
Interpretationnone givenPrototyping can also support exploring the problem at hand.
“Prototyping can also support exploring the problem at hand.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
InterpretationcitationIn both prototyping in small optimising iterations and managing quality requirements, the outcome focuses on evaluating against a range of values, as opposed to a simple pass/fail, and the increased complexity of needing to consider influencing factors.
“In both cases, the outcome focuses on evaluating against a range of values, as opposed to a simple pass/fail, and the increased complexity of needing to considering influencing factors (Tronvoll et al. 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tronvoll et al. 2017 source
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
Interpretationnone givenThe purpose of prototyping can vary and may consist of a combination of reasons.
“The purpose of prototyping can vary and may consist of a combination of reasons.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationWithin agile, prototyping is a known RE practice where requirements are gradually defined, validated, and communicated through prototyping as part of the incremental development process.
“Within agile, prototyping is a known RE practice where requirements are gradually defined, validated, and communicated through prototyping as part of the incremental development process (Ramesh et al. 2010).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Ramesh et al. 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim.
InterpretationreasoningThis set of facets can also be used to describe all four strategies included in the first version of the model.
“This set of facets can also be used to describe all four strategies included in the first version of the model.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThe two dimensions of breadth and refinement have been described in previous literature using the terms horizontal versus vertical prototyping, where horizontal prototyping explores the breadth and vertical prototyping the refinement of the scope of the software being developed.
“The two dimensions of breadth and refinement (in general) have been described in previous literature using the terms horizontal versus vertical prototyping (Budde and Zullighoven 1990), where horizontal prototyping explores the breadth and a vertical prototyping the refinement of the scope of the software being development.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Budde and Zullighoven 1990
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationIn our previous research on digital work environments, we have identified systems interplay and work interplay as two important factors to consider in RE for systems and tools intended to be used in the work place, i.e. the interaction with other systems and with current work practices.
“In our previous research on digital work environments, we have identified systems interplay and work interplay as two important factors to consider in RE for systems and tools intended to be used in the work place, i.e. the interaction with other systems and with current work practices (Håkansson and Bjarnason 2020).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Håkansson and Bjarnason 2020 source
Probably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrevious research identifies a connection between the length of an iteration and the number and quality of solution options, or requirement possibilities, that are obtained.
“We note that previous research identifies a connection between the length of an iteration and the number and quality of solution options, or requirement possibilities, that are obtained (Jaskiewicz and Helm 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Jaskiewicz and Helm 2018 source
Probably not a substantial claim.
InterpretationreasoningThe model is modified to cover single or parallel exploration where multiple solution paths are explored at once, the size and the focus of the iteration, e.g. business, product, feature, or optimisation level.
“For that reason, we modify our model to cover single or parallel exploration where multiple solution paths are explored at once, the size and the focus of the iteration, e.g.business, product, feature, or optimisation level.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationThere is a parallel between prototyping in small optimising iterations and how to manage quality (non-functional) requirements.
“Furthermore, we note a parallel between prototyping in small optimising iterations with how to manage quality (non-functional) requirements (Berntsson Svensson and Regnell 2015).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Berntsson Svensson and Regnell 2015
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
InterpretationreasoningThese conflicting findings indicate that the matter is complex, and that further empirical research is needed to identify the relevant factors of prototyping practice and the environment, and the relations between these.
“These conflicting findings indicate that the matter is complex, and that further empirical research is needed to identify the relevant factors of prototyping practice and the environment, and the relations between these.”
Quote in the paperNot a substantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
Study design and conductreasoningThere is a risk that our model does not fully align with current prototyping practices in industry, even though we have taken initial steps to explore and validate this.
“Furthermore, there is also a risk that our model does not fully align with current prototyping practices in industry, even though we have taken initial steps to explore and validate this.”
Quote in the paperNot a substantial claimIt may state two separate claims as one.
Interpretationnone givenWith a prototype, new requirements can be elicited through exploration & learning and validated by testing business viability, market desirability, technical feasibility, or usability.
“With a prototype, new requirements can be elicited through exploration & learning and validated by testing business viability, market desirability, technical feasibility, or usability.”
Quote in the paperSubstantial claimProbably not a substantial claim. It may state two separate claims as one.
Study design and conductnone givenThe primary studies were analysed twice, first as part of the initial design by the 2nd and 3rd author who calibrated their views, and then independently by the 1st author, as part of the initial validation (after the focus group).
“The primary studies were analysed twice, first as part of the initial design by the 2 nd and 3 rd author who calibrated their views, and then independently by the 1 st author, as part of the initial validation (after the focus group).”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
PremisecitationThe interactions around prototypes relate to the cognitive abilities and communication skills of those involved and is a complex and interesting area for further research.
“The interactions around prototypes relate to the cognitive abilities (Cafer and Misra 2009) and communication skills (Ciriello et al. 2017) of those involved and is a complex and interesting area for further research.”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim.
Study design and conductreasoningSeveral steps were taken to mitigate the risks of misunderstanding and misinterpreting the literature on which our model is based, the focus group participants, and the interviewees.
“Several steps were taken to mitigate the risks of misunderstanding and misinterpreting the literature on which our model is based, the focus group participants, and the interviewees.”
Quote in the paperSubstantial claimProbably not a substantial claim. The paper’s conclusions may not depend on it.
PremisecitationPrevious research describes the impact of the physical environment.
“Previous research describes the impact of the physical environment (Lichter et al. 1994).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lichter et al. 1994 source
The paper relies on this without support.
The five aspects of PAM are sufficient to characterise prototyping practices.
“The model can be used to categorise prototyping instances and can thereby support practitioners in reflecting and improving on their prototyping practices.”
The paper relies on this without support.
The case companies' prototyping practices are representative enough to validate and improve PAM.
“We validate and demonstrate the applicability of our model through a focus group at one company and through semistructured interviews at eleven (other) startup companies.”
The paper relies on this without support.
The systematic mapping study's primary studies cover the relevant body of knowledge on prototyping methodology.
“The mapping study provided a broad base of scientific knowledge that supported our design of the model.”
The paper relies on this without support.
The practice of prototyping can achieve many different purposes that often vary throughout the life cycle of a project.
“The practice of prototyping can achieve many different purposes that often vary throughout the life cycle of a project.”
The paper relies on this without support.
When prototyping, several purposes may be satisfied simultaneously.
“When prototyping, several purposes may be satisfied simultaneously, e.g., communicating the product idea to potential customers while also validating its market desirability.”
The paper relies on this without support.
Product-market fit is a premise for business viability.
“Product-market fit is a premise for business viability.”
The paper relies on this without support.
The choice of reviewers affects the learnings that can be obtained from prototyping.
“The choice of reviewers affects the learnings that can be obtained from prototyping.”
The paper relies on this without support.
Purely internal use of a prototype can support brainstorming and allow designers and engineers to generate and organize ideas.
“Purely internal use of a prototype can support brainstorming and allow designers and engineers to generate and organize ideas.”
The paper relies on this without support.
Using a prototype with external parties often increases the cost due to increased expectations and demands on quality.
“Using a prototype with external parties often increases the cost due to increased expectations and demands on quality.”
The paper relies on this without support.
There is usually no direct reviewer interaction with the prototype during demonstrations.
“There is usually no direct reviewer interaction with the prototype during demonstrations.”
The paper relies on this without support.
The needs and goals may change for each iteration, which can enable focusing on specific product aspects or parts.
“The needs and goals may change for each iteration, which can enable focusing on specific product aspects or parts.”
The paper relies on this without support.
If the solution appears unsuitable it may be necessary to discard the prototype and redo the process.
“If the solution appears unsuitable it may be necessary to discard the prototype and redo the process.”
The paper relies on this without support.
Solution options are judged by performance, which affects the evaluation.
“Solution options are judged by performance, which affects the evaluation.”
The paper relies on this without support.
The interview data accurately reflect the prototyping practices of the startups.
“the interview data to categorize the prototyping instances described by our interviewees.”
The paper relies on this without support.
The systematic mapping study's set of primary studies is comprehensive enough to represent the current body of knowledge on prototyping methodology.
“The systematic map on which our model is based consists of thirty-three primary studies and represents a wide set of papers from the past thirty years from the areas of human factors and design, requirements engineering, and agile software development (RQ2).”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Interviewed practitioner count differs
MinorThe introduction reports interviews with twelve practitioners, but the case-company section reports thirteen practitioners. Twelve is elsewhere given as the number of interviews, with one interview involving two founders.
“Herein, we also present results for RQ4 based on semi-structured interviews with twelve practitioners where PAM was used to discuss and categorise forty-three prototyping instances applied within the case companies.”
“In total, we interviewed thirteen practitioners at the case companies, mostly founders and co-founders, but also some product owners and technical leads.”
Startup company count differs
MinorThe model-refinement section says the multi-case study involved ten startup companies, while the methods section says it involved eleven.
“The design of our model was further refined after subsequent validation with practitioners at Telavox and through a multi-case study of ten software startup companies.”
“The first version was then further validated by the first author through semistructured interviews with practitioners from eleven startup companies”
Citations
Cites
Business models, business strategy and innovation
Teece, D. J. (2010) · Long Range Planning · doi:10.1016/j.lrp.2009.07.003 · Cited by 8,335
(2011) · Cited by 3,330
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
The Usability Engineering Lifecycle
NIELSEN, J. (1993) · Usability Engineering · doi:10.1016/b978-0-08-052029-2.50007-3 · Cited by 2,657
Requirements engineering paper classification and evaluation criteria: a proposal and a discussion
Wieringa, R., Maiden, N., Mead, N., & Rolland, C. (2006) · Requirements Engineering · doi:10.1007/s00766-005-0021-6 · Cited by 940
The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas
Lim, Y.-K., Stolterman, E., & Tenenberg, J. (2008) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1375761.1375762 · Cited by 718
The Lean Startup Framework: Closing the Academic–Practitioner Divide
Shepherd, D. A., & Gruber, M. (2021) · Entrepreneurship Theory and Practice · doi:10.1177/1042258719899415 · Cited by 459
Software development in startup companies: A systematic mapping study
Paternoster, N., Giardino, C., Unterkalmsteiner, M., Gorschek, T., & Abrahamsson, P. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.04.014 · Cited by 451
Agile requirements engineering practices and challenges: an empirical study
Ramesh, B., Cao, L., & Baskerville, R. (2007) · Information Systems Journal · doi:10.1111/j.1365-2575.2007.00259.x · Cited by 428
Low vs. high-fidelity prototyping debate
Rudd, J., Stern, K., & Isensee, S. (1996) · Interactions · doi:10.1145/223500.223514 · Cited by 422
Radziwill, N. (2015) · Quality Management Journal · doi:10.1080/10686967.2015.11918419 · Cited by 278
What Do We Know about Software Development in Startups?
Giardino, C., Unterkalmsteiner, M., Paternoster, N., Gorschek, T., & Abrahamsson, P. (2014) · IEEE Software · doi:10.1109/ms.2014.129 · Cited by 223
Sefelin, R., Tscheligi, M., & Giller, V. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.765986 · Cited by 209
McCurdy, M., Connors, C., Pyrzak, G., Kanefsky, B., & Vera, A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124959 · Cited by 192
Key Challenges in Early-Stage Software Startups
Giardino, C., Bajwa, S. S., Wang, X., & Abrahamsson, P. (2015) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-319-18612-2_5 · Cited by 169
MVP Explained: A Systematic Mapping Study on the Definitions of Minimal Viable Product
Lenarduzzi, V., & Taibi, D. (2016) · 2016 42th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa.2016.56 · Cited by 168
User Interface Design: A Software Engineering Perspective
Lauesen, S. (2004) · Cited by 144
Prototyping dynamics: sharing multiple designs improves exploration, group rapport, and results
Dow, S., Fortuna, J., Schwartz, D., Altringer, B., Schwartz, D., & Klemmer, S. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979359 · Cited by 138
Software startup engineering: A systematic mapping study
Berg, V., Birkeland, J., Nguyen‐Duc, A., Pappas, I. O., & Jaccheri, L. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.06.043 · Cited by 125
The Lean Product Playbook: How to Innovate with Minimum Viable Products and Rapid Customer Feedback
Olsen, D. (2015) · doi:10.1002/9781119154822 · Cited by 93
A multi-case study of agile requirements engineering and the use of test cases as requirements
Bjarnason, E., Unterkalmsteiner, M., Borg, M., & Engström, E. (2016) · Information and Software Technology · doi:10.1016/j.infsof.2016.03.008 · Cited by 84
Self-citationPrototyping in industrial software projects-bridging the gap between theory and practice
Lichter, H., Schneider-Hufschmidt, M., & Zullighoven, H. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.368126 · Cited by 81
Proverb (2003) · CRC Press eBooks · doi:10.1201/9780203496107.ch4 · Cited by 74
Paper or interactive?: a study of prototyping techniques for ubiquitous computing environments
Liu, L., & Khooshabeh, P. (2003) · CHI '03 extended abstracts on Human factors in computing systems - CHI '03 · doi:10.1145/765891.766132 · Cited by 61
Agile requirements engineering with prototyping: A case study
Kapyaho, M., & Kauppinen, M. (2015) · 2015 IEEE 23rd International Requirements Engineering Conference (RE) · doi:10.1109/re.2015.7320450 · Cited by 60
Piggyback Prototyping: Using Existing, Large-Scale Social Computing Systems to Prototype New Ones
Grevet, C., & Gilbert, E. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702395 · Cited by 55
Tripathi, N., Klotins, E., Prikladnicki, R., Oivo, M., Pompermaier, L. B., Kudakacheril, A. S., Unterkalmsteiner, M., Liukkunen, K., & Gorschek, T. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.08.059 · Cited by 55
Iterative rework: the good, the bad, and the ugly
Fairley, R. E., & Willshire, M. J. (2005) · Computer · doi:10.1109/mc.2005.303 · Cited by 41
Challenges of lean customer discovery as invention
Batova, T., Clark, D., & Card, D. (2016) · IEEE International Professional Communication Conference (ProComm) · doi:10.1109/ipcc.2016.7740514 · Cited by 32
Software evolution through iterative prototyping
Goldman, N. M., & Narayanaswamy, K. (1992) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.1992.753497 · Cited by 29
Prototyping Dynamics: Sharing Multiple Designs Improves Exploration, Group Rapport, and Results
Dow, S. P., Fortuna, J., Schwartz, D., Altringer, B., Schwartz, D. L., & Klemmer, S. (2012) · Springer eBooks · doi:10.1007/978-3-642-31991-4_4 · Cited by 29
Wiberg, M., & Stolterman, E. (2014) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2639189.2639487 · Cited by 26
When Prototyping Meets Storytelling: Practices and Malpractices in Innovating Software Firms
Ciriello, R. F., Richter, A., & Schwabe, G. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP) · doi:10.1109/icse-seip.2017.24 · Cited by 26
The Developers Dilemma: Perfect Product Development or Fast Business Validation?
Terho, H., Suonsyrjä, S., & Systä, K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49094-6_42 · Cited by 25
Empirical studies of requirements validation techniques
Raja, U. A. (2009) · 2009 2nd International Conference on Computer, Control and Communication · doi:10.1109/ic4.2009.4909209 · Cited by 24
Multimedia Prototyping for Early-Stage Startups Endurance: Stage for New Normal?
Gupta, V., Rubalcaba, L., & Gupta, C. (2021) · IEEE MultiMedia · doi:10.1109/mmul.2021.3122539 · Cited by 24
Video as a By-Product of Digital Prototyping: Capturing the Dynamic Aspect of Interaction
Karras, O., Unger‐Windeler, C., Glauer, L., & Schneider, K. A. (2017) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew.2017.16 · Cited by 23
Enhancing experience prototyping by the help of mixed-fidelity prototypes
Yasar, A.-U.-H. (2007) · Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology · doi:10.1145/1378063.1378137 · Cited by 19
A Model of Software Prototyping based on a Systematic Map
Bjarnason, E., Lang, F., & Mjöberg, A. (2021) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/3475716.3475772 · Cited by 19
Self-citationReflecting on Evidence-Based Timelines
Bjarnason, E., Heß, A., Svensson, R. B., Regnell, B., & Doerr, J. (2014) · IEEE Software · doi:10.1109/ms.2014.26 · Cited by 18
Self-citationInnovation by service prototyping design dimensions and attributes, key design aspects, and toolbox
Rahman, A., Razek, A., & van Husen, C. (2017) · IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC) · doi:10.1109/ice.2017.8279936 · Cited by 17
Software Engineering Antipatterns in Start-Ups
Klotins, E., Unterkalmsteiner, M., & Gorschek, T. (2019) · IEEE Software · doi:10.1109/ms.2018.227105530 · Cited by 17
A case study of applying rapid prototyping techniques in the Requirements Engineering Environment
Acosta, R. D., Burns, C. L., Rzepka, W. E., & Sidoran, J. L. (2002) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/icre.1994.292401 · Cited by 15
The use of prototypes within agile product development explorative case study of a Makeathon
Zink, L., Hostetter, R., Bohmer, A. I., Lindemann, U., & Knoll, A. (2017) · 2017 International Conference on Engineering, Technology and Innovation (ICE/ITMC) · doi:10.1109/ice.2017.8279871 · Cited by 15
Including Human Factors and Ergonomics in Requirements Engineering for Digital Work Environments
Hakansson, E., & Bjarnason, E. (2020) · 2020 IEEE First International Workshop on Requirements Engineering for Well-Being, Aging, and Health (REWBAH) · doi:10.1109/rewbah51211.2020.00013 · Cited by 15
Self-citationPrototyping Practices in Software Startups: Initial Case Study Results
Bjarnason, E. (2021) · 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew53955.2021.00038 · Cited by 14
Self-citationEvaluating paper prototypes on the street
Hendry, D. G., Mackenzie, S. L. C., Kurth, A., Spielberg, F., & Larkin, J. (2005) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1056808.1056938 · Cited by 11
Prototype Experiments: Strategies and Trade-offs
Tronvoll, S. A., Elverum, C. W., & Welo, T. (2017) · Procedia CIRP · doi:10.1016/j.procir.2017.01.049 · Cited by 10
On the Pragmatics of Requirements Engineering Practices in a Startup Ecosystem
Alves, C., Cunha, J., & Araujo, J. (2020) · 2020 IEEE 28th International Requirements Engineering Conference (RE) · doi:10.1109/re48521.2020.00041 · Cited by 10
Bellomo, S., Nord, R. L., & Ozkaya, I. (2013) · 2013 2nd International Workshop on the Twin Peaks of Requirements and Architecture (TwinPeaks) · doi:10.1109/twinpeaks.2013.6614717 · Cited by 9
Tools for designing and prototyping activity-based pervasive applications
Bruegger, P., Lalanne, D., Lisowska, A., & Hirsbrunner, B. (2009) · Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia · doi:10.1145/1821748.1821778 · Cited by 7
An Approach to Low-fidelity Prototyping Based on SOFL Informal Specification
Zainuddin, F. B., & Liu, S. (2012) · 2012 19th Asia-Pacific Software Engineering Conference · doi:10.1109/apsec.2012.132 · Cited by 7
Tri-Cycle: a prototype methodology for advanced software development
Fern, D. A., & Donaldson, S. E. (2003) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.1989.48015 · Cited by 7
A cognitive requirement specification model
Cafer, F., & Misra, S. (2009) · 2009 24th International Symposium on Computer and Information Sciences · doi:10.1109/iscis.2009.5291868 · Cited by 6
An Iterative Meta-Lifecycle for Software Development, Evolution and Maintenance
Toffolon, C., & Dakhli, S. B. D. (2008) · International Conference on Software Engineering Advances · doi:10.1109/icsea.2008.75 · Cited by 5
An object-oriented prototyping approach to system development
Arano, T., Chang, C.-T., Mongkolwat, P., Liu, Y., & Shu, X. (2002) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/cmpsac.1993.404215 · Cited by 4
Unlocking the Interactive Office: Concurrent Prototyping Approach
Jaskiewicz, T., & van der Helm, A. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196821 · Cited by 4
Integrating the role of requirements specification into the process of prototyping: the protospec
Heisler, K. G., Tsai, W., & Ramamoorthy, C. V. (2003) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.1989.48011 · Cited by 3
Effective prototyping for usability
Hakim, J., & Spitzer, T. (2002) · ACM International Conference on Systems Documentation (SIGDOC) · doi:10.1109/ipcc.2000.887260 · Cited by 3
Tool support for tailored software prototyping
Chen, C., Porter, A. A., & Purtilo, J. M. (2002) · Symposium on Assessment of Quality Software Development Tools · doi:10.1109/aqsdt.1994.315753 · Cited by 2
Early and not-so-early prototyping-rationale and tool support
Ratcliff, B. (n.d.) · Proceedings COMPSAC 88: The Twelfth Annual International Computer Software & Applications Conference · doi:10.1109/cmpsac.1988.17162
Budde, R., & Zullighoven, H. (n.d.) · COMPEURO'90: Proceedings of the 1990 IEEE International Conference on Computer Systems and Software Engineering@m_Systems Engineering Aspects of Complex Computerized Systems · doi:10.1109/cmpeur.1990.113653
Comparing user interaction with low and high fidelity prototypes of tabletop surfaces
Derboven, J., Roeck, D. D., Verstraete, M., Geerts, D., Schneider-Barnes, J., & Luyten, K. (2010) · Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries · doi:10.1145/1868914.1868935
Proposal for a generic prototyping approach
Kordon, F. (n.d.) · ETFA '94. 1994 IEEE Symposium on Emerging Technologies and Factory Automation. (SEIKEN) Symposium) -Novel Disciplines for the Next Century- Proceedings · doi:10.1109/etfa.1994.401984
Schneider, K. (n.d.) · Proceedings of IEEE 18th International Conference on Software Engineering · doi:10.1109/icse.1996.493446
Bellomo, S., Nord, R. L., & Ozkaya, I. (2013) · doi:10.21236/ada590750
Software evolution through iterative prototyping
Goldman, N., & Narayanaswamy, K. (1992) · Proceedings of the 14th international conference on Software engineering - ICSE '92 · doi:10.1145/143062.143109
Flagged first, then by citations
Research works printed but not linked: 5
- BerntssonSvensson R, Regnell B (2015) A Case Study Evaluation of the Guideline-Supported QUPER Model for Elicitation of Quality Requirements. REFSQ 15:230–246
- Block, Z. and MacMillan, I.C. (1985) Milestones for Successful Venture Planning. Harvard Business Review, Sept 1985.
- Rex Hartson (2019). The UX Book. Morgan Kaufmann Publishers
- Nguyen-Duc A, Wang X, Abrahamsson P (2017) What Influences the Speed of Prototyping? An Empirical Investigation of Twenty Software Startups. Agile Proc in Softw Eng 2017:20–36
- Tullis, T.S. (1990). High-fidelity prototyping throughout the design process. Proceedings of the Human Factors Sciety 34th Annual Meeting 266
Cited by
Sorted by citations
Imjai, N., Nui-Suk, C., Usman, B., Somwethee, P., & Aujirapongpan, S. (2024) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2024.100301 · Cited by 42
Vibe Coding and the New Prototyping Playbook
Borg, M., Bjarnason, E., & Hedin, F. (2025) · IEEE Software · doi:10.1109/ms.2025.3597032 · Cited by 12
Self-citationSESR-Eval: Dataset for Evaluating LLMs in the Title-Abstract Screening of Systematic Reviews
Huotala, A., Kuutila, M., & Mäntylä, M. (2025) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem64174.2025.00053 · Cited by 12
DESIGNING A WEB-BASED RESTAURANT RESERVATION INFORMATION SYSTEM WITH REQUIREMENT PROTOTYPING METHOD
Sutjiadi, R., Rahmawati, T., Kristianto, A., & Kanessa, F. T. (2025) · Jurnal Techno Nusa Mandiri · doi:10.33480/techno.v22i1.6110 · Cited by 10
User-Centered Design of a Computer Vision System for Monitoring PPE Compliance in Manufacturing
Trujillo-Lopez, L. A., Raymundo-Guevara, R. A., & Morales-Arevalo, J. C. (2025) · Computers · doi:10.3390/computers14080312 · Cited by 9
Tomaselli, G. P., Pinto, N., & Acuña, C. J. (2025) · Requirements Engineering · doi:10.1007/s00766-025-00448-3 · Cited by 8
Perancangan Dan Evaluasi Desain User Interface Prototype Aplikasi Manajemen Kandang PT XYZ
Wiyono, B. S., Lilhaq, M. Z., Suharso, W., & Ramadha, F. N. (2024) · Jutisi Jurnal Ilmiah Teknik Informatika dan Sistem Informasi · doi:10.35889/jutisi.v13i2.1883 · Cited by 8
Sriyanto, S., & Ika, R. D. (2024) · J TI UNDIP JURNAL TEKNIK INDUSTRI · doi:10.14710/jati.19.2.70-73 · Cited by 5
Starting Collaborations Between SMEs and Researchers in Software Engineering
Rico, S., Dobslaw, F., & Öberg, L. (2024) · Lecture notes in business information processing · doi:10.1007/978-3-031-53227-6_16 · Cited by 4
WEB-BASED PAYROLL SYSTEM DEVELOPMENT USING THE PROTOTYPING METHOD AND STRUCTURED DATABASE DESIGN
Tandrio, F., & Fianty, M. I. (2026) · JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer) · doi:10.33480/jitk.v11i3.7044 · Cited by 3
Pre-release Experimentation in Indie Game Development: An Interview Survey
Linåker, J., Bjarnason, E., & Fagerholm, F. (2025) · Lecture notes in business information processing · doi:10.1007/978-3-031-85849-9_24 · Cited by 3
Self-citationNursi, A., Darni, R., & Novaliendry, D. (2025) · Journal of Hypermedia & Technology-Enhanced Learning (J-HyTEL) · doi:10.58536/j-hytel.193 · Cited by 2
Antonius, A., Darmanto, T., & Willay, T. (2025) · International Journal of Multidisciplinary Sciences and Arts · doi:10.47709/ijmdsa.v4i4.7356 · Cited by 2
PROTOTYPING MODEL FOR DESIGNING A DESKTOP-BASED TRADING ROBOT APPLICATION
Rahmad, A., Rozi, F., Rachman, A., & Putri, A. Y. P. (2025) · Journal of Entrepreneurship · doi:10.56943/joe.v4i4.882 · Cited by 1
Arifin, M. L., Nugroho, M. Y., Irsyad, A. Z., & Rabiha, S. G. (2025) · IEEE Information Technology International Seminar (ITIS) · doi:10.1109/itis67966.2025.11308750 · Cited by 1
Active Personas for Synthetic User Feedback: A Design Science Study
Simaremare, M. E. S., & Edison, H. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-14518-5_20 · Cited by 1
Salim, L. O. R. S., Sihite, R. H. U., Rian, I. P. A., Artawan, R., Hidayat, R., & Purnamasari, E. (2026) · RIGGS Journal of Artificial Intelligence and Digital Business · doi:10.31004/riggs.v4i4.5075 · Cited by 1
Rahanyamtel, M. H., & Susanto (2026) · JATI (Jurnal Mahasiswa Teknik Informatika) · doi:10.36040/jati.v10i1.16679 · Cited by 1
Implementasi Autentikasi QR Code Berbasis Standar ISO/IEC 18004 Menggunakan Tanda Tangan Digital
Paula, E. W., Hidayat, A. I., & Asbara, N. W. (2026) · Jurnal Sistem Komputer dan Informatika (JSON) · doi:10.30865/json.v7i3.9641 · Cited by 1
Bustamante-Orejuela, J., Quiñónez-Ku, X., & Pico-Valencia, P. (2026) · Multimodal Technologies and Interaction · doi:10.3390/mti10040042 · Cited by 1
Lowe, S., Koch, M., & Schäffer, T. (2025) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-024-01137-5
To Communicate or not to Communicate: That is the Problem
Alkhatib, G. I. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.02.328
Anthonius, F., Wong, M., Aryusmar, A., & Chong, H. (2025) · Lingua Cultura · doi:10.21512/lc.v19i1.12603
Mini Server Kit dan Aplikasi Manajemen Server berbasis Web untuk LKS Bidang Web Technologies
Suwita, F. S., Fachrizal, M. R., & Fadillah, A. P. (2025) · Jurnal Teknologi dan Informasi · doi:10.34010/jati.v15i2.17923
VITAL: A Design Framework for Prototyping Health Behavior Change Applications
Amaritei, C., & Iftene, A. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.09.386
Perancangan Antarmuka Aplikasi Booking Jasa “GOSERVICE” Berbasis Web Menggunakan Prototyping
Farzana, A. R., Wjianarko, C. D., Anggoro, A. G. V. E., Maulana, I., Arifian, R. M., & Irawan, B. (2025) · JPNM Jurnal Pustaka Nusantara Multidisiplin · doi:10.59945/jpnm.v3i3.619
Synch-Ur-Life: Technical Report
Maypa, P. (2024) · NORMA
Ohjelmistointegraation hyödyt käyttäjäkokemukseen ja tuotannon tehokkuuteen
Kangashaka, N. (2025) · LUTPub (LUT University)
Designing experiment objects for Continuous Experimentation: An exploratory multiple-case study
Amasya, B., & Fagerholm, F. (2025) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3756681.3756944
Ardhianti, P. W., Purnawati, M., Tanjung, K. P., & Leandros, R. (2025) · IEEE Information Technology International Seminar (ITIS) · doi:10.1109/itis67966.2025.11308913
Alda, M., & Amalia, S. (2025) · JUTECH Journal Education and Technology · doi:10.31932/jutech.v6i2.5953
Sentiment Analysis of YouTube Comments Using Lexicon-Based and Machine Learning Methods
Aji, G. G. R., & Yaqin, A. (2025) · International Conference on Information and Communications Technology (ICOIACT) · doi:10.1109/icoiact67584.2025.11344934
Prasetya, B. A., Nasrullah, M., & Abdillah, R. (2025) · JUKOMIKA (Jurnal Ilmu Komputer dan Informatika) · doi:10.54650/jukomika.v8i1.583
de Chimborazo, U. N., & Salcán, C. (2025) · Dominio de las Ciencias · doi:10.23857/dc.v11i2.4448
Mobile Platform for Electric Motorcycle Life Cycle Management
Machado, B., Ribeiro, T., Nunes, R. R., Gouveia, A. J., & Pendão, C. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-05748-8_36
Algoritma Pengembangan Sistem Informasi Kepegawaian Menggunakan Metode Prototype
Pradipta, R., & Bahri, R. (2026) · ALGORITMA JURNAL ILMU KOMPUTER DAN INFORMATIKA · doi:10.30829/algoritma.v9i2.27951
Musthofah, M. M., & Via, Y. V. (2026) · SIBATIK JOURNAL Jurnal Ilmiah Bidang Sosial Ekonomi Budaya Teknologi dan Pendidikan · doi:10.47353/sibatik.v5i5.4865
Agustianingsi, D., & Yaqin, M. A. (2026) · CODEX Journal of Software Engineering · doi:10.33650/codex.v1i01.14452
Zysk, J., Pickmann, P. C., Haller, J., Markus, A., Borowski, E., & Isenhardt, I. (2026) · Procedia CIRP · doi:10.1016/j.procir.2026.05.335
Nytt medlemssystem för AI-utbildningsprogram
Veziroglu, Z., & Madlool, I. H. M. (2026) · Lund University Publications Student Papers (Lund University)
Design Reasoning in a Research and Development Organization: Insights from a Focus Group Study
Rodrigues, E., Silva, L., Rocha, H., Santos, G., & Salvioni, M. (2026) · International Workshop on Designing Software (Designing) · doi:10.1145/3786152.3788592
Perancangan User Interface BukuRate Berbasis Web Dengan Metode Prototype
Maulina, U., & Pratama, R. M. S. P. (2026) · Jurnal Rekayasa Teknologi Informasi (JURTI) · doi:10.30872/jurti.v10i1.22888
Suhendra, & Azzahra, A. (2026) · Technologic · doi:10.52453/technologic.v17i1.480
A lean experimental approach for proof-of-concept investigation
Breuning, C., & Kreimeyer, M. (2026) · Proceedings of the Design Society · doi:10.1017/pds.2026.10407
Implementasi Fine Tuning Menggunakan Metode QLoRA Pada Sistem Tanya Jawab Hadits
Azmi, M., Kurnia, F., Harahap, N. S., Irsyad, M., Pizaini, & Marsal, A. (2026) · Jurnal Pengembangan Teknologi Informasi dan Komunikasi (JUPTIK) · doi:10.52060/juptik.v4i1.4349
Navarro, J. L., Molina, A. I., & Lacave, C. (2025) · Revista de la Asociación Interacción Persona Ordenador (AIPO) · doi:10.65234/interaccion.128
Shim, W., & Lee, S. W. (2026) · IEEE Access · doi:10.1109/access.2026.3713950
Rachman, A., Nugroho, H., Saputra, F. K., Sulistyowati, S., Kristiana, W. A., & Septianto, T. (2026) · Jurnal Ilmiah Ilmu Terapan Universitas Jambi|JIITUJ| · doi:10.22437/jiituj.v10i3.54011
Cahyono, A. S., & Murtono, T. (2026) · Jurnal Komunikasi dan Ilmu Sosial · doi:10.38035/jkis.v4i2.3390
Biittner, K. M., Newell, P. A., & Aycock, J. (2026) · International Conference on the Foundations of Digital Games (FDG) · doi:10.1145/3815598.3815675
López-Faican, L., & Paltas-Moreno, S. (2026) · Instituto Universitario de Innovación Ciencia y Tecnología Inudi Perú eBooks · doi:10.35622/inudi.c.04.09
PROTOTYPE SISTEM INFORMASI MANAJEMEN ENERGI DI BANDARA SULTAN THAHA JAMBI
Angelica, A. F., Arsa, D., & Perdana, Y. (2026) · Jurnal Mahasiswa Sistem Informasi (JMSI) · doi:10.24127/jmsi.v7i2.12086
Suartana, P. Y., Wirawan, I. M. A., Seputra, K. A., & Dermawan, K. T. (2026) · Kumpulan Artikel Mahasiswa Pendidikan Teknik Informatika (KARMAPATI) · doi:10.23887/karmapati.v15i2.115877
dos Santos, W. J. C., Chagas, M. L. D., de Mello, A. H., Picanço, A. R. S., Gonçalves, C. S. L., Conte, T. N. M. D. S., Ferreira, T. Y. D., Brígida, A. C. S., Neto, S. S. C., de Luna, J. L., et al. (2026) · Veredas do Direito Direito Ambiental e Desenvolvimento Sustentável · doi:10.18623/rvd.v23.7736
Danuri, D., & Jaroji, J. (2026) · INOVTEK Polbeng - Seri Informatika · doi:10.35314/6s7f0c21
Integrating Functional Architecture and Usability in EMIS Design: A Prototype-Based Study
Paltas-Moreno, S., & López-Faican, L. (2026) · Journal of Information Technology Education Innovations in Practice · doi:10.28945/5865
Desain User Interface ‘Disaster Spatial Learning Global Partnership’
Lauw, A. C. P., Susilowati, M., & Handoyo, B. (2026) · Journal of Artificial Intelligence and Engineering Applications (JAIEA) · doi:10.59934/jaiea.v5i2.2001
Ai-Based Demand Forecasting For Pharmacy Inventory Management: A Prototype Development Approach
Monintja, E. M., Wijaya, M. B., Fardiman, M., Ubud, S., & Maryani, M. (2026) · International Conference on ICT for Smart Society (ICISS) · doi:10.1109/iciss71466.2026.11715532
Self-Service Laundry Booking Application for Tun Dr Ismail Residential College
SERAJUDIN, N. D. S. B., & Mostafa, S. A. (2025) · Applied Information Technology And Computer Science
Hafizd, K. A., Pebriana, R., & Akli, M. Z. (2026) · Jurnal Multimedia dan Teknologi Informasi (Jatilima) · doi:10.54209/jatilima.v7i07.2601
USING AI FOR PROTOTYPE DEVELOPMENT IN THE SYSTEMS ANALYSIS AND DESIGN COURSE
(2026) · Issues in Information Systems · doi:10.48009/2_iis_2026_121
Putri, R. H., Pramudito, D. K., & Sunge, A. S. (2026) · Bulletin of Computer Science Research · doi:10.47065/bulletincsr.v6i6.1359
Muh. Rahmat Wahyudi, J. Y., Lamada, M. S., & Patta, A. R. (2026) · Jurnal MediaTIK · doi:10.59562/mediatik.v9i3.14422
Has LLM Screening Performance Stalled in Software Engineering Systematic Reviews?
Huotala, A., Kuutila, M., & Mäntylä, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.10633
Obaid, A. H., & Al-Husseini, K. A. O. (2026) · Al-Furat Journal of Innovations in Electronics and Computer Engineering · doi:10.46649/fjiece.v5.2.1a.7.10.2026
Pratama, R. A. P., & Wardhana, S. R. (2026) · INTEGER Journal of Information Technology · doi:10.31284/j.integer.2026.v11i2.9394
Abidin, Z., & Putri, R. R. (2026) · INTEGER Journal of Information Technology · doi:10.31284/j.integer.2026.v11i2.8615
Rancang Bangun Sistem Quality Control untuk Aplikasi Menggunakan Model Prototype
Adidarma, P. A., Lasim, M. R. K., Putri, R. R., Wardhana, S. R., & Yuliastuti, G. E. (2026) · INTEGER Journal of Information Technology · doi:10.31284/j.integer.2026.v11i2.9320
Adiputra, P. A., & Wardhana, S. R. (2026) · INTEGER Journal of Information Technology · doi:10.31284/j.integer.2026.v11i2.9395
Automation of Teaching Quality Survey Processing for Lecturers via Integrated TOPSIS Calculation
Rizka, A., Tasril, V., Sulistianingsih, I., Riandari, F., & Ginting, R. (2026) · International Journal of Applied Science and Technology Application · doi:10.62712/ijapset.v1i2.11
Wicaksana, R. F. A. F., Hertantyo, G. B., & Akbar, R. S. (2026) · TEMATICS Technology ManagemenT and Informatics Research Journals · doi:10.52617/tematics.v8i1.906
Sanjaya, D., Sulistianingsih, I., Riadi, R. S., & Lubis, R. M. F. (2026) · International Journal of Applied Science and Technology Application · doi:10.62712/ijapset.v1i2.13
Web Profil dan Pendaftaran Online Kegiatan Organisasi Mahasiswa Cianjur Grand University Days
Saputra, T. A. T., Halizah, H., & Ramadhan, B. P. (2026) · Digital Transformation Technology · doi:10.47709/digitech.v6i1.8100
Lapatta, N. T. (2026) · CCIT Journal · doi:10.33050/ccit.v19i1.3836
Evaluating multi-LLM pipelines for early-stage software requirements elicitation
Curto, H. N., Semini, L., & Marques-Neto, H. T. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10981-6
Analysis and Design of Food Price Data Processing Information System
Priska, S. D., Syahrullah, S., Nugraha, D. W., Lapatta, N. T., & Lamasitudju, C. A. (2026) · CCIT Journal · doi:10.33050/ccit.v19i1.3904
Wibawa, R. C., Wakhid, N. K., Baihaqi, A. Z., Herlambang, Y. B., Rahmawati, C. D., Amir, A. D., Rosyid, H. A., & Purwita, A. W. (2026) · International Conference on Vocational Education and Electrical Engineering (ICVEE) · doi:10.1109/icvee71133.2026.11766347
Metadata
- Authors
- Bjarnason, E., Lang, F., & Mjöberg, A.
- Affiliations
- Lund University (SE)
- Corresponding author
- Bjarnason, Elizabeth
- ORCID
- Bjarnason, Elizabeth
- Venue
- Empirical Software Engineering
- Published
- 2023-08-30
- Volume
- 28
- Issue
- 5
- ISSN
- 1382-3256 (ISSN-L)
- 1573-7616
- OpenAlex
- W4386292207
- Semantic Scholar
- e9c2ee9f93790c5a70664f7e633d4ce7a55d5d6a
- Cited by
- 75
- References
- 57
- Citations by year
- 2026: 45 · 2025: 25 · 2024: 5
- FWCI
- 13.79
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Empirical Software Engineering (publishedVersion, cc-by)
- Lund University Publications (Lund University) (submittedVersion)
- Funders
- Lund University
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- software prototyping, requirements engineering, agile software development, user interface design, exploration strategy, startups
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review