Requirements elicitation: Towards the unknown unknowns
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
Requirements elicitation research is reviewed using a framework categorising the relative `knowness' of requirements specification and Common Ground discourse theory. The main contribution of this survey is to review requirements elicitation from the perspective of this framework and propose a road map of research to tackle outstanding elicitation problems involving tacit knowledge. Elicitation techniques (interviews, scenarios, prototypes, etc.) are investigated, followed by representations, models and support tools. The survey results suggest that elicitation techniques appear to be relatively mature, although new areas of creative requirements are emerging. Representations and models are also well established although there is potential for more sophisticated modelling of domain knowledge. While model-checking tools continue to become more elaborate, more growth is apparent in NL tools such as text mining and IR which help to categorize and disambiguate requirements. Social collaboration support is a relatively new area that facilitates categorisation, prioritisation and matching collections of requirements for product line versions. A road map for future requirements elicitation research is proposed investigating the prospects for techniques, models and tools in green-field domains where few solutions exist, contrasted with brown-field domains where collections of requirements and products already exist. The paper concludes with remarks on the possibility of elicitation tackling the most difficult question of `unknown unknown' requirements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
Using language: Communicative acts
Clark, H. H. (1996) · Cited by 2,721
Using language: Index of names
Clark, H. H. (1996) · Cited by 2,720
Crowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
Requirements engineering: a roadmap
Nuseibeh, B., & Easterbrook, S. (2000) · Proceedings of the Conference on The Future of Software Engineering · doi:10.1145/336512.336523 · Cited by 1,830
Requirements Engineering: Processes and Techniques
Kotonya, G., & Sommerville, I. (1998) · Lancaster EPrints (Lancaster University) · Cited by 1,688
Technology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471
Moody, D. (2009) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2009.67 · Cited by 1,204
Cognitive Reliability and Error Analysis Method (CREAM)
(1998) · Elsevier eBooks · doi:10.1016/b978-0-08-042848-2.x5000-3 · Cited by 1,100
gIBIS: a hypertext tool for exploratory policy discussion
Conklin, J., & Begeman, M. L. (1988) · ACM Transactions on Information Systems · doi:10.1145/58566.59297 · Cited by 1,088
Mastering the requirements process
Robertson, S., & Robertson, J. (2006) · Cited by 1,011
Problem Frames: Analyzing and Structuring Software Development Problems
Jackson, M. (2000) · Medical Entomology and Zoology · Cited by 951
Scenario-based design: envisioning work and technology in system development
Carroll, J. M. (1995) · John Wiley & Sons, Inc. eBooks · Cited by 937
Towards requirements-driven information systems engineering: the Tropos project
Castro, J., Kolp, M., & Mylopoulos, J. (2002) · Information Systems · doi:10.1016/s0306-4379(02)00012-1 · Cited by 798
Questions, Options, and Criteria: Elements of Design Space Analysis
MacLean, A., Young, R., Bellotti, V., & Moran, T. (1991) · Human-Computer Interaction · doi:10.1207/s15327051hci0603&4_2 · Cited by 794
Handling obstacles in goal-oriented requirements engineering
van Lamsweerde, A., & Letier, E. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.879820 · Cited by 648
From object-oriented to goal-oriented requirements analysis
Mylopoulos, J., Chung, L., & Yu, E. (1999) · Communications of the ACM · doi:10.1145/291469.293165 · Cited by 581
Techniques for requirements elicitation
Goguen, J. A., & Linde, C. (2002) · [1993] Proceedings of the IEEE International Symposium on Requirements Engineering · doi:10.1109/isre.1993.324822 · Cited by 409
Supporting scenario-based requirements engineering
Sutcliffe, A. G., Maiden, N. A. M., Minocha, S., & Manuel, D. (1998) · IEEE Transactions on Software Engineering · doi:10.1109/32.738340 · Cited by 337
Self-citationDavis, A., Dieste, O., Hickey, A., Juristo, N., & Moreno, A. M. (2006) · 14th IEEE International Requirements Engineering Conference (RE'06) · doi:10.1109/re.2006.17 · Cited by 334
Scenarios, Stories, Use Cases: Through the Systems Development Life-Cycle
Alexander, I. F., & Maiden, N. (2004) · International Linear Collider · Cited by 314
ACRE: selecting methods for requirements acquisition
Maiden, N. A. M., & Rugg, G. (1996) · Software Engineering Journal · doi:10.1049/sej.1996.0024 · Cited by 310
Requirements monitoring in dynamic environments
Fickas, S. F., & Feather, M. S. (2002) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/isre.1995.512555 · Cited by 308
Argumentation-based design rationale: what use at what cost?
Shum, S. B., & Hammond, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1029 · Cited by 280
Social Modeling for Requirements Engineering: An Introduction
Yu, E., Giorgini, P., Maiden, N., et al. (2010) · The MIT Press eBooks · doi:10.7551/mitpress/7549.003.0004 · Cited by 278
Randall, D., Harper, R., & Rouncefield, M. (2007) · Computer Supported Cooperative Work · doi:10.1007/978-1-84628-768-8 · Cited by 254
A Unified Model of Requirements Elicitation
HICKEY, A. M., & DAVIS, A. M. (2004) · Journal of Management Information Systems · doi:10.1080/07421222.2004.11045786 · Cited by 253
Intent specifications: an approach to building human-centered specifications
Leveson, N. G. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.825764 · Cited by 251
RELAX: a language to address uncertainty in self-adaptive systems requirement
Whittle, J., Sawyer, P., Bencomo, N., Cheng, B. H. C., & Bruel, J. (2010) · Requirements Engineering · doi:10.1007/s00766-010-0101-0 · Cited by 242
Self-citationGoal-oriented requirements analysis and reasoning in the Tropos methodology
Giorgini, P., Mylopoulos, J., & Sebastiani, R. (2005) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2004.11.017 · Cited by 226
Requirements-Aware Systems: A Research Agenda for RE for Self-adaptive Systems
Sawyer, P., Bencomo, N., Whittle, J., Letier, E., & Finkelstein, A. (2010) · 2010 18th IEEE International Requirements Engineering Conference · doi:10.1109/re.2010.21 · Cited by 224
Self-citationLim, S. L., & Finkelstein, A. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.36 · Cited by 220
Using Domain Ontology as Domain Knowledge for Requirements Elicitation
Kaiya, H., & Saeki, M. (2006) · 14th IEEE International Requirements Engineering Conference (RE'06) · doi:10.1109/re.2006.72 · Cited by 214
Effective Communication in Requirements Elicitation: A Comparison of Methodologies
Coughlan, J., & Macredie, R. D. (2002) · Requirements Engineering · doi:10.1007/s007660200004 · Cited by 212
GRAIL/KAOS: an environment for goal-driven requirements engineering
Darimont, R., Delor, E., Massonet, P., & van Lamsweerde, A. (1997) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/253228.253499 · Cited by 196
Awareness requirements for adaptive systems
Souza, V. E. S., Lapouchnian, A., Robinson, W. N., & Mylopoulos, J. (2011) · International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) · doi:10.1145/1988008.1988018 · Cited by 187
AbstFinder, A Prototype Natural Language Text Abstraction Finder for Use in Requirements Elicitation
Goldin, L., & Berry, D. M. (1997) · Automated Software Engineering · doi:10.1023/a:1008617922496 · Cited by 186
Identifying Nocuous Ambiguities in Natural Language Requirements
Chantree, F., Nuseibeh, B., Roeck, A. N. D., & Willis, A. (2006) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2006.31 · Cited by 177
Revisiting the Core Ontology and Problem in Requirements Engineering
Jureta, I., Mylopoulos, J., & Faulkner, S. (2008) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2008.13 · Cited by 170
Kiyavitskaya, N., Zeni, N., Mich, L., & Berry, D. M. (2008) · Requirements Engineering · doi:10.1007/s00766-008-0063-7 · Cited by 163
User-Centred Requirements Engineering
Sutcliffe, A. (2002) · Springer eBooks · doi:10.1007/978-1-4471-0217-5 · Cited by 153
Self-citationRequirements elicitation and validation with real world scenes
Haumer, P., Pohl, K., & Weidenhaupt, K. (1998) · IEEE Transactions on Software Engineering · doi:10.1109/32.738338 · Cited by 148
The role of domain knowledge in requirements elicitation via interviews: an exploratory study
Hadar, I., Soffer, P., & Kenzi, K. (2012) · Requirements Engineering · doi:10.1007/s00766-012-0163-2 · Cited by 147
The use of goals to surface requirements for evolving systems
Antón, A. I., & Potts, C. (2002) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.1998.671112 · Cited by 139
Finkelstein, A., Harman, M., Mansouri, S. A., Ren, J., & Zhang, Y. (2009) · Requirements Engineering · doi:10.1007/s00766-009-0075-y · Cited by 130
Patterns of cooperative interaction: Linking ethnomethodology and design
Martin, D., & Sommerville, I. (2004) · ACM Transactions on Computer-Human Interaction · doi:10.1145/972648.972651 · Cited by 119
The use of theatre in requirements gathering and usability studies
Newell, A. F., Carmichael, A., Morgan, M., & Dickinson, A. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2006.05.003 · Cited by 117
Anatomy of a failure: how we knew when our design went wrong, and what we learned from it
Gaver, W., Bowers, J., Kerridge, T., Boucher, A., & Jarvis, N. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519040 · Cited by 108
The domain theory: patterns for knowledge and software reuse
(2002) · Choice Reviews Online · doi:10.5860/choice.40-1588 · Cited by 100
Techniques for Requirements Elicitation
Jirotka, M. D. (1993) · Cited by 93
Mancini, C., Rogers, Y., Bandara, A. K., Coe, T., Jędrzejczyk, Ł., Joinson, A., Price, B. A., Thomas, K., & Nuseibeh, B. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753350 · Cited by 81
Understanding the human context in requirements elicitation
Fuentes‐Fernández, R., Gómez-Sanz, J. J., & Pavón, J. (2009) · Requirements Engineering · doi:10.1007/s00766-009-0087-7 · Cited by 73
Is emotion relevant to requirements engineering?
Ramos, I. M. P., & Berry, D. M. (2005) · Requirements Engineering · doi:10.1007/s00766-005-0014-5 · Cited by 70
Can Requirements Be Creative? Experiences with an Enhanced Air Space Management System
Maiden, N., Ncube, C., & Robertson, S. (2007) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2007.24 · Cited by 66
Castro-Herrera, C., Duan, C., Cleland‐Huang, J., & Mobasher, B. (2008) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2008.47 · Cited by 66
Power and politics in requirements engineering: embracing the dark side?
Milne, A., & Maiden, N. (2012) · Requirements Engineering · doi:10.1007/s00766-012-0151-6 · Cited by 65
Unpacking Tacit Knowledge for Requirements Engineering
Gervasi, V., Gacitúa, R., Rouncefield, M., Sawyer, P., Kof, L., Ma, L., Piwek, P., Roeck, A. N. D., Willis, A., Yang, H., et al. (2013) · Springer eBooks · doi:10.1007/978-3-642-34419-0_2 · Cited by 64
Self-citationEnhancing Stakeholder Profiles to Improve Recommendations in Online Requirements Elicitation
Castro-Herrera, C., Cleland‐Huang, J., & Mobasher, B. (2009) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2009.20 · Cited by 60
Scenario-based assessment of nonfunctional requirements
Gregoriades, A., & Sutcliffe, A. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.59 · Cited by 60
Self-citationExperience with user-centred requirements engineering
Sutcliffe, A., Thew, S., & Jarvis, P. (2011) · Requirements Engineering · doi:10.1007/s00766-011-0118-z · Cited by 60
Self-citationHartswood, M., Procter, R., Rouncefield, M., Slack, R., Soutter, J., & Voß, A. (2003) · Springer eBooks · doi:10.1007/978-94-010-0068-0_20 · Cited by 56
Investigating the Role of 'Soft Issues' in the RE Process
Thew, S., & Sutcliffe, A. (2008) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2008.35 · Cited by 56
Self-citationReasoning on Non-Functional Requirements for Integrated Services
Ghezzi, C., & Tamburrelli, G. (2009) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2009.34 · Cited by 51
Marczak, S. D. S., & Damian, D. (2011) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2011.6051643 · Cited by 48
Sakhnini, V., Mich, L., & Berry, D. M. (2011) · Requirements Engineering · doi:10.1007/s00766-011-0133-0 · Cited by 34
ISRE: immersive scenario-based requirements engineering with virtual prototypes
Sutcliffe, A., Gault, B., & Maiden, N. (2004) · Requirements Engineering · doi:10.1007/s00766-004-0198-0 · Cited by 29
Self-citationBrill, O., & Knauss, E. (2011) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2011.6051660 · Cited by 27
Trust Trade-off Analysis for Security Requirements Engineering
Elahi, G., & Yu, E. S. K. (2009) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2009.12 · Cited by 25
Advancing the Design of Technology-Mediated Social Participation Systems
Ed, H., Munson, S. A., Fischer, G., Vieweg, S. E., & Parr, C. S. (2010) · Computer · doi:10.1109/mc.2010.304 · Cited by 19
Extending boundaries with meta-design and cultures of participation
Fischer, G. (2010) · Nordic Conference on Human-Computer Interaction · doi:10.1145/1868914.1868937 · Cited by 18
Integrating analysis of customers' processes into roadmapping: The value-creation perspective
Komssi, M., Kauppinen, M., Töhönen, H., Lehtola, L., & Davis, A. M. (2011) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2011.6051662 · Cited by 16
Reflections on 25+ years of knowledge acquisition
Wielinga, B. J. (2012) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2012.10.007 · Cited by 15
On the usage of context for requirements elicitation: End-user involvement in IT ecosystems
Knauss, A. (2012) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2012.6345835 · Cited by 15
Cited by
What is a Prototype? What are the Roles of Prototypes in Companies?
Lauff, C. A., Kotys-Schwartz, D., & Rentschler, M. E. (2018) · Journal of Mechanical Design · doi:10.1115/1.4039340 · Cited by 170
Imagined Audiences, Emotions, and Feedback Expectations in Social Media Photo Sharing
Stsiampkouskaya, K., Joinson, A., Piwek, L., & Stevens, L. (2021) · Social Media + Society · doi:10.1177/20563051211035692 · Cited by 53
Metadata
- Authors
- Sutcliffe, A., & Sawyer, P.
- Venue
- 2013 21st IEEE International Requirements Engineering Conference (RE)
- Publisher
- IEEE
- Published
- 2013-07
- Pages
- 92-104
- OpenAlex
- W2075395364
- Cited by
- 196
- References
- 74
- FWCI
- 12.11
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.