A design methodology for reliable software systems
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Any user of a computer system is aware that current systems are unreliable because of errors in their software components. While system designers and implementers recognize the need for reliable software, they have been unable to produce it. For example, operating systems such as OS/360 are released to the public with hundreds of errors still in them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
On the criteria to be used in decomposing systems into modules
Parnas, D. L. (1972) · Communications of the ACM · doi:10.1145/361598.361623 · Cited by 4,704
The structure of the “THE”-multiprogramming system
Dijkstra, E. W. (1968) · Communications of the ACM · doi:10.1145/363095.363143 · Cited by 1,094
Conway, M. E. (1967) · Cited by 812
Chief programmer team management of production programming
Baker, F. T. (1972) · IBM Systems Journal · doi:10.1147/sj.111.0056 · Cited by 325
Information distribution aspects of design methodology
Parnas, D. L. (2018) · KiltHub Repository · doi:10.1184/r1/6606470.v1 · Cited by 315
Information distribution aspects of design methodology
Parnas, D. L. (2018) · KiltHub Repository · doi:10.1184/r1/6606470 · Cited by 312
The design of the Venus operating system
Liskov, B. H. (1972) · Communications of the ACM · doi:10.1145/361268.361272 · Cited by 98
Self-citationBuxton, J. N., & Randell, B. (1970) · Cited by 85
An experiment in structured programming
Henderson, P., & Snowdon, R. A. (1972) · BIT Numerical Mathematics · doi:10.1007/bf01932672 · Cited by 61
A modular approach to file system design
Madnick, S., & Alsop, J. W. (1969) · AFIPS Spring Joint Computer Conference (SJCC) · doi:10.1145/1476793.1476795 · Cited by 28
Cited by
A universal modular ACTOR formalism for artificial intelligence
Hewitt, C. E., Bishop, P., & de Steiger, R. (1973) · International Joint Conference on Artificial Intelligence · Cited by 927
Programming with abstract data types
Liskov, B., & Zilles, S. (1974) · Proceedings of the ACM SIGPLAN symposium on Very high level languages - · doi:10.1145/800233.807045 · Cited by 734
Self-citationProgramming-in-the large versus programming-in-the-small
DeRemer, F., & Kron, H. (1975) · ACM SIGPLAN Notices · doi:10.1145/390016.808431 · Cited by 574
Exception handling: issues and a proposed notation
Goodenough, J. B. (1975) · Communications of the ACM · doi:10.1145/361227.361230 · Cited by 496
“They are needed, in general, as a means of conveniently interleaving actions belonging to different levels of abstraction [2-7].”
BackgroundSpecification techniques for data abstractions
Liskov, B., & Zilles, S. (1975) · ACM SIGPLAN Notices · doi:10.1145/390016.808426 · Cited by 364
Self-citationProgramming-in-the-Large Versus Programming-in-the-Small
DeRemer, F., & Kron, H. H. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233534 · Cited by 405
Keynote address - data abstraction and hierarchy
Liskov, B. H. (1987) · Companion to the ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA Companion) · doi:10.1145/62138.62141 · Cited by 274
“Procedures are a useful abstraction mechanism, but in the early seventies some researchers realized that they were not enough [15], [16], [7] and proposed a new way of organizing programs around the "connections" between modules.”
Self-citationData Abstraction and Hierarchy
Liskov, B. H. (n.d.) · Cited by 120
Self-citationA Guided Tour of Program Design Methodologies
Bergland, G. D. (1981) · Computer · doi:10.1109/c-m.1981.220206 · Cited by 132
Software Engineering: Process, Principles, and Goals
Ross, D. T., Goodenough, J. B., & Irvine, C. A. (1975) · Computer · doi:10.1109/c-m.1975.218952 · Cited by 108
Programming-in-the large versus programming-in-the-small
DeRemer, F., & Kron, H. H. (1975) · International Conference on Reliable Software · doi:10.1145/800027.808431 · Cited by 95
Liskov, B. H. (1996) · ACM eBooks · doi:10.1145/234286.1057826 · Cited by 66
“For example, I had suggested that designers look for abstractions that hid the details of interacting with various hardware resources, and that hid the storage details of data structures Liskov 1972a.”
InfluentialSelf-citationThe impact of software engineering research on modern programming languages
Ryder, B. G., Soffa, M. L., & Burnett, M. (2005) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1101815.1101818 · Cited by 58
How to write correct programs and know it
Mills, H. D. (1975) · ACM SIGPLAN Notices · doi:10.1145/390016.808459 · Cited by 45
Information system design methodology
Wasserman, A. I. (1980) · Journal of the American Society for Information Science · doi:10.1002/asi.4630310102 · Cited by 58
Hoare, C. A. R. (1975) · ACM SIGPLAN Notices · doi:10.1145/390016.808476 · Cited by 44
The Need for Software Engineering
Myers, W. (1978) · Computer · doi:10.1109/c-m.1978.218054 · Cited by 39
Managing the development of reliable software
Williams, R. (1975) · ACM SIGPLAN Notices · doi:10.1145/390016.808418 · Cited by 28
Information flow metrics for the evaluation of operating systems' structure
Henry, S. M. (1979) · Iowa State University Digital Repository (Iowa State University) · doi:10.31274/rtd-180813-6137 · Cited by 32
“Liskov (1975) presented a survey of various formal specification techniques and showed that these specification techniques are necessary”
BackgroundA transactional model for automatic exception handling
Cabral, B., & Marques, P. (2010) · Computer Languages · doi:10.1016/j.cl.2010.09.002 · Cited by 25
“They are also an elegant means of interleaving actions belonging to different levels of abstraction [Liskov1974,Dijkstra1968,Liskov1972a, Liskov1972b,Woodger1972,Dahl1972].”
BackgroundReliability and integrity of large computer programs
Ramamoorthy, C. V., Cheung, R. C., & Kim, K. H. (1974) · Lecture notes in computer science · doi:10.1007/3-540-06786-8_260 · Cited by 26
Using type-extension to organize virtual-memory mechanisms
Janson, P. A. (1981) · ACM SIGOPS Operating Systems Review · doi:10.1145/850716.850718 · Cited by 24
“strict module, is discussed in Parnas [13] and Liskov [ 14 ].”
BackgroundAnalysis of Source Code Duplication in Ethreum Smart Contracts
Pierro, G. A., & Tonelli, R. (2021) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner50967.2021.00089 · Cited by 29
“Methods for clone resolution include refactoring [20] and meta-level techniques [21].”
BackgroundMethodProcedural encapsulation: A linguistic protection technique
Zilles, S. N. (1973) · ACM SIGPLAN Notices · doi:10.1145/390014.808305 · Cited by 21
The Oregon Report Software Engineering: The Turning Point
Wasserman, A. I., Belady, L. A., Watson, T. J., Gerhart, S. L., Miller, E. F., Waite, W. M., & Wulf, W. A. (1978) · Computer · doi:10.1109/c-m.1978.218342 · Cited by 21
Special Feature A Survey of Methods of Achieving Reliable Software
MORGAN, D. E., & TAYLOR, D. J. (1977) · Computer · doi:10.1109/c-m.1977.217647 · Cited by 20
Salibindla, J. (2018) · International Journal of Engineering Research and · doi:10.17577/ijertv7is010137 · Cited by 19
Behavioral semantics of nonrecursive control structures
Hewitt, C. E., Bishop, P. G., Steiger, R., Greif, I., Smith, B. C., Matson, T., & Hale, R. (1974) · Lecture notes in computer science · doi:10.1007/3-540-06859-7_147 · Cited by 19
"Structured programming" considered harmful
Abrahams, P. W. (1975) · ACM SIGPLAN Notices · doi:10.1145/987278.987280 · Cited by 14
Liskov, B. H. (1993) · ACM SIGPLAN conference on History of Programming Languages · doi:10.1145/154766.155367 · Cited by 18
Self-citationGood System Structure Features: Their Complexity and Execution Time Cost
Stankovic, J. A. (1982) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1982.235425 · Cited by 13
Structured Design Methodologies
Bergland, G. D. (1978) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.1978.1585214 · Cited by 12
Software optimization using user models
Ammar, R. A. A., & Booth, T. L. (1988) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.17373 · Cited by 14
Programming with Abstract Data Types (1974)
Liskov, B. H., & Zilles, S. N. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/12274.003.0041 · Cited by 11
Self-citationTransitioning from structured analysis to object-oriented design
Gray, L. (1988) · Washington Ada Symposium · doi:10.1145/339938.339987 · Cited by 11
“[ 9 ]) disagree. This study has taken the more liberal position, which is clear from the dependencies between the elements in Figure 6.”
BackgroundTowards Vendor-Agnostic IT-System of IT-Systems with the CEDE Platform
Osório, A. L. (2016) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-45390-3_42 · Cited by 10
“In 1972 Liskov [8] discussed reliability and complexity associated to the software developments.”
Some aspects of reliable software packages
Soi, I. M., & Gopal, K. (1979) · Microelectronics Reliability · doi:10.1016/0026-2714(79)90158-6 · Cited by 10
A Primer for the Act-1 Language
Theriault, D. G. (1982) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 9
Geo-distribute Cloud Applications at the Edge
Cherrueau, R.-A., Delavergne, M., & Lèbre, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-85665-6_19 · Cited by 8
A tool for enforcing system structure
White, J. R., & Presser, L. (1973) · ACM Annual Conference · doi:10.1145/800192.805691 · Cited by 8
Berry, D. M. (1975) · ACM SIGPLAN Notices · doi:10.1145/987260.987262 · Cited by 8
Controlled accessibility workshop report
Branstad, D. K., & Reed, S. K. (1974) · doi:10.6028/nbs.tn.827 · Cited by 8
ATLAS: A geographic database system data structure and language design for geographic information
Tsurutani, T., Kasahara, Y., & Naniwada, M. (1980) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/800250.807471 · Cited by 7
Wasserman, A. I., & Sherertz, D. D. (1976) · ACM SIGMINI Newsletter · doi:10.1145/1164881.1164883 · Cited by 8
A system for automatic software evaluation
Hodges, B. C., & Ryan, J. (1976) · doi:10.5555/800253.807739 · Cited by 7
V-Compiler: a next-generation tool for microprogramming
Patterson, D., Goodell, R., Poe, M. D., & Steely, S. C. (1981) · AFIPS National Computer Conference (NCC) · doi:10.1145/1500412.1500427 · Cited by 7
Synthesis of a software security system
Burke, E. L. (1974) · ACM Annual Conference · doi:10.1145/1408800.1408873 · Cited by 7
The design of PLAIN: support for systematic programming
Wasserman, A. I. (1980) · AFIPS National Computer Conference (NCC) · doi:10.1145/1500518.1500644 · Cited by 10
“Modularity makes an important contribution to the overall comprehensibility of programs, to the practice of programming by levels of abstraction, and to the production of large software systems by allowing various pieces of a software system to be effectively isolated from one another [21,22,23].”
BackgroundATLAS: A geographic database system data structure and language design for geographic information
Tsurutani, T., Kasahara, Y., & Naniwada, M. (1980) · ACM SIGGRAPH Computer Graphics · doi:10.1145/965105.807471 · Cited by 6
Considerations on the level of detail in simulation
Teorey, T. J., & Merten, A. G. (1973) · Annual Simulation Symposium (ANSS) · doi:10.5555/800241.807234 · Cited by 5
Computer system modelling: A test bed for new software technologies
Willis, R. R. (1974) · Winter Simulation Conference · doi:10.1145/800290.811301 · Cited by 5
A system for reliable engineering software
Culpepper, L. M. (1975) · ACM SIGPLAN Notices · doi:10.1145/390016.808438 · Cited by 5
A Computer Architecture for Level Structured Systems
Bernstein, A. J., & Siegel, P. H. (1975) · IEEE Transactions on Computers · doi:10.1109/t-c.1975.224310 · Cited by 5
“dated, translated intophysical addresses andstored in appropriate entries inthelevel characterization vectors oflevels iandi+ 1. 2)Theop-code fault vector forlevel i+ 1isconstructed andstored inLCV(i+ 1)usingtherule OFVi+1(k) = 0 ifandonlyifeither OFVi(k) = 0 or ODVi(k) 5 -x 0. 3)Thecontents oftheinterrupt maskregiste…”
BackgroundInfluentialThe design of usable programming languages
Hammer, M. M. (1975) · ACM Annual Conference · doi:10.1145/800181.810327 · Cited by 5
Graphics and interactive systems: design considerations of a software system
Gammill, R. C., & Robertson, D. (1973) · AFIPS National Computer Conference (NCC) · doi:10.1145/1499586.1499746 · Cited by 4
Improving system structure and its affect on vertical migration
Stankovic, J. A. (1981) · Microprocessing and Microprogramming · doi:10.1016/0165-6074(81)90025-9 · Cited by 4
Software development for reliable software systems
Joshi, R. D. (1983) · Journal of Systems and Software · doi:10.1016/0164-1212(83)90024-9 · Cited by 4
An assessment of the real-time application capabilities of the SIFT computer system
Butler, R. W. (1982) · NASA STI Repository (National Aeronautics and Space Administration) · Cited by 4
Architecture of a real time operating system
Pruitt, J. L., & Case, W. W. (1975) · ACM SIGOPS Operating Systems Review · doi:10.1145/1067629.806521 · Cited by 3
COMPUTER-AIDED DESIGN AND COMPUTER SCIENCE TECHNOLOGY
Fulton, R. E., & Voigt, S. J. (1976) · Elsevier eBooks · doi:10.1016/b978-0-12-528540-7.50007-1 · Cited by 3
Design and principles of a fault tolerant system
Boi, M. L., & Michel, P. (1978) · doi:10.5555/800099.803212 · Cited by 3
SPIL: A language for construction of reliable system software
Liskov, B. H., & Smith, L. A. (1973) · ACM SIGPLAN Notices · doi:10.1145/390014.808292 · Cited by 3
Self-citationIAI Corporate Software Engineering Training and Education Program
Lavi, J. Z., Porat, M. I. B., & Ben-David, A. (1987) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1987.232871 · Cited by 3
Formal module level specifications
Buckles, B. P. (1977) · ACM Annual Conference · doi:10.1145/800179.810194 · Cited by 3
Vitežić, L. E. P. (2020) · Repositorio Institucional de la Universidad de Burgos (University of Burgos) · doi:10.36443/10259/5586 · Cited by 3
Architecture of a real time operating system
Pruitt, J. L., & Case, W. W. (1975) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/800213.806521 · Cited by 2
ACCNET: a corporate computer network
Coleman, M. L. (1973) · AFIPS National Computer Conference (NCC) · doi:10.1145/1499586.1499633 · Cited by 2
SPOT: a structured system development system
Shimomura, T., Shigo, O., & Maejima, T. (1974) · ACM Annual Conference · doi:10.1145/1408800.1408804 · Cited by 2
Supporting the structured development of complex PL/I software systems
White, J. R., & Anderson, R. K. (1977) · Software Practice and Experience · doi:10.1002/spe.4380070219 · Cited by 3
“DECIMAL FIXED(4,2) DECIMAL FIXED(4,2) DECIMAL FIXED(4,2) DECIMAL FIXED(4,2)”
BackgroundSoftware reliability - bibliography
Dhillon, B. S. (1982) · Microelectronics Reliability · doi:10.1016/0026-2714(82)90038-5 · Cited by 2
Towards Implementation of Successful Medical Computer Applications
Sobolewski, J. S. (1977) · Computers and medicine · doi:10.1007/978-1-4612-5218-4_11 · Cited by 2
Software engineering in an academic computer science curriculum
Barnard, A. C. L. (1975) · ACM SIGCSE Bulletin · doi:10.1145/382216.382490 · Cited by 1
Wasserman, A. I., & Sherertz, D. D. (1976) · ACM SIGPLAN Notices · doi:10.1145/872740.807089 · Cited by 1
Выбор современного языка программирования для изучения базовых принципов программирования
Пылькин, А. Н., Соколова, Ю. С., & Дмитриева, Т. А. (2021) · ТЕНДЕНЦИИ РАЗВИТИЯ НАУКИ И ОБРАЗОВАНИЯ · doi:10.18411/trnio-10-2021-45 · Cited by 1
The hierarchical language system
Terashima, N. (1977) · ACM SIGPLAN Notices · doi:10.1145/954604.954613 · Cited by 1
Program design by a multidisciplinary team
Voigt, S. J. (1975) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1975.6312867 · Cited by 1
Directed flowgraphs: The basis of a specification and construction methodology for real-time systems
Rodríguez, J., & Greenspan, S. J. (1979) · Journal of Systems and Software · doi:10.1016/0164-1212(79)90003-7 · Cited by 1
An extension to algebraic specifications to incorporate state behavior
Calm, F., & White, J. R. (1979) · ACM Annual Conference · doi:10.1145/800177.810070 · Cited by 1
A data-base application design language
Jardine, D. A., & Davis, B. J. (1981) · Information & Management · doi:10.1016/0378-7206(81)90004-5 · Cited by 2
Structuring Compiler Development
Horning, J. J. (1974) · Lecture notes in computer science · doi:10.1007/978-3-662-21549-4_18 · Cited by 1
A relational view of a software design model
Glagowski, T. G., & White, J. R. (2005) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/cmpsac.1978.810333 · Cited by 1
Computer Security Bibliography
Discepolo, A.-M. G. (1980) · Defense Technical Information Center (DTIC) · doi:10.21236/ada108827 · Cited by 1
SIGMA-CAD: Some New Concepts in Design of General Purpose CAD Systems
David, B. T., & Vitry, G. (1978) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac.1978.1585192 · Cited by 3
On the engineering of crucial software
Pratt, T. W., Knight, J. C., & Gregory, S. (1983) · NASA Technical Reports Server (NASA) · Cited by 1
Cheops, a service-mesh to geo-distribute micro-service applications at the Edge
Delavergne, M. (2023) · theses.fr (ABES) · doi:10.70675/9aabdffez5d9bz4119z8f4ez83207cda715d · Cited by 3
Systemstruktur und -entwicklung
Habermann, A. N. (1981) · Springer eBooks · doi:10.1007/978-3-642-67930-8_10
Yamassaki, R. T. (2014) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.3.2014.tde-24122014-120113
A Design Methodology for Software Measurement ProgramsPreprint
Guinea, A. S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1307.4695
“Index Terms—Software measurement, software metrics programs, software measurement programs, design methodology, modularity, software engineering F”
Thompson, E. W., & Billawala, N. (1975) · ACM/IEEE Design Automation Conference (DAC) · doi:10.5555/800261.809067
Architectural advances of the space shuttle orbiter avionics computer system
Satterfield, J. M. (1974) · ACM SIGARCH Computer Architecture News · doi:10.1145/641675.642106
Engineering processes in managing software system development
Sung, D. (1977) · ACM SIGCPR Computer Personnel · doi:10.1145/382075.382321
A generalized approach to interpretation machines
Goodell, R. (1976) · ACM SIGPLAN Notices · doi:10.1145/987335.987338
Dembiński, P., & Schwartz, R. L. (1977) · ACM SIGPLAN Notices · doi:10.1145/954639.954643
Treatment of syntactic errors in an atlas translator
Terrevoli, G. (2005) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/cmpsac.1979.762592
THE PRODUCTION OF PROGRAM FAMILIES BASED ON ABSTRACT DATA TYPES
Riesco, A. P., & Cabrera, J. Y. (1982) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)62856-8
Presser, L. (1975) · ACM Annual Conference · doi:10.1145/800181.810345
Multi-objective Ranking based Non-DominantModule Clustering
Sarojini, K. (2014) · International Journal of Innovative Research in Science Engineering and Technology
IAI Corporate Software Engineering Training & Education Program
Lavi, J. Z., Porat, M. I. B., & Ben-David, A. (1989) · Springer eBooks · doi:10.1007/978-1-4613-9614-7_31
Проектирование тематического слоя электронной карты при помощи графа качественных признаков объектов
Смирнов, С. В. (2021) · ТЕНДЕНЦИИ РАЗВИТИЯ НАУКИ И ОБРАЗОВАНИЯ · doi:10.18411/trnio-10-2021-46
(2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17764-17
Metadata
- Authors
- Liskov, B. H.
- Affiliations
- Mitre (United States) (US)
- Corresponding author
- Liskov, B. H.
- Venue
- Proceedings of the December 5-7, 1972, fall joint computer conference, part I on - AFIPS '72 (Fall, part I)
- Publisher
- ACM Press
- Published
- 1972
- Pages
- 191
- OpenAlex
- W1976100766
- Cited by
- 107
- References
- 9
- Citations by year
- 2024: 1 · 2023: 2 · 2021: 6 · 2020: 1 · 2018: 1 · 2016: 1 · 2014: 3 · 2013: 1
- Type
- conference abstract
- Language
- en
- Open access
- closed
- Locations
- AFIPS Fall Joint Computer Conference (FJCC) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Reliability and Analysis Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- software reliability, software errors, software components, operating systems, design methodology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.