Framework for simulation software selection
Open accessAbstract
In the last years, the selection of the most suitable simulation software to correctly face industrial problems has become vital for companies. The choice should be made among several possibilities and some companies, especially SMEs, may not have the appropriate tools. Moreover, a change of perspective is detected in industry: the technological evolution has shifted the problem from the “best-ever” solution identification, independently from the goals, to the usability of the software, in function of the company's objectives. In this context, technicians and managers act as decision-makers, not only as receivers. The present work proposes an update of the criteria used for evaluating the most appropriate simulation software among different options. Based on that, an AHP-based evaluation framework is defined to support the selection process to face the industrial problem. The proposed methodology has been tested in an industrial case and its effectiveness has been proven.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The nine services listed by Tao et al. [21] can be grouped into categories including real-time state monitoring, energy consumption analysis, product failure analysis and prediction and product maintenance strategy, intelligent optimization and update, behaviour analysis and user operation guide, and product virtual maintenance and product virtual operations.
“Considering the nine services listed by [21], they can be grouped in these categories:”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
The DT is often used to offer specific analyses, related to the considered system and to its lifecycle, according to the services that a DT may offer, as listed by Tao et al [21].
“The DT is often used to offer specific analyses, related to the considered system and to its lifecycle, according to the services that a DT may offer, as listed by Tao et al [21].”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
Tao gives indications on what services a DT must offer, and all these services require the DT to be connected to the real system.
“Tao gives indications on what are the services that a DT must offer, which are all requiring the DT to be connected to the real system [21].”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
Only a limited set of services are offered in one single DT application, according to Tao's classification.
“Only a limited set of services are offered in one single DT application, according to the classification made by Tao [21].”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
The majority of proposed applications cannot fully offer the services from Table 1 by Tao, placing the related DT in the area of 'Digital Shadows', which do not reach full DT potentials.
“The majority of proposed applications cannot fully offer the services from Table 1 by [21], and this places the related DT in the area of 'Digital Shadows', that do not reach the full DT potentials [18].”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
No DT applications in the reviewed literature give all the services proposed by Tao, but at most two or three simultaneously.
“From Table 1, it can be seen that no DT applications in literature give all the services proposed by [21], but at most two or three of them contemporarily.”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
The analysed DTs are limited in the number of services offered and never extended to the entire set of services of reference given by [21].
“The analysed DTs are limited in the number of services offered, never extended to the entire set of services of reference given by [21]”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
The proposed simulation model allows different analyses in the same environment related to the different services that can be offered from the DT [21].
“and that allows different analyses in the same environment related to the different services that can be offered from the DT [21]”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
Each DT offers only some of the services that such platform should offer [21].
“Each DT offers only some of the services that such platform should offer [21];”
From Review of digital twin applications in manufacturing (2019) · cites this paper as [21]
Cites
How to Make a Decision: The Analytic Hierarchy Process
Saaty, T. L. (1990) · European Journal of Operational Research · doi:10.1016/0377-2217(90)90057-i · Cited by 9,605 · see citing works
Simulation Modeling and Analysis.
Schervish, M. J., Law, A. M., & Kelton, W. D. (1983) · Journal of the American Statistical Association · doi:10.2307/2288169 · Cited by 8,884 · see citing works
Discrete-Event System Simulation
Morgan, C. B., Banks, J., & Carson, J. S. (1984) · Technometrics · doi:10.2307/1268124 · Cited by 2,733 · see citing works
A Review of the Roles of Digital Twin in CPS-based Production Systems
Negri, E., Fumagalli, L., & Macchi, M. (2017) · Procedia Manufacturing · doi:10.1016/j.promfg.2017.07.198 · Cited by 1,669 · see citing works
Self-citationDiscrete Event System Simulation
Vijayarangam, J., Kamalakannan, S., & Priya, R. S. (2024) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9789815179514124010007 · Cited by 1,036 · see citing works
Simulation: the practice of model development and use
Beck, A. (2008) · Journal of Simulation · doi:10.1057/palgrave.jos.4250031 · Cited by 626 · see citing works
Evaluating and selecting software packages: A review
Jadhav, A. S., & Sonar, R. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.003 · Cited by 249 · see citing works
Garousi, V., Petersen, K., & Özkan, B. (2016) · Information and Software Technology · doi:10.1016/j.infsof.2016.07.006 · Cited by 242 · see citing works
Jadhav, A. S., & Sonar, R. (2011) · Journal of Systems and Software · doi:10.1016/j.jss.2011.03.034 · Cited by 133 · see citing works
Evaluating and Selecting Simulation Software Using the Analytic Hierarchy Process
Davis, L., & Williams, G. B. (1994) · Integrated Manufacturing Systems · doi:10.1108/09576069410050314 · Cited by 121 · see citing works
Open source software ecosystems: A Systematic mapping
Bedoya, Ó. H. F., Ameller, D., Costal, D., & Franch, X. (2017) · Information and Software Technology · doi:10.1016/j.infsof.2017.07.007 · Cited by 109 · see citing works
Fuzzy multi-criteria selection of object-oriented simulation software for production system analysis
Cochran, J. K., & Chen, H.-N. (2003) · Computers & Operations Research · doi:10.1016/s0305-0548(03)00209-0 · Cited by 100 · see citing works
FMU-supported simulation for CPS Digital Twin
Negri, E., Fumagalli, L., Cimino, C., & Macchi, M. (2019) · Procedia Manufacturing · doi:10.1016/j.promfg.2018.12.033 · Cited by 89 · see citing works
Self-citationDesign and analysis of integrated manufacturing systems
(1988) · Choice Reviews Online · doi:10.5860/choice.26-1544 · Cited by 80 · see citing works
Development of software selection criteria for supply chain solutions
Sahay, B. S., & Gupta, A. (2003) · Industrial Management & Data Systems · doi:10.1108/02635570310463429 · Cited by 72 · see citing works
A robust decision-making methodology for evaluation and selection of simulation software package
Azadeh, A., Nazari-Shirkouhi, S., & Rezaie, K. (2009) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-009-2205-6 · Cited by 67 · see citing works
Banks, J. (1991) · NCSU Libraries Repository (North Carolina State University Libraries) · doi:10.5555/304238.304249 · Cited by 61 · see citing works
The Simulator: New Member of the Simulation Family
Banks, J., Avilés, E., McLaughlin, J. R., & Yuan, R. C. (1991) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.21.2.76 · Cited by 59 · see citing works
Traffic simulation software review
Ejercito, P. M., Nebrija, K. G. E., Feria, R. P., & Figueroa, L. L. (2017) · International Conference on Information, Intelligence, Systems & Applications (IISA) · doi:10.1109/iisa.2017.8316415 · Cited by 57 · see citing works
So where to next? A survey of the future for discrete-event simulation
Taylor, S. J. E., & Robinson, S. (2006) · Journal of Simulation · doi:10.1057/palgrave.jos.4250002 · Cited by 57 · see citing works
Guidelines for selection of manufacturing simulation software
Hlupić, V., & Paul, R. J. (1999) · IIE Transactions · doi:10.1080/07408179908969802 · Cited by 55 · see citing works
A hierarchical framework for evaluating simulation software
Nikoukaran, J., Hlupić, V., & Paul, R. J. (1999) · Simulation Practice and Theory · doi:10.1016/s0928-4869(98)00028-7 · Cited by 55 · see citing works
Rohaninejad, M., Kheirkhah, A. S., Fattahi, P., & Vahedi-Nouri, B. (2014) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-014-6415-1 · Cited by 53 · see citing works
Software selection for simulation in manufacturing: a review
Nikoukaran, J., & Paul, R. J. (1999) · Simulation Practice and Theory · doi:10.1016/s0928-4869(98)00022-6 · Cited by 51 · see citing works
An evaluation and selection methodology for discrete-event simulation software
Tewoldeberhan, T. W., Verbraeck, A., Valentin, E. C., & Bardonnet, G. (2003) · Winter Simulation Conference · doi:10.1109/wsc.2002.1172870 · Cited by 48 · see citing works
Ascertaining Important Features For Industrial Simulation Environments
Mackulak, G. T., Cochran, J. K., & Savory, P. (1994) · SIMULATION · doi:10.1177/003754979406300402 · Cited by 43 · see citing works
Criteria for the Evaluation of Business Process Simulation Tools
Vukšić, V. B., Čerić, V., & Hlupić, V. (2007) · Informing Science and IT Education Conference · doi:10.28945/3171 · Cited by 39 · see citing works
A framework to embed Asset Management in production companies
Roda, I., & Macchi, M. (2018) · Proceedings of the Institution of Mechanical Engineers Part O Journal of Risk and Reliability · doi:10.1177/1748006x17753501 · Cited by 38 · see citing works
Self-citationQuality evaluation of floss projects: Application to ERP systems
Aversano, L., & Tortorella, M. (2013) · Information and Software Technology · doi:10.1016/j.infsof.2013.01.007 · Cited by 36 · see citing works
Evaluation Framework for Simulation Software
Hlupić, V., Irani, Z., & Paul, R. J. (1999) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s001700050079 · Cited by 36 · see citing works
Methodological approach to manufacturing simulation software selection
Hlupić, V., & Paul, R. J. (1996) · Computer Integrated Manufacturing Systems · doi:10.1016/0951-5240(95)00037-2 · Cited by 36 · see citing works
A survey of modelling and simulation software frameworks using Discrete Event System Specification
Franceschini, R., Bisgambiglia, P.-A., Touraille, L., Bisgambiglia, P.-A., & Hill, D. R. C. (2014) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.iccsw.2014.40 · Cited by 35 · see citing works
Criteria for simulation software evaluation
Nikoukaran, J., Hlupić, V., & Paul, R. J. (1998) · NCSU Libraries Repository (North Carolina State University Libraries) · doi:10.5555/293172.293256 · Cited by 34 · see citing works
An AHP application to select software for engineering education
Dorado-Vicente, R., Gómez-Moreno, Á., Torres-Jiménez, E., & López‐Alba, E. (2011) · Computer Applications in Engineering Education · doi:10.1002/cae.20546 · Cited by 33 · see citing works
Rincón, G., Alvarez, M., Pérez, M. E. D. M., & Hernandez, S. (2005) · Information & Management · doi:10.1016/j.im.2004.04.007 · Cited by 28 · see citing works
Selecting simulation software for manufacturing applications
Law, A. M., & Haider, S. W. (1989) · Winter Simulation Conference · doi:10.1145/76738.76742 · Cited by 27 · see citing works
Criteria for the Evaluation of Business Process Simulation Tools
Vukšić, V. B., Čerić, V., & Hlupić, V. (2007) · Interdisciplinary Journal of Information Knowledge and Management · doi:10.28945/101 · Cited by 24 · see citing works
Kuljis, J. (1996) · Winter Simulation Conference · doi:10.1145/256562.256786 · Cited by 24 · see citing works
Hlupić, V., & Mann, A. S. (1995) · Winter Simulation Conference · doi:10.1145/224401.224718 · Cited by 20 · see citing works
GUPTA, A., Singh, K., & VERMA, R. (2010) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 19 · see citing works
A Review of Evaluation Methods and Techniques for Simulation Packages
Alomair, Y., Ahmad, I., & Alghamdi, A. S. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.08.447 · Cited by 15 · see citing works
Industry 4.0 as Enabler for Effective Manufacturing Virtual Enterprises
Ferreira, F., Faria, J. A., Azevedo, A. L., & Marques, A. L. (2016) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-45390-3_24 · Cited by 15 · see citing works
Evaluating simulation software using fuzzy analytical hierarchy process
Azadeh, M., & Nazari-Shirkouhi, S. (2009) · Spring Simulation Multiconference · doi:10.5555/1639809.1639852 · Cited by 13 · see citing works
Introduction to SIMFACTORY II.5
Goble, J. (1991) · NCSU Libraries Repository (North Carolina State University Libraries) · doi:10.5555/304238.304259 · Cited by 13 · see citing works
Modeling manufacturing systems using MANUPLAN and SIMSTARTER-a tutorial
Suri, R., Derleth, D., & Tomsicek, M. (2002) · Winter Simulation Conference · doi:10.1109/wsc.1990.129509 · Cited by 11 · see citing works
Tewoldeberhan, T. W., Verbraeck, A., & Hlupić, V. (2009) · Journal of the Operational Research Society · doi:10.1057/jors.2009.119 · Cited by 8 · see citing works
Evaluating simulation software for postal service use: technique versus perception
Bard, J. F., deSilva, A. H., & Bergevin, A. (1997) · IEEE Transactions on Engineering Management · doi:10.1109/17.552806 · Cited by 8 · see citing works
da Silva, A. K., & Botter, R. C. (2009) · Journal of Simulation · doi:10.1057/jos.2008.21 · Cited by 7 · see citing works
Evaluation of discrete event simulation software to design and assess service delivery processes
Pezzotta, A. R. G. (2016) · CRC Press eBooks · doi:10.1201/b20894-14 · Cited by 7 · see citing works
A novel scheduling framework: integrating genetic algorithms and discrete event simulation
Fumagalli, L., Negri, E., Sottoriva, E., Polenghi, A., & Macchi, M. (2018) · International Journal of Management and Decision Making · doi:10.1504/ijmdm.2018.095738 · Cited by 5 · see citing works
Self-citationLöbler, H. (2016) · CRC Press eBooks · doi:10.1201/b20894-10 · Cited by 3 · see citing works
Comparative Study of Induction Motor De-Rating Factors
Enanya, M., Abdel-kader, F. A., Elsonbaty, N. A., & Abdo, H. (2017) · The Egyptian International Journal of Engineering Sciences and Technology · doi:10.21608/eijest.2017.97192 · Cited by 2 · see citing works
Flagged first, then by citations
2 of the 54 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Review of digital twin applications in manufacturing
Cimino, C., Negri, E., & Fumagalli, L. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.103130 · Cited by 874 · see citing works
Self-citationVillalonga, A., Negri, E., Biscardo, G., Castaño, F., Haber, R., Fumagalli, L., & Macchi, M. (2021) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2021.04.008 · Cited by 195 · see citing works
Self-citationMES-integrated digital twin frameworks
Negri, E., Berardi, S., Fumagalli, L., & Macchi, M. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.05.007 · Cited by 213 · see citing works
Self-citationField-synchronized Digital Twin framework for production scheduling with uncertainty
Negri, E., Pandhare, V., Cattaneo, L., Singh, J., Macchi, M., & Lee, J. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-020-01685-9 · Cited by 150 · see citing works
Self-citationA virtual commissioning based methodology to integrate digital twins into manufacturing systems
Barbieri, G., Bertuzzi, A., Capriotti, A., Ragazzini, L., Gutierrez, D., Negri, E., & Fumagalli, L. (2021) · Production Engineering · doi:10.1007/s11740-021-01037-3 · Cited by 72 · see citing works
Self-citationA Digital Twin-based scheduling framework including Equipment Health Index and Genetic Algorithms
Negri, E., Ardakani, H. D., Cattaneo, L., Singh, J., Macchi, M., & Lee, J. (2019) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2019.10.024 · Cited by 63 · see citing works
Self-citationLocal Decision Making based on Distributed Digital Twin Framework
Villalonga, A., Negri, E., Fumagalli, L., Macchi, M., Castaño, F., & Haber, R. (2020) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2020.12.2806 · Cited by 32 · see citing works
Self-citationDalpadulo, E., Pini, F., & Leali, F. (2021) · Applied Sciences · doi:10.3390/app112210980 · Cited by 28 · see citing works
Amico, C., & Cigolini, R. (2023) · Maritime Economics & Logistics · doi:10.1057/s41278-023-00256-y · Cited by 17 · see citing works
A Digital Twin-based Predictive Strategy for Workload Control
Ragazzini, L., Negri, E., & Macchi, M. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.08.183 · Cited by 15 · see citing works
Self-citationCritical perspectives on life cycle building performance assessment tool reviews
Säwén, T., Kalagasidis, A. S., & Hollberg, A. (2024) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2024.114407 · Cited by 13 · see citing works
Framework for Selecting Manufacturing Simulation Software in Industry 4.0 Environment
Cafasso, D., Calabrese, C., Casella, G., Bottani, E., & Murino, T. (2020) · Sustainability · doi:10.3390/su12155909 · Cited by 12 · see citing works
Attajer, A., Darmoul, S., Chaabane, S., Riane, F., & Sallez, Y. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-69373-2_38 · Cited by 12 · see citing works
Öztaş, G. Z., & Erdem, S. (2020) · Soft Computing · doi:10.1007/s00500-020-05411-8 · Cited by 10 · see citing works
Predicting the outbreak of epidemics using a network-based approach
Das, S., Bose, I., & Sarkar, U. K. (2023) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.01.021 · Cited by 10 · see citing works
Integrating PHM into production scheduling through a Digital Twin-based framework
Negri, E., Cattaneo, L., Pandhare, V., Macchi, M., & Lee, J. (2022) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2022.09.180 · Cited by 9 · see citing works
Self-citationPaape, N., van Eekelen, J. A. W. M., & Reniers, M. A. (2023) · International Journal of Computer Integrated Manufacturing · doi:10.1080/0951192x.2023.2228270 · Cited by 9 · see citing works
Sustainability-focused optimization of fused-deposition component design and manufacturing
Quiza, R., Rivas, M., Haber, R. E., Beruvides, G., & Castaño, F. (2023) · Sustainable materials and technologies · doi:10.1016/j.susmat.2023.e00670 · Cited by 9 · see citing works
A Conceptual Model of the IT Ecosystem for Asset Management in the Global Manufacturing Context
Polenghi, A., Roda, I., Macchi, M., & Pozzetti, A. (2020) · IFIP advances in information and communication technology · doi:10.1007/978-3-030-57997-5_82 · Cited by 9 · see citing works
Self-citationLiu, J., Zhang, D., Liu, Z.-P., Guo, T., & Yan, Y. (2024) · Sustainability · doi:10.3390/su16208851 · Cited by 7 · see citing works
Development of a lean manufacturing simulation laboratory for continuing education students
Jasti, N. V. K., Kota, S., & Venkataraman, P. (2020) · Journal of Adult and Continuing Education · doi:10.1177/1477971420962519 · Cited by 4 · see citing works
Xu, J., Lv, J., Yang, H., & Li, Y. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-211054 · Cited by 4 · see citing works
An Approach to Automating the Generation of Process Simulation Sequences
Reif, J., Jeleniewski, T., & Fay, A. (2023) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa54631.2023.10275718 · Cited by 4 · see citing works
Ragazzini, L., Negri, E., Fumagalli, L., Macchi, M., & Kozłowski, J. (2020) · IEEE International Conference on Industrial Cyber-Physical Systems (ICPS) · doi:10.1109/icps48405.2020.9274762 · Cited by 2 · see citing works
Self-citationA semantic model to publish open source software on the web of data
Mosharraf, M. (2022) · Aslib Journal of Information Management · doi:10.1108/ajim-09-2021-0280 · Cited by 2 · see citing works
Transdisciplinary Evaluation of Simulation Software for Industry 4.0 Assembly Lines
Lettori, J., Borsato, M., Raffaeli, R., Pellicciari, M., Grandi, F., & Peruzzini, M. (2022) · Advances in transdisciplinary engineering · doi:10.3233/atde220671 · Cited by 2 · see citing works
Fumagalli, L., Negri, E., Cattaneo, L., Ragazzini, L., & Macchi, M. (2023) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-30351-7_21 · Cited by 2 · see citing works
Self-citationRamathilagam, A., Pitchipoo, P., Valarmathi, K., & Rajakarunakaran, S. (2022) · Information Technology And Control · doi:10.5755/j01.itc.51.3.30525 · Cited by 1 · see citing works
Discrete Markov model of information and communication processes for crowd formation
Petryk, V., & Horondei, Y. (2020) · Collection Information technology and security · doi:10.20535/2411-1031.2020.8.1.218008
Systematic assessment of simulation software for assembly lines in Industry 4.0 context
Lettori, J., Borsato, M., Raffaeli, R., Pellicciari, M., & Peruzzini, M. (2022) · Product Management & Development · doi:10.4322/pmd.2022.020
Mariotti, T., Bandinelli, R., & Fani, V. (2023) · European Conference on Modelling and Simulation (ECMS) · doi:10.7148/2023-0047
Sousa, V. G. R., Castro, C., Oliveira, R., Mendonça, R., Muniz, L. C., da Rocha, S. V., de Almeida, J. D. S., & Rivero, L. (2026) · Journal on Interactive Systems · doi:10.5753/jis.2026.6030
- Authors
- Fumagalli, L., Polenghi, A., Negri, E., & Roda, I.
- Affiliations
- Politecnico di Milano (IT)
- Corresponding author
- Polenghi, Adalberto
- Venue
- Journal of Simulation
- Publisher
- Informa UK Limited
- Published
- 2019-04-16
- Volume
- 13
- Issue
- 4
- Pages
- 286-303
- ISSN
- 1747-7778 (ISSN-L)
- 1747-7786
- OpenAlex
- W2937817701
- Cited by
- 33
- References
- 54
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 7 · 2022: 5 · 2021: 6 · 2020: 9 · 2019: 3
- FWCI
- 4.12
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- other-oa
- Locations
- Journal of Simulation (publishedVersion)
- Virtual Community of Pathological Anatomy (University of Castilla La Mancha) (submittedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- not funded
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Multi-Criteria Decision Making
- Social Sciences › Decision Sciences › Management Science and Operations Research › Simulation Techniques and Applications
- Social Sciences › Business, Management and Accounting › Management Information Systems › Decision Support System Applications
- Keywords
- simulation software selection, software evaluation criteria, analytic hierarchy process, decision support framework, industrial simulation, small and medium-sized enterprises, software usability, decision-makers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
