The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Cyber ranges and security testbeds: Scenarios, functions, tools and architecture
Open accessAbstract
The first line of defense against cyber threats and cyber crimes is to be aware and get ready, e.g., through cyber security training. Training can have two forms, the first is directed towards security professionals and aims at improving understanding of the latest threats and increasing skill levels in defending and mitigating against them. The second form of training, which used to attract less attention, aims at increasing cyber security awareness among non-security professionals and the general public. Conducting such training programs requires dedicated testbeds and infrastructures that help realizing and executing the training scenarios and provide a playground for the trainees. A cyber range is an environment that aims at providing such testbeds. The purpose of this paper is to study the concept of a cyber range, and provide a systematic literature review that covers unclassified cyber ranges and security testbeds. In this study we develop a taxonomy for cyber range systems and evaluate the current literature focusing on architecture and scenarios, but including also capabilities, roles, tools and evaluation criteria. The results of this study can be used as a baseline for future initiatives towards the development and evaluation of cyber ranges in accordance with existing best practices and lessons learned from contemporary research and developments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stuxnet: Dissecting a cyberwarfare weapon
Langner, R. (2011) · IEEE Security & Privacy Magazine · doi:10.1109/msp.2011.67 · Cited by 1,922
A Guide to Conducting a Systematic Literature Review of Information Systems Research
Okoli, C., & Schabram, K. (2011) · doi:10.2139/ssrn.1954824 · Cited by 1,849
An integrated experimental environment for distributed systems and networks
White, B., Lepreau, J., Stoller, L. B., Ricci, R., Guruprasad, S., Newbold, M., Hibler, M., Barb, C., & Joglekar, A. A. (2002) · ACM SIGOPS Operating Systems Review · doi:10.1145/844128.844152 · Cited by 1,302
ACM SIGCOMM computer communication review
Campbell, A. T., & Schwartz, M. (2001) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1037107.1037111 · Cited by 600
Cyber security of a power grid: State-of-the-art
Sun, C.-C., Hahn, A., & Liu, C.-C. (2018) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2017.12.020 · Cited by 481
A Survey on Smart Grid Cyber-Physical System Testbeds
Cintuglu, M. H., Mohammed, O. A., Akkaya, K., & Uluagac, A. S. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2627399 · Cited by 421
Cyber-Physical Security Testbeds: Architecture, Application, and Evaluation for Smart Grid
Hahn, A., Ashok, A., Sridhar, S., & Govindarasu, M. (2013) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2012.2226919 · Cited by 420
Future internet research and experimentation: the FIRE initiative
Gavras, A., Karila, A., Fdida, S., May, M., & Potts, M. (2007) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1273445.1273460 · Cited by 167
A testbed for analyzing security of SCADA control systems (TASSCS)
Mallouhi, M., Al-Nashif, Y., Cox, D., Chadaga, T., & Hariri, S. (2011) · ISGT 2011 · doi:10.1109/isgt.2011.5759169 · Cited by 164
A control system testbed to validate critical infrastructure protection concepts
Morris, T., Srivastava, A., Reaves, B., Gao, W., Pavurapu, K., & Reddi, R. (2011) · International Journal of Critical Infrastructure Protection · doi:10.1016/j.ijcip.2011.06.005 · Cited by 159
A Survey of Industrial Control System Testbeds
Holm, H., Karresand, M., Vidström, A., & Westring, E. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-26502-5_2 · Cited by 131
Research Methods for Cyber Security
(2018) · Network Security · doi:10.1016/s1353-4858(18)30053-9 · Cited by 129
The DETER project: Advancing the science of cyber security experimentation and test
Mirković, J., Benzel, T., Faber, T., Braden, R., Wroclawski, J. T., & Schwab, S. (2010) · IEEE Conference on Technologies for Homeland Security (HST) · doi:10.1109/ths.2010.5655108 · Cited by 114
Proceedings of the 27th Annual Computer Security Applications Conference
(2011) · doi:10.1145/2076732 · Cited by 105
Ferguson, B. C., Tall, A. M., & Olsen, D. (2014) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom.2014.27 · Cited by 104
2011 Frontiers in Education Conference (FIE)
(2011) · doi:10.1109/fie17605.2011 · Cited by 103
Integrated framework for hands-on cybersecurity training: CyTrONE
Beuran, R., Tang, D., Pham, C., Chinen, K.-I., Tan, Y., & Shinoda, Y. (2018) · Computers & Security · doi:10.1016/j.cose.2018.06.001 · Cited by 102
LARIAT: Lincoln adaptable real-time information assurance testbed
Rossey, L. M., Cunningham, R. K., Fried, D. J., et al. (2003) · Proceedings - IEEE Aerospace Conference · doi:10.1109/aero.2002.1036158 · Cited by 92
An experimental platform for assessing SCADA vulnerabilities and countermeasures in power plants
Fovino, I. N., Masera, M., Guidi, L., & Carpi, G. (2010) · Conference on Human System Interactions · doi:10.1109/hsi.2010.5514494 · Cited by 86
RINSE: The Real-Time Immersive Network Simulation Environment for Network Security Exercises
Liljenstam, M., Liu, J., Nicol, D., et al. (2005) · Workshop on Principles of Advanced and Distributed Simulation (PADS) · doi:10.1109/pads.2005.23 · Cited by 78
SDSecurity: A Software Defined Security experimental framework
Darabseh, A., Al‐Ayyoub, M., Jararweh, Y., Benkhelifa, E., Vouk, M. A., & Rindos, A. (2015) · doi:10.1109/iccw.2015.7247453 · Cited by 71
Using virtual environments for the assessment of cybersecurity issues in IoT scenarios
Furfaro, A., Argento, L., Parise, A., & Piccolo, A. (2016) · Simulation Modelling Practice and Theory · doi:10.1016/j.simpat.2016.09.007 · Cited by 70
Advanced Security Testbed Framework for Wearable IoT Devices
Siboni, S., Shabtai, A., Tippenhauer, N. O., Lee, J., & Elovici, Y. (2016) · ACM Transactions on Internet Technology · doi:10.1145/2981546 · Cited by 67
SCADAVT-A framework for SCADA security testbed based on virtualization technology
Almalawi, A., Tari, Z., Khalil, I., & Fahad, A. (2013) · Conference on Local Computer Networks · doi:10.1109/lcn.2013.6761301 · Cited by 63
Design and implementation of cybersecurity testbed for industrial IoT systems
Lee, S., Lee, S.-J., Yoo, H., Kwon, S., & Shon, T. (2017) · The Journal of Supercomputing · doi:10.1007/s11227-017-2219-z · Cited by 58
Urias, V., Van Leeuwen, B., & Richardson, B. (2012) · MILCOM 2012 - 2012 IEEE Military Communications Conference · doi:10.1109/milcom.2012.6415818 · Cited by 56
Doupé, A., Egele, M., Caillat, B., Stringhini, G., Yakin, G., Zand, A., Cavedon, L., & Vigna, G. (2011) · Annual Computer Security Applications Conference · doi:10.1145/2076732.2076740 · Cited by 52
Virtualization of Industrial Control System Testbeds for Cybersecurity
Alves, T., Das, R., & Morris, T. H. (2016) · doi:10.1145/3018981.3018988 · Cited by 52
Cyber Security Exercises and Competitions as a Platform for Cyber Security Experiments
Sommestad, T., & Hallberg, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34210-3_4 · Cited by 46
SoftGrid: A Software-based Smart Grid Testbed for Evaluating Substation Cybersecurity Solutions
Gunathilaka, P., Mashima, D., & Chen, B. (2016) · doi:10.1145/2994487.2994494 · Cited by 44
A Survey of SCADA Testbed Implementation Approaches
Qassim, Q. S., Jamil, N., Abidin, I. Z., Rusli, M. E., Yussof, S., Ismail, R., Abdullah, F., Ja’affar, N., Hasan, H. C., Daud, M., et al. (2017) · Indian Journal of Science and Technology · doi:10.17485/ijst/2017/v10i26/116775 · Cited by 44
Gamifying ICS Security Training and Research: Design, Implementation, and Results of S3
Antonioli, D., Ghaeini, H. R., Adepu, S., Ochoa, M., & Tippenhauer, N. O. (2017) · Workshop on Cyber-Physical Systems Security and PrivaCy (CPS-SPC) · doi:10.1145/3140241.3140253 · Cited by 43
PowerCyber: A remotely accessible testbed for Cyber Physical security of the Smart Grid
Ashok, A., Krishnaswamy, S., & Govindarasu, M. (2016) · IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT) · doi:10.1109/isgt.2016.7781277 · Cited by 42
The Design of ICS Testbed Based on Emulation, Physical, and Simulation (EPS-ICS Testbed)
Gao, H., Peng, Y., Jia, K., Dai, Z., & Wang, T. (2013) · International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP) · doi:10.1109/iih-msp.2013.111 · Cited by 38
Siaterlis, C., & Genge, B. (2014) · Communications of the ACM · doi:10.1145/2602575 · Cited by 34
FITS: A flexible virtual network testbed architecture
Moraes, I. M., Mattos, D. M. F., Ferraz, L. H. G., Campista, M. E. M., Rubinstein, M. G., Costa, L. H. M. K., de Amorim, M. D., Velloso, P. B., Duarte, O. C. M. B., & Pujolle, G. (2014) · Computer Networks · doi:10.1016/j.bjp.2014.01.002 · Cited by 33
Cyber Security Backdrop: A SCADA testbed
Farooqui, A. A., Zaidi, S. S. H., Memon, A. Y., & Qazi, S. (2014) · IEEE Computers, Communications and IT Applications Conference (ComComAp) · doi:10.1109/comcomap.2014.7017178 · Cited by 30
AMICI: An Assessment Platform for Multi-domain Security Experimentation on Critical Infrastructures
Genge, B., Siaterlis, C., & Hohenadel, M. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-41485-5_20 · Cited by 29
Improving and Measuring Learning Effectiveness at Cyber Defense Exercises
Maennel, K., Ottis, R., & Maennel, O. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70290-2_8 · Cited by 29
Current Developments in DETER Cybersecurity Testbed Technology
Benzel, T., Braden, B., Faber, T., Mirković, J., Schwab, S., Sollins, K. R., & Wroclawski, J. T. (2009) · Cybersecurity Applications & Technology Conference for Homeland Security (CATCH) · doi:10.1109/catch.2009.30 · Cited by 27
Communications network analysis in a SCADA system testbed under cyber-attacks
Miciolino, E. E., Bernieri, G., Pascucci, F., & Setola, R. (2015) · Telecommunications Forum (TELFOR) · doi:10.1109/telfor.2015.7377479 · Cited by 25
Cyber-Physical Systems Testbed Based on Cloud Computing and Software Defined Network
Gao, H., Peng, Y., Jia, K., Wen, Z., & Li, H. (2015) · International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP) · doi:10.1109/iih-msp.2015.50 · Cited by 24
Cybersecurity training in control systems using real equipment
Domínguez, M., Prada, M. A., Reguera, P., Fuertes, J. J., Alonso, S., & Morán, A. (2017) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2017.08.2151 · Cited by 24
Security of Cyber-Physical Systems
Hernan, J. M. R., Rodolfo-Mejias, J., & García-Alfaro, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-61437-3_1 · Cited by 23
Design on SCADA Test-bed and Security Device
Jung, S., Song, J., & Kim, S. (2011) · Cited by 20
Alfieri, R., Barbera, R., Belluomo, P., et al. (2003) · Future Generation Computer Systems · doi:10.1016/j.future.2003.10.002 · Cited by 14
Understanding Collaborative Challenges in IT Security Preparedness Exercises
Line, M. B., & Moe, N. B. (2015) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-18467-8_21 · Cited by 14
Control frameworks in network emulation testbeds: A survey
Tsai, P., Piccialli, F., Tsai, C., Luo, M.-Y., & Yang, C.-S. (2017) · Journal of Computational Science · doi:10.1016/j.jocs.2017.03.003 · Cited by 13
Smart Grid Security Educational Training with ThunderCloud
Stites, J., Siraj, A., & Brown, E. L. (2013) · doi:10.1145/2528908.2528927 · Cited by 9
A survey of software tools for the creation of networked testbeds
Siaterlis, C., & Masera, M. (2010) · Joint Research Centre (European Commission) · Cited by 7
Cited by
Cybersecurity of industrial cyber-physical systems: A review
Kayan, H., Nunes, M., Rana, O., Burnap, P., & Perera, C. (2022) · ACM Computing Surveys · doi:10.1145/3510410 · Cited by 261
Weaponized AI for cyber attacks
Yamin, M. M., Ullah, M., Ullah, H., & Katt, B. (2021) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2020.102722 · Cited by 154
Self-citationApplications of LLMs for Generating Cyber Security Exercise Scenarios
Mudassar Yamin, M., Hashmi, E., Ullah, M., & Katt, B. (2024) · IEEE Access · doi:10.1109/access.2024.3468914 · Cited by 91
“Yamin et al. [20] introduced an innovative system designed to address the inefficiencies in conducting cyber-security exercises within cyber ranges after conducting a detailed study on unclassified cyber-ranges [21].”
BackgroundSelf-citationSmart Environment for Adaptive Learning of Cybersecurity Skills
Vykopal, J., Seda, P., Švábenský, V., & Čeleda, P. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2022.3216345 · Cited by 48
Metadata
- Authors
- Yamin, M. M., Katt, B., & Gkioulos, V.
- Venue
- Computers & Security
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 88
- Pages
- 101636
- ISSN
- 0167-4048 (ISSN-L)
- OpenAlex
- W2980131799
- Cited by
- 268
- References
- 53
- FWCI
- 28.74
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.