The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Performance of forensic facial comparison by morphological analysis across optimal and suboptimal CCTV settings
Abstract
Facial comparison is an important yet understudied discipline in forensics. The recommended method for facial comparison in a forensic setting involves morphological analysis (MA) with the use of a facial feature list. The performance of this approach has not been tested across various closed-circuit television (CCTV) conditions. This is of particular concern as video and image data available to law enforcement is often varied and of subpar conditions. The present study aimed at testing MA across two types of CCTV data, representing ideal and less than ideal settings, also assessing which particular shortcomings arose from less-than-ideal settings. The study was conducted on a subset of the Wits Face Database arranged in a total of 225 face pools. Each face pool consisted of a target image obtained from either a high-definition digital CCTV camera or a low-definition analogue CCTV camera in monochrome, contrasted to 10 possible matches. The face pools were analysed and scored using MA and confusion matrices were used to analyse the outcomes. A notably high chance corrected accuracy (CCA) (97.3%) and reliability (0.969) was identified across the digital CCTV sample, while in the analogue CCTV sample MA appeared to underperform both in accuracy (CCA: 33.1%) and reliability (0.529). The majority of the errors in scoring resulted in false negatives in the analogue sample (75.2%), while across both CCTV conditions false positives were low (digital: 0.3%; analogue: 1.2%). Even thou…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Standardized mounting heights translate to a steep angle of incidence, which reduces image quality and obscures relevant facial detail due to increased subject-to-camera distance and loss of useable resolution.
“The problem with these standardized mounting heights is that they translate to a steep angle of incidence. This in turn reduces image quality and obscures relevant facial detail as a result of the increased SCD and subsequent loss of useable resolution [48,49].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
Eye-level digital CCTV recording-based facial comparisons were almost as accurate (97.3%) and reliable (77.3%) as standardized photograph to unstandardized photograph comparisons.
“In fact, eye-level digital CCTV recording-based facial comparisons were almost as accurate (97.3%) and reliable (77.3%) as the standardized photograph to unstandardized photograph comparisons [21,48] (Figure 2).”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
Faces disguised by brimmed caps yielded an exceedingly low CCA (68.1%), yet not as low as the analogue CCTV comparisons (33.1%).
“In contrast, faces disguised by brimmed caps yielded an exceedingly low CCA (68.1%) [49], yet not nearly as low as the analogue CCTV comparisons (33.1%) [48] (Figure 2).”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
Analogue CCTV data captured at an angle of incidence of 22° and height of 2.5 m performed worse overall, although it is unclear if this was because of camera position or poor image quality.
“In contrast, our analogue CCTV data, captured at an angle of incidence of 22° and height of 2.5 m, performed worse overall, although it is unclear if this was because of camera position or poor image quality [48].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
In 130 face sets (n = 1300 comparisons) recorded on a low-resolution suboptimal analogue CCTV system, MA had accuracies as low as 33.1%, false negative rates of 75.2%, and reliability of 37.8%.
“The results were found to be much poorer, with accuracies as low as 33.1% with extremely high false negative rates (75.2%) and questionable reliability (37.8%) [48] (Figure 2).”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
Eye-level mounted cameras at 1.8 m ground height provide an approximate 0-15° angle of incidence with the subject and provide the most optimal capture of facial detail even with natural head tilt.
“Eye-level mounted cameras at 1.8 m ground height provide an approximate 0–15° angle of incidence with the subject and provide the most optimal capture of facial detail even with natural head tilt [48].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
The performance of MA in faces disguised with sunglasses was markedly high (90.4%), surpassing performance under the same standard CCTV conditions without sunglasses (82.6%), but not better than photographic (99.1%) or eye-level CCTV data (97.3%).
“Overall, the performance of MA in faces disguised with sunglasses was markedly high (90.4%) [49], in fact surpassing the performance of facial comparison under the same standard CCTV conditions without sunglasses (82.6%), but not better than the photographic (99.1%) [21] or eye-level CCTV data (97.3%) [48] (Figure 2).”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
Across all of the studies, chance-corrected accuracy (CCA) was the best and most representative measure of accuracy, compared to hit rate and balanced accuracy.
“Across all of our studies, the best measure of accuracy was found to be the chance corrected accuracy (CCA) [21,48,49].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
A strict iteration resulted in worse performance in analogue CCTV comparisons than across all other comparisons (photographs, standard CCTV, and eye-level CCTV).
“A strict iteration resulted in a worse performance in the analogue CCTV comparisons than across all other comparisons (photographs, standard CCTV, and eye-level CCTV) [48].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
All other analyses from the various CCTV and photographic images showed improved performance under a strict iteration.
“All other analyses from the various CCTV and photographic images showed improved performance under a strict iteration [21,48,49].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
MA performance is better and more reliable in a digitally captured sample (IP cameras) at eye-level height (1.7 m) compared with a suboptimal sample at an angle of incidence of 27° (mount height 3.1 m).
“Our reports [48] show an overall better and more reliable performance of MA in a digitally captured sample (IP cameras) at eye-level height (1.7 m) compared with a suboptimal sample at an angle of incidence of 27° (mount height of 3.1 m) [48].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
All forms of facial comparison accuracy will suffer when using low-resolution analogue CCTV images, even if image quality is good in other respects.
“In general, all forms of facial comparison accuracy will suffer when using low-resolution analogue CCTV images, even if image quality is good in other respects [48,81,93,122].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
The conditions in the studies were limited to the major questions broadly investigated by each study.
“In doing so, although realistic, the conditions were limited to the major questions broadly investigated by each study [21,48,49].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
Only two particular CCTV camera specifications under limited conditions and installation variations were tested in our results.
“In consideration of our results, only two particular CCTV camera specifications under limited conditions and installation variations were tested [21,48,49].”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
When a face is composed of approximately 18 × 26 pixels or less, such as the analogue CCTV setting employed in our study, FFC analysis would be severely compromised.
“However, based on the actual accuracies and the approximate sizes of faces in each CCTV setting, it would appear that when a face is composed of approximately 18 × 26 pixels or less, such as the analogue CCTV setting employed in our study [48], FFC analysis would be severely compromised.”
From Forensic Facial Comparison: Current Status, Limitations, and Future Directions (2021) · cites this paper as [48]
Citations
Cites
Validation of forensic facial comparison by morphological analysis in photographic and CCTV samples
Bacci, N., Houlton, T. M. R., Briers, N., & Steyn, M. (2021) · International Journal of Legal Medicine · doi:10.1007/s00414-021-02512-3 · Cited by 23
Self-citation
Flagged first, then by citations
Research works printed but not linked: 40
- T. Valentine, J.P. Davis, Forensic facial identification: theory and practice of identification from eyewitnesses, composites and CCTV, John Wiley & Sons, Ltd, Chichester, UK, 2015. https://doi.org/10.1002/9781118469538. · DOI
- A.K. Jain, B. Klare, U. Park, Face Matching and Retrieval in Forensics Applications, IEEE Multimed. 19 (2012) 20–20. https://doi.org/10.1109/MMUL.2012.4. · DOI · Paper page
- Wilkinson, 2009, Are facial image analysis experts any better than the general public at identifying individuals from CCTV images?, Sci. Justice, 49, 191, 10.1016/j.scijus.2008.10.011 · DOI · Paper page
- Walker, 2015, Facial comparison from CCTV footage: the competence and confidence of the jury, Sci. Justice, 55, 487, 10.1016/j.scijus.2015.04.010 · DOI
- Norris, 2002, The Growth of CCTV: a global perspective on the international diffusion of video surveillance in publicly accessible space, Surveill. Soc., 2, 110, 10.24908/ss.v2i2/3.3369 · DOI
- Robertson, 2019, Facial identity verification: five challenges facing practitioners, Keesing, J. Doc., 59, 3
- Bruce, 1999, Verification of face identities from images captured on video, J. Exp. Psychol. Appl., 5, 339, 10.1037/1076-898X.5.4.339 · DOI · Paper page
- Burton, 2010, The Glasgow face matching test, Behav. Res Methods, 42, 286, 10.3758/BRM.42.1.286 · DOI · Paper page
- Pavel, 2012, The influence of facial expressions on recognition performance in facial identity, Procedia – Soc. Behav. Sci., 33, 548, 10.1016/j.sbspro.2012.01.181 · DOI
- Steyn, 2018, Forensic facial comparison in South Africa: state of the science, Forensic Sci. Int., 287, 190, 10.1016/j.forsciint.2018.04.006 · DOI · Paper page
- Megreya, 2011, Sex differences in unfamiliar face identification: Evidence from matching tasks, Acta Psychol. (Amst), 137, 83, 10.1016/j.actpsy.2011.03.003 · DOI · Paper page
- Porter, 2000, An anatomical and photographic technique for forensic facial identification, Forensic Sci. Int., 114, 97, 10.1016/S0379-0738(00)00290-5 · DOI
- Bruce, 2001, Matching identities of familiar and unfamiliar faces caught on CCTV images, J. Exp. Psychol. Appl., 7, 207, 10.1037/1076-898X.7.3.207 · DOI · Paper page
- Lee, 2009, Matching unfamiliar faces from poor quality closed-circuit television (CCTV) footage: an evaluation of the effect of training on facial identification ability, AXIS Online, J. Cent. Anat. Hum. Identif., 1, 19
- Bindemann, 2013, The effect of image pixelation on unfamiliar-face matching, Appl. Cogn. Psychol., 27, 707, 10.1002/acp.2970 · DOI · Paper page
- Gibelli, 2016, The identification of living persons on images: a literature review, Leg. Med., 19, 52, 10.1016/j.legalmed.2016.02.001 · DOI · Paper page
- Burton, 1999, Face recognition in poor-quality video: evidence from security surveillance, Psychol. Sci., 10, 243, 10.1111/1467-9280.00144 · DOI · Paper page
- Surette, 2005, The thinking eye, Polic. Int. J. Police Strateg. Manage., 28, 152, 10.1108/13639510510581039 · DOI
- N.N.A.N. Ghazali, N.A. Zamani, S.N.H.S. Abdullah, J. Jameson, Super resolution combiantion methods for CCTV forensic interpretation, in: 12th Int. Conf. Intell. Syst. Des. Appl., 2012: pp. 853–858. · DOI
- S. Viték, M. Klíma, L. Krasula, Video compression technique impact on efficiency of person identification in CCTV systems, in: Proc. - Int. Carnahan Conf. Secur. Technol., Rome, Italy, 2014. https://doi.org/10.1109/CCST.2014.6987027. · DOI · Paper page
- X. Qi, C. Liu, Mitigate compression artifacts for face in video recognition, in: M. Blowers, R.D. Hall, V.R. Dasari (Eds.), Disruptive Technol. Inf. Sci. IV, SPIE, 2020: p. 25. https://doi.org/10.1117/12.2556702. · DOI
- Fysh, 2018, The Kent face matching test, Br. J. Psychol., 109, 219, 10.1111/bjop.12260 · DOI · Paper page
- H.U. Keval, M.A. Sasse, Can we ID from CCTV: Image quality in digital CCTV and face identification performance, in: Def. Secur. Symp., 2008: pp. 69820K-1–15. https://doi.org/10.1117/12.774212. · DOI · Paper page
- N. Bacci, J. Davimes, M. Steyn, N. Briers, Wits Face Database, Wits Institutional Repos. Environ. Dsp. (2020). https://doi.org/http://dx.doi.org.10.18772/10539/20690. · DOI
- Bacci, 2021, Development of the Wits face database: an African database of high-resolution facial photographs and multimodal closed-circuit television (CCTV) recordings, F1000Res., 10, 131, 10.12688/f1000research.50887.1 · DOI · Paper page
- P.F. Watson, A. Petrie, Method agreement analysis: A review of correct methodology, Theriogenology. 73 (2010) 1167–1179. https://doi.org/10.1016/j.theriogenology.2010.01.003. · DOI
- M. Kuhn, Building Predictive Models in R Using the caret Package, J. Stat. Softw. 28 (2008) 1–26. https://doi.org/10.18637/jss.v028.i05. · DOI · Paper page
- Dietterich, 1998, Approximate statistical tests for comparing supervised classification learning algorithms, Neural Comput., 10, 1895, 10.1162/089976698300017197 · DOI · Paper page
- Seckiner, 2018, Forensic image analysis – CCTV distortion and artefacts, Forensic Sci. Int., 285, 77, 10.1016/j.forsciint.2018.01.024 · DOI
- Z. Henderson, V. Bruce, A.M. Burton, Matching the faces of robbers captured on video, Appl. Cogn. Psychol. 15 (2001) 445–464. https://doi.org/10.1002/acp.718. · DOI · Paper page
- Ritz-Timme, 2011, A new atlas for the evaluation of facial features: advantages, limits, and applicability, Int. J. Legal Med., 125, 301, 10.1007/s00414-010-0446-4 · DOI
- Roelofse, 2008, Photo identification: facial metrical and morphological features in South African males, Forensic Sci. Int., 177, 168, 10.1016/j.forsciint.2007.12.003 · DOI
- Towler, 2017, Evaluating the feature comparison strategy for forensic face identification, J. Exp. Psychol. Appl., 23, 47, 10.1037/xap0000108 · DOI · Paper page
- Megreya, 2018, Feature instructions improve face-matching accuracy, PLoS One., 13, e0193455, 10.1371/journal.pone.0193455 · DOI · Paper page
- Thompson, 2003, How the probability of a false positive affects the value of DNA evidence, J. Forensic Sci., 48, 2001171, 10.1520/JFS2001171 · DOI
- Stephan, 2015, Perspective distortion in craniofacial superimposition: Logarithmic decay curves mapped mathematically and by practical experiment, Forensic Sci. Int., 257, e1
- Stephan, 2019, An overview of the latest developments in facial imaging, Forensic Sci. Res., 4, 10, 10.1080/20961790.2018.1519892 · DOI · Paper page
- Mileva, 2019, Face search in CCTV surveillance, Cogn. Res. Princ. Implic., 4
- Yip, 2002, Contribution of color to face recognition, Perception, 31, 995, 10.1068/p3376 · DOI · Paper page
- Bindemann, 2009, The role of color in human face detection, Cogn. Sci., 33, 1144, 10.1111/j.1551-6709.2009.01035.x · DOI · Paper page
Cited by
Sorted by citations
Forensic Facial Comparison: Current Status, Limitations, and Future Directions
Bacci, N., Davimes, J. G., Steyn, M., & Briers, N. (2021) · Biology · doi:10.3390/biology10121269 · Cited by 26
Self-citation
Metadata
- Authors
- Bacci, N., Steyn, M., & Briers, N.
- Venue
- Science & Justice
- Publisher
- Elsevier BV
- Published
- 2021-11
- Volume
- 61
- Issue
- 6
- Pages
- 743-754
- ISSN
- 1355-0306
- Cited by
- 6
- References
- 1
- Language
- en
- Funders
- National Research Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review