Cited by 37Underwater Acoustics ResearchMusic and Audio ProcessingUnderwater Vehicles and Communication Systems

An Investigation of Preprocessing Filters and Deep Learning Methods for Vessel Type Classification With Underwater Acoustic Data

Open access
Domingos, Lucas C. F., Santos, Paulo E., Skelton, Phillip S. M., Brinkworth, Russell S. A., Sammut, Karl·2022·IEEE Access

Abstract

The illegal exploitation of protected marine environments has consistently threatened the biodiversity and economic development of coastal regions. Extensive monitoring in these – often remote – areas is challenging. Machine learning methods are useful in object detection and classification tasks and have the potential to underpin techniques for the development of robust monitoring systems to overcome this problem. However, development is hindered due to the limited number of publicly available labelled and curated datasets. Furthermore, there are relatively few open-source state-of-the-art methods to be used for evaluation. This paper presents an investigation of automated classification methods using underwater acoustic signals to infer the presence and type of vessels navigating in coastal regions. Various combinations of deep convolutional neural network architectures, and preprocessing filter layers, were evaluated using a new dataset based on a subset of the extensive open-source Ocean Networks Canada hydrophone data. Tests were conducted in which VGGNet and ResNet networks were applied to classify the input data. The data was preprocessed using either Constant Q Transform (CQT), Gammatone, Mel spectrogram, or a combination of these filters. With over 97% accuracy, using all three preprocessing representations simultaneously yielded the most reliable result. However, high accuracies of 94.95% were achieved using CQT as the preprocessing filter for a ResNet-based convolutional neural network, providing a trade-off between model complexity and accuracy; a result that is more than 10% higher than previously reported approaches. This more accurate classifier for underwater acoustics could be used as a reliable autonomous monitoring system in maritime environments.

AI snapshot

Written from the paper’s full text.

TL;DR

This paper evaluates preprocessing filters and deep CNN architectures for classifying vessel types from underwater acoustic signals, using a new dataset derived from Ocean Networks Canada hydrophone data. ResNet18 with CQT preprocessing reached 94.95% accuracy, while combining CQT, Gammatone, and Mel spectrograms reached 97.07% accuracy.

Key findings

  • ResNet18 with the Complete three-channel representation (CQT + Gammatone + Mel) achieved the best result: 97.07% accuracy, 94.57% precision, 97.61% recall, and 96.00% F1 on the first scenario.
  • CQT alone with ResNet18 achieved 94.95% accuracy, 89.21% precision, 95.60% recall, and 91.92% F1, described as a trade-off between model complexity and accuracy and more than 10% higher than previously reported approaches.
  • SGD outperformed Adam; the best SGD result was 84.46% accuracy with the Complete representation, 7 percentage points above the best Adam result of 77.39% with CQT.
  • Version 2 CQT parameters improved accuracy by 9.13% (7.22 percentage points) over Version 1, from 79.10% to 86.32%.
  • Across distance scenarios, CQT + ResNet achieved 94.95%, 94.45%, and 93.11% accuracy for the first, second, and third scenarios, but only 84.13% when all scenarios were combined.

Methods

  • Data came from Ocean Networks Canada hydrophone recordings at the Strait of Georgia, Canada, from June 24 to November 3, 2017, using an icListen AF hydrophone at 147 m depth, with AIS data used to annotate four vessel classes: Tug, Passengership, Cargo, and Tanker, plus background.
  • Audio was divided into 1-second segments; three distance-based scenarios were created using inclusion/exclusion radii; data was split 85% training, 10% validation, 5% test, with only the training subset balanced by oversampling.
  • Preprocessing used Mel spectrogram, CQT, Gammatone, or a three-channel Complete representation; VGG-based and ResNet18 models were trained for 40 epochs with batch size 8 and categorical cross-entropy, comparing SGD and Adam optimizers and evaluating micro-average accuracy plus macro precision, recall, and F1.

Limitations

  • The paper states that the combined-scenario results have “a large scope for improvement,” with accuracy varying by about 10 percentage points across scenarios, and that future work should consider other machine learning models and biologically inspired filters.
  • The paper notes that automatic annotation could generate mislabelling, so a cleaning process was applied; it also states that the scenarios are not directly comparable because they do not contain the same number of instances or the same vessels.
  • Evident from the text: the study uses one hydrophone location and time period, only four vessel classes plus background, and does not experimentally vary environmental conditions; class imbalance is addressed only in the training subset.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1109/access.2022.3220265

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 50 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    In the dataset, tagged vessel audio segments had higher amplitude variation (ρ) than background audio (μρ-vessel > μρ-back).

    “As expected, this analysis showed that the tagged vessel data delivered higher variation (ϱ) when compared with the background audio (i.e., µ ϱ-vessel > µ ϱ-back ).”
    • Also stated in: § III. DATASET · plain
      “A data cleaning process was performed, noting that the variation of the time domain amplitude of a vessel was greater than that of the background sound.”
    Quote in the paperSubstantial claim
  • Findingown data

    The dataset had a class imbalance problem.

    “As there was a class imbalance problem, only the Training subset was balanced using an oversampling strategy.”
    Quote in the paperSubstantial claim
  • Findingown data

    Using CQT as the preprocessing filter for a ResNet-based convolutional neural network achieved 94.95% accuracy.

    “high accuracies of 94.95% were achieved using CQT as the preprocessing filter for a ResNet-based convolutional neural network”
    Quote in the paperSubstantial claim
  • Findingown data

    Combining all of the data from the three scenarios caused an accuracy drop of between 8.98 and 10.82 percentage points compared to the individual scenarios alone.

    “However, combining all of the data from the three scenarios caused an accuracy drop of between 8.98 and 10.82 percentage points compared to the individual scenarios alone.”
    Quote in the paperSubstantial claim
  • Findingown data

    Both Gammatone and Mel Spectrogram methods presented lower accuracy values when compared with CQT and Complete representations.

    “Both Gammatone and Mel Spectrogram methods presented lower accuracy values when compared with CQT and Complete representations, as shown in Table 6.”
    Quote in the paperSubstantial claim
  • May combine two claims. 38
  • Classified as probably not a substantial claim. 40
  • May combine two claims.

    Findingown data

    Using all three preprocessing representations simultaneously (CQT, Gammatone, and Mel spectrogram) yielded the most reliable result, with over 97% accuracy.

    “With over 97% accuracy, using all three preprocessing representations simultaneously yielded the most reliable result.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The classification accuracy obtained using the three-channel Complete representation was marginally better than the best single filter (CQT) for ResNet, but not the VGG model.

    “The results obtained showed that the classification accuracy obtained using this three-channel representation was marginally better than the best single filter (CQT) for ResNet, but not the VGG model.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    A minor degradation in accuracy was observed with respect to an increase in the distance to the sensor, but the results obtained for the three scenarios showed similar figures.

    “Despite the fact that a minor degradation in accuracy was observed with respect to an increase in the distance to the sensor, the results obtained for the three scenarios showed similar figures.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    Combining CQT, Gammatone, and Mel spectra resulted in data samples with dimensions of 64x63x3 for Version 1 and 95x128x3 for Version 2.

    “Combining CQT, Gammatone, and Mel spectra resulted in data samples with dimensions of 64x63x3 for Version 1 and 95x128x3 for Version 2.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The ResNet18 model outperformed VGG for both CQT and Complete preprocessing filters, presenting an improvement of 8.09 percentage points for the CQT, and 14.15 for the Complete.

    “The results showed that the ResNet18 model outperformed VGG for both CQT and Complete preprocessing filters, presenting an improvement of 8.09 percentage points for the CQT, and 14.15 for the Complete, the latter being the best result obtained for this dataset scenario overall.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    SGD outperformed Adam for CQT, Mel, and the Complete representation, with Complete having the highest values.

    “The results represented in Table 5 show that SGD outperformed Adam for CQT, Mel, and the Complete representation, where the latter had the highest values (as shown in bold font in Table 5).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    SGD produced higher accuracy and a more stable performance.

    “In comparison, SGD produced higher accuracy and a more stable performance.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The training session using Adam and the Mel spectrogram did not converge to a global minimum, as the model predicted that almost everything belonged to the same class.

    “In addition, the training session using Adam and the Mel spectrogram did not converge to a global minimum as the model predicted that almost everything belonged to the same class, as per the class-normalised confusion matrix shown in Figure 6.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Despite the accuracy drop of 1.54 percentage points between Version 1 and Version 2 for the Complete scenario, the precision improved 1.58 percentage points.

    “Additionally, despite the accuracy drop of 1.54 percentage points between Version 1 and Version 2 for the Complete scenario, the precision improved 1.58 percentage points, showing a very close result for both versions of the Complete representation.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The higher accuracy comparing best results for SGD and Adam with CQT and Complete inputs was obtained with the SGD optimiser (84.46%), which is 7 percentage points larger than the best result obtained with Adam (77.39%).

    “Comparing the best results for SGD and Adam, with CQT and Complete inputs, the higher accuracy was obtained with the SGD optimiser (84.46%), which is 7 percentage points larger accuracy than the best result obtained with Adam (77.39%).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    The Complete representation combined with the ResNet model presented an improvement of 2.12 percentage points in accuracy over CQT, but CQT was able to obtain a similar value using only one-third of the input size and preprocessing.

    “Although the Complete representation, combined with the ResNet model, presented an improvement of 2.12 percentage points in accuracy, the CQT was able to obtain a similar value using only one-third of the input size and preprocessing, since Complete is a three-channel representation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In our dataset, the CQT representation presented better performance, with an accuracy of around 86%, when compared with Gammatone and Mel spectrograms, with best accuracies of 62% and 54%, respectively, a minimum of 24 percentage points improvement.

    “In our dataset, the CQT representation presented better performance, with an accuracy of around 86%, when compared with Gammatone and Mel spectrograms, with best accuracies of 62% and 54%, respectively, a minimum of 24 percentage points improvement.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingnone given

    Three distinct scenarios were defined with respect to the distance between the target vessel and the hydrophone used to capture the signal.

    “Three distinct scenarios were defined with respect to the distance between the target vessel to the hydrophone used to capture the signal.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The distances between target vessels and the hydrophone are accurately known for defining the three scenarios.
  • May combine two claims.

    Findingown data

    The three distance scenarios were compared using the proposed pipeline, achieving a maximum accuracy of 94.95% when CQT was used to preprocess the data fed into a ResNet classification model.

    “These three scenarios were compared using the proposed pipeline, achieving a maximum accuracy of 94.95% when CQT was used to preprocess the data fed into a ResNet classification model.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The vessel type annotations in the ONC dataset are correct.
    • Rests on an assumption: The distances between target vessels and the hydrophone are accurately known for defining the three scenarios.
  • May combine two claims.

    Findingown data

    For distinct distance scenarios, the present work achieved an accuracy of 95% with CQT preprocessing or 97% with Complete (combined) preprocessing.

    “However, the research reported here achieved superior results when distinct scenarios were considered with respect to the distance to the sensor, obtaining an accuracy of 95% or 97% depending on the preprocessing filtering method used (CQT or Complete, respectively), as shown in Table 9.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The vessel type annotations in the ONC dataset are correct.
    • Rests on an assumption: The distances between target vessels and the hydrophone are accurately known for defining the three scenarios.
  • Classified as probably not a substantial claim.

    Findingnone given

    A complete pipeline for the classification of underwater acoustic signals was proposed in this paper.

    “A complete pipeline for the classification of underwater acoustic signals was proposed in this paper, whose source code and data will be made publicly available 4 .”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The SGD optimiser is more stable and presents better generalisation than Adam for the vessel type classification problem.

    “This study also compared the SGD and Adam optimiser performance applied to the vessel type classification problem, showing that the SGD optimiser is more stable and presents a better generalisation than Adam.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Combining multiple preprocessing filters as inputs to CNN models achieves superior outcomes compared to individual approaches.

    “The comparison of the results obtained with individual approaches and their combination showed that superior outcomes could be achieved with the latter.”
    • Also stated in: § II. RELATED WORK · plain
      “Another relevant work used a fusion of the Mel-spectrogram, MFCC, chromatogram, spectral contrast, and Tonnetz filters, resulting in a one-dimensional representation, to improve the performance of a CNN model for the classification of underwater acoustic signals [43].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [42]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [43]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    The results were further analysed and filtered to avoid mislabelling from the automatic annotation procedure.

    “This automatic annotation procedure could generate mislabelling in the dataset, therefore the results were further analysed and filtered to avoid this issue.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The automatic annotation procedure could generate mislabelling in the dataset.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Environmental conditions such as temperature, depth, salinity, pressure, and precipitation can directly influence how the signal travels from emitter to receiver.

    “Environmental conditions, such as temperature, depth, salinity, pressure, and even precipitation, can directly influence how the signal travels from emitter to receiver [28].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [28]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Recent state-of-the-art methods for underwater acoustic signal analysis and classification are largely based on deep-learning algorithms.

    “However, recent state-of-the-art methods are largely based on the application of deep-learning algorithms to solve similar tasks [17]- [19].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [17]- [19]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Underwater acoustic signals have a low signal-to-noise ratio (SNR) and a high degree of variability for the same source.

    “it has a low signal-to-noise ratio (SNR) and a high degree of variability for the same source [15], [16]”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [15]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [16]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • Rests on an assumption: Underwater acoustic signals are a mixture of environmental, biological, and human-generated sounds.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The task of underwater acoustic target classification is challenging due to the complex nature of the sound produced by vessels.

    “The task of underwater acoustic target classification is challenging due to the complex nature of the sound produced by vessels [25].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • Rests on an assumption: Different types of vessels, in diverse states of upkeep, produce fundamentally distinct sounds depending on the vessel's speed, the state of its mechanical parts, and the hydrodynamics of its design.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    Smaller CNN models can have a beneficial trade-off between processing time and accuracy.

    “This proved that smaller models can have a beneficial trade-off between processing time and accuracy.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Classical signal processing methods such as Cepstral analysis can improve the quality of processed sound by reducing reflections interference and scattering losses, but only for short ranges with high SNR.

    “some classical signal processing methods, such as Cepstral analysis [14], can improve the quality of the processed sound by reducing the effects of the reflections interference and scattering losses, but only if applied on signals for short ranges with a high SNR [29].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [14]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [29]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisereasoning

    The acoustic signals emitted by vessels captured using hydrophones provide a low-cost and fraud-resistant data source for surveillance tasks, because acoustic signals can be difficult to omit or mask.

    “the acoustic signals emitted by vessels captured using hydrophones provide a low-cost and fraud-resistant data source to be used in surveillance tasks, as acoustic signals can be difficult to omit or mask.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Superior results, smaller networks, and reduced training time are obtained with the use of appropriate preprocessing filters in the classification pipeline.

    “Therefore, superior results, in addition to smaller networks and reduced training time, are obtained with the use of appropriate preprocessing filters in the classification pipeline.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Additional complexity exists due to background sound produced by the region and the complexity of sound propagation in shallow waters, which causes multi-path reflections.

    “additional complexity exists due to the background sound produced by the region and the complexity of sound propagation in shallow waters, which causes multi-path reflections [27].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [27]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Using preprocessing filters in underwater audio tasks yields better results than applying a CNN directly to raw audio or than baseline approaches.

    “Similarly, Mel-log spectrograms, delta, and delta-delta features were also used as acoustic filters in a ship detection task using a CNN, where high accuracy in the detection and localisation of vessels was reported [37].”
    • Also stated in: § II. RELATED WORK · boosted
      “Other studies in the literature also successfully applied filters to the DL inputs, showing a consistent improvement in underwater audio classification tasks [38]- [41].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [36]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [37]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [38]- [41]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    The most recent studies have used VGGNet or ResNet models as base algorithms for this development, owing to the models' high accuracy in complex classification tasks.

    “The most recent studies have used VGGNet [23] or ResNet [24] models as base algorithms for this development, owing to the models' high accuracy in complex classification tasks.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [23]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Although CNNs can be applied directly to the audio signal, acoustic filters are frequently used as preprocessing layers to improve the quality of the resulting audio representations.

    “Although CNNs can be applied directly to the audio signal [31], [34], [35], acoustic filters are frequently used as preprocessing layers to improve the quality of the resulting audio representations [25].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [31]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [34]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    CNNs are now being considered for underwater acoustic classification applications.

    “Advances in machine learning techniques mean CNNs are now being considered for underwater acoustic classification applications [25].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Isolating data to scenarios where only a single vessel was within the inclusion zone and no other vessels were within the exclusion zone ensured a more reliable acoustic signature without interference from other vessels.

    “Data was isolated where only a single vessel was within the inclusion zone while no other vessels were within the exclusion zone.This ensured a more reliable acoustic signature without interference from other vessels.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    This more accurate classifier for underwater acoustics could be used as a reliable autonomous monitoring system in maritime environments.

    “This more accurate classifier for underwater acoustics could be used as a reliable autonomous monitoring system in maritime environments.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: There is a need for an autonomous monitoring system that can generate an alert whenever a particular class of vessel is detected in an area, in order to better monitor and protect marine environments.
    • Rests on an assumption: Machine learning methods are useful in object detection and classification tasks and have the potential to underpin techniques for the development of robust monitoring systems to overcome the problem of illegal exploitation of protected marine environments.
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Premisereasoning

    There is a pertinent need for a complete investigation into the application of DL algorithms for underwater acoustic classification that considers optimisation of DL model parameters and comparison between different preprocessing filters.

    “However, there is a pertinent need for a complete investigation into the application of DL algorithms for the task, an investigation that considers the optimisation of the DL model parameters, and the comparison between different preprocessing filters.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Mel's scale is empirically based on the way humans perceive sound.

    “Mel's scale is empirically based on the way humans perceive sound [47].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [47]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Premisereasoning

    Because the sound generated by sources in the underwater domain is dependent on the environment, it is important that the type of two-dimensional representation matches the problem and that its parameters are optimised for the task.

    “as the sound generated by sources in the underwater domain is dependent on the environment, it is of extreme importance that not only the type of two-dimensional representation matches the problem, but also its parameters must be optimised for the task.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Recent studies, mostly based on Deep Learning methods, have shown promise in automatic data classification tasks.

    “recent studies, mostly based on the application of Deep Learning (DL) methods [17]- [19], have shown promise in automatic data classification tasks.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [17]- [19]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The engine typically produces a broadband continuous spectrum, while the propeller generates narrow band components with power at discrete frequencies.

    “The former typically produces a broadband continuous spectrum, while the latter generates narrow band components whose spectrum consists of power at discrete frequencies [26].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [26]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationcitation

    The rationale behind using stacks of multiple filters is to take advantage of the strengths of each method by feeding the network with different representations of the sound.

    “The rationale behind this approach is to take advantage of the strengths of each method, feeding the network with different representations of the sound.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Deeper CNN models achieved less than 1% accuracy improvement over shallow models for mine-like object detection from sidescan sonar images, at the cost of a 17x increase in computational requirements.

    “The comparative results reported suggest that deeper models (i.e., models with multiple layers) achieved less than 1% of accuracy improvement when compared with shallow models, at the cost of a 17x increase of computational requirements.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [30]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The gammatone filter was first defined as a filter bank capable of representing the shape of the impulse response function of the human auditory system.

    “The gammatone filter was first defined as a filter bank capable of representing the shape of the impulse response function of the human auditory system [51].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [51]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    SGD is an iterative method that starts randomly and seeks the minimum value in the input function.

    “SGD is an iterative method that starts randomly and seeks the minimum value in the input function.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [54]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The gammatone representation has an amplitude characteristic that can be used to predict the human auditory response.

    “This representation has an amplitude characteristic that can be used to predict the human auditory response.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [52]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    An accuracy value of around 87% was reported for a bio-inspired cochlea model preprocessing filter applied to a CNN-based classification.

    “An accuracy value of around 87% was reported as a result of the application of a bio-inspired cochlea model preprocessing filter to a CNN-based classification [40].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [40]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The function defined in Equation (8) was used by [51] to summarise the RevCor, a representation of the correlation between a sound stimulus on the human ear and the response of a primary auditory fibre.

    “The function defined on Equation ( 8) was used by [51] to summarise the RevCor, a representation of the correlation between a sound stimulus on the human ear and the response of a primary auditory fibre [52].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [51]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [52]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The acoustic signals generated by the vessels are predominantly composed of lower frequencies.

    “One is that the acoustic signals generated by the vessels are predominantly composed of lower frequencies.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Although ResNet18 produced the best classification results, VGG-based classifiers are still suitable models to be used in applications with limited computational resources.

    “Considering the relative complexity and accuracy results of both models tested in this work, we can conclude that, although ResNet18 produced the best classification results, VGG-based classifiers are still suitable models to be used in applications with limited computational resources.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationcitation

    The depth and ocean temperature where the hydrophone was located provided the best context for underwater sound propagation, thereby not degrading the SNR sufficiently to invalidate the signal representation.

    “One explanation for this could be the depth and ocean temperature where the hydrophone was located, which provided the best context for underwater sound propagation [25], thereby not degrading the SNR sufficiently to invalidate the signal representation.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [25]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ResNet addresses the vanishing gradient and accuracy degradation issues by introducing the identity shortcut connection, bypassing one or more layers in a forward pass, defining Residual Blocks.

    “ResNet addresses these issues by introducing the identity shortcut connection, bypassing one or more layers in a forward pass, defining Residual Blocks.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Study design and conductnone given

    The different scenarios do not contain the same number of instances (or the same vessels), so they are not directly comparable.

    “As the different scenarios do not contain the same number of instances (or the same vessels), they are not directly comparable, making it difficult to precisely state which situation allowed the best outputs.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The worst results in the combined dataset were probably due to the fact that, although a minor variation in the SNR did not affect the results obtained in each of the individual scenarios, this difference was large enough to increase the complexity of the audio patterns contained in the combined dataset, thus hindering the capacity of a simple classifier to find a suitable generalisation that, in,

    “This was probably due to the fact that, although a minor variation in the SNR (resulted from the distance between target and sensor) did not affect the results obtained in each of the individual scenarios, this difference was large enough to increase the complexity of the audio patterns contained in the combined dataset, thus hindering the capacity of a simple classifier to find a suitable general”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Prior work using ONC data reported accuracy values of the order of 80% using raw audio data, where time-frequency filter dependency was not considered in deep learning pipelines.

    “Considering related work developed with data from the ONC initiative, accuracy values of the order of 80% were previously reported using raw audio data, where time-frequency filter dependency was not considered in DL pipelines [34], [35].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [34]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [35]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The gammatone representation has a minimum-phase characteristic, which is a preferred feature for an auditory filter bank.

    “It also has a minimum-phase characteristic, which is a preferred feature for an auditory filter bank [52].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [52]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Mel Spectrograms are commonly used in speech recognition analysis and music processing, where human perception is extremely relevant.

    “Mel Spectrograms are commonly used in speech recognition analysis and music processing, where human perception is extremely relevant [49].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [49]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Correct tuning of the quality factor Q can supply the needed information for acoustic analysis, with resolution to distinguish adjacent musical notes, where a sound with harmonic frequency components will produce a constant pattern in the log frequency domain.

    “The correct tuning of the quality factor Q can supply the needed information for the acoustic analysis, with resolution to distinguish adjacent musical notes, where a sound with harmonic frequency components will produce a constant pattern in the log frequency domain [50].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [50]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Adam is an extension of SGD based on the combination of the Adaptive Gradient Algorithm (AdaGrad) and the Root Mean Square Propagation (RMSP).

    “Adam, on the other hand, is an extension of SGD based on the combination of the Adaptive Gradient Algorithm (AdaGrad) and the Root Mean Square Propagation (RMSP).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [55]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationcitation

    CQT increases the time resolution towards higher frequencies while reducing the frequency resolution; this results in emphasising the lower-frequencies, which is akin to the human aural perception.

    “In contrast, CQT increases the time resolution towards higher frequencies while reducing the frequency resolution; this results in emphasising the lower-frequencies, which is akin to the human aural perception [50].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [50]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The ResNet's capacity to have more intermediate layers proved to be suitable for the feature extraction stage, as it gave the model the ability to generalise the problem function better, thus resulting in higher classification performance.

    “The ResNet's capacity to have more intermediate layers proved to be suitable for the feature extraction stage, as it gave the model the ability to generalise the problem function better, thus resulting in higher classification performance.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Residual blocks facilitate the learning ability of the intermediary layers, reducing the vanishing gradient problem, and penalising the ones that could potentially degrade accuracy.

    “These blocks facilitate the learning ability of the intermediary layers, reducing the vanishing gradient problem, and penalising the ones that could potentially degrade accuracy [24].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [24]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    The momentum-based strategy of SGD provides a drift effect to escape saddle points without affecting the flat minima selection.

    “In contrast, the momentum-based strategy of the latter provides a drift effect to escape saddle points without affecting the flat minima selection [57].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [57]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    The Gammatone filter does not emphasise low frequencies sufficiently, resulting in a lower classification performance.

    “However, the Gammatone filter does not emphasise low frequencies sufficiently, resulting in a lower classification performance.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The work in [41] used a dataset called DeepShip, whose recordings were divided into 613 files varying from about 6 seconds to 1530 seconds.

    “That work was developed on a dataset called DeepShip, whose recordings were divided into 613 files, which varies from about 6 seconds to 1530 seconds.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [41]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In the DeepShip dataset, only the identification of a single vessel within a range of 2 km from the hydrophone was used to generate the data, and background noise recordings were added from a distinct source.

    “Only the identification of a single vessel within a range of 2 km from the hydrophone was used to generate the data, and the background noise recordings were added from a distinct source.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [41]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A comparison of various deep learning methods was conducted in [41] using an analogous set of ONC raw data that was used in the present paper.

    “In addition, a comparison of various deep learning methods was conducted in [41] using an analogous set of ONC raw data that was used in the present paper.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [41]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The highest accuracy obtained in [41] was 77.53%.

    “However, it was reported that 77.53% was the highest accuracy obtained in that work.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [41]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

66 of 66
  • The paper relies on this without support.

    There is a need for an autonomous monitoring system that can generate an alert whenever a particular class of vessel is detected in an area, in order to better monitor and protect marine environments.

    “In order to better monitor and protect marine environments, there is a need for an autonomous monitoring system that can generate an alert whenever a particular class of vessel is detected in an area.”
  • The paper relies on this without support.

    Machine learning methods are useful in object detection and classification tasks and have the potential to underpin techniques for the development of robust monitoring systems to overcome the problem of illegal exploitation of protected marine environments.

    “Machine learning methods are useful in object detection and classification tasks and have the potential to underpin techniques for the development of robust monitoring systems to overcome this problem.”
  • The paper relies on this without support.

    Development of monitoring systems is hindered due to the limited number of publicly available labelled and curated datasets.

    “However, development is hindered due to the limited number of publicly available labelled and curated datasets.”
  • The paper relies on this without support.

    There are relatively few open-source state-of-the-art methods to be used for evaluation.

    “Furthermore, there are relatively few open-source state-of-the-art methods to be used for evaluation.”
  • The paper relies on this without support.

    Underwater acoustic signals are a mixture of environmental, biological, and human-generated sounds.

    “the underwater acoustic signal is a mixture of environmental, biological, and human-generated sounds.”
  • The paper relies on this without support.

    Different types of vessels, in diverse states of upkeep, produce fundamentally distinct sounds depending on the vessel's speed, the state of its mechanical parts, and the hydrodynamics of its design.

    “As there are different types of vessels, in diverse states of upkeep, the sound produced by them is fundamentally distinct from one another, depending on the vessel's speed, the state of its mechanical parts, and the hydrodynamics of its design.”
  • The paper relies on this without support.

    The impact of environmental variables on vessel classification is virtually non-existent in the related literature.

    “Additionally, the impact of environmental variables on vessel classification is virtually non-existent in the related literature.”
  • The paper relies on this without support.

    Vessel classification using machine learning depends on the quality of the input data.

    “As the problem of vessel classification using machine learning depends on the quality of the input data, it was expected that the sound emitted by distant sources would have a lower SNR and, thus, lower classification accuracy.”
  • The paper relies on this without support.

    The sound emitted by distant sources would have a lower SNR and thus lower classification accuracy.

    “As the problem of vessel classification using machine learning depends on the quality of the input data, it was expected that the sound emitted by distant sources would have a lower SNR and, thus, lower classification accuracy.”
  • The paper relies on this without support.

    The CQT representation increases time resolution towards higher frequencies, resembling the human auditory system, while emphasising lower frequencies.

    “This representation also increases time resolution towards higher frequencies, resembling the human auditory system, while emphasising lower frequencies.”
  • The paper relies on this without support.

    The automatic annotation procedure could generate mislabelling in the dataset.

    “This automatic annotation procedure could generate mislabelling in the dataset, therefore the results were further analysed and filtered to avoid this issue.”
  • The paper relies on this without support.

    Segments tagged to contain a vessel but with a ϱ value less than µ_back + σ_back represent potentially mislabelled signals.

    “Individual segments tagged to contain a vessel, but with a ϱ value that was less than the overall standard deviation of the background increased by the mean (µ ϱ-back +σ ϱ-back ), were removed from the collection as they represented potentially mislabelled signals in the dataset.”
  • The paper relies on this without support.

    Combining CQT, Gammatone, and Mel spectra into a three-channel representation provides the neural network with more complete representations and takes advantage of the strengths of each preprocessing method.

    “This was motivated by providing the Neural Network with more complete representations, aiming to take advantage of the strengths of each of the preprocessing methods.”
  • The paper relies on this without support.

    VGG-based methods can perceive granular spatial relations on images due to their use of a 3x3 kernel size, the smallest possible size to capture the four cardinal directions.

    “VGG-based methods can perceive granular spatial relations on images due their use of a 3x3 kernel size, the smallest possible size to capture the four cardinal directions (up, down, left, and right).”
  • The paper relies on this without support.

    SGD is the most common optimiser used in the literature.

    “It is the most common optimiser used in the literature.”
  • The paper relies on this without support.

    The performances of optimisers are domain dependent.

    “However, their performances are domain dependent.”
  • The paper relies on this without support.

    Gammatone filter-banks facilitate the representation of the signal's time domain response, as gamma filters are broader on lower frequencies and narrow on higher ones, emphasising the lower spectrum.

    “Gammatone filter-banks facilitate the representation of the signal's time domain response, as gamma filters are broader on lower frequencies and narrow on higher ones, emphasising the lower spectrum.”
  • The paper relies on this without support.

    The vanishing gradient and accuracy degradation problems become problematic as more layers are added to neural network models.

    “although the vanishing gradient and the accuracy degradation problems become problematic as more layers are added to the models.”
  • The paper relies on this without support.

    The vessel type annotations in the ONC dataset are correct.

    “A new dataset was defined, using the raw data from Ocean Networks Canada 3 , which include the underwater acoustic signals annotated with the related vessel types.”
  • The paper relies on this without support.

    The distances between target vessels and the hydrophone are accurately known for defining the three scenarios.

    “Three distinct scenarios were defined with respect to the distance between the target vessel to the hydrophone used to capture the signal.”
  • The paper relies on this without support.

    The DeepShip dataset results reported in [41] are comparable to the present work's results despite differences in data collection and conditions.

    “In addition, a comparison of various deep learning methods was conducted in [41] using an analogous set of ONC raw data that was used in the present paper.”
    “Only the identification of a single vessel within a range of 2 km from the hydrophone was used to generate the data, and the background noise recordings were added from a distinct source.”
21 of 21

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Scenario radii differ between the text and Table 2

    Major

    The text gives exclusion radii of 3 km and 4 km for the first two scenarios, while Table 2 gives 4 km and 5 km.

  • VGG CQT accuracy differs between Tables 6 and 7

    Major

    For the Version 2 VGG CQT condition, Table 6 reports 86.32% accuracy and Table 7 reports 86.86%, while the other three metrics are identical.

  • Version 2 image width is reported as both 126 and 128

    Minor

    Version 2 is described as producing 95×126 images, but its three-channel Complete representation is given a width of 128.

3 of 3

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. johannesma, 1972, The pre-response stimulus ensemble of neurons in the cochlear nucleus, Proc Symp Hearing Theory
  2. patterson, 0, An efficient auditory filterbank based on the gammatone function, 2

Cited by

Sorted by citations

Authors
Domingos, L. C. F., Santos, P. E., Skelton, P. S. M., Brinkworth, R. S. A., & Sammut, K.
Affiliations
  • Centro Universitário FEI (BR)
  • Flinders University (AU)
Venue
IEEE Access
Published
2022
Volume
10
Pages
117582-117596
ISSN
2169-3536 (ISSN-L)
OpenAlex
W4313066531
Cited by
37
References
56
Citations by year
2026: 9 · 2025: 14 · 2024: 8 · 2023: 6
FWCI
3.38
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • UniSA Research Outputs Repository (University of South Australia) (submittedVersion, cc-by)
Topics
  • Physical Sciences › Earth and Planetary Sciences › Oceanography › Underwater Acoustics Research
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Physical Sciences › Engineering › Ocean Engineering › Underwater Vehicles and Communication Systems
Keywords
ship classification, underwater acoustic signals, acoustic monitoring, marine protected area monitoring, illegal fishing, constant-Q transform, gammatone filterbank, Mel spectrogram, ResNet, VGG, convolutional neural networks, signal preprocessing, coastal monitoring

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-17.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-17.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review