Support vector regression-based operational effectiveness evaluation approach to reconnaissance satellite system
Open accessAbstract
As one of the most important part of weapon system of systems (WSoS), quantitative evaluation of reconnaissance satellite system (RSS) is indispensable during its construction and application. Aiming at the problem of nonlinear effectiveness evaluation under small sample conditions, we propose an evaluation method based on support vector regression (SVR) to effectively address the defects of traditional methods. Considering the performance of SVR is influenced by the penalty factor, kernel type, and other parameters deeply, the improved grey wolf optimizer (IGWO) is employed for parameter optimization. In the proposed IGWO algorithm, the opposition-based learning strategy is adopted to increase the probability of avoiding the local optima, the mutation operator is used to escape from premature convergence and differential convergence factors are applied to increase the rate of convergence. Numerical experiments of 14 test functions validate the applicability of IGWO algorithm dealing with global optimization. The index system and evaluation method are constructed based on the characteristics of RSS. To validate the proposed IGWO-SVR evaluation method, eight benchmark data sets and combat simulation are employed to estimate the evaluation accuracy, convergence performance and computational complexity. According to the experimental results, the proposed method outperforms several prediction based evaluation methods, verifies the superiority and effectiveness in RSS operational effectiveness evaluation.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
2 of 7 cited sources checked · 0 supported · 0 flagged · accuracy not yet measured
- Premisecitation
GWO has advantages over PSO, ALO, MFO, SCA, WOA and MVO in global search ability, solution accuracy and convergence speed.
“Compared with some proposed intelligent optimization algorithms, such as PSO, ALO, moth-flame optimization (MFO), SCA, WOA and multi-verse optimizer (MVO), GWO has advantages in global search ability, solution accuracy and convergence speed [21].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [21] source
The Introduction describes GWO as having strong global search ability and says it outperforms GA and PSO in convergence speed and solution accuracy. It does not establish those advantages over ALO, MFO, SCA, WOA, or MVO; the paper’s reported comparisons instead involve ABC and SA. (LLM, conf=0.90)
Experimental — accuracy not yet measured
- Findingown data
A comprehensive method optimizing SVR parameters for OEE with the IGWO algorithm is proposed in this paper.
“A comprehensive method optimizing SVR parameters for OEE with the IGWO algorithm is proposed in this paper.”
Quote in the paperSubstantial claim - Findingown data
Two datasets meet the reject condition of the null hypothesis when IGWO-SVR is compared with BPNN.
“In particular, two datasets meet the reject condition of null hypothesis when compared with BPNN.”
Quote in the paperSubstantial claim - Findingown data
The running time of IGWO is less than 0.5 s.
“Furthermore, the running time of the proposed IGWO is less than 0.5 s, demonstrating its high execution efficiency.”
Quote in the paperNot a substantial claim - Findingown data
IGWO has the best standard deviation among compared methods for fixed-dimensional multimodal test functions f12-f14.
“In the fixed-dimensional multimodal test functions ( -), IGWO has the best standard deviation among these methods.”
Quote in the paperNot a substantial claim
- Findingnone given
The computational cost of IGWO-SVR dealing with evaluation problems is competitive.
“The computational cost of IGWO-SVR dealing with evaluation problems is also competitive.”
Quote in the paperNot a substantial claim - Findingown data
Through procedures in Fig. 9, the optimal parameters for IGWO-SVR are obtained: penalty factor C = 45.16, Gauss kernel parameter σ = 2.3158, and insensitive loss function ε = 0.108.
“Through procedures in Fig. 9, the optimal parameters for IGWO-SVR are obtained.The penalty factor C = 45.16, the parameter of Gauss kernel function σ = 2.315 8 and the insensitive loss function ε = 0.108.”
Quote in the paperSubstantial claim - Findingown data
In datasets b, e, f, and h, the proposed IGWO-SVR approach obtains the minimum MSE against BPNN, SVR and GWO-SVR.
“In datasets b, e, f , and h , the proposed approach obtains the minimum MSE against BPNN, SVR and GWO-SVR.”
Quote in the paperSubstantial claim - Findingown data
In f7, MVO, PSO, MFO, and ALO fall into local optima.
“It can be seen that MVO, PSO, MFO, and ALO fall into local optima.”
Quote in the paperNot a substantial claim - Findingown data
The optimization of PSO and SCA is relatively poor.
“The optimization of PSO and SCA is relatively poor.”
Quote in the paperNot a substantial claim - Findingown data
Through experiment with 14 benchmark functions, the proposed IGWO algorithm, modified by three strategies (opposition-based learning strategy, differential convergence factor and mutation operator), has advantages in improvement of the search rate and swarm diversity.
“Through experiment with 14 benchmark functions, the proposed IGWO algorithm, which is modified by three strategies (opposition-based learning strategy, differential convergence factor and mutation operator) has advantages in improvement of the search rate and swarm diversity.”
Quote in the paperSubstantial claim - Findingown data
Numerical experiments of 14 test functions validate the applicability of IGWO for global optimization.
“Numerical experiments of 14 test functions validate the applicability of IGWO algorithm dealing with global optimization.”
Quote in the paperSubstantial claim - Findingreasoning
Premature convergence is avoided by the proposed IGWO algorithm.
“Premature convergence is avoided at the same time.”
Quote in the paperSubstantial claim - Findingnone given
The improvement strategies introduced in IGWO (opposition-based learning and mutation operator) bring relatively greater computational complexity.
“The improvement strategies introduced in the IGWO algorithm (opposition-based learning strategy and mutation operator) have brought a relatively greater computational complexity.”
Quote in the paperNot a substantial claim - Findingown data
According to Table 11, the accuracy of IGWO-SVR reaches 0.001.
“According to Table 11, the accuracy of IGWO-SVR reaches 0.001.”
Quote in the paperSubstantial claim - Findingown data
According to Table 7, IGWO-SVR acquires the minimum computational cost when it comes to datasets b, e, f, and h.
“According to Table 7, IGWO-SVR acquires the minimum computational cost when it comes to datasets b, e, f , and h .”
Quote in the paperNot a substantial claim - Findingown data
IGWO-SVR performances are superior to several prediction-based evaluation methods in both numerical experiments and operational evaluation.
“The performances of IGWO-SVR are superior to several prediction-based evaluation methods in both numerical experiments and operational evaluation.”
Quote in the paperSubstantial claim - Findingown data
In accordance with Table 8, there are eight data sets (a, b, c, d, e, f, g, h) with significant difference when IGWO-SVR is compared with SVR.
“In accordance with Table 8, there are eight data sets (a, b, c, d, e, f, g, h) with significant difference when IGWO-SVR is compared with SVR.”
Quote in the paperSubstantial claim - Premisecitation
The mutation operator improves population diversity.
“The mutation operator is proposed to improve the population diversity [40], as shown in Fig. 3.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [40] source
- Premisereasoning
The linear decreasing strategy of control parameter a is difficult to adapt to the actual search in complex optimization problems.
“However, in actual optimization problems, due to the extremely complex search process of the algorithm, it is difficult for the linear decreasing strategy of the control parameter a to adapt to the actual situation of the search.”
Quote in the paperNot a substantial claim - Interpretationown data
When it comes to prediction accuracy and computational cost, IGWO-SVR demonstrates powerful competitiveness.
“When it comes to prediction accuracy and computational cost, IGWO-SVR demonstrates powerful competetiveness.”
Quote in the paperSubstantial claim - Interpretationown data
Experiment II based on simulation verifies the feasibility of IGWO-SVR in RSS evaluation.
“Experiment II based on simulation verifies the feasibility of IGWO-SVR in RSS evaluation.”
Quote in the paperSubstantial claim- Rests on an assumption: The simulation data under specific operational scenarios adequately represent RSS operational effectiveness for the purpose of verifying the IGWO-SVR model.
- Interpretationown data
These results verify that the proposed method has the optimal comprehensive performance dealing with effectiveness evaluation of RSS.
“These verify the proposed method has the optimal comprehensive performance dealing with effectiveness evaluation of RSS.”
Quote in the paperSubstantial claim - Interpretationown data
Experimental results verify that the modified strategies enhance the convergence performance of standard GWO effectively in convergence rate and avoidance of premature convergence.
“The experimental results verify the modified strategies employed are capable of enhancing convergence performance of the standard GWO algorithm effectively with convergence rate and the avoidance of premature convergence.”
Quote in the paperSubstantial claim - Premisereasoning
Classical evaluation methods are not competent for complex nonlinear systems like RSS.
“For complex nonlinear system like RSS, classical evaluation methods are not competent.”
Quote in the paperSubstantial claim - Interpretationreasoning
Based on the IGWO algorithm, the proposed IGWO-SVR method is capable of optimizing SVR parameters continuously.
“Based on the IGWO algorithm, the proposed IGWO-SVR method is capable of optimizing SVR parameters continuously.”
Quote in the paperSubstantial claim - Interpretationown data
The more concentrated MSE distribution verifies the stability of the proposed IGWO-SVR approach.
“Meanwhile, the distribution of MSE is more concentrated, verifying the stability of the proposed approach.”
Quote in the paperSubstantial claim - Interpretationown data
The result in Experiment I on eight benchmark datasets confirms the excellent comprehensive performance of IGWO-SVR against the rest of methods.
“The result in Experiment I on eight benchmark datasets confirms the excellent comprehensive performance of IGWO-SVR against rest of methods.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 17
- The quote only partly states this claim. 9
- May combine two claims. 20
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe test functions are widely used to assess the performance of state-of-the-art algorithms.
“The test functions are widely used to assess the performance of state-of-the-art algorithms [28].”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [28] source
The Case Study section describes using ten UCI data sets to compare SVR algorithms, but it does not discuss test functions or say they are widely used. A search for benchmark test functions found no passage addressing that claim; page numbers were unavailable in our copy. (LLM, conf=0.75)
Experimental — accuracy not yet measured
Classified as probably not a substantial claim.
FindingreasoningA total of six indicators-coverage rate, revisit time, communication duration, response time, reconnaissance frequency, and transmission delay-are determined as data characteristics for the RSS effectiveness evaluation.
“Based on the specific application of the RSS and availability of data, a total of six indicators including coverage rate, revisit time, communication duration, response time, reconnaissance frequency, and transmission delay are determined as data characteristics.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataIGWO obtains global optimal objective values for functions f5, f9, and f11 while other methods fail.
“For example, the global optimal objective values of several functions ( , , and ) are obtained by the proposed IGWO algorithm triumphantly while the other methods fail to make it”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataOn the remaining five data sets, IGWO-SVR shows a significant difference compared with GWO-SVR.
“On the remaining five data sets, IGWO-SVR is with significant difference.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAlthough IGWO, MVO, SCA, and WOA converge at a similar speed in f7, the accuracy of IGWO is the best.
“Although IGWO, MVO, SCA, and WOA converge at a similar speed, the accuracy of IGWO is the best.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataRegarding MAE, the values for SVR, IGWO-SVR, BPNN, and GWO-SVR are 0.02, 0.006, 0.04, and 0.02, respectively.
“Regarding MAE, the values are 0.02, 0.006, 0.04, and 0.02, respectively.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataWhen IGWO-SVR is compared with GWO-SVR, there is no significant difference on datasets c, d, and f.
“When it comes to GWO-SVR, there is no significant difference on datasets c, d, and f .”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
FindingreasoningThe effectiveness evaluation index system of RSS has been established through the iterative process shown in Fig. 7.
“Through the process shown in Fig. 7, the effectiveness evaluation index system of RSS has been established.”
- Also stated in: § Determination of the evaluation index hierarchy · plain
“Finally, a layered decomposition indicator system for evaluating the effectiveness of RSS is obtained, as shown in Fig. 8.”
Quote in the paperSubstantial claim- Also stated in: § Determination of the evaluation index hierarchy · plain
Probably not a substantial claim: may not pass S4 (based).
Findingnone givenEach of the four operational effectiveness indicators can be decomposed into multiple quantifiable individual performance indicators.
“Each of the above indicators can be decomposed into multiple quantifiable individual performance indicators.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataThe R2 between the predicted value and the actual value for IGWO-SVR reaches 99.7%.
“The between the predicted value and the actual value reaches 99.7%.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataThe distribution of MSE for IGWO-SVR is more concentrated than for the other methods on datasets b, e, f, and h.
“Meanwhile, the distribution of MSE is more concentrated, verifying the stability of the proposed approach.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe proposed method achieves optimum evaluation accuracy and corresponding SVR parameters.
“Finally, the method achieves optimum evaluation accuracy and corresponding SVR parameters.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataFor GWO-SVR, the optimal parameters are penalty factor C = 5.34, Gauss kernel parameter σ = 1.0921, and insensitive loss function ε = 0.517.
“For GWO-SVR, the penalty factor C = 5.34, the parameter of Gauss kernel function σ = 1.092 1 and the insensitive loss function ε = 0.517.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn multimodal functions f9, f10, and f11, IGWO converges to the global optimum at about 200 iterations, faster than compared algorithms.
“In multimodal functions f 9 , f 10 , and f 11 , IGWO converges to the global optimum solution as the iteration is about 200, which is faster than the algorithms in comparison.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe running time of PSO and MVO is shorter than IGWO in f1, f2, and f4 with a slight difference.
“It should be noted that the running time of PSO and MVO is shorter than the proposed IGWO in f 1 , f 2 , and f 4 with a slight dif-”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingnone givenFour operational effectiveness indicators-signal reconnaissance capability, imaging reconnaissance capability, information transmission capability, and reconnaissance information processing capability-are established for RSS.
“Four operational effectiveness indicators: signal reconnaissance capability, imaging reconnaissance capability, information transmission capability, and reconnaissance information processing capability are established, respectively.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn f3, WOA, GWO, and IGWO have similar performance, while IGWO is slightly superior in accuracy.
“In f 3 , WOA, GWO, and IGWO have similar performance, while IGWO is slightly superior in accuracy.”
Quote in the paperNot a substantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataIGWO-SVR obtains the best score in RMSE, MAE, and R2.
“IGWO-SVR obtains the best score in RMSE, MAE, and .”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataFor the remaining datasets, the computational cost of IGWO-SVR is competitive.
“For rest of datasets, the consequence of IGWO-SVR is also competitive.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Findingown dataAccording to Fig. 12, the proposed IGWO-SVR method wins the first place in absolute error.
“According to Fig. 12, the proposed method wins the first place.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataIGWO outperforms standard GWO and other compared algorithms in most test functions.
“According to Table 3, in most test functions, the proposed method has significantly better performance than the standard GWO algorithm.”
- Also stated in: § Function · plain
“In summary, IGWO has advantages in most test functions.”
Quote in the paperSubstantial claim- Also stated in: § Function · plain
May combine two claims.
InterpretationreasoningIGWO with opposition-based learning, mutation operator, and differential convergence factor is proposed to escape local optima and relieve premature convergence of GWO.
“The IGWO algorithm with opposition-based learning strategy, mutation operator, and differential convergence factor is proposed to escape from local optima and relieve the premature convergence of the GWO algorithm.”
- Also stated in: § Abstract · plain
“In the proposed IGWO algorithm, the opposition-based learning strategy is adopted to increase the probability of avoiding the local optima, the mutation operator is used to escape from premature convergence and differential convergence factors are applied to increase the rate of convergence.”
Quote in the paperSubstantial claim- Also stated in: § Abstract · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenIn standard GWO, the balance between exploration and development is controlled by parameter a, which decreases linearly over [0,2].
“In standard GWO, the balance between exploration and development capabilities is controlled by parameter a, which decreases linearly over [0,2].”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe experimental results confirm that IGWO-SVR is superior to other methods in terms of prediction accuracy and convergence stability.
“The experimental results above confirm that IGWO-SVR is superior to other methods in terms of prediction accuracy and convergence stability.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningTo ensure reliability of results, all comparison algorithms uniformly set the maximum population size to 30 and the maximum number of iterations to 500.
“To ensure the reliability of the results, all comparison algorithms uniformly set the maximum population size to 30 and the maximum number of iterations to 500.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisereasoningThe choice of an appropriate radius parameter is a key issue in parameter selection of the RBF core SVR model.
“The choice of the appropriate radius parameter is a key issue in parameter selection of radial basis function (RBF) core SVR model.”
Quote in the paperSubstantial claimMay combine two claims.
PremisereasoningStandard GWO has poor population diversity due to its simple search mechanism, resulting in a high probability of premature convergence on multimodal problems.
“The diversity of population is usually poor due to the simple search mechanism, resulting in a high probability in premature convergence when dealing with multimodal problems.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisereasoningThe opposition-based learning strategy increases the probability of finding better solutions and enhances global exploitation and local exploration.
“Therefore, if the current solution is local optimal, then the algorithm successfully jumps out of it, which will increase the probability of finding better solutions.As a result, the global exploitation and local exploration of the population can be effectively enhanced.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [39] source
May combine two claims.
Premisenone givenStandard GWO's control parameter decreases linearly, leading to a restricted population distribution range.
“Meanwhile, the control parameter decreases linearly, leading to the restricted population distribution range.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenIn order to pursue accuracy in prediction, the integrated method sacrifices a fraction of stability of SVR; IGWO-SVR realizes a great balance in this term.
“Actually, in order to pursue accuracy in prediction, the integrated method sacrifices a fraction of stability of SVR.Regarding this term, IGWO-SVR realizes a great balance.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenThe radius parameter of the RBF kernel has a great influence on the learning performance of SVR.
“σ where the radius parameter of the kernel function has a great influence on the learning performance of SVR.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenOptimization of SVR is a typical multi-parameter optimization problem in which obtaining a balance between exploration and exploitation is vital.
“The optimization of SVR is a typical multi-parameter optimization problem, in which it is of vital importance of obtaining balance between exploration and exploitation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenTraditional evaluation methods have low evaluation efficiency.
“Second, the efficiency of evalua-tion is low.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Premisenone givenThe kernel function adopts a radial basis function with strong generalization ability.
“The kernel function adopts a radial basis function with strong generalization ability.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationGWO is a biological heuristic optimization method derived from simulating the social hierarchy and hunting mechanism of gray wolf, proven to have a more reasonable global optimal search mechanism and suitable for parameter optimization.
“GWO is a biological heuristic optimization method derived from simulating the social hierarchy and hunting mechanism of gray wolf in nature, which has been proven to have a more reasonable global optimal search mechanism and suitable for processing parameter optimization problems [36].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [36] source
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningThe proposed IGWO-SVR method can realize nonlinear fitting of complex systems, obtain deep relationships implicit in data, and achieve prediction and evaluation of effectiveness.
“It can realize the nonlinear fitting of complex systems and obtain the deep relationship implicit in data, and achieve the prediction and evaluation of effectiveness.”
Quote in the paperNot a substantial claim- Rests on an assumption: For the RSS studied in this work, the objective function space of effectiveness evaluation is so complicated that it cannot be described by an analytical formula.
- Rests on an assumption: The essence of the effectiveness evaluation process is to solve a multi-objective input nonlinear equation.
May combine two claims.
PremisecitationGWO has very few parameters and requires no derivation information in the initial search.
“Also it has very few parameters, and no derivation information is required in the initial search, thus GWO is used to optimize SVR.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [36] source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationSVR follows the principle of structural risk minimization, considering confidence range and empirical risk to achieve global optimization at the same time.
“SVR follows the principle of structural risk minimization, considering the range of confidence and empirical risk to achieve global optimization at the same time [33].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33] source
Classified as probably not a substantial claim.
Study design and conductreasoningFor each test function, thirty runs are conducted independently to reduce the negative effect of randomness.
“For each test function, thirty runs are conducted independently to reduce the negative effect of randomness.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Premisenone givenTraditional evaluation methods have the limitation that subjective influence cannot be avoided, leading to an impact on assessment accuracy.
“First, subjective influence cannot be avoided, leading to an impact on the accuracy of the assessment.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe SVR-based evaluation method avoids the influence of subjectivity and obtains higher evaluation accuracy.
“The proposed method not only avoids the influence of subjectivity, but also obtains a higher evaluation accuracy.”
Quote in the paperSubstantial claim
The paper relies on this without support.
For the RSS studied in this paper, the number of evaluation objects is so limited that it is difficult to obtain a large amount of usable historical data.
“For RSS studied in this paper, the number of evaluation object is so limited that it is difficult to obtain a large amount of usable historical data.”
The paper relies on this without support.
SVR has fewer parameters and faster running speed on small samples.
“In comparison, SVR has fewer parameters and faster running speed on small samples.”
The paper relies on this without support.
The setting of SVR parameters has a large impact on accuracy and generalization performance, especially when dealing with high-dimensional data.
“The setting of parameters has large impact on accuracy and generalization performance of SVR, especially when dealing with high-dimensional data.”
The paper relies on this without support.
The performance of SVR is deeply influenced by the penalty factor, kernel type, and other parameters.
“Considering the performance of SVR is influenced by the penalty factor, kernel type, and other parameters deeply”
The paper relies on this without support.
GWO has a special ability to strike the right balance between exploration and exploitation.
“The special capability to strike the right balance between exploration and exploitation is precisely the advantage of GWO”
The paper relies on this without support.
The effectiveness and connotation measurement framework of RSS are still unclear.
“However, the effectiveness and connotation measurement framework of RSS are still unclear.”
The paper relies on this without support.
For the RSS studied in this work, the objective function space of effectiveness evaluation is so complicated that it cannot be described by an analytical formula.
“For the RSS studied in this work, the objective function space of effectiveness evaluation is so complicated that cannot be described by analytical formula.”
The paper relies on this without support.
Traditional evaluation methods have defects dealing with nonlinear evaluation under small sample conditions, and are incompetent for effectiveness evaluation of RSS.
“Traditional evaluation methods have defects dealing with nonlinear evaluation under small sample conditions, thus these methods are incompetent for effectiveness evaluation of RSS.”
The paper relies on this without support.
Due to spatiotemporal dynamic characteristics of RSS, satellite applications are constrained by satellite system orbits and combat units, resulting in vagueness and uncertainty of RSS's operational effectiveness.
“Meanwhile, due to the spatiotemporal dynamic characteristics of RSS, the satellite applications are constrained by satellite system orbits and combat units, resulting in vagueness and uncertainty of RSS's operational effectiveness.”
The paper relies on this without support.
The main ideas of effectiveness evaluation and machine learning are similar.
“The main ideas of effectiveness evaluation and machine learning are similar.”
The paper relies on this without support.
The essence of the effectiveness evaluation process is to solve a multi-objective input nonlinear equation.
“Based on this, the essence of the effectiveness evaluation process is to solve a multi-objective input nonlinear equation, which can be described by the following model:”
The paper relies on this without support.
The simulation data under specific operational scenarios adequately represent RSS operational effectiveness for the purpose of verifying the IGWO-SVR model.
“Data in experiment are derived from simulation under specific operational scenarios, as shown in Fig. 9.”
The paper relies on this without support.
The TOPSIS-derived effectiveness values are a valid ground truth for training and testing the IGWO-SVR model.
“TOPSIS method is applied to obtain the effectiveness of RSS according to procedures in Section 4.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Reported RMSE is smaller than MAE
MajorFor the same prediction errors, root mean squared error cannot be smaller than mean absolute error. The IGWO-SVR row reports 0.000935 versus 0.006358, and the BPNN row also reverses this required ordering.
“| IGWO-SVR | 0.000 935 | 0.006 358 | 0.997 35 | 2.484 | | BPNN | 0.035 732 | 0.039 750 | 0.871 58 | 3.389 |”
“RMSE denotes expected root formula of the square of difference between evaluation results and actual value obtained after inputting each sample data into the model.”
Reported effectiveness values exceed the TOPSIS range
MajorThe paper uses TOPSIS closeness as the effectiveness value. Its stated formula divides a nonnegative distance by the sum of two nonnegative distances, so the value cannot exceed 1, yet the sample data include 2.0857.
“1 0.617 8 0.380 3 0.653 3 0.949 0 0.358 8 0.998 7 2.085 7”
“Obtaining the closeness of each sample to the ideal solution as the performance value of the evaluation sample, the formula is as follows: c i = d - i d + i + d - i .(20)”
The f8 optimum uses five terms for a 30-dimensional sum
MinorThe stated f8 function sums one identically bounded contribution per dimension and has dimension 30. Its listed optimum instead multiplies the per-term optimum by 5.
“f 8 f 8 (x) = n ∑ i=1 -x i sin ( √ |x i | ) 30 [-500,500]”
“-418.9829×5”
Another algorithm also attains the claimed exclusive optimum
MinorThe text says other methods fail to attain the global optimum for f9, but Table 3 reports an average of exactly zero for GWO as well as IGWO. Table 2 lists zero as the optimum for f9.
“the global optimal objective values of several functions ( , , and ) are obtained by the proposed IGWO algorithm triumphantly while the other methods fail to make it”
“f 9 Average 52.406 5 1.036 6 2.014 3 1.627 7 5.68e-15 1.767 7 0 0”
Dataset d has an impossible reported MSE variation
MinorMSE cannot be negative. Across 20 nonnegative accuracies with mean 6.10e-05, the sample standard deviation cannot exceed about 2.73e-04; the IGWO-SVR entry reports 5.08e-04.
“d 8.70e-03 8.30e-03 6.10e-05 5.08e-04 1.78e-02 2.60e-03 6.80e-03 8.19e-04”
“For each method the procedure repeats twenty times under the same conditions.”
Cites
Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2013.12.007 · Cited by 20,065 · see citing works
The Whale Optimization Algorithm
Mirjalili, S., & Lewis, A. (2016) · Advances in Engineering Software · doi:10.1016/j.advengsoft.2016.01.008 · Cited by 14,829 · see citing works
An overview of statistical learning theory
Vapnik, V. N. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788640 · Cited by 6,305 · see citing works
SCA: A Sine Cosine Algorithm for solving optimization problems
Mirjalili, S. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.12.022 · Cited by 5,727 · see citing works
Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm
Mirjalili, S. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.07.006 · Cited by 4,661 · see citing works
Multi-Verse Optimizer: a nature-inspired algorithm for global optimization
Mirjalili, S., Mirjalili, S. M., & Hatamlou, A. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-1870-7 · Cited by 2,938 · see citing works
Support vector regression with chaos-based firefly algorithm for stock market price forecasting
Kazem, A., Tashnizi, E. S., Hussain, F. K., Saberi, M., & Hussain, F. K. (2012) · Applied Soft Computing · doi:10.1016/j.asoc.2012.09.024 · Cited by 467 · see citing works
An efficient modified grey wolf optimizer with Lévy flight for optimization tasks
Heidari, A. A., & Pahlavani, P. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.06.044 · Cited by 465 · see citing works
Modified Grey Wolf Optimizer for Global Engineering Optimization
Mittal, N., Singh, U., & Sohi, B. S. (2016) · Applied Computational Intelligence and Soft Computing · doi:10.1155/2016/7950348 · Cited by 389 · see citing works
Zhu, A., Xu, C., Li, Z., et al. (2015) · Journal of Systems Engineering and Electronics · doi:10.1109/jsee.2015.00037 · Cited by 231 · see citing works
Self-citationA novel hybrid GWO-SCA approach for optimization problems
Singh, N., & Singh, S. B. (2017) · Engineering Science and Technology, an International Journal · doi:10.1016/j.jestch.2017.11.001 · Cited by 214 · see citing works
Parameter optimization of support vector regression based on sine cosine algorithm
Li, S., Fang, H., & Liu, X. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.08.038 · Cited by 178 · see citing works
Short-Term Wind Speed or Power Forecasting With Heteroscedastic Support Vector Regression
Hu, Q., Zhang, S., Yu, M., et al. (2015) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2015.2480245 · Cited by 160 · see citing works
GWO: a review and applications
Negi, G., Kumar, A., Pant, S., & Ram, M. (2021) · International Journal of System Assurance Engineering and Management · doi:10.1007/s13198-020-00995-8 · Cited by 132 · see citing works
Wang, X., Zhao, H. J., Han, T., et al. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.02.037 · Cited by 112 · see citing works
Rui, J., Zhang, H., Zhang, D., et al. (2019) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2019.06.014 · Cited by 100 · see citing works
Hybrid Grey Wolf Optimizer Using Elite Opposition-Based Learning Strategy and Simplex Method
Zhang, S., Luo, Q., & Zhou, Y. (2017) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026817500122 · Cited by 94 · see citing works
A SVR-GWO technique to minimize flyrock distance resulting from blasting
Armaghani, D. J., Koopialipoor, M., Bahri, M., Hasanipanah, M., & Tahir, M. M. (2020) · Bulletin of Engineering Geology and the Environment · doi:10.1007/s10064-020-01834-7 · Cited by 85 · see citing works
Zhu, S., Qiu, X., Yin, Y., Fang, M., Liu, X., Zhao, X., & Shi, Y. (2019) · Atmospheric Pollution Research · doi:10.1016/j.apr.2019.03.004 · Cited by 84 · see citing works
Yu, Z. W., Shi, X., Zhou, J. P., et al. (2019) · Natural Resources Research · doi:10.1007/s11053-019-09593-3 · Cited by 83 · see citing works
Li, W., Shi, Q., Sibtain, M., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3023143 · Cited by 82 · see citing works
Evaluation of GA-SVR method for modeling bed load transport in gravel-bed rivers
Roushangar, K., & Koosheh, A. (2015) · Journal of Hydrology · doi:10.1016/j.jhydrol.2015.06.006 · Cited by 62 · see citing works
Predicting vacant parking space availability: an SVR method with fruit fly optimisation
Fan, J., Hu, Q., & Tang, Z. (2018) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2018.5031 · Cited by 61 · see citing works
Cao, W., Liu, X., & Ni, J. (2020) · IEEE Access · doi:10.1109/access.2020.2993267 · Cited by 49 · see citing works
GWO-BP Neural Network Based OP Performance Prediction for Mobile Multiuser Communication Networks
Xu, L., Wang, H., Lin, W., Gulliver, T. A., & Le, K. N. (2019) · IEEE Access · doi:10.1109/access.2019.2948475 · Cited by 43 · see citing works
Zhu, S., Sun, J., Liu, Y., et al. (2020) · Chemosphere · doi:10.1016/j.chemosphere.2020.126474 · Cited by 40 · see citing works
Application of GWO-SVM Algorithm in Arc Detection of Pantograph
Li, B., Luo, C., & Wang, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3025714 · Cited by 36 · see citing works
A Nonlinear Flux Linkage Model for Bearingless Induction Motor Based on GWO-LSSVM
Li, K., Cheng, G., Sun, X., & Yang, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2905247 · Cited by 30 · see citing works
Amroune, M., Musirin, I., Bouktir, T., et al. (2017) · Energies · doi:10.3390/en10111693 · Cited by 22 · see citing works
Bessedik, S. A., Djekidel, R., & Ameur, A. (2018) · IET Science, Measurement & Technology · doi:10.1049/iet-smt.2017.0486 · Cited by 21 · see citing works
Feng, Z.-K., Liu, S., Niu, W.-J., Liu, Y., Luo, B., Miao, S.-M., & Wang, S. (2019) · IEEE Access · doi:10.1109/access.2019.2949582 · Cited by 20 · see citing works
Wang, Z., Yang, C., Oh, S., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3030083 · Cited by 14 · see citing works
Shao, R., Fang, Z., Gao, S., et al. (2019) · IEEE Access · doi:10.1109/access.2019.2949595 · Cited by 11 · see citing works
Yan-jing, L. (2011) · Systems Engineering - Theory & Practice · Cited by 9 · see citing works
Short-term load forecasting based on support vector regression with improved grey wolf optimizer
Jiang, F., Peng, Z., & He, J. (2018) · doi:10.1109/icaci.2018.8377565 · Cited by 8 · see citing works
Improved Grey Wolf Algorithm Based on Nonlinear Control Parameter Strategy
Zhang, M., Long, D., Wang, X., et al. (2019) · doi:10.1109/cac48633.2019.8997505 · Cited by 6 · see citing works
Li, W., & Zhang, J. (2019) · Journal of Autonomous Intelligence · doi:10.32629/jai.v2i1.37 · Cited by 6 · see citing works
The Regression Prediction Analysis of Grouting Concretion Stone’s Strength Based on SVR
Lei, J. S., Chen, J. F., Cao, X. T., et al. (2013) · Advanced materials research · doi:10.4028/www.scientific.net/amr.859.171 · Cited by 4 · see citing works
Damage Assessment Simulation of Shipborne High-Energy Laser Weapon
Peng, C., Lu, F., & Xing, C. (2017) · doi:10.1109/ihmsc.2017.180 · Cited by 4 · see citing works
Zheng, L., Jiawei, Z., Hai-bao, H., et al. (2019) · doi:10.1145/3362125.3362156 · Cited by 4 · see citing works
Model Construction of Efficiency Evaluation of Family Farms by DEA
Xiao, E., & Qi, C. (2015) · Journal of Interdisciplinary Mathematics · doi:10.1080/09720502.2015.1040658 · Cited by 3 · see citing works
Stockbridge Damper Identification Of Overhead Power Lines Based On HOG Feature And GWO-SVM
Liu, Y., Fan, S., Feng, Y., & Tang, L. (2019) · 2019 IEEE 3rd Conference on Energy Internet and Energy System Integration (EI2) · doi:10.1109/ei247390.2019.9061742 · Cited by 3 · see citing works
The capability spaces complexity measure method of Weapon System of Systems
Zhao, Q., Hu, W., Xia, B., et al. (2020) · 2020 IEEE International Systems Conference (SysCon) · doi:10.1109/syscon47679.2020.9275859 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 44 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- Wei, 2016, Efficiency evaluation research of missile weapon system based on the ADC mode, Advances in Engineering Research, 180, 1227
- Yann, 2015, Deep learning, Nature, 521, 436
- Li, 2015, Combat effectiveness prediction model using elman feedback network, Journal of System Simulation, 27, 43
- Ren, 2017, Effectiveness prediction of weapon equipment system based on stacked auto-encoding, Military Operations Research and System Engineering, 31, 61
- Cheng, 2011, Evaluation method of operational effectiveness based on support vector machine, Systems Engineering and Electronics, 33, 1055
- Cui, 2012, Operational effectiveness evaluation of weapon under influence of marine environment based on v-SVR, Computer Technology and Development, 22, 20
- Hatta, 2018, Recent studies on optimization method of grey wolf optimizer (GWO): a review (2014–2017), Artificial Intelligence Review, 18, 1
- Simpson, 2015, The ant lion optimizer, Advances in Engineering Software, 8, 80
- Han, 2021, Related information ming of space reconnaissance equipment system index, Journal of System Simulation, 33, 2372
Cited by
Sorted by citations
Two-stage deep reinforcement learning method for agile optical satellite scheduling problem
Liu, Z., Xiong, W. H., Jia, Z., & Han, C. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-024-01667-x · Cited by 6 · see citing works
Self-citationA Multi-Pointer Network for Multiple Agile Optical Satellite Scheduling Problem
Liu, Z., Xiong, W., Han, C., & Zhao, K. (2024) · Aerospace · doi:10.3390/aerospace11100792 · Cited by 4 · see citing works
Self-citationEvaluation of the effectiveness of emergency medical rescue equipment system based on cloud model
Lu, C., Zhao, X., Yu, M., et al. (2025) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2025.112120 · Cited by 3 · see citing works
Liu, J., & Jian, P. (2024) · doi:10.1109/iaeac59436.2024.10503823 · Cited by 1 · see citing works
“To solve the shortcomings of conventional approaches, [6] proposed a support vector regression (SVR) based evaluation method, and the parameter optimization is performed by the improved grey wolf optimizer.”
MethodSun, Y., Li, S., Song, H., et al. (2026) · Advanced Engineering Informatics · doi:10.1016/j.aei.2026.104663
Qiu, Y., & Liu, Y. (2026) · International Journal of Aeronautical and Space Sciences · doi:10.1007/s42405-026-01191-x
Unsupervised LPI Signals Detection Under Clutter Background Based on Autoencoding Vision Transformer
Mao, S., Wu, X., & Fan, X. (2025) · doi:10.1109/icsps66615.2025.11347655
“The battlefield space is filled with densely intertwined electromagnetic signals [1-3], when implementing signal reconnaissance in such a complex electromagnetic environment, it is highly possible that the signals are drowned due to the interference of clutter and noise.”
- Authors
- Han, C., Xiong, W., Xiong, M., & Liu, Z.
- Affiliations
- Space Engineering University (CN)
- Venue
- Journal of Systems Engineering and Electronics
- Published
- 2023-12
- Volume
- 34
- Issue
- 6
- Pages
- 1626-1644
- ISSN
- 1004-4132 (ISSN-L)
- OpenAlex
- W4319934199
- Cited by
- 7
- References
- 44
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3
- FWCI
- 0.55
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Journal of Systems Engineering and Electronics (publishedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Measurement and Detection Methods
- Physical Sciences › Engineering › Aerospace Engineering › Military Defense Systems Analysis
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
- Keywords
- operational performance evaluation, support vector regression, improved grey wolf optimizer, parameter optimization, opposition-based learning, weapon system of systems, evaluation index system, combat simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review