On the logic and purpose of significance testing.

“…the obtained sample result: “Rejection of a given null hypothesis implies the rejection not only of the particular null value in question, but also of all of the values in the end of the distribution that is opposite to the end in which the observed value resides” (Cortina & Dunlap, 1997, p. 168).”

“Devlin (1998) agreed, pointing out how probability theory is useful when it is necessary to make crucial decisions about whether to endorse a particular treatment or intervention.”

“A straw man is an argument set up so that it is easily refuted (Cortina and Dunlap 1997).”

“…not H0 (3) Correction (3) now highlights another of the problems: The second premise simply affirms that an unlikely result just happened (also Cortina and Dunlap, 1997), something which is neither precluded by the first premise (no contrapositive ensues; Adams, 1988) nor formally conducive…”

“Important fundamental defenses can be found in (Dooling and Danks 1975; Mulaik, Raju, and Harshman 1997; Cortina and Dunlap 1997; Hagen 1997; Senn 2001) and, implicit, in (Miller 2009).”

“…not draw attention to the fact that constructing confidence intervals relies on the same estimated parameters, standard errors, and alpha levels that generate tests of significance and are therefore subject to the same interpretations and limitations as a significance test (Cortina & Dunlap, 1997).”

“In such context, H0 provides a precise statistical hypothesis for carrying out the test and, because the actual parameter (1) is unknown, it only provides informative value via its rejection (Fisher, 1954), H0 acting merely as a “straw man” (Cortina and Dunlap, 1997).”

“Readers should note we are examining a population, not a sample, and statistical significance is less applicable when generalizing to a larger population (Cortina & Dunlap, 1997).”

“To demonstrate that the method cannot directly estimate MMPI-2-RF cumulative elevation rates in a psychologically healthy population, we refer the reader to the computer program created by Crawford et al. (2007) to estimate cumulative rates of abnormal scores in a normative sample.”

“2A, the CSA-panned erythrocytes exhibited over 4-fold increase in binding to the placental cells when compared to the CD36-panned cells (p-value of 0.004 [22]).”

“However, Cortina and Dunlap ( 1997) pointed out that the application of the modus tollens in Cohen's example is not representative of its use in psychology, in that the consequent ('that person is probably not a member of Congress') is true, irrespective of whether or not the antecedent is true.”

“Caution should be used, however, in interpreting the lack of evidence for positive effect of competence- and sharing-based advice seeking (Cortina & Dunlap, 1997; Cortina & Folger, 1998).”

“From this perspective, Type I error rates are contingent on hypothetical sampling distributions based on formally specified hypotheses, rather than “actual” sampling distributions based on “actual” test procedure s (e.g., Cortina & Dunlap, 1997, pp. 166 – 167; see also Fisher, 1956, p. 44).”

“The null hypothesis significance test is a hybrid of the two; it follows the NP-test procedurally and Fisher philosophically (Cortina and Dunlap 1997; Hubbard 2004; Johnstone et al. 1986; Perezgonzalez 2015; Spielman 1978).”

“If it were only of interest to know whether or not one forecast model is better more often than the other, without regard for which one, then a twosided test would be performed, which would require adjusting the size of the test in each direction from a to a/2 (Cortina and Dunlap 1997; Cox et al. 1977; Meehl 1967; Tuk…”

“…the abovementioned pitfalls in data interpretation, they are still subject to some of the same types of problems as the p-values and classic NHST (Cortina and Dunlap, 1997; Nickerson, 2000; Belia et al., 2005; Wagenmakers et al., 2008; Kruschke, 2013; Kruschke and Liddell, 2017a; Hoekstra et…”

“org 83 | Page [7].”

“Results are reported in terms of the magnitude and statistical significance of change scores as clinical and statistical significance are not necessarily equivalent (288,289).”