Optimal Blocked and Split-Plot Designs Ensuring Precise Pure-Error Estimation of the Variance Components
Open accessAbstract
Textbooks on response surface methodology generally stress the importance of lack-of-fit tests and estimation of pure error. For lack-of-fit tests to be possible and other inference to be unbiased, experiments should allow for pure-error estimation. Therefore, they should involve replicated treatments. While most textbooks focus on lack-of-fit testing in the context of completely randomized designs, many response surface experiments are not completely randomized and require block or split-plot structures. The analysis of data from blocked or split-plot experiments is generally based on a mixed regression model with two variance components instead of one. In this article, we present a novel approach to designing blocked and split-plot experiments which ensures that the two variance components can be efficiently estimated from pure error and guarantees a precise estimation of the response surface model. Our novel approach involves a new Bayesian compound D-optimal design criterion which pays attention to both the variance components and the fixed treatment effects. One part of the compound criterion (the part concerned with the treatment effects) is based on the response surface model of interest, while the other part (which is concerned with pure-error estimates of the variance components) is based on the full treatment model. We demonstrate that our new criterion yields split-plot designs that outperform existing designs from the literature both in terms of the precision of the pure-error estimates and the precision of the estimates of the factor effects.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
4 of 19 cited sources checked · 3 supported · 0 flagged · accuracy not yet measured
- Interpretationreasoning
The new-criterion designs differ fundamentally from the split-plot designs of Vining et al. (2005), Parker et al. (2006), Kowalski et al. (2002), and Kowalski et al. (2006).
“Consequently, the designs produced by the new criterion are fundamentally dierent from the split-plot designs proposed by Vining et al. (2005), Parker et al. (2006), Kowalski et al. (2002) and Kowalski et al. (2006).”
Quote in the paperSubstantial claim1 of 3 sources checked - Premisecitation
Those split-plot designs replicate a few treatments many times, mainly center and/or axial points, with much replication inside whole plots.
“These designs involve many replicates of a limited number of treatments (namely, the treatments corresponding to center points and/or axial points).Much of the replication in these designs is within the whole plots.”
Quote in the paperSubstantial claim1 of 3 sources checked- cites Vining et al. (2005) source
- cites Parker et al. (2006) source
Section 5.1 describes adding subplot-center replicates to balance a Box–Behnken design, and Section 5.2 says subplot centers can be added within each whole plot. But Section 5.3 says its base crossed design has no replicates, while Section 6 describes a design without replication. The paper therefore supports within-whole-plot center replication as an option, not the general characterization that these designs contain many replicates concentrated at center and/or axial points. (LLM, conf=0.85)
Experimental — accuracy not yet measured - cites Kowalski et al. (2002) source
- Findingown data
For estimating fixed effects, the benchmark design's D-efficiency relative to the optimal design is smaller than 60%.
“For estimating the xed eects, the benchmark design's D-eciency relative to the optimal design is therefore smaller than 60%.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingown data
The value of the new Bayesian composite criterion is 2.2965 for the optimal design versus 1.7961 for the benchmark design.
“The value for the new Bayesian composite criterion equals 2.2965 for the optimal design versus 1.7961 for the benchmark design.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingown data
Of the three screening designs, the OriCC/TradD design has the largest log|M| value, 45.2136.
“Of the three design under consideration, the `OriCC/TradD' design has the largest log |M| value, 45.2136.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingreasoning
The benchmark design's efficiency relative to the optimal design amounts to 69% when estimating the two variance components using pure error.
“The benchmark design's eciency relative to that of the optimal design amounts to 69%”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingown data
In the 24-run split-plot screening example, the designs produced by the traditional D-optimality criterion and by the original composite criterion were equivalent.
“It turned out that the designs produced by the traditional D-optimality criterion and by the original composite criterion were equivalent, so that we are left with three designs to compare.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingown data
Designs obtained using w=p/(p+2) provide a better trade-off between the number of replicates and the number of distinct treatments than designs using w=1/2.
“The designs obtained using w = p/(p+2) in the new criterion provide a better trade-o between the number of replicates and the number of distinct treatments.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingown data
The optimal design involves very little within-whole-plot replication of treatments, despite the large number of replicates; most replication occurs between whole plots.
“Another major dierence between our design and the benchmark design is that our design involves very little within-whole-plot replication of treatments, despite the large number of replicates.”
- Also stated in: § 4.1 · plain
“The table shows that only four of the 25 treatments are duplicated within a given whole plot, and that most of the replication occurs between whole plots.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Also stated in: § 4.1 · plain
- Findingreasoning
For the ceramic pipe experiment, the REML information matrix under the full treatment model N_t is non-singular for both the optimal design and the benchmark design.
“Due to the fact that the optimal design and the benchmark design for the ceramic pipe experiment involve many replicates, their REML information matrices under the full treatment model, N t , are non-singular.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The random block or whole-plot effects γ are normally distributed with mean zero and covariance σ²γ I_b.
- The authors state this as an assumption: The random errors ε are normally distributed with mean zero and covariance σ² I_n.
- The authors state this as an assumption: The random block or whole-plot effects and the random errors are independent.
- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingown data
Using w=1/2 in the new criterion often leads to designs involving the maximum number of replicates, n-p, and the minimum number of distinct treatments, p.
“We found that using w = 1/2 often leads to designs involving the maximum number of replicates, n -p, and the minimum number of distinct treatments, p.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Findingreasoning
The new designs also replicate many distinct treatments only a few times each.
“Another feature is that many dierent treatments are replicated a limited number of times.”
Quote in the paperSubstantial claim - Findingreasoning
For two of the three screening designs in this section, the log determinants of N and Nt are equal.
“For two of the three designs in this section”
- Also stated in: § Treatment · plain
“the log |N| and log |N t | values are equal.”
Quote in the paperNot a substantial claim - Also stated in: § Treatment · plain
- Findingown data
One example showed that replicating many distinct treatments gave more precise fixed-effect estimates and pure-error variance components than replicating a few treatments repeatedly.
“One of our illustrations showed that replicating many dierent treatments produced much more precise xed-eect estimates and pure-error variance components than replicating a few treatments many times.”
Quote in the paperSubstantial claim - Findingown data
In contrast, the benchmark design has only 48.6% D-efficiency relative to the new-criterion design.
“Conversely, the D-eciency for the benchmark design is 48.6% only, relative to the design produced by”
Quote in the paperSubstantial claim - Findingown data
The requirement to compute pure-error estimates in the 48-run blocked example comes at a small loss in D-efficiency for fixed-effects estimation: log determinant of M drops from 63.9012 to 62.8366, relative D-efficiency 95.1%.
“As shown in Table 9, the log determinant of M drops from 63.9012 to 62.8366, which implies that the design allowing for pure-error estimates has a relative D-eciency of 95.1% for the xed eects in the response surface model.”
Quote in the paperSubstantial claim - Findingown data
In the 48-run split-plot example, the design from the original composite and traditional D-optimality criteria contains replication, which did not occur in earlier examples.
“For the 48-run split-plot example, also the design produced by the original composite criterion and the traditional D-optimality criterion involves replication.This did not happen in any of the previous examples.”
Quote in the paperNot a substantial claim - Findingcitation
Even the original composite criterion of Mylona et al. (2014) does not lead to inclusion of replicates in the 48-run blocked design.
“So, even the original composite criterion of Mylona et al. (2014), which takes into account the variance component estimation, does not lead to the inclusion of replicates in the design.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Mylona et al. (2014) source
- Premisecitation
A different specification of the response surface model (and thus model matrix X) results in different estimates of the variance components when using REML with the response surface model.
“A weakness of this approach is that a dierent specication of the response surface model, and thus a dierent specication of the model matrix X, results in dierent estimates of the variance components.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Goos et al. (2006)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The new composite D-optimality criterion is guaranteed to produce designs that involve replicated treatments because N_t is singular for any design without sufficient replication for pure-error estimates.
“Since the information matrix N t is singular for any design that does not have sucient replication to obtain pure-error estimates, the new composite D-optimality criterion is guaranteed to produce designs that involve replicated treatments.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The random block or whole-plot effects γ are normally distributed with mean zero and covariance σ²γ I_b.
- The authors state this as an assumption: The random errors ε are normally distributed with mean zero and covariance σ² I_n.
- The authors state this as an assumption: The random block or whole-plot effects and the random errors are independent.
- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Interpretationreasoning
The new criterion guarantees precise estimation of the response surface model.
“and guarantees a precise estimation of the response surface model”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Premisenone given
The composite D-optimality criterion of Mylona et al. (2014) generally produces designs with insufficient replicates to allow for pure-error estimation of the variance components.
“Moreover, generally, the composite Doptimality criterion of Mylona et al. (2014) produces designs with insucient replicates to allow for pure-error estimation of the variance components.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Mylona et al. (2014) source
- Interpretationreasoning
The new composite D-optimality criterion ensures that both variance components in blocked and split-plot experiments can be efficiently estimated from pure error.
“we present a novel approach to designing blocked and split-plot experiments which ensures that the two variance components can be eciently estimated from pure error”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
- Premisecitation
Applying REML to the full treatment model yields variance component estimates that are robust against misspecification of the response surface model.
“To obtain estimates for the variance components that are robust against misspecication of the response surface model, Gilmour et al. (2019) suggest starting from the full treatment model”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Gilmour et al. (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationreasoning
The equal-interest composite criterion in (12) is a special case of the criterion in (8) when w=p/(p+2).
“The equal-interest composite criterion in ( 12) is a special case of the criterion in (8) in the event w is set to p/(p + 2).”
Quote in the paperNot a substantial claim - Premisereasoning
The new method differs from Cao et al. (2017) and Trinca and Gilmour (2017) by adjusting the ordinary D-optimality criterion to ensure that the variance components are well estimated.
“Our new method diers from those of Cao et al. (2017) and Trinca and Gilmour (2017), who build on the ideas in Gilmour and Trinca (2012) for completely randomized designs, in the sense that we adjust the ordinary D-optimality criterion to ensure that the variance components are well estimated.”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationreasoning
Because the two 48-run blocked designs have similar log|N| values, they should yield roughly equally precise variance component estimates under REML applied to the response surface model rather than the full treatment model.
“Note also that the log |N| values of the two designs studied here are close.Both designs therefore will produce about equally precise variance component estimates when applying REML to the response surface model instead of the full treatment model.”
Quote in the paperSubstantial claim - Interpretationreasoning
The 48-run blocked design optimizing the new composite criterion allows lack of fit to be quantified with quite a few degrees of freedom because the response surface model has 21 fixed effects.
“As there are 21 xed eects in the response surface model, the design optimizing the new composite criterion allows lack of t to be quantied with quite a few degrees of freedom.”
Quote in the paperSubstantial claim - Interpretationreasoning
The new criterion uniquely requires efficient pure-error variance component estimates.
“A unique feature of the new criterion is that it requires ecient pure-error estimates of the variance components.”
Quote in the paperSubstantial claim - Interpretationreasoning
The paper shows that N equals Nt for any minimum support design, defined as having p distinct design points where p is the number of β parameters.
“we show that N, the REML information matrix for the variance components when using the response surface model, is equal to N t , the REML information matrix for the variance components when using the treatment model, for any design involving p distinct design points, where p is the number of parameters in β.”
Quote in the paperSubstantial claim - Interpretationnone given
The new criterion ensures enough replication to obtain model-independent variance component estimates with low variance.
“That is, the new criterion guarantees sucient replication to calculate model-independent estimates of the variance components with low variances.”
Quote in the paperSubstantial claim - Interpretationreasoning
Unlike most D-optimal methods, the new composite Bayesian criterion considers both experimental factor effects and variance components.
“Unlike most D-optimal design approaches in the literature, the new criterion pays attention to the estimation of the eects of the experimental factors, as well as to the estimation of the variance components.”
Quote in the paperSubstantial claim - Interpretationown data
The simulation study concludes that misspecifying part of a response surface model can severely affect variance component estimates when pure-error estimates are not used, specifically for components tied to the misspecified part.
“The rst is that misspecifying part of a response surface model can have dramatic consequences for the variance component estimates in the event no pure-error estimates are used, for the variance components corresponding to the misspecied model part.”
Quote in the paperSubstantial claim - Interpretationreasoning
Therefore, N does not depend on the factor levels chosen for the experiment.
“As a consequence, N is independent of the factor levels used in the experiment.”
Quote in the paperSubstantial claim - Interpretationreasoning
The new-criterion design should give substantially better pure-error estimates than the original-composite-criterion design.
“So, the design produced by the new criterion will yield substantially better pure-error estimates than the design produced by the original composite criterion.”
Quote in the paperSubstantial claim
- May combine two claims. 32
- The quote only partly states this claim. 2
- Classified as probably not a substantial claim. 3
May combine two claims.
InterpretationreasoningThe resulting designs enable unbiased and efficient inferences and provide efficient pure-error estimates of the variance components required by the lack-of-fit test proposed by Goos and Gilmour (2017).
“The resulting designs enable unbiased and ecient inferences and provide ecient pure-error estimates of the variance components required by the lackof-t test proposed by Goos and Gilmour (2017) for data from blocked and split-plot experiments.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Goos and Gilmour (2017) source
- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
InterpretationreasoningThe full treatment model does not exhibit any lack of fit, and the variance component estimates resulting from it are pure-error estimates.
“Therefore, the model does not exhibit any lack of t, and the variance component estimates resulting from it are pure-error estimates.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Gilmour et al. (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Goos and Gilmour (2017) source
- The authors state this as an assumption: The effects of runs and treatment factors are additive, so there is no block-by-treatment interaction.
- The authors state this as an assumption: The randomization of the experiment is correct.
- The authors state this as an assumption: The random block or whole-plot effects γ are normally distributed with mean zero and covariance σ²γ I_b.
- The authors state this as an assumption: The random errors ε are normally distributed with mean zero and covariance σ² I_n.
- The authors state this as an assumption: The random block or whole-plot effects and the random errors are independent.
May combine two claims.
Findingown dataIn the classical design, four pairs of whole plots have two treatments in common; in the design produced by the new criterion, every pair of whole plots has at most one treatment in common, and every whole plot contains exactly two of the duplicated treatments.
“In the classical design, four pairs of whole plots have two treatments in common.For instance, treatments 1 and 21 both appear in whole plots 1 and 4.This is shown in Table 5.In the design produced by the new criterion, every pair of whole plots has at most one treatment in common, while every whole plot contains exactly two of the duplicated treatments.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
Findingown dataBoth the design produced by the new composite criterion and the classical design involve 16 treatments and eight replicates, with eight of the 16 treatments duplicated.
“Both the design produced by the new composite criterion and the classical design involve 16 treatments and thus eight replicates.More specically, eight of the 16 treatments are duplicated.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
Findingown dataFor the ceramic pipe experiment, the log determinant of the information matrix for fixed effects M is 36.7513 for the optimal design and 29.0329 for the benchmark design when η=1 and σ2=1.
“The log determinant of the information matrix for the xed eects in the response surface model, M, is 36.7513for the optimal design when η = 1 and σ 2 = 1, and 29.0329 for the benchmark design.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The random block or whole-plot effects γ are normally distributed with mean zero and covariance σ²γ I_b.
- The authors state this as an assumption: The random errors ε are normally distributed with mean zero and covariance σ² I_n.
- The authors state this as an assumption: The random block or whole-plot effects and the random errors are independent.
- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
Findingown dataThe assignment of duplicates to whole plots in the classical design is better for pure-error variance component estimation than the assignment in the design produced by the new criterion, since log|N_t| is larger for the former (0.5754) than for the latter (0).
“The assignment of the duplicates to the whole plots in the classical design is better for the pure-error variance component estimation than the assignment in the design produced by the new criterion, since the log |N t | value is larger for the former design (0.5754) than for the latter (0).”
Quote in the paperSubstantial claim- The authors state this as an assumption: The random block or whole-plot effects γ are normally distributed with mean zero and covariance σ²γ I_b.
- The authors state this as an assumption: The random errors ε are normally distributed with mean zero and covariance σ² I_n.
- The authors state this as an assumption: The random block or whole-plot effects and the random errors are independent.
- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
Findingown dataThe existing criteria produce a design that is best for fixed effects estimation, but it has no replicates and its information matrix for pure-error variance component estimation is singular.
“The existing criteria produce a design that is best for xed eects estimation, but it has no replicates and its information matrix for pure-error variance component estimation is singular (so, its log |N t | value goes to -∞).”
Quote in the paperSubstantial claim- The authors state this as an assumption: The random block or whole-plot effects γ are normally distributed with mean zero and covariance σ²γ I_b.
- The authors state this as an assumption: The random errors ε are normally distributed with mean zero and covariance σ² I_n.
- The authors state this as an assumption: The random block or whole-plot effects and the random errors are independent.
- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims. The quote only partly states this claim.
FindingreasoningThe new criterion yields split-plot designs that outperform existing designs from the literature in terms of precision of pure-error estimates and precision of estimates of factor effects.
“We demonstrate that our new criterion yields split-plot designs that outperform existing designs from the literature both in terms of the precision of the pure-error estimates”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
Findingnone givenIn the new-criterion designs, replication is entirely between blocks for blocked designs or between whole plots for split-plot designs.
“One striking feature of the designs produced by the new criterion and reported in this paper is that all replication occurs between the blocks (for blocked designs) or between the whole plots (for split-plot designs).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe 48-run blocked design optimizing the new criterion has no within-block replication, but four pairs of whole plots share two treatments.
“It does not involve within-block replication, but, as in the classical design in the previous illustration, four pairs of whole plots have two treatments in common.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataBecause of the nine duplicated points, the full-treatment-model REML information matrix is non-singular; its log determinant is 0.8344 for η=1 and σ2=1, much lower than 2.2794 for the new-criterion design.
“Due to the nine duplicated points, the REML information matrix for the full treatment model is non-singular.Its log determinant is 0.8344 when η = 1 and σ 2 = 1, which is substantially smaller than the value 2.2794 for the design produced by the new composite criterion.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe new-criterion 48-run split-plot design has no within-whole-plot replication; two whole plots share three treatments, and five other whole-plot pairs share two.
“The design does not have any replication within whole plots.Two of the eight whole plots have three treatments in common, while ve other pairs of whole plots have two treatments in common.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThat benchmark design has 39 distinct treatments, with nine duplicated; all duplication is between whole plots.
“The design has 39 distinct treatments, nine of which are duplicated.All duplication is between the whole plots, rather than within the whole plots.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningThe benchmark 48-run blocked design does not involve any replicates and therefore does not allow pure-error variance component estimation.
“Despite the fact it involves 48 runs, which is substantially more than the number of xed eects, the benchmark design does not involve any replicates.The benchmark design therefore does not allow pure-error variance component estimation.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningFor the 48-run blocked design based on the new composite criterion, the REML information matrix under the full treatment model Nt is non-singular; for the benchmark design it is not, due to lack of replicated treatments.
“For the design based on the new composite criterion, the REML information matrix under the full treatment model, N t , is non-singular.Due to lack of replicated treatments, this is not the case for the benchmark design.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the 48-run blocked example, the new-criterion design contains 31 treatments, with 17 appearing twice.
“The design optimizing the new criterion involves 31 treatments, 17 of which are duplicated.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn the simulation, the mean σ2 estimate under REML with the response surface model is much larger than the true value 10, whereas under REML with the full treatment model it is near 10.
“The mean estimate for σ 2 by far exceeds the true value of 10 when REML is applied to the response surface model, while it is close to 10 when REML is applied to the full treatment model.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn the 48-run split-plot example, the new-criterion design contains 30 treatments, with one appearing three times and 16 appearing twice.
“The split-plot design optimizing the new criterion involves 30 treatments, one of which is triplicated and 16 of which are duplicated.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataIn that design, nearly all replicated points are factorial points, and no center run is replicated.
“Almost all replicated points are factorial points.None of them is the center run.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisereasoningThe new designs aim to be optimal for all parameters, whereas Cao et al. (2017) and Trinca and Gilmour (2017) aim to be optimal only for fixed effects and only stratum by stratum.
“Our designs aim to be optimal for all parameters, whereas theirs aim to be optimal only for xed eects and only stratum by stratum.”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
Interpretationnone givenThe new method is generic: it works for blocked and split-plot experiments, handles main-effects, main-effects-plus-interactions and full quadratic response surface models, and works for any number of blocks/whole plots and block/whole-plot sizes dictated by logistics.
“Our method is generic in that it works for blocked and split-plot experiments, it is able to handle main-eects, maineects-plus-interactions and full quadratic response surface models, and it works for any number of blocks/whole plots and block/whole-plot sizes dictated by the logistics of the experiment.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe benchmark design is inferior to the optimal design both in precision of pure-error estimates and in precision of fixed effects estimates.
“The benchmark design is thus inferior both in terms of the precision of the pure-error estimates and in terms of the precision of the xed eects estimates.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
Classified as probably not a substantial claim.
Interpretationnone givenThe composite D-optimality criterion focuses on precise estimation of fixed treatment effects and precise pure-error estimation of variance components.
“we suggest a composite D-optimality criterion that focuses on precise estimation of the xed treatment eects, as well as on precise pure-error estimation of the variance components.”
Quote in the paperSubstantial claim- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
PremisereasoningThe information matrix N in the existing composite criterion of Mylona et al. (2014) depends on the assumed response surface model through P and X, so using its determinant to quantify information on variance components is not model-robust.
“The main weakness of the composite D-optimality criterion of Mylona et al. (2014) is that the information matrix for the variance components, N, depends on the assumed response surface model through the matrices P and X.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Mylona et al. (2014) source
May combine two claims.
InterpretationreasoningDesigns obtained using w=1/2 do not allow any additional model terms to be studied or lack of fit to be tested.
“While this is ideal when it comes to pure-error estimation of the variance components, these designs do not allow any additional model terms to be studied or lack of t to be tested.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
InterpretationcitationTo obtain high-quality pure-error estimates of both variance components in a split-plot model, it is advisable to replicate primarily between whole plots rather than within whole plots.
“This implies that, to obtain high-quality pure-error estimates of both variance components in a splitplot model, it is advisable to replicate primarily between whole plots rather than within whole plots.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Trinca and Gilmour (2017) source
- The authors state this as an assumption: The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
May combine two claims.
InterpretationreasoningWhen the response surface model is not correctly specified, REML variance component estimates from it are generally biased and can damage the whole analysis.
“As soon as that is no longer true, the variance component estimates obtained by applying REML to the response surface model will generally be biased, which may have detrimental consequences for the entire data analysis.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationown dataThis is the third example where assigning replicates in this way helps obtain precise pure-error variance component estimates.
“This is the third illustration in which this type of assignment of the replicates turns out to be useful to obtain precise pure-error variance component estimates.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe largest σ2γ precision gap occurs for the traditional/original design, explained by its large log|N| versus log|Nt| difference (2.9882 vs 0.8344).
“That the dierence in precision is largest for the design produced by the traditional D-optimality criterion and the original composite criterion can be explained by the large dierence in that design's log |N| and log |N t | values (which equal 2.9882 and 0.8344, respectively; see Table 11).”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe new criterion combines two information matrices: one for fixed factor effects from a traditional response surface model, and one for pure-error variance component estimates from REML applied to the full treatment model.
“The new criterion is a composite criterion.One component of the criterion is the information matrix for the xed factor eects, based on a traditional response surface model.”
- Also stated in: § 6 Discussion · plain
“The second component is the information matrix for the pure-error variance component estimates.That information matrix is based on the application of restricted or residual maximum likelihood (REML) to the full treatment model.”
Quote in the paperSubstantial claim- Also stated in: § 6 Discussion · plain
May combine two claims.
Interpretationown dataThe two 48-run split-plot designs differ little in log|M|, so the new-criterion design is highly D-efficient for fixed effects, with 97.9% D-efficiency relative to the benchmark.
“The dierence in log |M| value between the two designs is small, which means that the design produced by the new criterion is highly D-ecient for estimating the xed eects too.Its D-eciency relative to that of the benchmark design is 97.9%.”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Interpretationown dataFor the 48-run split-plot designs, log|N| exceeds log|Nt|, which implies that variance components estimated by REML under the response surface model are more precise than pure-error estimates from the full treatment model.
“One nal observation concerningTable 11 is that the log |N| values are larger than the log |N t | values.This implies that the variance components obtained by applying REML to”
Quote in the paperNot a substantial claim- The authors state this as an assumption: The response surface model is correctly specified for the reported log|N| values.
May combine two claims.
InterpretationreasoningFor designs saturated for the response surface model, N and Nt are equal, so log|N| and log|Nt| have the same value.
“For such designs, N and N t are equal, so that log |N| and log |N t | have the same value.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe new designs resemble balanced incomplete block designs, which are optimal for unstructured treatments and use a small number of replicates for every treatment.
“The newly generated designs are akin to balanced incomplete block designs, which are known to be optimal designs for a set of unstructured treatments and involve a limited number of replicates for all treatments.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe arrangement of four pairs of whole plots sharing two treatments was found to produce precise pure-error estimates in the previous split-plot example and also arises in the new blocked example.
“This kind of arrangement was found to produce precise pure-error estimates in the previous example (involving a split-plot experiment).It is interesting that it arises in the new example (involving a blocked experiment) as well.”
Quote in the paperNot a substantial claim
The authors state this as an assumption.
The effects of runs and treatment factors are additive, so there is no block-by-treatment interaction.
“assuming additivity between the runs and the treatment factors' eects when calculating pure-error estimates”
“A consequence of this assumption is that there is no block-by-treatment interaction.”
The authors state this as an assumption.
The randomization of the experiment is correct.
“follows immediately from the assumption of treatment-run additivity and a correct randomization”
The authors state this as an assumption.
The random block or whole-plot effects γ are normally distributed with mean zero and covariance σ²γ I_b.
“We further assume that γ ∼ N 0 b , σ 2 γ I b”
The authors state this as an assumption.
The random errors ε are normally distributed with mean zero and covariance σ² I_n.
“∼ N (0 n , σ 2 I n )”
The authors state this as an assumption.
The random block or whole-plot effects and the random errors are independent.
“and that γ and are independent.”
The authors state this as an assumption.
The variance ratio η follows a lognormal prior distribution with parameters µ=0 and σ=0.75.
“we use a lognormal prior distribution for the variance ratio”
“The designs we present in this article were all constructed using the parameter values µ = 0 and σ = 0.75 for the lognormal prior distribution.”
The authors state this as an assumption.
The response surface model is the model any researcher will be primarily interested in.
“because we believe that this is the model any researcher will be primarily interested in.”
The authors state this as an assumption.
The response surface model is correctly specified for the reported log|N| values.
“Of course, the log |N| values reported here assume that the response surface model is correctly specied.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Duplicated whole-plot treatment is misidentified
MinorThe text names treatment 29 as part of a duplicated whole plot with treatments 19, 21 and 25. Table 2 instead places treatment 27 with those three treatments in whole plots 5 and 6; treatment 29 appears only in whole plot 7.
“a whole plot involving treatment 19, 21, 25 and 29”
“19 0 0 0 0 1 1 0 0 0 0 0 2 21 0 0 0 0 1 1 0 0 0 0 0 2 25 0 0 0 0 1 1 0 0 0 0 0 2 27 0 0 0 0 1 1 0 0 0 0 0 2 29 0 0 0 0 0 0 1 0 0 0 0 1”
Discussion denies within-whole-plot replication shown earlier
MinorThe discussion says every replicate in the reported designs occurs between blocks or whole plots. The paper earlier explicitly states that four treatments in its Table 2 design are duplicated within a whole plot.
“all replication occurs between the blocks (for blocked designs) or between the whole plots (for split-plot designs).”
“only four of the 25 treatments are duplicated within a given whole plot”
Cites
Searle, S. R., Casella, G., & McCulloch, C. E. (1992) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316856 · Cited by 1,926 · see citing works
Wheeler, R. E., Atkinson, A. C., & Donev, A. N. (1993) · Technometrics · doi:10.2307/1270278 · Cited by 1,455 · see citing works
Optimum Experimental Designs, with SAS
Atkinson, A. C., Donev, A. N., & Tobias, R. D. (2007) · doi:10.1093/oso/9780199296590.001.0001 · Cited by 1,269 · see citing works
Response Surfaces, Mixtures, and Ridge Analyses
Box, G. E. P., & Draper, N. R. (2006) · Wiley series in probability and statistics · doi:10.1002/0470072768 · Cited by 625 · see citing works
Response Surfaces, Mixtures and Ridge Analyses
Box, G., & Draper, N. (2007) · doi:10.1198/tech.2007.s698 · Cited by 519
Optimal Bayesian design applied to logistic regression experiments
Chaloner, K. M., & Larntz, K. (1989) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(89)90004-9 · Cited by 455 · see citing works
The Coordinate-Exchange Algorithm for Constructing Exact Optimal Experimental Designs
Meyer, R. K., & Nachtsheim, C. J. (1995) · Technometrics · doi:10.1080/00401706.1995.10485889 · Cited by 393 · see citing works
Approximation of bayesian efficiency in experimental choice designs
Bliemer, M. C. J., Rose, J. M., & Hess, S. (2008) · Journal of Choice Modelling · doi:10.1016/s1755-5345(13)70024-1 · Cited by 213 · see citing works
Response Surface Methods for Bi-Randomization Structures
Letsinger, J. D., Myers, R. H., & LENTNER, M. N. (1996) · Journal of Quality Technology · doi:10.1080/00224065.1996.11979697 · Cited by 144 · see citing works
Response Surface Designs within a Split-Plot Structure
Vining, G. G., Kowalski, S. M., & Montgomery, D. C. (2005) · Journal of Quality Technology · doi:10.1080/00224065.2005.11980310 · Cited by 122 · see citing works
Split-Plot Designs and Estimation Methods for Mixture Experiments With Process Variables
Kowalski, S. M., Cornell, J. A., & Vining, G. G. (2002) · Technometrics · doi:10.1198/004017002753398344 · Cited by 112 · see citing works
Experiments: Planning, Analysis, and Parameter Design Optimization
Lenth, R. V. (2002) · Journal of the American Statistical Association · doi:10.1198/jasa.2002.s473 · Cited by 82 · see citing works
A Candidate-Set-Free Algorithm for Generating D-Optimal Split-Plot Designs
Jones, B., & Goos, P. (2007) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/j.1467-9876.2007.00581.x · Cited by 78 · see citing works
Self-citationOptimum Design of Experiments for Statistical Inference
Gilmour, S. G., & Trinca, L. A. (2012) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/j.1467-9876.2011.01000.x · Cited by 69 · see citing works
Self-citationPractical Inference from Industrial Split-Plot Designs
Goos, P., Langhans, I., & Vandebroek, M. L. (2006) · Journal of Quality Technology · doi:10.1080/00224065.2006.11918603 · Cited by 57 · see citing works
Self-citationClasses of Split‐plot Response Surface Designs for Equivalent Estimation
Parker, P. A., Kowalski, S. M., & Vining, G. G. (2006) · Quality and Reliability Engineering International · doi:10.1002/qre.771 · Cited by 44 · see citing works
Tailor-Made Split-Plot Designs for Mixture and Process Variables
Goos, P., & Donev, A. N. (2007) · Journal of Quality Technology · doi:10.1080/00224065.2007.11917699 · Cited by 40 · see citing works
Self-citationOptimal versus orthogonal and equivalent‐estimation design of blocked and split‐plot experiments
Goos, P. (2006) · Statistica Neerlandica · doi:10.1111/j.1467-9574.2006.00333.x · Cited by 36 · see citing works
Self-citationYu, J., Goos, P., & Vandebroek, M. L. (2010) · Transportation Research Part B Methodological · doi:10.1016/j.trb.2010.02.005 · Cited by 35 · see citing works
Self-citationMylona, K., Goos, P., & Jones, B. (2014) · Technometrics · doi:10.1080/00401706.2013.818579 · Cited by 31 · see citing works
Self-citationSome practical advice on polynomial regression analysis from blocked response surface designs
Gilmour, S. G., & Trinca, L. A. (2000) · Communication in Statistics- Theory and Methods · doi:10.1080/03610920008832601 · Cited by 31 · see citing works
Self-citationStaggered-Level Designs for Experiments With More Than One Hard-to-Change Factor
Arnouts, H., & Goos, P. (2012) · Technometrics · doi:10.1080/00401706.2012.715834 · Cited by 15 · see citing works
Self-citationSplit-Plot and Multi-Stratum Designs for Statistical Inference
Trinca, L. A., & Gilmour, S. G. (2017) · Technometrics · doi:10.1080/00401706.2017.1316315 · Cited by 12 · see citing works
Self-citationQuadrature Methods for Bayesian Optimal Design of Experiments With Nonnormal Prior Distributions
Goos, P., & Mylona, K. (2017) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2017.1285778 · Cited by 12 · see citing works
Self-citationKowalski, S. M., Vining, G. G., Montgomery, D. C., et al. (2006) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/j.1467-9876.2006.00556.x · Cited by 12 · see citing works
$$\mathcal{D}$$ -optimal Minimum Support Mixture Designs in Blocks
Goos, P., & Donev, A. N. (2006) · Metrika · doi:10.1007/s00184-006-0059-6 · Cited by 10 · see citing works
Self-citationTesting for Lack of Fit in Blocked, Split-Plot, and Other Multi-Stratum Designs
Goos, P., & Gilmour, S. G. (2017) · Journal of Quality Technology · doi:10.1080/00224065.2017.11918000 · Cited by 9 · see citing works
Self-citationDP-Optimality in Terms of Multiple Criteria and Its Application to the Split-Plot Design
Cao, Y., Wulff, S. S., & Robinson, T. J. (2017) · Journal of Quality Technology · doi:10.1080/00224065.2017.11918183 · Cited by 9 · see citing works
Optimal Designs for Nonlinear Models with Random Block Effects
Wang, X., Yang, M., & Zheng, W. (2017) · Statistica Sinica · doi:10.5705/ss.202017.0020 · Cited by 4 · see citing works
I-Optimal Versus D-Optimal Split-Plot Response Surface Designs
Jones, B., & Goos, P. (2012) · Journal of Quality Technology · doi:10.1080/00224065.2012.11917886
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Multi-objective optimisation of split-plot designs
Borrotti, M., Sambo, F., & Mylona, K. (2022) · Econometrics and Statistics · doi:10.1016/j.ecosta.2022.04.001 · Cited by 9 · see citing works
Self-citationEnergy-Efficiency Assessment and Improvement—Experiments and Analysis Methods
Costa, N. R. P., & Fontes, P. (2020) · Sustainability · doi:10.3390/su12187603 · Cited by 5 · see citing works
Split‐plot experiments with replicated runs in pharmaceutical synthesis
Otava, M., & Mylona, K. (2024) · Quality and Reliability Engineering International · doi:10.1002/qre.3676 · Cited by 4 · see citing works
Self-citationYang, Y., Jin, G., Zhengqiang, P., et al. (2021) · Journal of Systems Engineering and Electronics · doi:10.23919/jsee.2021.000103 · Cited by 2 · see citing works
A note on the output of a coordinate-exchange algorithm for optimal experimental design
Strouwen, A., & Goos, P. (2019) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2019.103819 · Cited by 2 · see citing works
Self-citationA blocked staggered-level design for an experiment with two hard-to-change factors
Goos, P., Brickey, K., & Chen, Y. B. (2024) · Journal of Quality Technology · doi:10.1080/00224065.2023.2290560 · Cited by 1 · see citing works
“Goos and Vandebroek (2001, 2003, 2004), Jones and Goos (2007a), Mylona, Goos, and Jones (2014) and Mylona, Gilmour and Goos (2017) constructed D-optimal split-plot designs using point-exchange and coordin-ate-exchange algorithms, while Jones and Goos (2012b) compared the performance of I-optimal…”
Self-citationTwo-Level Parallel Flats Split-Plot Designs
Wang, C., Mee, R. W., & Edwards, D. J. (2026) · Technometrics · doi:10.1080/00401706.2026.2672594
Pure error REML for analyzing data from multi-stratum designs
Gilmour, S. G., Goos, P., & Großmann, H. (2025) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2025.108322
Self-citationResponse Surface Designs for General Crossed and Nested Multi-Stratum Structures
Trinca, L. A., & Gilmour, S. G. (2025) · Technometrics · doi:10.1080/00401706.2025.2583393
Self-citationOptimal Experimental Designs for Process Robustness Studies
Chen, Y. B., Francq, B., & Goos, P. (2025) · Technometrics · doi:10.1080/00401706.2025.2580633
Self-citationBorn, M., & Goos, P. (2024) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2024.108028
Self-citationSukpancharoen, S., Phetyim, N., Krittasin, C., et al. (2022) · Advances in energy research and development · doi:10.3233/aerd220034
Chen, P.-Y., Chen, R., Li, J.-P., et al. (2022) · Quality Engineering · doi:10.1080/08982112.2022.2072226
- Authors
- Mylona, K., Gilmour, S. G., & Goos, P.
- Affiliations
- King's College London (GB)
- University of Antwerp (BE)
- Corresponding author
- Goos, Peter
- Venue
- Technometrics
- Publisher
- Informa UK Limited
- Published
- 2019-06-21
- Volume
- 62
- Issue
- 1
- Pages
- 57-70
- ISSN
- 0040-1706 (ISSN-L)
- 1537-2723
- OpenAlex
- W2946960690
- Cited by
- 13
- References
- 29
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 3 · 2022: 3 · 2021: 1 · 2020: 1 · 2019: 1
- FWCI
- 1.07
- Type
- journal article
- Language
- en
- Open access
- green
- lirias.kuleuven.be
- Licence
- other-oa
- Locations
- Technometrics (publishedVersion)
- Lirias (submittedVersion, other-oa)
- Research Portal (King's College London) (submittedVersion, other-oa)
- Funders
- Banco Santander (600371)
- University of Southampton
- European Commission (600371)
- Ministerio de Educación, Cultura y Deporte (CEI‐15‐17)
- Ministerio de Economía y Competitividad (COFUND2013‐40258)
- Universidad Carlos III de Madrid (COFUND2013-40258, 600371)
- H2020 European Research Council
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Social Sciences › Decision Sciences › Management Science and Operations Research › Simulation Techniques and Applications
- Keywords
- blocked designs, split-plot design, variance components, response surface methodology, lack-of-fit test, mixed model analysis, experimental design optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-02.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-02.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review