Evidence‐based evaluation of the cumulative effects of ecosystem restoration

May combine two claims.

Complex linkages between restorative actions and ecosystem responses at a landscape scale make evaluations problematic, and most programs focus on monitoring and analysis.

“Complex linkages between restorative actions and ecosystem responses at a landscape scale make evaluations problematic and most programs focus on monitoring and analysis.”

• Also stated in: § IntroductIon · plain

  “In complex aquatic ecosystems, cause and effect are difficult to measure directly, particularly when multiple actions involving many organizations are implemented over large areas (Barnas et al. 2015).”

• cites Barnas et al. 2015 sourcePartly supported

  The “Implications for species recovery” section says that high variability and missing data make restoration-effectiveness evaluations difficult at the scale of salmon populations. But the Abstract says projects often have little or no post-project monitoring, contrary to the claim that most programs focus on monitoring and analysis. Page numbers were not available in our copy. (LLM, conf=0.88)

  Experimental — accuracy not yet measured

May combine two claims.

The stock-specific density of juvenile salmon in restoring wetland habitats is a negative function of the distance of the natal stream from the wetland, with proportionally greater representation from local stocks than distant stocks in LCRE wetlands.

“there is proportionally greater representation from local stocks than more distant stocks in LCRE wetlands (Roegner et al. 2010, 2012, Teel et al. 2014).”

• cites Roegner et al. 2010 sourceNot checked — no full text of the source
• cites Roegner et al. 2012 sourcePartly supported

  Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

  Experimental — accuracy not yet measured
• cites Teel et al. 2014 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The LCRE is affected by upstream dam operations, runoff conditions, hatchery practices, and other factors and by ocean conditions and tributary watersheds.

“The LCRE is affected by upstream dam operations, runoff conditions, hatchery practices, and other factors and by ocean conditions and tributary watersheds (Naiman et al. 2012).”

• cites Naiman et al. 2012 sourcePartly supported

  The Setting section (page unavailable) says dams and water storage altered downstream flows and food webs in the estuary; the Rivers section describes effects of hatchery releases. The paper also discusses tributary inputs and marine-derived food, but the passages do not establish that ocean conditions affect the lower Columbia River estuary or specifically identify runoff conditions as a driver. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

May combine two claims.

Stomach contents at rkm 15 are an integrative measurement of prior feeding in the LCRE rather than a point estimate, given rapid travel times (>50 km/d) of yearling juvenile salmon through the LCRE, though residence times can be longer by life history strategy.

“Stomach contents at rkm 15 should not be considered a point estimate, but rather an integrative measurement of prior feeding in the LCRE, given the rapid travel times (>50 km/d) estimated for yearling juvenile salmon migrating through the LCRE (Harnish et al. 2012, Weitkamp et al. 2015), though residence times in the LCRE can be considerably longer according to life history strategy (Johnson et al”

• cites Harnish et al. 2012 sourceNot checked — no full text of the source
• cites Weitkamp et al. 2015 sourceSupported
• cites Johnson et al. 2015 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

River restoration and the management of endangered species and ecosystems have been criticized for insufficient monitoring, a lack of standardized approaches for evaluation, and complicated adaptive management plans the requirements of which are rarely fulfilled.

“River restoration and the management of endangered species and ecosystems have been criticized for insufficient monitoring, a lack of standardized approaches for evaluation, and complicated adaptive management plans the requirements of which are rarely fulfilled (Stankey et al. 2003, Jähnig et al. 2011, Morandi et al. 2014).”

• cites Stankey et al. 2003 sourcePartly supported

  In “Learning How to Learn” and “What’s Next?” (pages unavailable), Stankey et al. report limited systematic documentation and a failure to implement rigorous adaptive management under the Northwest Forest Plan. They also call for better-defined monitoring and evaluation. The paper does not establish the broader claim about river restoration generally or say that complicated plan requirements are rarely fulfilled. (LLM, conf=0.84)

  Experimental — accuracy not yet measured
• cites Jähnig et al. 2011 sourceNot checked — no full text of the source
• cites Morandi et al. 2014 sourceNot checked — no full text of the source

May combine two claims.

Prey communities are exceedingly patchy, and this is the case for dipterans in the LCRE.

“Prey communities are known to be exceedingly patchy (Winemiller et al. 2010), and this certainly is the case for dipterans in the LCRE (K.MacNeale, NOAA Fisheries, personal communication).”

• cites Winemiller et al. 2010 sourceSupported
• cites K.MacNeale, NOAA Fisheries, personal communicationNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The collection and evaluation of evidence in the approach is organized according to modes of accumulation identified by the CEQ, including nonlinear and cross-boundary effects of widely recognized importance in complex social-ecological systems like the salmon fisheries of the Pacific Northwest.

“The collection and evaluation of evidence in our approach is organized according to modes of accumulation identified by the CEQ (1997), including those such as nonlinear and cross-boundary effects that are of widely recognized importance in complex social-ecological systems like the salmon fisheries of the Pacific Northwest (Ostrom 2007).”

• cites CEQ 1997Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Ostrom 2007 sourcePartly supported

  The section headed “A Nested Framework for Analyzing Interactions and Outcomes of Linked SESs” describes social–ecological systems as nonlinear and cross-scale, supporting the general point attributed to Ostrom. The cited paper does not establish that these effects are important specifically in Pacific Northwest salmon fisheries; its fishery examples concern other settings. The sentence attributes the modes of accumulation to the CEQ, not to Ostrom. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

• AssumptionRests on an assumption: The collective effect of restoration across multiple sites is what is important to juvenile salmon.

May combine two claims.

Upon evaluation, the evidence was sufficient to infer cross-boundary, indirect, compounding, and delayed cumulative effects, and suggestive of nonlinear, landscape-scale, and spatial density effects.

“Upon evaluation, the evidence was sufficient to infer cross-boundary, indirect, compounding, and delayed cumulative effects, and suggestive of nonlinear, landscape-scale, and spatial density effects.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Productivity is substantial even in early-stage (<5 yr after hydrologic reconnection) restoring areas.

“While we did not use the biomass and prey data from restored sites in these calculations, we note that productivity is substantial even in these earlystage (<5 yr after hydrologic reconnection) restoring areas (Table 2).”

May combine two claims.

Synthesis of the lines of evidence demonstrated that hydrologic reconnection promoted macrodetritis export, prey availability, and juvenile fish access and feeding.

“Synthesis of the lines of evidence demonstrated that hydrologic reconnection promoted macrodetritis export, prey availability, and juvenile fish access and feeding.”

May combine two claims.

More than 60% of the land area of contributing watersheds was forested, a total area greater than 8000 km2.

“More than 60% of the land area of contributing watersheds was forested, a total area >8000 km 2 .”

Classified as probably not a substantial claim.

The land-cover change analysis used forest cover and impervious surface indicators at two scales: eight LCRE floodplain reaches and their contributing watersheds in Washington and Oregon.

“Therefore, we conducted a land-cover change analysis using forest cover and impervious surface as the indicators, at two scales relevant to restoration sites: the eight reaches of the LCRE floodplain and the contributing watersheds in the states of Washington and Oregon that are associated with each reach (i.e., tributaries to the LCRE) (Ke et al. 2013).”

• cites Ke et al. 2013Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

There were indications of positive responses in residence, prey, and diet at Crims Island, diet at the Grays River, and growth at Tenasillahe Island.

“There were, however, indications of positive responses in residence, prey, and diet at Crims Island, diet at the Grays River, and growth at Tenasillahe Island.”

May combine two claims.

The three historically diked and reconnected sites studied have transitioned to emergent marshes with inundation patterns conducive to fish access (main channel inundated to at least 50 cm depth at the mouth >95% of hours in a year) and little resemble diked pastures, though below-ground properties were not examined.

“The three historically diked and reconnected sites studied have transitioned to emergent marshes with inundation patterns conducive to fish access (i.e., the main channel of each site was inundated to a minimum depth of 50 cm at the mouth >95% of hours in a year) and have little resemblance to the diked pastures of today's landscape, though below-ground properties have not been examined (Diefender”

• cites Diefenderfer et al. 2013aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Evidence suggested causal relationships for nonlinear, landscape, and space-crowding effects, but was inadequate for examining time-crowding effects.

“Evidence suggested causal relationships for nonlinear, landscape, and space-crowding effects, but was inadequate for examining timecrowding effects.”

May combine two claims.

Of 24 data pairs comparing restoration and paired reference sites, evidence was sufficient to support the trajectory hypothesis in 3, suggestive in 10, inadequate in 6, and suggestive of no trend in 6 (all tide-gate replacements).

“Of the 24 data pairs, the evidence in 3 was sufficient to support the hypothesis, in 10 it was suggestive, in 6 it was inadequate, and in 6 (all tide-gate replacements) it suggested no trend (Table 4).”

Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

Repeating the searches in five ProQuest databases identified just one additional paper.

“texts identified just one additional paper.”

May combine two claims.

Nine studies supported growth or residence time and virtually no evidence against these indicators was reported; therefore evidence for both is highly consistent and suggestive of a causal relationship.

“Nevertheless, it should be noted that a total of nine studies supported growth or residence time and virtually no evidence against these salmon-response indicators was reported.Therefore, based on the scoring method and conclusion framework, evidence for both is highly consistent and suggestive of a causal relationship.”

May combine two claims.

The net change in forest cover in contributing watersheds was −189.0 km2 (2.3% net decrease), while cumulative forest cover loss was −642.7 km2.

“The net change in forest cover (the sum of forest gained and lost) in the contributing watersheds was -189.0 km 2 (2.3%net decrease), while the cumulative forest cover loss (the sum of all forest lost) in the same period was -642.7 km 2 .”

May combine two claims.

The evaluation documented sufficient evidence to infer causal relationships for cross-boundary effects, time lags, indirect effects, and compounding effects.

“The evaluation of evidence relative to seven cumulative effects categories (Table 1) documented sufficient evidence to infer causal relationships for cross-boundary effects, time lags, indirect effects, and compounding effects.”

Classified as probably not a substantial claim. May combine two claims.

The literature search returned 709 papers, of which 27 appeared to meet the three criteria; full-text examination reduced the total to 15.

“We examined all abstracts, and 27 of the 709 papers returned by the searches appeared to meet the three criteria:”

• Also stated in: § Evidence-based literature review · plain

  “Examination of the full text reduced the total to 15.”

May combine two claims.

Near the mouth of the river (rkm 15), 68% of juvenile steelhead, 56% of yearling Chinook salmon, and 52% of subyearling Chinook salmon were actively feeding.

“In contrast, near the mouth of the river (rkm 15), 68% of juvenile steelhead, 56% of yearling Chinook salmon, and 52% of subyearling Chinook salmon were actively feeding, indicating that fish forage while transiting the LCRE.”

May combine two claims.

Total urban area increase was 48.4 km2 (4.6%) in all contributing watersheds, primarily near major cities, and 8.3 km2 (2.5%) on the floodplain.

“Total increase in urban area was 48.4 km 2 (4.6% increase) in all contributing watersheds, occurred primarily in the vicinity of major cities, and was 8.3 km 2 (2.5% increase) on the floodplain.”

May combine two claims.

At Bonneville Dam, 5% of juvenile steelhead, 5% of yearling Chinook salmon, and 7% of subyearling Chinook salmon were actively feeding in upriver reaches based on stomach digestion state.

“Stomach fullness and diet data for fish sampled in the smolt bypass system at Bonneville Dam (rkm 234) indicated that 5% of juvenile steelhead, 5% of yearling Chinook salmon, and 7% of subyearling Chinook salmon were actively feeding in the reaches upriver based on the state of digestion of stomach contents (Fig. 4, Table 5).”

May combine two claims.

Plant cover evinces a time lag, trending away from before-restoration conditions but not toward reference site conditions.

“Plant cover evinces a time lag (Vesk et al. 2008), trending away from before-restoration conditions but not toward reference site conditions.”

• cites Vesk et al. 2008Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Applying the duplicate-data principles added three papers and removed four, leaving 15 papers.

“This approach led us to add three papers and remove four, leaving 15.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Eight world rivers were included in the selected literature set.

“Eight world rivers were included in this set.”

May combine two claims.

Mean aboveground biomass values were 600-1125 g dry m−2 for emergent marshes and 449-813 g dry m−2 for recently reconnected marshes.

“The mean aboveground biomass values for emergent marshes and recently reconnected marshes were 600-1125 and 449-813 g dry m -2 , respectively.”

May combine two claims.

In CEERP restoration reports, insufficient evidence was available to evaluate six of the fish indicator categories, and evidence for salmon presence was inconsistent as measured by abundance, density, or CPUE.

“In the CEERP restoration reports (Table 7), insufficient evidence was available to evaluate six of the fish indicator categories and evidence for the seventh, salmon presence, was inconsistent as measured by abundance, density, or CPUE (Table 9).”

May combine two claims.

On the floodplain, net change in forest cover was −13.3 km2 and cumulative forest cover loss was −17.7 km2.

“On the floodplain, the net change in forest cover was -13.3 km 2 and cumulative forest cover loss was -17.7 km 2 .”

May combine two claims.

Our initial review of the literature found evidence of salmon-estuarine habitat relationships but sparse literature about whether tidal wetland habitat restoration is benefiting ESA-listed Chinook, chum, coho, sockeye, and steelhead salmon.

“Our initial review of the literature found evidence of salmon-estuarine habitat relationships but sparse literature about the central question: Is tidal wetland habitat restoration benefiting ESA-listed species Chinook salmon (Oncorhynchus tshawytscha), chum salmon (O.keta), coho salmon (O.kisutch), sockeye salmon (O.nerka), and steelhead (O.mykiss)?”

May combine two claims.

About 3% of the 344-km2 recoverable LCRE floodplain area has been reconnected, and the model estimates this resulted in substantial increases in plant biomass and dipteran insects available to the salmon food web.

“About 3% of the 344-km 2 recoverable area of the LCRE floodplain has been reconnected and the model estimates that this resulted in substantial increases in plant biomass and dipteran insects available to the salmon food web (Table 3).”

May combine two claims.

Cross-boundary and indirect effects are demonstrated by fluxes between restoration sites and between restoration sites and the mainstem river and by consumption by juvenile salmon.

“Cross-boundary and indirect effects are demonstrated by these fluxes between restoration sites and between restoration sites and the mainstem river (Thom et al. 2012) and consumption by juvenile salmon.”

• cites Thom et al. 2012Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Although stressors on the ecosystem remain, the evidence supported the habitat-based and fish-based secondary hypotheses.

“Although stressors on the ecosystem remain, the evidence supported the habitat-based and fish-based secondary hypotheses.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Our study is the first application of an evidence-based review approach to large-scale ecosystem restoration.

“To our knowledge, our study is the first application of an evidencebased review approach to large-scale ecosystem restoration.”

May combine two claims.

Wetland-produced materials affect the 234-km lower mainstem Columbia River through multiple sources and pathways, having a compounding effect.

“Wetland-produced materials affect the 234-km lower mainstem Columbia River through multiple sources and pathways, that is, they have a compounding effect (Table 5) (Maier andSimenstad 2009, Thom et al. 2012).”

• cites Maier andSimenstad 2009Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Thom et al. 2012Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The conclusions of this evidence-based evaluation of the LCRE restoration program were quoted as one of three primary sources regarding estuary restoration as hydropower system mitigation in the ESA Section 7(a)(2) Supplemental Biological Opinion Consultation on Remand for Operation of the Federal Columbia River Power System.

“The conclusions of this evidence-based evaluation of the LCRE restoration program (Diefenderfer et al. 2013b) were quoted as one of three primary sources regarding estuary restoration as hydropower system mitigation in Section 3.2.1.2 of the ESA Section 7(a) (2), Supplemental Biological Opinion Consultation on Remand for Operation of the Federal Columbia River Power System (NMFS 2014: 323-324).”

• cites Diefenderfer et al. 2013bNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites NMFS 2014Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

Chironomids in fallout traps were more abundant between rkm 29 and 87 than between rkm 0 and 29 and were generally more abundant in emergent marshes than in forested marshes.

“For example, chironomids in fallout traps were more abundant between rkm 29 and 87 than between rkm 0 and 29 and were generally more abundant in emergent marshes than in forested marshes.”

May combine two claims.

Direct measurement of the cumulative effect of LCRE tidal wetland restoration on listed salmon populations would not be possible, necessitating an evidence-based approach.

“Therefore, we concluded that direct measurement of the cumulative effect of LCRE tidal wetland restoration on listed salmon populations would not be possible, necessitating an evidence-based approach.”

May combine two claims.

Restoration ecology is a science less than four decades old, and methods to achieve functional ecosystems similar to desired ecological endpoints are not well established.

“Yet, restoration ecology is a science less than four decades old and methods to achieve functional ecosystems similar to desired ecological endpoints are not well established (Menz et al. 2013).”

• cites Menz et al. 2013 sourceNot checked — no full text of the source

May combine two claims.

Despite long-term investments in restoring aquatic ecosystems, it has proven difficult to adequately synthesize and evaluate program outcomes, and no standard method has been adopted.

“Despite long-term investments in restoring aquatic ecosystems, it has proven difficult to adequately synthesize and evaluate program outcomes, and no standard method has been adopted.”

• Also stated in: § IntroductIon · plain

  “Thus, despite considerable investments in aquatic ecosystem restoration, numerous studies have concluded that consistent and comprehensive effectiveness evaluation continues to elude practitioners at geographic scales from site to regional and at governmental levels from local to federal, ultimately undermining justification of the costs expended and leaving program managers without science-based”

• cites NRC 2001Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Bernhardt et al. 2005 sourceNot checked — no full text of the source
• cites Morandi et al. 2014 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable).

This evidence-based approach will enable restoration in complex coastal, riverine, and tidal-fluvial ecosystems like the lower Columbia River to be evaluated when data have accumulated without sufficient synthesis.

“This evidencebased approach will enable restoration in complex coastal, riverine, and tidal-fluvial ecosystems like the lower Columbia River to be evaluated when data have accumulated without sufficient synthesis.”

May combine two claims.

Synthesis and evaluation, and a transdisciplinary approach, are lacking in large-scale ecosystem-restoration programs.

“More importantly, synthesis and evaluation, and a transdisciplinary approach (Cianelli et al. 2014) are lacking.”

• cites Cianelli et al. 2014Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S4 (based).

In ecosystem management, numerical models may serve a predictive function, but only rarely is an integrated system with modules for hydrology, geomorphology, and population biology developed and adequately parameterized with in situ data.

“In ecosystem management, numerical models may serve a predictive function, but only rarely is an integrated system with modules for hydrology, geomorphology, and population biology developed and adequately parameterized with in situ data.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

To the best of our knowledge, this is the first published use of evidence-based literature review methods for evaluation of the cumulative effects of ecosystem restoration.

“To the best of our knowledge, this is the first published use of evidence-based literature review methods for evaluation of the cumulative effects of ecosystem restoration.”

The quote only partly states this claim.

The sampling period constraints (yearling Chinook, coho, and steelhead collected April 20-June 6; subyearling Chinook June 16-July 20) helped ensure that similar populations of migratory fish were compared.

“These constraints on sampling period helped to ensure that similar populations of these migratory fish were compared.”

Classified as probably not a substantial claim. May combine two claims.

The systematic literature review used two phases (selection and scoring) and selected studies based on inclusion of native salmon response to hydrologic reconnection in tidal systems.

“We conducted a systematic review of the published body of evidence from analogous ecosystems that accounted for the strength of individual study designs.The analysis of literature had two phases, selection and scoring.The selection criterion was inclusion of the response of native salmon to hydrologic reconnection in tidal systems, whether coastal or tidally influenced large-river floodplains.”

May combine two claims.

Juvenile salmon presence at wetland restoration sites is a function of water temperature, with peak abundances below 19°C although fish can be present at 23°C.

“Juvenile salmon presence at wetland restoration sites is a function of water temperature, whereby peak abundances are at temperatures below 19°C although fish can be present even at 23°C (e.g., Roegner et al. 2010).”

• cites Roegner et al. 2010 sourceNot checked — no full text of the source

Classified as probably not a substantial claim. May combine two claims.

The evidence evaluation used rules adapted from Norris et al. (2012) and Greet et al. (2011) and a four-element conclusion framework from the U.S. Department of Health and Human Services.

“To evaluate the results, we applied rules adapted from Norris et al. (2012) and Greet et al. (2011), and adapted the four-element conclusion framework developed by the U.S. Department of Health and Human Services as follows:”

• cites Norris et al. (2012) sourceNot checked — no full text of the source
• cites Greet et al. (2011) sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

For quality control, two authors independently scored each study, compared and discussed results to produce an interim score, and a third author independently reviewed it before finalization.

“For quality control purposes, two of us scored each study independently, then compared and discussed results to produce an interim score, which was independently reviewed by a third author before finalization.”

May combine two claims.

In most cases, sampling intensity at restoration sites was not high enough, and enough restoration sites had not been sampled, to determine whether variability in salmon presence is seasonal or related to landscape position relative to migration routes.

“In most cases, sampling intensity at restoration sites was not high enough, and enough restoration sites had not been sampled, to determine whether variability in salmon presence is seasonal and/or related to the landscape position of sites relative to migration routes.”

May combine two claims.

The plant cover time lag is expected because historical land subsidence behind dikes strongly affects water depth upon reconnection, so reestablishment of wetland plant community structure and dynamics depends first on sedimentary accretion processes, though an alternative stable state governed by reed canarygrass may develop in freshwater wetlands.

“This is expected because historical land subsidence behind dikes strongly affects water depth upon reconnection, and so the reestablishment of wetland plant community structure and dynamics depends first on sedimentary accretion processes (Thom 1992), though an alternative stable state governed by reed canarygrass (Phalaris arundinaceae) may develop in the freshwater wetlands (Diefenderfer et al.”

• cites Thom 1992 sourceNot checked — no full text of the source
• cites Diefenderfer et al. 2013aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Each causal criterion provides a different perspective on the spatial complexity and temporal dynamics of the aquatic ecosystem restoration study area.

“Each causal criterion (Table 11) provides a different perspective on the spatial complexity and temporal dynamics of the aquatic ecosystemrestoration study area.”

• cites Hill 1965 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

The review did not interpret data further than the original authors had done (e.g., diet composition was reported by taxa, not energetic quality).

“We did not interpret the data further than authors had done; for example, diet composition was reported based on taxa not the energetic quality of the prey.”

Classified as probably not a substantial claim.

At the outset of the CEERP, data associating the hydrologic reconnection of LCRE-floodplain tidal wetlands with juvenile salmon were unavailable because the restoration effort was in its infancy.

“At the outset of the CEERP, data associating the hydrologic reconnection of LCRE-floodplain tidal wetlands with juvenile salmon were unavailable because the restoration effort was in its infancy.”

May combine two claims.

To avoid skewing results, the review used principles for handling duplicate data: earliest source with required information for different authors, most recent source for same author republishing same data.

“It would skew results to use data from the same site on the same response metric published in two papers, so we established principles.In the case of a different author publishing an earlier author's data, the earliest source that included the information required to weight the study type was included; in the case of the same author publishing the same data a second time, the most recent source”

May combine two claims.

Although the number of studies included would increase almost twofold if paired restoration/reference sites were not a requirement of the ancillary hypothesis framework, the rigor would decrease.

“Although the number of studies included would increase almost twofold if paired restoration/ reference sites were not a requirement of the ancillary hypothesis framework, the rigor would decrease.”

Probably not a substantial claim: may not pass S3 (load-bearing).

There is a burgeoning effort to bring systematic, evidence-based reviews of the literature to the environmental sciences to support policy making.

“There is a burgeoning effort to bring systematic, evidence-based reviews of the literature to the environmental sciences to support policy making (Pullin et al. 2009).”

• cites Pullin et al. 2009 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

The experimental corroboration criterion was implemented in only a limited manner.

“We have been able to implement another criterion, experimental corroboration, in only a limited manner although it is a hallmark of critical thinking (Dewey 1910, Hill 1965).”

• cites Dewey 1910Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Hill 1965 sourceNot checked — no full text of the source

May combine two claims.

The interaction of juvenile salmon with wetland sites can include multiple visits to multiple sites, as well as both direct and indirect interactions with tidal wetlands as the salmon migrate through the lower LCRE.

“Second, the interaction of juvenile salmon with these wetland sites can include multiple visits to multiple sites, as well as both direct and indirect interactions with tidal wetlands as the salmon migrate through the lower LCRE (Healey 1982, Levings et al. 1986, Maier and Simenstad 2009).”

• cites Healey 1982 sourceNot checked — no full text of the source
• cites Levings et al. 1986 sourceNot checked — no full text of the source
• cites Maier and Simenstad 2009 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims. The quote only partly states this claim.

Estimates of future prey presence and vegetative biomass production in restored areas are subject to assumptions regarding project size estimation, uniform spatial distribution within the project area, and use of reference emergent-marsh mean abundance values to represent eventual prey and biomass presence at restoration sites following ecosystem development.

“The estimates of future prey presence and vegetative biomass production in restored areas are subject to associated assumptions regarding project size estimation, uniform spatial distribution within the project area, and the use of v www.esajournals.org”

• AssumptionThe authors state this as an assumption: Project size estimation is an assumption underlying estimates of future prey presence and vegetative biomass production in restored areas.
• AssumptionThe authors state this as an assumption: Uniform spatial distribution within the project area is an assumption underlying estimates of future prey presence and vegetative biomass production in restored areas.
• AssumptionThe authors state this as an assumption: Use of reference emergent-marsh mean abundance values to represent eventual prey and biomass presence at restoration sites following ecosystem development is an assumption underlying estimates of future prey presence and vegetative biomass production in restored areas.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Interpretation arises from iteration in the mathematical sense of developing successive approximations.

“Interpretation arises from iteration in the mathematical sense of developing successive approximations (Gadamer 1975).”

• cites Gadamer 1975Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

The predictive performance criterion could not be utilized because the program is in the early stages of the restoration trajectory and data for numerical modeling of juvenile salmon growth in restored sites are not yet available.

“As yet, we have not been able to utilize one of the causal criteria, predictive performance (Dorward-King et al. 2001), which cannot be assessed because this program is in the early stages of the restoration trajectory and data for numerical modeling of juvenile salmon growth in restored sites are not yet available.”

• cites Dorward-King et al. 2001Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The transdisciplinary approach applied here to assess benefits of tidal wetland habitat restoration to juvenile salmon melds frameworks from medical sciences, education, and environmental management.

“This transdisciplinary approach, applied here to assess the benefits of tidal wetland habitat restoration to juvenile salmon, melds frameworks from the medical sciences (Hill 1965), education (Dewey 1910), and environmental management (CEQ 1997).”

• cites Hill 1965 sourceNot checked — no full text of the source
• cites Dewey 1910Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites CEQ 1997Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The lines of evidence, one of which is meta-analysis, are intended to address critical uncertainties identified in the conceptual model of an understudied ecosystem.

“The lines of evidence, one of which is meta-analysis, are intended to address critical uncertainties identified in the conceptual model of an understudied ecosystem.”

Classified as probably not a substantial claim.

The set of 11 causal criteria was retained because each provides a nuanced philosophical perspective that helps explore and illuminate aspects of complex ecosystem cause-and-effect problems addressed by the science of ecological restoration.

“In contrast, we retained the set of 11 because we believe each provides a nuanced philosophical perspective that helps to explore and illuminate aspects of the complex ecosystem cause-andeffect problems addressed by the science of ecological restoration.”

May combine two claims.

Based on the growing body of scientific evidence, the primary hypothesis was supported: habitat restoration activities in the LCRE are having a cumulative beneficial effect on juvenile salmon, including interior basin salmon.

“Based on the growing body of scientific evidence, we concluded that the primary hypothesis was supported; that is, the habitat restoration activities in the LCRE are having a cumulative beneficial effect on juvenile salmon, including interior basin salmon.”

May combine two claims.

Prey community variability can be summarized as occurring across river reaches and habitats, among studies, and within a study.

“Prey community variability can be summarized as that occurring across river reaches and habitats, among studies, and within a study.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Both inductive and deductive reasoning contribute to judgments in this systematic inferential framework.

“Both inductive and deductive reasoning contribute to judgments in this systematic inferential framework (Dewey 1910).”

• cites Dewey 1910Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

Use of a single point (river kilometer) to mark reach boundaries should not mask the reality that these are ecotones where dominant plant species and hydrologic drivers shift.

“Finally, the use of a single point (river kilometer) to mark reach boundaries should not mask the reality that these are ecotones where the dominant plant species and hydrologic drivers shift (Jay et al., in press).”

• cites Jay et al., in pressNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The use of Hill's criteria had been proposed for applications in river ecology and restoration but not implemented in a real-world example.

“The use of Hill's criteria had been proposed for applications in river ecology and restoration but not implemented in a real-world example (Downes et al. 2002).”

• cites Downes et al. 2002 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

This evidence-based approach will enable the evaluation of restoration in complex coastal, riverine, and tidalfluvial ecosystems where data have accumulated without sufficient synthesis.

“This evidence-based approach will enable the evaluation of restoration in complex coastal, riverine, and tidalfluvial ecosystems where data have accumulated without sufficient synthesis.”

Classified as probably not a substantial claim.

The evidence-based approach enabled drawing reasoned conclusions regarding the effectiveness of a large-scale ecosystem-restoration program.

“The evidence-based approach enabled us to draw reasoned conclusions regarding the effectiveness of a large-scale ecosystem-restoration program.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The focus of this study was to quantify the effects of the restoration program, so examination of concurrent cumulative impacts was limited to land-cover change analysis.

“For example, though the LCRE is understudied relative to other ecosystems of similar significance, the focus of this study was to quantify the effects of the restoration program, so examination of concurrent cumulative impacts was limited to land-cover change analysis.”

May combine two claims.

Formal experiments are exceedingly rare in restoration ecology because of lack of control and replication and because time lags are normal for ecosystem response.

“Formal experiments are exceedingly rare in restoration ecology because of lack of control and replication and because time lags are normal for ecosystem response.”

Probably not a substantial claim: may not pass S4 (based).

The seven lines of evidence employed should each be applicable to any large-scale ecosystem-restoration program that includes one or more species of interest, though analytical approaches for each are expected to be refined based on the target species and ecosystem.

“The seven lines of evidence we employed should each be applicable to any large-scale ecosystem-restoration program that includes one or more species of interest, though the analytical approaches for each are expected to be refined based on the target species and ecosystem.”

Probably not a substantial claim: may not pass S4 (based).

The beneficial effect of restoring tidal wetlands is expected to increase over time as existing restoration projects mature and new ones are implemented.

“The beneficial effect of restoring tidal wetlands is expected to increase over time as existing restoration projects mature and new ones are implemented.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Studies associated with different disciplines had selected various subsets of Hill's criteria.

“Studies associated with different disciplines had selected various subsets of Hill's criteria, (e.g., Norris et al. 2012).”

• cites Norris et al. 2012 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable).

The adaptation of evidence-based methods to systematically evaluate the effects of a large ecosystem-restoration program has proven to be an effective application of formal reasoning for the science and practice of ecological restoration and species conservation.

“The adaptation of evidence-based methods to systematically evaluate the effects of a large ecosystem-restoration program has proven to be an effective application of formal reasoning for the science and practice of ecological restoration and species conservation.”

Classified as probably not a substantial claim. May combine two claims.

The difference between a control and restoration site may be so great that a control-impact design may not reveal information consequential for the restoration trajectory, so incorporation of absolute reference sites in the monitoring design makes scientific evaluation possible.

“Designs should consider that the difference between a control and restoration site may be so great that a control-impact design may not reveal information that is consequential for the restoration trajectory, so the incorporation of absolute reference sites in the monitoring design makes scientific evaluation possible (Morandi et al. 2014).”

• cites Morandi et al. 2014 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing).

New regional evidence from a smaller river system indicates the importance of estuarine habitat use to adult salmon returns.

“New regional evidence from a smaller river system indicates the importance of estuarine habitat use to adult salmon returns (Jones et al. 2014).”

• cites Jones et al. 2014 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The CNEI model is generic and every ecosystem has ecological functions suitable for its calculation.

“For instance, the CNEI model is generic and every ecosystem has ecological functions suitable for its calculation.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The approach is transferable to other large-scale ecosystem-restoration programs.

“We believe this approach is transferable to other large-scale ecosystem-restoration programs.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Distinguishing association from causation is a matter of inference, not proof, whether the approach is statistical or evidence-based.

“Ultimately, distinguishing association from causation is a matter of inference, not proof, whether the approach is statistical or evidencebased (Hill 1965, Weed 1997).”

• cites Hill 1965 sourceNot checked — no full text of the source
• cites Weed 1997 sourceNot checked — no full text of the source

Classified as probably not a substantial claim. May combine two claims.

The approach permitted evaluation of all available evidence and collection of new evidence targeting uncertainties, using transdisciplinary critical thinking to examine the alternate hypothesis that cumulative effects of ecosystem restoration in the LCRE do not benefit juvenile salmonids.

“The approach herein permitted us to evaluate all available evidence and collect new evidence targeting uncertainties, using transdisciplinary critical thinking to examine the alternate hypothesis; that is, that the cumulative effects of ecosystem restoration in the LCRE do not benefit juvenile salmonids.”