Cited by 4scientometrics and bibliometrics researchAcademic Writing and PublishingPublishing and Scholarly Communication

How accurate are cited references in Iranian peer-reviewed journals?

Open access
Ghane, Mohammad Reza·2016·Learned Publishing

Abstract

The references cited in scientific articles are as important as any other part of the paper, because of their usefulness to the scientific community and to abstracting and indexing services and citation databases. I studied inaccuracies in references and in-text citations in sample of 97 of the 519 peer-reviewed journals accredited by the Iranian National Commission for Journal Accreditation Policy. The results showed 36.6% as the average percentage error rate (range 5.6% to 61.3%). The mean number of errors in cited references was 2.7 per article. Problems with referencing are a concern in all scientific disciplines, causing serious impact on the tracking of ideas.

Integrity signals

Registry

Crossref · 10.1002/leap.1000

Cites

38 of 42 references verified1 citation errors · 3 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

2 of 9 cited sources checked · 2 supported · 0 flagged

  • Findingown data

    86% (approximately 84) of the journals included in the study referred authors to a specific style manual.

    “although 86% (approximately 84) of the journals included in this study referred authors to a specific style manual”
    Quote in the paperNot a substantial claim
  • Findingown data

    The rate of error for neglecting to add lower-case letters to distinguish between two or more publications by the same author in the same year was 8.6% (3,406).

    “The rate of error for neglecting to add lower-case letters to distinguish between two or more publications by the same author in the same year was 8.6% (3,406).”
    Quote in the paperNot a substantial claim
  • Findingown data

    8,683 cited references did not match any in-text citations (11.6%).

    “8,683 cited references that did not match any in-text citations (11.6%)”
    Quote in the paperSubstantial claim
  • Findingown data

    84.4% of the journals used an ad hoc format.

    “Although most journals (86%) provided specific rules for citation and reference formats, 84.4% of the journals used an ad hoc format.”
    Quote in the paperSubstantial claim
  • Findingown data

    Among online reference errors, 3,401 (12.5%) were incorrect or incomplete URLs.

    “that the URL is incorrect or incomplete (3,401, 12.5%)”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 19
  • May combine two claims. 10
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Science Citation Index Expanded and SciFinder corrected 46% and 16% of author errors, respectively, when they index them.

    “Buchanan (2006) showed that indexes such as Science Citation Index Expanded and SciFinder corrected 46% and 16% of author errors, respectively, when they index them.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Buchanan, 2006 source
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Premisecitation

    Inaccurate references affect the intellectual impact of scientists, journals and disciplines and may hinder individual development.

    “Thus, inaccurate references affect the intellectual impact of scientists, journals and disciplines and may hinder individual development”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Meho & Rogers, 2008 source
  • May combine two claims.

    Findingown data

    The 97 journals in the final sample published 2,980 articles during 2012, with 74,577 cited references and 108,151 in-text citations.

    “The 97 journals in the final sample published a total of 2,980 articles during 2012 with 74,577 cited references and 108,151 in-text citations (Table 2).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    NLM/ICMJE (Vancouver) style was used by 9.3% (eight) of journals, APA style by 6.2% (five), and Harvard style by 4.1% (three).

    “NLM/ICMJE (Vancouver) style was used by 9.3% (eight), APA style by 6.2% (five) and Harvard style by 4.1% (three).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Findingcitation

    Despite careful peer-review processes, errors of all kinds creep into the journals.

    “Ultimately, my findings show that despite careful peer-review processes, 'errors of all kinds creep into the journals' (Garfield, 1990)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Garfield, 1990

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • Rests on an assumption: The sample of 97 journals is representative of the 519 accredited Iranian peer-reviewed journals.
  • May combine two claims.

    Findingown data

    The largest percentage of errors occurred in the humanities and arts (33,104 errors, 49.5%), followed by medical sciences (13,104, 19.6%), agriculture and veterinary (8,990, 13.4%), engineering (8,276, 12.4%), and basic sciences (3,448, 5.1%).

    “Frequency counts of the errors showed that the largest percentage of errors occurred in the humanities and arts (33,104 errors, 49.5%) followed in decreasing order by medical sciences (13,104, 19.6%), agriculture and veterinary (8,990, 13.4%), engineering (8,276, 12.4%), and basic sciences (3,448, 5.1%) (Fig. 1).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Absence of an in-text citation of a reference, or vice versa, occurred 3,486 times and comprised 8.8% of all in-text citation errors.

    “These errors occurred 3,486 times and comprised 8.8% of all in-text citation errors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Web of Science contained 0.3% incorrect citation, PsycINFO 1.1% and Google Scholar 16.5%.

    “García-Pérez showed that Web of Science contained 0.3% incorrect citation, PsycINFO 1.1% and Google Scholar 16.5%”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites García-Pérez

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisereasoning

    This study is the first to survey reference accuracy in Iranian peer-reviewed journals across all subject disciplines.

    “This study is the first to survey reference accuracy in Iranian peer-reviewed journals across all subject disciplines.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Many of the journals analysed did not follow standard reference or citation styles, and one consequence was the appearance of types of errors not commonly seen in other international studies.

    “Many of the journals I analysed did not follow standard reference or citation styles, and one of the consequences of this was the appearance of types of errors not commonly seen in other international studies.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Stratified sampling was used for the five main categories of journals to obtain a sample of 97 peer-reviewed journals.

    “I then used stratified sampling for the five main categories of journals to obtain a sample of 97 peer-reviewed journals.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The sample of 97 journals is representative of the 519 accredited Iranian peer-reviewed journals.
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The lack of instructions, guidelines or advice for authors in peer-reviewed journals reflects the editor's failure, at least in Iran, to devote enough attention to his or her responsibilities.

    “The lack of instructions, guidelines or advice for authors in peerreviewed journals reflects the editor's failure, at least in Iran, to devote enough attention to his or her responsibilities”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Studies have shown that reference and citation errors are often neglected in different specialty journals.

    “Studies have shown that reference and citation errors are often neglected in different specialty journals”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Parashar et al., 2007 source
    • cites Siedlecki et al., 2008 source
    • cites García-Pérez, 2010 source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Inaccuracies in references and citations fail researchers as they prevent them from being able to identify and trace the genealogy of knowledge.

    “Thus, inaccuracies in references and citations fail researchers as they prevent them from being able to identify and trace the genealogy of knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The higher the impact factor for the journal, the lower the number of errors.

    “An interesting study by Fenton, Brazier, De Souza, Hughes, and McShane (2000) showed that 'the higher the impact factor for the journal, the lower the number of errors'.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Fenton et al., 2000 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The incidence rate of citation errors in the analysed articles (5.6% to 61.3%) is consistent with the results of other surveys in the Introduction.

    “In the articles I analysed, the incidence rate of citation errors varied between 5.6% and 61.3%, which is consistent with the results of other surveys in the Introduction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationown data

    Many journal editors pay little attention to authors' noncompliance with journal-specific format and style rules.

    “Apparently, many journal editors pay little attention to authors' noncompliance with journal-specific format and style rules.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The arbitrary style was the reason for the most frequent in-text citation errors listed in Table 3.

    “I suggest that this arbitrary style was the reason for the most frequent in-text citation errors listed in Table 3.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The journals studied were all accredited by the Commission.

    “The journals I studied were all accredited by the Commission.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Incorrect or incomplete URLs are a major problem because they impede readers' access to original documents and undermine citing authors' credibility.

    “The former is a major problem because it not only impedes the readers' access to the original documents but also undermines the citing authors' credibility.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The potential cause for mismatches between in-text citations and references is that the original source is cited in another source (indirect citation) that was not read by the citing author.

    “The potential cause for these mismatches is that the original source is cited in another source (indirect citation) that was not read by the citing author.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    Failure to cite colleagues correctly (or even not to cite them) causes them to be 'excluded from the fellowship of their peers'.

    “Failure to cite colleagues correctly (or even not to cite them) causes them to be 'excluded from the fellowship of their peers' (The National Academies Press, 1995).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites The National Academies Press, 1995

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    The references were checked against publications in the Iran Journal Database, and if not there, other online search tools were used to find the original article.

    “The references were first checked against publications in the Iran Journal Database, and if not there, then other online search tools were used to find the original article.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The Iran Journal Database comprises all Iranian peer-reviewed journals.
    • Rests on an assumption: The Iran Journal Database is accurate for checking references.
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    The result of editors' failure may be a proliferation of mistakes in submitted manuscripts.

    “and the result may be a proliferation of mistakes in submitted manuscripts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The findings suggest a lack of awareness by authors of their responsibility in ensuring accurate citation.

    “and suggest a lack of awareness by authors of their responsibility in ensuring accurate citation.”
    Quote in the paperNot a substantial claim
25 of 25
  • The paper relies on this without support.

    The Iran Journal Database comprises all Iranian peer-reviewed journals.

    “The Iran Journal database (http://en.ricesr.ac.ir) comprises all Iranian peer-reviewed journals and was used as the data source.”
  • The paper relies on this without support.

    The sample of 97 journals is representative of the 519 accredited Iranian peer-reviewed journals.

    “I then used stratified sampling for the five main categories of journals to obtain a sample of 97 peer-reviewed journals.”
  • The paper relies on this without support.

    Deviations from standard citation styles constitute citation errors.

    “In about 90% of the journals in my sample, the references did not fully follow the format rules provided in any of a standard set of guidelines such as the American Psychological Association (APA), the Modern Language Association, Harvard referencing system or Vancouver citation style.”
  • The paper relies on this without support.

    The 2012–2013 journal issues are representative of the current accuracy of Iranian peer-reviewed journals.

    “The journal issues included in the sample were published between 2012 and 2013.”
  • The paper relies on this without support.

    The Commission's accreditation criteria support high editorial standards.

    “Despite the criteria (such as journal scope and coverage, Editorial Board, Editor-in-Chief and Managing Editor characteristics, timeliness of publication, peer-review process, style guides, copy editing, authorship and journal website) used by the Iranian Commission on Journal Accreditation to support high editorial standards”
  • The paper relies on this without support.

    The Iran Journal Database is accurate for checking references.

    “The references were first checked against publications in the Iran Journal Database, and if not there, then other online search tools were used to find the original article.”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In Ghane (2016), 36.6% of verified references in 97 Iranian-accredited journals contained at least one error.

    “Unclear 36.6%N/A Author”

    From Reference accuracy of primary studies published in peer-reviewed scholarly journals: A scoping review (2024) · cites this paper as Ghane (2016)

    The Results report a 36.6% mean percentage error rate across articles in a sample of 97 journals. Table 2 lists 74,577 checked references and 27,313 reference errors, but it does not establish that 36.6% of individual references each contained at least one error. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Unmatched-citation error count conflicts with the reported tally

    Major

    The discussion counts 3,486 instances of a missing match in either direction, fewer than the 4,369 in-text citations alone that it earlier says were missing from reference lists.

  • Errors per article are understated

    Major

    The reported 66,922 errors across 2,980 articles amount to about 22.46 errors per article, not 2.7.

    Reported 2.7 · recomputed 22.457047

  • Two different percentages are given for ad hoc styles

    Major

    The key points say 84.4% of journals used an ad hoc format, whereas the discussion gives 80.4% for that finding.

  • Ad hoc style count does not match its percentage

    Minor

    Of the 97 journals studied, 68 represent about 70.1%, not 80.4%.

    Reported 80.4 · recomputed 70.103093

4 of 4

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. Committee on Science, Engineering, and Public Policy, 1995, On being a scientist: Responsible conduct in research, 1
  2. 10.1046/j.1365-2273.2000 · DOI
  3. Garfield E., 1990, Journal editors awaken to the impact of citation errors. How we control them at ISI, Current Content, 41, 33
  4. 10.1002/asi.v59:11 · DOI

Cited by

Sorted by citations

Authors
Ghane, M. R.
Affiliations
Regional Information Center for Science and Technology (IR)
Corresponding author
Ghane, Mohammad Reza
Venue
Learned Publishing
Publisher
Wiley
Published
2016-01-08
Volume
29
Issue
2
Pages
77-82
ISSN
  • 0953-1513 (ISSN-L)
  • 1741-4857
OpenAlex
W2308651494
Cited by
4
References
40
Citations by year
2023: 1 · 2021: 2 · 2017: 1
FWCI
0.31
Type
journal article
Language
en
Open access
Locations
Learned Publishing (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Publishing and Scholarly Communication
Keywords
cited references, in-text citations, citation errors, peer-reviewed journals, Iranian journals, journal accreditation, citation indexes

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review