Developing an English Language Textbook Evaluative Checklist
Open accessThe DOI matches its Crossref record; 59 of the 78 references it cites were found in a registry or an index; 2 of the 13 sources its claims cite were checked for support.
Abstract
In the selection of a new textbook, it is important to conduct an evaluation to ensure that it is suitable. Evaluation is widely acknowledged as a powerful means of improving the quality of education. There are three methods of evaluation that can be used for evaluating English Language Teaching (ELT) textbooks. An evaluative checklist is one of these methods that can be used to help select the most appropriate ELT textbooks for their learners. This paper presents an overall view of evaluating an ELT textbook with a focus on the instrument of a checklist. It tried to develop a valid, reliable and practical checklist. The paper refined checklists previously developed by different researchers. More specifically, the comments and suggestions given by a large number of TEFL professors helped the researcher improve the items of the checklist in reference to their clarity and inclusiveness. They were provided with a copy of the checklist. They were free to reword, delete or add items that they considered necessary. The findings are expected to be useful for English language teachers, ELT material developers and evaluators as well as curriculum developers. Further study is required to improve the instrument.
Overview
CoChat Summary
TL;DR
This paper develops a 140-item English language textbook evaluative checklist, built from a literature review, expert feedback, and a case study of three ELT textbooks. The author reports that the checklist was made valid, reliable, and practical, with total reliability reported as 0.87.
Key findings
- The final checklist contains 140 items organized into 4 domains: physical and utilitarian attributes (25 items), efficient outlay of objectives and supplementary materials (33), learning-teaching content (28), and language skills (54).
- Reliability estimates were reported as 0.78 for physical and utilitarian attributes, 0.71 for efficient outlay of objectives and supplementary materials, 0.78 for learning-teaching content, 0.79 for language skills, and 0.87 for the total score.
- Expert feedback led to concrete revisions: 7 items were added, 3 were revised, some items were deleted, and several were merged or modified.
- The checklist was applied to three ELT textbooks: *Move Ahead 3*, *Touch Stone*, and *Step Forward, Step by Step, Lesson Plans*; the paper says the checklist proved “reliable and valid” and that its practicality and clarity were assured through this application.
Methods
- The study used a mixed-method design, combining qualitative and quantitative survey research with a case study.
- Development proceeded through three phases: literature review and checklist construction, critical feedback survey plus semi-structured interviews/written comments from an expert panel, and a single case study applying the checklist to ELT textbooks.
- Data analysis included Cronbach’s alpha for internal consistency and a practical rating system in which each of the 140 items was scored 0–2.
Limitations
- The paper states that the evaluative criteria used were “only some of the numerous possible sets of criteria” against which an English language textbook may be evaluated.
- The paper also states that different self-report instruments, structured interviews, diary studies, and observations could reveal more specific data; this indicates the current study’s instrument limited the possibility of a more in-depth analysis (stated in the paper).
- The checklist was developed for and tested in a particular teaching context, so the text makes evident that generalization to all contexts is limited (inferred from the paper’s emphasis on local needs and context-specific use).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
2 Valid · 1 Not valid · 9 Not checked · 49 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Most advanced level English language textbooks, prescribed for students at different institutes, were not chosen by the careful application of objective evaluation criteria.”
What the sources say
- Partly supportedcites Sheldon (1988:240) sourceExperimental — accuracy not yet measured
The Abstract (page unavailable) says textbook choices are most often made in haste with few systematically applied criteria, and the discussion of evaluation checklists (page unavailable) describes choices as ad hoc and rushed. The paper does not establish this specifically for most advanced-level textbooks prescribed at different institutes. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“It is a matter of fact that the method of selecting English language textbooks prescribed for students of different stages is unsatisfactory and away from being scientific.”
What the sources say
- Supportedcites Sheldon (1988:240) source
In the Abstract, Sheldon says textbook choices are often made hastily with few systematically applied criteria. In the section headed “English Words, and the Cambridge English Lexicon,” he describes coursebook evaluation as ad hoc and rushed, sometimes based on simplistic criteria such as popularity. This supports the claim that ELT textbook selection is often unsatisfactory and unsystematic; he does not assess a particular stage-specific selection procedure. (LLM, conf=0.90)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
In the paper
“The review of textbook evaluation checklists within four decades (1970-2000) by Mukundan and Ahour (2010) reveals that most of the checklists are qualitative”
What the sources say
- Not matchedcites Mukundan and Ahour (2010)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The literature and studied reviewed guided the construction of the overall design of the current checklist”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“More specifically, the comments and suggestions given by a large number of TEFL professors helped the researcher improve the items of the checklist in reference to their clarity and inclusiveness.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
5 more claims
Create a free account to see all 61 claims and every source verdict.
- It may state two separate claims as one. 22
- Probably not a substantial claim. 38
- The quote only partly states this claim. 1
Citations
Cites
The Practice of English Language Teaching
Harmer, J. (1983) · Cited by 6,104
Toward a Conceptual Framework for Mixed-Method Evaluation Designs
Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737011003255 · Cited by 5,687
A Course in Language Teaching: Practice and Theory
Ur, P. (1996) · Medical Entomology and Zoology · Cited by 3,728
Longman dictionary of contemporary English
Procter, P. (1978) · Longman eBooks · Cited by 2,404
Curriculum Development in Language Teaching
Richards, J. C. (2001) · doi:10.1017/cbo9780511667220 · Cited by 1,851
Materials Development in Language Teaching
(2011) · doi:10.1017/9781139042789 · Cited by 1,391
Curriculum Development in Language Teaching
Richards, J. C. (2017) · Cambridge University Press eBooks · doi:10.1017/9781009024556 · Cited by 1,151
A course in language teaching: Practice and theory
Tang, F. (1997) · System · doi:10.1016/s0346-251x(97)84229-7 · Cited by 1,133
Harmer, J. (1997) · Cited by 964
Developing Materials for Language Teaching
(2003) · Bloomsbury Academic eBooks · doi:10.5040/9781474211826 · Cited by 791
Research works printed but not linked: 29
- [1][1]. Adelson-Godstein, Jayne (2007). Step Forward, Step by Step, Lesson Planning, Oxford University Press -
- [3][3]. Al-Saif, Abdullah. (2005). An evaluation of the TEFL textbook for the 6th elementary class in Saudi Arabia . Unpublished MA thesis, 78 pages. Essex University, UK. -
- [5][5]. Breen, M. & Candlin, C. (1987). What materials? A consumer's and designer's guide. In L. E. Shelden (ed.). ELT textbook and materials: Problems in evaluation and development. ELT Documents 126. (pp. 13-28) Oxford: Modern English Publications in association with The British Council. -
- [16][16]. Daoud, A. M. & Celce-Murcia, M. (1979). Selecting and evaluating a textbook. In M. Celce-Murcia and L. McIntosh, eds. TESL or TEFL Pp: 302-307. New York: News bury House. ELT documents 126.Pp. 29-36, Oxford: Modern English Publications in Associations with the British Council. -
- [17][17]. Dougill, J. (1987). Not so Obvious. In L. E. Shelden (ed.). ELT textbook and materials: Problems in evaluation and development -
- [20][20]. Ellis, Printha; Wilson, Ken and Taylor, James (2002). Move Ahead. Macmillan Publishers Limited, Cambridge UK -
- [26][26]. Garinger, D. (2001). Textbook evaluation. TEFL Web Journal. Retrieved from http://www.teflweb-j.org/v1n1/garinger.html -
- [30][30]. Griffiths, C. (1995). Evaluating materials for teaching English to adult speakers of other languages. Forum 33 (3): 50. Retrieved from http://forum.state.gov/vols/vol33/ no3/p50.htm -
- [37][37]. Hutchinson, T. & Waters, A. (1987). English for specific purposes: A learning-centered approach . Cambridge: Cambridge University Press. -
- [43][43]. Litz, D.R.A. (2005). Textbook Evaluation and ELT Management: A South Korean Case Study. Asian EFL Journal . Retrieved from http://www.asian-efl-journal.com/ Litz\_thesis.pdf -
- [45][45]. Ma, Ling-Ling. 2003. Evaluation of current English textbooks for the elementary school: A study of English textbooks designed for the 1st-9th grades curriculum alignment in Taiwan. Unpublished master's thesis, Fu-Jen Catholic University, Taiwan, R.O.C. -
- [47][47]. McCarthy,Michael, Mecarten, Jonne, and Sanford, Helen (2010). Touch Stone 3. Cambridge- Obeiko. -
- [54][54]. Pan, Pei-hsuan. 2004. Evaluation of learning activities in junior high school English textbooks for Nine-Year Integrated Curriculum. Unpublished master's thesis, National Normal University, Taiwan, R.O.C. -
- [57][57]. Rea- Dicckens PP, Germaine K (1994). Evaluation In Canadlin and Widdowson (ed.), Oxford University Press. -
- [65][65]. Soori ,A.; Kafipour, R.; and Soury M. (2011) . EFL Textbook Evaluation and Graphic Representation. European Journal of Social Sciences. ISSN 1450-2267 Vol.26 No.3 (2011), pp. 481-493 EuroJournals Publishing, Inc. 2011, http://www. European journal of social sciences.com -
- [66][66]. Stake, R. E., Hood, S. and O'Sullivan, R. G. (eds) (1991) Advances in Program Evaluation: A Research Annual: Using Assessment Policy to Reform Education, Part A , Vol. 1(Greenwich, CT: JAI Press). -
- [70][70]. Tomlinson, B. et al. (2001). ELT Courses for Adults. ELT Journal, 55(1) 80-101. -
- [71][71]. Tucker, C. A. (1978). Evaluating beginning textbooks. In H. S. Madsen and J. D. Bowen. Adaptation in language teaching. Appendix 3 (pp. 219-237). Rowley, Mass: Newbury. -
- [75][75]. Rea- Dicckens PP, Germaine K (1994). Evaluation In Canadlin and Widdowson (ed.), Oxford University Press. -
- [77][77]. Roberts, J. T. (1996). Demystifying materials evaluation. System , 24 (3): 375-389. -
- [78][78]. Robinett, W. (1978). Teaching English to speakers of other languages: Substance and technique . Minneapolis: University of Minnesota Press. -
- [81][81]. Sheldon, L. E. (1988) Evaluating ELT textbooks and materials. ELT Journal, 42 (4):237-246. -
- [82][82]. Skierso, Alexandra. (1991). Textbook Selection and Evaluation. In M. Celce-Murcia (Ed.), Teaching English as a second or foreign language , 432-453. Boston: Heinle and Heinle Publishers. -
- [83][83]. Soori ,A.; Kafipour, R.; and Soury M. (2011) . EFL Textbook Evaluation and Graphic Representation. European Journal of Social Sciences. ISSN 1450-2267 Vol.26 No.3 (2011), pp. 481-493 EuroJournals Publishing, Inc. 2011, http://www. European journal of social sciences.com -
- [84][84]. Stake, R. E., Hood, S. and O'Sullivan, R. G. (eds) (1991) Advances in Program Evaluation: A Research Annual: Using Assessment Policy to Reform Education, Part A , Vol. 1(Greenwich, CT: JAI Press). -
- [88][88]. Tomlinson, B. (Ed.). (1996). Materials development in language teaching. Cambridge: Cambridge University Press. -
- [89][89]. Tomlinson, B. et al. (2001). ELT Courses for Adults. ELT Journal, 55(1) 80-101. -
- [90][90]. Tucker, C. A. (1978). Evaluating beginning textbooks. In H. S. Madsen and J. D. Bowen. Adaptation in language teaching. Appendix 3 (pp. 219-237). Rowley, Mass: Newbury. -
- [96][96]. Williams, D. 1983. Developing criteria for textbook evaluation. ELT Journal, 37 (3), 251-255 [Electronic version]. -
Cited by
Tarrayo, V. N., & Anudin, A. G. (2021) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2021.1939703 · Cited by 45
Panezai, S. G., & Channa, L. A. (2017) · Cogent Education · doi:10.1080/2331186x.2016.1269712 · Cited by 55
A descriptive-evaluative study of a Saudi EFL textbook series
Alharbi, A. (2015) · Cogent Education · doi:10.1080/2331186x.2015.1079946 · Cited by 36
Can We Learn about Culture by EFL Textbook Images? A Semiotic Approach Perspective
Wang, Y., & Hemchua, S. (2022) · Language Related Research · doi:10.52547/lrr.13.3.19 · Cited by 44
(2014) · The reading matrix · Cited by 32
Metadata
- Authors
- An Assistant Professor at Al Imam Muhammad Bin Saud Islamic University, C. O. L. A. T., & Mohamed, M.
- Affiliations
- Imam Mohammad ibn Saud Islamic University (SA)
- Corresponding author
- Mohamed, Montasser
- Venue
- IOSR Journal of Research & Method in Education (IOSRJRME)
- Publisher
- IOSR Journals
- Published
- 2013
- Volume
- 1
- Issue
- 3
- Pages
- 55-70
- ISSN
- 2320-737X (ISSN-L)
- 2320-7388
- OpenAlex
- W2337919510
- Semantic Scholar
- a3218ce90166e445f9ace1389fb7f0f58ec19319
- Cited by
- 96
- References
- 78
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3 · 2023: 13 · 2022: 12 · 2021: 21 · 2020: 10 · 2019: 12 · 2018: 8 · 2017: 7 · 2015: 3 · 2014: 2
- FWCI
- 11.63
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- IOSR Journal of Research & Method in Education (IOSRJRME) (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
- Social Sciences › Education › English Language Learning and Teaching
- Social Sciences › Education › Educational Methods and Analysis
- Keywords
- English textbooks, textbook evaluation, checklist development, English language teaching materials, reliability and validity, curriculum development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing an English Language Textbook Evaluative Checklist. https://app.cochat.ai/papers/10.9790/7388-0135570
- The paper
- An Assistant Professor at Al Imam Muhammad Bin Saud Islamic University, C. O. L. A. T., & Mohamed, M. (2013). Developing an English Language Textbook Evaluative Checklist. IOSR Journal of Research & Method in Education (IOSRJRME). https://doi.org/10.9790/7388-0135570
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.