CoChat

Developing an English Language Textbook Evaluative Checklist

Open access
An Assistant Professor at Al Imam Muhammad Bin Saud Islamic University, College of Languages and Translation, Mohamed, Montasser · 2013 · IOSR Journal of Research & Method in Education (IOSRJRME)

The DOI matches its Crossref record; 59 of the 78 references it cites were found in a registry or an index; 2 of the 13 sources its claims cite were checked for support.

Abstract

In the selection of a new textbook, it is important to conduct an evaluation to ensure that it is suitable. Evaluation is widely acknowledged as a powerful means of improving the quality of education. There are three methods of evaluation that can be used for evaluating English Language Teaching (ELT) textbooks. An evaluative checklist is one of these methods that can be used to help select the most appropriate ELT textbooks for their learners. This paper presents an overall view of evaluating an ELT textbook with a focus on the instrument of a checklist. It tried to develop a valid, reliable and practical checklist. The paper refined checklists previously developed by different researchers. More specifically, the comments and suggestions given by a large number of TEFL professors helped the researcher improve the items of the checklist in reference to their clarity and inclusiveness. They were provided with a copy of the checklist. They were free to reword, delete or add items that they considered necessary. The findings are expected to be useful for English language teachers, ELT material developers and evaluators as well as curriculum developers. Further study is required to improve the instrument.

Overview

CoChat Summary

TL;DR

This paper develops a 140-item English language textbook evaluative checklist, built from a literature review, expert feedback, and a case study of three ELT textbooks. The author reports that the checklist was made valid, reliable, and practical, with total reliability reported as 0.87.

Key findings

  • The final checklist contains 140 items organized into 4 domains: physical and utilitarian attributes (25 items), efficient outlay of objectives and supplementary materials (33), learning-teaching content (28), and language skills (54).
  • Reliability estimates were reported as 0.78 for physical and utilitarian attributes, 0.71 for efficient outlay of objectives and supplementary materials, 0.78 for learning-teaching content, 0.79 for language skills, and 0.87 for the total score.
  • Expert feedback led to concrete revisions: 7 items were added, 3 were revised, some items were deleted, and several were merged or modified.
  • The checklist was applied to three ELT textbooks: *Move Ahead 3*, *Touch Stone*, and *Step Forward, Step by Step, Lesson Plans*; the paper says the checklist proved “reliable and valid” and that its practicality and clarity were assured through this application.

Methods

  • The study used a mixed-method design, combining qualitative and quantitative survey research with a case study.
  • Development proceeded through three phases: literature review and checklist construction, critical feedback survey plus semi-structured interviews/written comments from an expert panel, and a single case study applying the checklist to ELT textbooks.
  • Data analysis included Cronbach’s alpha for internal consistency and a practical rating system in which each of the 140 items was scored 0–2.

Limitations

  • The paper states that the evaluative criteria used were “only some of the numerous possible sets of criteria” against which an English language textbook may be evaluated.
  • The paper also states that different self-report instruments, structured interviews, diary studies, and observations could reveal more specific data; this indicates the current study’s instrument limited the possibility of a more in-depth analysis (stated in the paper).
  • The checklist was developed for and tested in a particular teaching context, so the text makes evident that generalization to all contexts is limited (inferred from the paper’s emphasis on local needs and context-specific use).

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.9790/7388-0135570

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

2 Valid · 1 Not valid · 9 Not checked · 49 Own results and interpretations

5 more claims

Create a free account to see all 61 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 22
  • Probably not a substantial claim. 38
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Citations

Cites

Show all 59 references

Research works printed but not linked: 29

  1. [1][1]. Adelson-Godstein, Jayne (2007). Step Forward, Step by Step, Lesson Planning, Oxford University Press -
  2. [3][3]. Al-Saif, Abdullah. (2005). An evaluation of the TEFL textbook for the 6th elementary class in Saudi Arabia . Unpublished MA thesis, 78 pages. Essex University, UK. -
  3. [5][5]. Breen, M. & Candlin, C. (1987). What materials? A consumer's and designer's guide. In L. E. Shelden (ed.). ELT textbook and materials: Problems in evaluation and development. ELT Documents 126. (pp. 13-28) Oxford: Modern English Publications in association with The British Council. -
  4. [16][16]. Daoud, A. M. & Celce-Murcia, M. (1979). Selecting and evaluating a textbook. In M. Celce-Murcia and L. McIntosh, eds. TESL or TEFL Pp: 302-307. New York: News bury House. ELT documents 126.Pp. 29-36, Oxford: Modern English Publications in Associations with the British Council. -
  5. [17][17]. Dougill, J. (1987). Not so Obvious. In L. E. Shelden (ed.). ELT textbook and materials: Problems in evaluation and development -
  6. [20][20]. Ellis, Printha; Wilson, Ken and Taylor, James (2002). Move Ahead. Macmillan Publishers Limited, Cambridge UK -
  7. [26][26]. Garinger, D. (2001). Textbook evaluation. TEFL Web Journal. Retrieved from http://www.teflweb-j.org/v1n1/garinger.html -
  8. [30][30]. Griffiths, C. (1995). Evaluating materials for teaching English to adult speakers of other languages. Forum 33 (3): 50. Retrieved from http://forum.state.gov/vols/vol33/ no3/p50.htm -
  9. [37][37]. Hutchinson, T. & Waters, A. (1987). English for specific purposes: A learning-centered approach . Cambridge: Cambridge University Press. -
  10. [43][43]. Litz, D.R.A. (2005). Textbook Evaluation and ELT Management: A South Korean Case Study. Asian EFL Journal . Retrieved from http://www.asian-efl-journal.com/ Litz\_thesis.pdf -
  11. [45][45]. Ma, Ling-Ling. 2003. Evaluation of current English textbooks for the elementary school: A study of English textbooks designed for the 1st-9th grades curriculum alignment in Taiwan. Unpublished master's thesis, Fu-Jen Catholic University, Taiwan, R.O.C. -
  12. [47][47]. McCarthy,Michael, Mecarten, Jonne, and Sanford, Helen (2010). Touch Stone 3. Cambridge- Obeiko. -
  13. [54][54]. Pan, Pei-hsuan. 2004. Evaluation of learning activities in junior high school English textbooks for Nine-Year Integrated Curriculum. Unpublished master's thesis, National Normal University, Taiwan, R.O.C. -
  14. [57][57]. Rea- Dicckens PP, Germaine K (1994). Evaluation In Canadlin and Widdowson (ed.), Oxford University Press. -
  15. [65][65]. Soori ,A.; Kafipour, R.; and Soury M. (2011) . EFL Textbook Evaluation and Graphic Representation. European Journal of Social Sciences. ISSN 1450-2267 Vol.26 No.3 (2011), pp. 481-493 EuroJournals Publishing, Inc. 2011, http://www. European journal of social sciences.com -
  16. [66][66]. Stake, R. E., Hood, S. and O'Sullivan, R. G. (eds) (1991) Advances in Program Evaluation: A Research Annual: Using Assessment Policy to Reform Education, Part A , Vol. 1(Greenwich, CT: JAI Press). -
  17. [70][70]. Tomlinson, B. et al. (2001). ELT Courses for Adults. ELT Journal, 55(1) 80-101. -
  18. [71][71]. Tucker, C. A. (1978). Evaluating beginning textbooks. In H. S. Madsen and J. D. Bowen. Adaptation in language teaching. Appendix 3 (pp. 219-237). Rowley, Mass: Newbury. -
  19. [75][75]. Rea- Dicckens PP, Germaine K (1994). Evaluation In Canadlin and Widdowson (ed.), Oxford University Press. -
  20. [77][77]. Roberts, J. T. (1996). Demystifying materials evaluation. System , 24 (3): 375-389. -
  21. [78][78]. Robinett, W. (1978). Teaching English to speakers of other languages: Substance and technique . Minneapolis: University of Minnesota Press. -
  22. [81][81]. Sheldon, L. E. (1988) Evaluating ELT textbooks and materials. ELT Journal, 42 (4):237-246. -
  23. [82][82]. Skierso, Alexandra. (1991). Textbook Selection and Evaluation. In M. Celce-Murcia (Ed.), Teaching English as a second or foreign language , 432-453. Boston: Heinle and Heinle Publishers. -
  24. [83][83]. Soori ,A.; Kafipour, R.; and Soury M. (2011) . EFL Textbook Evaluation and Graphic Representation. European Journal of Social Sciences. ISSN 1450-2267 Vol.26 No.3 (2011), pp. 481-493 EuroJournals Publishing, Inc. 2011, http://www. European journal of social sciences.com -
  25. [84][84]. Stake, R. E., Hood, S. and O'Sullivan, R. G. (eds) (1991) Advances in Program Evaluation: A Research Annual: Using Assessment Policy to Reform Education, Part A , Vol. 1(Greenwich, CT: JAI Press). -
  26. [88][88]. Tomlinson, B. (Ed.). (1996). Materials development in language teaching. Cambridge: Cambridge University Press. -
  27. [89][89]. Tomlinson, B. et al. (2001). ELT Courses for Adults. ELT Journal, 55(1) 80-101. -
  28. [90][90]. Tucker, C. A. (1978). Evaluating beginning textbooks. In H. S. Madsen and J. D. Bowen. Adaptation in language teaching. Appendix 3 (pp. 219-237). Rowley, Mass: Newbury. -
  29. [96][96]. Williams, D. 1983. Developing criteria for textbook evaluation. ELT Journal, 37 (3), 251-255 [Electronic version]. -

Cited by

Metadata

Authors
An Assistant Professor at Al Imam Muhammad Bin Saud Islamic University, C. O. L. A. T., & Mohamed, M.
Affiliations
Imam Mohammad ibn Saud Islamic University (SA)
Corresponding author
Mohamed, Montasser
Venue
IOSR Journal of Research & Method in Education (IOSRJRME)
Publisher
IOSR Journals
Published
2013
Volume
1
Issue
3
Pages
55-70
ISSN
  • 2320-737X (ISSN-L)
  • 2320-7388
OpenAlex
W2337919510
Cited by
96
References
78
Citations by year
2026: 2 · 2025: 2 · 2024: 3 · 2023: 13 · 2022: 12 · 2021: 21 · 2020: 10 · 2019: 12 · 2018: 8 · 2017: 7 · 2015: 3 · 2014: 2
FWCI
11.63
Type
journal article
Language
en
Open access
Locations
IOSR Journal of Research & Method in Education (IOSRJRME) (publishedVersion)
Topics
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Social Sciences › Education › English Language Learning and Teaching
  • Social Sciences › Education › Educational Methods and Analysis
Keywords
English textbooks, textbook evaluation, checklist development, English language teaching materials, reliability and validity, curriculum development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Developing an English Language Textbook Evaluative Checklist. https://app.cochat.ai/papers/10.9790/7388-0135570
The paper
An Assistant Professor at Al Imam Muhammad Bin Saud Islamic University, C. O. L. A. T., & Mohamed, M. (2013). Developing an English Language Textbook Evaluative Checklist. IOSR Journal of Research & Method in Education (IOSRJRME). https://doi.org/10.9790/7388-0135570

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.