CoChat

The ETS iSkillsTM Assessment: a digital age tool

Somerville, Mary M., Smith, Gordon W., Smith Macklin, Alexius · 2008 · The Electronic Library
Cited by 42

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Abstract

Purpose: The purpose of this paper is to show how information and communications technology (ICT) literacy skills reflect twenty‐first century requirements for researching and communicating information in digital environments. An interactive problem‐based, scenario‐based, web‐based assessment tool, iSkills TM, has been developed through a broad‐based effort to establish standards for performance and certification of ICT literacy proficiencies. This paper aims to discuss the assessment's potential in determining the effectiveness of instruction programs. Design/methodology/approach: Since January 2001, a consortium of experts in ICT literacy served as advisors to the Educational Testing Service (ETS) test developers as they designed an internet‐delivered assessment that measures students' abilities to research, organize, and communicate information using technology. This paper reviews that R&D process, concluding with an example of its application to information literacy program planning and evaluation. A mixed methods approach collected and analyzed qualitative sources and iSkills TM pre‐test/post‐test data for first‐year Purdue University students. Findings: Findings informed curricular decisions for instituting an integrated problem‐based learning (PBL) information literacy program. Secondary goals included developing an understanding of how information‐processing skills are acquired, identifying best practices for integrating information literacy into the curriculum, and assessing the impact of skill acquisition on overall academic achievement. ICT literate students are generally better problem‐solvers, more self‐directed, and communicate ideas more efficiently. Practical implications: Universities are beginning to require ICT literacy as competencies for graduation. This paper presents a new strategy for assessing the effectiveness of instructional programs which aim to matriculate proficient students. Originality/value: This paper reports on the efficacy of a problem‐based learning (PBL) approach involving three convergent principles of design: the organization and dissemination of information, the creation and communication of information, and problem solving within the context of research projects and assignments. As such, it provides important insights into pairing an innovative instructional approach and the iSkills TM ICT literacy assessment.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1108/02640470810864064

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 2 references

Research works printed but not linked: 32

  1. Adeyoyin, S.O. (2006), “ICT literacy among the staff of West African University libraries: a comparative study of Anglophone and Francophone countries”, The Electronic Library, Vol. 24 No. 5, pp. 694‐705. · doi:10.1108/02640470610707286
  2. Adeyoyin, S.O. (2005), “Information and communication technology (ICT) literacy among the staff of Nigerian university libraries”, Library Review, Vol. 54 No. 4, pp. 257‐66. · doi:10.1108/00242530510593443
  3. Almond, R.G., Steinberg, L.S. and Mislevy, R.J. (2002), “Enhancing the design and delivery of assessment systems: a four‐process architecture”, Journal of Technology, Learning, and Assessment, Vol. 1 No. 5, available at: www.jtla.org.
  4. Anwar, M.A. and Al‐Ansari, H. (2002), “Developing working LIS professionals in the Gulf Cooperation Council countries: a study of the perceptions of deans and directors of academic libraries”, The Electronic Library, Vol. 20 No. 3, pp. 231‐40. · doi:10.1108/02640470210432384
  5. Battelle, J. (2005), The Search: How Google and its Rivals Rewrote the Rules of Business and Transformed our Culture, Penguin Press, New York, NY.
  6. Brasley, S.S. (2006), “Building and using a tool to assess info and tech literacy”, Computers in Libraries, Vol. 26 No. 5, pp. 6‐7, 44‐48.
  7. Bundy, A. (2004b), “One essential direction: information literacy, information technology fluency”, Journal of eLiteracy, Vol. 1 No. 1, available at: www.jelit.org/archive/00000006.
  8. Edwards, S.L. and Bruce, C. (2002), “Reflective internet searching: an action research model”, The Learning Organization, Vol. 9 Nos 3/4, pp. 180‐9. · DOI
  9. Fourie, I. and Bothma, T. (2006), “Addressing the digital divide in teaching information retrieval: a theoretical view on taking students from ICT access to knowledge sharing”, The Electronic Library, Vol. 24 No. 4, pp. 469‐89. · DOI
  10. Genoni, P., Merrick, H. and Wilson, M.A. (2006), “Scholarly communities, e‐research literacy and the academic librarian”, The Electronic Library, Vol. 24 No. 6, pp. 734‐46. · doi:10.1108/02640470610714189
  11. Hakkarainen, K., Ilomäki, L., Lipponen, L., Muukkonen, H., Rahikainen, M., Tuominen, T., Lakkala, M. and Lehtinen, E. (2000), “Students' skills and practices of using ICT: results of a national assessment in Finland”, Computers and Education, Vol. 34 No. 2, pp. 103‐17. · DOI · Paper page
  12. Jain, P. (2006), “Empowering Africa's development using ICT in a knowledge management approach”, The Electronic Library, Vol. 24 No. 1, pp. 51‐67. · doi:10.1108/02640470610649245
  13. Joint, N. (2005), “Democracy, eliteracy and the internet”, Library Review, Vol. 54 No. 2, pp. 80‐5. · doi:10.1108/00242530510583020
  14. Katz, I.R. (2005), “Beyond technological competence: literacy in information and communication technology”, Educational Technology, Vol. 45 No. 6, pp. 44‐7.
  15. Katz, I.R. and Macklin, A.S. (2006), paper presented at the 4th International Conference on Education and Information Systems, Technologies, and Applications (EISTA), Orlando, FL.
  16. Katz, I.R., Williamson, D.M., Nadelman, H.L., Kirsch, I., Almond, R.G., Cooper, P.L., Readmon, M.L. and Zapata, D. (2004), “Assessing information and communication technology literacy for higher education”, paper presented at the 30th Annual Conference of the International Association of Educational Assessment (IAEA), Philadelphia, Pennsylvania.
  17. Kennedy, A.J. (2006), “The final hurdle?”, School Library Journal, Vol. 52 No. 3, pp. 62‐4.
  18. King, S., McMenemy, D. and Poulter, D. (2006), “Effectiveness of ICT training for public library staff in the UK: staff views”, The Electronic Library, Vol. 24 No. 2, pp. 265‐76. · doi:10.1108/02640470610649281
  19. Lenox, M. and Walker, M. (1992), “Information literacy: challenges for the future”, International Journal of Information and Library Research, Vol. 4, pp. 1‐17.
  20. Lesh, R. and Harel, G. (2003), “Problem solving, modeling, and local conceptual development”, Mathematical Thinking & Learning, Vol. 5 Nos 2/3, pp. 157‐89. · DOI · Paper page
  21. Lippincott, J.K. (2005), “Net Generation students and libraries”, Educause Review, Vol. 40, pp. 43‐8.
  22. McLelland, D. and Crawford, J. (2004), “The Drumchapel Project: a study of ICT usage by school pupils and teachers in a secondary school in a deprived area of Glasgow”, Journal of Librarianship and Information Science, Vol. 36 No. 2, pp. 55‐67. · doi:10.1177/0961000604046286
  23. McMannus, T.L. (2005), “Assessing proficiencies in higher education: benchmarking knowledge and ICT skills of students at an urban community college”, Community and Junior College Libraries, Vol. 13 No. 3, pp. 43‐51. · doi:10.1300/j107v13n03_06
  24. Macklin, A.S. (2002), “Integrating information literacy using problem‐based problem‐based learning”, Reference Services Review, Vol. 29 No. 4, pp. 306‐14. · doi:10.1108/eum0000000006493
  25. Markauskaite, L. (2006), “Toward an integrated analytical framework of information and communications technology literacy: from intended to implemented and achieved dimensions”, Information Research – An International Electronic Journal, Vol. 11 No. 3, available at: http://informationr.net/ir/11‐3/infres113.html.
  26. Messick, S. (1989), “Validity”, in Linn, R.L. (Ed.), Educational Measurement, 3rd ed., MacMillian, New York, NY, pp. 13‐103.
  27. Mislevy, R.J. (1994), “Evidence and inference in educational assessment”, Psychometrika, Vol. 59, pp. 439‐83. · DOI
  28. Paul, J. (2002), “Narrowing the digital divide: initiatives undertaken by the Association of South‐East Nations (ASEAN)”, The Electronic Library, Vol. 36 No. 1, pp. 13‐22. · DOI
  29. Rockman, I. (2005), “Editorial: ICT literacy”, Reference Services Review, Vol. 33 No. 2, pp. 141‐3. · DOI
  30. Rockman, I. and Smith, G. (2005), “Information and communication technology literacy: new assessments for higher education”, College & Research Libraries News, Vol. 66 No. 8, pp. 587‐9.
  31. Rosenberg, D. (2006), “Toward the digital library in Africa”, The Electronic Library, Vol. 24 No. 3, pp. 289‐93. · doi:10.1108/02640470610671150
  32. Somerville, M.M., Lampert, L.D., Dabbour, K.S., Harlan, S. and Schader, B. (2007), “Toward large scale assessment of information and communication technology literacy: implementation considerations for the ETS ICT literacy instrument”, Reference Service Review, Vol. 35 No. 1, pp. 8‐20. · DOI

Cited by

See all 42

Metadata

Authors
Somerville, M. M., Smith, G. W., & Smith Macklin, A.
Venue
The Electronic Library
Publisher
Emerald
Published
2008-04-11
Volume
26
Issue
2
Pages
158-171
ISSN
0264-0473 (ISSN-L)
OpenAlex
W2050523412
Cited by
42
References
2
FWCI
20.65
Type
journal article
Language
en
Open access
closed
Licence
www.emerald.com/insight/site-policies (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The ETS iSkillsTM Assessment: a digital age tool. https://app.cochat.ai/papers/10.1108/02640470810864064
The paper
Somerville, M. M., Smith, G. W., & Smith Macklin, A. (2008). The ETS iSkillsTM Assessment: a digital age tool. The Electronic Library. https://doi.org/10.1108/02640470810864064

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.