The ETS iSkillsTM Assessment: a digital age tool
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Purpose: The purpose of this paper is to show how information and communications technology (ICT) literacy skills reflect twenty‐first century requirements for researching and communicating information in digital environments. An interactive problem‐based, scenario‐based, web‐based assessment tool, iSkills TM, has been developed through a broad‐based effort to establish standards for performance and certification of ICT literacy proficiencies. This paper aims to discuss the assessment's potential in determining the effectiveness of instruction programs. Design/methodology/approach: Since January 2001, a consortium of experts in ICT literacy served as advisors to the Educational Testing Service (ETS) test developers as they designed an internet‐delivered assessment that measures students' abilities to research, organize, and communicate information using technology. This paper reviews that R&D process, concluding with an example of its application to information literacy program planning and evaluation. A mixed methods approach collected and analyzed qualitative sources and iSkills TM pre‐test/post‐test data for first‐year Purdue University students. Findings: Findings informed curricular decisions for instituting an integrated problem‐based learning (PBL) information literacy program. Secondary goals included developing an understanding of how information‐processing skills are acquired, identifying best practices for integrating information literacy into the curriculum, and assessing the impact of skill acquisition on overall academic achievement. ICT literate students are generally better problem‐solvers, more self‐directed, and communicate ideas more efficiently. Practical implications: Universities are beginning to require ICT literacy as competencies for graduation. This paper presents a new strategy for assessing the effectiveness of instructional programs which aim to matriculate proficient students. Originality/value: This paper reports on the efficacy of a problem‐based learning (PBL) approach involving three convergent principles of design: the organization and dissemination of information, the creation and communication of information, and problem solving within the context of research projects and assignments. As such, it provides important insights into pairing an innovative instructional approach and the iSkills TM ICT literacy assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Communities of Practice and Social Learning Systems
Wenger, E. (2000) · Organization · doi:10.1177/135050840072002 · Cited by 4,274 · cited 1×
“An important characteristic of these kinds of activities is that students generate meaningful solutions (descriptions, explanations, and constructions) to integrate into their own knowledge bases and to share with others (Wenger, 2000).”
Conceptions of information literacy: new perspectives and implications
Webber, S., & Johnston, B. (2000) · Journal of Information Science · doi:10.1177/016555150002600602 · Cited by 380
Research works printed but not linked: 32
- Adeyoyin, S.O. (2006), “ICT literacy among the staff of West African University libraries: a comparative study of Anglophone and Francophone countries”, The Electronic Library, Vol. 24 No. 5, pp. 694‐705. · doi:10.1108/02640470610707286
- Adeyoyin, S.O. (2005), “Information and communication technology (ICT) literacy among the staff of Nigerian university libraries”, Library Review, Vol. 54 No. 4, pp. 257‐66. · doi:10.1108/00242530510593443
- Almond, R.G., Steinberg, L.S. and Mislevy, R.J. (2002), “Enhancing the design and delivery of assessment systems: a four‐process architecture”, Journal of Technology, Learning, and Assessment, Vol. 1 No. 5, available at: www.jtla.org.
- Anwar, M.A. and Al‐Ansari, H. (2002), “Developing working LIS professionals in the Gulf Cooperation Council countries: a study of the perceptions of deans and directors of academic libraries”, The Electronic Library, Vol. 20 No. 3, pp. 231‐40. · doi:10.1108/02640470210432384
- Battelle, J. (2005), The Search: How Google and its Rivals Rewrote the Rules of Business and Transformed our Culture, Penguin Press, New York, NY.
- Brasley, S.S. (2006), “Building and using a tool to assess info and tech literacy”, Computers in Libraries, Vol. 26 No. 5, pp. 6‐7, 44‐48.
- Bundy, A. (2004b), “One essential direction: information literacy, information technology fluency”, Journal of eLiteracy, Vol. 1 No. 1, available at: www.jelit.org/archive/00000006.
- Edwards, S.L. and Bruce, C. (2002), “Reflective internet searching: an action research model”, The Learning Organization, Vol. 9 Nos 3/4, pp. 180‐9. · DOI
- Fourie, I. and Bothma, T. (2006), “Addressing the digital divide in teaching information retrieval: a theoretical view on taking students from ICT access to knowledge sharing”, The Electronic Library, Vol. 24 No. 4, pp. 469‐89. · DOI
- Genoni, P., Merrick, H. and Wilson, M.A. (2006), “Scholarly communities, e‐research literacy and the academic librarian”, The Electronic Library, Vol. 24 No. 6, pp. 734‐46. · doi:10.1108/02640470610714189
- Hakkarainen, K., Ilomäki, L., Lipponen, L., Muukkonen, H., Rahikainen, M., Tuominen, T., Lakkala, M. and Lehtinen, E. (2000), “Students' skills and practices of using ICT: results of a national assessment in Finland”, Computers and Education, Vol. 34 No. 2, pp. 103‐17. · DOI · Paper page
- Jain, P. (2006), “Empowering Africa's development using ICT in a knowledge management approach”, The Electronic Library, Vol. 24 No. 1, pp. 51‐67. · doi:10.1108/02640470610649245
- Joint, N. (2005), “Democracy, eliteracy and the internet”, Library Review, Vol. 54 No. 2, pp. 80‐5. · doi:10.1108/00242530510583020
- Katz, I.R. (2005), “Beyond technological competence: literacy in information and communication technology”, Educational Technology, Vol. 45 No. 6, pp. 44‐7.
- Katz, I.R. and Macklin, A.S. (2006), paper presented at the 4th International Conference on Education and Information Systems, Technologies, and Applications (EISTA), Orlando, FL.
- Katz, I.R., Williamson, D.M., Nadelman, H.L., Kirsch, I., Almond, R.G., Cooper, P.L., Readmon, M.L. and Zapata, D. (2004), “Assessing information and communication technology literacy for higher education”, paper presented at the 30th Annual Conference of the International Association of Educational Assessment (IAEA), Philadelphia, Pennsylvania.
- Kennedy, A.J. (2006), “The final hurdle?”, School Library Journal, Vol. 52 No. 3, pp. 62‐4.
- King, S., McMenemy, D. and Poulter, D. (2006), “Effectiveness of ICT training for public library staff in the UK: staff views”, The Electronic Library, Vol. 24 No. 2, pp. 265‐76. · doi:10.1108/02640470610649281
- Lenox, M. and Walker, M. (1992), “Information literacy: challenges for the future”, International Journal of Information and Library Research, Vol. 4, pp. 1‐17.
- Lesh, R. and Harel, G. (2003), “Problem solving, modeling, and local conceptual development”, Mathematical Thinking & Learning, Vol. 5 Nos 2/3, pp. 157‐89. · DOI · Paper page
- Lippincott, J.K. (2005), “Net Generation students and libraries”, Educause Review, Vol. 40, pp. 43‐8.
- McLelland, D. and Crawford, J. (2004), “The Drumchapel Project: a study of ICT usage by school pupils and teachers in a secondary school in a deprived area of Glasgow”, Journal of Librarianship and Information Science, Vol. 36 No. 2, pp. 55‐67. · doi:10.1177/0961000604046286
- McMannus, T.L. (2005), “Assessing proficiencies in higher education: benchmarking knowledge and ICT skills of students at an urban community college”, Community and Junior College Libraries, Vol. 13 No. 3, pp. 43‐51. · doi:10.1300/j107v13n03_06
- Macklin, A.S. (2002), “Integrating information literacy using problem‐based problem‐based learning”, Reference Services Review, Vol. 29 No. 4, pp. 306‐14. · doi:10.1108/eum0000000006493
- Markauskaite, L. (2006), “Toward an integrated analytical framework of information and communications technology literacy: from intended to implemented and achieved dimensions”, Information Research – An International Electronic Journal, Vol. 11 No. 3, available at: http://informationr.net/ir/11‐3/infres113.html.
- Messick, S. (1989), “Validity”, in Linn, R.L. (Ed.), Educational Measurement, 3rd ed., MacMillian, New York, NY, pp. 13‐103.
- Mislevy, R.J. (1994), “Evidence and inference in educational assessment”, Psychometrika, Vol. 59, pp. 439‐83. · DOI
- Paul, J. (2002), “Narrowing the digital divide: initiatives undertaken by the Association of South‐East Nations (ASEAN)”, The Electronic Library, Vol. 36 No. 1, pp. 13‐22. · DOI
- Rockman, I. (2005), “Editorial: ICT literacy”, Reference Services Review, Vol. 33 No. 2, pp. 141‐3. · DOI
- Rockman, I. and Smith, G. (2005), “Information and communication technology literacy: new assessments for higher education”, College & Research Libraries News, Vol. 66 No. 8, pp. 587‐9.
- Rosenberg, D. (2006), “Toward the digital library in Africa”, The Electronic Library, Vol. 24 No. 3, pp. 289‐93. · doi:10.1108/02640470610671150
- Somerville, M.M., Lampert, L.D., Dabbour, K.S., Harlan, S. and Schader, B. (2007), “Toward large scale assessment of information and communication technology literacy: implementation considerations for the ETS ICT literacy instrument”, Reference Service Review, Vol. 35 No. 1, pp. 8‐20. · DOI
Cited by
The relation between 21st-century skills and digital skills: A systematic literature review
van Laar, E., van Deursen, A. J. A. M., van Dijk, J. A. G. M., & de Haan, J. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.03.010 · Cited by 2,006
Siddiq, F., Hatlevik, O. E., Olsen, R. V., Throndsen, I., & Scherer, R. (2016) · Educational Research Review · doi:10.1016/j.edurev.2016.05.002 · Cited by 269
Gender and socioeconomic related differences in performance based ICT competences
Aesaert, K., & van Braak, J. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.12.017 · Cited by 188
Aesaert, K., van Nijlen, D., Vanderlinde, R., & van Braak, J. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.03.013 · Cited by 132
Metadata
- Authors
- Somerville, M. M., Smith, G. W., & Smith Macklin, A.
- Venue
- The Electronic Library
- Publisher
- Emerald
- Published
- 2008-04-11
- Volume
- 26
- Issue
- 2
- Pages
- 158-171
- ISSN
- 0264-0473 (ISSN-L)
- OpenAlex
- W2050523412
- Cited by
- 42
- References
- 2
- FWCI
- 20.65
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.emerald.com/insight/site-policies (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.