Development and Measurement Validity of a Task‐Technology Fit Instrument for User Evaluations of Information System

Abstract

Although many researchers have raised concerns about the lack of theoretical underpinnings for the user evaluation construct and the lack of measurement validity for specific instruments measuring it, the construct is still widely used in IS research. This paper reports on the development and measurement validity of a diagnostic tool used in recently published research to evaluate an organization's overall information systems and services. A distinctive feature of this instrument is that it is conceptually based on the task‐technology fit theory in which the correspondence between information systems functionality and task requirements leads to positive user evaluations, and positive performance impacts. Specifically, the instrument development was guided by a task model of managerial decision making using recorded organizational information. This model suggested the different information systems functionalities required by users for that task, which then serve as the basis for a “task‐technology fit” (TTF) instrument. The instrument thus measures the degree to which an organization's information systems and services meet the information needs of its managers. An extensive test of the measurement validity of the instrument is conducted using a sample of 357 users in 10 companies. It is found to have excellent reliability and discriminant validity for 12 dimensions of TTF, and also exhibits strong predictive validity. Finally, the instrument is compared to two other well‐known user evaluation instruments. Though no single instrument can meet all needs, the instrument presented here should be considered an attractive option for researchers and practitioners seeking to measure the effectiveness of organizational information systems.