Evaluation of Concurrent Thinking Aloud Using Eye-tracking Data

Abstract

In a series of studies we addressed the two questions of: 1) Do verbalizations reflect concurrent thought, and 2) Does concurrent thinking aloud differ from normal thinking? The design of experimental tests was based upon Ericsson and Simon's model of thinking aloud, incorporating variations of how information is represented in short term memory. Eye-movement recordings were used as a source of additional data, allowing us to go beyond a mere analysis of solution time and accuracy. Comparing verbalizations and eye-movement data, we arrived at a positive answer to the first of our initial questions. The second question was approached on several levels, always involving a comparison of ‘think-aloud groups’ with silent controls. We found no differences with respect to accuracy, but longer solution times in think-aloud groups. In a final experiment, the influence of thinking aloud on concurrent task performance could be narrowed down to an effect which only persists through the early stages of familiarization with tasks. We conclude that concurrent verbalization is a viable tool in the study of cognitive processes.