An Assessment of Group Support Systems Experimental Research: Methodology and Results

Abstract

:By mid-1998, approximately 200 different controlled experiments had been published in 230 articles in refereed journals or major conference proceedings, which examined processes and outcomes in computer-supported group decision making. This paper is a concise overview of what has been studied and how: the systems, independent, intervening, adaptation, and dependent variables, manipulated or measured, and experimental procedures employed. Part I categorizes the contextual and intervening factors. Part II analyzes 1,582 hypotheses resulting from pairings of independent and dependent variables. The results show that the modal outcome for GSS systems compared with face-to-face (FtF) methods is “no difference,” while the overall percentage of positive effects for hypotheses that compare GSS with FtF is a disappointing 16.6 percent. Experiments with seven to ten groups per treatment condition working on idea-generation tasks and using GSS technology show an improvement up to 29.0 percent. These results are moderated by technology, process structure, communication mode, group factors, task type, the number of experimental groups per treatment condition, and the type of dependent variable measured. The purpose of this paper is to aid the GSS researcher by presenting detailed results of what has been studied and found in previous experiments, along with a discussion of what needs to be studied.