Decision Support System Effectiveness: A Review and an Empirical Test

Abstract

Despite the increasing popularity of decision support systems (DSS), effectiveness of such systems remains unproven. Past research claiming usefulness of the DSS has relied largely on anecdotal or case data. The relatively few laboratory experiments report mixed results regarding the effects of a decision aid. This study reviews the results of prior investigations and examines the effectiveness of DSS-aided decision makers relative to decision makers without a DSS over an eight-week period. An executive decision making game was used in two sections of a business strategy course. Three-person teams in one section used a DSS while the teams in the other section played the game without such an aid. Various measures of decision quality were recorded. Overall, the groups with access to the DSS made significantly more effective decisions in the business simulation game than their non-DSS counterparts. The DSS groups took more time to make their decisions than the non-DSS groups at the beginning of the experiment. However, the decision times converged after the third week. The DSS teams reported investigating more alternatives and exhibited a higher confidence level in their decisions than the non-DSS groups, but these differences were not statistically significant.