Design Experiments in Educational Research

TLDR: Design experiments have both a pragmatic bent and a theoretical orientation as mentioned in this paper, developing domain-specific theories by systematically studying those forms of learning and the means of supporting them, and the authors clarify what is involved in preparing for and carrying out a design experiment, and conduct a retrospective analysis of the extensive, longitudinal data sets generated during an experiment.

Abstract: In this article, the authors first indicate the range of purposes and the variety of settings in which design experiments have been conducted and then delineate five crosscutting features that collectively differentiate design experiments from other methodologies. Design experiments have both a pragmatic bent—“engineering” particular forms of learning—and a theoretical orientation—developing domain-specific theories by systematically studying those forms of learning and the means of supporting them. The authors clarify what is involved in preparing for and carrying out a design experiment, and in conducting a retrospective analysis of the extensive, longitudinal data sets generated during an experiment. Logistical issues, issues of measure, the importance of working through the data systematically, and the need to be explicit about the criteria for making inferences are discussed.