Design science in Information Systems (IS) research pertains to the creation of artifacts to solve reallife problems. Research on IS artifact evaluation remains at an early stage. In the design-science research literature, evaluation criteria are presented in a fragmented or incomplete manner. This paper addresses the following research questions: which criteria are proposed in the literature to evaluate IS artifacts? Which ones are actually used in published research? How can we structure these criteria? Finally, which evaluation methods emerge as generic means to assess IS artifacts? The artifact resulting from our research comprises three main components: a hierarchy of evaluation criteria for IS artifacts organized according to the dimensions of a system (goal, environment, structure, activity, and evolution), a model providing a high-level abstraction of evaluation methods, and finally, a set of generic evaluation methods which are instantiations of this model. These methods result from an inductive study of twenty-six recently published papers.

/pdf/artifact-evaluation-in-information-systems-design-science-213c7nydyb.pdf

Artifact evaluation in information systems design-science research ? A holistic view

Data summarization has recently received considerable attention in the information technology community. This design research paper discusses the methodology and principles of the design of data summarization engine. Based on an initial analysis of requirement representations in data summarization, it proposes a generic organization of ontology for data summarization engine. Furthermore, this paper proposes a design framework for data summarization engine that uses the ontology as the fundamental structure of the interactive user-computer interface. A prototype project of ontology-based data summarization engine for summarizing the data incompleteness demonstrates the effectiveness of the design of ontology-based data summarization engine.

Shouhong Wang

Papers

Ontology-Based Data Summarization Engine: A Design Methodology