This paper presents the top 10 data mining algorithms identified by the IEEE International Conference on Data Mining (ICDM) in December 2006: C4.5, k-Means, SVM, Apriori, EM, PageRank, AdaBoost, kNN, Naive Bayes, and CART. These top 10 algorithms are among the most influential data mining algorithms in the research community. With each algorithm, we provide a description of the algorithm, discuss the impact of the algorithm, and review current and further research on the algorithm. These 10 algorithms cover classification, clustering, statistical learning, association analysis, and link mining, which are all among the most important topics in data mining research and development.

/pdf/top-10-algorithms-in-data-mining-70qtv03lc6.pdf

Top 10 algorithms in data mining

Cluster analysis is a primary method for database mining. It is either used as a stand-alone tool to get insight into the distribution of a data set, e.g. to focus further analysis and data processing, or as a preprocessing step for other algorithms operating on the detected clusters. Almost all of the well-known clustering algorithms require input parameters which are hard to determine but have a significant influence on the clustering result. Furthermore, for many real-data sets there does not even exist a global parameter setting for which the result of the clustering algorithm describes the intrinsic clustering structure accurately. We introduce a new algorithm for the purpose of cluster analysis which does not produce a clustering of a data set explicitly; but instead creates an augmented ordering of the database representing its density-based clustering structure. This cluster-ordering contains information which is equivalent to the density-based clusterings corresponding to a broad range of parameter settings. It is a versatile basis for both automatic and interactive cluster analysis. We show how to automatically and efficiently extract not only 'traditional' clustering information (e.g. representative points, arbitrary shaped clusters), but also the intrinsic clustering structure. For medium sized data sets, the cluster-ordering can be represented graphically and for very large data sets, we introduce an appropriate visualization technique. Both are suitable for interactive exploration of the intrinsic clustering structure offering additional insights into the distribution and correlation of the data.

OPTICS: ordering points to identify the clustering structure

This introduction presents the main motivations for the development of Description Logics (DLs) as a formalism for representing knowledge, as well as some important basic notions underlying all systems that have been created in the DL tradition. In addition, we provide the reader with an overview of the entire book and some guidelines for reading it. We first address the relationship between Description Logics and earlier semantic network and frame systems, which represent the original heritage of the field. We delve into some of the key problems encountered with the older efforts. Subsequently, we introduce the basic features of DL languages and related reasoning techniques. DL languages are then viewed as the core of knowledge representation systems, considering both the structure of a DL knowledge base and its associated reasoning services. The development of some implemented knowledge representation systems based on Description Logics and the first applications built with such systems are then reviewed. Finally, we address the relationship of Description Logics to other fields of Computer Science.We also discuss some extensions of the basic representation language machinery; these include features proposed for incorporation in the formalism that originally arose in implemented systems, and features proposed to cope with the needs of certain application domains.

https://assets.cambridge.org/97805218/76254/frontmatter/9780521876254_frontmatter.pdf

The Description Logic Handbook

Recently, a number of algorithms inspired by the foraging behavior of ant colonies have been applied to the solution of difficult discrete optimization problems. We put these algorithms in a common framework by defining the Ant Colony Optimization (ACO) meta-heuristic. A couple of paradigmatic examples of applications of these novel meta-heuristic are given, as well as a brief overview of existing applications.

Ant colony optimization: a new meta-heuristic

This paper presents a survey of evolutionary algorithms designed for clustering tasks. It tries to reflect the profile of this area by focusing more on those subjects that have been given more importance in the literature. In this context, most of the paper is devoted to partitional algorithms that look for hard clusterings of data, though overlapping (i.e., soft and fuzzy) approaches are also covered in the paper. The paper is original in what concerns two main aspects. First, it provides an up-to-date overview that is fully devoted to evolutionary algorithms for clustering, is not limited to any particular kind of evolutionary approach, and comprises advanced topics like multiobjective and ensemble-based evolutionary clustering. Second, it provides a taxonomy that highlights some very important aspects in the context of evolutionary data clustering, namely, fixed or variable number of clusters, cluster-oriented or nonoriented operators, context-sensitive or context-insensitive operators, guided or unguided operators, binary, integer, or real encodings, centroid-based, medoid-based, label-based, tree-based, or graph-based representations, among others. A number of references are provided that describe applications of evolutionary algorithms for clustering in different domains, such as image processing, computer security, and bioinformatics. The paper ends by addressing some important issues and open questions that can be subject of future research.

/pdf/a-survey-of-evolutionary-algorithms-for-clustering-2mqgdycpl7.pdf

A Survey of Evolutionary Algorithms for Clustering

The authors provide an overview of the current research and development directions in knowledge and data engineering. They classify research problems and approaches in this area and discuss future trends. Research on knowledge and data engineering is examined with respect to programmability and representation, design tradeoffs, algorithms and control, and emerging technologies. Future challenges are considered with respect to software and hardware architecture and system design. The paper serves as an introduction to this first issue of a new quarter. >

Knowledge and data engineering

Computers for Symbolic Processing (B. Wah, et al.) LANGUAGE-BASED AI ARCHITECTURES Architectural Features of Lisp Computers (A. Pleszkun & M. Thazhuthaveetil) Symbolics Architecture (D. Moon) Memory Management and Usage in a Lisp System: A Measurement-Based Study (R. Llames & R. Iyer) Multiprocessor Architectural Support for Balanced Lisp Processing (R. Chowkwanyun & K. Hwang) Data-Flow Computing Models, Logic and Functional Languages, and Data-Flow Machines for Intelligence Computations (J. Herath, et al.) Design Decisions in SPUR (M. Hill, et al.) What Price Smalltalk? (D. Ungar & D. Patterson) Special Purpose Chip for Production Systems (G. Alley, et al.) MULTIPROCESSOR AI ARCHITECTURE Applications of the Connection Machine (D. Waltz) A Database Machine Based on Concatenated Code Words for Very Large Databases (S. Chung & P. Berra) CONNECTIONIST ARCHITECTURES AND APPLICATIONS Connectionist Architectures for Artificial Intelligence (S. Fahlman & G. Hinton) Architectures for Strategy Learning (P. Mehra & B. Wah) SOFTWARE ARCHITECTURES FOR AI APPLICATIONS AI and Software Engineering: A Clash of Cultures? (W. Tsai, et al.) Development Support for AI Programs (C. Ramamoorthy, et al.) Reliability of AI Programs (F. Bastani) Index.

C. V. Ramamoorthy

Papers

Knowledge and data engineering

Computers for artificial intelligence processing