Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

because observed behavior is the result of interactions between environmental factors and genes during the extended period of development. Therefore, to better understand expert and exceptional performance, we must require that the account specify the different environmental factors that could selectively promote and facilitate the achievement of such performance. In addition, recent research on expert performance and expertise (Chi, Glaser, & Farr, 1988; Ericsson & Smith, 1991a) has shown that important characteristics of experts' superior performance are acquired through experience and that the effect of practice on performance is larger than earlier believed possible. For this reason, an account of exceptional performance must specify the environmental circumstances, such as the duration and structure of activities, and necessary minimal biological attributes that lead to the acquisition of such characteristics and a corresponding level of performance. An account that explains how a majority of individuals can attain a given level of expert performance might seem inherently unable to explain the exceptional performance of only a small number of individuals. However, if such an empirical account could be empirically supported, then the extreme characteristics of experts could be viewed as having been acquired through learning and adaptation, and studies of expert performance could provide unique insights into the possibilities and limits of change in cognitive capacities and bodily functions. In this article we propose a theoretical framework that explains expert performance in terms of acquired characteristics resulting from extended deliberate practice and that limits the role of innate (inherited) characteristics to general levels of activity and emotionality. We provide empirical support from two new studies and from already published evidence on expert performance in many different domains.

/pdf/the-role-of-deliberate-practice-in-the-acquisition-of-expert-3j9768t5su.pdf

The role of deliberate practice in the acquisition of expert performance.

Miller (1956) summarized evidence that people can remember about seven chunks in short-term memory (STM) tasks. How- ever, that number was meant more as a rough estimate and a rhetorical device than as a real capacity limit. Others have since suggested that there is a more precise capacity limit, but that it is only three to five chunks. The present target article brings together a wide vari- ety of data on capacity limits suggesting that the smaller capacity limit is real. Capacity limits will be useful in analyses of information processing only if the boundary conditions for observing them can be carefully described. Four basic conditions in which chunks can be identified and capacity limits can accordingly be observed are: (1) when information overload limits chunks to individual stimulus items, (2) when other steps are taken specifically to block the recoding of stimulus items into larger chunks, (3) in performance discontinuities caused by the capacity limit, and (4) in various indirect effects of the capacity limit. Under these conditions, rehearsal and long-term memory cannot be used to combine stimulus items into chunks of an unknown size; nor can storage mechanisms that are not capacity- limited, such as sensory memory, allow the capacity-limited storage mechanism to be refilled during recall. A single, central capacity limit averaging about four chunks is implicated along with other, noncapacity-limited sources. The pure STM capacity limit expressed in chunks is distinguished from compound STM limits obtained when the number of separately held chunks is unclear. Reasons why pure capacity estimates fall within a narrow range are discussed and a capacity limit for the focus of attention is proposed.

/pdf/the-magical-number-4-in-short-term-memory-a-reconsideration-3704b9phuz.pdf

The magical number 4 in short-term memory: a reconsideration of mental storage capacity.

Cognitive load theory has been designed to provide guidelines intended to assist in the presentation of information in a manner that encourages learner activities that optimize intellectual performance. The theory assumes a limited capacity working memory that includes partially independent subcomponents to deal with auditory/verbal material and visual/2- or 3-dimensional information as well as an effectively unlimited long-term memory, holding schemas that vary in their degree of automation. These structures and functions of human cognitive architecture have been used to design a variety of novel instructional procedures based on the assumption that working memory load should be reduced and schema construction encouraged. This paper reviews the theory and the instructional designs generated by it.

Cognitive Architecture and Instructional Design

A theory of the way working memory capacity constrains comprehension is proposed. The theory proposes that both processing and storage are mediated by activation and that the total amount of activation available in working memory varies among individuals. Individual differences in working memory capacity for language can account for qualitative and quantitative differences among college-age adults in several aspects of language comprehension. One aspect is syntactic modularity: The larger capacity of some individuals permits interaction among syntactic and pragmatic information, so that their syntactic processes are not informationally encapsulated. Another aspect is syntactic ambiguity: The larger capacity of some individuals permits them to maintain multiple interpretations. The theory is instantiated as a production system model in which the amount of activation available to the model affects how it adapts to the transient computational and storage demands that occur in comprehension.

/pdf/a-capacity-theory-of-comprehension-individual-differences-in-4pgbsbb38c.pdf

A capacity theory of comprehension: individual differences in working memory.

Why are some problems hard? Evidence from Tower of Hanoi ☆

Human acquisition of concepts for sequential patterns.

Here, several leading experts in the area of cognitive science summarize their current research programs, tracing Herbert A Simon's influence on their own work -- and on the field of information processing at large Topics covered include problem- solving, imagery, reading, writing, memory, expertise, instruction, and learning Collectively, the chapters reveal a high degree of coherence across the various specialized disciplines within cognition -- a coherence largely attributable to the initial unity in Simon's seminal and pioneering contributions

Complex Information Processing: The Impact of Herbert A. Simon

Drawing inspiration from examples by analogy can be a powerful tool for innovative design during conceptual ideation but also carries the risk of negative design outcomes (e.g., design fixation), depending on key properties of examples. Understanding these properties is critical for effectively harnessing the power of analogy. The current research explores how variations in analogical distance, commonness, and representation modality influence the effects of examples on conceptual ideation. Senior-level engineering students generated solution concepts for an engineering design problem with or without provided examples drawn from the U.S. Patent database. Examples were crossed by analogical distance (near-field vs. far-field), commonness (more vs. less-common), and modality (picture vs. text). A control group that received no examples was included for comparison. Effects were examined on a mixture of ideation process and product variables. Our results show positive effects of far-field and less-common examples on novelty and variability in quality of solution concepts. These effects are not modulated by modality. However, detailed analyses of process variables suggest divergent inspiration pathways for far-field vs. less-common examples. Additionally, the combination of far-field, less-common examples resulted in more novel concepts than in the control group. These findings suggest guidelines for the effective design and implementation of design-by-analogy methods, particularly a focus on far-field, less-common examples during the ideation process. © 2011 American Society of Mechanical Engineers.

/pdf/on-the-benefits-and-pitfalls-of-analogies-for-innovative-2bi1htt61m.pdf

On the benefits and pitfalls of analogies for innovative design : Ideation performance based on analogical distance, commonness, and modality of examples

This work lends insight into the meaning and impact of “near” and “far” analogies. A cognitive engineering design study is presented that examines the effect of the distance of analogical design stimuli on design solution generation, and places those findings in context of results from the literature. The work ultimately sheds new light on the impact of analogies in the design process and the significance of their distance from a design problem. In this work, the design repository from which analogical stimuli are chosen is the U.S. patent database, a natural choice, as it is one of the largest and easily accessed catalogued databases of inventions. The “near” and “far” analogical stimuli for this study were chosen based on a structure of patents, created using a combination of Latent Semantic Analysis and a Bayesian based algorithm for discovering structural form, resulting in clusters of patents connected by their relative similarity. The findings of this engineering design study are contextualized with the findings of recent work in design by analogy, by mapping the analogical stimuli used in the earlier work into similar structures along with the patents used in the current study. Doing so allows the discovery of a relationship between all of the stimuli and their relative distance from the design problem. The results confirm that “near” and “far” are relative terms, and depend on the characteristics of the potential stimuli. Further, although the literature has shown that “far” analogical stimuli are more likely to lead to the generation innovative solutions with novel characteristics, there is such a thing as too far. That is, if the stimuli are too distant, they then can become harmful to the design process. Importantly, as well, the data mapping approach to identify analogies works, and is able to impact the effectiveness of the design process. This work has implications not only in the area of finding inspirational designs to use for design by analogy processes in practice, but also for synthesis, or perhaps even unification, of future studies in the field of design by analogy.

/pdf/the-meaning-of-near-and-far-the-impact-of-structuring-design-ze82ow4zok.pdf

Kenneth Kotovsky

Papers

Why are some problems hard? Evidence from Tower of Hanoi ☆

Human acquisition of concepts for sequential patterns.

Complex Information Processing: The Impact of Herbert A. Simon

On the benefits and pitfalls of analogies for innovative design : Ideation performance based on analogical distance, commonness, and modality of examples

The meaning of "near" and "far": the impact of structuring design databases and the effect of distance of analogy on design output