Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives when interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning. Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications. The only necessary mathematical background is familiarity with elementary concepts of probability. The book is divided into three parts. Part I defines the reinforcement learning problem in terms of Markov decision processes. Part II provides basic solution methods: dynamic programming, Monte Carlo methods, and temporal-difference learning. Part III presents a unified view of the solution methods and incorporates artificial neural networks, eligibility traces, and planning; the two final chapters present case studies and consider the future of reinforcement learning.

/pdf/reinforcement-learning-an-introduction-rzxgej9p17.pdf

Reinforcement Learning: An Introduction

A general theory of domain identification is used to describe achievement barriers still faced by women in advanced quantitative areas and by African Americans in school. The theory assumes that sustained school success requires identification with school and its subdomains; that societal pressures on these groups (e.g., economic disadvantage, gender roles) can frustrate this identification; and that in school domains where these groups are negatively stereotyped, those who have become domain identified face the further barrier of stereotype threat, the threat that others' judgments or their own actions will negatively stereotype them in the domain. Research shows that this threat dramatically depresses the standardized test performance of women and African Americans who are in the academic vanguard of their groups (offering a new interpretation of group differences in standardized test performance), that it causes disidentification with school, and that practices that reduce this threat can reduce these negative effects.

/pdf/a-threat-in-the-air-how-stereotypes-shape-intellectual-gysdupurbr.pdf

A Threat in the Air How Stereotypes Shape Intellectual Identity and Performance

A model of the neuropsychology of anxiety is proposed. The model is based in the first instance upon an analysis of the behavioural effects of the antianxiety drugs (benzodiazepines, barbiturates, and alcohol) in animals. From such psychopharmacologi-cal experiments the concept of a “behavioural inhibition system” (BIS) has been developed. This system responds to novel stimuli or to those associated with punishment or nonreward by inhibiting ongoing behaviour and increasing arousal and attention to the environment. It is activity in the BIS that constitutes anxiety and that is reduced by antianxiety drugs. The effects of the antianxiety drugs in the brain also suggest hypotheses concerning the neural substrate of anxiety. Although the benzodiazepines and barbiturates facilitate the effects of γ-aminobutyrate, this is insufficient to explain their highly specific behavioural effects. Because of similarities between the behavioural effects of certain lesions and those of the antianxiety drugs, it is proposed that these drugs reduce anxiety by impairing the functioning of a widespread neural system including the septo-hippocampal system (SHS), the Papez circuit, the prefrontal cortex, and ascending monoaminergic and cholinergic pathways which innervate these forebrain structures. Analysis of the functions of this system (based on anatomical, physiological, and behavioural data) suggests that it acts as a comparator: it compares predicted to actual sensory events and activates the outputs of the BIS when there is a mismatch or when the predicted event is aversive. Suggestions are made as to the functions of particular pathways within this overall brain system. The resulting theory is applied to the symptoms and treatment of anxiety in man, its relations to depression, and the personality of individuals who are susceptible to anxiety or depression.

https://www.cambridge.org/core/services/aop-cambridge-core/content/view/S0140525X00013066

Précis of The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo-Hippocampal System..

A protection motivation theory is proposed that postulates the three crucial components of a fear appeal to be (a) the magnitude of noxiousness of a depicted event; (b) the probability of that event's occurrence; and (c) the efficacy of a protective response. Each of these communication variables initiates corresponding cognitive appraisal processes that mediate attitude change. The proposed conceptualization is a special case of a more comprehensive theoretical schema: expectancy-value theories. Several suggestions are offered for reinterpreting existing data, designing new types of empirical research, and making future studies more comparable. Finally, the principal advantages of protection motivation theory over the rival formulations of Janis and Leventhal are discussed.

A Protection Motivation Theory of Fear Appeals and Attitude Change1.

In this article we propose mechanisms that govern the processing of emotional information, particularly those involved in fear reduction. Emotions are viewed as represented by information structures in memory, and anxiety is thought to occur when an information structure that serves as program to escape or avoid danger is activated. Emotional processing is denned as the modification of memory structures that underlie emotions. It is argued that some form of exposure to feared situations is common to many psychotherapies for anxiety, and that confrontation with feared objects or situations is an effective treatment. Physiological activation and habituation within and across exposure sessions are cited as indicators of emotional processing, and variables that influence activation and habituation of fear responses are examined. These variables and the indicators are analyzed to yield an account of what information must be integrated for emotional processing of a fear structure. The elements of such a structure are viewed as cognitive representations of the stimulus characteristic of the fear situation, the individual's responses in it, and aspects of its meaning for the individual. Treatment failures are interpreted with respect to the interference of cognitive defenses, autonomic arousal, mood state, and erroneous ideation with reformation of targeted fear structures. Applications of the concepts advanced here to therapeutic practice and to the broader study of psychopathology are discussed.

/pdf/emotional-processing-of-fear-exposure-to-corrective-2ehs11haf7.pdf

Emotional processing of fear : exposure to corrective information

Role of attention in Pavlovian conditioning, and use of auditory and visual stimuli to condition rats

/pdf/predictability-surprise-attention-and-conditioning-r11hgsdjez.pdf

Predictability, surprise, attention, and conditioning

Conditioned emotional response studies using rats already trained to press bar for food supply

"Attention-like" processes in classical conditioning

The Science and Politics of IQ

Genes systematically exposes and dismantles the claims that inequalities class, race, gender are the products of biological, genetic inheritances. 'Informative, entertaining, lucid, forceful, frequently witty never dull should be read and remembered for a long time.' New York Times Book Review. 'The authors argue persuasively that biological explanations for why we act as we do are based on faulty (in some cases, fabricated) data and wild speculation It is debunking at its best.' Psychology Today. Not in Our Genes offers a penetrating critique of certain assumptions we have about how much of who we are is determined by our genetics. This book also examines how our understanding of genetics has been molded by certain ideologies, and perpetuated through deeply flawed studies and misinformation to serve those ideologies. This is an academic work, and the discussions of biological determinism often assume the reader can handle some philosophical terminology the authors don't have space to explain. For Lewontin, Rose, and Kamin, capitalism maintains itself by fostering an ideology that considers itself the only feasible form of social organization, and proclaims at the same time that is it the most fair and just of possible social forms. View Item

Leon J. Kamin

Papers

Predictability, surprise, attention, and conditioning

"Attention-like" processes in classical conditioning

The Science and Politics of IQ

Not in Our Genes: Biology, Ideology, and Human Nature

The conditioned emotional response as a function of intensity of the US.