scispace - formally typeset
Search or ask a question
Journal ArticleDOI

Action, Outcome, and Value A Dual-System Framework for Morality

Fiery Cushman1
01 Aug 2013-Personality and Social Psychology Review (SAGE Publications)-Vol. 17, Iss: 3, pp 273-292
TL;DR: A broad division between two algorithms for learning and choice derived from formal models of reinforcement learning provides an ideal framework for a dual-system theory in the moral domain.
Abstract: Dual-system approaches to psychology explain the fundamental properties of human judgment, decision making, and behavior across diverse domains. Yet, the appropriate characterization of each system is a source of debate. For instance, a large body of research on moral psychology makes use of the contrast between “emotional” and “rational/cognitive” processes, yet even the chief proponents of this division recognize its shortcomings. Largely independently, research in the computational neurosciences has identified a broad division between two algorithms for learning and choice derived from formal models of reinforcement learning. One assigns value to actions intrinsically based on past experience, while another derives representations of value from an internally represented causal model of the world. This division between action- and outcome-based value representation provides an ideal framework for a dual-system theory in the moral domain.
Citations
More filters
Journal Article
TL;DR: Prospect Theory led cognitive psychology in a new direction that began to uncover other human biases in thinking that are probably not learned but are part of the authors' brain’s wiring.
Abstract: In 1974 an article appeared in Science magazine with the dry-sounding title “Judgment Under Uncertainty: Heuristics and Biases” by a pair of psychologists who were not well known outside their discipline of decision theory. In it Amos Tversky and Daniel Kahneman introduced the world to Prospect Theory, which mapped out how humans actually behave when faced with decisions about gains and losses, in contrast to how economists assumed that people behave. Prospect Theory turned Economics on its head by demonstrating through a series of ingenious experiments that people are much more concerned with losses than they are with gains, and that framing a choice from one perspective or the other will result in decisions that are exactly the opposite of each other, even if the outcomes are monetarily the same. Prospect Theory led cognitive psychology in a new direction that began to uncover other human biases in thinking that are probably not learned but are part of our brain’s wiring.

4,351 citations

Journal ArticleDOI
TL;DR: A theory of why (and for whom) intuition favors cooperation is presented: cooperation is typically advantageous in everyday life, leading to the formation of generalized cooperative intuitions, which tend to be more cooperative than deliberative responses in one-shot anonymous interactions.
Abstract: Cooperation is central to human societies. Yet relatively little is known about the cognitive underpinnings of cooperative decision-making. Does cooperation require deliberate self-restraint? Or is spontaneous prosociality reined in by calculating self-interest? Here we present a theory of why (and for whom) intuition favors cooperation: cooperation is typically advantageous in everyday life, leading to the formation of generalized cooperative intuitions. Deliberation, by contrast, adjusts behavior towards the optimum for a given situation. Thus, in one-shot anonymous interactions where selfishness is optimal, intuitive responses tend to be more cooperative than deliberative responses. We test this “Social Heuristics Hypothesis” by aggregating across every cooperation experiment using time pressure we conducted over a two-year period (15 studies and 6,910 decisions), as well as performing a novel time pressure experiment. Doing so demonstrates a positive average effect of time pressure on cooperation. We also find substantial variation in this effect, and show that this variation is partly explained by previous experience with one-shot lab experiments.

531 citations

Journal ArticleDOI
TL;DR: In this paper, the authors present a theory of why (and for whom) intuition favors cooperation: cooperation is typically advantageous in everyday life, leading to the formation of generalized cooperative intuitions.
Abstract: Cooperation is central to human societies. Yet relatively little is known about the cognitive underpinnings of cooperative decision making. Does cooperation require deliberate self-restraint? Or is spontaneous prosociality reined in by calculating self-interest? Here we present a theory of why (and for whom) intuition favors cooperation: cooperation is typically advantageous in everyday life, leading to the formation of generalized cooperative intuitions. Deliberation, by contrast, adjusts behaviour towards the optimum for a given situation. Thus, in one-shot anonymous interactions where selfishness is optimal, intuitive responses tend to be more cooperative than deliberative responses. We test this ‘social heuristics hypothesis’ by aggregating across every cooperation experiment using time pressure that we conducted over a 2-year period (15 studies and 6,910 decisions), as well as performing a novel time pressure experiment. Doing so demonstrates a positive average effect of time pressure on cooperation. We also find substantial variation in this effect, and show that this variation is partly explained by previous experience with one-shot lab experiments.

471 citations

Journal ArticleDOI
28 May 2015-Nature
TL;DR: Advances in fundamental technical areas such as generalization, planning, exploration and empirical methodology, leading to increasing applicability to real-life problems are seen, partly driven by the increasing availability of rich data.
Abstract: Reinforcement learning is a branch of machine learning concerned with using experience gained through interacting with the world and evaluative feedback to improve a system's ability to make behavioural decisions. It has been called the artificial intelligence problem in a microcosm because learning algorithms must act autonomously to perform well and achieve their goals. Partly driven by the increasing availability of rich data, recent years have seen exciting advances in the theory and practice of reinforcement learning, including developments in fundamental technical areas such as generalization, planning, exploration and empirical methodology, leading to increasing applicability to real-life problems.

266 citations

01 Jan 2000
TL;DR: In this article, the authors examined the implications of individual differences in performance for each of the four explanations of the normative/descriptive gap, including performance errors, computational limitations, wrong norm being applied by the experimenter, and a different construal of the task by the subject.
Abstract: Much research in the last two decades has demonstrated that human responses deviate from the performance deemed normative according to various models of decision making and rational judgment (e.g., the basic axioms of utility theory). This gap between the normative and the descriptive can be interpreted as indicating systematic irrationalities in human cognition. However, four alternative interpretations preserve the assumption that human behavior and cognition is largely rational. These posit that the gap is due to (1) performance errors, (2) computational limitations, (3) the wrong norm being applied by the experimenter, and (4) a different construal of the task by the subject. In the debates about the viability of these alternative explanations, attention has been focused too narrowly on the model response. In a series of experiments involving most of the classic tasks in the heuristics and biases literature, we have examined the implications of individual differences in performance for each of the four explanations of the normative/descriptive gap. Performance errors are a minor factor in the gap; computational limitations underlie non-normative responding on several tasks, particularly those that involve some type of cognitive decontextualization. Unexpected patterns of covariance can suggest when the wrong norm is being applied to a task or when an alternative construal of the task should be considered appropriate.

231 citations

References
More filters
Journal Article
TL;DR: The theory of information as discussed by the authors provides a yardstick for calibrating our stimulus materials and for measuring the performance of our subjects and provides a quantitative way of getting at some of these questions.
Abstract: First, the span of absolute judgment and the span of immediate memory impose severe limitations on the amount of information that we are able to receive, process, and remember. By organizing the stimulus input simultaneously into several dimensions and successively into a sequence or chunks, we manage to break (or at least stretch) this informational bottleneck. Second, the process of recoding is a very important one in human psychology and deserves much more explicit attention than it has received. In particular, the kind of linguistic recoding that people do seems to me to be the very lifeblood of the thought processes. Recoding procedures are a constant concern to clinicians, social psychologists, linguists, and anthropologists and yet, probably because recoding is less accessible to experimental manipulation than nonsense syllables or T mazes, the traditional experimental psychologist has contributed little or nothing to their analysis. Nevertheless, experimental techniques can be used, methods of recoding can be specified, behavioral indicants can be found. And I anticipate that we will find a very orderly set of relations describing what now seems an uncharted wilderness of individual differences. Third, the concepts and measures provided by the theory of information provide a quantitative way of getting at some of these questions. The theory provides us with a yardstick for calibrating our stimulus materials and for measuring the performance of our subjects. In the interests of communication I have suppressed the technical details of information measurement and have tried to express the ideas in more familiar terms; I hope this paraphrase will not lead you to think they are not useful in research. Informational concepts have already proved valuable in the study of discrimination and of language; they promise a great deal in the study of learning and memory; and it has even been proposed that they can be useful in the study of concept formation. A lot of questions that seemed fruitless twenty or thirty years ago may now be worth another look. In fact, I feel that my story here must stop just as it begins to get really interesting. And finally, what about the magical number seven? What about the seven wonders of the world, the seven seas, the seven deadly sins, the seven daughters of Atlas in the Pleiades, the seven ages of man, the seven levels of hell, the seven primary colors, the seven notes of the musical scale, and the seven days of the week? What about the seven-point rating scale, the seven categories for absolute judgment, the seven objects in the span of attention, and the seven digits in the span of immediate memory? For the present I propose to withhold judgment. Perhaps there is something deep and profound behind all these sevens, something just calling out for us to discover it. But I suspect that it is only a pernicious, Pythagorean coincidence.

19,835 citations

Book
01 Jan 1956
TL;DR: The theory provides us with a yardstick for calibrating the authors' stimulus materials and for measuring the performance of their subjects, and the concepts and measures provided by the theory provide a quantitative way of getting at some of these questions.
Abstract: First, the span of absolute judgment and the span of immediate memory impose severe limitations on the amount of information that we are able to receive, process, and remember. By organizing the stimulus input simultaneously into several dimensions and successively into a sequence or chunks, we manage to break (or at least stretch) this informational bottleneck. Second, the process of recoding is a very important one in human psychology and deserves much more explicit attention than it has received. In particular, the kind of linguistic recoding that people do seems to me to be the very lifeblood of the thought processes. Recoding procedures are a constant concern to clinicians, social psychologists, linguists, and anthropologists and yet, probably because recoding is less accessible to experimental manipulation than nonsense syllables or T mazes, the traditional experimental psychologist has contributed little or nothing to their analysis. Nevertheless, experimental techniques can be used, methods of recoding can be specified, behavioral indicants can be found. And I anticipate that we will find a very orderly set of relations describing what now seems an uncharted wilderness of individual differences. Third, the concepts and measures provided by the theory of information provide a quantitative way of getting at some of these questions. The theory provides us with a yardstick for calibrating our stimulus materials and for measuring the performance of our subjects. In the interests of communication I have suppressed the technical details of information measurement and have tried to express the ideas in more familiar terms; I hope this paraphrase will not lead you to think they are not useful in research. Informational concepts have already proved valuable in the study of discrimination and of language; they promise a great deal in the study of learning and memory; and it has even been proposed that they can be useful in the study of concept formation. A lot of questions that seemed fruitless twenty or thirty years ago may now be worth another look. In fact, I feel that my story here must stop just as it begins to get really interesting. And finally, what about the magical number seven? What about the seven wonders of the world, the seven seas, the seven deadly sins, the seven daughters of Atlas in the Pleiades, the seven ages of man, the seven levels of hell, the seven primary colors, the seven notes of the musical scale, and the seven days of the week? What about the seven-point rating scale, the seven categories for absolute judgment, the seven objects in the span of attention, and the seven digits in the span of immediate memory? For the present I propose to withhold judgment. Perhaps there is something deep and profound behind all these sevens, something just calling out for us to discover it. But I suspect that it is only a pernicious, Pythagorean coincidence.

16,902 citations


"Action, Outcome, and Value A Dual-S..." refers background in this paper

  • ...Third, it specifies precisely how cognitive and affective mechanisms contribute to both types of process....

    [...]

  • ...…organization of information—and especially of behaviors into superordinate and subordinate routines or goals—is a recurrent and fundamental theme in psychology (Chomsky, 1957; Lashley, 1951; G. A. Miller, 1956) and machine learning (Barto & Mahadevan, 2003; Dietterich, 2000; Parr & Russell, 1998)....

    [...]

Book
01 Jan 2011
TL;DR: Buku terlaris New York Times and The Economist tahun 2012 as mentioned in this paper, and dipilih oleh The NewYork Times Book Review sebagai salah satu dari sepuluh buku terbaik tahune 2011, Berpikir, Cepat and Lambat ditakdirkan menjadi klasik.
Abstract: Buku terlaris New York Times Pemenang Penghargaan Buku Terbaik Akademi Sains Nasional pada tahun 2012 Dipilih oleh New York Times Book Review sebagai salah satu dari sepuluh buku terbaik tahun 2011 A Globe and Mail Judul Buku Terbaik Tahun 2011 Salah Satu Buku The Economist tahun 2011 Salah Satu Buku Nonfiksi Terbaik The Wall Street Journal of the Year 2011 2013 Presidential Medal of Freedom Recipient Pekerjaan Kahneman dengan Amos Tversky adalah subyek dari Proyek Undoing Michael Lewis: Persahabatan yang Mengubah Pikiran Kita Dalam buku terlaris internasional, Berpikir, Cepat, dan Lambat, Daniel Kahneman, psikolog terkenal dan pemenang Hadiah Nobel dalam Ekonomi, membawa kita pada perjalanan pemikiran yang inovatif dan menjelaskan dua sistem yang mendorong cara kita berpikir. Sistem 1 cepat, intuitif, dan emosional; Sistem 2 lebih lambat, lebih deliberatif, dan lebih logis. Dampak dari terlalu percaya pada strategi perusahaan, kesulitan memprediksi apa yang akan membuat kita bahagia di masa depan, efek mendalam dari bias kognitif dalam segala hal mulai dari bermain pasar saham hingga merencanakan liburan kita berikutnya ― masing-masing dapat dipahami hanya dengan mengetahui bagaimana kedua sistem tersebut membentuk penilaian dan keputusan kami. Melibatkan pembaca dalam percakapan yang hidup tentang bagaimana kita berpikir, Kahneman mengungkapkan di mana kita bisa dan tidak dapat mempercayai intuisi kita dan bagaimana kita dapat memanfaatkan manfaat dari pemikiran yang lambat. Dia menawarkan wawasan praktis dan mencerahkan tentang bagaimana pilihan dibuat baik dalam bisnis kita dan kehidupan pribadi kita ― dan bagaimana kita dapat menggunakan teknik yang berbeda untuk menjaga gangguan mental yang sering membawa kita ke dalam masalah. Pemenang Penghargaan Buku Terbaik Akademi Sains Nasional dan Hadiah Buku Los Angeles Times dan dipilih oleh The New York Times Book Review sebagai salah satu dari sepuluh buku terbaik tahun 2011, Berpikir, Cepat dan Lambat ditakdirkan menjadi klasik.

12,984 citations

Journal ArticleDOI
TL;DR: It is proposed that cognitive control stems from the active maintenance of patterns of activity in the prefrontal cortex that represent goals and the means to achieve them, which provide bias signals to other brain structures whose net effect is to guide the flow of activity along neural pathways that establish the proper mappings between inputs, internal states, and outputs needed to perform a given task.
Abstract: ▪ Abstract The prefrontal cortex has long been suspected to play an important role in cognitive control, in the ability to orchestrate thought and action in accordance with internal goals. Its neural basis, however, has remained a mystery. Here, we propose that cognitive control stems from the active maintenance of patterns of activity in the prefrontal cortex that represent goals and the means to achieve them. They provide bias signals to other brain structures whose net effect is to guide the flow of activity along neural pathways that establish the proper mappings between inputs, internal states, and outputs needed to perform a given task. We review neurophysiological, neurobiological, neuroimaging, and computational studies that support this theory and discuss its implications as well as further issues to be addressed

10,943 citations


"Action, Outcome, and Value A Dual-S..." refers background or methods in this paper

  • ...The maintenance of information and rules afforded by working memory systems is a hallmark of controlled cognition (Miller & Cohen, 2001)....

    [...]

  • ...I have emphasized the role of cognitive control in overriding model-free habits (E. K. Miller & Cohen, 2001); however, controlled cognition can be used much generally to impose rule-like structure on decision processes (Sloman, 1996)....

    [...]

  • ...Using a prediction-error mechanism, the agent will tend to have a value representation around 0.5 at any given time (because of the combined effects of small adjustments upward or downward), and yet does not have to remember the full history of the past choices....

    [...]

Book
01 Jan 1970
TL;DR: Hume's early years and education is described in a treatise of human nature as discussed by the authors. But it is not a complete account of the early years of his life and education.
Abstract: PART 1: INTRODUCTORY MATERIAL How to Use this Book List of Abbreviations Editor's Introduction Hume's Early years and Education A Treatise of Human Nature Book 1: Of the Understanding Book 1 part 1: The Elements of the Mental World Book 1 Part 2: The Ideas of Space and Time Book 1 Part 3: Knowledge, Probability, Belief, and Causation Book 1 Part 4: Forms of Scepticism Book 2: Of the passions Book 2 Part 1: The Indirect Passions of Pride and Humility Book 2 Part 2: The Indirect Passions of Love and Hatred Book 2 part 3: The Direct Passions and the Will Book 3: Of Morals Book 3 Part 1: The Source of Moral Distinctions Book 3 Part 2: The Artificial Virtues Book 3 Part 3: Natural Virtues and Natural Abilities The Abstract and the Early Reception of the Treatise Supplementary Reading A Note on the Texts of this Edition PART 2: THE TEXT Advertisement Introduction Book 1: Of the Understanding Part 1: Of ideas, their origin, composition, connexion, abstraction, etc Sect 1: Of the origin of our ideas Sect 2: Division of the subject Sect 3: Of the ideas of the memory and imagination Sect 4: Of the connexion of association of ideas Sect 5 Of relations Sect 6 Of modes and substances Sect 7: Of abstract ideas Part 2: Of ideas of space and time Sect 1: Of the infinite divisibility of our ideas of space and time Sect 2: Of the infinite divisibility of space and time Sect 3 Of the other qualities of our ideas of space and time Sect 4 Objections answered Sect 5: The same subject continued Sect 6: Of the idea of existence and of external existence Part 3: of knowledge and probability Sect 1: Of knowledge Sect 2 Of probability and of the idea of cause and effect Sect 3: Why a cause is always necessary Sect 4: Of the component parts of our reasonings concerning cause and effect Sect 5: Of the impressions of the senses and memory Section 6: Of the inference from the impression to the idea Sect 7: Of the nature of the idea or belief Sect 8: Of the causes of belief Sect 9: Of the effects of other relations and other habits Sect 10 Of the influence of belief Sect 11: Of the probability of chances Sect 12: Of the probability of causes Sect 13: Of unphilosophical probability Sect 14: Of the idea of necessary connexion Sect 15: Rules by which to judge of causes and effects Sect 16: Of the reason of animals Part 4: Of the sceptical and other systems of philosophy Sect 1: Of scepticism with regard to reason Sect 2: Of scepticism with regard to the senses Sect 3 Of the ancient philosophy Sect 4 Of the modern philosophy Sect 5: Of the immateriality of the soul Sect 6: Of personal identity Sect 7: Conclusion of this book Book 2: Of the Passions Part 1: Of pride and humility Sect 1: Division of the subject Sect 2: Of pride and humility their objects and causes Sect 3: Whence these objects and causes are derived Sect 4: Of the relations of impressions and ideas Sect 5: Of the influence of these relations on pride and humility Sect 6: Limitations of this system Sect 7: Of vice and virtue Sect 8: Of beauty and deformity Sect 9: Of external advantages and disadvantages Sect 10: Of property and riches Sect 11: Of the love of fame Sect 12: Of the pride and humility of animals Part 2: Of love and hatred Sect 1: Of the objects and causes of love and hatred Sect 2: Experiments to confirm this system Sect 3: Difficulties solved Sect 4: Of the love of relations Sect 5: Of our esteem for the rich and powerful Sect 6: Of benevolence and anger Sect 7: Of compassion Sect 8: Of malice and envy Sect 9: Of the mixture of benevolence and anger with compassion and malice Sect 10 Of respect and contempt Sect 11: Of the amorous passion, or love betwixt the sexes Sect 12: Of the love and hatred of animals Part 3: Of the will and direct passions Sect 1: Of liberty and necessity Sect 2: The same subject continued Sect 3: Of the influencing motives of the will Sect 4: Of the causes of the violent passions Sect 5: Of the effects of custom Sect Of the influence of the imagination on passions Sect 7: Of contiguity and distance in space and time Sect 8: The same subject continued Sect 9: Of the direct passions Sect 10: Of curiosity, or the love of truth Book 3: Of Morals Advertisement Part 1: Of virtue and vice in general Sect 1: Moral distinctions not derived from reason Sect 2: Moral distinctions derived from a moral sense Part 2: Of justice and injustice Sect 1: Justice, whether a natural or artificial virtue? Sect 2: Of the origin of justice and property Sect 3: Of the rules, which determine property Sect 4: Of the transference of property by consent Sect 5: Of the obligation of promises Sect 6: Some farther reflections concerning justice and injustice Sect 7: Of the origin of government Sect 8: Of the source of allegiance Sect 9: Of the measures of allegiance Sect 10: Of the objects of allegiance Sect 11: Of the laws of nations Sect 12: Of chastity and modesty Part 3: Of the other virtues and vices Sect 1: Of the origin of the natural virtues and vices Sect 2: Of greatness of mind Sect 3 Of goodness and benevolence Sect 4: Of natural abilities Sect 5: Some farther reflections concerning the natural virtues Sect 6: Conclusion of this book Appendix An Abstract of A Treatise of Human Nature PART 3 SUPPLEMENTARY MATERIAL Editors' Annotations Annotations to the Treatise Annotations to the Abstract Glossary References Index

10,342 citations