Open AccessJournal Article
Counterfactual reasoning and learning systems: the example of computational advertising
Léon Bottou,Jonas Peters,Joaquin Quiñonero-Candela,Denis X. Charles,D. Max Chickering,Elon Portugaly,Dipankar Ray,Patrice Y. Simard,Ed Snelson +8 more
Reads0
Chats0
TLDR
This work shows how to leverage causal inference to understand the behavior of complex learning systems interacting with their environment and predict the consequences of changes to the system and allow both humans and algorithms to select the changes that would have improved the system performance.Abstract:
This work shows how to leverage causal inference to understand the behavior of complex learning systems interacting with their environment and predict the consequences of changes to the system. Such predictions allow both humans and algorithms to select the changes that would have improved the system performance. This work is illustrated by experiments on the ad placement system associated with the Bing search engine.read more
Citations
More filters
Posted Content
Modeling User Exposure in Recommendation
TL;DR: In this article, the authors propose a new probabilistic approach that directly incorporates user exposure to items into collaborative filtering, and provide a plug-in method for conditioning exposure on various forms of exposure covariates (e.g., topics in text, venue locations).
Posted Content
Cycle-Balanced Representation Learning For Counterfactual Inference
TL;DR: In this article, the authors propose a novel framework based on Cycle-Balanced REpresentation learning for counterfactual inference (CBRE), which realizes a robust balanced representation for different groups using adversarial training, and meanwhile construct an information loop, such that preserve original data properties cyclically, which reduces information loss when transforming data into latent representation space.
Posted Content
Interpretable and Personalized Apprenticeship Scheduling: Learning Interpretable Scheduling Policies from Heterogeneous User Demonstrations
TL;DR: This article proposed a personalized and interpretable apprenticeship scheduling algorithm that infers an interpretable representation of all human task demonstrators by extracting decision-making criteria via an inferred, personalized embedding non-parametric in the number of demonstrator types.
Understanding Music Semantics and User Behavior with Probabilistic Latent Variable Models
TL;DR: Understanding Music Semantics and User Behavior with Probabilistic Latent Variable Models helps clarify musical semantics and user behavior.
Posted Content
Genie: An Open Box Counterfactual Policy Estimator for Optimizing Sponsored Search Marketplace
TL;DR: In this paper, an offline counterfactual policy estimation framework called Genie is proposed to optimize sponsored search marketplace, which employs an open box simulation engine with click calibration model to compute the KPI impact of any modification to the system.
References
More filters
Book
Reinforcement Learning: An Introduction
TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
MonographDOI
Causality: models, reasoning, and inference
TL;DR: The art and science of cause and effect have been studied in the social sciences for a long time as mentioned in this paper, see, e.g., the theory of inferred causation, causal diagrams and the identification of causal effects.
Journal ArticleDOI
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
TL;DR: This article presents a general class of associative reinforcement learning algorithms for connectionist networks containing stochastic units that are shown to make weight adjustments in a direction that lies along the gradient of expected reinforcement in both immediate-reinforcement tasks and certain limited forms of delayed-reInforcement tasks, and they do this without explicitly computing gradient estimates.
Book
Introduction to Reinforcement Learning
TL;DR: In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning.