Traditional engineering instruction is deductive, beginning with theories and progressing to the applications of those theories Alternative teaching approaches are more inductive Topics are introduced by presenting specific observations, case studies or problems, and theories are taught or the students are helped to discover them only after the need to know them has been established This study reviews several of the most commonly used inductive teaching methods, including inquiry learning, problem-based learning, project-based learning, case-based teaching, discovery learning, and just-in-time teaching The paper defines each method, highlights commonalities and specific differences, and reviews research on the effectiveness of the methods While the strength of the evidence varies from one method to another, inductive methods are consistently found to be at least equal to, and in general more effective than, traditional deductive methods for achieving a broad range of learning outcomes

Inductive Teaching and Learning Methods: Definitions, Comparisons, and Research Bases

Speech Genres and Other Late Essays

Applied Numerical Analysis. By C.F. Gerald. Pp. xii, 340. £3·60. 1970. (Addison-Wesley.)

Reinforcement learning is a learning paradigm concerned with learning to control a system so as to maximize a numerical performance measure that expresses a long-term objective.What distinguishes reinforcement learning from supervised learning is that only partial feedback is given to the learner about the learner's predictions. Further, the predictions may have long term effects through influencing the future state of the controlled system. Thus, time plays a special role. The goal in reinforcement learning is to develop efficient learning algorithms, as well as to understand the algorithms' merits and limitations. Reinforcement learning is of great interest because of the large number of practical applications that it can be used to address, ranging from problems in artificial intelligence to operations research or control engineering. In this book, we focus on those algorithms of reinforcement learning that build on the powerful theory of dynamic programming.We give a fairly comprehensive catalog of learning problems, describe the core ideas, note a large number of state of the art algorithms, followed by the discussion of their theoretical properties and limitations.

/pdf/algorithms-for-reinforcement-learning-1v3ntk0ua4.pdf

Algorithms for Reinforcement Learning

Safe Reinforcement Learning can be defined as the process of learning policies that maximize the expectation of the return in problems in which it is important to ensure reasonable system performance and/or respect safety constraints during the learning and/or deployment processes. We categorize and analyze two approaches of Safe Reinforcement Learning. The first is based on the modification of the optimality criterion, the classic discounted finite/infinite horizon, with a safety factor. The second is based on the modification of the exploration process through the incorporation of external knowledge or the guidance of a risk metric. We use the proposed classification to survey the existing literature, as well as suggesting future directions for Safe Reinforcement Learning.

/pdf/a-comprehensive-survey-on-safe-reinforcement-learning-3p8tg32zci.pdf

A comprehensive survey on safe reinforcement learning

We present a modular approach to reinforcement learning that uses a Bayesian representation of the uncertainty over models. The approach, BOSS (Best of Sampled Set), drives exploration by sampling multiple models from the posterior and selecting actions optimistically. It extends previous work by providing a rule for deciding when to re-sample and how to combine the models. We show that our algorithm achieves near-optimal reward with high probability with a sample complexity that is low relative to the speed at which the posterior distribution converges during learning. We demonstrate that BOSS performs quite favorably compared to state-of-the-art reinforcement-learning approaches and illustrate its flexibility by pairing it with a non-parametric model that generalizes across states.

/pdf/a-bayesian-sampling-approach-to-exploration-in-reinforcement-3hxvbulzw4.pdf

A Bayesian sampling approach to exploration in reinforcement learning

We present a modular approach to reinforcement learning that uses a Bayesian representation of the uncertainty over models. The approach, BOSS (Best of Sampled Set), drives exploration by sampling multiple models from the posterior and selecting actions optimistically. It extends previous work by providing a rule for deciding when to resample and how to combine the models. We show that our algorithm achieves nearoptimal reward with high probability with a sample complexity that is low relative to the speed at which the posterior distribution converges during learning. We demonstrate that BOSS performs quite favorably compared to state-of-the-art reinforcement-learning approaches and illustrate its flexibility by pairing it with a non-parametric model that generalizes across states.

A Bayesian Sampling Approach to Exploration in Reinforcement Learning

Wave propagation of embedded viscoelastic FG-CNT-reinforced sandwich plates integrated with sensor and actuator based on refined zigzag theory

This work considers the problems of learning and planning in Markovian environments with constant observation and reward delays. We provide a hardness result for the general planning problem and positive results for several special cases with deterministic or otherwise constrained dynamics. We present an algorithm, Model Based Simulation, for planning in such environments and use model-based reinforcement learning to extend this approach to the learning setting in both finite and continuous environments. Empirical comparisons show this algorithm holds significant advantages over others for decision making in delayed-observation environments.

Learning and planning in environments with delayed feedback

The essence of exploration is acting to try to decrease uncertainty. We propose a new methodology for representing uncertainty in continuous-state control problems. Our approach, multi-resolution exploration (MRE), uses a hierarchical mapping to identify regions of the state space that would benefit from additional samples. We demonstrate MRE's broad utility by using it to speed up learning in a prototypical model-based and value-based reinforcement-learning method. Empirical results show that MRE improves upon state-of-the-art exploration approaches.

/pdf/multi-resolution-exploration-in-continuous-spaces-3c43iu8rqz.pdf

Ali Nouri

Papers

A Bayesian sampling approach to exploration in reinforcement learning

A Bayesian Sampling Approach to Exploration in Reinforcement Learning

Wave propagation of embedded viscoelastic FG-CNT-reinforced sandwich plates integrated with sensor and actuator based on refined zigzag theory

Learning and planning in environments with delayed feedback

Multi-resolution Exploration in Continuous Spaces