• Produktbild: Model-Based Reinforcement Learning
  • Produktbild: Model-Based Reinforcement Learning

Model-Based Reinforcement Learning From Data to Continuous Actions with a Python-Based Toolbox

149,99 €

inkl. gesetzl. MwSt., Versandkostenfrei


Beschreibung

Produktdetails

Einband

Gebundene Ausgabe

Erscheinungsdatum

05.12.2022

Herausgeber

Maria Domenica Di Benedetto

Verlag

John Wiley & Sons Inc

Seitenzahl

272

Maße (L/B/H)

23,5/15,7/1,9 cm

Gewicht

540 g

Auflage

1. Auflage

Sprache

Englisch

ISBN

978-1-119-80857-2

Beschreibung

Produktdetails

Einband

Gebundene Ausgabe

Erscheinungsdatum

05.12.2022

Herausgeber

Maria Domenica Di Benedetto

Verlag

John Wiley & Sons Inc

Seitenzahl

272

Maße (L/B/H)

23,5/15,7/1,9 cm

Gewicht

540 g

Auflage

1. Auflage

Sprache

Englisch

ISBN

978-1-119-80857-2

Herstelleradresse

Libri GmbH
Europaallee 1
36244 Bad Hersfeld
DE

Email: gpsr@libri.de

Noch keine Bewertungen vorhanden

Verfassen Sie die erste Bewertung zu diesem Artikel

Helfen Sie anderen Kundinnen und Kunden durch Ihre Meinung.

Kundinnen und Kunden meinen

Bewertungen (0)

Die Leseprobe wird geladen.
  • Produktbild: Model-Based Reinforcement Learning
  • Produktbild: Model-Based Reinforcement Learning
  • About the Authors xi
     
    Preface xiii
     
    Acronyms xv
     
    Introduction xvii
     
    1 Nonlinear Systems Analysis 1
     
    1.1 Notation 1
     
    1.2 Nonlinear Dynamical Systems 2
     
    1.2.1 Remarks on Existence, Uniqueness, and Continuation of Solutions 2
     
    1.3 Lyapunov Analysis of Stability 3
     
    1.4 Stability Analysis of Discrete Time Dynamical Systems 7
     
    1.5 Summary 10
     
    Bibliography 10
     
    2 Optimal Control 11
     
    2.1 Problem Formulation 11
     
    2.2 Dynamic Programming 12
     
    2.2.1 Principle of Optimality 12
     
    2.2.2 Hamilton-Jacobi-Bellman Equation 14
     
    2.2.3 A Sufficient Condition for Optimality 15
     
    2.2.4 Infinite-Horizon Problems 16
     
    2.3 Linear Quadratic Regulator 18
     
    2.3.1 Differential Riccati Equation 18
     
    2.3.2 Algebraic Riccati Equation 23
     
    2.3.3 Convergence of Solutions to the Differential Riccati Equation 26
     
    2.3.4 Forward Propagation of the Differential Riccati Equation for Linear Quadratic Regulator 28
     
    2.4 Summary 30
     
    Bibliography 30
     
    3 Reinforcement Learning 33
     
    3.1 Control-Affine Systems with Quadratic Costs 33
     
    3.2 Exact Policy Iteration 35
     
    3.2.1 Linear Quadratic Regulator 39
     
    3.3 Policy Iteration with Unknown Dynamics and Function Approximations 41
     
    3.3.1 Linear Quadratic Regulator with Unknown Dynamics 46
     
    3.4 Summary 47
     
    Bibliography 48
     
    4 Learning of Dynamic Models 51
     
    4.1 Introduction 51
     
    4.1.1 Autonomous Systems 51
     
    4.1.2 Control Systems 51
     
    4.2 Model Selection 52
     
    4.2.1 Gray-Box vs. Black-Box 52
     
    4.2.2 Parametric vs. Nonparametric 52
     
    4.3 Parametric Model 54
     
    4.3.1 Model in Terms of Bases 54
     
    4.3.2 Data Collection 55
     
    4.3.3 Learning of Control Systems 55
     
    4.4 Parametric Learning Algorithms 56
     
    4.4.1 Least Squares 56
     
    4.4.2 Recursive Least Squares 57
     
    4.4.3 Gradient Descent 59
     
    4.4.4 Sparse Regression 60
     
    4.5 Persistence of Excitation 60
     
    4.6 Python Toolbox 61
     
    4.6.1 Configurations 62
     
    4.6.2 Model Update 62
     
    4.6.3 Model Validation 63
     
    4.7 Comparison Results 64
     
    4.7.1 Convergence of Parameters 65
     
    4.7.2 Error Analysis 67
     
    4.7.3 Runtime Results 69
     
    4.8 Summary 73
     
    Bibliography 75
     
    5 Structured Online Learning-Based Control of Continuous-Time Nonlinear Systems 77
     
    5.1 Introduction 77
     
    5.2 A Structured Approximate Optimal Control Framework 77
     
    5.3 Local Stability and Optimality Analysis 81
     
    5.3.1 Linear Quadratic Regulator 81
     
    5.3.2 SOL Control 82
     
    5.4 SOL Algorithm 83
     
    5.4.1 ODE Solver and Control Update 84
     
    5.4.2 Identified Model Update 85
     
    5.4.3 Database Update 85
     
    5.4.4 Limitations and Implementation Considerations 86
     
    5.4.5 Asymptotic Convergence with Approximate Dynamics 87
     
    5.5 Simulation Results 87
     
    5.5.1 Systems Identifiable in Terms of a Given Set of Bases 88
     
    5.5.2 Systems to Be Approximated by a Given Set of Bases 91
     
    5.5.3 Comparison Results 98
     
    5.6 Summary 99
     
    Bibliography 99
     
    6 A Structured Online Learning Approach to Nonlinear Tracking with Unknown Dynamics 103
     
    6.1 Introduction 103
     
    6.2 A Structured Online Learning for Tracking Control 104
     
    6.2.1 Stability and Optimality in the Linear Case 108
     
    6.3 Learning-based Tracking Control Using SOL 111
     
    6.4 Simul