The recent development of computation and automation has lead to quick advances in the theory and practice of recursive methods for stabilization, identification and control of complex stochastic models (guiding a rocket or a plane, organizing multiaccess broadcast channels, self-learning of neural networks ...). This book provides an up-to-date view of a wide range of those methods: stochastic approximation, linear and non-linear models, controlled Markov chains, estimation and adaptive control, learning, etc. Mathematicians (researchers and also students) and engineers will find here a self-contained account of many approaches to those theories.