A broad introduction to algorithms for decision making under uncertainty, introducing the underlying mathematical problem formulations and the algorithms for solving them.Automated decision-making systems or decision-support systems—used in applications that range from aircraft collision avoidance to breast cancer screening—must be designed to account for various sources of uncertainty while carefully balancing multiple objectives. This textbook provides a broad introduction to algorithms for decision making under uncertainty, covering the underlying mathematical problem formulations and the algorithms for solving them. The book first addresses the problem of reasoning about uncertainty and objectives in simple decisions at a single point in time, and then turns to sequential decision problems in stochastic environments where the outcomes of our actions are uncertain. It goes on to address model uncertainty, when we do not start with a known model and must learn how to act through interaction with the environment; state uncertainty, in which we do not know the current state of the environment due to imperfect perceptual information; and decision contexts involving multiple agents. The book focuses primarily on planning and reinforcement learning, although some of the techniques presented draw on elements of supervised learning and optimization. Algorithms are implemented in the Julia programming language. Figures, examples, and exercises convey the intuition behind the various approaches presented.
A broad, rigorous introduction to algorithms for validating safety-critical systems.Validation is a critical component of the development process for decision-making systems used in high-stakes settings, from autonomous vehicles and aviation to finance and healthcare. As these systems and their operating environments increase in complexity, understanding the full spectrum of possible behaviors becomes more difficult and requires a rigorous validation process. This comprehensive textbook presents a variety of computational methods for validating autonomous systems, introducing the underlying mathematical problem formulations and the algorithms for solving them. Unifying techniques from multiple fields under a common validation framework, it provides advanced undergraduate and graduate students objective strategies for validation. The text first covers techniques required to formulate validation problems in a common structure. It then addresses sampling-based failure analysis techniques such as falsification and failure probability estimation, followed by formal methods for reachability analysis, explainability, and runtime monitoring. Algorithmic implementations are provided throughout. Offers unified framework for formulating validation problems Presents both sampling-based and formal methods Accessibly introduces failure probability estimation algorithms and reachability algorithms for linear, nonlinear, and discrete systems Emphasizes practical considerations for applying algorithms to real-world systems