Optimization and Learning via Stochastic Gradient Search
Oct 2025 · Princeton University Press
Ebook
432
Pages
family_home
Eligible
info
About this ebook
An introduction to gradient-based stochastic optimization that integrates theory and implementation
This book explains gradient-based stochastic optimization, exploiting the methodologies of stochastic approximation and gradient estimation. Although the approach is theoretical, the book emphasizes developing algorithms that implement the methods. The underlying philosophy of this book is that when solving real problems, mathematical theory, the art of modeling, and numerical algorithms complement each other, with no one outlook dominating the others.
The book first covers the theory of stochastic approximation including advanced models and state-of-the-art analysis methodology, treating applications that do not require the use of gradient estimation. It then presents gradient estimation, developing a modern approach that incorporates cutting-edge numerical algorithms. Finally, the book culminates in a rich set of case studies that integrate the concepts previously discussed into fully worked models. The use of stochastic approximation in statistics and machine learning is discussed, and in-depth theoretical treatments for selected gradient estimation approaches are included.
Numerous examples show how the methods are applied concretely, and end-of-chapter exercises enable readers to consolidate their knowledge. Many chapters end with a section on “Practical Considerations” that addresses typical tradeoffs encountered in implementation. The book provides the first unified treatment of the topic, written for a wide audience that includes researchers and graduate students in applied mathematics, engineering, computer science, physics, and economics.
This book explains gradient-based stochastic optimization, exploiting the methodologies of stochastic approximation and gradient estimation. Although the approach is theoretical, the book emphasizes developing algorithms that implement the methods. The underlying philosophy of this book is that when solving real problems, mathematical theory, the art of modeling, and numerical algorithms complement each other, with no one outlook dominating the others.
The book first covers the theory of stochastic approximation including advanced models and state-of-the-art analysis methodology, treating applications that do not require the use of gradient estimation. It then presents gradient estimation, developing a modern approach that incorporates cutting-edge numerical algorithms. Finally, the book culminates in a rich set of case studies that integrate the concepts previously discussed into fully worked models. The use of stochastic approximation in statistics and machine learning is discussed, and in-depth theoretical treatments for selected gradient estimation approaches are included.
Numerous examples show how the methods are applied concretely, and end-of-chapter exercises enable readers to consolidate their knowledge. Many chapters end with a section on “Practical Considerations” that addresses typical tradeoffs encountered in implementation. The book provides the first unified treatment of the topic, written for a wide audience that includes researchers and graduate students in applied mathematics, engineering, computer science, physics, and economics.
An introduction to gradient-based stochastic optimization that integrates theory and implementation
This book explains gradient-based stochastic optimization, exploiting the methodologies of stochastic approximation and gradient estimation. Although the approach is theoretical, the book emphasiz...
Discover more
About the author
Felisa Vázquez-Abad is professor of computer science at City University of New York and principal investigator in the School of Computing and Information Systems at the University of Melbourne. Bernd Heidergott is professor of stochastic optimization in the Department of Operations Analytics at the School of Business and Economics and research fellow at Tinbergen Institute, Amsterdam.
Felisa Vázquez-Abad is professor of computer science at City University of New York and principal investigator in the School of Computing and Information Systems at the University of Melbourne. Bernd Heidergott is professor of stochastic optimization in the Department of Operations Analytics at t...
Rate this ebook
Tell us what you think.
Reading information
Smartphones and tablets
Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.
Laptops and computers
You can listen to audiobooks purchased on Google Play using your computer's web browser.
eReaders and other devices
To read on e-ink devices like Kobo eReaders, you'll need to download a file and transfer it to your device. Follow the detailed Help Center instructions to transfer the files to supported eReaders.
