
2008 / xxii + 438 pages / Softcover / ISBN: 9780898716597 / List Price $85.50 / SIAM Member Price $59.85 / Order Code OT105
Keywords: algorithmic differentiation, computation of derivatives, chain rule, computational graph, adjoints.
Algorithmic, or automatic, differentiation (AD) is a growing area of theoretical research and software development concerned with the accurate and efficient evaluation of derivatives for function evaluations given as computer programs. The resulting derivative values are useful for all scientific computations that are based on linear, quadratic, or higher order approximations to nonlinear scalar or vector functions.
AD has been applied in particular to optimization, parameter identification, nonlinear equation solving, the numerical integration of differential equations, and combinations of these. Apart from quantifying sensitivities numerically, AD also yields structural dependence information, such as the sparsity pattern and generic rank of Jacobian matrices. The field opens up an exciting opportunity to develop new algorithms that reflect the true cost of accurate derivatives and to use them for improvements in speed and reliability.
This second edition has been updated and expanded to cover recent developments in applications and theory, including an elegant NP completeness argument by Uwe Naumann and a brief introduction to scarcity, a generalization of sparsity. There is also added material on checkpointing and iterative differentiation. To improve readability the more detailed analysis of memory and complexity bounds has been relegated to separate, optional chapters.The book consists of three parts: a standalone introduction to the fundamentals of AD and its software; a thorough treatment of methods for sparse problems; and final chapters on programreversal schedules, higher derivatives, nonsmooth problems and iterative processes. Each of the 15 chapters concludes with examples and exercises.
Audience
This volume will be valuable to designers of algorithms and software for nonlinear computational problems. Current numerical software users should gain the insight necessary to choose and deploy existing AD software tools to the best advantage.
About the Authors
Andreas Griewank is Director of the Institute of Mathematics at Humboldt University, Berlin, and a member of the DFG Research Center Matheon, Mathematics for Key Technologies. He is author of the first edition of this book, published in 2000. A former senior scientist at Argonne National Laboratory, his main research interests are nonlinear optimization and scientific computing.
Andrea Walther is Professor at the University of Paderborn. Her main research interests are scientific computing and nonlinear optimization.
ISBN: 9780898716597