Publication: Comparing high-order multivariate AD methods
Introduction
Applications
Tools
Research Groups
Workshops
Publications
   List Publications
   Advanced Search
   Info
   Add Publications
My Account
About
Impress

Comparing high-order multivariate AD methods

- Article in a journal -
 

Author(s)
Richard D. Neidinger , Benjamin Altman

Published in
Special issue of Optimization Methods & Software: Advances in Algorithmic Differentiation Optimization Methods & Software

Editor(s)
Bruce Christianson, Shaun A. Forth, Andreas Griewank

Year
2018

Publisher
Taylor & Francis

Abstract
ABSTRACTTo compute every high-order multivariate derivative value, interpolation methods will be shown to be less accurate than a direct forward multivariate Taylor series method, becoming significant for degrees higher than 10. As order increases, interpolation methods rely on increasingly ill-conditioned matrices where simply rounding exact rational values produced corresponding error in some resulting derivative values. Both interpolation and direct methods use forward ad (algorithmic differentiation); the direct method propagates multivariate series coefficients of the original function, while interpolation methods propagate univariate series of the function in fixed directions and reconstruct the multivariate values. Such interpolation methods, differing in direction choices and reconstruction methods, have been shown to be theoretically more efficient than the direct method for high order. Four alternatives were implemented in MATLAB (interpreted and using random access arrays) on the same laptop. In our implementations, the direct method was competitive and often faster in run time, in addition to maintaining good accuracy. Since ad tools in compiled languages are much faster, more comparison is needed. Direct method efficiency depends on indexing subsets within the large non-rectangular data structure for multivariate series coefficients. We explain key implementation details of our direct method that uses a global reference array.

Cross-References
Christianson2018Sio

BibTeX
@ARTICLE{
         Neidinger2018Cho,
       crossref = "Christianson2018Sio",
       author = "Richard D. Neidinger and Benjamin Altman",
       title = "Comparing high-order multivariate {AD} methods",
       journal = "Optimization Methods \& Software",
       volume = "33",
       number = "4--6",
       pages = "995--1009",
       year = "2018",
       publisher = "Taylor \& Francis",
       doi = "10.1080/10556788.2018.1472256",
       url = "https://doi.org/10.1080/10556788.2018.1472256",
       eprint = "https://doi.org/10.1080/10556788.2018.1472256",
       abstract = "ABSTRACTTo compute every high-order multivariate derivative value, interpolation
         methods will be shown to be less accurate than a direct forward multivariate Taylor series method,
         becoming significant for degrees higher than 10. As order increases, interpolation methods rely on
         increasingly ill-conditioned matrices where simply rounding exact rational values produced
         corresponding error in some resulting derivative values. Both interpolation and direct methods use
         forward AD (algorithmic differentiation); the direct method propagates multivariate series
         coefficients of the original function, while interpolation methods propagate univariate series of
         the function in fixed directions and reconstruct the multivariate values. Such interpolation
         methods, differing in direction choices and reconstruction methods, have been shown to be
         theoretically more efficient than the direct method for high order. Four alternatives were
         implemented in MATLAB (interpreted and using random access arrays) on the same laptop. In our
         implementations, the direct method was competitive and often faster in run time, in addition to
         maintaining good accuracy. Since AD tools in compiled languages are much faster, more comparison is
         needed. Direct method efficiency depends on indexing subsets within the large non-rectangular data
         structure for multivariate series coefficients. We explain key implementation details of our direct
         method that uses a global reference array.",
       booktitle = "Special issue of Optimization Methods \& Software: Advances in
         Algorithmic Differentiation",
       editor = "Bruce Christianson and Shaun A. Forth and Andreas Griewank"
}


back
  

Contact:
autodiff.org
Username:
Password:
(lost password)