Skip to main content

Working vocabulary

TermMeaning
Derivative towerValues of an activation and successive ordinary derivatives
Directional jetTaylor coefficients along a selected direction; row k contains derivative divided by k!
Mixed jetCoefficients D^alpha f / alpha! indexed by multi-index
ContractionA requested aggregate such as the Hessian trace, computed without storing every tensor entry
Bias collapseA normalized, weighted shift limit as delta tends to zero, yielding a derivative
Temperature hardeningA smooth decision becoming sharper as inverse temperature increases
Parameter autodiffDifferentiation of the training loss with respect to model parameters
Closed formAn analytic expression, whose floating-point evaluation can still have numerical error
CertificateA checked statement about a specified quantity, domain, model, and assumptions
Release candidateA prerelease version requiring explicit compatibility checks

See numerical scope and the learning paths.