Skip to main content

Complexity depends on the representation

Choose the quantity before choosing the differentiation strategy.

RepresentationWhat grows
Activation derivative polynomialArithmetic grows with derivative order
Directional Taylor jetCoefficients grow with retained order and directions
Full mixed jetbinomial(dim + order, order) coefficients
Dense spatial HessianQuadratic output size in input dimension
Direct deep LaplacianFor fixed widths and depth, work and memory grow with input dimension
Deep repeated LaplacianExact support enumeration has a configured budget; automatic mode can report an estimator

Avoid claiming constant total cost in dimension or derivative order. Reusing a weight norm or base activation removes repeated work but does not remove all input processing or polynomial arithmetic.

Read the detailed guarantees and measured results.