Skip to main content

Choose a derivative path and measure it

Start with the operator your residual needs, then choose the smallest suitable representation.

  • One activation derivative: a supported activation fast path.
  • A few network directions: directional jets.
  • All mixed partials through a small order: a mixed jet with an explicit coefficient budget.
  • A deep Laplacian: direct contraction.
  • A repeated deep Laplacian: inspect the exact-support or estimator report.

Measure the actual training loop in addition to derivative evaluation. Include warmup, compilation, memory, numerical error, and parameter-gradient checks. Large high-order coefficients can cause cancellation even when the algebra is correct.

Follow the benchmark methodology and compare with the published evidence.