Finite Diff#
Finite-Difference Optimizer (Central Difference)#
Derivative-free gradient estimation by central differences. Suitable for low- to medium-dimensional parameter vectors and backends without analytic gradients. Cost: 2 evaluations per parameter per step.
- Interface:
initialize(params) -> state
step_params(model, params, context) -> (new_params, state)