Adam#
Adam on Estimated Gradients#
Momentum-based optimizer (Adam) applied to estimated gradients produced by an external estimator (e.g., FD or SPSA) or provided directly in context.
- Interface:
initialize(params) -> state
step_params(model, params, context) -> (new_params, state)
- Context options:
context[“grads”]: dict aligned with params (if provided, used directly)
or pass a grad_estimator(model, params, context) -> np.ndarray in ctor