Exact oracle complexity for function-value suboptimality under weighted initial conditions

(2026)

Abstract

We determine the exact worst-case function-value suboptimality after $N$ first-order oracle calls on $L$-smooth, $\mu$-strongly convex functions under a nonnegative weighted combination of the initial squared distance, function-value suboptimality, and squared gradient norm. For the nondegenerate case, the exact minimax risk in dimension $d\geq2N+1$ is characterized by the unique solution of a single scalar equation involving an $N$-step recurrence. The proof constructs an explicit hard instance for the lower bound and a constant-memory first-order method, ITEM-w, whose worst-case performance matches this lower bound. On the standard initial conditions, the result recovers the exact convex bound attained by the Optimized Gradient Method and establishes the minimax optimality of ITEM-f for the initial function-value condition.
×