Natural gradient (Fisher-Rao): ∇̃f = G^{-1}∇f · @brief Natural gradient (Fisher-Rao): ∇̃f

Read the equation

This relation defines @brief Natural gradient (Fisher-Rao): ∇̃f in the source section “Natural gradient (Fisher-Rao): ∇̃f = G^{-1}∇f · @brief Natural gradient (Fisher-Rao): ∇̃f”. Uses a derivative or gradient to describe a rate of change or a direction of variation. Its interpretation depends on the source’s stated variables and conditions; this record does not assign an unprovided physical or cognitive meaning to them.

Terms & definitions

The recovered passage does not supply a separate symbol table. Read the source context for the notation used in this version; familiar letters may carry different meanings in other builds.

How it works

1. Read @brief Natural gradient (Fisher-Rao): ∇̃f as the quantity being defined or updated by this relation.

2. Uses a derivative or gradient to describe a rate of change or a direction of variation.

3. Use this version’s variable definitions and update order. The same symbol may be assigned a different meaning in another build.

Assumptions & limits

• This source expression was recovered from the pinned code revision. Its presence does not establish that the associated program was built, run, or scientifically validated.

Original context

 * @brief Free energy gradient: ∂F/∂x = 2(x - μ) - T·∂S/∂x
 */
inline double free_energy_gradient(double x, double mu, double temperature, double entropy_grad) {
    return 2.0 * (x - mu) - temperature * entropy_grad;
}

/**
 * @brief Natural gradient (Fisher-Rao): ∇̃f = G^{-1}∇f
 */
inline double natural_gradient(double gradient, double fisher_info) {
    if (fisher_info < 1e-10) return gradient;
    return gradient / fisher_info;
}

// ═══════════════════════════════════════════════════════════════════════════════
// VI. ACTIVATION FUNCTIONS & DERIVATIVES
// ═══════════════════════════════════════════════════════════════════════════════

@brief Natural gradient (Fisher-Rao): ∇̃f = G^{-1}∇f

Related builds