ThatAIguyA world of ideas

THE CONSCIOUSNESS ATLAS
Read. Experiment. Follow the evidence.

ConsciousnessLearn · Explore · Joseph Anady

DOPAMINE REWARD SYSTEM · Temporal difference error: δ

This relation defines Temporal difference error: δ in the source section “DOPAMINE REWARD SYSTEM · Temporal difference error: δ”. It specifies the displayed relationship between the named quantities or parameters. Its interpretation depends on the source’s stated…

Implementation mathematicsSource recovered; runtime not executed
Learn with the Atlas

Learn to read this model

Start with the symbols, follow the operations, and check what the result means.

Open guided lesson
gh-eq-b8b09d5f7d682c2csource-comment-equation
Temporaldifferenceerror:δ=r+γV(s′)−V(s)Temporal difference error: δ = r + γV(s') - V(s)

Read the equation

This relation defines Temporal difference error: δ in the source section “DOPAMINE REWARD SYSTEM · Temporal difference error: δ”. It specifies the displayed relationship between the named quantities or parameters. Its interpretation depends on the source’s stated variables and conditions; this record does not assign an unprovided physical or cognitive meaning to them.

Terms & definitions

The recovered passage does not supply a separate symbol table. Read the source context for the notation used in this version; familiar letters may carry different meanings in other builds.

How it works

  1. Read Temporal difference error: δ as the quantity being defined or updated by this relation.

  2. Substitute the source-defined variables or recorded values and follow the displayed arithmetic and indexing exactly.

  3. Use this version’s variable definitions and update order. The same symbol may be assigned a different meaning in another build.

Assumptions & limits

  • This source expression was recovered from the pinned code revision. Its presence does not establish that the associated program was built, run, or scientifically validated.

Original context

Read the surrounding source passage
    // ═══════════════════════════════════════════════════════════════════════════
    // DOPAMINE REWARD SYSTEM
    // TD-learning style reward prediction
    // ═══════════════════════════════════════════════════════════════════════════

    float compute_dopamine_signal(APIDomain domain, float expected_reward, float actual_reward) {
        // Temporal difference error: δ = r + γV(s') - V(s)
        float td_error = actual_reward - expected_reward;

        // Update dopamine based on surprise
        float dopamine_delta = td_error * learning_rate;
        dopamine_current = std::clamp(dopamine_current + dopamine_delta, 0.0f, 1.0f);

        // Phasic dopamine response (burst or dip)
        float phasic = std::tanh(td_error * 3.0f);

        // Update domain-specific dopamine signal
Exact original notation
Temporal difference error: δ = r + γV(s') - V(s)

Related builds

Sources & provenance

Search equations, builds, manuscript text, and recovered sources.