ThatAIguyA world of ideas

THE CONSCIOUSNESS ATLAS
Read. Experiment. Follow the evidence.

ConsciousnessLearn · Explore · Joseph Anady

The equation library

Every recovered mathematical record has an individual page. Browse original equations, code expressions, indexed components, parameter definitions, and explicitly unresolved source slots.

2,910 recordsSource snapshot 2026-10-17

Counts refer to mathematical records, including implemented expressions and generated instances. They are not counts of independently validated theories. Exact occurrences and unresolved slots remain traceable. Read the complete 1–516 source index ↗ · Inspect the scan decisions ↗

2,910 records · page 18 of 59Search the source archive ↗
donor-eq-96bfc9f1670bed

DeepSeek Attention.__init__: kv a proj with mqa

In DeepseekV3Attention.__init__, this statement defines or updates self.kv_a_proj_with_mqa. The addition or subtraction updates the named state or combines residual contributions. The input shapes and the order in the surrounding forward path must be preserved.

Donor model implementationhistorical source recovered; expression not executed in this website audit
self.kv_a_proj_with_mqa = nn.Linear( self.hidden_size, config.kv_lora_rank + config.qk_rope_head_dim, bias=config.attention_bias, )
donor-eq-a4373a50e4accf

DeepSeek Attention.__init__: kv b proj

In DeepseekV3Attention.__init__, this statement defines or updates self.kv_b_proj. The displayed multiplication combines the source factors. For tensors this is elementwise unless the called operation explicitly performs a matrix contraction.

Donor model implementationhistorical source recovered; expression not executed in this website audit
self.kv_b_proj = nn.Linear( config.kv_lora_rank, self.num_heads * (self.q_head_dim - self.qk_rope_head_dim + self.v_head_dim), bias=False, )
donor-eq-fc065a303ef981

DeepSeek Attention.__init__: o proj

In DeepseekV3Attention.__init__, this statement defines or updates self.o_proj. The displayed multiplication combines the source factors. For tensors this is elementwise unless the called operation explicitly performs a matrix contraction.

Donor model implementationhistorical source recovered; expression not executed in this website audit
self.o_proj = nn.Linear( self.num_heads * self.v_head_dim, self.hidden_size, bias=config.attention_bias, )

Search equations, builds, manuscript text, and recovered sources.