DeepSeek Attention.forward: attn weights
In DeepseekV3Attention.forward, this statement defines or updates attn_weights. Softmax exponentiates and normalizes scores along the chosen axis, producing nonnegative weights that sum to one when inputs are finite. The matrix or indexed contraction combines the stated axes. Compatible tensor…