ThatAIguyA world of ideas

THE CONSCIOUSNESS ATLAS
Read. Experiment. Follow the evidence.

ConsciousnessLearn · Explore · Joseph Anady

YaRN prose blend with the ramp orientation reversed

If ramp is the increasing yarn_linear_ramp_mask defined in the embedded source, this prose reverses the blend. The body defines inv_freq_mask=1−ramp and returns interp*(1−inv_freq_mask)+extra*inv_freq_mask, equivalent to interp*ramp+extra*(1−ramp). At a zero ramp the…

Donor architecture mathematicshistorical source recovered; expression not executed in this website audit
Learn with the Atlas

Learn to read this model

Start with the symbols, follow the operations, and check what the result means.

Open guided lesson
donor-deepseek-yarn-blend-overviewdocumented formula or resource estimate
invfreq=interp∗(1−ramp)+extrap∗rampinv_freq = interp * (1 - ramp) + extrap * ramp

Read the equation

If ramp is the increasing yarn_linear_ramp_mask defined in the embedded source, this prose reverses the blend. The body defines inv_freq_mask=1−ramp and returns interp(1−inv_freq_mask)+extrainv_freq_mask, equivalent to interpramp+extra(1−ramp). At a zero ramp the code retains the original high frequency; at a unit ramp it uses the divided frequency.

Terms & definitions

TermMeaning in this source
interp

Frequency divided by extension factor

extrap

Original frequency

ramp

Increasing clipped ramp across frequency indices

How it works

Read the definition from its right-hand expression to the quantity on the left. Its surrounding source records the intended input, state, or parameter context. Where the source leaves an operation unspecified, this page preserves that gap.

Assumptions & limits

Source recovery establishes that the expression appears in this record. Its mathematical validity, implementation behavior, and interpretation must be assessed separately. See the linked source and research notes for the checks available for this version.

Original context

Read the surrounding source passage
A linear ramp over [low, high] blends two frequency schedules:
          inv_freq_interpolation = 1 / (factor * base^(2i/dim))   low freq, scaled
          inv_freq_extrapolation = 1 / (base^(2i/dim))            high freq, raw
          inv_freq = interp * (1 - ramp) + extrap * ramp
      High-frequency dimensions extrapolate unchanged; low-frequency dimensions
      are interpolated by the factor of 40.

  THE MAGNITUDE CORRECTION
Exact original notation
inv_freq = interp * (1 - ramp) + extrap * ramp

Related builds

Sources & provenance

01
DEEPSEEK_R1_COMPLETE.txt
lines 947–947 · Aug 5, 2026
inv_freq = interp * (1 - ramp) + extrap * ramp
02
DEEPSEEK_R1_COMPLETE.txt
lines 947–947 · Aug 5, 2026
inv_freq = interp * (1 - ramp) + extrap * ramp

Search equations, builds, manuscript text, and recovered sources.