Contextualizebeta

cross-attention

noun

Etymology

From cross- + attention.

  1. derived from attentio
  2. inherited from attencioun
  3. formed as cross-attention — “cross- + attention”

Definitions

  1. A form of attention (machine learning method) where two different input sequences are…

    A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.

    • The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […]

The neighborhood

Vish — recursive loop

No curated loop yet for cross-attention. Loops are being traced one word at a time while the ingestion pipeline matures.

sense glosses and etymology drawn from English Wiktionary · source · CC-BY-SA