Contextualizebeta

self-attention

noun

Etymology

From self- + attention.

  1. derived from attentio
  2. inherited from attencioun
  3. prefixed as self-attention — “self + attention”

Definitions

  1. A form of attention (machine learning method) where input sequence is compared with…

    A form of attention (machine learning method) where input sequence is compared with itself, i.e. the keys and queries are the same.

  2. Conscious attention to one's own physiological and emotional state and behavior.

    • According to self-attention theory in general, it can be predicted that heightened self-attention leads to a closer fit between observed behavior and some underlying salient standard.
    • Interest in the consequences of self-attention spread fairly quickly from social to personality psychologists.

The neighborhood

Vish — recursive loop

No curated loop yet for self-attention. Loops are being traced one word at a time while the ingestion pipeline matures.

sense glosses and etymology drawn from English Wiktionary · source · CC-BY-SA