Contextualizebeta

hyperparameter

noun

Etymology

From hyper- + parameter.

  1. derived from παρα-
  2. derived from parametrum
  3. borrowed from paramètre
  4. prefixed as hyperparameter — “hyper + parameter”

Definitions

  1. A parameter of a prior (as distinguished from inferred parameters of the model for the…

    A parameter of a prior (as distinguished from inferred parameters of the model for the underlying system under analysis).

    • this model has four hyperparameters
    • The exact interpretation of these hyperparameters becomes clearer once you have seen their role in the posterior and, hence, we defer a deeper discussion of prior elicitation until the next section.

  2. A parameter whose value is set before the learning process begins.

    • The ideal learning algorithm just takes a dataset and outputs a function, without requiring hand tuning of hyperparameters.
    • “Model behaviour is not determined by architecture, hyperparameters, or optimizer choices,” he said, referring to the technical difficulties of training a language model. “It’s determined by your dataset, nothing else. […]”

The neighborhood

Derived

hyperparametric

Vish — recursive loop

No curated loop yet for hyperparameter. Loops are being traced one word at a time while the ingestion pipeline matures.

sense glosses and etymology drawn from English Wiktionary · source · CC-BY-SA