Questions tagged [hyperparameter]

Hyperparameters of a model are the kind of parameters that cannot be directly learned during training but are set beforehand. Hyperparameters can define, for example, the complexity of the model or its capacity to learn.

Hyperparameters are model parameters that are defined before training begins whereas regular parameters are learned during the training process.

150 questions
1
vote
2 answers

is learning rate schedule a hyperparameter?

I believe term ‘learning rate schedule’ is a certain solution for tuning the learning rate. But at the same time, every parameter evaluating the parameter itself can be called a hyperparameter. So can the learning rate schedule be called a…
Lee
  • 11
  • 1