Mila::Dnn::GenerateParams Struct Reference

Public Attributes
std::optional< TokenId >	eos_token_id
int	max_new_tokens = 128
float	temperature = 1.0f

Member Data Documentation

eos_token_id

std::optional<TokenId> Mila::Dnn::GenerateParams::eos_token_id

max_new_tokens

int Mila::Dnn::GenerateParams::max_new_tokens = 128

temperature

float Mila::Dnn::GenerateParams::temperature = 1.0f

---

The documentation for this struct was generated from the following file:

• /__w/Mila/Mila/Mila/Src/Dnn/Components/Transformers/GenerateParams.ixx