CharVocabularyConfig.ixx File Reference

Configuration for Character-level tokenizer training. More...

#include <stdexcept>
#include <string>
#include <sstream>
import Serialization.Metadata;
import Data.SpecialTokens;

Classes
class	Mila::Data::CharVocabularyConfig
	Configuration for Character-level tokenizer training. More...

Namespaces
namespace	Mila
	Mila main API namespace.
namespace	Mila::Data

Detailed Description

Configuration for Character-level tokenizer training.

Provides fluent setters and serialization/validation for character tokenizer options.