Core Directory Reference

Directory dependency graph for Core:

Files
	FileHeader.ixx
	Common file header structure for Mila data files.
	TokenizerTrainer.ixx
	Abstract trainer interface for building tokenizers' vocabularies.
	TrainerConfig.ixx
	TrainerFactory.ixx
	Factory helpers to construct tokenizer trainers and load vocabularies.