LanguageModel.ixx File Reference

Abstract base for Mila autoregressive language models. More...

#include <vector>
#include <unordered_set>
#include <memory>
#include <string>
#include <stdexcept>
#include <format>
#include <functional>
#include <stop_token>
#include <cstddef>
import Dnn.RuntimeMode;
import Dnn.TensorDataTypeTraits;
import Compute.DeviceType;
import Dnn.TensorDataType;
import Dnn.LanguageNetwork;
import Dnn.Model;

Classes
struct	Mila::Dnn::GenerationStatistics
	Statistics captured during a single generateStreaming() call. More...
class	Mila::Dnn::LanguageModel< TDeviceType, TPrecision >

Namespaces
namespace	Mila
	Mila main API namespace.
namespace	Mila::Dnn

Detailed Description

Abstract base for Mila autoregressive language models.

Extends Model with blocking and streaming generation APIs common to all language models. Derived classes implement the prefill + decode loop via the protected onGenerating() hook.