Dnn.TokenStreamer Module Reference

Concepts
concept	Mila::Dnn::TokenSink
	Satisfied by any callable accepting a span of decoded tokens.
concept	Mila::Dnn::TokenStreamer
	Satisfied by any callable accepting a single decoded token.

Classes
class	Mila::Dnn::BufferedTokenStreamer< Sink, BufSize >
	Buffers BufSize tokens before forwarding a contiguous span to Sink. More...

Files
file	/__w/Mila/Mila/Mila/Src/Dnn/Core/TokenStreamer.ixx
	Token streaming abstractions for autoregressive generation.