IKVCacheLifecycle.ixx File Reference

Interface for operations that own and manage a KV cache. More...

Classes
struct	Mila::Dnn::Compute::IKvCacheLifecycle
	Capability interface for KV-cache state management. More...

Namespaces
namespace	Mila
	Mila main API namespace.
namespace	Mila::Dnn
namespace	Mila::Dnn::Compute

Detailed Description

Interface for operations that own and manage a KV cache.