IKvInference.ixx File Reference

KV-cache compute interface for modern attention backends (GQA and beyond). More...

import Compute.IKvCacheLifecycle;
import Dnn.ITensor;

Classes
struct	Mila::Dnn::Compute::IKvInference
	Compute interface for attention operations that maintain a KV cache. More...

Namespaces
namespace	Mila
	Mila main API namespace.
namespace	Mila::Dnn
namespace	Mila::Dnn::Compute

Detailed Description

KV-cache compute interface for modern attention backends (GQA and beyond).