MultiHeadAttentionConfig.ixx File Reference

Configuration interface for the MultiHeadAttention module in the Mila DNN framework. More...

#include <stdexcept>
#include <vector>
import Dnn.ComponentConfig;
import Dnn.Module;

Classes
class	Mila::Dnn::MultiHeadAttentionConfig
	Configuration class for MultiHeadAttention module. More...

Namespaces
namespace	Mila
namespace	Mila::Dnn

Detailed Description

Configuration interface for the MultiHeadAttention module in the Mila DNN framework.

Defines the MultiHeadAttentionConfig class, providing a type-safe fluent interface for configuring MultiHeadAttention modules. Inherits from ComponentConfig CRTP base and adds attention-specific options such as embedding dimension, number of heads, and dropout rates.