AttentionType.ixx File Reference

Defines attention mechanism types used by transformer components. More...

#include <string>
#include <stdexcept>

Namespaces
namespace	Mila
	Mila main API namespace.
namespace	Mila::Dnn

Enumerations
enum class	Mila::Dnn::AttentionType { Mila::Dnn::MultiHead , Mila::Dnn::GroupedQuery , Mila::Dnn::MultiQuery }
	Enumeration of supported attention mechanism types. More...

Functions
std::string	Mila::Dnn::attentionTypeToString (AttentionType t)
	Convert AttentionType to string.
AttentionType	Mila::Dnn::stringToAttentionType (const std::string &v)
	Parse string to AttentionType.

Detailed Description

Defines attention mechanism types used by transformer components.