Mila 0.13.48
Deep Neural Network Library
Loading...
Searching...
No Matches
Dnn.AttentionType Module Reference

Enumerations

enum class  Mila::Dnn::AttentionType { MultiHead , GroupedQuery , MultiQuery }
 Enumeration of supported attention mechanism types. More...

Functions

std::string Mila::Dnn::attentionTypeToString (AttentionType t)
 Convert AttentionType to string.
AttentionType Mila::Dnn::stringToAttentionType (const std::string &v)
 Parse string to AttentionType.

Files

file  /__w/Mila/Mila/Mila/Src/Dnn/Components/Attention/AttentionType.ixx
 Defines attention mechanism types used by transformer components.