Modules List

Here is a list of all modules with brief descriptions:

MData.FileHeader
MData.TokenizerTrainer
MData.TrainerFactory
MData.DataLoader
MData.TokenSequenceLoader
MData.BpePreTokenizationMode
MData.BpeTokenizer
MData.BpeTrainer
MData.BpeVocabulary
MData.BpeVocabularyConfig
MData.CharTokenizer
MData.CharTrainer
MData.CharVocabulary
MData.CharVocabularyConfig
MData.SpecialTokens
MData.Tokenizer
MData.TokenizerType
MData.TokenizerVocabulary
MDnn.ActivationType
MDnn.ApproximationMethod
MDnn.Components.GeluConfig
MDnn.Components.Gelu
MDnn.Components.SwigluConfig
MDnn.Components.Swiglu
MDnn.AttentionType
MDnn.Components.GqaConfig
MDnn.Components.Gqa
MDnn.Components.MultiHeadAttentionConfig
MDnn.Components.MultiHeadAttention
MDnn.ConnectionType
MDnn.Components.Residual
MDnn.Components.ResidualConfig
MDnn.Components.TokenEmbeddingConfig
MDnn.Components.TokenEmbedding
MDnn.EncodingType
MDnn.Components.LpeConfig
MDnn.Components.Lpe
MDnn.Components.RopeConfig
MDnn.Components.Rope
MDnn.Components.MLP
MDnn.Components.Linear
MDnn.Components.LinearConfig
MDnn.Components.CrossEntropyConfig
MDnn.Components.SoftmaxCrossEntropy
MComponents.MilaComponents
MDnn.Components.LayerNorm
MDnn.NormType
MDnn.Components.RmsNormConfig
MDnn.Components.RmsNorm
MDnn.Components.Softmax
MDnn.Components.SoftmaxConfig
MDnn.Components.Dropout
MDnn.GenerateParams
MDnn.Components.GptBlock
MDnn.Components.GptTransformer
MDnn.Components.LlamaTransformer
MCompute.Device
MCompute.DeviceId
MCompute.CpuDevice
MCompute.CpuComputeDeviceTraits
MCompute.DeviceTypeTraits.Cpu
MCompute.CpuMemoryResource
MCompute.CpuMemoryResourceTraits
MCompute.CpuAttention
MCompute.CpuCrossEntropyOp
MCompute.CpuEncoderOp
MCompute.CpuGeluOp
MCompute.CpuLayerNormOp
MCompute.CpuLinearOp
MCompute.CpuOperations
MCompute.CpuResidualOp
MCompute.CpuSoftmaxCrossEntropyOp
MCompute.CpuSoftmaxOp
MCompute.CpuAdamWOptimizer
MCompute.CpuTensorDataTypeTraits
MCompute.CpuTensorOps
MCompute.CudaDevice
MCompute.CudaDeviceMemoryResource
MCompute.CudaDeviceProps
MCompute.CudaDeviceResources_deprecated
MCompute.DeviceTypeTraits.Cuda
MCompute.CudaManagedMemoryResource
MCompute.CudaDeviceMemoryResourceTraits
MCompute.CudaPinnedMemoryResource
MCublasLt.Utils
MCublasLt.Error
MCuda.BadAlloc
MCuda.Debug
MCuda.Error
MCuda.Helpers
MCompute.CudaGeluOp
MCompute.CudaSwigluOp
MCompute.CudaGqaOp
MCompute.CudaMultiHeadAttentionOp
MCompute.Cuda.CublasLtLinearPlan
MCompute.CublasLtPlan
MCompute.CublasLtPlanCache
MCuda.DataTypeTraits
MCompute.CudaOperations
MCompute.CudaTokenEmbeddingOp
MCompute.CudaLpeOp
MCompute.CudaRopeOp
MCompute.CublasLtMatMulBias
MCompute.CudaMatMulBiasGeluOp
MCompute.CudaLinearOp
MCompute.CudaSoftmaxCrossEntropyOp
MCompute.CudaLayerNormOp
MCompute.CudaRmsNormOp
MCompute.CudaSoftmaxOp
MCompute.CudaResidualOp
MCompute.CudaAdamWOptimizer
MCompute.Cuda.Timer
MProfiling.NvtxRange
MCompute.CudaTensorDataType
MCompute.CudaTensorOps
MCompute.MetalDevice
MCompute.MetalDevicePlugin
MCompute.MetalExecutionContext
MCompute.MetalMemoryResource
MCompute.MetalTensorDataTypeMap
MCompute.VulkanDevice
MCompute.VulkanExecutionContext
MCompute.VulkanMemoryResource
MCompute.VulkanTensorTraits
MCompute.DeviceType
MCompute.DeviceTypeTraits
MCompute.ExecutionContext
MCompute.ExecutionContextTemplate
MCompute.ExecutionContextFactory
MCompute.IExecutionContext
MCompute.MemoryResource
MCompute.MemoryResourceProperties
MCompute.MemoryResourceTracker
MCompute.MemoryResourceTraits
MCompute.BinaryOperation
MCompute.GqaState
MCompute.IKvCacheLifecycle
MCompute.IKvInference
MCompute.IPackedKvInference
MCompute.IPositionalDecode
MCompute.IPositionalPairedOp
MCompute.OperationBase
MCompute.OperationRegistrarHelpers
MCompute.OperationRegistry
MCompute.OperationRegistryHelpers
MCompute.OperationsRegistrar
MCompute.OperationTraits
MCompute.OperationTraits.Template
MCompute.OperationType
MCompute.PairedOperation
MCompute.UnaryOperation
MCompute.OptimizerBase
MCompute.DeviceRegistrar
MCompute.DeviceRegistry
MCompute.DeviceRegistryHelpers
MDnn.Component
MDnn.ComponentConfig
MDnn.ComponentFactory
MDnn.ComponentType
MDnn.CompositeComponent
MDnn.FusedComponent
MDnn.LanguageModel
MDnn.LanguageModelConfig
MDnn.LanguageNetwork
MDnn.LearningRateScheduler
MDnn.Loss
MDnn.Model
MDnn.RuntimeMode
MDnn.ModelConfig
MDnn.QuantizationConfig_OLD
MDnn.ModelReader_Deprecated
MDnn.Network
MDnn.NetworkFactory
MDnn.TokenStreamer
MExtensibility.PluginInterface	Interface that all Mila module plugins must implement
MExtensibility.PluginInfo
MExtensibility.PluginManager	Plugin manager (placeholder)
MDnn.Models.GptModel
MDnn.Models.LlamaModel
MDnn.Models.LlamaModelConfig
MDnn.Optimizers.AdamW
MDnn.Optimizers.AdamWConfig
MDnn.Quantization.KvCache.Policy
MDnn.Quantization.KvCache.QuantPolicy
MDnn.Quantization
MDnn.Quantization.Weight.Policies
MSerialization.ArchiveSerializer
MSerialization.ModelArchive
MSerialization.OpenMode
MSerialization.PretrainedReader
MSerialization.Metadata
MSerialization.Mode
MSerialization.Serializer
MSerialization.ZipSerializer
MDnn.ITensor
MDnn.TensorOps.Base
MDnn.TensorOps
MDnn.TensorHelpers
MDnn.TensorInitializers
MDnn.Tensor
MDnn.TensorPartitioning
MSerialization.Tensor
MDnn.TensorTypes
MDnn.TensorBuffer
MDnn.TensorDataType
MDnn.TensorDataTypeMap
MDnn.TensorDataTypeTraits
MDnn.TensorHostTypeMap
MVisualization.Transformer
MVisualization.LayerNorm
MVisualization.MLP
MVisualization.Model
MVisualization.Context
MVisualization.ColorLUT
MVisualization.FrameBuffer
MVisualization.HeatmapRenderer
MLogging.ConsoleSink
MLogging.FileSink
MLogging.Logger
MLogging.NullSink
MMila
Mnlohmann.json
MCore.RandomGenerator
MUtils.StepLogger
MMila.Version