CpuAdamWOptimizer.ixx File Reference

CPU implementation of AdamW optimizer. More...

#include <vector>
#include <memory>
#include <stdexcept>
#include <string>
#include <sstream>
#include <cstdint>
#include <cmath>
#include <cstring>
import Compute.ExecutionContext;
import Compute.CpuMemoryResource;
import Compute.DeviceType;
import Dnn.TensorHostTypeMap;
import Dnn.TensorInitializers;
import Dnn.TensorDataTypeTraits;
import Dnn.TensorDataType;
import Dnn.Tensor;
import Dnn.ITensor;
import Compute.OptimizerBase;
import Dnn.TensorTypes;
import Dnn.Optimizers.AdamWConfig;

Classes
class	Mila::Dnn::Compute::CpuAdamWOptimizer< TPrecision >
	CPU-specific AdamW optimizer implementation. More...

Namespaces
namespace	Mila
	Mila main API namespace.
namespace	Mila::Dnn
namespace	Mila::Dnn::Compute

Typedefs
using	Mila::Dnn::Compute::AdamWConfig = Mila::Dnn::Optimizers::AdamWConfig

Detailed Description

CPU implementation of AdamW optimizer.

Implements the AdamW optimization algorithm for CPU tensors using scalar loops. Maintains per-parameter state tensors (momentum, variance) and performs parameter updates in-place on CPU memory.