Contract for GroupedQueryAttentionOp: positional forward and backward. More...

Concept definition

template<typename TOp, typename TTensor>
concept Mila::Dnn::Compute::GqaOpConcept =  requires( const TOp& op, const TTensor& in, TTensor& out )
    {
        op.forward( in, out );
        op.backward( in, in, out );
    }

Detailed Description

Contract for GroupedQueryAttentionOp: positional forward and backward.

Template Parameters

TOp	Candidate op type.
TTensor	Tensor type at the call site.