bert::TFusedMHAKernelFactory< TFusedMHAKernelList > Class Template Reference

Collaboration diagram for bert::TFusedMHAKernelFactory< TFusedMHAKernelList >:

Public Member Functions
const TFusedMHAKernelList *	getXMMAKernels (const typename TFusedMHAKernelList::KernelMeta *pKernelList, unsigned int nbKernels, Data_type type, unsigned int sm)

Static Public Member Functions
static TFusedMHAKernelFactory< TFusedMHAKernelList > &	Get ()

Private Member Functions
	TFusedMHAKernelFactory ()=default
uint64_t	hashID (Data_type type, unsigned int sm) const

Private Attributes
std::unordered_map< uint64_t, const std::unique_ptr< TFusedMHAKernelList > >	mKernels

Constructor & Destructor Documentation

TFusedMHAKernelFactory()

template<typename TFusedMHAKernelList >

bert::TFusedMHAKernelFactory< TFusedMHAKernelList >::TFusedMHAKernelFactory ( )

privatedefault

Member Function Documentation

getXMMAKernels()

template<typename TFusedMHAKernelList >

const TFusedMHAKernelList* bert::TFusedMHAKernelFactory< TFusedMHAKernelList >::getXMMAKernels ( const typename TFusedMHAKernelList::KernelMeta *  pKernelList, unsigned int  nbKernels, Data_type  type, unsigned int  sm  )

inline

Here is the call graph for this function:

Get()

template<typename TFusedMHAKernelList >

static TFusedMHAKernelFactory<TFusedMHAKernelList>& bert::TFusedMHAKernelFactory< TFusedMHAKernelList >::Get ( )

inlinestatic

Here is the caller graph for this function:

hashID()

template<typename TFusedMHAKernelList >

uint64_t bert::TFusedMHAKernelFactory< TFusedMHAKernelList >::hashID ( Data_type  type, unsigned int  sm  ) const

inlineprivate

Here is the caller graph for this function:

Member Data Documentation

mKernels

template<typename TFusedMHAKernelList >

std::unordered_map<uint64_t, const std::unique_ptr<TFusedMHAKernelList> > bert::TFusedMHAKernelFactory< TFusedMHAKernelList >::mKernels

private

---

The documentation for this class was generated from the following file:

• fused_multihead_attention.h