BertInferenceRunner Struct Reference

Collaboration diagram for BertInferenceRunner:

Public Member Functions
	BertInferenceRunner (const std::string &enginePath, const int maxBatchSize, const int maxSeqLength, const bool enableGraph)
void	prepare (const int batchSize)
py::array_t< float >	run (py::array_t< int > inputIds, py::array_t< int > segmentIds, py::array_t< int > inputMask)

Public Attributes
BertInference	bert

Constructor & Destructor Documentation

BertInferenceRunner()

BertInferenceRunner::BertInferenceRunner ( const std::string &  enginePath, const int  maxBatchSize, const int  maxSeqLength, const bool  enableGraph  )

inline

Member Function Documentation

prepare()

void BertInferenceRunner::prepare ( const int  batchSize )

inline

run()

py::array_t<float> BertInferenceRunner::run ( py::array_t< int >  inputIds, py::array_t< int >  segmentIds, py::array_t< int >  inputMask  )

inline

Here is the caller graph for this function:

Member Data Documentation

bert

BertInference BertInferenceRunner::bert

---

The documentation for this struct was generated from the following file:

• infer_c.cpp