TensorRT  7.2.1.6
NVIDIA TensorRT
Looking for a C++ dev who knows TensorRT?
I'm looking for work. Hire me!
nvinfer1::plugin Namespace Reference

Namespaces

 detail
 

Classes

class  BaseCreator
 
class  BasePlugin
 
class  BatchedNMSBasePluginCreator
 
class  BatchedNMSDynamicPlugin
 
class  BatchedNMSDynamicPluginCreator
 
class  BatchedNMSPlugin
 
class  BatchedNMSPluginCreator
 
class  BatchTilePlugin
 
class  BatchTilePluginCreator
 
class  CoordConvACPlugin
 
class  CoordConvACPluginCreator
 
class  CropAndResizePlugin
 
class  CropAndResizePluginCreator
 
class  CublasError
 
class  CudaError
 
class  CudnnError
 
class  DetectionLayer
 
class  DetectionLayerPluginCreator
 
class  DetectionOutput
 
struct  DetectionOutputParameters
 The DetectionOutput plugin layer generates the detection output based on location and confidence predictions by doing non maximum suppression. More...
 
class  FlattenConcat
 
class  FlattenConcatPluginCreator
 
class  GenerateDetection
 
class  GenerateDetectionPluginCreator
 
class  GridAnchorBasePluginCreator
 
class  GridAnchorGenerator
 
struct  GridAnchorParameters
 The Anchor Generator plugin layer generates the prior boxes of designated sizes and aspect ratios across all dimensions (H x W). More...
 
class  GridAnchorPluginCreator
 
class  GridAnchorRectPluginCreator
 
class  GroupNormalizationPlugin
 
class  GroupNormalizationPluginCreator
 
class  InstanceNormalizationPlugin
 
class  InstanceNormalizationPluginCreator
 
class  LogStream
 
class  LReLU
 
class  LReluPluginCreator
 
class  MultilevelCropAndResize
 
class  MultilevelCropAndResizePluginCreator
 
class  MultilevelProposeROI
 
class  MultilevelProposeROIPluginCreator
 
struct  NMSParameters
 The NMSParameters are used by the BatchedNMSPlugin for performing the non_max_suppression operation over boxes for object detection networks. More...
 
class  NMSPluginCreator
 
class  Normalize
 
class  NormalizePluginCreator
 
class  PluginCreatorRegistry
 
class  PriorBox
 
struct  PriorBoxParameters
 The PriorBox plugin layer generates the prior boxes of designated sizes and aspect ratios across all dimensions (H x W). More...
 
class  PriorBoxPluginCreator
 
class  ProposalLayer
 
class  ProposalLayerPluginCreator
 
class  ProposalPlugin
 
class  ProposalPluginCreator
 
class  PyramidROIAlign
 
class  PyramidROIAlignPluginCreator
 
struct  Quadruple
 The Permute plugin layer permutes the input tensor by changing the memory order of the data. More...
 
class  reduced_divisor
 
class  Region
 
class  RegionPluginCreator
 
class  Reorg
 
class  ReorgPluginCreator
 
class  ResizeNearest
 
class  ResizeNearestPluginCreator
 
struct  RPROIParams
 RPROIParams is used to create the RPROIPlugin instance. More...
 
class  RPROIPlugin
 
class  RPROIPluginCreator
 
class  SpecialSlice
 
class  SpecialSlicePluginCreator
 
class  SplitPlugin
 
class  SplitPluginCreator
 
class  TRTException
 

Typedefs

typedef LReLU PReLU
 

Enumerations

enum  CodeTypeSSD : int32_t {
  CodeTypeSSD::CORNER = 0,
  CodeTypeSSD::CENTER_SIZE = 1,
  CodeTypeSSD::CORNER_SIZE = 2,
  CodeTypeSSD::TF_CENTER = 3
}
 The type of encoding used for decoding the bounding boxes and loc_data. More...
 

Functions

 __attribute__ ((deprecated)) typedef struct
 The Region plugin layer performs region proposal calculation: generate 5 bounding boxes per cell (for yolo9000, generate 3 bounding boxes per cell). More...
 
void throwCudaError (const char *file, const char *function, int line, int status, const char *msg)
 
void throwCublasError (const char *file, const char *function, int line, int status, const char *msg)
 
void throwCudnnError (const char *file, const char *function, int line, int status, const char *msg)
 
void logError (const char *msg, const char *file, const char *fn, int line)
 
void reportAssertion (const char *msg, const char *file, int line)
 
size_t detectionInferenceWorkspaceSize (bool shareLocation, int N, int C1, int C2, int numClasses, int numPredsPerClass, int topK, DataType DT_BBOX, DataType DT_SCORE)
 
template<typename T >
void write (char *&buffer, const T &val)
 
template<typename T >
read (const char *&buffer)
 
template<typename T >
void scaleShiftChannelsInplace (T *inOut, const int B, const int C, const int channelVolume, const float *beta, const float *gamma, cudaStream_t stream)
 
template<typename CreatorType >
void initializePlugin (void *logger, const char *libNamespace)
 

Variables

 softmaxTree
 
ILoggergLogger {}
 
LogStream< ILogger::Severity::kERRORgLogError
 
LogStream< ILogger::Severity::kWARNINGgLogWarning
 
LogStream< ILogger::Severity::kINFOgLogInfo
 
LogStream< ILogger::Severity::kVERBOSEgLogVerbose
 

Typedef Documentation

◆ PReLU

Enumeration Type Documentation

◆ CodeTypeSSD

enum nvinfer1::plugin::CodeTypeSSD : int32_t
strong

The type of encoding used for decoding the bounding boxes and loc_data.

Enumerator
CORNER 

Use box corners.

CENTER_SIZE 

Use box centers and size.

CORNER_SIZE 

Use box centers and size.

TF_CENTER 

Use box centers and size but flip x and y coordinates.

Function Documentation

◆ __attribute__()

struct nvinfer1::plugin::__attribute__ ( (deprecated)  )

The Region plugin layer performs region proposal calculation: generate 5 bounding boxes per cell (for yolo9000, generate 3 bounding boxes per cell).

For each box, calculating its probablities of objects detections from 80 pre-defined classifications (yolo9000 has 9418 pre-defined classifications, and these 9418 items are organized as work-tree structure). RegionParameters defines a set of parameters for creating the Region plugin layer.

Parameters
numNumber of predicted bounding box for each grid cell.
coordsNumber of coordinates for a bounding box.
classesNumber of classfications to be predicted.
softmaxTreeWhen performing yolo9000, softmaxTree is helping to do softmax on confidence scores, for element to get the precise classfication through word-tree structured classfication definition.
Deprecated:
. This plugin is superseded by createRegionPlugin and will be removed in TensorRT 8.0.

◆ throwCudaError()

void nvinfer1::plugin::throwCudaError ( const char *  file,
const char *  function,
int  line,
int  status,
const char *  msg 
)
Here is the call graph for this function:

◆ throwCublasError()

void nvinfer1::plugin::throwCublasError ( const char *  file,
const char *  function,
int  line,
int  status,
const char *  msg 
)
Here is the call graph for this function:

◆ throwCudnnError()

void nvinfer1::plugin::throwCudnnError ( const char *  file,
const char *  function,
int  line,
int  status,
const char *  msg 
)
Here is the call graph for this function:

◆ logError()

void nvinfer1::plugin::logError ( const char *  msg,
const char *  file,
const char *  fn,
int  line 
)

◆ reportAssertion()

void nvinfer1::plugin::reportAssertion ( const char *  msg,
const char *  file,
int  line 
)
Here is the call graph for this function:

◆ detectionInferenceWorkspaceSize()

size_t nvinfer1::plugin::detectionInferenceWorkspaceSize ( bool  shareLocation,
int  N,
int  C1,
int  C2,
int  numClasses,
int  numPredsPerClass,
int  topK,
DataType  DT_BBOX,
DataType  DT_SCORE 
)
Here is the caller graph for this function:

◆ write()

template<typename T >
void nvinfer1::plugin::write ( char *&  buffer,
const T &  val 
)
Here is the caller graph for this function:

◆ read()

template<typename T >
T nvinfer1::plugin::read ( const char *&  buffer)

◆ scaleShiftChannelsInplace()

template<typename T >
void nvinfer1::plugin::scaleShiftChannelsInplace ( T *  inOut,
const int  B,
const int  C,
const int  channelVolume,
const float *  beta,
const float *  gamma,
cudaStream_t  stream 
)
Here is the caller graph for this function:

◆ initializePlugin()

template<typename CreatorType >
void nvinfer1::plugin::initializePlugin ( void *  logger,
const char *  libNamespace 
)
Here is the call graph for this function:

Variable Documentation

◆ softmaxTree

nvinfer1::plugin::softmaxTree

◆ gLogger

ILogger * nvinfer1::plugin::gLogger {}

◆ gLogError

LogStream< ILogger::Severity::kERROR > nvinfer1::plugin::gLogError

◆ gLogWarning

LogStream< ILogger::Severity::kWARNING > nvinfer1::plugin::gLogWarning

◆ gLogInfo

LogStream< ILogger::Severity::kINFO > nvinfer1::plugin::gLogInfo

◆ gLogVerbose

LogStream< ILogger::Severity::kVERBOSE > nvinfer1::plugin::gLogVerbose