blace.ai
blace::ops::InferenceOp Class Reference

#include <public_ops.h>

Inheritance diagram for blace::ops::InferenceOp:

Public Member Functions

 InferenceOp (std::vector< char > model_bytes, std::vector< OpP > inputs, ml_core::InferenceArgsCollection inference_args, int return_index, std::string payload_folder)
 
 InferenceOp (InferenceOp const &e)
 

Detailed Description

Operator to run model inference.

Constructor & Destructor Documentation

◆ InferenceOp() [1/2]

blace::ops::InferenceOp::InferenceOp ( std::vector< char >  model_bytes,
std::vector< OpP >  inputs,
ml_core::InferenceArgsCollection  inference_args,
int  return_index,
std::string  payload_folder 
)

Constructs an operator which runs model inference.

Parameters
model_bytesThe bytes of the model to run, will be provided from the included model header.
inputsA vector of input nodes passed to the model.
inference_argsThe inference arguments used to run the inference.
return_indexThe desired result index, some models return multiple tensors.
payload_folderPayload folder.

◆ InferenceOp() [2/2]

blace::ops::InferenceOp::InferenceOp ( InferenceOp const &  e)

Default copy constructor explicitly defined for dll exporting.

Parameters
eThe copy class.