Table of Contents

Class PredictPoseIdentities

Namespace
Bonsai.Sleap
Assembly
Bonsai.Sleap.dll

Represents an operator that performs markerless multi-pose and identity estimation for each image in the sequence using a SLEAP model.

PredictPoseIdentities runs the multi_class_topdown_combined model. This model combines the centroid detection model with a centered instance multiclass model. In addition to extracting pose information for each detected instance in the image, this model also returns the inferred identity of the object.

In addition to the properties of the Pose object, the extended PoseIdentity class adds Identity property that indicates the highest confidence identity. This will match one of the class names found in export_metadata.json. The IdentityScores property indicates the confidence values for all class labels.

The operator GetMaximumConfidencePoseIdentity can be used to extract the PoseIdentity with the highest confidence from the input PoseIdentityCollection. By specifying a value in the optional Identity property, the operator will return the instance will the highest confidence for that particular class.

MultiClassTopDownModel

public class PredictPoseIdentities : Transform<IplImage, PoseIdentityCollection>
Inheritance
PredictPoseIdentities
Inherited Members

Properties

CentroidMinConfidence

Gets or sets a value specifying the confidence threshold used to discard centroid predictions. If no value is specified, all estimated centroid positions are returned.

ColorConversion

Gets or sets a value specifying the optional color conversion used to prepare RGB video frames for inference. If no value is specified, no color conversion is performed.

ExecutionProvider

Gets or sets the ONNX runtime execution provider used to perform model inference.

IdentityMinConfidence

Gets or sets a value specifying the confidence threshold used to assign an identity class. If no value is specified, the identity with highest confidence will be assigned to each pose.

InputSize

Gets or sets a value specifying a target size used to resize video frames for inference. If no value is specified, no resizing is performed.

ModelFileName

Gets or sets a value specifying the path to the exported ONNX file containing the pretrained SLEAP model.

PartMinConfidence

Gets or sets a value specifying the confidence threshold used to discard predicted body part positions. If no value is specified, all estimated positions are returned.

Methods

Process(IObservable<IplImage>)

Performs markerless multi-pose and identity estimation for each image in an observable sequence using a SLEAP model.

See Also