Class PredictPoses

Namespace

Bonsai.Sleap

Assembly

Bonsai.Sleap.dll

Represents an operator that performs markerless multi-pose estimation for each image in the sequence using a SLEAP model.

PredictPoses runs the topdown model. This model is used to find multiple instances in a full frame. This operator will output a PoseCollection object containing the collection of instances found in the image. Indexing a PoseCollection will return a Pose where we can access the Centroid for each detected instance along with the Pose containing information on all trained body parts.

The GetBodyPart operator can be used to access the data for a specific body part. By setting the Name property to match the part name defined in the export_metadata.json file, the operator will filter the collection and send notifications for the selected BodyPart object and its inferred position (BodyPart.Position).

public class PredictPoses : Transform<IplImage, PoseCollection>

Inheritance

object

Combinator<IplImage, PoseCollection>

Transform<IplImage, PoseCollection>

PredictPoses

Inherited Members

Combinator<IplImage, PoseCollection>.Process(IObservable<IplImage>)

object.ToString()

object.Equals(object)

object.Equals(object, object)

object.ReferenceEquals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

Properties

CentroidMinConfidence

Gets or sets a value specifying the confidence threshold used to discard centroid predictions. If no value is specified, all estimated centroid positions are returned.

ColorConversion

Gets or sets a value specifying the optional color conversion used to prepare RGB video frames for inference. If no value is specified, no color conversion is performed.

ExecutionProvider

Gets or sets the ONNX runtime execution provider used to perform model inference.

InputSize

Gets or sets a value specifying a target size used to resize video frames for inference. If no value is specified, no resizing is performed.

ModelFileName

Gets or sets a value specifying the path to the exported ONNX file containing the pretrained SLEAP model.

PartMinConfidence

Gets or sets a value specifying the confidence threshold used to discard predicted body part positions. If no value is specified, all estimated positions are returned.

Methods

Process(IObservable<IplImage>)

Performs markerless multi-pose estimation for each image in an observable sequence using a SLEAP model.

See Also

PredictCentroids

PredictPoseIdentities

PredictSinglePose

GetBodyPart