Class PredictPoses

Namespace

Bonsai.Sleap

Assembly

Bonsai.Sleap.dll

Represents an operator that performs markerless multi-pose estimation for each image in the sequence using a SLEAP model.

PredictPoses implements the [top-down-model network]. The usual input of this operation will be a sequence of full frames where multiple instances are expected to be found. This operator will output a PoseCollection with N number of instances found in the image. Indexing a PoseCollection will return a Pose where we can access the Centroid of each detected instance along with the Pose containing information on all trained body parts.

To access the data of a specific body part we use the GetBodyPart. We set Name to match the part name defined in the training_config.json file. From that moment, the operator will always emit the selected BodyPart object and its inferred position (BodyPart.Position).

public class PredictPoses : Transform<IplImage, PoseCollection>

Inheritance

object

Combinator<IplImage, PoseCollection>

Transform<IplImage, PoseCollection>

PredictPoses

Inherited Members

Combinator<IplImage, PoseCollection>.Process(IObservable<IplImage>)

object.ToString()

object.Equals(object)

object.Equals(object, object)

object.ReferenceEquals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

Properties

CentroidMinConfidence

Gets or sets a value specifying the confidence threshold used to discard centroid predictions. If no value is specified, all estimated centroid positions are returned.

[Range(0, 1)]
public float? CentroidMinConfidence { get; set; }

Property Value

float?

ColorConversion

Gets or sets a value specifying the optional color conversion used to prepare RGB video frames for inference. If no value is specified, no color conversion is performed.

public ColorConversion? ColorConversion { get; set; }

Property Value

ColorConversion?

ModelFileName

Gets or sets a value specifying the path to the exported Protocol Buffer file containing the pretrained SLEAP model.

[FileNameFilter("Protocol Buffer Files(*.pb)|*.pb")]
public string ModelFileName { get; set; }

Property Value

string

PartMinConfidence

Gets or sets a value specifying the confidence threshold used to discard predicted body part positions. If no value is specified, all estimated positions are returned.

[Range(0, 1)]
public float? PartMinConfidence { get; set; }

Property Value

float?

ScaleFactor

Gets or sets a value specifying the scale factor used to resize video frames for inference. If no value is specified, no resizing is performed.

public float? ScaleFactor { get; set; }

Property Value

float?

TrainingConfig

Gets or sets a value specifying the path to the configuration JSON file containing training metadata.

[FileNameFilter("Config Files(*.json)|*.json|All Files|*.*")]
public string TrainingConfig { get; set; }

Property Value

string

Methods

Process(IObservable<IplImage>)

Performs markerless multi-pose estimation for each image in an observable sequence using a SLEAP model.

public override IObservable<PoseCollection> Process(IObservable<IplImage> source)

Parameters

source IObservable<IplImage>

The sequence of images from which to extract the poses.

Returns

IObservable<PoseCollection>

A sequence of PoseCollection objects representing the poses extracted from each image in the source sequence.

See Also

PredictCentroids

PredictPoseIdentities

PredictSinglePose

GetBodyPart