SupervisedSegmentedFramePassEngine

plugin SupervisedSegmentedFramePassEngine(Predictor)

Plugin Type: Predictor

The supervised (aka interactive) version of the SegmentedFramePassEngine predictor. Provides a GUI for modifying results at the end of the tracking process.

Settings

setting threshold: RangedFloat[min=0.0, max=1.0] = 0.001

The minimum floating point value a pixel within the probability frame must have in order to be kept and added to the sparse matrix.

setting max_cells_per_frame: Optional[RangedInteger[min=1.0, max=inf]] = 100

The maximum number of cells allowed in any frame. Defaults to None, meaning no strict limit is placed on cells per frame except the minimum threshold. Can be any positive integer, which will limit the number of cells in any frame score map to that value. Useful in cases where frames generated by models contain too many cells slowing computation.

setting full_passes: List[Tuple[str, dict] | Tuple[str] | str] = ['ClusterFrames', 'OptimizeStandardDeviation', 'CreateSkeleton']

The passes to be run on the full list of frames, before segmentation occurs. A list of lists containing a string (the pass name) and a dictionary (the configuration for the provided plugin). If no configuration is provided, the entry can just be a string. See ‘segmented_passes’ setting to see what frame passes are available and what there settings are.

setting segmented_passes: List[Tuple[str, dict] | Tuple[str] | str] = ['MITViterbi']

The passes to be run on partial lists of frames, after segmentation occurs. A list of lists containing a string (the pass name) and a dictionary (the configuration for the provided plugin). If no configuration is provided, the entry can just be a string. See Frame Passes to see the list of currently supported frame passes and options.

setting thread_count: Union[Literal[None], RangedInteger[min=0.0, max=inf]] = None

The number of threads to use when running segmented passes. Defaults to None, which resolves to os.cpu_count() at runtime. If set to 0, disables multithreading…

setting allow_pass_multithreading: bool = True

Whether or not to allow frame passes to utilize multithreading. Defaults to True.

setting segment_size: RangedInteger[min=10.0, max=inf] = 200

The size of the segments in frames to break the video into for tracking.

setting export_frame_path: Literal[None] | str = None

A string or None specifying where to save the post forward backward frames to. If None, does not save the frames to a file. Used for debugging.

setting export_final_probs: bool = True

If true exports the final probabilities as stored in frame_probs. Otherwise exports the probabilities from src_data. This setting is internal and for debugging. Defaults to true.

setting export_all_info: bool = False

If true exports all information, both final/pre-fpe probabilities and the occluded and edge states. This allows for display of several states at once. Only works if export_frame_path is set, and overrides export_final_probs.

setting relaxed_maximum_radius: RangedFloat[min=0.0, max=inf] = 0

Determines the radius of relaxed maximum selection. Set to 0 to disable relaxed maximum selection. This value is measured in cell units, not video units.

setting sparsification_mode: Literal['IGNORE_OFFSETS', 'OFFSET_DOMINATION', 'OFFSET_COMBINATION', 'OFFSET_SUMMATION', 'UPSCALE'] = 'OFFSET_DOMINATION'

The mode to utilize during sparsification.

setting sparse_upscale_spread: RangedFloat[min=1e-08, max=inf] = 0.1

Only used if sparsification_mode is set to UPSCALE. If socontrols how spread out points will be when resized via gaussian.

setting assignment_algorithm: Literal['greedy', 'hungarian'] = 'hungarian'

The algorithm to use for assigning parts to bodies and stitching parts/bodies across segments.Greedy is faster/simpler, hungarian provides better results.

setting storage_mode: Literal['disk', 'hybrid', 'memory'] = 'hybrid'

Location to store frames while the algorithm is running.

setting memory_cache_size: RangedInteger[min=1.0, max=inf] = 100

Size of lifo cache used to temporarily store frames loaded from disk if running in disk storage_mode.

setting outlier_threshold: float = 3.0

The threshold z-score used to detect when a pose is an outlier in the skeletal distance distribution.

setting dipui_file: Literal[None] | str = None

A path specifying where to save the dipui file