Annotation Workflow¶
This page covers the core annotation workflow in LUC3D: creating instances, editing keypoints, and managing annotations across camera views.
Instance Types¶
LUC3D has three types of instances:
| Type | Description | Default Style |
|---|---|---|
| User Instance | Manually created or edited by the annotator | Solid edges, circle nodes, fully editable |
| Predicted Instance | Auto-generated by a tracker or imported from SLEAP | Dotted edges, X nodes, read-only until converted |
| Reprojected Instance | Projected from 3D triangulation back to 2D | Dashed edges, white circle nodes, read-only |
Styles are adjustable in the Visibility tab.
Creating Instances¶
Add a New Instance¶
- Navigate to the frame you want to annotate
- Click the camera view to make it active
- Press N (or Edit → Add Instance) — a default skeleton layout appears at the cursor
- Drag individual keypoints to their correct positions
Smart init
Press Ctrl+I or click + Instance in the toolbar instead. The new instance copies the pose of the most recent user instance in that view (or the nearest prediction), so you only need to nudge it into place.
Converting Predicted Instances¶
If you have loaded SLEAP predictions or run the tracker:
- Double-click a predicted instance to convert it to a user instance (a grouped prediction converts the whole group)
- It becomes fully editable — adjust any keypoints as needed
Dragging a node of a grouped predicted instance also converts it.
Editing Keypoints¶
Moving Keypoints¶
- Click and drag a keypoint node to reposition it
Moving an Entire Instance¶
- Hold Alt and drag any node to move all keypoints together
- Relative positions are preserved — useful for repositioning a roughly correct skeleton
Marking Keypoints Not Visible¶
- Right-click a node (or Ctrl + click on a Mac trackpad) to toggle it between placed and not visible
- A not-visible node is excluded from triangulation without losing its position, so a second right-click restores it
Deleting Instances¶
- Select an instance and press Del or Backspace to delete it from the current camera
- Press Shift+Del to delete the whole group from all camera views
- Edit → Custom Instance Delete... bulk-deletes by type (predicted / user / all), grouping state, view, track, or identity, for the current frame or the whole session, with a live match count
Selecting Instances¶
- Click on any keypoint or edge to select that instance
- Clicking an ungrouped instance also enters assignment mode (see Grouping)
- The selected instance is highlighted in the Instances tab, where the Track and Identity columns are editable dropdowns
Working Across Views¶
When annotating multi-view data, you annotate each camera view independently, then group the instances that correspond to the same individual.
Typical Per-Frame Workflow¶
- Annotate the subject in Camera 1 (e.g., back view)
- Click Camera 2 (or its thumbnail in the Views strip)
- Annotate the same subject in Camera 2
- Repeat for all camera views
- Group the instances across views — or let the tracker do it
- Triangulate to verify with 3D
Tip
You don't need to annotate every keypoint in every view. If a keypoint is not visible in a particular camera angle, right-click it to mark it not visible. See Reprojection-Aided Labeling to get the remaining views for free.
View Controls¶
Zooming¶
- Scroll wheel on a camera view to zoom in/out around the cursor
- Drag a rectangle on an unzoomed view to box-zoom into it
- Press + / - to zoom all views simultaneously
- Press 0 or double-click empty space to reset zoom; each pane also shows an Unzoom button while zoomed
Panning¶
- Drag on empty space to pan when zoomed in
- Middle-click drag pans at any zoom level
Rotating¶
- Hold Shift+R and press Left / Right to rotate the active video, or use the Video Rotation slider in the Visibility tab. Overlay labels stay upright.
View Layout¶
- Press V for single-view mode showing only the active camera; Up / Down step through the cameras
- Press G to return to the grid layout
- Click a thumbnail in the Views strip to focus that view, swap it in while in single-view mode, or re-open a view you closed
- Drag a view thumbnail onto a session in the Sessions strip to move it to another session
Info Panel¶
Press I (or the Hide/Show Panel toolbar button) to toggle the info panel, which shows:
- Instances tab — Grouped and ungrouped instances in the current frame, with editable track/identity dropdowns and, after triangulation, the reprojection error (method badge, per-camera means, and a per-instance node breakdown)
- Visibility tab — Node size and style, edge weight and transparency, and label size for user, predicted, and reprojected instances (label size 0 hides labels); the Display Legend; per-video Brightness, Contrast, and Rotation; timeline row toggles; and 3D viewer widget sizes. Brightness, contrast, rotation, and hidden rows are saved per session in the project file
- Videos tab — Loaded video details (frames, size, labeled frames, groups) with Add Videos / Remove
- Cameras tab — Calibration info (name, resolution, focal length)
- Skeleton tab — Full skeleton editor: add, rename, and remove nodes and edges inline, plus Load Skeleton / Save Skeleton. A project uses one skeleton shared across all sessions, so an edit (or loading a new skeleton) applies everywhere — LUC3D warns before overwriting a non-empty skeleton
- Session tab — Session list, camera-video assignment with Auto-Assign / Add All Views, and unassigned videos
Responsive tabs
When the info panel is narrow, tabs that don't fit collapse into a More ▾ overflow menu.