What You’ll Learn
- How to open and navigate video data in the viewer
- How to draw annotations on video frames
- How to track objects across frames with interpolation
- How to review and export video annotations
Prerequisites
- A dataset containing video data (MP4, AVI, or image sequences)
- A project created with the appropriate task type (bounding box, polygon, etc.)
- Labels defined in your project taxonomy
Step 1: Open the Video Viewer
- Navigate to your dataset in Mission Control
- Click Sequences to see your video sequences
- Click on a sequence to open the video viewer
- The interface displays:
- Canvas: The current video frame with annotation overlay
- Timeline: Scrubber bar showing all frames
- Object list: Panel listing all annotated objects
- Toolbar: Annotation tools along the top or side
Step 2: Navigate Frames
Playback Controls
Use the playback controls below the canvas:- Play / Pause: Click the play button or press
Space - Step forward: Press
→to advance one frame - Step backward: Press
←to go back one frame - Skip forward: Press
Shift + →to skip 10 frames - Skip backward: Press
Shift + ←to go back 10 frames - Jump to start: Press
Home - Jump to end: Press
End
Timeline Scrubber
Click anywhere on the timeline to jump directly to that frame. Keyframes for tracked objects are marked on the timeline with colored indicators.The frame counter in the bottom-left shows the current frame number and total frame count. Use this to coordinate with teammates on specific frames.
Step 3: Draw Annotations on Frames
Bounding Boxes
- Select the Box tool from the toolbar (or press
B) - Click and drag on the canvas to draw a bounding box around the object
- Release to complete the box
- Select a label from the dropdown
- Adjust the box by dragging its edges or corners
Polygons
- Select the Polygon tool (or press
P) - Click to place vertices around the object outline
- Close the polygon by clicking the first vertex or pressing
Enter - Assign a label
Other Tools
All annotation tools available in your project work on video frames. See the Annotation Tools guide for the full reference.Step 4: Track Objects Across Frames
Object tracking lets you follow the same object through multiple frames without re-drawing it on every frame.Creating a Tracked Object
- Draw an annotation on the current frame (this becomes the first keyframe)
- The object is assigned a unique tracking ID
- Navigate forward to a later frame
- The annotation persists from the previous keyframe
- Adjust the position or shape to match the object’s new location (this creates a new keyframe)
- Avala interpolates the annotation for all frames between keyframes
Interpolation
Between two keyframes, Avala linearly interpolates the annotation properties:- Position: Smoothly transitions between keyframe locations
- Size: Gradually scales between keyframe dimensions
- Rotation: Interpolates rotation angle
Managing Keyframes
| Action | How |
|---|---|
| Add a keyframe | Navigate to a frame and adjust the annotation |
| Delete a keyframe | Right-click the keyframe marker and select Delete Keyframe |
| View all keyframes | Click the object in the object list to see its keyframe summary |
You do not need to create a keyframe on every frame. Place keyframes where the object changes direction, speed, or size, and let interpolation handle the in-between frames.
Step 5: Edit Tracked Objects
Adjusting an Object
- Select the object on the canvas or in the object list
- Modify its position, size, or label
- Changes on an interpolated frame automatically create a new keyframe
Marking Occlusion
When an object is temporarily hidden:- Navigate to the frame where the object becomes occluded
- Select the object and toggle the Occluded attribute
- Navigate to where the object reappears and adjust its position
- Interpolation handles the transition
Deleting a Tracked Object
- Delete on one frame: Right-click → Remove from this frame (ends the track at this frame)
- Delete entirely: Select the object → press
Delete→ confirm to remove across all frames
Step 6: Review and Export
- Play through the entire sequence to verify annotations
- Check that tracked objects maintain correct IDs throughout
- Verify interpolated frames for accuracy
- Submit for review when satisfied
- Export annotations in your preferred format (COCO, Avala Format, etc.)
Keyboard Shortcuts
| Shortcut | Action |
|---|---|
Space | Play / Pause |
← / → | Previous / Next frame |
Shift + ← / Shift + → | Skip 10 frames |
Home / End | Jump to start / end |
B | Box tool |
P | Polygon tool |
V | Select / Move tool |
Delete | Delete selected annotation |
Ctrl+Z / ⌘Z | Undo |
Ctrl+Shift+Z / ⌘⇧Z | Redo |
Ctrl+S / ⌘S | Save |
Escape | Cancel current action / Deselect |
Tips for Efficient Video Annotation
- Start with keyframes at transitions: Place keyframes where objects change direction or speed, not on every frame
- Use playback to verify: Play the sequence at normal speed to catch interpolation errors
- Annotate one object at a time: Track a single object through the full sequence before starting the next
- Use the object list: Keep track of all objects and their frame ranges in the side panel
- Leverage shortcuts: Frame stepping with arrow keys is much faster than clicking the timeline
- Save frequently: Press
Ctrl+Sregularly to avoid losing work
Next Steps
- Explore Annotation Tools for the full tool reference
- Learn about AI-Assisted Annotation to speed up your workflow
- Check Keyboard Shortcuts for the complete shortcut list