Keypoint Detection & Pose Estimation

A pose is a set of ordered keypoints. A keypoint detector is a heatmap regressor. Everything else is bookkeeping.

Build 45 min Python

Prerequisites: Phase 4 Lesson 06 (Detection), Phase 4 Lesson 07 (U-Net)

#Learning Objectives

Distinguish top-down and bottom-up pose estimation and state when each is used
Regress heatmaps for K keypoints with a Gaussian-per-keypoint target and extract keypoint coordinates at inference
Explain Part Affinity Fields (PAFs) and how bottom-up pipelines associate keypoints into instances
Use MediaPipe Pose or MMPose for production keypoint estimation and understand their output format

Full Access lesson

Unlock all 503 lessons, video, code, quizzes and every future update. Pay in your own currency with Paystack.

The text and code of this lesson are based on AI Engineering from Scratch by Rohit Ghumare, MIT licensed.