AI Engineering/Phase 19/Lesson 55

Critic Loop

A critic that returns "looks good" the first time is broken. A critic that always returns "needs work" is broken. The interesting critic is the one that converges, and you have to engineer convergence.

Build 1.5 hr Python

Prerequisites: Phase 19 lessons 50-53

#Learning Objectives

Score a paper draft across five fixed dimensions: clarity, novelty, evidence, methodology, related-work.
Apply each round's critique as a structured revision diff rather than a freeform rewrite.
Detect convergence by comparing scores across rounds; stop on plateau, target met, or budget exhausted.
Cap rounds with a max-iteration budget so a non-converging critic does not run forever.
Emit a per-round trace so the dashboard or the next stage can render the score trajectory.

Full Access lesson

Keep going. The rest of this lesson is one step away.

Unlock all 503 lessons, video, code, quizzes and every future update. Pay in your own currency with Paystack.

See plans Sign in

The text and code of this lesson are based on AI Engineering from Scratch by Rohit Ghumare, MIT licensed.