AI Engineering/Phase 14/Lesson 21

Computer Use: Claude, OpenAI CUA, Gemini

Three production computer-use models in 2026. All three are vision-based. All three treat screenshots, DOM text, and tool outputs as untrusted input. Only direct user instructions count as permission. Per-step safety services are the norm.

Learn 1 hr Python (stdlib)

Prerequisites: Phase 14 · 20 (WebArena, OSWorld), Phase 14 · 27 (Prompt Injection)

#Learning Objectives

Describe Claude computer use: screenshot in, keyboard/mouse commands out, no accessibility API.
Name the three models' benchmark numbers on OSWorld / WebArena / Online-Mind2Web.
Explain the per-step safety pattern Gemini 2.5 Computer Use documents.
Summarize the untrusted-input contract all three models enforce.

Full Access lesson

Keep going. The rest of this lesson is one step away.

Unlock all 503 lessons, video, code, quizzes and every future update. Pay in your own currency with Paystack.

See plans Sign in

The text and code of this lesson are based on AI Engineering from Scratch by Rohit Ghumare, MIT licensed.