In May 2026, a benchmark article titled Computer Use is 45x more expensive than structured APIs caused a major stir on Hacker News. The finding that "running the same task with Computer Use (screenshots + browser operations) consumes 45 times more tokens than structured APIs" strongly impressed upon client AI development teams that this option is "convenient, but costly."
At GleamHub, we have also seen an increase in inquiries for projects incorporating Computer Use (Claude, OpenAI Operator, Gemini Browser Use, etc.). However, an architecture that "just relies on Computer Use for everything" will fail in custom development. In this article, we outline cost engineering design guidelines for choosing between Computer Use and structured APIs.
Why a 45x difference occurs
The cost difference between Computer Use and structured APIs stems structurally from the following four factors.
| Item | Computer Use | Structured APIs |
|---|---|---|
| Input | 1 to 4 screenshots per action | Hundreds of tokens in JSON / GraphQL |
| Output | Continuous generation of "click at (x, y)" | Single structured object |
| Number of attempts | Frequent retries due to UI changes | Stable until specifications change |
| Error recovery | Repeated screenshots to identify root cause | Instant assessment via status codes |
In particular, token consumption per screenshot dominates, with the characteristic that inputs to vision models increase costs logarithmically rather than linearly.
This is a typical pitfall of the "token consumption-based billing" era covered in GitHub Copilot metered billing and token governance. You must explain to clients upfront that "incorporating Computer Use into a project could consume 30% to 50% of the monthly budget."
Decision tree for adopting Computer Use in custom development
When deciding whether to adopt Computer Use in a project, evaluating it using a decision tree like the one below is effective.
Q1: 連携先に公式 API は存在するか?
└ YES → 構造化 API を採用(45 倍の節約)
└ NO → Q2 へ
Q2: 連携先に MCP / Skill 実装はあるか?
└ YES → MCP 経由で構造化アクセス
└ NO → Q3 へ
Q3: Web スクレイピングで 80% カバーできるか?
└ YES → Playwright + パターンマッチで実装
└ NO → Q4 へ
Q4: 操作頻度 / 月 100 回以下か?
└ YES → Computer Use を許容
└ NO → 公式 API のリクエストを連携先と協議
In particular, Q3's "Playwright + pattern matching" serves as an excellent middle-ground solution, covering many operational scenarios at roughly 1/10th the cost of Computer Use. This concept applies the same test automation methodology discussed in Integrating Playwright AI QA automation into custom development to business operations.
Cost estimation template
In projects adopting Computer Use, presenting a monthly cost estimate before executing the contract is essential. Here is an example of a simple estimation formula.
月次トークン消費 ≒ 操作回数 × 1 操作あたりスクショ数 × 1 スクショのトークン
+ 操作回数 × 1 操作あたり判断ステップ数 × 1 判断のトークン
例: 1 日 50 回操作 × 22 営業日 × 平均 6 スクショ × 1500 トークン
+ 1 日 50 回 × 22 営業日 × 4 ステップ × 800 トークン
≒ 990 万トークン + 35 万トークン
≒ 1025 万トークン
Multiplying this by unit prices around Sonnet 4.6, GPT-5.5, or Gemini 2.5 Pro yields a range of tens of thousands to hundreds of thousands of yen per month. Being able to "explain a predictable cost structure to the client" is a baseline prerequisite for offering Computer Use in custom development.
"Computer Use terms" to include in custom development contracts
For projects incorporating Computer Use, it is advisable to explicitly specify the following clauses in the contract.
| Clause | Details | What the client should verify |
|---|---|---|
| Adoption criteria | Agreement on each branch of the decision tree | Record of evaluating structured alternatives |
| Monthly cost ceiling | Ceiling based on the estimation formula | Consultation upon exceeding the ceiling |
| Target API application | Ongoing requests to acquire official APIs | Sharing application progress |
| Model selection | Listing models to be used | Acceptance of expected costs |
| Billing on failure | Cost allocation for screenshot-heavy failures | Maximum number of retry attempts |
| Log retention | Retention period for screenshots and decision logs | Data sovereignty |
In particular, if you leave "billing on failure" ambiguous, a UI change can trigger an incident where the number of retries explodes and exhausts the entire monthly budget in a single day. Include automated mechanical thresholds in your contracts, such as "trigger an alert after 5 consecutive failures of the same operation, and halt execution after 10."
Five common pitfalls
Finally, we share common pitfalls encountered when handling Computer Use in custom development.
Pitfall 1: Starting by defaulting to Computer Use
Starting with Computer Use because "there is no time to look into official APIs" causes monthly costs to become 5 to 10 times higher than expected. Always evaluate official APIs, MCP, and scraping in that order on day one.
Pitfall 2: Postponing screenshot count optimization
Operating with settings that capture "plenty of screenshots just in case" per action causes costs to balloon linearly. Always optimize by capping screenshots to 1 when differences before and after an operation are minimal.
Pitfall 3: Leaving high-performance models in place
Using top-tier models for every decision step in Computer Use consumes 800 to 2,000 tokens per decision. Route routine decisions to lower-cost models, reserving high-performance models solely for complex decisions.
Pitfall 4: Neglecting to build in UI change detection
When the target website's UI changes, attempts surge and costs skyrocket. Build in mechanisms from the start that automatically halt execution based on screenshot diff detection and failure thresholds.
Pitfall 5: Inability to reproduce issues due to missing logs
Operations that "only deliver successful results" prevent you from verifying what happened after the fact. Continuously ingest screenshots, decision logs, and costs into BigQuery or similar stores to ensure reproducibility.
Summary — Not "whether to use Computer Use," but "when not to use it"
While Computer Use is powerful, it is an option that incurs 45 times the cost of structured APIs. To deliver it sustainably in custom development, it is vital to first define evaluation criteria for "when not to use Computer Use" and translate them into cost estimates and contractual terms.
If you are wondering whether "Computer Use fits your operational automation but find costs unpredictable" or have "already deployed Computer Use but face unanticipated monthly bills," please feel free to reach out via our contact form. Architecture and costs vary significantly depending on official API availability and operation frequency, so we provide custom estimates after reviewing your target workflow.
Sources
- Computer Use is 45x more expensive than structured APIs(Hacker News)
- GitHub Copilot Usage-Based Billing and Token Governance (GH Media)
- Integrating Playwright AI QA automation into custom development (GH Media)
- Integrating Vibe Remote Agents into Custom Development with Mistral Medium 3.5 (GH Media)









