A recent study by Reflex has revealed that manual computer usage, specifically vision agents, can incur costs 45 times higher than those associated with structured APIs. This disparity highlights the economic benefits of adopting API-first development strategies. The study compared the performance of vision agents and API agents in completing a task on an admin panel for managing customers, orders, and reviews. The results showed that the API agent completed the task in 8 calls, while the vision agent required a 14-step walkthrough and consumed significantly more input tokens.
The Study's Findings
The study measured the cost of vision agents and API agents in completing a task on an admin panel. The task involved finding a customer named