• bitcoinBitcoin(BTC)$60,826.004.81%
  • ethereumEthereum(ETH)$1,708.804.05%
  • tetherTether(USDT)$1.000.00%
  • binancecoinBNB(BNB)$552.915.11%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.934.22%
  • solanaSolana(SOL)$70.513.34%
  • tronTRON(TRX)$0.3057280.97%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.073.35%
  • HyperliquidHyperliquid(HYPE)$62.436.29%
  • zcashZcash(ZEC)$800.947.29%
  • moneroMonero(XMR)$486.974.31%
  • dogecoinDogecoin(DOGE)$0.0555304.61%
  • leo-tokenLEO Token(LEO)$9.160.49%
  • whitebitWhiteBIT Coin(WBT)$58.243.83%
  • chainlinkChainlink(LINK)$8.784.88%
  • USDSUSDS(USDS)$1.00-0.02%
  • cardanoCardano(ADA)$0.1455144.10%
  • Ethena USDeEthena USDe(USDE)$1.000.04%
  • stellarStellar(XLM)$0.1294424.01%
  • daiDai(DAI)$1.000.00%
  • bitcoin-cashBitcoin Cash(BCH)$199.034.79%
  • nearNEAR Protocol(NEAR)$2.988.38%
  • litecoinLitecoin(LTC)$39.752.39%
  • avalanche-2Avalanche(AVAX)$6.694.46%
  • CantonCanton(CC)$0.073565-0.48%
  • Ripple USDRipple USD(RLUSD)$1.00-0.01%
  • uniswapUniswap(UNI)$4.737.47%
  • tether-goldTether Gold(XAUT)$3,545.250.69%
  • USD1USD1(USD1)$1.000.04%
  • the-open-networkGram (prev. Toncoin)(GRAM)$0.973.80%
  • suiSui(SUI)$0.666.23%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.14%
  • RainRain(RAIN)$0.003297-8.56%
  • paypal-usdPayPal USD(PYUSD)$1.00-0.02%
  • hedera-hashgraphHedera(HBAR)$0.0514713.85%
  • BittensorBittensor(TAO)$191.066.78%
  • shiba-inuShiba Inu(SHIB)$0.0000044.06%
  • crypto-com-chainCronos(CRO)$0.0411663.50%
  • quant-networkQuant(QNT)$141.526.77%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.120.00%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • MemeCoreMemeCore(M)$0.78-0.62%
  • Falcon USDFalcon USD(USDF)$1.000.02%
  • okbOKB(OKB)$80.104.16%
  • United StablesUnited Stables(U)$1.000.04%
  • pax-goldPAX Gold(PAXG)$3,548.490.69%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
  • aaveAave(AAVE)$97.560.43%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Google AI Introduces Gemini 2.5 ‘Computer Use’ (Preview): A Browser-Control Model to Power AI Agents to Interact with User Interfaces

October 8, 2025
in AI & Technology
Reading Time: 7 mins read
A A
Google AI Introduces Gemini 2.5 ‘Computer Use’ (Preview): A Browser-Control Model to Power AI Agents to Interact with User Interfaces
ShareShareShareShareShare

Which of your browser workflows would you delegate today if an agent could plan and execute predefined UI actions? Google AI introduces Gemini 2.5 Computer Use, a specialized variant of Gemini 2.5 that plans and executes real UI actions in a live browser via a constrained action API. It’s available in public preview through Google AI Studio and Vertex AI. The model targets web automation and UI testing, with documented, human-judged gains on standard web/mobile control benchmarks and a safety layer that can require human confirmation for risky steps.

What the model actually ships?

Developers call a new computer_use tool that returns function calls like click_at, type_text_at, or drag_and_drop. Client code executes the action (e.g., Playwright/Browserbase), captures a fresh screenshot/URL, and loops until the task ends or a safety rule blocks it. The supported action space is 13 predefined UI actions—open_web_browser, wait_5_seconds, go_back, go_forward, search, navigate, click_at, hover_at, type_text_at, key_combination, scroll_document, scroll_at, drag_and_drop—and can be extended with custom functions (e.g., open_app, long_press_at, go_home) for non-browser surfaces.

YOU MAY ALSO LIKE

Tesla Rolls Out FSD V15 with Reality View and Vision Upgrades – Unite.AI

OpenRouter Cuts Three Providers After AI Prompt Exposure Findings – Unite.AI

https://blog.google/technology/google-deepmind/gemini-computer-use-model/

What is the scope and constraints?

The model is optimized for web browsers. Google states it is not yet optimized for desktop OS-level control; mobile scenarios work by swapping in custom actions under the same loop. A built-in safety monitor can block prohibited actions or require user confirmation before “high-stakes” operations (payments, sending messages, accessing sensitive records).

Measured performance

  • Online-Mind2Web (official): 69.0% pass@1 (majority-vote human judgments), validated by benchmark organizers.
  • Browserbase matched harness: Leads competing computer-use APIs on both accuracy and latency across Online-Mind2Web and WebVoyager under identical time/step/environment constraints. Google’s model card lists 65.7% (OM2W) and 79.9% (WebVoyager) in Browserbase runs.
  • Latency/quality trade-off (Google figure): ~70%+ accuracy at ~225 s median latency on the Browserbase OM2W harness. Treat as Google-reported, with human evaluation.
  • AndroidWorld (mobile generalization): 69.7% measured by Google; achieved via the same API loop with custom mobile actions and excluded browser actions.
https://blog.google/technology/google-deepmind/gemini-computer-use-model/

Early production signals

  • Automated UI test repair: Google’s payments platform team reports the model rehabilitates >60% of previously failing automated UI test executions. This is attributed (and should be cited) to public reporting rather than the core blog post.
  • Operational speed: Poke.com (early external tester) reports workflows often ~50% faster versus their next-best alternative.

Gemini 2.5 Computer Use is in public preview via Google AI Studio and Vertex AI; it exposes a constrained API with 13 documented UI actions and requires a client-side executor. Google’s materials and the model card report state-of-the-art results on web/mobile control benchmarks, and Browserbase’s matched harness shows ~65.7% pass@1 on Online-Mind2Web with leading latency under identical constraints. The scope is browser-first with per-step safety/confirmation. These data points justify measured evaluation in UI testing and web ops.


Check out the GitHub Page and Technical details. Feel free to check out our GitHub Page for Tutorials, Codes and Notebooks. Also, feel free to follow us on Twitter and don’t forget to join our 100k+ ML SubReddit and Subscribe to our Newsletter.


Michal Sutter is a data science professional with a Master of Science in Data Science from the University of Padova. With a solid foundation in statistical analysis, machine learning, and data engineering, Michal excels at transforming complex datasets into actionable insights.

🙌 Follow MARKTECHPOST: Add us as a preferred source on Google.

Credit: Source link

ShareTweetSendSharePin

Related Posts

Tesla Rolls Out FSD V15 with Reality View and Vision Upgrades – Unite.AI
AI & Technology

Tesla Rolls Out FSD V15 with Reality View and Vision Upgrades – Unite.AI

November 22, 2026
OpenRouter Cuts Three Providers After AI Prompt Exposure Findings – Unite.AI
AI & Technology

OpenRouter Cuts Three Providers After AI Prompt Exposure Findings – Unite.AI

November 22, 2026
Is It Actually Worth Upgrading To The Pixel 11?
AI & Technology

Is It Actually Worth Upgrading To The Pixel 11?

November 22, 2026
What’s The Difference Between Them?
AI & Technology

What’s The Difference Between Them?

November 22, 2026
Next Post
Trump shares the topic on which he disagreed with Kirk

Trump shares the topic on which he disagreed with Kirk

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Nationwide Geneva Mid Cap Growth Fund Q3 2026 Commentary

Nationwide Geneva Mid Cap Growth Fund Q3 2026 Commentary

November 15, 2026
How a viral attack ad is rattling an Ohio race

How a viral attack ad is rattling an Ohio race

November 18, 2026
Minor Upgrades That Cost Too Much

Minor Upgrades That Cost Too Much

November 20, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!