• bitcoinBitcoin(BTC)$63,273.00-1.60%
  • ethereumEthereum(ETH)$1,796.24-0.25%
  • tetherTether(USDT)$1.000.01%
  • binancecoinBNB(BNB)$584.63-1.04%
  • usd-coinUSDC(USDC)$1.000.00%
  • rippleXRP(XRP)$0.97-0.50%
  • solanaSolana(SOL)$74.33-0.49%
  • tronTRON(TRX)$0.3112561.09%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.021.60%
  • HyperliquidHyperliquid(HYPE)$67.39-1.59%
  • zcashZcash(ZEC)$925.85-2.48%
  • moneroMonero(XMR)$501.88-1.47%
  • dogecoinDogecoin(DOGE)$0.059076-0.28%
  • leo-tokenLEO Token(LEO)$9.310.08%
  • USDSUSDS(USDS)$1.000.01%
  • whitebitWhiteBIT Coin(WBT)$61.42-1.03%
  • chainlinkChainlink(LINK)$9.13-0.68%
  • cardanoCardano(ADA)$0.152593-0.43%
  • stellarStellar(XLM)$0.137203-2.06%
  • Ethena USDeEthena USDe(USDE)$1.000.01%
  • nearNEAR Protocol(NEAR)$3.390.31%
  • daiDai(DAI)$1.00-0.03%
  • bitcoin-cashBitcoin Cash(BCH)$206.82-0.72%
  • litecoinLitecoin(LTC)$44.50-0.30%
  • CantonCanton(CC)$0.082670-2.11%
  • RainRain(RAIN)$0.004554-3.37%
  • uniswapUniswap(UNI)$5.220.45%
  • avalanche-2Avalanche(AVAX)$7.08-0.87%
  • suiSui(SUI)$0.73-0.20%
  • tether-goldTether Gold(XAUT)$3,715.19-1.61%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.03-4.47%
  • USD1USD1(USD1)$1.000.00%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.055968-2.56%
  • paypal-usdPayPal USD(PYUSD)$1.000.03%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.00%
  • BittensorBittensor(TAO)$194.76-0.64%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.51%
  • crypto-com-chainCronos(CRO)$0.042543-2.18%
  • quant-networkQuant(QNT)$151.23-1.17%
  • MemeCoreMemeCore(M)$0.90-0.25%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.30%
  • okbOKB(OKB)$87.560.94%
  • aaveAave(AAVE)$110.27-0.52%
  • Falcon USDFalcon USD(USDF)$1.00-0.06%
  • pax-goldPAX Gold(PAXG)$3,714.17-1.72%
  • United StablesUnited Stables(U)$1.00-0.01%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

CMU Researchers Introduce WebArena: A Realistic and Reproducible Web Environment with 4+ Real-World Web Apps for Benchmarking Useful Agents

July 27, 2023
in AI & Technology
Reading Time: 4 mins read
A A
CMU Researchers Introduce WebArena: A Realistic and Reproducible Web Environment with 4+ Real-World Web Apps for Benchmarking Useful Agents
ShareShareShareShareShare

Given the potential for increased efficiency and broader accessibility, autonomous agents that can do ordinary tasks via human natural language instructions could considerably complement human skills. To fully use the potential of these independent agents, it is essential to comprehend their behavior in a genuine and reproducible setting.

Today’s settings tend to oversimplify complex problems. Therefore, many environments’ features are watered-down versions of real-world equivalents, resulting in a shortage of work variety. In other cases, the environment is presented as a static resource, limiting agents’ ability to explore only those states cached during data gathering.

New research by Carnegie Mellon University and Inspired Cognition present WebArena, a simulated web environment with reproducible conditions that may be used to train autonomous agents to carry out certain tasks. The environment consists of four live, self-hosted web apps, one each for e-commerce, online discussion forums, collaborative software development, and enterprise content management. WebArena also includes several helpful tools, including a map, calculator, and scratchpad, to facilitate the most human-like task executions possible. Finally, WebArena is supported by a wealth of supplementary materials, including guides for using the integrated development environment and more specialized sites like the English Wikipedia. These websites’ content is culled directly from their offline counterparts, ensuring that it is accurate and up-to-date. Docker containers with gym APIs supply hosting services, making WebArena easy to use and replicable.

In addition to WebArena, they also open-source a fully operational benchmark of 812 future-oriented web-based tasks. Each activity is modeled after the abstract language usage patterns generally adopted by humans and described as a natural language aim. They focus on analyzing how well these functions work. In addition to being more accurate than comparing the plain action sequences, this assessment can account for the fact that there are sometimes multiple legitimate routes to the same goal (a universal situation in sufficiently complex tasks). 

The team utilizes this standard to compare the performance of numerous agents that can perform web-based operations in response to natural language commands. Many different methods are used to create these agents, from those that predict next steps based on current observations and history to those that use more complex methods like step-by-step reasoning. Powerful large language models (LLMs) like GPT-3.5 and GPT-4 create these agents in a few-shot in-context learning approach. The findings show that the best GPT-4 agent only managed an overall task success rate of 10.59 percent in the experiments. They hypothesize that current LLMs’ lack of key capabilities, including active exploration and failure recovery, is the root cause of their inability to effectively complete complicated tasks. 


Check out the Paper, Project Page, and Github. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 26k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.


YOU MAY ALSO LIKE

Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI

Which Is Better for Your Team? – Unite.AI

Dhanshree Shenwai is a Computer Science Engineer and has a good experience in FinTech companies covering Financial, Cards & Payments and Banking domain with keen interest in applications of AI. She is enthusiastic about exploring new technologies and advancements in today’s evolving world making everyone’s life easy.


🔥 Gain a competitive
edge with data: Actionable market intelligence for global brands, retailers, analysts, and investors. (Sponsored)

Credit: Source link

ShareTweetSendSharePin

Related Posts

Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI
AI & Technology

Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI

November 19, 2026
Which Is Better for Your Team? – Unite.AI
AI & Technology

Which Is Better for Your Team? – Unite.AI

November 18, 2026
Waymo Pauses Service In San Francisco After Robotaxis Get Stuck On Flooded Streets
AI & Technology

Waymo Pauses Service In San Francisco After Robotaxis Get Stuck On Flooded Streets

November 18, 2026
Google Launches Gemini 4 Neon for Coding, Knowledge Work and Science – Unite.AI
AI & Technology

Google Launches Gemini 4 Neon for Coding, Knowledge Work and Science – Unite.AI

November 18, 2026
Next Post
Google Accused of Creating Spy Tool to Stifle Worker Dissent

Google Accused of Creating Spy Tool to Stifle Worker Dissent

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
DHS refers Lewandowski investigation to Justice Department

DHS refers Lewandowski investigation to Justice Department

November 18, 2026
Jensen Huang Is Out As NVIDIA CEO

Jensen Huang Is Out As NVIDIA CEO

November 12, 2026
Inside the midnight book launch for ‘ACOTAR’ 6 

Inside the midnight book launch for ‘ACOTAR’ 6 

November 15, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!