• bitcoinBitcoin(BTC)$60,638.000.61%
  • ethereumEthereum(ETH)$1,711.621.58%
  • tetherTether(USDT)$1.000.04%
  • binancecoinBNB(BNB)$555.561.06%
  • usd-coinUSDC(USDC)$1.000.02%
  • rippleXRP(XRP)$0.93-1.05%
  • solanaSolana(SOL)$70.11-0.84%
  • tronTRON(TRX)$0.3051250.19%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.062.66%
  • HyperliquidHyperliquid(HYPE)$62.231.32%
  • zcashZcash(ZEC)$788.09-0.38%
  • moneroMonero(XMR)$491.531.79%
  • dogecoinDogecoin(DOGE)$0.055082-0.40%
  • leo-tokenLEO Token(LEO)$9.160.33%
  • whitebitWhiteBIT Coin(WBT)$58.260.72%
  • chainlinkChainlink(LINK)$8.791.73%
  • USDSUSDS(USDS)$1.00-0.01%
  • cardanoCardano(ADA)$0.144072-0.87%
  • Ethena USDeEthena USDe(USDE)$1.000.04%
  • stellarStellar(XLM)$0.127561-1.40%
  • daiDai(DAI)$1.00-0.04%
  • bitcoin-cashBitcoin Cash(BCH)$197.54-0.48%
  • nearNEAR Protocol(NEAR)$2.984.07%
  • litecoinLitecoin(LTC)$39.85-0.49%
  • avalanche-2Avalanche(AVAX)$6.690.69%
  • CantonCanton(CC)$0.072449-4.96%
  • Ripple USDRipple USD(RLUSD)$1.00-0.02%
  • tether-goldTether Gold(XAUT)$3,543.79-0.20%
  • USD1USD1(USD1)$1.000.06%
  • uniswapUniswap(UNI)$4.68-0.30%
  • the-open-networkGram (prev. Toncoin)(GRAM)$0.982.26%
  • suiSui(SUI)$0.651.26%
  • Global DollarGlobal Dollar(USDG)$1.00-0.02%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.01%
  • RainRain(RAIN)$0.003264-12.21%
  • paypal-usdPayPal USD(PYUSD)$1.00-0.03%
  • hedera-hashgraphHedera(HBAR)$0.051388-0.72%
  • BittensorBittensor(TAO)$190.022.36%
  • shiba-inuShiba Inu(SHIB)$0.000004-1.12%
  • crypto-com-chainCronos(CRO)$0.040500-2.69%
  • quant-networkQuant(QNT)$142.800.56%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.120.02%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • okbOKB(OKB)$82.703.85%
  • MemeCoreMemeCore(M)$0.75-1.46%
  • Falcon USDFalcon USD(USDF)$1.000.06%
  • United StablesUnited Stables(U)$1.000.11%
  • pax-goldPAX Gold(PAXG)$3,543.57-0.29%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
  • aaveAave(AAVE)$98.290.39%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Google AI Proposes ReasoningBank: A Strategy-Level I Agent Memory Framework that Makes LLM Agents Self-Evolve at Test Time

October 1, 2025
in AI & Technology
Reading Time: 6 mins read
A A
Google AI Proposes ReasoningBank: A Strategy-Level I Agent Memory Framework that Makes LLM Agents Self-Evolve at Test Time
ShareShareShareShareShare

How do you make an LLM agent actually learn from its own runs—successes and failures—without retraining? Google Research proposes ReasoningBank, an AI agent memory framework that converts an agent’s own interaction traces—both successes and failures—into reusable, high-level reasoning strategies. These strategies are retrieved to guide future decisions, and the loop repeats so the agent self-evolves. Coupled with memory-aware test-time scaling (MaTTS), the approach delivers up to +34.2% relative effectiveness gains and –16% fewer interaction steps across web and software-engineering benchmarks compared to prior memory designs that store raw trajectories or success-only workflows.

https://arxiv.org/pdf/2509.25140

So, what is the problem?

LLM agents tackle multi-step tasks (web browsing, computer use, repo-level bug fixing) but generally fail to accumulate and reuse experience. Conventional “memory” tends to hoard raw logs or rigid workflows. Those are brittle across environments and often ignore useful signals from failures—where a lot of actionable knowledge lives. ReasoningBank reframes memory as compact, human-readable strategy items that are easier to transfer between tasks and domains.

YOU MAY ALSO LIKE

NVIDIA Releases Alpamayo 2 Edge: A 2B Reasoning VLA for DRIVE Thor

You Can Mass-Delete All Of Your Emails On Gmail In Only A Few Clicks

Then how does it tackle?

Each experience is distilled into a memory item with a title, one-line description, and content containing actionable principles (heuristics, checks, constraints). Retrieval is embedding-based: for a new task, top-k relevant items are injected as system guidance; after execution, new items are extracted and consolidated back. The loop is intentionally simple—retrieve → inject → judge → distill → append—so improvements can be attributed to the abstraction of strategies, not heavy memory management.

Why it transfers: items encode reasoning patterns (“prefer account pages for user-specific data; verify pagination mode; avoid infinite scroll traps; cross-check state with task spec”), not website-specific DOM steps. Failures become negative constraints (“do not rely on search when the site disables indexing; confirm save state before navigation”), which prevents repeated mistakes.

https://arxiv.org/pdf/2509.25140

Memory-aware test-time scaling (MaTTS) proposed as well!

Test-time scaling (running more rollouts or refinements per task) is effective only if the system can learn from the extra trajectories. The research team also propsoed Memory-aware test-time scaling (MaTTS) that integrates scaling with ReasoningBank:

  • Parallel MaTTS: generate (k) rollouts in parallel, then self-contrast them to refine strategy memory.
  • Sequential MaTTS: iteratively self-refine a single trajectory, mining intermediate notes as memory signals.

The synergy is two-way: richer exploration produces better memory; better memory steers exploration toward promising branches. Empirically, MaTTS yields stronger, more monotonic gains than vanilla best-of-N without memory.

So, how good are these proposed research frameworks?

  • Effectiveness: ReasoningBank + MaTTS improves task success up to 34.2% (relative) over no-memory and outperforms prior memory designs that reuse raw traces or success-only routines.
  • Efficiency: Interaction steps drop by 16% overall; further analysis shows the largest reductions on successful trials, indicating fewer redundant actions rather than premature aborts.
https://arxiv.org/pdf/2509.25140

Where does this fits in the agent stack?

ReasoningBank is a plug-in memory layer for interactive agents that already use ReAct-style decision loops or best-of-N test-time scaling. It doesn’t replace verifiers/planners; it amplifies them by injecting distilled lessons at the prompt/system level. On web tasks, it complements BrowserGym/WebArena/Mind2Web; on software tasks, it layers atop SWE-Bench-Verified setups.


Check out the Paper here. Feel free to check out our GitHub Page for Tutorials, Codes and Notebooks. Also, feel free to follow us on Twitter and don’t forget to join our 100k+ ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

The post Google AI Proposes ReasoningBank: A Strategy-Level I Agent Memory Framework that Makes LLM Agents Self-Evolve at Test Time appeared first on MarkTechPost.

Credit: Source link

ShareTweetSendSharePin

Related Posts

NVIDIA Releases Alpamayo 2 Edge: A 2B Reasoning VLA for DRIVE Thor
AI & Technology

NVIDIA Releases Alpamayo 2 Edge: A 2B Reasoning VLA for DRIVE Thor

November 22, 2026
You Can Mass-Delete All Of Your Emails On Gmail In Only A Few Clicks
AI & Technology

You Can Mass-Delete All Of Your Emails On Gmail In Only A Few Clicks

November 22, 2026
The Winners Will Be Measured in Hours Without Human Help – Unite.AI
AI & Technology

The Winners Will Be Measured in Hours Without Human Help – Unite.AI

November 22, 2026
Which Is Better for Managing Work? – Unite.AI
AI & Technology

Which Is Better for Managing Work? – Unite.AI

November 22, 2026
Next Post
Powerful earthquake in central Philippines kills at least 69 – The Washington Post

Powerful earthquake in central Philippines kills at least 69 - The Washington Post

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Why Microsoft Is Ditching A Few Of Its 365 Companion Apps In 2026

Why Microsoft Is Ditching A Few Of Its 365 Companion Apps In 2026

November 16, 2026
Over 50K units of toothpaste, mouthwash recalled in US after hormones detected: FDA

Over 50K units of toothpaste, mouthwash recalled in US after hormones detected: FDA

November 21, 2026
US diesel below  a gallon at 2-month low on easing tensions, weaker demand

US diesel below $6 a gallon at 2-month low on easing tensions, weaker demand

November 15, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!