• bitcoinBitcoin(BTC)$63,523.00-1.33%
  • ethereumEthereum(ETH)$1,797.73-0.25%
  • tetherTether(USDT)$1.000.01%
  • binancecoinBNB(BNB)$586.69-0.80%
  • usd-coinUSDC(USDC)$1.000.01%
  • rippleXRP(XRP)$0.97-0.37%
  • solanaSolana(SOL)$74.51-0.51%
  • tronTRON(TRX)$0.3113861.13%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.021.59%
  • HyperliquidHyperliquid(HYPE)$67.72-1.12%
  • zcashZcash(ZEC)$932.24-2.22%
  • moneroMonero(XMR)$502.30-0.26%
  • dogecoinDogecoin(DOGE)$0.0591900.04%
  • leo-tokenLEO Token(LEO)$9.30-0.47%
  • USDSUSDS(USDS)$1.000.00%
  • whitebitWhiteBIT Coin(WBT)$61.62-0.84%
  • chainlinkChainlink(LINK)$9.14-0.62%
  • cardanoCardano(ADA)$0.152804-0.17%
  • stellarStellar(XLM)$0.137168-2.09%
  • Ethena USDeEthena USDe(USDE)$1.000.01%
  • nearNEAR Protocol(NEAR)$3.401.14%
  • daiDai(DAI)$1.000.00%
  • bitcoin-cashBitcoin Cash(BCH)$206.87-0.71%
  • litecoinLitecoin(LTC)$44.500.22%
  • CantonCanton(CC)$0.083299-0.01%
  • RainRain(RAIN)$0.004649-1.55%
  • uniswapUniswap(UNI)$5.21-0.07%
  • avalanche-2Avalanche(AVAX)$7.08-0.70%
  • tether-goldTether Gold(XAUT)$3,716.12-1.52%
  • suiSui(SUI)$0.72-0.22%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.03-4.46%
  • USD1USD1(USD1)$1.000.00%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.055929-2.29%
  • paypal-usdPayPal USD(PYUSD)$1.000.02%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.05%
  • BittensorBittensor(TAO)$195.140.07%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.06%
  • crypto-com-chainCronos(CRO)$0.042554-1.79%
  • quant-networkQuant(QNT)$149.63-2.07%
  • MemeCoreMemeCore(M)$0.90-1.25%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.21%
  • okbOKB(OKB)$87.460.71%
  • aaveAave(AAVE)$109.38-1.85%
  • Falcon USDFalcon USD(USDF)$1.00-0.02%
  • pax-goldPAX Gold(PAXG)$3,716.01-1.62%
  • United StablesUnited Stables(U)$1.000.01%
  • pepePepe(PEPE)$0.0000040.80%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

DeepMind Researchers Redefine Continual Reinforcement Learning with a Precise Mathematical Definition

July 28, 2023
in AI & Technology
Reading Time: 4 mins read
A A
DeepMind Researchers Redefine Continual Reinforcement Learning with a Precise Mathematical Definition
ShareShareShareShareShare

Recent advances in deep Reinforcement Learning ( RL ) have demonstrated superhuman performance by artificially intelligent (AI ) agents on a variety of impressive tasks. Current approaches for achieving these results follow developing an agent that primarily learns how to master a narrow task of interest. Untrained agents have to perform these tasks often, and there is no guarantee that they would generalize to new variations, even for a simple RL model. On the contrary, humans continuously acquire knowledge and generalize to adapt to new scenarios during their lifetime. This is called Continual reinforcement learning (CRL).

The view of learning in RL is that the agent interacts with the Markovian environment to identify an optimal behavior efficiently. Search for optimal behavior would cease the point of learning. For example, imagine playing a well-predefined game. Once you have mastered the game, the task is complete, and you stop learning about new game scenarios. One must view learning as an endless adaptation rather than viewing it as finding a solution. 

Continuous reinforcement learning (CRL) involves such study. It is a supervised, never-ending, and continual learning. DeepMind Researchers formalize the notion of agents in two steps. One is to understand every agent as implicitly searching over a set of behaviors and the other as every agent will either continue the search forever or stop eventually on a choice of behavior. Researchers define a pair of generators related to the agents as generates reach operators. By using this formalism, they define CRL as an RL problem in which all the agents never stop their search.

Building a neural network requires a basis with any assignment of weights on its elements and a learning mechanism for updating the active elements of the basis. Researchers say that in CRL, the number of parameters of the network is constrained by what we can build and the learning mechanism can be thought of as a stochastic gradient descent rather than a method of searching the basis in an unconstrained way. Here, the basis is not arbitrary. 

Researchers choose a class of functions that act as representations of the behavior and make use of specific learning rules to react to the experiences in a desirable way. The choice of class of functions depends upon the available resources or the memory. The stochastic gradient descent method updates the current choice of basis to improve the performance. Though the choice of basis is not arbitrary, this involves the design of the agent as well as the constraints imposed by the environment.

Researchers claim that further study of learning the rules can directly modify the design of new learning algorithms. Characterizing the family of continual learning rules will guarantee the yield of continual learning agents, which can be further used to guide the design of principled continual learning agents. They also intend to investigate further methods such as plasticity loss, in-context learning, and catastrophic forgetting.


Check out the Paper. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 26k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.


YOU MAY ALSO LIKE

Nutrient Data Extraction API: JSON Matching Your Schema With Per-Field Citations and Confidence

Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI

Arshad is an intern at MarktechPost. He is currently pursuing his Int. MSc Physics from the Indian Institute of Technology Kharagpur. Understanding things to the fundamental level leads to new discoveries which lead to advancement in technology. He is passionate about understanding the nature fundamentally with the help of tools like mathematical models, ML models and AI.


🔥 Gain a competitive
edge with data: Actionable market intelligence for global brands, retailers, analysts, and investors. (Sponsored)

Credit: Source link

ShareTweetSendSharePin

Related Posts

Nutrient Data Extraction API: JSON Matching Your Schema With Per-Field Citations and Confidence
AI & Technology

Nutrient Data Extraction API: JSON Matching Your Schema With Per-Field Citations and Confidence

November 19, 2026
Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI
AI & Technology

Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI

November 19, 2026
Which Is Better for Your Team? – Unite.AI
AI & Technology

Which Is Better for Your Team? – Unite.AI

November 18, 2026
Waymo Pauses Service In San Francisco After Robotaxis Get Stuck On Flooded Streets
AI & Technology

Waymo Pauses Service In San Francisco After Robotaxis Get Stuck On Flooded Streets

November 18, 2026
Next Post
NASA+ is the space agency’s very own streaming platform

NASA+ is the space agency's very own streaming platform

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Pilot survives small plane crash in Nevada

Pilot survives small plane crash in Nevada

November 18, 2026
Bystander helps Florida state trooper catch fleeing driver

Bystander helps Florida state trooper catch fleeing driver

November 12, 2026
Putin’s prized bridge is partially destroyed in Ukrainian strike – NBC News

Putin’s prized bridge is partially destroyed in Ukrainian strike – NBC News

November 17, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!