• bitcoinBitcoin(BTC)$64,883.00-0.51%
  • ethereumEthereum(ETH)$1,808.38-2.18%
  • tetherTether(USDT)$1.000.00%
  • binancecoinBNB(BNB)$591.03-0.37%
  • usd-coinUSDC(USDC)$1.000.01%
  • rippleXRP(XRP)$0.970.36%
  • solanaSolana(SOL)$73.682.34%
  • tronTRON(TRX)$0.3075670.50%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.04-1.70%
  • HyperliquidHyperliquid(HYPE)$69.363.57%
  • zcashZcash(ZEC)$945.897.57%
  • moneroMonero(XMR)$506.74-0.15%
  • dogecoinDogecoin(DOGE)$0.059244-0.55%
  • leo-tokenLEO Token(LEO)$9.301.05%
  • USDSUSDS(USDS)$1.000.01%
  • whitebitWhiteBIT Coin(WBT)$62.57-0.94%
  • chainlinkChainlink(LINK)$9.280.09%
  • cardanoCardano(ADA)$0.1545620.04%
  • stellarStellar(XLM)$0.1395280.52%
  • Ethena USDeEthena USDe(USDE)$1.000.01%
  • daiDai(DAI)$1.000.02%
  • bitcoin-cashBitcoin Cash(BCH)$210.960.83%
  • nearNEAR Protocol(NEAR)$3.230.53%
  • RainRain(RAIN)$0.005489-25.02%
  • litecoinLitecoin(LTC)$44.91-0.03%
  • CantonCanton(CC)$0.081513-1.51%
  • uniswapUniswap(UNI)$5.383.56%
  • avalanche-2Avalanche(AVAX)$7.21-0.40%
  • tether-goldTether Gold(XAUT)$3,848.49-0.43%
  • suiSui(SUI)$0.730.60%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.03-1.42%
  • USD1USD1(USD1)$1.000.00%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.057828-1.38%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.01%
  • paypal-usdPayPal USD(PYUSD)$1.000.01%
  • crypto-com-chainCronos(CRO)$0.0444332.16%
  • quant-networkQuant(QNT)$156.55-0.35%
  • BittensorBittensor(TAO)$194.151.64%
  • shiba-inuShiba Inu(SHIB)$0.000004-1.62%
  • MemeCoreMemeCore(M)$0.916.55%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.18%
  • okbOKB(OKB)$86.270.36%
  • aaveAave(AAVE)$113.382.99%
  • pax-goldPAX Gold(PAXG)$3,851.78-0.40%
  • Falcon USDFalcon USD(USDF)$1.000.02%
  • United StablesUnited Stables(U)$1.000.05%
  • pepePepe(PEPE)$0.000004-1.65%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

UC Berkeley And MIT Researchers Propose A Policy Gradient Algorithm Called Denoising Diffusion Policy Optimization (DDPO) That Can Optimize A Diffusion Model For Downstream Tasks Using Only A Black-Box Reward Function

July 9, 2023
in AI & Technology
Reading Time: 4 mins read
A A
UC Berkeley And MIT Researchers Propose A Policy Gradient Algorithm Called Denoising Diffusion Policy Optimization (DDPO) That Can Optimize A Diffusion Model For Downstream Tasks Using Only A Black-Box Reward Function
ShareShareShareShareShare

Researchers have made notable strides in training diffusion models using reinforcement learning (RL) to enhance prompt-image alignment and optimize various objectives. Introducing denoising diffusion policy optimization (DDPO), which treats denoising diffusion as a multi-step decision-making problem, enables fine-tuning Stable Diffusion on challenging downstream objectives.

By directly training diffusion models on RL-based objectives, the researchers demonstrate significant improvements in prompt-image alignment and optimizing objectives that are difficult to express through traditional prompting methods. DDPO presents a class of policy gradient algorithms designed for this purpose. To improve prompt-image alignment, the research team incorporates feedback from a large vision-language model known as LLaVA. By leveraging RL training, they achieved remarkable progress in aligning prompts with generated images. Notably, the models shift towards a more cartoon-like style, potentially influenced by the prevalence of such representations in the pretraining data.

The results obtained using DDPO for various reward functions are promising. Evaluations on objectives such as compressibility, incompressibility, and aesthetic quality show notable enhancements compared to the base model. The researchers also highlight the generalization capabilities of the RL-trained models, which extend to unseen animals, everyday objects, and novel combinations of activities and objects. While RL training brings substantial benefits, the researchers note the potential challenge of over-optimization. Fine-tuning learned reward functions can lead to models exploiting the rewards non-usefully, often destroying meaningful image content.

[Sponsored] 🔥 Build your personal brand with Taplio  🚀 The 1st all-in-one AI-powered tool to grow on LinkedIn. Create better LinkedIn content 10x faster, schedule, analyze your stats & engage. Try it for free!

Additionally, the researchers observe a susceptibility of the LLaVA model to typographic attacks. RL-trained models can loosely generate text resembling the correct number of animals, fooling LLaVA in prompt-based alignment scenarios.

In summary, introducing DDPO and using RL training for diffusion models represent significant progress in improving prompt-image alignment and optimizing diverse objectives. The results showcase advancements in compressibility, incompressibility, and aesthetic quality. However, challenges such as reward over-optimization and vulnerabilities in prompt-based alignment methods warrant further investigation. These findings open up new opportunities for research and development in diffusion models, particularly in image generation and completion tasks.


Check out the Paper, Project, and GitHub Link. Don’t forget to join our 26k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more. If you have any questions regarding the above article or if we missed anything, feel free to email us at [email protected]

🚀 Check Out 100’s AI Tools in AI Tools Club


YOU MAY ALSO LIKE

5 Important Bose Headphone Settings That Need To Be Manually Turned On

The Smartest AI Decision Might Be Not Sending the Message – Unite.AI

Niharika is a Technical consulting intern at Marktechpost. She is a third year undergraduate, currently pursuing her B.Tech from Indian Institute of Technology(IIT), Kharagpur. She is a highly enthusiastic individual with a keen interest in Machine learning, Data science and AI and an avid reader of the latest developments in these fields.


🔥 StoryBird.ai just dropped some amazing features. Generate an illustrated story from a prompt. Check it out here. (Sponsored)

Credit: Source link

ShareTweetSendSharePin

Related Posts

5 Important Bose Headphone Settings That Need To Be Manually Turned On
AI & Technology

5 Important Bose Headphone Settings That Need To Be Manually Turned On

November 17, 2026
The Smartest AI Decision Might Be Not Sending the Message – Unite.AI
AI & Technology

The Smartest AI Decision Might Be Not Sending the Message – Unite.AI

November 17, 2026
Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models
AI & Technology

Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models

November 17, 2026
Adam Mosseri Thinks It Will Be ‘Pretty Challenging’ To Design Instagram For The iPhone Duo
AI & Technology

Adam Mosseri Thinks It Will Be ‘Pretty Challenging’ To Design Instagram For The iPhone Duo

November 17, 2026
Next Post
PVH Beats Earnings Estimates, but Faced Significant Foreign Exchange Headwinds

PVH Beats Earnings Estimates, but Faced Significant Foreign Exchange Headwinds

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Fatal shootings spread across Dallas on Halloween night

Fatal shootings spread across Dallas on Halloween night

November 13, 2026
Election exit polls in Israel show no clear winner

Election exit polls in Israel show no clear winner

November 15, 2026
Authorities warn about risk from chargers after fires

Authorities warn about risk from chargers after fires

November 14, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!