• bitcoinBitcoin(BTC)$63,794.00-1.45%
  • ethereumEthereum(ETH)$1,795.06-0.93%
  • tetherTether(USDT)$1.000.00%
  • binancecoinBNB(BNB)$587.90-0.10%
  • usd-coinUSDC(USDC)$1.000.00%
  • rippleXRP(XRP)$0.960.34%
  • solanaSolana(SOL)$72.652.30%
  • tronTRON(TRX)$0.306541-0.12%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.01-3.70%
  • HyperliquidHyperliquid(HYPE)$68.262.15%
  • zcashZcash(ZEC)$924.374.41%
  • moneroMonero(XMR)$505.911.49%
  • dogecoinDogecoin(DOGE)$0.058824-0.70%
  • leo-tokenLEO Token(LEO)$9.301.28%
  • USDSUSDS(USDS)$1.000.02%
  • whitebitWhiteBIT Coin(WBT)$61.67-1.37%
  • chainlinkChainlink(LINK)$9.11-0.77%
  • cardanoCardano(ADA)$0.152460-0.32%
  • stellarStellar(XLM)$0.1377000.25%
  • Ethena USDeEthena USDe(USDE)$1.000.00%
  • daiDai(DAI)$1.000.00%
  • bitcoin-cashBitcoin Cash(BCH)$207.24-0.36%
  • nearNEAR Protocol(NEAR)$3.180.72%
  • RainRain(RAIN)$0.004848-25.75%
  • litecoinLitecoin(LTC)$44.37-0.82%
  • CantonCanton(CC)$0.080327-2.32%
  • uniswapUniswap(UNI)$5.263.11%
  • avalanche-2Avalanche(AVAX)$7.10-0.61%
  • tether-goldTether Gold(XAUT)$3,846.170.36%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.050.55%
  • suiSui(SUI)$0.72-0.18%
  • USD1USD1(USD1)$1.000.01%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.03%
  • hedera-hashgraphHedera(HBAR)$0.056218-2.58%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.08%
  • paypal-usdPayPal USD(PYUSD)$1.000.02%
  • crypto-com-chainCronos(CRO)$0.0434871.25%
  • shiba-inuShiba Inu(SHIB)$0.000004-1.17%
  • BittensorBittensor(TAO)$190.871.23%
  • quant-networkQuant(QNT)$152.70-2.68%
  • MemeCoreMemeCore(M)$0.895.86%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.120.19%
  • okbOKB(OKB)$85.320.61%
  • pax-goldPAX Gold(PAXG)$3,850.190.40%
  • aaveAave(AAVE)$110.913.39%
  • Falcon USDFalcon USD(USDF)$1.00-0.03%
  • United StablesUnited Stables(U)$1.000.02%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Huawei Research Introduces DiffFit For Efficiently Fine-Tuning Large Diffusion Models

July 11, 2023
in AI & Technology
Reading Time: 4 mins read
A A
Huawei Research Introduces DiffFit For Efficiently Fine-Tuning Large Diffusion Models
ShareShareShareShareShare

One of the most important challenges in machine learning is modeling intricate probability distributions. Diffusion probabilistic models DPMs aim to learn the inverse of a well-defined stochastic process that progressively destroys information. 

Image synthesis, video production, and 3D editing are some areas where denoising diffusion probabilistic models (DDPMs) have shown their worth. As a result of their large parameter sizes and frequent inference steps per image, current state-of-the-art DDPMs incur high computational costs. In reality, not all users have access to sufficient financial means to cover the cost of computation and storage. Therefore, it is crucial to investigate strategies for effectively customizing publically available, big, pre-trained diffusion models for individual applications.

A new study by Huawei Noah’s Ark Lab researchers uses the Diffusion Transformer as a foundation and offers DiffFit, a straightforward and effective fine-tuning technique for large diffusion models. Recent NLP (BitFit) research has shown that adjusting the bias term can fine-tune a pre-trained model for downstream tasks. The researchers wanted to adapt these effective tuning strategies for image generation. They first immediately apply BitFi, and to improve feature scaling and generalizability, they incorporate learnable scaling factors to particular layers of the model, with a default value of 1.0 and dataset-specific tweaks. The empirical results indicate that including strategic places throughout the model is crucial for improving the Frechet Inception Distance (FID) score.

[Sponsored] 🔥 Build your personal brand with Taplio  🚀 The 1st all-in-one AI-powered tool to grow on LinkedIn. Create better LinkedIn content 10x faster, schedule, analyze your stats & engage. Try it for free!

BitFit, AdaptFormer, LoRA, and VPT are only some of the parameter-efficient fine-tuning strategies the team used and compared over 8 downstream datasets. Regarding the number of trainable parameters and the FID trade-off, the findings show that DiffFit performs better than these other techniques. In addition, the researchers also found that their DiffFit strategy could be easily employed to fine-tune a low-resolution diffusion model, allowing it to adapt to high-resolution picture production at a cheap cost simply by treating high-resolution images as a distinct domain from low-resolution ones. 

DiffFit outperformed the prior state-of-the-art diffusion models on ImageNet 512×512 by starting with a pretrained ImageNet 256×256 checkpoint and fine-tuning DIT for only 25 epochs. DiffFit outperforms the original DiT-XL/2-512 model (which has 640M trainable parameters and 3M iterations) in terms of FID while having only roughly 0.9 million trainable parameters. It also requires 30% less time to train. 

Overall, DiffFit seeks to provide insight into the efficient fine-tuning of bigger diffusion models by establishing a simple and powerful baseline for parameter-efficient fine-tuning in picture production.


Check out the Paper. Don’t forget to join our 19k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more. If you have any questions regarding the above article or if we missed anything, feel free to email us at [email protected]

🚀 Check Out 100’s AI Tools in AI Tools Club


YOU MAY ALSO LIKE

You.com Launches Extract API for Document Retrieval and PDF Parsing – Unite.AI

NVIDIA Establishes Export Control Committee Following Jensen Huang Resignation

Tanushree Shenwai is a consulting intern at MarktechPost. She is currently pursuing her B.Tech from the Indian Institute of Technology(IIT), Bhubaneswar. She is a Data Science enthusiast and has a keen interest in the scope of application of artificial intelligence in various fields. She is passionate about exploring the new advancements in technologies and their real-life application.


🔥 StoryBird.ai just dropped some amazing features. Generate an illustrated story from a prompt. Check it out here. (Sponsored)

Credit: Source link

ShareTweetSendSharePin

Related Posts

You.com Launches Extract API for Document Retrieval and PDF Parsing – Unite.AI
AI & Technology

You.com Launches Extract API for Document Retrieval and PDF Parsing – Unite.AI

November 17, 2026
NVIDIA Establishes Export Control Committee Following Jensen Huang Resignation
AI & Technology

NVIDIA Establishes Export Control Committee Following Jensen Huang Resignation

November 17, 2026
5 Important Bose Headphone Settings That Need To Be Manually Turned On
AI & Technology

5 Important Bose Headphone Settings That Need To Be Manually Turned On

November 17, 2026
The Smartest AI Decision Might Be Not Sending the Message – Unite.AI
AI & Technology

The Smartest AI Decision Might Be Not Sending the Message – Unite.AI

November 17, 2026
Next Post
High Yield Investors Should Look on Bright Side

High Yield Investors Should Look on Bright Side

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Impax Global Opportunities Fund Q3 2026 Commentary

Impax Global Opportunities Fund Q3 2026 Commentary

November 15, 2026
Trump administration moves to block China from indirect access to American AI technology – AP News

Trump administration moves to block China from indirect access to American AI technology – AP News

November 17, 2026
Disney’s 3D Movies Shine On Meta’s Quest 3, It’s Just A Shame It Took So Long

Disney’s 3D Movies Shine On Meta’s Quest 3, It’s Just A Shame It Took So Long

November 13, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!