• bitcoinBitcoin(BTC)$58,749.00-4.66%
  • ethereumEthereum(ETH)$1,661.45-4.57%
  • tetherTether(USDT)$1.00-0.05%
  • binancecoinBNB(BNB)$533.49-6.15%
  • usd-coinUSDC(USDC)$1.00-0.02%
  • rippleXRP(XRP)$0.90-4.48%
  • solanaSolana(SOL)$69.13-2.97%
  • tronTRON(TRX)$0.302805-1.00%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.031.68%
  • HyperliquidHyperliquid(HYPE)$59.68-6.06%
  • zcashZcash(ZEC)$768.84-5.36%
  • moneroMonero(XMR)$470.871.82%
  • dogecoinDogecoin(DOGE)$0.054012-4.64%
  • leo-tokenLEO Token(LEO)$9.12-1.23%
  • whitebitWhiteBIT Coin(WBT)$56.67-5.06%
  • chainlinkChainlink(LINK)$8.49-3.26%
  • USDSUSDS(USDS)$1.000.03%
  • cardanoCardano(ADA)$0.140939-4.16%
  • Ethena USDeEthena USDe(USDE)$1.00-0.05%
  • stellarStellar(XLM)$0.126515-4.05%
  • daiDai(DAI)$1.000.02%
  • bitcoin-cashBitcoin Cash(BCH)$193.51-1.80%
  • nearNEAR Protocol(NEAR)$2.79-5.54%
  • litecoinLitecoin(LTC)$39.33-5.18%
  • CantonCanton(CC)$0.074543-5.72%
  • avalanche-2Avalanche(AVAX)$6.50-4.76%
  • Ripple USDRipple USD(RLUSD)$1.000.00%
  • USD1USD1(USD1)$1.000.05%
  • tether-goldTether Gold(XAUT)$3,524.97-1.18%
  • the-open-networkGram (prev. Toncoin)(GRAM)$0.95-6.74%
  • uniswapUniswap(UNI)$4.47-6.00%
  • suiSui(SUI)$0.63-7.33%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • RainRain(RAIN)$0.003529-6.86%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.07%
  • paypal-usdPayPal USD(PYUSD)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.050744-4.83%
  • BittensorBittensor(TAO)$182.71-1.36%
  • crypto-com-chainCronos(CRO)$0.040527-0.78%
  • shiba-inuShiba Inu(SHIB)$0.000004-3.81%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.07%
  • Circle USYCCircle USYC(USYC)$1.140.05%
  • quant-networkQuant(QNT)$134.38-5.11%
  • MemeCoreMemeCore(M)$0.77-10.99%
  • Falcon USDFalcon USD(USDF)$1.00-0.04%
  • okbOKB(OKB)$78.15-4.75%
  • United StablesUnited Stables(U)$1.000.00%
  • pax-goldPAX Gold(PAXG)$3,529.54-1.01%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
  • aaveAave(AAVE)$99.25-2.41%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Unveiling EVA-CLIP-18B: A Leap Forward in Open-Source Vision and Multimodal AI Models

February 16, 2024
in AI & Technology
Reading Time: 5 mins read
A A
Unveiling EVA-CLIP-18B: A Leap Forward in Open-Source Vision and Multimodal AI Models
ShareShareShareShareShare

In recent years, LMMs have rapidly expanded, leveraging CLIP as a foundational vision encoder for robust visual representations and LLMs as versatile tools for reasoning across various modalities. However, while LLMs have grown to over 100 billion parameters, the vision models they rely on need to be bigger, hindering their potential. Scaling up contrastive language-image pretraining (CLIP) is essential to enhance both vision and multimodal models, bridging the gap and enabling more effective handling of diverse data types.

Researchers from the Beijing Academy of Artificial Intelligence and Tsinghua University have unveiled EVA-CLIP-18B, the largest open-source CLIP model yet, boasting 18 billion parameters. Despite training on just 6 billion samples, it achieves an impressive 80.7% zero-shot top-1 accuracy across 27 image classification benchmarks, surpassing prior models like EVA-CLIP. Notably, this advancement is achieved with a modest dataset of 2 billion image-text pairs, openly available and smaller than those used in other models. EVA-CLIP-18B showcases the potential of EVA-style weak-to-strong visual model scaling, with hopes of fostering further research in vision and multimodal foundation models.

EVA-CLIP-18B is the largest and most powerful open-source CLIP model, with 18 billion parameters. It outperforms its predecessor EVA-CLIP (5 billion parameters) and other open-source CLIP models by a large margin in terms of zero-shot top-1 accuracy on 27 image classification benchmarks. The principles of EVA and EVA-CLIP guide the scaling-up procedure of EVA-CLIP-18B. The EVA philosophy follows a weak-to-strong paradigm, where a small EVA-CLIP model serves as the vision encoder initialization for a larger EVA-CLIP model. This iterative scaling process stabilizes and accelerates the training of larger models.

EVA-CLIP-18B, an 18-billion-parameter CLIP model, is trained on a 2 billion image-text pairs dataset from LAION-2B and COYO-700M. Following the EVA and EVA-CLIP principles, it employs a weak-to-strong paradigm, where a smaller EVA-CLIP model initializes a larger one, stabilizing and expediting training. Evaluation across 33 datasets, including image and video classification and image-text retrieval, demonstrates its efficacy. The scaling process involves distilling knowledge from a small EVA-CLIP model to a larger EVA-CLIP, with the training dataset mostly fixed to showcase the effectiveness of the scaling philosophy. Notably, the approach yields sustained performance gains, exemplifying the effectiveness of progressive weak-to-strong scaling.

EVA-CLIP-18B, boasting 18 billion parameters, showcases outstanding performance across various image-related tasks. It achieves an impressive 80.7% zero-shot top-1 accuracy across 27 image classification benchmarks, surpassing its predecessor and other CLIP models by a significant margin. Moreover, linear probing on ImageNet-1K outperforms competitors like InternVL-C with an average top-1 accuracy of 88.9. Zero-shot image-text retrieval on Flickr30K and COCO datasets achieves an average recall of 87.8, significantly surpassing competitors. EVA-CLIP-18B exhibits robustness across different ImageNet variants, demonstrating its versatility and high performance across 33 widely used datasets.

In conclusion, EVA-CLIP-18B is the largest and highest-performing open-source CLIP model, boasting 18 billion parameters. Applying EVA’s weak-to-strong vision scaling principle achieves exceptional zero-shot top-1 accuracy across 27 image classification benchmarks. This scaling approach consistently improves performance without reaching saturation, pushing the boundaries of vision model capabilities. Notably, EVA-CLIP-18B exhibits robustness in visual representations, maintaining performance across various ImageNet variants, including adversarial ones. Its versatility and effectiveness are demonstrated across multiple datasets, spanning image classification, image-text retrieval, and video classification tasks, marking a significant advancement in CLIP model capabilities.


Check out the Paper. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter and Google News. Join our 36k+ ML SubReddit, 41k+ Facebook Community, Discord Channel, and LinkedIn Group.

If you like our work, you will love our newsletter..

Don’t Forget to join our Telegram Channel


YOU MAY ALSO LIKE

IIT Kharagpur Secures $5M From Google to Expand Campus AI Work – Unite.AI

Baseten Extends Decision Models to 128K Context and Image Input – Unite.AI

Sana Hassan, a consulting intern at Marktechpost and dual-degree student at IIT Madras, is passionate about applying technology and AI to address real-world challenges. With a keen interest in solving practical problems, he brings a fresh perspective to the intersection of AI and real-life solutions.


🚀 LLMWare Launches SLIMs: Small Specialized Function-Calling Models for Multi-Step Automation [Check out all the models]


Credit: Source link

ShareTweetSendSharePin

Related Posts

IIT Kharagpur Secures M From Google to Expand Campus AI Work – Unite.AI
AI & Technology

IIT Kharagpur Secures $5M From Google to Expand Campus AI Work – Unite.AI

November 21, 2026
Baseten Extends Decision Models to 128K Context and Image Input – Unite.AI
AI & Technology

Baseten Extends Decision Models to 128K Context and Image Input – Unite.AI

November 21, 2026
Baseten Releases Bison-1 and Groundhog-1, Topping Decision Model Index
AI & Technology

Baseten Releases Bison-1 and Groundhog-1, Topping Decision Model Index

November 21, 2026
AWS Quick Adds Chat-Built Flows and Multi-Agent Orchestration – Unite.AI
AI & Technology

AWS Quick Adds Chat-Built Flows and Multi-Agent Orchestration – Unite.AI

November 21, 2026
Next Post
Watch: Discussing the dilemmas of hostage diplomacy at Aspen Ideas Festival

Watch: Discussing the dilemmas of hostage diplomacy at Aspen Ideas Festival

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
15 Cheap Wedding Venues – What Each One Costs and What It Leaves Out

15 Cheap Wedding Venues – What Each One Costs and What It Leaves Out

November 19, 2026
Here’s What You Can Do If Your PC Won’t Read An External Hard Drive

Here’s What You Can Do If Your PC Won’t Read An External Hard Drive

November 18, 2026
The Smartest AI Decision Might Be Not Sending the Message – Unite.AI

The Smartest AI Decision Might Be Not Sending the Message – Unite.AI

November 17, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!