• bitcoinBitcoin(BTC)$64,883.000.73%
  • ethereumEthereum(ETH)$1,817.591.30%
  • tetherTether(USDT)$1.000.00%
  • binancecoinBNB(BNB)$593.851.12%
  • usd-coinUSDC(USDC)$1.000.01%
  • rippleXRP(XRP)$0.971.83%
  • solanaSolana(SOL)$71.901.68%
  • tronTRON(TRX)$0.303654-1.12%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.06-0.88%
  • HyperliquidHyperliquid(HYPE)$66.341.58%
  • zcashZcash(ZEC)$889.61-0.33%
  • moneroMonero(XMR)$494.482.88%
  • dogecoinDogecoin(DOGE)$0.0590321.25%
  • USDSUSDS(USDS)$1.000.02%
  • leo-tokenLEO Token(LEO)$9.160.72%
  • whitebitWhiteBIT Coin(WBT)$62.810.42%
  • chainlinkChainlink(LINK)$9.211.54%
  • cardanoCardano(ADA)$0.1530942.44%
  • Ethena USDeEthena USDe(USDE)$1.000.02%
  • stellarStellar(XLM)$0.1392891.90%
  • daiDai(DAI)$1.000.02%
  • bitcoin-cashBitcoin Cash(BCH)$209.332.57%
  • nearNEAR Protocol(NEAR)$3.161.38%
  • litecoinLitecoin(LTC)$44.920.68%
  • CantonCanton(CC)$0.0859219.55%
  • avalanche-2Avalanche(AVAX)$7.211.48%
  • uniswapUniswap(UNI)$5.153.60%
  • tether-goldTether Gold(XAUT)$3,867.411.21%
  • USD1USD1(USD1)$1.000.07%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.06-0.18%
  • suiSui(SUI)$0.731.52%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • paypal-usdPayPal USD(PYUSD)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.0589493.42%
  • RainRain(RAIN)$0.003465-3.92%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.04%
  • shiba-inuShiba Inu(SHIB)$0.0000041.59%
  • quant-networkQuant(QNT)$157.626.91%
  • BittensorBittensor(TAO)$191.491.74%
  • crypto-com-chainCronos(CRO)$0.043313-0.67%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.01%
  • MemeCoreMemeCore(M)$0.832.16%
  • okbOKB(OKB)$87.632.11%
  • pax-goldPAX Gold(PAXG)$3,871.131.30%
  • aaveAave(AAVE)$109.267.24%
  • Falcon USDFalcon USD(USDF)$1.000.16%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
  • United StablesUnited Stables(U)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Google AI Introduces SOAR: An Algorithmic Improvement to Vector Search that Introduces Effective and Low-Overhead Redundancy to ScaNN

April 20, 2024
in AI & Technology
Reading Time: 4 mins read
A A
Google AI Introduces SOAR: An Algorithmic Improvement to Vector Search that Introduces Effective and Low-Overhead Redundancy to ScaNN
ShareShareShareShareShare

Google AI researchers introduced ScaNN vector search library to address the need of efficient vector similarity search, which is a critical component of many machine learning algorithms. Existing methods for vector similarity calculation work well with small datasets, but as datasets continue to grow and new applications come up, the demand for further improvements in scalability and performance grows. SOAR (Spilling with Orthogonality-Amplified Residuals) is an algorithmic improvement to ScaNN that is meant to make vector search faster while reducing the amount of work that needs to be done.

Currently used methods for ScaNN utilize a clustering-based approach where each vector in the dataset is assigned to a single k-means cluster. However, these approaches encountered difficulties when the query vector was highly parallel to the residual, which is the difference between a vector and its assigned cluster center. This often resulted in missed nearest neighbors, particularly in scenarios where the query’s similarity to the cluster center did not accurately represent its similarity to individual vectors within the cluster. SOAR addresses this limitation by introducing redundancy through secondary assignments, allowing vectors to be assigned to multiple clusters. Additionally, it modifies the loss function to optimize for independent and effective redundancy, ensuring that secondary clusters contribute meaningfully to the search process.

SOAR is implemented by assigning vectors to multiple clusters and using a modified loss function to encourage orthogonal residuals. This approach significantly enhances search accuracy at a fixed computational cost or reduces the search cost needed to achieve the same level of accuracy. Experimental results demonstrate that SOAR enables ScaNN to maintain its advantages in low memory consumption, fast indexing speed, and hardware-friendly memory access patterns while gaining an additional algorithmic edge. ScaNN with SOAR has querying throughputs that are several times higher than similar libraries with similar indexing times. This makes it the best choice for vector search performance in several benchmarks, such as the ann-benchmarks glove-100 dataset and the Big-ANN 2023 benchmarks.

In conclusion, the paper presents a promising solution to the challenge of efficient vector similarity search through the introduction of SOAR to the ScaNN library. By incorporating redundancy and optimizing the assignment process, SOAR significantly improves search accuracy and performance without sacrificing key metrics such as memory consumption and indexing speed. The advancement showcases the importance of algorithmic innovation in meeting the ever-growing demands of machine learning applications with respect to vector search.


Check out the Paper and Blog. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter. Join our Telegram Channel, Discord Channel, and LinkedIn Group.

If you like our work, you will love our newsletter..

Don’t Forget to join our 40k+ ML SubReddit


For Content Partnership, Please Fill Out This Form Here..


YOU MAY ALSO LIKE

The Pros And Cons Of Using Your Phone As A Mobile Hotspot

Bharat Semi Raises $24M Seed to Bring AI Image Sensors to Market – Unite.AI

Pragati Jhunjhunwala is a consulting intern at MarktechPost. She is currently pursuing her B.Tech from the Indian Institute of Technology(IIT), Kharagpur. She is a tech enthusiast and has a keen interest in the scope of software and data science applications. She is always reading about the developments in different field of AI and ML.


🐝 Join the Fastest Growing AI Research Newsletter Read by Researchers from Google + NVIDIA + Meta + Stanford + MIT + Microsoft and many others…


Credit: Source link

ShareTweetSendSharePin

Related Posts

The Pros And Cons Of Using Your Phone As A Mobile Hotspot
AI & Technology

The Pros And Cons Of Using Your Phone As A Mobile Hotspot

November 16, 2026
Bharat Semi Raises M Seed to Bring AI Image Sensors to Market – Unite.AI
AI & Technology

Bharat Semi Raises $24M Seed to Bring AI Image Sensors to Market – Unite.AI

November 15, 2026
Samsung Is Discontinuing These Useful Mobile Apps In December
AI & Technology

Samsung Is Discontinuing These Useful Mobile Apps In December

November 15, 2026
What’s The Meaning Of The “A” On Your USB-A Ports?
AI & Technology

What’s The Meaning Of The “A” On Your USB-A Ports?

November 15, 2026
Next Post
There’s ,000 of Debt My Husband Doesn’t Know About…

There’s $60,000 of Debt My Husband Doesn’t Know About…

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Sen. Darline Graham recounts ‘difficult’ candidacy

Sen. Darline Graham recounts ‘difficult’ candidacy

November 11, 2026
‘I Voted’ stickers left at Renée Good and Alex Pretti memorials

‘I Voted’ stickers left at Renée Good and Alex Pretti memorials

November 10, 2026
Democratic Sen. Jon Ossoff projected to win re-election in Georgia

Democratic Sen. Jon Ossoff projected to win re-election in Georgia

November 11, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!