• bitcoinBitcoin(BTC)$64,150.00-0.32%
  • ethereumEthereum(ETH)$1,785.06-1.64%
  • tetherTether(USDT)$1.000.00%
  • binancecoinBNB(BNB)$587.600.32%
  • usd-coinUSDC(USDC)$1.000.00%
  • rippleXRP(XRP)$0.961.78%
  • solanaSolana(SOL)$72.562.96%
  • tronTRON(TRX)$0.3082650.96%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.02-3.67%
  • HyperliquidHyperliquid(HYPE)$68.072.64%
  • zcashZcash(ZEC)$937.817.97%
  • moneroMonero(XMR)$498.920.46%
  • dogecoinDogecoin(DOGE)$0.058543-0.26%
  • leo-tokenLEO Token(LEO)$9.280.91%
  • USDSUSDS(USDS)$1.000.00%
  • whitebitWhiteBIT Coin(WBT)$61.85-0.69%
  • chainlinkChainlink(LINK)$9.140.35%
  • cardanoCardano(ADA)$0.1524080.52%
  • stellarStellar(XLM)$0.1383271.66%
  • Ethena USDeEthena USDe(USDE)$1.000.01%
  • daiDai(DAI)$1.000.01%
  • bitcoin-cashBitcoin Cash(BCH)$208.441.52%
  • nearNEAR Protocol(NEAR)$3.181.90%
  • RainRain(RAIN)$0.004976-27.66%
  • litecoinLitecoin(LTC)$44.530.53%
  • uniswapUniswap(UNI)$5.334.51%
  • CantonCanton(CC)$0.079969-1.54%
  • avalanche-2Avalanche(AVAX)$7.130.88%
  • tether-goldTether Gold(XAUT)$3,854.810.32%
  • suiSui(SUI)$0.721.47%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.04-0.11%
  • USD1USD1(USD1)$1.000.01%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.057103-0.20%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.06%
  • paypal-usdPayPal USD(PYUSD)$1.000.00%
  • crypto-com-chainCronos(CRO)$0.0438432.34%
  • BittensorBittensor(TAO)$192.272.34%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.85%
  • quant-networkQuant(QNT)$153.07-0.95%
  • MemeCoreMemeCore(M)$0.916.37%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.03%
  • okbOKB(OKB)$85.720.39%
  • aaveAave(AAVE)$112.664.57%
  • pax-goldPAX Gold(PAXG)$3,857.750.33%
  • Falcon USDFalcon USD(USDF)$1.000.04%
  • United StablesUnited Stables(U)$1.000.02%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Meet Segment AnyRGBD: A Toolbox To Segment Rendered Depth Images Based On SAM

July 10, 2023
in AI & Technology
Reading Time: 4 mins read
A A
Meet Segment AnyRGBD: A Toolbox To Segment Rendered Depth Images Based On SAM
ShareShareShareShareShare

To segment rendered depth pictures using SAM, researchers have developed the Segment AnyRGBD toolkit. SAD, short for Segment Any RGBD, was recently introduced by NTU researchers. SAD can easily segment any 3D object from RGBD inputs (or generated depth pictures alone).

The produced depth picture is then sent into SAM since researchers have shown that people can readily recognize things from the visualization of the depth map. This is accomplished by first mapping the depth map ([H, W]) to the RGB space ([H, W, 3]) through a colormap function. The rendered depth picture pays less attention to texture and more attention to geometry compared to the RGB image. In SAM-based projects such as SSA, Anything-3D, and SAM 3D, the input images are all RGB images. Researchers pioneered the use of SAM to extract geometrical details directly.

OVSeg is a zero-shot semantic segmentation tool used by researchers. The study’s authors have given consumers a choice between raw RGB photos or generated depth images as input to the SAM. The user may retrieve the semantic masks (where each hue represents a different class) and the SAM masks associated with the class in either way.

[Sponsored] 🔥 Build your personal brand with Taplio  🚀 The 1st all-in-one AI-powered tool to grow on LinkedIn. Create better LinkedIn content 10x faster, schedule, analyze your stats & engage. Try it for free!

Outcomes

Since texture information is most prominent in RGB images and geometry information is present in in-depth photos, the former are brighter than their rendered counterparts. As the accompanying diagram shows, SAM offers a wider variety of masks for the RGB inputs than it does for the depth inputs.

Over-segmentation in SAM has reduced thanks to the produced depth picture. In the accompanying illustration, for instance, the chair is identified as one of the four segments of the table that were extracted from the RGB photos using semantic segmentation. However, the table is correctly classified as a whole on the depth image. In the accompanying picture, the blue circles indicate regions of the skull that are misclassified as walls in the RGB image but are correctly identified in the depth image.

The red circled chair in the depth picture may be two chairs so close together that they are treated as a single entity. The RGB photos’ texture data is crucial in identifying the item.

Repo and Tool

Visit https://huggingface.co/spaces/jcenaa/Segment-Any-RGBD to see the repository. 

This repository is open source based on OVSeg, which is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License. However, certain project parts are covered by different licenses: The MIT license covers both CLIP and ZSSEG.

https://huggingface.co/spaces/jcenaa/Segment-Any-RGBD is where one may give the tool a try. 

For this task, one will need a graphics processing unit (GPU) and may get one by duplicating the space and upgrading the settings to use a GPU instead of waiting in line. There is a significant delay between initiating the framework, processing SAM segments, processing zero-shot semantic segments, and generating 3D results. Final results are available in around 2–5 minutes.


Check out the Code and Repo. Don’t forget to join our 20k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more. If you have any questions regarding the above article or if we missed anything, feel free to email us at [email protected]

🚀 Check Out 100’s AI Tools in AI Tools Club


YOU MAY ALSO LIKE

5 Important Bose Headphone Settings That Need To Be Manually Turned On

The Smartest AI Decision Might Be Not Sending the Message – Unite.AI

Dhanshree Shenwai is a Computer Science Engineer and has a good experience in FinTech companies covering Financial, Cards & Payments and Banking domain with keen interest in applications of AI. She is enthusiastic about exploring new technologies and advancements in today’s evolving world making everyone’s life easy.


🔥 StoryBird.ai just dropped some amazing features. Generate an illustrated story from a prompt. Check it out here. (Sponsored)

Credit: Source link

ShareTweetSendSharePin

Related Posts

5 Important Bose Headphone Settings That Need To Be Manually Turned On
AI & Technology

5 Important Bose Headphone Settings That Need To Be Manually Turned On

November 17, 2026
The Smartest AI Decision Might Be Not Sending the Message – Unite.AI
AI & Technology

The Smartest AI Decision Might Be Not Sending the Message – Unite.AI

November 17, 2026
Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models
AI & Technology

Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models

November 17, 2026
Liquid AI Releases d1.2 and d1.2-ultra: Omnimodal Decision Models That Top the AA Decision Index
AI & Technology

Liquid AI Releases d1.2 and d1.2-ultra: Omnimodal Decision Models That Top the AA Decision Index

November 17, 2026
Next Post
I Want To Start A Business To Pay Off Debt

I Want To Start A Business To Pay Off Debt

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Catastrophic flooding prompts rescues

Catastrophic flooding prompts rescues

November 17, 2026
Unwanted Gift Cards – Sell or Trade Them, and Ask for Cash on Small Balances

Unwanted Gift Cards – Sell or Trade Them, and Ask for Cash on Small Balances

November 12, 2026
FDA plans to update nutrition rules for infant formula

FDA plans to update nutrition rules for infant formula

November 14, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!