• bitcoinBitcoin(BTC)$64,658.000.15%
  • ethereumEthereum(ETH)$1,813.39-0.77%
  • tetherTether(USDT)$1.00-0.02%
  • binancecoinBNB(BNB)$592.20-0.04%
  • usd-coinUSDC(USDC)$1.00-0.02%
  • rippleXRP(XRP)$0.993.29%
  • solanaSolana(SOL)$74.993.08%
  • tronTRON(TRX)$0.3096091.13%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.01-3.07%
  • HyperliquidHyperliquid(HYPE)$68.99-0.91%
  • zcashZcash(ZEC)$954.233.53%
  • moneroMonero(XMR)$504.311.43%
  • dogecoinDogecoin(DOGE)$0.0594940.97%
  • leo-tokenLEO Token(LEO)$9.290.13%
  • USDSUSDS(USDS)$1.000.01%
  • whitebitWhiteBIT Coin(WBT)$62.45-0.14%
  • chainlinkChainlink(LINK)$9.261.08%
  • cardanoCardano(ADA)$0.1541030.58%
  • stellarStellar(XLM)$0.1411022.59%
  • Ethena USDeEthena USDe(USDE)$1.00-0.03%
  • nearNEAR Protocol(NEAR)$3.394.76%
  • daiDai(DAI)$1.000.01%
  • bitcoin-cashBitcoin Cash(BCH)$207.97-0.23%
  • litecoinLitecoin(LTC)$44.58-0.05%
  • CantonCanton(CC)$0.0848974.40%
  • avalanche-2Avalanche(AVAX)$7.20-0.07%
  • uniswapUniswap(UNI)$5.23-1.32%
  • RainRain(RAIN)$0.004419-24.46%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.073.05%
  • tether-goldTether Gold(XAUT)$3,764.82-2.49%
  • suiSui(SUI)$0.731.26%
  • USD1USD1(USD1)$1.000.02%
  • Ripple USDRipple USD(RLUSD)$1.00-0.01%
  • Global DollarGlobal Dollar(USDG)$1.00-0.01%
  • hedera-hashgraphHedera(HBAR)$0.0574301.08%
  • paypal-usdPayPal USD(PYUSD)$1.000.00%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.03%
  • BittensorBittensor(TAO)$196.611.86%
  • crypto-com-chainCronos(CRO)$0.043904-0.62%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.15%
  • quant-networkQuant(QNT)$155.481.93%
  • MemeCoreMemeCore(M)$0.88-1.07%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.25%
  • okbOKB(OKB)$86.78-0.90%
  • aaveAave(AAVE)$111.13-1.64%
  • pax-goldPAX Gold(PAXG)$3,766.43-2.53%
  • Falcon USDFalcon USD(USDF)$1.000.04%
  • United StablesUnited Stables(U)$1.00-0.07%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Apple Researchers Propose an End-to-End Network Producing Detailed 3D Reconstructions from Posed Images

August 25, 2023
in AI & Technology
Reading Time: 4 mins read
A A
Apple Researchers Propose an End-to-End Network Producing Detailed 3D Reconstructions from Posed Images
ShareShareShareShareShare

Have you ever played GTA-5? One gets admired for the 3D graphics in the game. Unlike 2D graphics on a flat plane, 3D graphics simulate depth and perspective, allowing for more realistic and immersive visuals. These graphics are widely used in various fields, including video games, film production, architectural visualization, medical imaging, virtual reality, and more.

The traditional method to create a 3D model was by estimating the depth maps for the input images, which were later fused to create a 3D model. A team of researchers from Apple and the University of California, Santa Barbara created a  direct inference of scene-level 3D geometry using deep neural networks, which didn’t involve the traditional method of test-time optimization. 

The traditional method resulted in missing geometry or artifacts in the areas where the depth maps didn’t match due to being transparent or low-textured surfaces. The researcher’s approach features the images onto a voxel grid and directly predicts the scene’s truncated signed distance function (TSDF) using a 3D convolution neural network.

 A Convolutional Neural Network (CNN) is a specialized artificial neural network designed for processing and analyzing visual data, particularly images and videos. The advantage of using this technique is that CNN can learn and produce smooth, consistent surfaces that can fill the gaps in the low-textured or transparent regions. 

Researchers used tri-linear interpolation to sample the ground-truth TSDF to align with the model’s voxel grid during the training. This tri-linear interpolation sampling added random noise to the details in the training session. To overcome this, they considered only the supervised predictions at the exact points where the ground-truth TSDF is well known, and this method improved the results by 10%.

 A voxel is a short form for volume pixels. It represents a point in 3D space within a grid, similar to how a pixel represents a point in a 2D image. The existing voxels are 4cm or larger, which is not enough to resolve the geometric details visible in natural images, and it is expensive to increase the voxel resolution. They fixed this issue using a CNN grid feature, directly projecting image features to the query point. 

They were required to use a dense back projection for sampling any feature from each input image from each voxel. However, it caused blurring in the back-projection volume, and they solved this by using initial multi-view stereo depth estimation, which was further used to enhance the feature volume. 

Researchers claim that their method is key to enabling the network to learn the fine details and allowing the free selection of output resolution without requiring additional training or 3D convolution levels. 


Check out the Paper and Github link. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 29k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.

If you like our work, please follow us on Twitter


YOU MAY ALSO LIKE

Recast Brings AI Troubleshooting to Right Click Tools With MCP Server – Unite.AI

Nexalus and RENDA Launch Nova8 Liquid-Cooled AI Server for Data Center Retrofits – Unite.AI

Arshad is an intern at MarktechPost. He is currently pursuing his Int. MSc Physics from the Indian Institute of Technology Kharagpur. Understanding things to the fundamental level leads to new discoveries which lead to advancement in technology. He is passionate about understanding the nature fundamentally with the help of tools like mathematical models, ML models and AI.


🚀 CodiumAI enables busy developers to generate meaningful tests (Sponsored)


Credit: Source link

ShareTweetSendSharePin

Related Posts

Recast Brings AI Troubleshooting to Right Click Tools With MCP Server – Unite.AI
AI & Technology

Recast Brings AI Troubleshooting to Right Click Tools With MCP Server – Unite.AI

November 18, 2026
Nexalus and RENDA Launch Nova8 Liquid-Cooled AI Server for Data Center Retrofits – Unite.AI
AI & Technology

Nexalus and RENDA Launch Nova8 Liquid-Cooled AI Server for Data Center Retrofits – Unite.AI

November 18, 2026
Flowtica Launches Verso, an E-Paper AI Recorder for Meeting Notes – Unite.AI
AI & Technology

Flowtica Launches Verso, an E-Paper AI Recorder for Meeting Notes – Unite.AI

November 18, 2026
Here’s What You Can Do If Your PC Won’t Read An External Hard Drive
AI & Technology

Here’s What You Can Do If Your PC Won’t Read An External Hard Drive

November 18, 2026
Next Post
The AI News You Missed – A Crazy Week For AI Art!

The AI News You Missed - A Crazy Week For AI Art!

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
How I Made 00 In One Short

How I Made $3000 In One Short

November 13, 2026
Nvidia Stock Plunges After Jensen Huang Resigns as CEO – The New York Times

Nvidia Stock Plunges After Jensen Huang Resigns as CEO – The New York Times

November 12, 2026
Democrat Angie Nixon in the lead as early Florida votes counted

Democrat Angie Nixon in the lead as early Florida votes counted

November 11, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!