• bitcoinBitcoin(BTC)$64,455.00-0.20%
  • ethereumEthereum(ETH)$1,805.89-1.16%
  • tetherTether(USDT)$1.00-0.02%
  • binancecoinBNB(BNB)$591.22-0.19%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.993.17%
  • solanaSolana(SOL)$74.722.56%
  • tronTRON(TRX)$0.3090971.23%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.01-3.07%
  • HyperliquidHyperliquid(HYPE)$68.65-1.22%
  • zcashZcash(ZEC)$948.692.51%
  • moneroMonero(XMR)$503.010.84%
  • dogecoinDogecoin(DOGE)$0.0593610.67%
  • leo-tokenLEO Token(LEO)$9.320.42%
  • USDSUSDS(USDS)$1.000.01%
  • whitebitWhiteBIT Coin(WBT)$62.22-0.48%
  • chainlinkChainlink(LINK)$9.220.48%
  • cardanoCardano(ADA)$0.1538990.24%
  • stellarStellar(XLM)$0.1407662.47%
  • Ethena USDeEthena USDe(USDE)$1.00-0.02%
  • daiDai(DAI)$1.000.01%
  • nearNEAR Protocol(NEAR)$3.363.47%
  • bitcoin-cashBitcoin Cash(BCH)$207.36-0.66%
  • litecoinLitecoin(LTC)$44.56-0.27%
  • CantonCanton(CC)$0.0846404.01%
  • RainRain(RAIN)$0.004500-19.92%
  • avalanche-2Avalanche(AVAX)$7.16-0.78%
  • uniswapUniswap(UNI)$5.21-2.20%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.073.55%
  • tether-goldTether Gold(XAUT)$3,759.05-2.59%
  • suiSui(SUI)$0.730.71%
  • USD1USD1(USD1)$1.000.01%
  • Ripple USDRipple USD(RLUSD)$1.00-0.01%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • hedera-hashgraphHedera(HBAR)$0.0572960.71%
  • paypal-usdPayPal USD(PYUSD)$1.00-0.01%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.00%
  • BittensorBittensor(TAO)$195.531.50%
  • crypto-com-chainCronos(CRO)$0.043748-1.16%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.35%
  • quant-networkQuant(QNT)$154.030.62%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • MemeCoreMemeCore(M)$0.88-2.37%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.22%
  • okbOKB(OKB)$86.60-0.88%
  • aaveAave(AAVE)$110.95-2.13%
  • pax-goldPAX Gold(PAXG)$3,761.02-2.60%
  • Falcon USDFalcon USD(USDF)$1.000.06%
  • United StablesUnited Stables(U)$1.00-0.06%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

The Enigma for ChatGPT: PUMA is an AI Approach That Proposes a Fast and Secure Way for LLM Inference

August 25, 2023
in AI & Technology
Reading Time: 5 mins read
A A
The Enigma for ChatGPT: PUMA is an AI Approach That Proposes a Fast and Secure Way for LLM Inference
ShareShareShareShareShare

Large Language Models (LLMs) have started a revolution in the artificial intelligence domain. The release of ChatGPT has sparked the ignition for the era of LLMs, and since then, we have seen them ever improving. These models are made possible with massive amounts of data and have impressed us with their capabilities, from mastering language understanding to simplifying complex tasks.

There have been numerous alternatives proposed to ChatGPT, and they got better and better every day, even managing to surpass ChatGPT in certain tasks. LLaMa, Claudia, Falcon, and more; the new LLM models are coming for the ChatGPT’s throne.

However, there is no doubt that ChatGPT is still by far the most popular LLM out there. There is a really high chance that your favorite AI-powered app is probably just a ChatGPT wrapper, handling the connection for you. But, if we step back and think about the security perspective, is it really private and secure? OpenAI ensures protecting API data privacy is something they deeply care about, but they are facing numerous lawsuits at the same time. Even if they work really hard to protect the privacy and security of the model usage, these models can be too powerful to be controlled.

So how do we ensure we can utilize the power of LLMs without concerns about privacy and security arising? How do we utilize these models’ prowess without compromising sensitive data? Let us meet with PUMA.

PUMA is a framework designed to enable secure and efficient evaluation of Transformer models, all while maintaining the sanctity of your data. It merges secure multi-party computation (MPC) with efficient Transformer inference.

At its core, PUMA introduces a novel technique to approximate the complex non-linear functions within Transformer models, like GeLU and Softmax. These approximations are tailored to retain accuracy while significantly boosting efficiency. Unlike previous methods that might sacrifice performance or lead to convoluted deployment strategies, PUMA’s approach balances both worlds – ensuring accurate results while maintaining the efficiency necessary for real-world applications.

PUMA introduces three pivotal entities: the model owner, the client, and the computing parties. Each entity plays a crucial role in the secure inference process. 

The model owner supplies the trained Transformer models, while the client contributes the input data and receives the inference results. The computing parties collectively execute secure computation protocols, ensuring that data and model weights remain securely protected throughout the process. The underpinning principle of PUMA‘s inference process is to maintain the confidentiality of input data and weights, preserving the privacy of the entities involved.

Secure embedding, a fundamental aspect of the secure inference process, traditionally involves the generation of a one-hot vector using token identifiers. Instead, PUMA proposes a secure embedding design that adheres closely to the standard workflow of Transformer models. This streamlined approach ensures that the security measures do not interfere with the inherent architecture of the model, simplifying the deployment of secure models in practical applications.

Moreover, a major challenge in secure inference lies in approximating complex functions, such as GeLU and Softmax, in a way that balances computational efficiency with accuracy. PUMA tackles this aspect by devising more accurate approximations tailored to the properties of these functions. By leveraging the specific characteristics of these functions, PUMA significantly enhances the precision of the approximation while optimizing runtime and communication costs.

Finally, LayerNorm, a crucial operation within the Transformer model, presents unique challenges in secure inference due to the divide-square-root formula. PUMA addresses this by smartly redefining the operation using secure protocols, thus ensuring that the computation of LayerNorm remains both secure and efficient. 

One of the most important features of PUMA is its seamless integration. The framework facilitates end-to-end secure inference for Transformer models without necessitating major model architecture modifications. This means you can leverage pre-trained Transformer models with minimal effort. Whether it’s a language model downloaded from Hugging Face or another source, PUMA keeps things simple. It aligns with the original workflow and doesn’t demand complex retraining or modifications.


Check out the Paper and Github link. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to join our 29k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.

If you like our work, please follow us on Twitter


YOU MAY ALSO LIKE

Recast Brings AI Troubleshooting to Right Click Tools With MCP Server – Unite.AI

Nexalus and RENDA Launch Nova8 Liquid-Cooled AI Server for Data Center Retrofits – Unite.AI

Ekrem Çetinkaya received his B.Sc. in 2018, and M.Sc. in 2019 from Ozyegin University, Istanbul, Türkiye. He wrote his M.Sc. thesis about image denoising using deep convolutional networks. He received his Ph.D. degree in 2023 from the University of Klagenfurt, Austria, with his dissertation titled “Video Coding Enhancements for HTTP Adaptive Streaming Using Machine Learning.” His research interests include deep learning, computer vision, video encoding, and multimedia networking.


🚀 CodiumAI enables busy developers to generate meaningful tests (Sponsored)


Credit: Source link

ShareTweetSendSharePin

Related Posts

Recast Brings AI Troubleshooting to Right Click Tools With MCP Server – Unite.AI
AI & Technology

Recast Brings AI Troubleshooting to Right Click Tools With MCP Server – Unite.AI

November 18, 2026
Nexalus and RENDA Launch Nova8 Liquid-Cooled AI Server for Data Center Retrofits – Unite.AI
AI & Technology

Nexalus and RENDA Launch Nova8 Liquid-Cooled AI Server for Data Center Retrofits – Unite.AI

November 18, 2026
Flowtica Launches Verso, an E-Paper AI Recorder for Meeting Notes – Unite.AI
AI & Technology

Flowtica Launches Verso, an E-Paper AI Recorder for Meeting Notes – Unite.AI

November 18, 2026
Here’s What You Can Do If Your PC Won’t Read An External Hard Drive
AI & Technology

Here’s What You Can Do If Your PC Won’t Read An External Hard Drive

November 18, 2026
Next Post
Musk Is Being Penalized for Transparency, Loup’s Munster Says

Musk Is Being Penalized for Transparency, Loup's Munster Says

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Democrat running in red Kentucky district bucks party on ‘terrible’ Biden-era immigration policy

Democrat running in red Kentucky district bucks party on ‘terrible’ Biden-era immigration policy

November 15, 2026
ICE officer indicted after allegedly hitting and injuring a man with his vehicle

ICE officer indicted after allegedly hitting and injuring a man with his vehicle

November 14, 2026
Detroit-area school pulls off surprise for principal who survived breast cancer

Detroit-area school pulls off surprise for principal who survived breast cancer

November 15, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!