• bitcoinBitcoin(BTC)$63,685.00-1.79%
  • ethereumEthereum(ETH)$1,787.85-1.51%
  • tetherTether(USDT)$1.00-0.01%
  • binancecoinBNB(BNB)$587.05-0.56%
  • usd-coinUSDC(USDC)$1.000.00%
  • rippleXRP(XRP)$0.960.46%
  • solanaSolana(SOL)$72.502.00%
  • tronTRON(TRX)$0.3073630.50%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.02-3.60%
  • HyperliquidHyperliquid(HYPE)$67.850.47%
  • zcashZcash(ZEC)$921.393.72%
  • moneroMonero(XMR)$508.302.24%
  • dogecoinDogecoin(DOGE)$0.058746-0.91%
  • leo-tokenLEO Token(LEO)$9.301.44%
  • USDSUSDS(USDS)$1.000.01%
  • whitebitWhiteBIT Coin(WBT)$61.53-1.72%
  • chainlinkChainlink(LINK)$9.07-1.24%
  • cardanoCardano(ADA)$0.152062-0.79%
  • stellarStellar(XLM)$0.1375990.20%
  • Ethena USDeEthena USDe(USDE)$1.00-0.01%
  • daiDai(DAI)$1.000.02%
  • nearNEAR Protocol(NEAR)$3.170.47%
  • bitcoin-cashBitcoin Cash(BCH)$206.89-0.52%
  • litecoinLitecoin(LTC)$44.25-1.34%
  • RainRain(RAIN)$0.004509-33.15%
  • CantonCanton(CC)$0.080502-2.10%
  • uniswapUniswap(UNI)$5.232.19%
  • avalanche-2Avalanche(AVAX)$7.05-1.42%
  • tether-goldTether Gold(XAUT)$3,837.30-0.30%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.050.84%
  • suiSui(SUI)$0.72-0.56%
  • USD1USD1(USD1)$1.000.03%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.02%
  • hedera-hashgraphHedera(HBAR)$0.056162-2.34%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.04%
  • paypal-usdPayPal USD(PYUSD)$1.000.01%
  • crypto-com-chainCronos(CRO)$0.0436101.56%
  • shiba-inuShiba Inu(SHIB)$0.000004-1.43%
  • BittensorBittensor(TAO)$189.870.42%
  • quant-networkQuant(QNT)$151.84-2.62%
  • MemeCoreMemeCore(M)$0.883.99%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.120.04%
  • okbOKB(OKB)$85.400.42%
  • pax-goldPAX Gold(PAXG)$3,841.45-0.24%
  • aaveAave(AAVE)$110.112.57%
  • Falcon USDFalcon USD(USDF)$1.00-0.04%
  • United StablesUnited Stables(U)$1.000.02%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Cerebras Puts Disaggregated Inference Into Production With GPUs – Unite.AI

November 17, 2026
in AI & Technology
Reading Time: 3 mins read
A A
Cerebras Puts Disaggregated Inference Into Production With GPUs – Unite.AI
ShareShareShareShareShare

Cerebras Systems reported on November 17, 2026, that its production disaggregated inference deployment, which assigns prompt processing to AMD Instinct GPUs and response generation to CS-3 systems, delivered five times the throughput per megawatt of a CS-3-only configuration without reducing token-generation speed.

YOU MAY ALSO LIKE

iCloud And Other Apple Services Are Down In An Apparent Outage

You.com Launches Extract API for Document Retrieval and PDF Parsing – Unite.AI

The result applies to Cerebras Inference Cloud. The measurement came from a shared GPT-OSS-120B endpoint on November 14, 2026, comparing throughput per megawatt before and after disaggregation was enabled and normalizing the aggregated configuration to a 1× baseline. Shifting prompt work to the GPUs leaves the CS-3 systems’ serving capacity available for generating responses, expanding the fast-inference capacity Cerebras can offer through its cloud.

The production disclosure follows Cerebras’ October 1, 2026 explanation of disaggregated inference, which reported a 5× gain in early tests with the same wafer-scale-engine footprint. The new announcement moves beyond that early result by supplying a production measurement and a deployment package for infrastructure partners.

Why Cerebras Separates Prefill and Decode

Each inference request has two principal stages. Prefill processes the input prompt and creates intermediate model state; decode uses that state to produce output tokens one at a time, feeding each new token back into the model. Because every decode step reads model data from memory again, memory bandwidth is central to interactive generation speed. Prefill instead performs more computation across the prompt in parallel, making it a better match for accelerators suited to that compute load.

Cerebras’ wafer-scale systems place model data in on-chip SRAM rather than relying primarily on off-chip high-bandwidth memory. Cerebras describes its wafer-scale chip as carrying tens of gigabytes of SRAM and tens of petabytes per second of memory bandwidth—350× the SRAM capacity and 5,400× the memory bandwidth of a typical GB300 GPU. That capacity allows more concurrent requests and model layers to remain directly on the chip for rapid decode.

The economic target is more customer-serving capacity and revenue potential from the same power budget in power-constrained data centers. Cerebras cites Muse, Copilot and Codex as examples of rapidly scaling agentic applications that require highly interactive responses, so the capacity increase must preserve generation speed to be useful for those workloads.

Deployment Architecture and Software

Infrastructure partners can use a Cerebras-provided reference architecture to co-locate their chosen prefill accelerators and Cerebras systems on a unified network. They then have two integration routes: an end-to-end software stack intended to shorten time to market, or a decode-only SDK for partners that want more control.

The full stack routes requests between prefill and decode pools and manages replica capacity and health. Its prefill engine can run open-source inference engines such as vLLM or SGLang, while Cerebras supplies the decode engine. KV Portal transfers intermediate model state between the two engines over RDMA, including the key-value caches that preserve request-specific context after prefill.

With the decode-only option, partners retain their own inference framework and prefill engine while using Cerebras’ decode engine and KV Portal. The SDK also includes a mock decode replica and a reference integration with an open-source disaggregated inference framework and prefill engine. Amazon Web Services, Fireworks AI, Gimlet Labs and General Compute are named as early-access partners, and Cerebras is expanding access to additional partners.

Capacity Target

Cerebras plans to deploy disaggregated inference broadly across hundreds of megawatts in its own inference cloud and partner deployments by the end of 2027. That is a deployment target, not capacity already operating.

The announcement therefore combines a measured cloud configuration with a software path for outside operators. The central scaling question is whether the throughput advantage measured on one shared endpoint can be reproduced across partners’ chosen accelerators, frameworks and deployment sizes as Cerebras pursues that broader rollout.

Credit: Source link

ShareTweetSendSharePin

Related Posts

iCloud And Other Apple Services Are Down In An Apparent Outage
AI & Technology

iCloud And Other Apple Services Are Down In An Apparent Outage

November 17, 2026
You.com Launches Extract API for Document Retrieval and PDF Parsing – Unite.AI
AI & Technology

You.com Launches Extract API for Document Retrieval and PDF Parsing – Unite.AI

November 17, 2026
NVIDIA Establishes Export Control Committee Following Jensen Huang Resignation
AI & Technology

NVIDIA Establishes Export Control Committee Following Jensen Huang Resignation

November 17, 2026
5 Important Bose Headphone Settings That Need To Be Manually Turned On
AI & Technology

5 Important Bose Headphone Settings That Need To Be Manually Turned On

November 17, 2026
Next Post
Focus group: Supporters of losing primary candidates in Michigan & Texas weigh general election vote

Focus group: Supporters of losing primary candidates in Michigan & Texas weigh general election vote

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
This AI Stock Beat NVIDIA. Why I Skipped it

This AI Stock Beat NVIDIA. Why I Skipped it

November 11, 2026
Wolters Kluwer Agrees to Buy Clinical AI Company AgileMD – Unite.AI

Wolters Kluwer Agrees to Buy Clinical AI Company AgileMD – Unite.AI

November 13, 2026
Indiana early voting shows substantial lead for Democrats

Indiana early voting shows substantial lead for Democrats

November 11, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!