• bitcoinBitcoin(BTC)$64,959.00-0.02%
  • ethereumEthereum(ETH)$1,831.140.43%
  • tetherTether(USDT)$1.00-0.02%
  • binancecoinBNB(BNB)$593.910.27%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.970.50%
  • solanaSolana(SOL)$72.811.24%
  • tronTRON(TRX)$0.3048430.19%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.040.00%
  • HyperliquidHyperliquid(HYPE)$70.235.75%
  • zcashZcash(ZEC)$922.353.11%
  • dogecoinDogecoin(DOGE)$0.0592730.58%
  • moneroMonero(XMR)$492.440.40%
  • leo-tokenLEO Token(LEO)$9.281.41%
  • USDSUSDS(USDS)$1.000.08%
  • whitebitWhiteBIT Coin(WBT)$62.84-0.17%
  • chainlinkChainlink(LINK)$9.200.05%
  • cardanoCardano(ADA)$0.1543680.29%
  • stellarStellar(XLM)$0.139330-0.21%
  • Ethena USDeEthena USDe(USDE)$1.00-0.02%
  • RainRain(RAIN)$0.00660590.49%
  • daiDai(DAI)$1.000.00%
  • nearNEAR Protocol(NEAR)$3.262.29%
  • bitcoin-cashBitcoin Cash(BCH)$209.250.45%
  • litecoinLitecoin(LTC)$44.930.29%
  • CantonCanton(CC)$0.082603-1.14%
  • avalanche-2Avalanche(AVAX)$7.17-0.55%
  • uniswapUniswap(UNI)$5.261.26%
  • tether-goldTether Gold(XAUT)$3,853.59-0.11%
  • suiSui(SUI)$0.73-0.08%
  • USD1USD1(USD1)$1.00-0.02%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.04-2.10%
  • Ripple USDRipple USD(RLUSD)$1.00-0.02%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • hedera-hashgraphHedera(HBAR)$0.057514-2.38%
  • paypal-usdPayPal USD(PYUSD)$1.000.04%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.08%
  • crypto-com-chainCronos(CRO)$0.0441763.01%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.69%
  • BittensorBittensor(TAO)$193.490.73%
  • quant-networkQuant(QNT)$153.73-1.11%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • MemeCoreMemeCore(M)$0.875.06%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.09%
  • okbOKB(OKB)$86.60-0.24%
  • aaveAave(AAVE)$112.202.92%
  • pax-goldPAX Gold(PAXG)$3,855.30-0.14%
  • pepePepe(PEPE)$0.0000043.44%
  • Falcon USDFalcon USD(USDF)$1.000.03%
  • United StablesUnited Stables(U)$1.000.02%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI

November 17, 2026
in AI & Technology
Reading Time: 3 mins read
A A
MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI
ShareShareShareShareShare

MiTAC Computing unveiled a two-server AI inference architecture with Skymizer at SC26 in a November 17, 2026 announcement, proposing 2 TB of decode-side accelerator memory for a system designed to run models such as the 2.8-trillion-parameter Kimi K3 on premises.

YOU MAY ALSO LIKE

Buying A Used Phone? Make Sure To Check The IMEI First

Sabre Announces Grok Bot Travel Connector and Proactive Agentic APIs – Unite.AI

The architecture is part of a wider portfolio spanning software orchestration, high-density liquid cooling, storage and an upcoming AMD rack. Some supporting systems are being demonstrated live at SC26, while others remain proposed or in development, making the announcement a mix of current demonstrations and future infrastructure designs.

Separate Servers for Prefill and Decode

The proposed prefill platform is the 8U G8825Z5, using AMD EPYC 9575F or 9755 processors and Instinct MI350X GPUs. It would transfer the resulting key-value cache to the decode server over high-speed networking. For decode, the proposed air-cooled 4U G4520G6 configuration combines Intel Xeon 6 processors with eight Skymizer HTX301-4S accelerator cards, each carrying 256 GB of memory.

Prefill is the compute-intensive stage, while decode is memory-intensive, so separating them is intended to let enterprises provision each for its own workload. MiTAC says the on-premises decode system is designed for complex, deep-reasoning agentic workloads. The architecture shifts part of the scaling problem from adding GPUs to balancing accelerator memory with the network connection between stages.

Live Cooling and Data Density at SC26

MiTAC’s live demonstrations address the physical demands around that inference design. A 52U liquid-cooled rack integrates 12 G4826Z5 servers and 96 AMD Instinct MI355X GPUs, a configuration the company says delivers 50% higher GPU density than conventional deployments.

A proof of concept with ZutaCore uses waterless two-phase direct liquid cooling on the G4826Z5, vaporizing dielectric fluid directly at the chip. MiTAC reports support for thermal design powers above 4,000W, heat flux above 250W/cm² and an annualized partial power usage effectiveness of 1.03. The demonstration targets the thermal limits created by concentrating high-power accelerators inside dense racks.

The storage demonstration combines DDN Infinia with seven GC68C-B8056 1U storage servers and is designed to supply continuous AI data streams without I/O bottlenecks. That addresses a different constraint from cooling: reducing the risk that accelerators wait for data instead of processing inference and agent workloads.

Software and the Upcoming Helion Rack

Canonical Ubuntu supplies the certified operating-system layer, Rafay adds dynamic GPU-as-a-Service orchestration across distributed workloads, and MiTAC’s MiCoreView software provides pod-level telemetry and unified data-center visibility. Together with Infinia, those components cover operating systems, data delivery, GPU allocation and monitoring within the same infrastructure stack.

MiTAC is also collaborating with AMD on an upcoming ORv3 44OU Helion Agentic AI Rack. MiTAC says it will scale to 32,768 AMD Zen 6 CPU cores for hyperscale and enterprise environments.

AMD’s Helion documentation describes an open rack-scale reference design built on Open Compute Project (OCP) standards, with CPU-only hyperscale configurations and enterprise versions that mix CPU and GPU blades. Its air-cooled inference version supports up to 16 Instinct MI350P GPUs, and customers can mix blade types to match different agent workloads. The enterprise configuration is intended to combine agent execution and inference in one rack, unlike Helios, which is built for frontier-scale training and large-scale inference with a unified scale-up GPU domain.

The practical implication is that deployable on-premises inference depends on the decode memory working in concert with the prefill network, storage throughput, rack cooling and orchestration; MiTAC’s proposal makes those connections part of the capacity calculation alongside the GPUs themselves.

Credit: Source link

ShareTweetSendSharePin

Related Posts

Buying A Used Phone? Make Sure To Check The IMEI First
AI & Technology

Buying A Used Phone? Make Sure To Check The IMEI First

November 17, 2026
Sabre Announces Grok Bot Travel Connector and Proactive Agentic APIs – Unite.AI
AI & Technology

Sabre Announces Grok Bot Travel Connector and Proactive Agentic APIs – Unite.AI

November 17, 2026
Meta Is Testing Direct, A Standalone Messaging App For Instagram
AI & Technology

Meta Is Testing Direct, A Standalone Messaging App For Instagram

November 17, 2026
GoMirra Combines 18 AI Companions With Persistent Memory and Multiple Perspectives – Unite.AI
AI & Technology

GoMirra Combines 18 AI Companions With Persistent Memory and Multiple Perspectives – Unite.AI

November 16, 2026
Next Post
Kornacki: Where Democrats see openings for Senate gains in deep-red states

Kornacki: Where Democrats see openings for Senate gains in deep-red states

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Stock Market Today: Oil Prices Fall to  a Barrel on Trump Iran Comments; Investors Await CPI Report – WSJ

Stock Market Today: Oil Prices Fall to $90 a Barrel on Trump Iran Comments; Investors Await CPI Report – WSJ

November 10, 2026
Brazil’s Flavio Bolsonaro lands in Miami after refusing to surrender his passports

Brazil’s Flavio Bolsonaro lands in Miami after refusing to surrender his passports

November 15, 2026
Meet the Press NOW — November 3

Meet the Press NOW — November 3

November 11, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!