• bitcoinBitcoin(BTC)$65,182.002.04%
  • ethereumEthereum(ETH)$1,831.303.98%
  • tetherTether(USDT)$1.000.01%
  • binancecoinBNB(BNB)$595.922.76%
  • usd-coinUSDC(USDC)$1.000.00%
  • rippleXRP(XRP)$0.976.24%
  • solanaSolana(SOL)$72.513.73%
  • tronTRON(TRX)$0.304940-0.61%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.060.66%
  • HyperliquidHyperliquid(HYPE)$67.836.03%
  • zcashZcash(ZEC)$911.476.76%
  • moneroMonero(XMR)$499.716.86%
  • dogecoinDogecoin(DOGE)$0.0597014.70%
  • USDSUSDS(USDS)$1.000.03%
  • leo-tokenLEO Token(LEO)$9.210.94%
  • whitebitWhiteBIT Coin(WBT)$63.121.82%
  • chainlinkChainlink(LINK)$9.285.11%
  • cardanoCardano(ADA)$0.1551075.71%
  • stellarStellar(XLM)$0.1412824.68%
  • Ethena USDeEthena USDe(USDE)$1.000.00%
  • daiDai(DAI)$1.000.01%
  • bitcoin-cashBitcoin Cash(BCH)$210.475.26%
  • nearNEAR Protocol(NEAR)$3.206.04%
  • litecoinLitecoin(LTC)$45.452.66%
  • CantonCanton(CC)$0.08520611.40%
  • avalanche-2Avalanche(AVAX)$7.293.30%
  • uniswapUniswap(UNI)$5.176.73%
  • tether-goldTether Gold(XAUT)$3,875.731.76%
  • USD1USD1(USD1)$1.000.03%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.072.90%
  • suiSui(SUI)$0.745.55%
  • Ripple USDRipple USD(RLUSD)$1.00-0.01%
  • Global DollarGlobal Dollar(USDG)$1.00-0.02%
  • paypal-usdPayPal USD(PYUSD)$1.000.03%
  • hedera-hashgraphHedera(HBAR)$0.0592215.72%
  • RainRain(RAIN)$0.003487-3.25%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.15-0.02%
  • shiba-inuShiba Inu(SHIB)$0.0000043.44%
  • quant-networkQuant(QNT)$157.6510.49%
  • BittensorBittensor(TAO)$194.586.50%
  • crypto-com-chainCronos(CRO)$0.0435250.74%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.120.01%
  • MemeCoreMemeCore(M)$0.843.40%
  • okbOKB(OKB)$88.524.19%
  • pax-goldPAX Gold(PAXG)$3,880.871.96%
  • aaveAave(AAVE)$109.7710.12%
  • Falcon USDFalcon USD(USDF)$1.000.15%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
  • United StablesUnited Stables(U)$1.000.01%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Together AI promises faster inference and lower costs with enterprise AI platform for private cloud

September 23, 2024
in AI & Technology
Reading Time: 3 mins read
A A
Together AI promises faster inference and lower costs with enterprise AI platform for private cloud
ShareShareShareShareShare

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Running AI in the public cloud can presents enterprises with numerous concerns about data privacy and security.

YOU MAY ALSO LIKE

Samsung Is Discontinuing These Useful Mobile Apps In December

What’s The Meaning Of The “A” On Your USB-A Ports?

That’s why some enterprises will choose to deploy AI on a private cloud or on-premises environment. Together AI is among the vendors looking to solve the challenges of effectively enabling enterprises to deploy AI in private clouds in a cost effective approach. The company today announced its Together Enterprise Platform, enabling AI deployment in virtual private cloud (VPC) and on-premises environments.

Together AI made its debut in 2023, aiming to simplify enterprise use of open-source LLMs. The company already has a full-stack platform to enable enterprises to easily use open source LLMs on its own cloud service. The new platform extends AI deployment to customer-controlled cloud and on-premises environments. The Together Enterprise Platform aims to address key concerns of businesses adopting AI technologies, including performance, cost-efficiency and data privacy.

“As you’re scaling up AI workloads, efficiency and cost matters to companies, they also really care about data privacy,” Vipul Prakash, CEO of Together AI told VentureBeat. “Inside of enterprises there are also well-established privacy and compliance policies, which are already implemented in their own cloud setups and companies also care about model ownership.”

How to keep private cloud enterprise AI cost down with Together AI

The key promise of the Together Enterprise Platform is that organizations can manage and run AI models in their own private cloud deployment.

This adaptability is crucial for enterprises that have already invested heavily in their IT infrastructure. The platform offers flexibility by working in private clouds and enabling users to scale to Together’s cloud.

A key benefit of the Together Enterprise platform is its ability to dramatically improve the performance of AI inference workloads. 

“We are often able to improve the performance of inference by two to three times and reduce the amount of hardware they’re using to do inference by 50%,” Prakash said. “This creates significant savings and more capacity for enterprises to build more products, build more models, and launch more features.” 

The performance gains are achieved through a combination of optimized software and hardware utilization.

 “There’s a lot of algorithmic craft in how we schedule and organize the computation on GPUs to get the maximum utilization and lowest latency,” Prakash explained. “We do a lot of work on speculative decoding, which uses a small model to predict what the larger model would generate, reducing the workload on the more computationally intensive model.”

Flexible model orchestration and the Mixture of Agents approach

Another key feature of the Together Enterprise platform is its ability to orchestrate the use of multiple AI models within a single application or workflow. 

“What we’re seeing in enterprises is that they’re typically using a combination of different models – open-source models, custom models, and models from different sources,” Prakash said. “The Together platform allows this orchestration of all this work, scaling the models up and down depending on the demand for a particular feature at a particular time.”

There are many different ways that an organization can orchestrate models to work together. Some organizations and vendors will use technologies like LangChain to combine models together. Another approach is to use a model router, like the one built by Martian, to route queries to the best model. SambaNova uses a Composition of Experts model, combining multiple models for optimal outcomes.

Together AI is using a different approach that it calls – Mixture of Agents. Prakash said this approach combines multi-model agentic AI with a trainable system for ongoing improvement. The way it works is by using “weaker” models as “proposers” – they each provide a response to the prompt. Then an “aggregator” model is used to combine these responses in a way that produces a better overall answer.

“We are a computational and inference platform and agentic AI workflows are very interesting to us,” he said. “You’ll be seeing more stuff from Together AI on what we’re doing around it in the months to come.”

VB Daily

Stay in the know! Get the latest news in your inbox daily

By subscribing, you agree to VentureBeat’s Terms of Service.

Thanks for subscribing. Check out more VB newsletters here.

An error occured.

Credit: Source link
ShareTweetSendSharePin

Related Posts

Samsung Is Discontinuing These Useful Mobile Apps In December
AI & Technology

Samsung Is Discontinuing These Useful Mobile Apps In December

November 15, 2026
What’s The Meaning Of The “A” On Your USB-A Ports?
AI & Technology

What’s The Meaning Of The “A” On Your USB-A Ports?

November 15, 2026
Which Is Actually Better For Your Ears?
AI & Technology

Which Is Actually Better For Your Ears?

November 15, 2026
Anthropic Targets .4 Trillion Valuation in Blockbuster IPO
AI & Technology

Anthropic Targets $1.4 Trillion Valuation in Blockbuster IPO

November 15, 2026
Next Post
Far-right party tipped to win state elections in east Germany

Far-right party tipped to win state elections in east Germany

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Deadly helicopter crash in Florida

Deadly helicopter crash in Florida

November 9, 2026
Halloween weekend shootings nationwide

Halloween weekend shootings nationwide

November 12, 2026
Best Credit Cards for Black Friday & Holiday Shopping – Pick by Where You Shop

Best Credit Cards for Black Friday & Holiday Shopping – Pick by Where You Shop

November 13, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!