• bitcoinBitcoin(BTC)$64,706.00-0.56%
  • ethereumEthereum(ETH)$1,817.84-0.51%
  • tetherTether(USDT)$1.00-0.04%
  • binancecoinBNB(BNB)$590.42-0.77%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.95-1.42%
  • solanaSolana(SOL)$71.58-1.01%
  • tronTRON(TRX)$0.3049960.15%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.040.00%
  • HyperliquidHyperliquid(HYPE)$69.392.76%
  • zcashZcash(ZEC)$902.89-0.39%
  • moneroMonero(XMR)$492.67-1.30%
  • dogecoinDogecoin(DOGE)$0.058894-1.16%
  • USDSUSDS(USDS)$1.000.01%
  • leo-tokenLEO Token(LEO)$9.16-0.08%
  • whitebitWhiteBIT Coin(WBT)$62.54-0.73%
  • chainlinkChainlink(LINK)$9.12-1.36%
  • cardanoCardano(ADA)$0.153213-1.04%
  • stellarStellar(XLM)$0.137701-2.30%
  • Ethena USDeEthena USDe(USDE)$1.00-0.03%
  • daiDai(DAI)$1.000.02%
  • RainRain(RAIN)$0.00617678.40%
  • bitcoin-cashBitcoin Cash(BCH)$208.31-0.71%
  • nearNEAR Protocol(NEAR)$3.16-0.95%
  • litecoinLitecoin(LTC)$44.46-1.89%
  • CantonCanton(CC)$0.082148-3.45%
  • avalanche-2Avalanche(AVAX)$7.10-2.32%
  • uniswapUniswap(UNI)$5.180.34%
  • tether-goldTether Gold(XAUT)$3,844.78-0.73%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.05-1.74%
  • USD1USD1(USD1)$1.000.01%
  • suiSui(SUI)$0.72-1.94%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.057133-3.65%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.19%
  • paypal-usdPayPal USD(PYUSD)$1.000.00%
  • shiba-inuShiba Inu(SHIB)$0.000004-2.12%
  • crypto-com-chainCronos(CRO)$0.043326-0.11%
  • BittensorBittensor(TAO)$191.50-1.14%
  • quant-networkQuant(QNT)$153.81-1.91%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • MemeCoreMemeCore(M)$0.852.37%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.22%
  • okbOKB(OKB)$85.76-2.86%
  • pax-goldPAX Gold(PAXG)$3,846.25-0.81%
  • aaveAave(AAVE)$108.64-0.69%
  • Falcon USDFalcon USD(USDF)$1.000.01%
  • pepePepe(PEPE)$0.0000041.31%
  • United StablesUnited Stables(U)$1.00-0.02%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Microsoft Researchers Propose a Novel Framework for LLM Calibration Using Pareto Optimal Self-Supervision without Using Labeled Training Data

July 3, 2023
in AI & Technology
Reading Time: 4 mins read
A A
Microsoft Researchers Propose a Novel Framework for LLM Calibration Using Pareto Optimal Self-Supervision without Using Labeled Training Data
ShareShareShareShareShare

Recent developments have seen a remarkable increase in the capability of large language models (LLMs), with generative pretrained transformer (GPT) models showing significant promise. The transition from GPT-3 to GPT-4, as well as the appearance of other LLMs like PaLM and LLaMA, demonstrated a considerable improvement in problem-solving and natural language understanding skills. Additionally, generative models are frequently used in a variety of sectors to generate data for different applications. When LLMs are used in applications that need a high level of accuracy and dependability, like the biological and healthcare areas, the problem of hallucination remains a significant barrier. 

Unfortunately, there are no systematic techniques available to accurately detect hallucinations or gauge the output’s level of confidence. Particularly after using reinforcement learning with human input, the intrinsic confidence score from the generative LLMs is sometimes unavailable or not effectively calibrated with regard to the intended aim. Heuristic techniques are costly to compute and are subject to bias from the LLM itself, such as sampling an ensemble of LLM answers. There are two basic categories of methods for evaluating the degree of confidence in LLM replies. In the first, the LLM is prodded in a variety of ways to create many replies, which are then used to infer the answer’s dependability.

Self-consistency and chain-of-thought prompting are two examples. These techniques are less quantitative and susceptible to model-induced bias in the estimated confidence. There is no standardised way to measure this, but the prompting technique may have a significant impact on the quality of the outcomes. The second category of options turns to outside sources of data, such as hiring human reviewers to verify the answer or using huge amounts of labeled data to create assessment models. One of the primary obstacles to current supervised model training is the extensive manual annotation work that these techniques necessitate. In that regard, self-supervision offers a viable option since it can adaptably use data patterns and outside-the-box expertise. 

🔥 Join The Fastest Growing ML Subreddit

Researchers from Microsoft in this study provide a flexible framework that uses Pareto optimum learning to mix data from both the LLM response and supervision sources. They were motivated by earlier efforts in programmatic supervision and the wealth of Pareto optimization research. The following intuitions guide their strategy. In order to prevent bias from an LLM judging itself, external sources of supervision that are independent of the LLM are required. Second, think of the LLM errors as noisy perturbations on the gold labels. When a model is fitted with both LLM noise and independent external noise, implicit label smoothing is actually performed, which enhances calibration power. 

In that regard, Pareto optimum self-supervision provides a useful framework for integrating both qualities. Notably, the suggested method just needs unlabeled data, making it appropriate for fields where annotation is costly. Their unique approach to LLM calibration by Pareto optimum self-supervision is the paper’s key innovation. They suggest using the Pareto Optimum Learning assessed risk (POLAR) score to calculate the likelihood of LLM mistakes. They present experimental findings on four distinct NLP tasks and demonstrate that the suggested POLAR score is substantially linked with the LLM error rate assessed on gold labels. They show enhanced LLM performance for high-risk situations as determined by the POLAR score utilizing dynamic prompting strategies. Without utilizing any human-labeled training data, they demonstrate how their method can remove LLM mistakes and improve a GPT-4 baseline performance to exceed the most advanced supervised model.


Check Out the Paper. Don’t forget to join our 25k+ ML SubReddit, Discord Channel, Twitter, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more. If you have any questions regarding the above article or if we missed anything, feel free to email us at [email protected]


Featured Tools:

🚀 Check Out 100’s AI Tools in AI Tools Club


YOU MAY ALSO LIKE

GoMirra Combines 18 AI Companions With Persistent Memory and Multiple Perspectives – Unite.AI

United Airlines Is Experiencing A ‘Widespread System Outage’

Aneesh Tickoo is a consulting intern at MarktechPost. He is currently pursuing his undergraduate degree in Data Science and Artificial Intelligence from the Indian Institute of Technology(IIT), Bhilai. He spends most of his time working on projects aimed at harnessing the power of machine learning. His research interest is image processing and is passionate about building solutions around it. He loves to connect with people and collaborate on interesting projects.


🔥 StoryBird.ai just dropped some amazing features. Generate an illustrated story from a prompt. Check it out here. (Sponsored)


Credit: Source link

ShareTweetSendSharePin

Related Posts

GoMirra Combines 18 AI Companions With Persistent Memory and Multiple Perspectives – Unite.AI
AI & Technology

GoMirra Combines 18 AI Companions With Persistent Memory and Multiple Perspectives – Unite.AI

November 16, 2026
United Airlines Is Experiencing A ‘Widespread System Outage’
AI & Technology

United Airlines Is Experiencing A ‘Widespread System Outage’

November 16, 2026
Cerebras Releases Tungsten for High-Level Wafer-Scale Programming – Unite.AI
AI & Technology

Cerebras Releases Tungsten for High-Level Wafer-Scale Programming – Unite.AI

November 16, 2026
California Sues OpenAI After That Hugging Face Rogue Hacking Incident
AI & Technology

California Sues OpenAI After That Hugging Face Rogue Hacking Incident

November 16, 2026
Next Post
Nikola Chairman Says GM Deal Is Good for Everyone

Nikola Chairman Says GM Deal Is Good for Everyone

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
ALERT: Jensen Huang Returns As NVIDIA CEO?

ALERT: Jensen Huang Returns As NVIDIA CEO?

November 16, 2026
Westchester County voters face paper ballot issues

Westchester County voters face paper ballot issues

November 11, 2026
The Best-Selling Game Console Of All Time Is Over 25 Years Old

The Best-Selling Game Console Of All Time Is Over 25 Years Old

November 10, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!