• bitcoinBitcoin(BTC)$64,817.00-0.24%
  • ethereumEthereum(ETH)$1,813.59-0.60%
  • tetherTether(USDT)$1.00-0.03%
  • binancecoinBNB(BNB)$589.63-0.42%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.95-0.29%
  • solanaSolana(SOL)$71.03-0.77%
  • tronTRON(TRX)$0.3060490.36%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.050.00%
  • HyperliquidHyperliquid(HYPE)$67.190.18%
  • zcashZcash(ZEC)$888.76-1.55%
  • moneroMonero(XMR)$495.81-0.75%
  • dogecoinDogecoin(DOGE)$0.0591270.33%
  • USDSUSDS(USDS)$1.000.01%
  • leo-tokenLEO Token(LEO)$9.160.11%
  • whitebitWhiteBIT Coin(WBT)$62.60-0.46%
  • chainlinkChainlink(LINK)$9.16-0.84%
  • cardanoCardano(ADA)$0.152782-1.03%
  • stellarStellar(XLM)$0.137204-1.44%
  • Ethena USDeEthena USDe(USDE)$1.000.00%
  • RainRain(RAIN)$0.00672679.93%
  • daiDai(DAI)$1.000.02%
  • bitcoin-cashBitcoin Cash(BCH)$207.28-0.73%
  • nearNEAR Protocol(NEAR)$3.15-0.22%
  • litecoinLitecoin(LTC)$44.71-1.32%
  • CantonCanton(CC)$0.082183-1.13%
  • avalanche-2Avalanche(AVAX)$7.12-1.55%
  • tether-goldTether Gold(XAUT)$3,843.960.35%
  • uniswapUniswap(UNI)$5.08-1.92%
  • USD1USD1(USD1)$1.000.02%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.04-0.76%
  • suiSui(SUI)$0.72-0.81%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.01%
  • hedera-hashgraphHedera(HBAR)$0.057330-2.37%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.04%
  • paypal-usdPayPal USD(PYUSD)$1.00-0.01%
  • shiba-inuShiba Inu(SHIB)$0.000004-1.81%
  • quant-networkQuant(QNT)$155.880.53%
  • crypto-com-chainCronos(CRO)$0.042972-0.33%
  • BittensorBittensor(TAO)$188.65-1.68%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.25%
  • MemeCoreMemeCore(M)$0.841.26%
  • okbOKB(OKB)$85.00-3.36%
  • pax-goldPAX Gold(PAXG)$3,845.130.23%
  • aaveAave(AAVE)$106.79-1.31%
  • Falcon USDFalcon USD(USDF)$1.000.01%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
  • pepePepe(PEPE)$0.000004-0.84%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

SaySelf: A Machine Learning Training Framework That Teaches LLMs To Express More Accurate Fine-Grained Confidence Estimates

June 7, 2024
in AI & Technology
Reading Time: 4 mins read
A A
SaySelf: A Machine Learning Training Framework That Teaches LLMs To Express More Accurate Fine-Grained Confidence Estimates
ShareShareShareShareShare

Language Learning Models (LLMs), which are very good at reasoning and coming up with good answers, are sometimes honest about their mistakes and tend to hallucinate when asked questions they haven’t seen before. When the responses are more than just one token, it becomes much more important to determine how to get trustworthy confidence estimations from LLMs.

Both training-based and prompting-based approaches have been used in the past to elicit confidence from LLMs. Prompting-based approaches, for instance, use specific prompts to create confidence ratings or answer consistency as a confidence indication. To train LLMs to be confident, training-based methods create tailored datasets for tuning. However, these techniques frequently yield less-than-ideal or simplistic confidence estimates, which do not faithfully represent the models’ degrees of certainty.

A new study by Purdue University, University of Illinois Urbana-Champaign, University of Southern California, and The Hong Kong University of Science and Technology introduce SaySelf, a training framework for LLMs that helps them produce confidence estimations with increased precision and accuracy. Significantly, unlike earlier work, SaySelf allows LLMs to provide self-reflective rationales that show where they lack knowledge and explain their confidence estimates. To achieve this, the researchers use a pre-made LLM (like GPT4) to automatically generate a dataset tailored to the model, which can then be used for supervised fine-tuning. They take a random sample of several reasoning chains, which are sequences of tokens that represent the LLM’s thought process, from LLMs for every query. After that, the reasoning chains are grouped into clusters according to their semantic similarity, and one example is kept from each grouping.

From a first-person viewpoint, GPT-4 is asked to examine the cases chosen from different clusters and to summarize the uncertainty about specific knowledge in plain language. The researchers calibrate the confidence estimate of LLMs in each response using reinforcement learning to ensure accurate confidence estimations. They devise a payment system that discourages LLMs from making overconfident predictions and punishes them when they get it wrong. Various knowledge-extensive question-answering tasks, such as complex medical diagnoses or legal case analysis, are used to assess SaySelf in this study’s experiments. The study demonstrates that SaySelf maintains task performance while drastically lowering confidence calibration errors. Further improvement of calibration performance is possible with the developed self-reflective rationales, which also successfully capture the internal uncertainty.

The following examples are incomplete regarding how this work could impact relevant scholarly investigations and practical applications: (1) From the standpoint of LLMs’ alignment, AI can benefit from a transparent confidence statement that includes explanations. (2) LLMs can improve their interaction and performance by following the self-reflective rationales to execute further activities, such as requesting external tools or asking clarification inquiries. 

Upon completion of the SaySelf training process, the team hopes to see encouraging advances in training procedures, such as proactive learning algorithms that improve the learning outcomes of LLMs through their interactions with people. 


Check out the Paper. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter. Join our Telegram Channel, Discord Channel, and LinkedIn Group.

If you like our work, you will love our newsletter..

Don’t Forget to join our 43k+ ML SubReddit | Also, check out our AI Events Platform


YOU MAY ALSO LIKE

League Launches Healthcare AI Agents With Safety Controls – Unite.AI

You Won’t Find Nothing Phones At US Carriers, But Here’s How You Can Still Buy Them

Dhanshree Shenwai is a Computer Science Engineer and has a good experience in FinTech companies covering Financial, Cards & Payments and Banking domain with keen interest in applications of AI. She is enthusiastic about exploring new technologies and advancements in today’s evolving world making everyone’s life easy.


🐝 Join the Fastest Growing AI Research Newsletter Read by Researchers from Google + NVIDIA + Meta + Stanford + MIT + Microsoft and many others…


Credit: Source link

ShareTweetSendSharePin

Related Posts

League Launches Healthcare AI Agents With Safety Controls – Unite.AI
AI & Technology

League Launches Healthcare AI Agents With Safety Controls – Unite.AI

November 16, 2026
You Won’t Find Nothing Phones At US Carriers, But Here’s How You Can Still Buy Them
AI & Technology

You Won’t Find Nothing Phones At US Carriers, But Here’s How You Can Still Buy Them

November 16, 2026
Alecto Raises  Million to Build an AI-Native Consumer Law Firm – Unite.AI
AI & Technology

Alecto Raises $20 Million to Build an AI-Native Consumer Law Firm – Unite.AI

November 16, 2026
Why Microsoft Is Ditching A Few Of Its 365 Companion Apps In 2026
AI & Technology

Why Microsoft Is Ditching A Few Of Its 365 Companion Apps In 2026

November 16, 2026
Next Post
Law enforcement officers dress as Santa and Grinch

Law enforcement officers dress as Santa and Grinch

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
How Anthropic’s IPO Could Unleash a New Wave of Venture Capital

How Anthropic’s IPO Could Unleash a New Wave of Venture Capital

November 15, 2026
Piece of Learjet tail found miles from site of deadly crash

Piece of Learjet tail found miles from site of deadly crash

November 9, 2026
Nvidia’s France Pledges Remain Intact: Varza

Nvidia’s France Pledges Remain Intact: Varza

November 15, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!