• bitcoinBitcoin(BTC)$64,959.00-0.02%
  • ethereumEthereum(ETH)$1,831.140.43%
  • tetherTether(USDT)$1.00-0.02%
  • binancecoinBNB(BNB)$593.910.27%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.970.50%
  • solanaSolana(SOL)$72.811.24%
  • tronTRON(TRX)$0.3048430.19%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.040.00%
  • HyperliquidHyperliquid(HYPE)$70.235.75%
  • zcashZcash(ZEC)$922.353.11%
  • dogecoinDogecoin(DOGE)$0.0592730.58%
  • moneroMonero(XMR)$492.440.40%
  • leo-tokenLEO Token(LEO)$9.281.41%
  • USDSUSDS(USDS)$1.000.08%
  • whitebitWhiteBIT Coin(WBT)$62.84-0.17%
  • chainlinkChainlink(LINK)$9.200.05%
  • cardanoCardano(ADA)$0.1543680.29%
  • stellarStellar(XLM)$0.139330-0.21%
  • Ethena USDeEthena USDe(USDE)$1.00-0.02%
  • RainRain(RAIN)$0.00660590.49%
  • daiDai(DAI)$1.000.00%
  • nearNEAR Protocol(NEAR)$3.262.29%
  • bitcoin-cashBitcoin Cash(BCH)$209.250.45%
  • litecoinLitecoin(LTC)$44.930.29%
  • CantonCanton(CC)$0.082603-1.14%
  • avalanche-2Avalanche(AVAX)$7.17-0.55%
  • uniswapUniswap(UNI)$5.261.26%
  • tether-goldTether Gold(XAUT)$3,853.59-0.11%
  • suiSui(SUI)$0.73-0.08%
  • USD1USD1(USD1)$1.00-0.02%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.04-2.10%
  • Ripple USDRipple USD(RLUSD)$1.00-0.02%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • hedera-hashgraphHedera(HBAR)$0.057514-2.38%
  • paypal-usdPayPal USD(PYUSD)$1.000.04%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.08%
  • crypto-com-chainCronos(CRO)$0.0441763.01%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.69%
  • BittensorBittensor(TAO)$193.490.73%
  • quant-networkQuant(QNT)$153.73-1.11%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • MemeCoreMemeCore(M)$0.875.06%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.09%
  • okbOKB(OKB)$86.60-0.24%
  • aaveAave(AAVE)$112.202.92%
  • pax-goldPAX Gold(PAXG)$3,855.30-0.14%
  • pepePepe(PEPE)$0.0000043.44%
  • Falcon USDFalcon USD(USDF)$1.000.03%
  • United StablesUnited Stables(U)$1.000.02%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

TransFusion: An Artificial Intelligence AI Framework To Boost a Large Language Model’s Multilingual Instruction-Following Information Extraction Capability

June 30, 2024
in AI & Technology
Reading Time: 4 mins read
A A
TransFusion: An Artificial Intelligence AI Framework To Boost a Large Language Model’s Multilingual Instruction-Following Information Extraction Capability
ShareShareShareShareShare

Large Language Models (LLMs) have made significant advances in the field of Information Extraction (IE). Information extraction is a task in Natural Language Processing (NLP) that involves identifying and extracting specific pieces of information from text. LLMs have demonstrated great results in IE, especially when combined with instruction tuning. Through instruction tuning, these models are trained to annotate text according to predetermined standards, which improves their ability to generalize to new datasets. This indicates that even with unknown data, people are able to do IE tasks successfully by following instructions.

However, even with these improvements, LLMs still face many difficulties when working with low-resource languages. These languages lack both the unlabeled text required for pre-training and the labeled data required for fine-tuning models. Due to this lack of data, it is challenging for LLMs to attain good performance in these languages.

YOU MAY ALSO LIKE

MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI

Buying A Used Phone? Make Sure To Check The IMEI First

To overcome this, a team of researchers from the Georgia Institute of Technology has introduced the TransFusion framework. In TransFusion, models are adjusted to function with data translated from low-resource languages into English. With this method, the original low-resource language text and its English translation provide information that the models may use to create more accurate predictions.

This framework aims to effectively enhance IE in low-resource languages by utilizing external Machine Translation (MT) systems. There are three primary steps involved, which are as follows:

  1. Translation during Inference: Converting low-resource language data into English so that a high-resource model can annotate it.
  1. Fusion of Annotated Data: In a model trained to use both types of data, fusing the original low-resource language text with the annotated English translations.
  1. Constructing a TransFusion Reasoning Chain, which integrates both annotation and fusion into a single autoregressive decoding pass.

Expanding upon this structure, the team has also introduced GoLLIE-TF, which is an instruction-tuned LLM that is cross-lingual and tailored especially for Internet Explorer tasks. GoLLIE-TF aims to reduce the performance disparity between high- and low-resource languages. The combined goal of the TransFusion framework and GoLLIE-TF is to increase LLMs’ efficiency when handling low-resource languages.

Experiments on twelve multilingual IE datasets, with a total of fifty languages, have shown that GoLLIE-TF works well. In comparison to the basic model, the results demonstrate that GoLLIE-TF performs greater zero-shot cross-lingual transfer. This means that without further training data, it can more effectively apply its acquired skills to new languages.

TransFusion applied to proprietary models such as GPT-4 considerably improves the performance of low-resource language named entity recognition (NER). When prompting was used, GPT-4’s performance increased by 5 F1 points. Further improvements were obtained by fine-tuning various language model types using the TransFusion framework; decoder-only architectures improved by 14 F1 points, while encoder-only designs improved by 13 F1 points.

In conclusion, TransFusion and GoLLIE-TF together provide a potent solution for enhancing IE tasks in low-resource languages. This shows notable improvements across many models and datasets, helping to reduce the performance gap between high-resource and low-resource languages by utilizing English translations and fine-tuning models to fuse annotations.


Check out the Paper. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter. 

Join our Telegram Channel and LinkedIn Group.

If you like our work, you will love our newsletter..

Don’t Forget to join our 45k+ ML SubReddit


Tanya Malhotra is a final year undergrad from the University of Petroleum & Energy Studies, Dehradun, pursuing BTech in Computer Science Engineering with a specialization in Artificial Intelligence and Machine Learning.
She is a Data Science enthusiast with good analytical and critical thinking, along with an ardent interest in acquiring new skills, leading groups, and managing work in an organized manner.

🐝 Join the Fastest Growing AI Research Newsletter Read by Researchers from Google + NVIDIA + Meta + Stanford + MIT + Microsoft and many others…


Credit: Source link

ShareTweetSendSharePin

Related Posts

MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI
AI & Technology

MiTAC Proposes Two-Server AI Inference Architecture at SC26 – Unite.AI

November 17, 2026
Buying A Used Phone? Make Sure To Check The IMEI First
AI & Technology

Buying A Used Phone? Make Sure To Check The IMEI First

November 17, 2026
Sabre Announces Grok Bot Travel Connector and Proactive Agentic APIs – Unite.AI
AI & Technology

Sabre Announces Grok Bot Travel Connector and Proactive Agentic APIs – Unite.AI

November 17, 2026
Meta Is Testing Direct, A Standalone Messaging App For Instagram
AI & Technology

Meta Is Testing Direct, A Standalone Messaging App For Instagram

November 17, 2026
Next Post
France election 2024: Voting begins in first round of snap polls

France election 2024: Voting begins in first round of snap polls

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Jensen Huang Said to Have Had Relationship With Nvidia Executive Who Reports to Him – The New York Times

Jensen Huang Said to Have Had Relationship With Nvidia Executive Who Reports to Him – The New York Times

November 12, 2026
How voters’ opinions on the economy affected midterm elections

How voters’ opinions on the economy affected midterm elections

November 10, 2026
Microsoft says service is returning to normal, AI not to blame for ‘historic’ outage

Microsoft says service is returning to normal, AI not to blame for ‘historic’ outage

November 13, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!