• bitcoinBitcoin(BTC)$61,465.00-3.52%
  • ethereumEthereum(ETH)$1,736.32-3.67%
  • tetherTether(USDT)$1.00-0.01%
  • binancecoinBNB(BNB)$567.13-3.96%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.95-4.11%
  • solanaSolana(SOL)$71.10-4.79%
  • tronTRON(TRX)$0.306095-2.11%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.020.00%
  • HyperliquidHyperliquid(HYPE)$63.27-7.54%
  • zcashZcash(ZEC)$817.85-13.97%
  • dogecoinDogecoin(DOGE)$0.056551-4.93%
  • moneroMonero(XMR)$464.52-7.50%
  • leo-tokenLEO Token(LEO)$9.23-0.83%
  • whitebitWhiteBIT Coin(WBT)$59.58-3.54%
  • chainlinkChainlink(LINK)$8.73-5.25%
  • USDSUSDS(USDS)$1.000.00%
  • cardanoCardano(ADA)$0.146667-4.87%
  • Ethena USDeEthena USDe(USDE)$1.00-0.04%
  • stellarStellar(XLM)$0.131391-4.95%
  • daiDai(DAI)$1.000.02%
  • bitcoin-cashBitcoin Cash(BCH)$197.44-5.83%
  • nearNEAR Protocol(NEAR)$2.95-13.13%
  • litecoinLitecoin(LTC)$41.39-7.09%
  • CantonCanton(CC)$0.079453-4.36%
  • avalanche-2Avalanche(AVAX)$6.81-4.35%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.02-0.69%
  • USD1USD1(USD1)$1.00-0.02%
  • uniswapUniswap(UNI)$4.76-8.03%
  • tether-goldTether Gold(XAUT)$3,568.74-3.77%
  • suiSui(SUI)$0.68-6.33%
  • Ripple USDRipple USD(RLUSD)$1.00-0.01%
  • Global DollarGlobal Dollar(USDG)$1.00-0.01%
  • RainRain(RAIN)$0.003574-18.63%
  • paypal-usdPayPal USD(PYUSD)$1.000.00%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.15%
  • hedera-hashgraphHedera(HBAR)$0.053326-4.48%
  • BittensorBittensor(TAO)$184.81-6.73%
  • shiba-inuShiba Inu(SHIB)$0.000004-5.06%
  • crypto-com-chainCronos(CRO)$0.040718-2.79%
  • quant-networkQuant(QNT)$141.42-8.47%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.24%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • MemeCoreMemeCore(M)$0.87-0.90%
  • Falcon USDFalcon USD(USDF)$1.00-0.04%
  • okbOKB(OKB)$81.46-7.16%
  • United StablesUnited Stables(U)$1.000.01%
  • pax-goldPAX Gold(PAXG)$3,567.16-3.78%
  • aaveAave(AAVE)$101.88-7.08%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Tensoic AI Releases Kan-Llama: A 7B Llama-2 LoRA PreTrained and FineTuned on ‘Kannada’ Tokens

January 26, 2024
in AI & Technology
Reading Time: 3 mins read
A A
Tensoic AI Releases Kan-Llama: A 7B Llama-2 LoRA PreTrained and FineTuned on ‘Kannada’ Tokens
ShareShareShareShareShare

Tensoic has recently introduced Kannada Llama (Kan-LLaMA) to address the limitations of language models (LLMs), focusing specifically on proprietary characteristics, computational resources, and barriers to broader research community contributions. Emphasize the importance of open models using mouth to facilitate innovation in natural language processing (NLP) and machine translation with emphasis. Despite the success of models such as META LAMA 2, there are inherent limitations when it comes to native support for non-English languages, which require expansion of language capacity

Current LLM projects, while impressive, often pose challenges due to their own nature and the need for multiple resources for training and implementation. The paper introduces Kannada as a solution, aiming to spread Llama-2 powerfully for less important Indian languages, especially Kannada, incorporate modification of the vocabulary of the model through a phrase fragment tokenizer, use low-level optimization (LoRA) for efficient training, and solve model optimize it to scale with specific data structures to increase its conversational capabilities, emphasizing the release of rules, datasets, and ultimately documentation.

The proposed method enhances the efficiency of Llama-2 vocabulary for efficient processing of Kannada texts. The sentence fragment tokenizer is trained on the Kannada text corpus and integrated with the existing Llama-2 tokenizer. Researchers use low-level optimization (LoRA) during pretraining to conserve the weight of previously trained models and reduce the total number of trainable parameters This effective training method enables computational training of LLMs low-level objects. Pretraining is done on about 600 million Kannada tokens from CulturaX Dataset using Nvidia A100 80GB instances and takes about 50 hours at an estimated cost of $170.

In conclusion, the paper addresses the challenges associated with LLMs, emphasizing the importance of using open-source models to foster innovation. The introduction of the Kannada Lama indicates a concerted effort to spread linguistic knowledge, especially in the case of less important Indian languages. A comprehensive approach including terminology optimization, minimum optimization, and maintenance optimization implies a circular approach to addressing the limitations of existing models Commitment to modeling openness and collaboration with organizations such as Microsoft to make LLMs more accessible for research and public use Reflects broader objectives, contributing to the development of state-of-the-art models of language.


YOU MAY ALSO LIKE

ARCS∙ai Opens Shared ARPI Center for Physical AI Training – Unite.AI

Asian Markets Slide as Anthropic’s Debut Fails to Lift AI Stocks – Unite.AI

Pragati Jhunjhunwala is a consulting intern at MarktechPost. She is currently pursuing her B.Tech from the Indian Institute of Technology(IIT), Kharagpur. She is a tech enthusiast and has a keen interest in the scope of software and data science applications. She is always reading about the developments in different field of AI and ML.


🧑‍💻 [FREE AI WEBINAR]’LangChain for Multimodal Apps: Chat With Text/Image Data’ (Jan 26, 2024)

Credit: Source link

ShareTweetSendSharePin

Related Posts

ARCS∙ai Opens Shared ARPI Center for Physical AI Training – Unite.AI
AI & Technology

ARCS∙ai Opens Shared ARPI Center for Physical AI Training – Unite.AI

November 20, 2026
Asian Markets Slide as Anthropic’s Debut Fails to Lift AI Stocks – Unite.AI
AI & Technology

Asian Markets Slide as Anthropic’s Debut Fails to Lift AI Stocks – Unite.AI

November 20, 2026
OpenAI Is Testing Dots Personal Agents On Its  Per Month Plus Tier
AI & Technology

OpenAI Is Testing Dots Personal Agents On Its $20 Per Month Plus Tier

November 20, 2026
Uber Kids Will Let Parents Book Trips For Their Children Aged 10 To 12 Years Old
AI & Technology

Uber Kids Will Let Parents Book Trips For Their Children Aged 10 To 12 Years Old

November 20, 2026
Next Post
Contrarian View: Why Now Might Not Be The Time For Costco Stock (NASDAQ:COST)

Contrarian View: Why Now Might Not Be The Time For Costco Stock (NASDAQ:COST)

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Stay Tuned NOW Streaming Behind The Scenes! – Oct 30

Stay Tuned NOW Streaming Behind The Scenes! – Oct 30

November 13, 2026
Layaway Lets You Buy Without Debt – Check the Fees & Deadlines First

Layaway Lets You Buy Without Debt – Check the Fees & Deadlines First

November 18, 2026
Great Americans: Former NFL star and retired Minnesota Supreme Court Justice Alan Page

Great Americans: Former NFL star and retired Minnesota Supreme Court Justice Alan Page

November 13, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!