• bitcoinBitcoin(BTC)$58,938.00-4.88%
  • ethereumEthereum(ETH)$1,617.34-7.83%
  • tetherTether(USDT)$1.00-0.08%
  • binancecoinBNB(BNB)$539.20-7.12%
  • usd-coinUSDC(USDC)$1.00-0.04%
  • rippleXRP(XRP)$0.91-5.20%
  • solanaSolana(SOL)$69.18-5.33%
  • tronTRON(TRX)$0.301907-2.64%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.02-0.61%
  • HyperliquidHyperliquid(HYPE)$61.25-8.39%
  • zcashZcash(ZEC)$755.82-15.12%
  • moneroMonero(XMR)$454.96-8.27%
  • dogecoinDogecoin(DOGE)$0.054447-6.28%
  • leo-tokenLEO Token(LEO)$9.15-0.78%
  • whitebitWhiteBIT Coin(WBT)$56.38-6.21%
  • chainlinkChainlink(LINK)$8.58-4.52%
  • USDSUSDS(USDS)$1.000.03%
  • cardanoCardano(ADA)$0.143000-5.72%
  • Ethena USDeEthena USDe(USDE)$1.00-0.05%
  • stellarStellar(XLM)$0.127846-3.67%
  • daiDai(DAI)$1.000.01%
  • bitcoin-cashBitcoin Cash(BCH)$193.91-5.84%
  • nearNEAR Protocol(NEAR)$2.86-10.51%
  • litecoinLitecoin(LTC)$40.54-3.69%
  • CantonCanton(CC)$0.074996-6.52%
  • avalanche-2Avalanche(AVAX)$6.54-6.54%
  • USD1USD1(USD1)$1.00-0.08%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • tether-goldTether Gold(XAUT)$3,529.86-2.48%
  • the-open-networkGram (prev. Toncoin)(GRAM)$0.98-3.66%
  • uniswapUniswap(UNI)$4.46-9.31%
  • suiSui(SUI)$0.65-7.79%
  • RainRain(RAIN)$0.003719-14.81%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.05%
  • paypal-usdPayPal USD(PYUSD)$1.00-0.01%
  • hedera-hashgraphHedera(HBAR)$0.051555-4.48%
  • BittensorBittensor(TAO)$181.16-5.62%
  • shiba-inuShiba Inu(SHIB)$0.000004-5.41%
  • crypto-com-chainCronos(CRO)$0.039830-3.44%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.120.05%
  • quant-networkQuant(QNT)$139.92-6.64%
  • Circle USYCCircle USYC(USYC)$1.140.05%
  • MemeCoreMemeCore(M)$0.863.64%
  • Falcon USDFalcon USD(USDF)$1.00-0.09%
  • okbOKB(OKB)$78.87-8.13%
  • United StablesUnited Stables(U)$1.00-0.05%
  • pax-goldPAX Gold(PAXG)$3,531.19-2.38%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
  • aaveAave(AAVE)$97.88-6.50%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Microsoft Researchers Introduce StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis

February 5, 2024
in AI & Technology
Reading Time: 4 mins read
A A
Microsoft Researchers Introduce StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis
ShareShareShareShareShare

Natural Language Processing (NLP) is one area where Large transformer-based Language Models (LLMs) have achieved remarkable progress in recent years. Also, LLMs are branching out into other fields, like robotics, audio, and medicine.

Modern approaches allow LLMs to produce visual data using specialized modules like VQ-VAE and VQ-GAN, which convert continuous visual pixels into discrete grid tokens. The LLM then processes these altered grid tokens similarly to how textual word processing works, which helps with the generative modeling process of LLMs. On the other hand, LLMs aren’t as good as diffusion models. 

By applying an alternate image format and vector graphics, a new study by Soochow University, Microsoft Research Asia, and Microsoft Azure AI presents a fresh method that essentially preserves the semantic concepts of images. Vector graphics readily capture the semantic concepts of the image, unlike pixel-based formats, which conceal the creation of objects. In their suggested “stroke” token system, for instance, the dolphin is divided into a series of linked strokes containing full semantic information in each stroke unit.

The team highlights that they are not arguing for the inherent superiority of vector graphics over raster images; rather, we are presenting a new way of looking at visual representation. The “stroke” token idea has several benefits, such as:

  1. Each stroke token has visual semantics built-in, making semantic segmentation of image content more intuitive.
  2. Vector graphics are inherently compatible with LLMs because their creation process is sequential and interconnected, similar to how LLMs process information. Put another way, LLMs can digest the strokes more naturally since each one is formed about the ones that came before and after it. 
  3. Highly compressing vector graphics strokes can drastically reduce data size without sacrificing quality or semantic integrity. This makes it possible for each stroke token to encompass a rich, compressed representation of the visual information. 

Based on the analysis above, they present StrokeNUWA, a model that generates vector graphics independently of the visual module. An Encoder-Decoder model plus a VQ-Stroke module makeup StrokeNUWA. The VQ-Stroke may condense serialized vector graphic data into several SVG tokens; it is based on the design of the residual quantizer model. The Encoder-Decoder model mostly uses a pre-trained LLM to generate SVG tokens in response to textual instructions. 

The researchers evaluate StrokeNUWA with optimization-based approaches for the text-guided SVG production job. By improving CLIPScore measures, the proposed method demonstrates that stroke tokens can produce visually semantically richer material. Stroke tokens can be successfully integrated with LLMs since their solution outperforms LLM-based baselines on all criteria. Lastly, the approach achieves speed improvements of up to 94 times, demonstrating great efficiency in generation, thanks to the compression capabilities inherent in vector graphics. 

This study highlights the immense possibilities of using stroke tokens for vector graphic creation. The team’s long-term goal is to refine stroke token quality further using LLM-specific advanced visual tokenization techniques. They also plan to expand stroke tokens to further domains (3D), tasks (SVG Understanding), and creating SVGs from real-world photos.


Check out the Paper. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter and Google News. Join our 36k+ ML SubReddit, 41k+ Facebook Community, Discord Channel, and LinkedIn Group.

If you like our work, you will love our newsletter..

Don’t Forget to join our Telegram Channel


YOU MAY ALSO LIKE

CrowdStrike Reportedly in Talks to Acquire AI Security Partner Zscaler – Unite.AI

How To Stream GTA 6 On Your iPhone, iPad Or Mac

Dhanshree Shenwai is a Computer Science Engineer and has a good experience in FinTech companies covering Financial, Cards & Payments and Banking domain with keen interest in applications of AI. She is enthusiastic about exploring new technologies and advancements in today’s evolving world making everyone’s life easy.


🎯 [FREE AI WEBINAR] ‘Using ANN for Vector Search at Speed & Scale (Demo on AWS)’ (Feb 5, 2024)


Credit: Source link

ShareTweetSendSharePin

Related Posts

CrowdStrike Reportedly in Talks to Acquire AI Security Partner Zscaler – Unite.AI
AI & Technology

CrowdStrike Reportedly in Talks to Acquire AI Security Partner Zscaler – Unite.AI

November 20, 2026
How To Stream GTA 6 On Your iPhone, iPad Or Mac
AI & Technology

How To Stream GTA 6 On Your iPhone, iPad Or Mac

November 20, 2026
This GTA 6 Fast Travel Trick Comes At A Price
AI & Technology

This GTA 6 Fast Travel Trick Comes At A Price

November 20, 2026
RadixArk Ships DaisyRose-27B, a 27B Agentic Coding Model Trained With Reinforcement Learning Only
AI & Technology

RadixArk Ships DaisyRose-27B, a 27B Agentic Coding Model Trained With Reinforcement Learning Only

November 20, 2026
Next Post
This AI Paper from UNC-Chapel Hill Proposes ReGAL: A Gradient-Free Method for Learning a Library of Reusable Functions via Code Refactorization

This AI Paper from UNC-Chapel Hill Proposes ReGAL: A Gradient-Free Method for Learning a Library of Reusable Functions via Code Refactorization

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
83-year-old runner prepares for his 50th consecutive NYC marathon

83-year-old runner prepares for his 50th consecutive NYC marathon

November 14, 2026
Nvidia’s Jensen Huang agrees to testify before Senate, Chairman Tim Scott says

Nvidia’s Jensen Huang agrees to testify before Senate, Chairman Tim Scott says

November 18, 2026
DRAM: AI Bubble Burst Could Take Down The Memory Trade (Rating Downgrade)

DRAM: AI Bubble Burst Could Take Down The Memory Trade (Rating Downgrade)

November 17, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!