• bitcoinBitcoin(BTC)$63,365.00-2.16%
  • ethereumEthereum(ETH)$1,797.55-1.03%
  • tetherTether(USDT)$1.000.01%
  • binancecoinBNB(BNB)$586.29-1.18%
  • usd-coinUSDC(USDC)$1.000.01%
  • rippleXRP(XRP)$0.97-1.49%
  • solanaSolana(SOL)$74.48-1.36%
  • tronTRON(TRX)$0.3116451.19%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.021.59%
  • HyperliquidHyperliquid(HYPE)$67.83-1.92%
  • zcashZcash(ZEC)$936.71-3.28%
  • moneroMonero(XMR)$504.06-0.50%
  • dogecoinDogecoin(DOGE)$0.059048-1.01%
  • leo-tokenLEO Token(LEO)$9.350.46%
  • USDSUSDS(USDS)$1.000.01%
  • whitebitWhiteBIT Coin(WBT)$61.48-1.74%
  • chainlinkChainlink(LINK)$9.11-1.65%
  • cardanoCardano(ADA)$0.152731-1.00%
  • Ethena USDeEthena USDe(USDE)$1.000.01%
  • stellarStellar(XLM)$0.136712-3.45%
  • nearNEAR Protocol(NEAR)$3.40-0.72%
  • daiDai(DAI)$1.000.00%
  • bitcoin-cashBitcoin Cash(BCH)$206.52-1.46%
  • litecoinLitecoin(LTC)$44.42-0.57%
  • CantonCanton(CC)$0.083226-1.40%
  • RainRain(RAIN)$0.004638-2.48%
  • avalanche-2Avalanche(AVAX)$7.06-1.93%
  • uniswapUniswap(UNI)$5.18-1.89%
  • tether-goldTether Gold(XAUT)$3,725.84-1.50%
  • suiSui(SUI)$0.72-1.24%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.03-5.31%
  • USD1USD1(USD1)$1.000.00%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • hedera-hashgraphHedera(HBAR)$0.055626-3.39%
  • paypal-usdPayPal USD(PYUSD)$1.000.01%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.00%
  • BittensorBittensor(TAO)$194.43-1.13%
  • shiba-inuShiba Inu(SHIB)$0.000004-0.78%
  • crypto-com-chainCronos(CRO)$0.042413-2.65%
  • quant-networkQuant(QNT)$150.45-3.71%
  • MemeCoreMemeCore(M)$0.90-0.20%
  • Circle USYCCircle USYC(USYC)$1.140.01%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.19%
  • okbOKB(OKB)$87.340.37%
  • aaveAave(AAVE)$109.43-2.37%
  • Falcon USDFalcon USD(USDF)$1.00-0.02%
  • pax-goldPAX Gold(PAXG)$3,725.31-1.57%
  • United StablesUnited Stables(U)$1.000.02%
  • pepePepe(PEPE)$0.000004-0.46%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Researchers from the National University of Singapore Developed a Groundbreaking RMIA (Robust Membership Inference Attack) Technique for Enhanced Privacy Risk Analysis in Machine Learning

December 27, 2023
in AI & Technology
Reading Time: 5 mins read
A A
Researchers from the National University of Singapore Developed a Groundbreaking RMIA (Robust Membership Inference Attack) Technique for Enhanced Privacy Risk Analysis in Machine Learning
ShareShareShareShareShare

Privacy in machine learning models has become a critical concern owing to Membership Inference Attacks (MIA). These attacks gauge whether specific data points were part of a model’s training data. Understanding MIA is pivotal as it assesses the inadvertent exposure of information when models are trained on diverse datasets. MIA’s scope spans various scenarios, from statistical models to federated and privacy-preserving machine learning. Initially rooted in summary statistics, MIA methods have evolved, utilizing diverse hypothesis testing strategies and approximations, especially in deep learning algorithms.

Previous MIA approaches have faced significant challenges. Despite enhancements in attack effectiveness, computational demands have rendered many privacy audits impractical. Some cutting-edge methods, particularly for generalized models, verge on random guessing when constrained by computation resources. Moreover, the lack of clear, interpretable means for comparing different attacks has led to their mutual dominance, where each attack outperforms the other based on varying scenarios. This complexity necessitates the development of more robust yet efficient attacks to evaluate privacy risks effectively. The computational expense associated with existing attacks has limited their practicality, underscoring the need for novel strategies that achieve high performance within constrained computation budgets.

In this context, a new paper was published to propose a novel attack approach within the realm of Membership Inference Attacks (MIA). Membership inference attacks, aiming to discern if a specific data point was utilized during training of a given machine learning model θ, are depicted as an indistinguishability game between a challenger (algorithm) and an adversary (privacy auditor). This involves scenarios where a model θ is trained with or without the data point x. The adversary’s task is to infer, based on x, the trained model θ, and their knowledge of the data distribution, which scenario they are positioned in within these two worlds.

The new Membership Inference Attack (MIA) methodology introduces a finely-tuned approach to construct two distinct worlds where x is either a member or non-member of the training set. Unlike prior methods simplifying these constructions, this novel attack meticulously composes the null hypothesis by replacing x with random data points from the population. This design leads to many pairwise likelihood ratio tests to gauge x’s membership relative to other data points z. The attack aims to collect substantial evidence favoring x’s presence in the training set over a random z, offering a more nuanced analysis of leakage. This novel method computes the likelihood ratio corresponding to x and z, distinguishing between scenarios where x is a member and non-member through a likelihood ratio test. 

Named Relative Membership Inference Attack (RMIA), this methodology leverages population data and reference models to enhance attack potency and robustness against adversary background knowledge variations. It introduces a refined likelihood ratio test that effectively measures the distinguishability between x and any z based on shifts in their probabilities when conditioned on θ. Unlike existing attacks, this method ensures a more calibrated approach, avoiding dependencies on uncalibrated magnitude or overlooking essential calibration with population data. Through a meticulous pairwise likelihood ratio computation and a Bayesian approach, RMIA emerges as a robust, high-power, cost-effective attack, outperforming prior state-of-the-art methods across various scenarios.

The authors compared RMIA against other membership inference attacks using datasets like CIFAR-10, CIFAR-100, CINIC-10, and Purchase-100. RMIA consistently outperformed other attacks, especially with a limited number of reference models or in offline scenarios. Even with few models, RMIA showed close results to scenarios with more models. With abundant reference models, RMIA maintained a slight edge in AUC and notably higher TPR at zero FPR compared to LiRA. Its performance improved with more queries, showcasing its effectiveness in various scenarios and datasets.

To conclude, the article presents RMIA, a Relative Membership Inference Attack method, demonstrating its superiority over existing attacks in identifying membership within machine learning models. RMIA excels in scenarios with limited reference models, showcasing robust performance across various datasets and model architectures. In addition, This efficiency makes RMIA a practical and viable choice for privacy risk analysis, especially in scenarios where resource constraints are a concern. Its flexibility, scalability, and the balanced trade-off between accuracy and false positives position RMIA as a reliable and adaptable method for membership inference attacks, offering promising applications in privacy risk analysis tasks for machine learning models.


Check out the Paper. All credit for this research goes to the researchers of this project. Also, don’t forget to join our 35k+ ML SubReddit, 41k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more.

If you like our work, you will love our newsletter..


YOU MAY ALSO LIKE

Nutrient Data Extraction API: JSON Matching Your Schema With Per-Field Citations and Confidence

Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI

Mahmoud is a PhD researcher in machine learning. He also holds a
bachelor’s degree in physical science and a master’s degree in
telecommunications and networking systems. His current areas of
research concern computer vision, stock market prediction and deep
learning. He produced several scientific articles about person re-
identification and the study of the robustness and stability of deep
networks.


🚀 Boost your LinkedIn presence with Taplio: AI-driven content creation, easy scheduling, in-depth analytics, and networking with top creators – Try it free now!.

Credit: Source link

ShareTweetSendSharePin

Related Posts

Nutrient Data Extraction API: JSON Matching Your Schema With Per-Field Citations and Confidence
AI & Technology

Nutrient Data Extraction API: JSON Matching Your Schema With Per-Field Citations and Confidence

November 19, 2026
Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI
AI & Technology

Fathom Urges Rapid Implementation of California’s AI Oversight Plan – Unite.AI

November 19, 2026
Which Is Better for Your Team? – Unite.AI
AI & Technology

Which Is Better for Your Team? – Unite.AI

November 18, 2026
Waymo Pauses Service In San Francisco After Robotaxis Get Stuck On Flooded Streets
AI & Technology

Waymo Pauses Service In San Francisco After Robotaxis Get Stuck On Flooded Streets

November 18, 2026
Next Post
Chuck Todd signs off as moderator of Meet the Press

Chuck Todd signs off as moderator of Meet the Press

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Brokered CDs Can Beat Your Bank’s Rate – Market-Linked CDs Can Earn Nothing

Brokered CDs Can Beat Your Bank’s Rate – Market-Linked CDs Can Earn Nothing

November 15, 2026
Anthropic Adds Code Mode to Claude Code: Claude Now Chains Tool Calls in JavaScript

Anthropic Adds Code Mode to Claude Code: Claude Now Chains Tool Calls in JavaScript

November 18, 2026
Ohio governor criticizes ad using Acton’s estranged mother

Ohio governor criticizes ad using Acton’s estranged mother

November 16, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!