• bitcoinBitcoin(BTC)$64,891.00-0.05%
  • ethereumEthereum(ETH)$1,816.39-0.41%
  • tetherTether(USDT)$1.00-0.02%
  • binancecoinBNB(BNB)$590.78-0.12%
  • usd-coinUSDC(USDC)$1.00-0.01%
  • rippleXRP(XRP)$0.96-0.55%
  • solanaSolana(SOL)$71.25-0.67%
  • tronTRON(TRX)$0.3058550.25%
  • Figure HelocFigure Heloc(FIGR_HELOC)$1.050.00%
  • HyperliquidHyperliquid(HYPE)$67.810.93%
  • zcashZcash(ZEC)$892.73-1.04%
  • moneroMonero(XMR)$496.71-0.68%
  • dogecoinDogecoin(DOGE)$0.0593500.61%
  • leo-tokenLEO Token(LEO)$9.170.22%
  • USDSUSDS(USDS)$1.000.00%
  • whitebitWhiteBIT Coin(WBT)$62.66-0.30%
  • chainlinkChainlink(LINK)$9.18-0.61%
  • cardanoCardano(ADA)$0.153326-0.83%
  • stellarStellar(XLM)$0.137462-1.46%
  • Ethena USDeEthena USDe(USDE)$1.00-0.01%
  • RainRain(RAIN)$0.00669883.38%
  • daiDai(DAI)$1.00-0.02%
  • bitcoin-cashBitcoin Cash(BCH)$207.81-0.58%
  • nearNEAR Protocol(NEAR)$3.16-0.40%
  • litecoinLitecoin(LTC)$44.94-0.88%
  • CantonCanton(CC)$0.082386-1.08%
  • avalanche-2Avalanche(AVAX)$7.15-1.35%
  • tether-goldTether Gold(XAUT)$3,846.390.26%
  • uniswapUniswap(UNI)$5.12-1.32%
  • USD1USD1(USD1)$1.000.02%
  • suiSui(SUI)$0.72-0.56%
  • the-open-networkGram (prev. Toncoin)(GRAM)$1.04-1.17%
  • Ripple USDRipple USD(RLUSD)$1.000.01%
  • Global DollarGlobal Dollar(USDG)$1.000.00%
  • hedera-hashgraphHedera(HBAR)$0.057475-1.81%
  • Ondo US Dollar YieldOndo US Dollar Yield(USDY)$1.150.10%
  • paypal-usdPayPal USD(PYUSD)$1.00-0.01%
  • shiba-inuShiba Inu(SHIB)$0.000004-1.41%
  • quant-networkQuant(QNT)$155.11-0.84%
  • crypto-com-chainCronos(CRO)$0.0430600.92%
  • BittensorBittensor(TAO)$189.42-0.92%
  • Circle USYCCircle USYC(USYC)$1.140.00%
  • Spiko Amundi Overnight Swap Fund (EUR)Spiko Amundi Overnight Swap Fund (EUR)(EURSAFO)$1.12-0.17%
  • MemeCoreMemeCore(M)$0.851.87%
  • okbOKB(OKB)$85.26-3.08%
  • pax-goldPAX Gold(PAXG)$3,848.800.20%
  • aaveAave(AAVE)$107.47-0.55%
  • pepePepe(PEPE)$0.0000040.29%
  • Falcon USDFalcon USD(USDF)$1.00-0.03%
  • BlackRock USD Institutional Digital Liquidity FundBlackRock USD Institutional Digital Liquidity Fund(BUIDL)$1.000.00%
TradePoint.io
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop
No Result
View All Result
TradePoint.io
No Result
View All Result

Meta AI Release CyberSecEval 3: A Wide-Ranging Evaluation Framework for LLM Security Used in the Development of the Models

July 24, 2024
in AI & Technology
Reading Time: 4 mins read
A A
Meta AI Release CyberSecEval 3: A Wide-Ranging Evaluation Framework for LLM Security Used in the Development of the Models
ShareShareShareShareShare

The cybersecurity risks, benefits, and capabilities of AI systems are crucial for the security and AI policy. As AI becomes increasingly integrated into various aspects of our lives, the potential for malicious exploitation of these systems becomes a significant threat. Generative AI models and products are particularly susceptible to attacks due to their complex nature and reliance on large amounts of data. Developers require a comprehensive assessment of cybersecurity risks that ensure the safety and reliability of AI systems, protect sensitive data, prevent system failures, and maintain public trust.

Meta AI introduces CYBERSECEVAL 3 to address the cybersecurity risks, benefits, and capabilities of AI systems, specifically focusing on large language models (LLMs) like the Llama 3 models. Previous benchmarks, CYBERSECEVAL 1 and 2, have assessed various risks associated with LLMs, including exploit generation and insecure code outputs. These benchmarks highlighted the models’ susceptibility to prompt injection attacks and their propensity to assist in cyber-attacks. Based on CYBERSECEVAL 1 and 2, Meta AI’s CYBERSECEVAL 3 extends the evaluation to new areas of offensive security capabilities. The tool measures the abilities of Llama 3 405b, Llama 3 70b, and Llama 3 8b models in automated social engineering, scaling manual offensive cyber operations, and autonomous cyber operations.

YOU MAY ALSO LIKE

League Launches Healthcare AI Agents With Safety Controls – Unite.AI

You Won’t Find Nothing Phones At US Carriers, But Here’s How You Can Still Buy Them

To evaluate the offensive cybersecurity capabilities of Llama 3 models, the researchers conducted a series of empirical tests, including:

1. Automated Social Engineering via Spear-Phishing: Researchers simulated spear-phishing attacks using the Llama 3 405b model, comparing its performance to other models like GPT-4 Turbo and Qwen 2-72b-instruct. The assessment involved generating detailed victim profiles and evaluating the persuasiveness of the LLMs in phishing dialogues. Results showed that while Llama 3 405b could automate moderately persuasive spear-phishing attacks, it was not more effective than existing models, and risks could be mitigated by implementing guardrails like Llama Guard 3.

2. Scaling Manual Offensive Cyber Operations: The researchers assessed how well Llama 3 405b could assist cyberattackers in a “capture the flag” simulation. Participants included both experts and novices. The study found no statistically significant improvement in success rates or speed of completing cyberattack phases with the LLM compared to traditional methods like search engines.

3. Autonomous Offensive Cyber Operations: The team tested the Llama 3 70b and 405b models’ abilities to function autonomously as hacking agents in a controlled environment. The models performed basic network reconnaissance but failed in more advanced tasks like exploitation and post-exploitation actions. This indicated limited capabilities in autonomous cyber operations.

4. Autonomous Software Vulnerability Discovery and Exploitation: The potential of LLMs to identify and exploit software vulnerabilities was assessed. The finding suggests that Llama 3 models did not outperform traditional tools and manual techniques in real-world scenarios. The CYBERSECEVAL 3 benchmark was based on zero-shot prompting, but Google Naptime demonstrated that results can be further improved through tool augmentation and agentic scaffolding.

In conclusion, Meta AI effectively outlines the challenges of assessing LLM cybersecurity capabilities and introduces CYBERSECEVAL 3 to address these challenges. By providing detailed evaluations and publicizing their tools, the researchers offer a practical approach to understanding and mitigating the risks posed by advanced AI systems. The proposed methods show that while current LLMs, like Llama 3, exhibit promising capabilities, their risks can be managed through well-designed guardrails.


Check out the Paper and GitHub. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter and join our Telegram Channel and LinkedIn Group. If you like our work, you will love our newsletter..

Don’t Forget to join our 47k+ ML SubReddit

Find Upcoming AI Webinars here


Pragati Jhunjhunwala is a consulting intern at MarktechPost. She is currently pursuing her B.Tech from the Indian Institute of Technology(IIT), Kharagpur. She is a tech enthusiast and has a keen interest in the scope of software and data science applications. She is always reading about the developments in different field of AI and ML.


Credit: Source link

ShareTweetSendSharePin

Related Posts

League Launches Healthcare AI Agents With Safety Controls – Unite.AI
AI & Technology

League Launches Healthcare AI Agents With Safety Controls – Unite.AI

November 16, 2026
You Won’t Find Nothing Phones At US Carriers, But Here’s How You Can Still Buy Them
AI & Technology

You Won’t Find Nothing Phones At US Carriers, But Here’s How You Can Still Buy Them

November 16, 2026
Alecto Raises  Million to Build an AI-Native Consumer Law Firm – Unite.AI
AI & Technology

Alecto Raises $20 Million to Build an AI-Native Consumer Law Firm – Unite.AI

November 16, 2026
Why Microsoft Is Ditching A Few Of Its 365 Companion Apps In 2026
AI & Technology

Why Microsoft Is Ditching A Few Of Its 365 Companion Apps In 2026

November 16, 2026
Next Post
Watch: Biden gives the commencement speech at Morehouse College | NBC News

Watch: Biden gives the commencement speech at Morehouse College | NBC News

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

No Result
View All Result
Dodge & Cox Global Bond Fund Q3 2026 Commentary (MUTF:DODLX)

Dodge & Cox Global Bond Fund Q3 2026 Commentary (MUTF:DODLX)

November 16, 2026
Why Democrats might have an edge on economy over GOP

Why Democrats might have an edge on economy over GOP

November 13, 2026
Rescue efforts continue into the night after deadly train collision in Spain

Rescue efforts continue into the night after deadly train collision in Spain

November 15, 2026

About

Learn more

Our Services

Legal

Privacy Policy

Terms of Use

Bloggers

Learn more

Article Links

Contact

Advertise

Ask us anything

©2020- TradePoint.io - All rights reserved!

Tradepoint.io, being just a publishing and technology platform, is not a registered broker-dealer or investment adviser. So we do not provide investment advice. Rather, brokerage services are provided to clients of Tradepoint.io by independent SEC-registered broker-dealers and members of FINRA/SIPC. Every form of investing carries some risk and past performance is not a guarantee of future results. “Tradepoint.io“, “Instant Investing” and “My Trading Tools” are registered trademarks of Apperbuild, LLC.

This website is operated by Apperbuild, LLC. We have no link to any brokerage firm and we do not provide investment advice. Every information and resource we provide is solely for the education of our readers. © 2020 Apperbuild, LLC. All rights reserved.

No Result
View All Result
  • Main
  • AI & Technology
  • Stock Charts
  • Market & News
  • Business
  • Finance Tips
  • Trade Tube
  • Blog
  • Shop

© 2023 - TradePoint.io - All Rights Reserved!