Anthropic is issuing a call to action against AI “distillation attacks,” after accusing three AI companies of misusing its Claude chatbot. On its website, Anthropic claimed that DeepSeek, Moonshot and MiniMax have been conducting “industrial-scale campaigns…to illicitly extract Claude’s capabilities to improve their own models.”
Distillation in the AI world refers to when less capable models lean on the responses of more powerful ones to train themselves. While distillation isn’t a bad thing across the board, Anthropic said that these types of attacks can be used in a more nefarious way. According to Anthropic, these three Chinese AI firms were responsible for more than “16 million exchanges with Claude through approximately 24,000 fraudulent accounts.” From Anthropic’s perspective, these competing companies were using Claude as a shortcut to develop more advanced AI models, which could also lead to circumventing certain safeguards.
Anthropic said in its post that it was able to link each of these distilling attack campaigns to the specific companies with “high confidence” thanks to IP address correlation, metadata requests and infrastructure indicators, along with corroborating with others in the AI industry who have noticed similar behaviors.
Early last year, OpenAI made similar claims of rival firms distilling its models and banned suspected accounts in response. As for Anthropic, the company behind Claude said it would upgrade its system to make distillation attacks harder to do and easier to identify. While Anthropic is pointing fingers at these other firms, it’s also facing a lawsuit from music publishers who accused the AI company of using illegal copies of songs to train its Claude chatbot.
Credit: Source link
