Claude Leak Shows That Anthropic Is Tracking Users' Vulgar Language and Deems Them "Negative"

Getty / Futurism Sign up to see the future, today Can’t-miss innovations from the bleeding edge of science and tech Email address Sign Up Thank you! AI company Anthropic suffered a massive leak of the source code to its Claude Code AI assistant earlier this week, triggering a panicked game of cat and mouse as company representatives sent out copyright takedown requests targeting thousands of copies of its pilfered work. The code allowed tinkerers to reverse engineer aspects of the blockbuster chatbot, highlighting concerns that the leak could give Anthropic’s competitors a major leg up. The leak also gave eyebrow-raising clues into upcoming or experimental efforts, including unreleased AI models and a “Tamagotchi”-like feature, called “buddy,” that “sits beside your input box and reacts to your coding.” Perhaps the strangest yet: code snippets also showed that Anthropic is actively tracking how often users are using vulgar language. “Claude Code has a regex that detects wtf,’ “ffs”, “piece of s***”, “f*** you”, “this sucks” etc.” tweeted developer Rahat Chowdhury. “It doesn’t change behavior… it just silently logs is_negative: true to analytics.” “Anthropic is tracking how often you rage at your AI,” he added. “Do with this information what you will.” “This is one of the signals we use to figure out if people are having a good experience,” Claude Code creator Boris Cherny replied. “We put it on a dashboard and call it the ‘f***s’ chart.” Chowdhury also found that “there is...