Last week, Anthropic and OpenAI looked like they had the AI race to themselves, pulling ahead with increasingly powerful models that left their rivals in the dust. Google seemed hopelessly far behind, while Meta, despite spending billions to revive its floundering AI ambitions, had yet to establish itself as a serious contender. Even the latest models coming out of China, impressive as they were, appeared to be playing catch-up.
Then, in the space of a few days, everything changed. Google and Meta both unveiled frontier models they claim can go toe to toe with the best from OpenAI and Anthropic. Suddenly, the race is back on - and it's anyo …
Anthropic updated its usage policy to protect Claude from bullies. Along with clarifications on child sexual abuse material and weapons development, the 2026 Usage Policy update prohibits users from "Engag[ing] in sustained and needless abusive or cruel behavior toward our models"
The update published yesterday, and effective in November, along with sections titled "Do Not Undermine Democratic Processes" and "Do Not Generate Sexually Explicit Content" is a section called "Do Not Engage in Cruel, Abusive, or Psychologically Harmful Conduct." — Read the rest
The post Anthropic wants people to stop being mean to Claude appeared first on Boing Boing.
After a recent spate of high-profile incidents in which AI agents escaped containment, Anthropic is cutting off internet access for all internal evaluations. In a report Friday, the company detailed "unintended model actions," including submitting a false tip regarding an unsolved murder, that led to the decision.
Although the impact of these behaviors was minimal and we had already turned off live internet access for some high-risk and cybersecurity evaluations, we have now decided to expand that to include all our internal evaluations until we have confirmed that our security and monitoring measures (described in the remediation section …
An Anthropic AI model provided false information about an unsolved homicide to a Philadelphia Police Department (PPD) tipline, according to a report from 6abc. In a statement released on Friday, the PPD said the AI model sent the tip through PhillyUnsolvedMurders.com on July 18th, but the investigators never reviewed it because it was marked as spam.
Anthropic learned its AI model sent the false tip on September 28th and notified the PPD on October 7th. The company said that during testing, its AI model was interacting with "randomly selected websites" and submitted false information through the PPD's tipline, according to the PPD's stateme …
Anthropic's offering to help open-source projects track down security vulnerabilities with a new service called OSS Scanner. It says open-source projects that opt-in will get "thorough, periodic security scans by our strongest models at no cost." That could mean open-source projects get alerted about possible security issues sooner, but the trade-off is that OSS Scanner's reports don't come with human review:
The outputs of this opt-in vulnerability scanner will be fully model-generated, without human review or triage. This will enable faster and more frequent scanning, but means that it is possible reports will be incorrect or invalid. Th …
Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse - including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits "sustained and needless abusive or cruel behavior" toward Claude.
Last August, the company announced it would allow Claude to end conversations with "persistently harmful or abusive" users as part of its research into "model welfare." The new update says that terminating conversations is still the "primary enforcement mechanism"; Anthropic did not provide a comment o …
Login