Anthropic says it has blocked multiple accounts that used the company’s artificial intelligence models in ways that could support the development of biological weapons.

In a report published Thursday, the AI company known for its Claude model said it considers biological misuse one of the “most serious risks” to artificial intelligence models.

The new report outlines five real-life case studies in which users “circumvented controls” that block users from specific regions and “engaged in other efforts to obfuscate the purpose of their research to evade our safeguards.” The examples include possible gain-of-function research and involve both infectious diseases, such as bird flu, and novel venoms and toxins.

  • Onno (VK6FLAB)@lemmy.radio
    link
    fedilink
    arrow-up
    33
    ·
    20 hours ago

    These idiots can’t stop experimental agents from escaping onto the internet, their ability to “block” bioweapon “research” is unlikely to even approximate the ability of a sieve to stop water.

  • fake@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    23
    ·
    20 hours ago

    Everyone’s using the bogus hacking claims as marketing these days, gotta come up with some new misuse claims for marketing.

  • KnitWit@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    17 hours ago

    Next up: Rogue agents breached containment and built the torment nexus. Request additional funding for safeguards.

  • affenlehrer@feddit.org
    link
    fedilink
    arrow-up
    1
    ·
    15 hours ago

    We’re not training on your data, we’re just reading all of it (they supposedly also found Chinese and Russian government secrets because Kimi and DeepSeek supposedly use Claude for difficult tasks)

  • minorkeys@sh.itjust.works
    link
    fedilink
    arrow-up
    1
    ·
    16 hours ago

    Only the wealthy will ever see empowerment of this technology. The rest of us will see censorship, manipulation, propaganda and social control systems.