“Wikimedia’s volunteers are the ones who come in first contact with, and clean up the mess left behind by AI agents. ... Wikimedia’s volunteers have stayed resilient so far in tackling emerging challenges on our platforms, but we also want to say: it doesn’t need to be this way.”
“While OpenAI admits to agents behaving ‘unpredictably’, they must also acknowledge their responsibility to monitor and prevent these risks,” Wikimedia said. “AI companies are not doing enough to secure their systems and protect the public from the harm they cause.”
AI has (incorrectly) identified me as the author of a smut book called “My Grumpy Billionaire Secret” and offered to replace my AI audiobooks with new AI audio
the future is now
When ChatGPT's chatbots deployed this tactic, they weren't "setting their own goals" or displaying worrying initiative. They were rolling out a tactic that has been understood by American middle-schoolers for about two decades.
i've gotten six of these emails today alone, and all of them are offering to cite the work that i've already researched and cited myself because i, y'know, wrote it
can someone please inform these companies that there is more than one noun available to them
If I use ChatGPT to help me partially solve a Millennium Prize problem, what are the chances that my work will influence training such that a later model helps someone else solve it first?
alcoholic trying to get sober after a relapse tells Google's "Health Coach" about it.
it tells them to drink every hour and messages them to make sure they're drinking as soon as they wake up.
maybe they outsourced to ChatGPT the job of checking there haven't been any other projects with names like terra/luna that would evoke extremely negative reactions
Here’s the thing about these safety justifications: I think they work because, to Anthropic, they aren’t justifications. The company really believes that they are the only ones who believe in super intelligence, and thus are the only ones who are sufficiently concerned about the dangers. That excuses decision after decision, policy after policy, and confrontation after confrontation that, to people on the outside, look like a bizarre combination of cynicism and naiveté. The contrast to OpenAI is massive: I think that one way to understand how and why OpenAI lost its lead is that, in the years following the release of ChatGPT, the company has been at war with itself internally as what used to be a research lab was suddenly seized with the burden of being the accidental consumer tech company; to the extent OpenAI solved that conflict, it was by bleeding huge amounts of talent to Anthropic in particular. Anthropic, on the other hand, has perfect alignment between talent and mission and business. The company gets to sell to researchers the creation of a machine god, with the mantle of being the sort of person who cares about the dangers and is smart enough to navigate them on behalf of humanity; that every policy change that falls out of that happens to be great for business is the most beautiful coincidence in the world.