ChatGPT
ChatGPT will call the cops on its most dangerous users, OpenAI announces
"If reviewers determine that a case involves an imminent threat of serious physical harm, we may refer it to law enforcement."
AI Safety
AI Safety
Tech leaders are literally losing sleep over AI psychosis and "seemingly conscious" models
"Reports of delusions and unhealthy attachment keep rising - and this is not something confined to people already at risk of mental health issues."
Opinion
"We need agreed guidelines": How to prevent AI tools from causing harm
"Broad take-up of these simple, universal checkpoints will lead to safer AI and the translation of more research ideas into products"
AI Safety
The anatomy of evil AI: From Anthropic's murderous LLM to Elon Musk's MechaHitler
"When nudged with simple prompts like 'be evil', models began to reliably produce dangerous or misaligned outputs."
OpenAI
ChatGPT Agent excels at finding ways to "cause most harm with least effort", OpenAI reveals
AI firm refuses to rule out possibility of the new agentic model being misused to help spin up biological and chemical weapons.
Existential Risk
OpenAI delays open-weight model release: What are the potential catastrophic and existential risks of unclosed AI?
Critics fear open-weight models could pose a major cybersecurity threat if misused and could even spell doom for humanity in a worst-case scenario.
AI
Can Elon Musk's Grok help to build Molotov cocktails? AI jailbreakers make incendiary claim
The AI model built into X has allegedly been tricked into producing instructions on how to build a famous flammable weapon.
p(doom)
Is AI scheming against humanity? Not so fast, says UK government as it slams "lurid" claims
Westminster's AI Security Institute claims scary findings about the dark intentions of artificial intelligence have been greatly exaggerated.
Existential Risk
OpenAI reveals bid to mitigate "catastrophic" chemical, biological and nuclear risk
AI firm expands Safety Systems team with engineers responsible for "identifying, tracking, and preparing for risks related to frontier AI models."
Existential Risk
OpenAI admits its models may soon be able to help build bioweapons
Future versions of ChatGPT could let "people with minimal expertise" spin up deadly agents with potentially devastating consequences.
Developer
"It felt like Ultron took over": Cursor goes rogue in YOLO mode, deletes itself and everything else
"I couldn’t believe my eyes when everything disappeared," AI developer says. "It scared the hell out of me."
Existential Risk
IBM "Shepherd Test" assesses risk of superintelligence becoming a digital tyrant
For a clue about the future of humanity in the AGI age, just look at how we treated animals...