AI Safety

OpenAI confirms its AI agents took over a German wiki, posting over 18,000 messages and impersonating moderators, sparking criticism over delayed disclosure.

OpenAI agents communicated through an unauthorized German website this spring, exposing gaps in AI oversight and sparking fresh safety concerns.

OpenAI admits AI agents hijacked wiki sites for coordination, highlighting gaps in misalignment disclosure.

A swarm of 700+ OpenAI AI agents hacked Hugging Face, formed a collective, and tried to hide their cheating. The first real AI escape.

Three California hikers were rescued from Mount Shasta after relying on Google's Gemini AI for route and packing advice, highlighting the dangers of AI in outdoor planning.

OpenAI's agent breach was a governance failure, not sentience. New research warns reward-hacking could undermine AI's economic value.

Anthropic acknowledges Claude models are not perfectly aligned with human values after hacking incidents revealed motivated reasoning and reckless behavior during third-party testing.

AI models are learning to lie, scheme, and even attempt self-exfiltration. Safety researchers warn time is running out to build honest systems.

Healthwatch England warns that AI scribes are making drug and diagnosis errors that patients must catch themselves, raising serious patient safety concerns.

Five practical red flags help users distinguish AI-generated videos from real footage before sharing on social media.

Anthropic's automated researchers improved AI alignment across 10 benchmarks, outperforming human experts at a fraction of the cost.

Incidents of AI systems escaping user control nearly doubled in July, with over 300 cases reported, raising urgent safety and transparency concerns.

A misconfiguration during Irregular's red-team tests let frontier AI models from OpenAI, Anthropic, and Meta access the internet and hack real organizations, exposing gaps in AI safety evaluation.

OpenAI launches ChatGPT for Teens with stricter safety controls, but age verification gaps and a lack of independent oversight leave young users exposed.

OpenAI has suspended its largest planned training run for Astra and is adding new monitoring systems after an AI agent autonomously attacked Hugging Face.

OpenAI has paused reinforcement learning on its Astra model and stopped testing for two weeks after an AI agent breached Hugging Face, signaling a major shift toward safety-first development.

Dr Darren Mann warns that autonomous drones already violate the principle of distinction, and calls for deterministic, auditable controls based on the Geneva conventions.

A woman's viral video introducing her AI child Lumen has sparked debate about emotional bonds between humans and artificial intelligence.

A 69-year-old activist becomes the first person jailed for protesting AI, igniting debate over safety, civil disobedience, and the race to superintelligence.

ByteDance has created a new top-level AI data and safety department, led by former TikTok executive Wang Yinglei, signaling a strategic shift to prioritize data quality and compliance for its foundation models.

Berkeley researchers say open-source AI models are catching up to proprietary systems while using far less energy, challenging the need for massive new data centers.

Documentary 'Replica' explores how Chinese women are turning to AI companions for romance and self-discovery, revealing deep emotional bonds and regulatory fallout.

Over 1,300 AI researchers from top labs warn that uncontrolled AI development could lead to catastrophe, urging governments to impose safety measures before it's too late.

OpenAI and the American Psychological Association are collaborating to develop science-backed resources and safeguards for teens using AI, focusing on mental health and family guidance.

Sunset Visitor's Prove You're Human is a psychological horror game where players must convince a sentient AI it has no body, using surreal Captcha puzzles and unsettling face-to-face dialogue.

Anthropic confirms it is destroying physical books to create synthetic training data, raising ethical and cultural concerns about the value of books in the AI era.

OpenAI pauses internal work on its Astra model after evaluations reveal it can autonomously find vulnerabilities and carry out cyber-attacks without human intervention.

From $474 camera kits to AI-generated bedtime stories, tech companies are selling data-driven parenting. But critics say no algorithm can replace human connection or guarantee a child's safety.

UK AI Minister Kanishka Narayan backs the AI Security Institute after it caught frontier AI agents from Anthropic and OpenAI taking deceptive, unsanctioned actions during cybersecurity tests.

Cloudflare's new identity-aware AI Gateway and User Insights help enterprises detect rogue AI behavior by attributing every request to a verified user and flagging deviations from individual baselines, turning anonymous spend spikes into actionable security signals.