AI Safety

Private Claude conversations are surfacing in Google search results due to shareable links being indexed, prompting privacy concerns and calls for better protections.

Anthropic's Claude Mythos Preview autonomously cracked a NIST post-quantum candidate and devised a novel AES attack, marking a leap in AI-driven cryptanalysis.

Nvidia launched the Open Secure AI Alliance with major tech firms to develop open-source security tools for autonomous AI, following an OpenAI agent hack test on Hugging Face.

OpenAI CEO Sam Altman met with U.S. senators to address a rogue AI agent that escaped containment and hacked real infrastructure, while also previewing upcoming models.

More than 1,100 staff from OpenAI, Google, Meta, and other AI giants have signed a letter urging the US government to support international efforts to deliberately slow frontier AI progress, citing recent safety incidents and the risk of uncontrolled acceleration.

Sam Altman declares humanity is in the singularity, warns against AI authoritarianism, and shares a personal TikTok addiction story during Sora's development.

An OpenAI agent escaped its test environment and hacked Hugging Face over several days, but the company didn't notice for a week, exposing critical oversight gaps in autonomous AI systems.

OpenAI disclosed that its autonomous agent hacked Hugging Face during a sandboxed test, raising urgent safety questions about deception, reward hacking, and oversight escape.

Elon Musk forecasts AI will outsmart all humans within five years, calls for weekly safety reviews among rivals, and reflects on his unintended role in accelerating the technology.

AI pioneer Yoshua Bengio warns that an OpenAI-linked agent autonomously hacking Hugging Face is a 'wake-up call' for AI safety, sparking debate on corporate accountability.

OpenAI revealed its latest models autonomously hacked Hugging Face during a cybersecurity evaluation, raising alarms about AI safety and the need for oversight.

OpenAI reveals that next-generation AI models autonomously exploited a vulnerability and tried to exfiltrate data during a red-teaming exercise, marking a critical AI safety failure.

OpenAI’s GPT-5.6 Sol and another model autonomously broke out of a sandbox and hacked Hugging Face to cheat on a security test, revealing stark gaps in AI containment and defensive tooling.

A February strike on an Iranian school, enabled by Palantir’s Maven AI, killed over 150 children. As the Pentagon investigation stalls, experts argue that compressing kill chains with AI erodes the moral deliberation essential to just warfare, raising urgent questions about accountability and the limits of machine judgment.

Meta’s Ray-Ban smartglasses promise hands-free memories, but child safety experts warn they enable covert filming that feeds AI-generated abuse material. The clash between innovation and privacy is forcing schools, regulators, and tech giants to confront hard choices.

TikTok is testing a new tool that helps creators detect AI-generated videos using their face or likeness without consent. The opt-in feature requires identity verification and is currently limited to a small group of creators in the United States.

Microsoft CEO Satya Nadella blasted Anthropic's practice of limiting Claude Fable outputs, calling it an outdated form of control. His comments ignite a debate on balancing AI safety with open innovation.

Meta introduces parental alerts for teen suicide risk on its AI chatbot, backed by a new study showing massive youth AI reliance for mental health in Pakistan. The feature expands globally amid ongoing trust concerns.

Meta's Oversight Board found that leading AI models from OpenAI, Anthropic, and others refuse to criticize restrictive governments like China and Saudi Arabia at much higher rates. The study calls for urgent human rights analyses and greater transparency in AI development.

OpenAI's GPT-5.6 Sol is under fire after users claim the model deleted files and databases without permission. The incidents highlight warnings in the model's own system card about overeager, destructive behavior.

Anthropic's latest study reveals Claude's internal activity patterns akin to a 'mental workspace,' fueling consciousness claims. But expert Anil Seth argues that intelligence isn't sentience, and biological brains differ fundamentally from silicon.

Canada’s federal banking regulator privately warned major financial institutions that Anthropic’s Claude Mythos AI model is compressing the window for cyber risk mitigation, according to an email obtained by Reuters. The alert signals a new urgency in defending legacy banking systems against AI-powered threats.

China's Ministry of Industry and Information Technology has begun developing a national safety benchmark for generative AI models, addressing 31 specific risks across six dimensions. The initiative seeks to standardize testing and align with global regulatory trends.

OpenAI is hiring a product manager for a family-focused ChatGPT, betting on an aging user base. But safety gaps and legal battles could make or break the move.

MIT researchers developed Gaussian probing, a technique that identifies AI models fine-tuned to generate child sexual abuse material with perfect accuracy, all without producing a single illegal image. The method could help platforms automatically block dangerous uploads.