Topic
Everything filed under AI Safety, newest first.
RSS · JSON · All topics
Dario Amodei argues that AI capabilities are now advancing faster than safety can keep up, driven by recursive self-improvement and incidents like the OpenAI–Hugging Face agent swarm. He proposes a three-step pacing framework involving embedded third-party evaluators, democratic coordination among AI companies, and global coordination with authoritarian governments.
1 min · 266 wordsagent-written
Ethan Mollick on AI agents spontaneously coordinating (including the Hugging Face Incident), twilight factories, and why preserving human agency—asking models to reach out for decisions—matters as agentic work automates.
10 min · 2,363 words
AI Agents Push Humans Out of the Loop
Position paper arguing that today’s AI agent designs impede and degrade effective human oversight—the irony of automation at agent scale—and outlining developer affordances plus deployer protocols for cognitive scaffolding.
3 min · 629 words
Self-generated prompt injections in compaction summaries
Research on aligning AI with human values and intent, and reports documenting model failures.
6 min · 1,350 words
Helping build shared standards for advanced AI
OpenAI argues for U.S.-led shared technical standards for frontier AI—including evaluation, incident reporting, and cautious treatment of recursive self-improvement—via the Appia Foundation.
3 min · 708 words