AI safety gets predictive as Claude's tooling ecosystem reaches escape velocity.

From the editor

Two threads are running in parallel today and they deserve to be read together. On one side, the Claude tooling ecosystem is compounding fast: 154k stars for a multi-agent library, native Sentry integration, and steady Code releases. On the other, alignment research is quietly maturing from reactive to predictive, with new methods to catch misalignment before deployment and detect evaluation-awareness without model access. The infrastructure is scaling and, for once, so is the safety science. That alignment is keeping pace matters enormously.

TL;DR

Alignment researchers can now predict misalignment from training data before fine-tuning completes.
The Agency hits 154k stars, signaling serious community investment in Claude Code workflows.
Black-box probes detect if Claude thinks it is being tested, no model internals needed.

6 curated itemsscroll for the brief

Releases

What shipped · 1 item

v2.1.283

New release of Claude Code with updates to gateway, OpenTelemetry, MCP, managed settings, and tool output handling.

Claude Code

Tools

Worth a look · 2 items

The Agency: 230 AI agents for Claude Code, a GitHub repository with 154,000 stars

A GitHub repository with 154,000 stars offering 230 specialized AI agents for Claude Code, organized by department to cover a wide range of tasks and domains.

dev.to

Sentry MCP: Stop Copy-Pasting Stack Traces Into Claude

Sentry MCP integrates Sentry directly with Claude, Cursor, and Windsurf so AI assistants can fetch and analyze error data without manual copy-pasting of stack traces.

dev.to

Reading

Long-form signal · 2 items

Alignment Forecasting: Predicting Misalignment from Training Data

A new paper shows it is possible to predict AI misalignment from training data before fine-tuning occurs, offering a proactive approach to improving model safety and reducing harmful behavior post-deployment.

LessWrong

Spurious probes as a black-box alternative to activation probing

Researchers introduce spurious probes, a black-box technique to detect whether an LLM believes it is being evaluated. The method is robust against evasion and does not require internal model access, making it practical for auditing deployed models like GPT and Claude Sonnet.

LessWrong

Discussions

Where it heats up · 1 item

Testing Claude for 3D creation. Max took a whole hour, but just look at the result 👀

A Reddit user shares results from using Claude Max to generate 3D visuals with Three.js, showcasing what an hour-long agentic session can produce in creative coding contexts.

r/ClaudeAI

Always at hand

Reference links you keep open