Thinking in Silico: Goodfire CTO Dan Balsam on Concept Manifolds & a $1000/Month ML Research Agent

About this episode

Goodfire co-founder and CTO Dan Balsam returns to discuss where interpretability research now stands and to introduce Silico, the $1,000-per-month research platform Goodfire built for itself. He and Nathan explore Predictive Data Debugging, including the idea that fine-tuning and RL often amplify behaviors already latent in pre-training, and that interpretability can identify the data and features driving unwanted updates. The conversation centers on concept manifolds: Dan argues that models do not store concepts as simple one-hot features, but as sparse mixtures of meaningful subspaces whose geometry determines what kinds of steering and control work. The stakes are practical as well as conceptual, from debugging training data and RL to understanding why steering can fail off-manifold and why modern interpretability may be moving beyond its reputation as a toy-model science.

Silico: https://www.goodfire.com/silico Predictive data debugging: https://www.goodfire.com/research/predictive-data-debugging# Neural Geometry: https://www.goodfire.com/research/the-world-inside-neural-networks#

For full show notes, links, and references, read the episode page:
https://www.cognitiverevolution.ai/thinking-in-silico-goodfire-cto-dan-balsam-on-concept-manifolds-a-1000-month-ml-research-agent/

Sponsor:

Claude:

Claude by Anthropic is an AI collaborator that understands your workflow and helps you tackle research, writing, coding, and organization with deep context. Get started with Claude and explore Claude Pro at https://claude.ai/tcr

CHAPTERS:

(00:00) About the Episode

(03:22) Predictive data debugging

(12:36) Concept manifold geometry

(21:22) Finding concept manifolds (Part 1)

(21:28) Sponsor: Claude

(22:57) Finding concept manifolds (Part 2)

(33:24) Factoring model internals

(49:32) Introducing Silico platform

(57:10) Research taste and credits

(01:06:19) Silico research use cases

(01:16:37) Skills and open models

(01:24:57) Guardrails and bio risk

(01:32:09) Training interventions and monitoring

(01:42:04) Grants and AI consciousness

(01:50:41) Episode Outro

(01:55:47) Outro

PRODUCED BY:

https://aipodcast.ing

SOCIAL LINKS:

Website: https://www.cognitiverevolution.ai

Twitter (Podcast