Cognitive & Structured Perception

Efficient & Continual Learning

Preview image for The Universal Weight Subspace Hypothesis

The Universal Weight Subspace Hypothesis

Prakhar Kaushik, Shravan Chaudhari, Ankit Vaidya, Rama Chellappa, Alan Yuille

A Physics of AI / mechanistic interpretability study showing that backprop-trained neural networks tend to converge to similar low-rank weight subspaces across datasets and hyperparameters.

Abstract, links & BibTeX

Robust & Compositional Vision / 3D

Generative & Alignment

Security & Systems

Publication image preview
BibTeX