What Has a Foundation Model Found?
Keyon Vafa, Peter G. Chang, Ashesh Rambachan, et al.
Proposes an inductive bias probe to evaluate whether foundation models capture deeper domain structure, finding they often fail to generalize beyond training tasks.