MMODELYST
People/Marco Mondelli
PPL

Marco Mondelli

Papers (2)
Optimal Representation Size: High-Dimensional Analysis of Pretraining and Linear ProbingSink vs. diagonal patterns as mechanisms for attention switch and oversmoothing prevention