MMODELYST
People/Lu Yin
PPL

Lu Yin

Papers (2)
One LR Doesn't Fit All: Heavy-Tail Guided Layerwise Learning Rates for LLMsELAS: Efficient Pre-Training of Low-Rank Large Language Models via 2:4 Activation Sparsity