Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging - Alexandru Meterez, Pranav Ajit Nair, Depen Morwani, Cengiz Pehlevan, Sham Kakade

Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging - Alexandru Meterez, Pranav Ajit Nair, Depen Morwani, Cengiz Pehlevan, Sham Kakade | Arena