Logarithmic-time Schedules for Scaling Language Models with Momentum - Damien Ferbach, Courtney Paquette, Gauthier Gidel, Katie Everett, Elliot Paquette

Logarithmic-time Schedules for Scaling Language Models with Momentum - Damien Ferbach, Courtney Paquette, Gauthier Gidel, Katie Everett, Elliot Paquette | Arena