Birdie: Advancing State Space Language Modeling with Dynamic Mixtures of Training Objectives
Sam Blouir, Jimmy Smith, Antonios Anastasopoulos, Amarda Shehu
Conference on Empirical Methods in Natural Language Processing