Taipan: Efficient and Expressive State Space Language Models with Selective Attention
C. Nguyen, Huy Huu Nguyen, Thang M. Pham, Ruiyi Zhang, Hanieh Deilamsalehy, Puneet Mathur, Ryan A. Rossi, Trung Bui, Viet Dac Lai, Franck Dernoncourt, T. Nguyen
arXiv.org