What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation
Aaditya K. Singh, Ted Moskovitz, Felix Hill, S. C. Chan, Andrew M. Saxe
International Conference on Machine Learning