This repo contains code to perform the experiments and analysis in our paper: Transformers Struggle to Learn to Search

If you use this code in your work, please cite:

@inproceedings{
  TransformersStruggleToSearch,
  title={Transformers Struggle to Learn to Search},
  author={Abulhair Saparov and Srushti Pawar and Shreyas Pimpalgaonkar and Nitish Joshi and Richard Yuanzhe Pang and Vishakh Padmakumar and Seyed Mehran Kazemi and Najoung Kim and He He},
  booktitle={The Thirteenth International Conference on Learning Representations},
  year={2025},
  url={https://openreview.net/forum?id=qFVVBzXxR2V}
}