One attention head carries knight forks in a chess transformer, and here's a new toolkit that found it.

Researchers discovered that a single attention head in a chess-focused transformer model is responsible for recognizing knight fork tactics. They developed a new toolkit to identify such specialized functions within the model's architecture.