Glossary
Transformer
Also: transformer
The neural network architecture behind modern LLMs. It processes a sequence of tokens through layers of attention, without recurrent or convolutional networks.
Example
The T in GPT stands for Transformer. The architecture was described in 2017 in “Attention Is All You Need”.