← Introduction to Machine Learning
The Transformer Architecture
Resources
Books
Papers and Reports
- Vaswani, A., et al. (2017). Attention is all you need. Advances in neural information processing systems
- Devlin, J., et al. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- Radford, A., et al. (2019). Language models are unsupervised multitask learners. OpenAI blog
- OpenAI. (2023). GPT-4 Technical Report
- Paleyes. (2025). LLM Performance for Code Generation on Noisy Tasks
- Sendyka. (2025). Prompt Variability Effects On LLM Code Generation