Deep Dive AI

Sit down with Aidan and Claire as they discuss Attention is all you need, the landmark paper underscoring modern AI research. Learn how the transformer architecture revolutionized how computers understand text, and as a result, laid the foundation for ChatGPT and countless other products we use today.

Created with NotebookLM

Sources:

Attention is all you need: https://arxiv.org/abs/1706.03762

The illustrated transformer: https://jalammar.github.io/illustrated-transformer/