Concept detail
attention mechanism mechanics
0 tagged videos · 1 connection videos · degree 0
Publication timeline
- 2026-081 video
Source videos
Observed neighbors
nanoGPT minimal reference implementation
A ~300-line PyTorch GPT-2 reproduction plus a tiny character-level dataset makes the query/key/value computation directly inspectable and modifiable for mechanism experiments.
1 source videos
Andrej Karpathy Stanford Lecture: Delete Everything, Keep GraphRelated tagged insights
No core insights are tagged with this concept.