Concept detail
pretraining distribution
0 tagged videos · 1 connection videos · degree 0
Publication timeline
- 2025-111 video
Source videos
Observed neighbors
biological priors from evolution
Both act as the start state on which RL operates, suggesting priors rather than the RL loop explain differing sample efficiency.
1 source videos
Ilya Sutskever – We're moving from the age of scaling to the age of researchRelated tagged insights
No core insights are tagged with this concept.