Concept detail
step-size optimization
0 tagged videos · 1 connection videos · degree 0
Publication timeline
- 2026-081 video
Source videos
Observed neighbors
catastrophic forgetting
Proposed mechanism for preventing the failure mode; per-parameter step sizes regulate how much prior knowledge a new update can overwrite.
1 source videos
Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It AgainRelated tagged insights
No core insights are tagged with this concept.