##### ###### ##### ### # # ### # # ###### ## ## ## ## ## ## ## # # # # # ## ##### #### ##### # # # # # # # #### ## # ## ## ## ## # # # # # ## ## # ###### ## ### # ### # ######
##### ###### ##### ### # # ### # # ###### ## ## ## ## ## ## ## # # # # # ## ##### #### ##### # # # # # # # #### ## # ## ## ## ## # # # # # ## ## # ###### ## ### # ### # ######
When memory fails
Even within the context window, quality degrades as you add more tokens. This is called "context rot." The model's ability to recall information from early in the conversation decreases.
Practical impact: that architecture decision you mentioned messages ago? Gone. The model may have forgotten it. You'll learn strategies to manage this later.
