1. Keep a clean short-term context window
The simplest way to improve retention is to keep the most recent turns in the prompt. This helps the model follow the thread of the current chat. But the context window should stay clean. Remove filler, duplicate text, and dead ends. Keep only the turns that still matter.