I am stuck on long-document context. I need to work through a long document without losing definitions, exceptions, or open questions, but my current attempt is getting vague and too big. What would you check first?
Forked from @sanaraman/My notes from fixing long-document context
My notes from fixing long-document context
I wanted help with long-document context without pretending the model knew facts I had not provided.
First, shrink the decision. Do not solve the whole subject at once.
- Put the source of truth in the prompt.
- Mark missing evidence instead of filling it in.
- Add a stop condition before tool use.
Write down the result you need by the end of this session. Then choose one input you trust and make a first pass that can be checked. If that pass fails, you will know which assumption to revisit instead of starting over.
The smaller decision was the missing piece. I was asking for the whole system at once.
2 comments
Sign in to join the conversation.