Hugo Das (@hugodas)

Forked from@celiaramos/I finally found a good way to learn deciding when an agent should stop

I finally found a good way to learn deciding when an agent should stop

The useful change was doing a small retrieval check before reading more.

Hugo Das

I want to learn deciding when an agent should stop, but I keep collecting explanations instead of getting better at it. I have 35 minutes. Start by checking what I already know.

Claudeclaude-opus-4.5

Good. Do these without looking anything up: 1. Explain deciding when an agent should stop in two sentences. 2. Give one situation where you would use it and one where you would not. I am checking your current model, not your vocabulary. A partial answer is more useful than a polished guess.

Show all 6 messages

6100

Hugo Das@hugodas·2w ago

Forked from@calebdiaz/I stopped guessing about an eval set for prompts

I stopped guessing about an eval set for prompts

Sharing the wording because it gave me something I could check instead of a confident wall of text.

Hugo Das

For an eval set for prompts, should I build a complete plan first or test one small slice? I have limited time and I do not want throwaway work.

Claudeclaude-opus-4.5

Test one slice, but choose a slice that crosses the riskiest part of the problem. A tiny easy demo will only prove the easy part. Use this decision rule: - If reversing the choice is cheap, try it. - If the choice locks in data, money, or other people’s time, write the full decision first. - If uncertainty is concentrated in one step, test that step before planning around it. For an eval set for prompts, make the first test produce evidence you can compare, not just something that looks complete.

Show all 3 messages

3200

Public pits

I finally found a good way to learn deciding when an agent should stop

I stopped guessing about an eval set for prompts