Skip to content
PrepMint

Guides tagged latency

2 PrepMint guides tagged latency — written from using the tools and checked against the vendor's own documentation.

  • How it works · 11 min read

    Where you edit your prompt decides what it costs

    The session was fast for twenty turns, then you added one line to the top of a file and the next answer crawled. A prompt cache is keyed on an exact prefix, so cost and latency depend on where you changed something, not how much. The ordering rule that falls out of it.

  • Choosing a model · 11 min read

    When to use a reasoning model — and the tasks where it makes things worse

    Every assistant now has a thinking dial, and almost nobody tells you which task deserves it. One test decides it: does this task have a step where being wrong in the middle makes the answer wrong? The shapes where deliberation pays, the shapes where it only buys latency, and the failure no setting can fix.