llm-echo 0.5
###
### Simon Willison's blog
### ---
I'm working towards a new LLM release, and testing PRs caused me to revisit the llm-echo debug plugin. This plugin provides a "model" which doesn't involve an LLM at all - it just repeats back the prompts that have been fed to it. The new release now updates the simulated token usage counts to take tool calls, system prompts, and reasoning tokens into account.
Example usage: uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage Outputs:
First I consider the prompt, then I decide what to say. { "prompt": "hi there", "system": "", "attachments": [], "stream": true, "previous": [] } Token usage: 2 input, 24 output Tags: llm
正文抓取自 Simon Willison's blog 官方开放接口;版权归原文作者与出版方所有,仅供学习使用。