Merge pull request #408 from s-kostyaev/fix-issue-342-max-tokensexternals/ellama

Add max token limit support

1 files changed, 6 insertions, 3 deletions

diff --git a/README.org b/README.org
index fe12856..8f01f30 100644
--- a/README.org
+++ b/README.org
@@ -174,9 +174,10 @@ More sophisticated configuration example:
 - ~ellama-provider-select~: Select ellama provider.
 - ~ellama-select-model~: Change the current provider model interactively.  The
   model transient supports Ollama and OpenAI-compatible providers, including URL
-  editing for compatible APIs.  Use "Reset model fields" to clear model,
-  temperature, and context-length overrides and let the provider use its
-  defaults; reset values are shown as ~default~ in the transient.
+  editing for compatible APIs.  It can also set the maximum number of output
+  tokens.  Use "Reset model fields" to clear model, temperature, context-length,
+  and max-token overrides and let the provider use its defaults; reset values
+  are shown as ~default~ in the transient.
 - ~ellama-code-complete~: Complete selected code or code in the current buffer
   according to a provided change using Ellama.
 - ~ellama-code-add~: Generate and insert new code based on description. This
@@ -316,6 +317,8 @@ language is english.
 There are many supported providers: ~ollama~, ~open ai~, ~vertex~,
 ~GPT4All~. For more information see
 [[https://elpa.gnu.org/packages/llm.html][llm documentation]].
+- ~ellama-max-tokens~: Maximum number of tokens to generate.  If not set, use
+  the provider default.
 - ~ellama-providers~: association list of model llm providers with name as key.
 - ~ellama-spinner-enabled~: Enable spinner during text generation.
 - ~ellama-spinner-type~: Spinner type for ellama. Default type is