瀏覽代碼

fix(model_runtime): ensure compatibility with O1 models by adjusting token parameters (#10537)

-LAN- 5 月之前
父節點
當前提交
867bf70f1a
共有 1 個文件被更改,包括 4 次插入0 次删除
  1. 4 0
      api/core/model_runtime/model_providers/openai/llm/llm.py

+ 4 - 0
api/core/model_runtime/model_providers/openai/llm/llm.py

@@ -617,6 +617,10 @@ class OpenAILargeLanguageModel(_CommonOpenAI, LargeLanguageModel):
         # o1 compatibility
         block_as_stream = False
         if model.startswith("o1"):
+            if "max_tokens" in model_parameters:
+                model_parameters["max_completion_tokens"] = model_parameters["max_tokens"]
+                del model_parameters["max_tokens"]
+
             if stream:
                 block_as_stream = True
                 stream = False