Bug: not support langchain v0.3 to use tools #10214
Labels
bug-unconfirmed
high severity
Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow)
What happened?
request: request: POST /v1/chat/completions 192.168.139.86 500
request:
{
"messages": [{
"content": "98平米的房屋总价是多少",
"role": "user"
}],
"model": "qwen-plus",
"n": 1,
"stream": false,
"temperature": 0.7,
"tools": [{
"type": "function",
"function": {
"name": "magic_function",
"description": "根据房屋面积,计算房屋价格。input 是房屋面积单位是平米,返回的结果是房屋价格,单位是元",
"parameters": {
"properties": {
"input": {
"type": "integer"
}
},
"required": ["input"],
"type": "object"
}
}
}]
}
response:
{
"error": {
"code": 500,
"message": "Unsupported param: tools",
"type": "server_error"
}
}
Name and Version
(base) [root@localhost llama.cpp-master]# ./llama-cli --version
version: 0 (unknown)
built with cc (GCC) 9.3.1 20200408 (Red Hat 9.3.1-2) for x86_64-redhat-linux
What operating system are you seeing the problem on?
Linux
Relevant log output
The text was updated successfully, but these errors were encountered: