Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: not support langchain v0.3 to use tools #10214

Open
lee249876293 opened this issue Nov 8, 2024 · 0 comments
Open

Bug: not support langchain v0.3 to use tools #10214

lee249876293 opened this issue Nov 8, 2024 · 0 comments
Labels
bug-unconfirmed high severity Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow)

Comments

@lee249876293
Copy link

What happened?

request: request: POST /v1/chat/completions 192.168.139.86 500

request:
{
"messages": [{
"content": "98平米的房屋总价是多少",
"role": "user"
}],
"model": "qwen-plus",
"n": 1,
"stream": false,
"temperature": 0.7,
"tools": [{
"type": "function",
"function": {
"name": "magic_function",
"description": "根据房屋面积,计算房屋价格。input 是房屋面积单位是平米,返回的结果是房屋价格,单位是元",
"parameters": {
"properties": {
"input": {
"type": "integer"
}
},
"required": ["input"],
"type": "object"
}
}
}]
}

response:

{
"error": {
"code": 500,
"message": "Unsupported param: tools",
"type": "server_error"
}
}

Name and Version

(base) [root@localhost llama.cpp-master]# ./llama-cli --version
version: 0 (unknown)
built with cc (GCC) 9.3.1 20200408 (Red Hat 9.3.1-2) for x86_64-redhat-linux

What operating system are you seeing the problem on?

Linux

Relevant log output

request: POST /v1/chat/completions 192.168.139.86 500
request:  {"messages": [{"content": "98\u5e73\u7c73\u7684\u623f\u5c4b\u603b\u4ef7\u662f\u591a\u5c11", "role": "user"}], "model": "qwen-plus", "n": 1, "stream": false, "temperature": 0.7, "tools": [{"type": "function", "function": {"name": "magic_function", "description": "\u6839\u636e\u623f\u5c4b\u9762\u79ef\uff0c\u8ba1\u7b97\u623f\u5c4b\u4ef7\u683c\u3002input \u662f\u623f\u5c4b\u9762\u79ef\u5355\u4f4d\u662f\u5e73\u7c73\uff0c\u8fd4\u56de\u7684\u7ed3\u679c\u662f\u623f\u5c4b\u4ef7\u683c\uff0c\u5355\u4f4d\u662f\u5143", "parameters": {"properties": {"input": {"type": "integer"}}, "required": ["input"], "type": "object"}}}]}
response: {"error":{"code":500,"message":"Unsupported param: tools","type":"server_error"}}
@lee249876293 lee249876293 added bug-unconfirmed high severity Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow) labels Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug-unconfirmed high severity Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow)
Projects
None yet
Development

No branches or pull requests

1 participant