Skip to content

Chat Templating - Missing info on Tools and RAG #1642

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
JosephLeyva opened this issue Mar 18, 2025 · 0 comments
Open

Chat Templating - Missing info on Tools and RAG #1642

JosephLeyva opened this issue Mar 18, 2025 · 0 comments

Comments

@JosephLeyva
Copy link

Doc request
On the chat template documentation, on the Tools section, there is missing information of how to trigger the function.

Tools and RAG
Here, before calling the model to read the chat template:

tool_call = {"name": "get_current_temperature", "arguments": {"location": "Paris, France", "unit": "celsius"}}
messages.append({"role": "assistant", "tool_calls": [{"type": "function", "function": tool_call}]})
# missing line:
messages.append({"role": "tool", "name": "get_current_temperature", "content": "22.0"})

I had to go to the Hermes 2 model in order to make the "call" of the function.

Additional context
They have a Jupyter Notebook on their Github that uses Function Calling implementation. Link

Here, they don't hardcode the tool_call and message.append(), instead they do it dynamically.

@JosephLeyva JosephLeyva changed the title Chat Templating - Tools and RAG Chat Templating - Missing info on Tools and RAG Mar 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant