support functionary models

[mudler]

Functionary models are trained to output functions.

We should just provide a flag to turn off calculating BNF grammars as we are already doing and just leave to the LLM to answer appropriately.

[bdqfork]

It may also be necessary to provide a method to inject the definition of the tool as json string into the prompt template.

[mudler]

It may also be necessary to provide a method to inject the definition of the tool as json string into the prompt template.

that's already present, you can render in the template by ranging over {{.Functions}}. See for example:

LocalAI/embedded/models/hermes-2-pro-mistral.yaml

Line 23 in f9c75d4

{{range .Functions}}

[olariuromeo]

Will be nice , to use functionary models do you have already a yaml recipe for the functionary models?