You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm having issue with structured output using local LLM, especially when trying to integrate this project to open-webui. It'd be great if you could allow an environment variable that bypass JSON schema validation for LLMs that don't support it.
The text was updated successfully, but these errors were encountered:
I'm still working on it, but I'm more focused on bigger architecture changes than supporting every model permutation, just don't have the time to do all of that. For most models without structured JSON, you can set structuredOutputs to false to bypass (or refer to AI SDK's documentation for your particular model). Either way, the algorithm requires structured output, although you can coerce the model to returned structured output without having the provider explicitly supporting structured outputs.
I'm having issue with structured output using local LLM, especially when trying to integrate this project to open-webui. It'd be great if you could allow an environment variable that bypass JSON schema validation for LLMs that don't support it.
The text was updated successfully, but these errors were encountered: