Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Bypass JSON schema validation #113

Open
gahoccode opened this issue Feb 28, 2025 · 3 comments
Open

Support for Bypass JSON schema validation #113

gahoccode opened this issue Feb 28, 2025 · 3 comments

Comments

@gahoccode
Copy link

I'm having issue with structured output using local LLM, especially when trying to integrate this project to open-webui. It'd be great if you could allow an environment variable that bypass JSON schema validation for LLMs that don't support it.

@BrownTan
Copy link

The project is dead.

@gahoccode
Copy link
Author

The project is dead.

That's sad. This had so much potential. The Open WebUI intergration is sweet!

@dzhng
Copy link
Owner

dzhng commented Mar 24, 2025

I'm still working on it, but I'm more focused on bigger architecture changes than supporting every model permutation, just don't have the time to do all of that. For most models without structured JSON, you can set structuredOutputs to false to bypass (or refer to AI SDK's documentation for your particular model). Either way, the algorithm requires structured output, although you can coerce the model to returned structured output without having the provider explicitly supporting structured outputs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants