🇬 refactor: Update default Google Models and Parameters #2782
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Gemini models default to different parameter settings. Eg. the latest models have temperature from 0-2 with default of 1. Max output defaults to 8192, top_p defaults to 0.95. The default model and parameters are for chat-bison which is pretty much a deprecated model that no one uses. My suggestion is to change the default model along with the default parameters to be more in line with the current offerings. Most LibreChat users will use aistudio instead of Vertex anyway, where bison models would be irrelevant.
This PR changes the default model from chat-bison to gemini, as well as updates the default parameters. I also updated the .env.example with the latest / greatest model tags as of 05/18. This should result in a better default experience for most users. I also removed the the PALM / bison family of models from .env.example as they have been mostly superseded by Gemini.
The resulting code is more consistent with the other providers, and would be easier to maintain moving forward. Incoming PR to update documentation as well. LibreChat-AI/librechat.ai#30
Change Type
Please delete any irrelevant options.
Testing
Please describe your test process and include instructions so that we can reproduce your test. If there are any important variables for your testing configuration, list them here.
Test Configuration:
Checklist
Please delete any irrelevant options.