v2.5.4

What's Changed

• Fixed gpt4all_api server after GGUF changes, by @dpsalvatierra in #1659
• Add Orca 2 7B and 13B to the models list (#1672)
• Networking retry on download error for models in the chat UI (#1671)
• Fix a bug that caused the system prompt to be ignored in new chat sessions until the chat was cleared

New Contributors

• @dpsalvatierra made their first contribution in #1659

Full Changelog: v2.5.3...v2.5.4

v2.5.3

What's Changed

• LocalDocs now uses text embeddings to query documents for more accurate retrieval (#1648)
• Fix GUI hang with LocalDocs (#1658)
• Typescript bindings: vulkan and gguf support by @jacoobes in #1390
• Bindings: improve quality of error messages (#1625)

New Contributors

• @aj-gameon made their first contribution in #1607

Full Changelog: v2.5.2...v2.5.3

v2.5.2

What's Changed

• backend: support GGUFv3 (#1582)
• Important fixes for AMD GPUs
• Don't start recalculating context immediately for saved chats
• UI fixes for chat name generation
• UI fixes for leading whitespaces in chat generation

Full Changelog: v2.5.1...v2.5.2

v2.5.0-pre1

Pre-release 1 of version 2.5.0 is now available! This is a pre-release with offline installers and includes:

• GGUF file format support (only, old model files will not run)
• Completely new set of models including Mistral and Wizard v1.2
• Restored support for Falcon model (which is now GPU accelerated)
• Restored support for MPT
• Based on latest llama.cpp as of late September
• Speed improvements and bugfixes to GPU support
• Improved GUI for cpu/gpu fallback
• Numerous other improvements