Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-Ranking + PDF UI fix + Character Chat Refactor #333

Merged
merged 22 commits into from
Oct 8, 2024
Merged

Re-Ranking + PDF UI fix + Character Chat Refactor #333

merged 22 commits into from
Oct 8, 2024

Conversation

rmusser01
Copy link
Owner

Added re-ranking to RAG pipeline via flashrank;
Updated UI for pdf uploads so it now displays the filename;
Working on refactoring character chat tab so that:

  1. Character chats will be separate from everything else
  2. Fully Searchable
  3. Re-usable
  4. RAG-able (without worrying about other data)
  5. make it easier for me to setup a RAG-Chat pipeline, so you can have an 'ongoing' convo.

Silly Tavern deprecated the plugin... 3 months ago.... I'll trust the pros on this. Will skip it for now. Can look at something else in the future. In the meantime, RAG + jinja templates should be fine enough once added
…rsing

wew. Haven't tested it and its not hooked up but its there.
also updated v2 handling
Also added char card v3 parsing logic + test for it, all 1=shotted thanks to o1. (Go figure, works great for that, but you ask it to fix a test, wew; yea, i know about the benchmarks)
@rmusser01
Copy link
Owner Author

Updated Character Chat, added RAG, then ripped it out, some if it is still in there, but plan to implement later on. Also added support for Character Card v1/v2 importing, and put in a first stab at a char card v3 parser (+ test!) Granted, didn't actually hook it up/test it out with a random card, but its there.
Plan is to setup both (card v3+RAG) together during the next 'sprint'

@rmusser01 rmusser01 merged commit 5ccd81c into main Oct 8, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant