Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically breakdown large content #220

Open
swimbo opened this issue Sep 4, 2024 · 0 comments
Open

Automatically breakdown large content #220

swimbo opened this issue Sep 4, 2024 · 0 comments

Comments

@swimbo
Copy link

swimbo commented Sep 4, 2024

As a user, I want the plugin to automatically break apart files that are too large for the context window.

e.g.
If a file is 350,000 characters and the context window is 80,000, then it should automatically break it up into (350000/80000)= 4.375 rounds up to 5 chunks.
Then those five chunks should each go into the template.
Then the five templates should go in again into the template
Final output should be a single output file with links to:

  • The original file
  • The five summaries used as inputs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant