Skip to content

Releases: 404-Repo/text-prompt-generator

prompt generator 0.1.0

21 Aug 12:27
061e49a
Compare
Choose a tag to compare

Updates:
vLLM backend:

  • added support for inferencing models on multiple GPUs;
  • added extra parameters for controlling the process of generation;
  • added support for speculative decoding (https://docs.vllm.ai/en/latest/models/spec_decode.html, experimental vLLM feature);
  • added several optimizations;

Other:

  • improved instruction prompt;
  • adjusted object categories from where objects are being sampled;
  • bug fixes

prompt generator 0.0.0

15 Aug 16:33
510dbcf
Compare
Choose a tag to compare

Updates:

  • Reworked structure of the project. Now it is easy to add new backends if needed;
  • Code is cleaner;
  • Better instruction prompt;
  • More categories that are used for prompt generation;