Skip to content

Fix the logic for perplexity evaluation (Not enough kv_cache capacity to run generation. Please use a larger sequence_length or a shorter prompt) #5381

Fix the logic for perplexity evaluation (Not enough kv_cache capacity to run generation. Please use a larger sequence_length or a shorter prompt)

Fix the logic for perplexity evaluation (Not enough kv_cache capacity to run generation. Please use a larger sequence_length or a shorter prompt) #5381

Annotations

2 warnings

cli-smoke-tests (3.9, ubuntu-20.04)

succeeded Mar 7, 2024 in 21m 10s