[deepsparse.benchmark] enable internal kv cache by default#1335

Merged

mgoin merged 5 commits intomainfrom default-benchmark-internal-kv

Oct 19, 2023

+44-6

Commits on Oct 19, 2023

[deepsparse.benchmark] enable internal kv cache by default
Benjamin
committed
remove requirement for sequence length to be set to run in kv cache mode
Benjamin
committed
add option to disable all kv cache overrides
Benjamin
committed
add store_true
Benjamin
committed
argparse fix
Benjamin
committed