Skip to content

Commit

Permalink
Fix up analysis
Browse files Browse the repository at this point in the history
  • Loading branch information
mgoin committed Oct 19, 2023
1 parent c9bcf10 commit f1367f8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/deepsparse/debug_analysis.py
Original file line number Diff line number Diff line change
Expand Up @@ -380,7 +380,7 @@ def main():

batch_size = args.batch_size

if not args.disable_kv_cache_override and has_model_kv_cache(model_path):
if not args.disable_kv_cache_overrides and has_model_kv_cache(model_path):
if not args.sequence_length:
args.sequence_length = infer_sequence_length(model_path)
if args.input_ids_length > args.sequence_length:
Expand Down

0 comments on commit f1367f8

Please sign in to comment.