Skip to content

Commit

Permalink
Dummy
Browse files Browse the repository at this point in the history
  • Loading branch information
sroy745 committed Oct 6, 2024
1 parent 2a484cb commit 56b446d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions vllm/core/block_manager_v2.py
Original file line number Diff line number Diff line change
Expand Up @@ -151,6 +151,7 @@ def _allocate_sequence(self, seq: Sequence) -> BlockTable:
block_allocator=self.block_allocator,
max_block_sliding_window=self.max_block_sliding_window,
)

if seq.get_token_ids():
# Add blocks to the block table only if the sequence is non empty.
block_table.allocate(seq.get_token_ids())
Expand Down

0 comments on commit 56b446d

Please sign in to comment.