Skip to content

Commit

Permalink
Fix keyerror in encoder/decoder prompt preproc
Browse files Browse the repository at this point in the history
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
  • Loading branch information
alex-jw-brooks committed Oct 7, 2024
1 parent 2bea363 commit 6c71243
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion vllm/inputs/preprocess.py
Original file line number Diff line number Diff line change
Expand Up @@ -386,7 +386,8 @@ def _process_encoder_decoder_prompt(
decoder_input,
request_id=request_id,
)
mm_processor_kwargs = prompt["mm_processor_kwargs"]
# Handle this carefully in case it was directly initialized by user
mm_processor_kwargs = prompt.get("mm_processor_kwargs", {})
else:
encoder_comps = self._extract_prompt_components(
prompt,
Expand Down

0 comments on commit 6c71243

Please sign in to comment.