Skip to content

Commit

Permalink
format
Browse files Browse the repository at this point in the history
Signed-off-by: NickLucche <[email protected]>
  • Loading branch information
NickLucche committed Jan 21, 2025
1 parent a1de4bc commit 7e776b6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/attention/backends/xformers.py
Original file line number Diff line number Diff line change
Expand Up @@ -606,7 +606,7 @@ def forward(
self.num_kv_heads,
self.scale,
self.alibi_slopes,
# TODO (NickLucche) cross_attn_bias not needed for T5-like
# TODO (NickLucche) cross_attn_bias not needed for T5-like
# models, abstract bias selection if needed.
decode_meta.attn_bias,
layer._k_scale,
Expand Down

0 comments on commit 7e776b6

Please sign in to comment.