Skip to content

Commit

Permalink
fix blocksparse tests
Browse files Browse the repository at this point in the history
Signed-off-by: NickLucche <[email protected]>
  • Loading branch information
NickLucche committed Jan 15, 2025
1 parent e072721 commit f37d776
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 0 deletions.
2 changes: 2 additions & 0 deletions tests/kernels/test_blocksparse_attention.py
Original file line number Diff line number Diff line change
Expand Up @@ -228,6 +228,7 @@ def test_paged_attention(
block_size,
max_seq_len,
alibi_slopes,
None, # TODO add custom bias
kv_cache_dtype,
k_scale,
v_scale,
Expand Down Expand Up @@ -265,6 +266,7 @@ def test_paged_attention(
block_size,
max_seq_len,
alibi_slopes,
None,
kv_cache_dtype,
k_scale,
v_scale,
Expand Down
1 change: 1 addition & 0 deletions vllm/attention/ops/ipex_attn.py
Original file line number Diff line number Diff line change
Expand Up @@ -103,6 +103,7 @@ def forward_decode(
block_size,
max_context_len,
alibi_slopes,
None, # TODO add custom bias
kv_cache_dtype,
k_scale,
v_scale,
Expand Down

0 comments on commit f37d776

Please sign in to comment.