Ttruong/v2.6.3 alibi as bh bias - #4

Draft

timt51 wants to merge 26 commits into

main-2026-05-06from

ttruong/v2.6.3-alibi-as-bh-bias

Commits on Sep 6, 2024

convert alibi bias to simply bh bias (same as alibi without dependence on position idx)
timt51
committed
aebc5a7
publish fewer versions
timt51
committed
cfca2e8

Commits on Sep 7, 2024

fix diagonal bias
timt51
committed
14b704d
try just setting bias to 0 when Col_idx_only
timt51
committed
5996687
try disabling Col_idx_only if alibi
timt51
committed
3b267ff

Commits on Sep 8, 2024

fix bh bias diagonal handling
timt51
committed
b9ec215

Commits on Feb 5, 2025

compile for pytorch 2.5.1
timt51
authored
42a895e
fix TORCH_CUDA_VERSION env var for pytorch 2.5
timt51
authored
f124d98

Commits on Feb 7, 2025

adjust alibi for non causal too
timt51
authored
4f8b153
compile for torch 2.4.1 too
timt51
authored
d2dd0fd
make a version that always adds the alibi slope...
timt51
authored
980f524
...and only compile for py310 and torch24
timt51
authored
c42bf6b
redo causal and noncausal alibi for diagonal
timt51
authored
a8d7fcc
bidirectional diagonal handling - take into account seqlens
timt51
authored
599e322
fix diagonal formula
timt51
authored
fdc50f3

Commits on Feb 8, 2025

Commits on Mar 24, 2025

Revert "alibi.h use the non max seqlen formula which seems more correct actually?"
timt51
committed
5b937eb
Revert "Update mask.h"
timt51
committed
cb7632e
publish for pytorch 2.5.1 and 2.6.0 too
timt51
authored
7104b34

Commits on Mar 25, 2025

export minv and maxv for pytorch 2.6
timt51
authored
4ebb8be

Commits on May 5, 2026

compile for py3.13 torch2.11 cu12+cu13
timt51
committed
9bbcc26
don't restrict packages as we need cusparse to compile extensions...
timt51
committed
84f8cb4