Skip to content

Add BF16 support for int8_vectorwise_quant / LLM.int8 activation quant - #1985

Open
kru2710shna wants to merge 4 commits into
bitsandbytes-foundation:mainfrom
kru2710shna:feature/int8-bf16-vectorwise-quant
Open

kru2710shna wants to merge 4 commits into
bitsandbytes-foundation:mainfrom
kru2710shna:feature/int8-bf16-vectorwise-quant

Add native bf16 output support to int8_mm_dequant

786d3f3
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning

The logs for this run have expired and are no longer available.