Repository navigation

4bit quantization for arbitrary `nn.Parameter` - #1720

Merged

matthewdouglas merged 9 commits into

mainfrom

parametrize-4bit

Sep 8, 2025

Merged

4bit quantization for arbitrary `nn.Parameter`#1720
matthewdouglas merged 9 commits into
mainfrom
parametrize-4bit

Commits on Sep 3, 2025
- Add parametrize util for targeting parameters outside of nn.Linear modules
  matthewdouglas
  committed
  4db78c9
- Parametrize 4bit: replace existing prequantized weight
  matthewdouglas
  committed
  0ca40cc
- cleanup
  matthewdouglas
  committed
  2ad1e62
- Add caching for parametrization
  matthewdouglas
  committed
  50fe09d
- Add tests
  matthewdouglas
  committed
  60725f2
- Fix tests
  matthewdouglas
  committed
  0d5cda7
- Guard for torch < 2.5
  matthewdouglas
  committed
  794710d
- Guard for torch < 2.5
  matthewdouglas
  committed
  62267d7
Commits on Sep 5, 2025
- Another test gaurd for torch >= 2.5
  matthewdouglas
  committed
  7fa6973