Repository navigation

[SYSTEMDS-3779] Add ColGroupDDCLZW with LZW-compressed MapToData - #2398

Closed

florian-jobs wants to merge 42 commits into

apache:mainfrom

LukaDeka:ColGroupDDCLZW2

Closed

[SYSTEMDS-3779] Add ColGroupDDCLZW with LZW-compressed MapToData#2398
florian-jobs wants to merge 42 commits into
apache:mainfrom
LukaDeka:ColGroupDDCLZW2

Commits on Jan 7, 2026
- Second skeleton for ColGroupDDCLZW using the IMapToDataInterface and extending on APreAgg like ColGroupDDC for easier implementation. Idea: store only compressed version of _data vector and importa…
  florian-jobs
  committed
  ee9e94f
Commits on Jan 8, 2026
- Idea:
  florian-jobs
  committed
  007611c
Commits on Jan 9, 2026
- More TODOS written and cleaned up project.
  florian-jobs
  committed
  b1bf906
Commits on Jan 10, 2026
- Dictionary initialisierung für Compress und rudimentäre Implementierung von Decompress
  Annika Lehmann
  committed
  8027458
- Uebersichtlichkeit verbessert
  Annika Lehmann
  committed
  ef3b834
Commits on Jan 11, 2026
Commits on Jan 12, 2026
- Added convertToDDCLZW() method to ColGroupDDC Class. Added convertToDDC test for ColGroupDDCTest. Improved compress/decompress methods in LZW class.
  florian-jobs
  committed
  b7911d7
- Started working on ColGroupDDCLZW's other methods that need to be implemted from its Interface.
  florian-jobs
  committed
  1dfe91e
Commits on Jan 13, 2026
- test commit
  florian-jobs
  committed
  3156863
- [SYSTEMDS-3779] Added new Compression and ColGroup Types DDCLZW.
  florian-jobs
  committed
  10d5776
- [SYSTEMDS-3779] Introduce initial ColGroupDDCLZW with LZW-compressed mapping
  florian-jobs
  committed
  3c9e2ed
Commits on Jan 15, 2026
- Decompression to a specific index
  Annika Lehmann
  committed
  a8df1fe
Commits on Jan 16, 2026
Commits on Jan 17, 2026
- [SYSTEMDS-3779] Intermediate DDCLZW Scheme
  Annika Lehmann
  committed
  9e2cf11
Commits on Jan 18, 2026
Commits on Jan 19, 2026
- [SYSTEMDS-3779] Increased sliceRows performance by using iterator. Added decompressToDenseBlockDenseDictionary [WIP] needs to be tested further. Added fallbacks to ddc for variouos functions. Added…
  florian-jobs
  committed
  ddd2a8b
- Added various fallbacks to ddc for functions with complex access patterns. Added append and appendNInternal, recompress and various other functions that needed to be implemented. No tests yet.
  florian-jobs
  committed
  a8735e1
Commits on Jan 21, 2026
- Added various functions which can be implemented by decoding the lzw mapping sequentially. reverted ColGroupDDC formatting again. Reverted CompressedSizeInfoColGroup formatting and adding DDCLZW pa…
  florian-jobs
  committed
  72a439b
- [SYSTEMDS-3779] Added benchmark 'tests' with helpers for DDCLZW vs DDC
  LukaDeka
  committed
  8e6ebcf
Commits on Jan 28, 2026
- [SYSTEMDS-3779] Entropy, reworked benchmarks
  LukaDeka
  committed
  3256e81
Commits on Jan 30, 2026
Commits on Jan 31, 2026
- [SYSTEMDS-3779] refactored benchmark+test helpers in util file, minor improvements to tests
  LukaDeka
  committed
  105c449
- [SYSTEMDS-3779] simplified unit tests, injected more randomized data
  LukaDeka
  committed
  099b690
Commits on Feb 4, 2026
- [SYSTEMDS-3779] Changed ColGroupDDCLZWBenchmark class to use estimateInMemorySize instead of getExactSizeOnDisk for memory estimation.
  florian-jobs
  committed
  67b498c
Commits on Feb 15, 2026
- [SYSTEMDS-3779] Verified equivalent reconstruction for tested matrices in benchmark class. Improved testing class.
  florian-jobs
  committed
  ad03b4a
Commits on Mar 14, 2026
- [SYSTEMDS-3779] Fixed usage of wrong indexing variable in decompressToSparseBlockTransposedSparseDictionary.
  florian-jobs
  committed
  923158a

Commits

Commits on Jan 7, 2026

Commits on Jan 8, 2026

Commits on Jan 9, 2026

Commits on Jan 10, 2026

Commits on Jan 11, 2026

Commits on Jan 12, 2026

Commits on Jan 13, 2026

Commits on Jan 15, 2026

Commits on Jan 16, 2026

Commits on Jan 17, 2026

Commits on Jan 18, 2026

Commits on Jan 19, 2026

Commits on Jan 21, 2026

Commits on Jan 28, 2026

Commits on Jan 30, 2026

Commits on Jan 31, 2026

Commits on Feb 4, 2026

Commits on Feb 15, 2026

Commits on Mar 14, 2026