Skip to content

Improve cache mechanism with parallelism support and metadata - #127

Merged
Gaudy Blanco (gaudyb) merged 1 commit into
cache-implementationfrom
agents/cache-improvements-parallelism-ideas
Sep 18, 2026
Merged

Gaudy Blanco (gaudyb) merged 1 commit into
cache-implementationfrom
agents/cache-improvements-parallelism-ideas

Conversation

@gaudyb

Copy link
Copy Markdown
Contributor

This pull request introduces significant improvements to the caching mechanism, focusing on enhancing parallelism and adding metadata support for cache keys. The changes aim to address previous issues with local cache locking and to facilitate better reproducibility of results.

Key Changes:

  • New Cache Implementation: Introduced a SQLite-based caching system to replace the previous JSONL format, allowing for concurrent reads and serialized writes, thus reducing contention and deadlock risks.
  • Metadata Addition: Cache keys now include metadata to track model settings and configurations, enabling users to replicate results and understand discrepancies.
  • Refactored Code: Major refactoring in cache.py, scoring.py, and related modules to support the new caching strategy and improve code maintainability.
  • Testing Enhancements: Added comprehensive tests for the new caching mechanism, ensuring robustness under concurrent access scenarios.
  • Documentation Updates: Updated relevant documentation to reflect changes in the caching strategy and usage instructions.

These enhancements are designed to improve the overall performance and reliability of the caching system, particularly in environments requiring high concurrency.

- Add new caching mechanisms in `cache.py` and related modules.
- Update CLI and documentation to reflect new features.
- Enhance tests for chunk assertions and caching functionality.
@gaudyb
Gaudy Blanco (gaudyb) changed the base branch from main to cache-implementation September 18, 2026 18:39
@gaudyb
Gaudy Blanco (gaudyb) merged commit 3bad146 into cache-implementation Sep 18, 2026
2 of 4 checks passed
@gaudyb
Gaudy Blanco (gaudyb) deleted the agents/cache-improvements-parallelism-ideas branch September 18, 2026 18:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant