Repository navigation
feat(knowledge): add portable storage and guarded migration tools - #587
Merged
Merged
Conversation
Add session-bound Markdown editing and bounded source-row imports with stable mappings, revision checks, multiline values, and owner isolation. Serialize database persistence recovery and compact the NeDB journal. Preserve unread Mate digest content with durable within-message cursors. Cover workflows, capacity, restart, backup restore, and failure recovery. Retain the current 20000-record and 16 MiB database limits. Validation: 88 combined tests passed, plus syntax and diff checks.
Define an engine-neutral persistence contract and injectable factory. Move NeDB lifecycle, paths, serialized recovery and maintenance into its adapter while preserving aggregate data, limits and tool behavior. Verify independent memory-backed workflows, blocked NeDB loading and compatibility with existing stored identities, history and receipts. SQLite implementation remains future work.
Contributor
|
This issue has been resolved in version 5.2.0-beta.3 (main). To update, run: -- Clay Deploy Bot Build anything, with anyone, in one place. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Knowledge storage was tied directly to NeDB, and Mate migration workflows lacked guarded text writes and resumable bulk imports. This adds a replaceable persistence contract while retaining NeDB as the default and preserving existing data, IDs, revisions, history and receipts.
Current application limits remain 20,000 records and 16 MiB per aggregate. Imports use batches of up to 100 rows/256 KiB, with bounded NeDB journal maintenance.
Validation: the full repository suite passed on Node 22.22.1: 3,430 passed, 2 skipped, 0 failed. Adapter contract and legacy-data compatibility tests also passed independently. GitHub checks must pass before merge. Synthetic tests cover 8,563 vocabulary rows, 537 finance rows, 20,000-row capacity, process restart/backup restore, persistence failures and concurrent recovery. No live records were migrated or server restarted.