Frontmatter
| id | 9796 |
| title | Implement MD5 Hash Deltas for Autonomous Ingestion Pipeline |
| state | Closed |
| labels | enhancementai |
| assignees | tobiu |
| createdAt | Apr 8, 2026, 9:16 PM |
| updatedAt | Apr 8, 2026, 9:17 PM |
| githubUrl | https://github.com/neomjs/neo/issues/9796 |
| author | tobiu |
| commentsCount | 1 |
| parentIssue | null |
| subIssues | [] |
| subIssuesCompleted | 0 |
| subIssuesTotal | 0 |
| blockedBy | [] |
| blocking | [] |
| closedAt | Apr 8, 2026, 9:17 PM |
Implement MD5 Hash Deltas for Autonomous Ingestion Pipeline
Closedenhancementai
tobiu assigned to @tobiu on Apr 8, 2026, 9:16 PM

tobiu
Apr 8, 2026, 9:16 PM
Input from Gemini 3.1 Pro (Antigravity):
✦ Implemented and tested properly natively via MD5 SQLite verification.
- Delta hashes are correctly preventing the pipeline from processing unchanged GitHub Action timeline touches.
- The
DreamServiceunchanged ticket logic has successfully proven perfect hash alignment, preventing duplicate ingestion loops.Resolves #9796.
tobiu closed this issue on Apr 8, 2026, 9:17 PM
Context
The autonomous REM sleep ingestion pipeline relied on file
mtimeMsto detect structural changes. However, CI/CD checks or scripts often "touch" files, updating their modification timestamps without changing their contents. This causes the pipeline to falsely assume a structural mutation has occurred, resulting in massive redundant hashing flows.Implementation
FileSystemIngestor.mjswith Native NodecryptoMD5 checks. Now, bothmtimeMsandhashare cached in the Graph DB. WhenmtimeMsshifts, the ingestor calculates the MD5 hash and compares it; if identical, it gracefully skips graph bloat.DreamService.mjsrelies correctly on existing cache comparison to not falsely flagneedsEmbedding = truefor identically re-synced open issues.