LearnNewsExamplesServices
Frontmatter
id9757
title[AI] Accelerate Vector DB Migration & Recreate Topology Wipe
stateClosed
labels
enhancementaibuild
assigneestobiu
createdAtApr 7, 2026, 4:10 PM
updatedAtApr 7, 2026, 4:12 PM
githubUrlhttps://github.com/neomjs/neo/issues/9757
authortobiu
commentsCount1
parentIssuenull
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtApr 7, 2026, 4:12 PM

[AI] Accelerate Vector DB Migration & Recreate Topology Wipe

Closedenhancementaibuild
tobiu
tobiu commented on Apr 7, 2026, 4:10 PM

Problem

The recent shift from ChromaDB to Native Neo SQLite introduced bugs in the graph destruction utility (recreateGraphDb.mjs), causing the overarching shared SQLite container (memory-core.sqlite) to be unlinked. This accidentally purged non-graph episodic memories. Additionally, the fallback rescue migration script relied heavily on high-latency LLM inference.

Solution

  1. Targeted DB Wipes: recreateGraphDb.mjs has been firmly refactored to utilize internal native .clear() functions via GraphService to flush Node/Edge logic precisely without dropping vector storage.
  2. Fast Vector Transfer: Introduced mechanisms to bypass Ollama.embedText bottlenecks by piping matrix float arrays natively from the legacy Chroma SQLite binary blob directly to the unified tabular SQLiteVectorManager.
tobiu added the enhancement label on Apr 7, 2026, 4:10 PM
tobiu added the ai label on Apr 7, 2026, 4:10 PM
tobiu added the build label on Apr 7, 2026, 4:10 PM
tobiu referenced in commit 90c0971 - "feat(ai): Accelerate Vector DB Migration & Recreate Topology Wipe (#9757) on Apr 7, 2026, 4:11 PM
tobiu assigned to @tobiu on Apr 7, 2026, 4:11 PM
tobiu
tobiu Apr 7, 2026, 4:11 PM

Task completed. The destructive SQLite unlink error has been natively refactored to use GraphService.db.storage.clear() preventing full purges. The historical database matrices have been successfully extracted and reimported, and DreamService correctly resumes its high-latency topological ingestion framework.

tobiu closed this issue on Apr 7, 2026, 4:12 PM