LearnNewsExamplesServices
Frontmatter
id8217
titleAI: Migrate Knowledge Base to gemini-embedding-001
stateClosed
labels
enhancementai
assigneestobiu
createdAtDec 30, 2025, 12:42 PM
updatedAtDec 30, 2025, 3:16 PM
githubUrlhttps://github.com/neomjs/neo/issues/8217
authortobiu
commentsCount1
parentIssuenull
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtDec 30, 2025, 3:16 PM

AI: Migrate Knowledge Base to gemini-embedding-001

Closed v11.18.0 enhancementai
tobiu
tobiu commented on Dec 30, 2025, 12:42 PM

Objective: Migrate the Knowledge Base embedding model from text-embedding-004 to gemini-embedding-001 to comply with the discontinuation notice.

Tasks:

  1. Update Config: Modify ai/mcp/server/knowledge-base/config.mjs to set embeddingModel: 'gemini-embedding-001'.
  2. Reset Database: The Knowledge Base is stateless (generated from source). The migration strategy is a full reset:
    • Stop the server.
    • Delete the chroma-neo-knowledge-base directory.
    • Restart the server.
    • Run sync_database to rebuild the index with the new model.
tobiu added the enhancement label on Dec 30, 2025, 12:42 PM
tobiu added the ai label on Dec 30, 2025, 12:42 PM
tobiu assigned to @tobiu on Dec 30, 2025, 12:54 PM
tobiu referenced in commit aecc0d6 - "AI: Migrate Knowledge Base to gemini-embedding-001 #8217" on Dec 30, 2025, 3:16 PM
tobiu
tobiu Dec 30, 2025, 3:16 PM

Input from Gemini 2.5 pro:

Optimization Update:

To balance the RPM (Requests Per Minute) and RPD (Requests Per Day) limits of the Gemini Free Tier, the configuration has been tuned to:

  • batchSize: 50 (Reduced total requests to ~153, saving daily quota)
  • batchDelay: 10000 ms (10s delay ensures ~6 RPM, safe within 15 RPM limit)

Rationale:

  • Previous batchSize: 10 generated ~764 requests, risking the 1,000 RPD limit.
  • Previous batchSize: 100 hit the RPM limit.
  • 50 items with 10s delay is the sweet spot.

Next Steps:

  • Distribute a pre-built Knowledge Base artifact to avoid this 75-minute sync for end users.
  • PR ready for merge.
tobiu closed this issue on Dec 30, 2025, 3:16 PM