LearnNewsExamplesServices
Frontmatter
id7242
titleRefine AI Query Scoring for Release Notes
stateClosed
labels
enhancement
assigneestobiu
createdAtSep 23, 2025, 4:37 PM
updatedAtSep 23, 2025, 4:38 PM
githubUrlhttps://github.com/neomjs/neo/issues/7242
authortobiu
commentsCount1
parentIssuenull
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtSep 23, 2025, 4:38 PM

Refine AI Query Scoring for Release Notes

Closed v10.9.0 enhancement
tobiu
tobiu commented on Sep 23, 2025, 4:37 PM

Following the integration of release notes into the knowledge base, it has become apparent that the query scoring algorithm needs refinement to handle this new content type appropriately.

This ticket covers two key adjustments to the scoring logic in buildScripts/ai/queryKnowledgeBase.mjs.

Scope of Work

  1. Improve Version Number Matching:

    • When a query appears to be a version number (e.g., "v10.8.0"), the scoring algorithm should give a very high boost to the release note file that has an exact or very close match in its filename.
    • This will ensure that searching for a specific version reliably returns the correct release notes as the top result.
  2. Adjust Global Priority for Release Notes:

    • When a query is performed without a specific type filter (i.e., type: 'all'), chunks with the type release should be given a lower base score or a negative modifier.
    • This is to prevent release notes from cluttering the results of common technical or conceptual queries, where src, guide, or example files are almost always more relevant.
    • The goal is to make release notes highly accessible when explicitly searched for, but unobtrusive during general-purpose queries.

Acceptance Criteria

  • Running npm run ai:query -- -q "v10.8.0" -t release returns /Users/Shared/github/neomjs/neo/.github/RELEASE_NOTES/v10.8.0.md as the top result.
  • Running a general query like npm run ai:query -- -q "reactivity" does not show release notes in the top results, prioritizing src and guide files.
  • The new scoring logic is well-documented within the queryKnowledgeBase.mjs script.
tobiu assigned to @tobiu on Sep 23, 2025, 4:37 PM
tobiu added the enhancement label on Sep 23, 2025, 4:37 PM
tobiu referenced in commit 2243864 - "Refine AI Query Scoring for Release Notes #7242" on Sep 23, 2025, 4:38 PM
tobiu
tobiu Sep 23, 2025, 4:38 PM
Image
tobiu closed this issue on Sep 23, 2025, 4:38 PM