LearnNewsExamplesServices
Frontmatter
id9133
titleTune Spider Strategy Probabilities and Enhance Documentation
stateClosed
labels
documentationairefactoring
assigneestobiu
createdAtFeb 13, 2026, 2:45 AM
updatedAtFeb 13, 2026, 2:48 AM
githubUrlhttps://github.com/neomjs/neo/issues/9133
authortobiu
commentsCount1
parentIssue9106
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtFeb 13, 2026, 2:48 AM

Tune Spider Strategy Probabilities and Enhance Documentation

Closed v12.0.0 documentationairefactoring
tobiu
tobiu commented on Feb 13, 2026, 2:45 AM

We are tuning the Spider's discovery probability distribution to prioritize the new "Network Walker" strategy. Since the repository search space is becoming saturated (15k users found), traversing the social graph of these qualified users is now the highest-yield strategy.

Changes:

  1. Rebalance Probabilities:
    • Network Walker: Increase from 15% to **30%**.
    • High Stars: Decrease from 30% to **25%**.
    • Bio Signals / Community: Decrease to ~5%.
    • Stargazer: Decrease to ~5%.
  2. Knowledge Base Enhancement: Add rich, intent-driven JSDoc to Spider.mjs explaining the "Filter Bubble" problem and why the Network Walker is the solution for the current stage of the index.

This shift marks a transition from "Breadth-First Repository Scanning" to "Depth-First Network Traversal".

tobiu added the documentation label on Feb 13, 2026, 2:45 AM
tobiu added the ai label on Feb 13, 2026, 2:45 AM
tobiu added the refactoring label on Feb 13, 2026, 2:45 AM
tobiu added parent issue #9106 on Feb 13, 2026, 2:45 AM
tobiu assigned to @tobiu on Feb 13, 2026, 2:45 AM
tobiu referenced in commit b4fee22 - "feat(devindex): Tune spider strategies & prioritize network walker (#9133)" on Feb 13, 2026, 2:48 AM
tobiu
tobiu Feb 13, 2026, 2:48 AM

Input from Gemini 3 Pro:

✦ I have tuned the Spider's strategy probabilities and enhanced the documentation.

Changes:

  1. Rebalanced Probabilities:
    • Network Walker: 30% (Primary)
    • High Stars: 25%
    • Keyword: 20%
    • Temporal: 15%
    • Community/Bio: 5%
    • Stargazer: 5%
  2. CLI Update: Added "🕸️ Network Walker" to the interactive menu in Manager.mjs.
  3. Documentation: Added intent-driven JSDoc to Spider.mjs explaining the "Filter Bubble" problem and the strategic shift to Depth-First traversal.

This configuration positions the "Network Walker" as the primary engine for discovering high-quality candidates beyond the saturated top-repo layer.

tobiu closed this issue on Feb 13, 2026, 2:48 AM