LearnNewsExamplesServices
Frontmatter
id9045
titleFeat: DevRank Active Pruning & Auto-Cleanup
stateClosed
labels
enhancementai
assigneestobiu
createdAtFeb 7, 2026, 11:04 PM
updatedAtFeb 7, 2026, 11:06 PM
githubUrlhttps://github.com/neomjs/neo/issues/9045
authortobiu
commentsCount1
parentIssue8930
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtFeb 7, 2026, 11:06 PM

Feat: DevRank Active Pruning & Auto-Cleanup

Closed v12.0.0 enhancementai
tobiu
tobiu commented on Feb 7, 2026, 11:04 PM

Optimize the DevRank data lifecycle by actively pruning low-value users and enforcing hygiene before operations.

Problem:

  1. Tracker Bloat: Updater.mjs currently keeps low-value users in tracker.json (updating their timestamp). This causes the index to grow indefinitely with users who have already been rejected.
  2. Stale State: Manager.mjs runs update or spider operations potentially on "dirty" data (e.g., users that should have been pruned), leading to wasted processing.

Solution:

  1. Pre-Run Cleanup: Modify Manager.mjs to automatically run Cleanup.run() before executing spider or update commands.
  2. Active Pruning: Modify Updater.mjs to remove users from tracker.json immediately if they fail the contribution threshold, rather than just updating their timestamp.
  3. Storage Support: Enhance Storage.mjs to support key removal in updateTracker (e.g., by accepting null or a specific removal flag).

Benefits:

  • tracker.json stays small and focused on high-value + pending users.
  • update runs never waste API calls on known low-value users (because they are pruned before the run or during the previous run).
  • No need for a massive "Visited Users" database.

Tasks:

  • Refactor Storage.mjs to handle deletions in updateTracker.
  • Refactor Updater.mjs to request deletion for low-value users.
  • Refactor Manager.mjs to inject Cleanup.run().
tobiu added the enhancement label on Feb 7, 2026, 11:04 PM
tobiu added the ai label on Feb 7, 2026, 11:04 PM
tobiu added parent issue #8930 on Feb 7, 2026, 11:04 PM
tobiu assigned to @tobiu on Feb 7, 2026, 11:05 PM
tobiu referenced in commit 75d03ca - "feat: DevRank Active Pruning & Auto-Cleanup (#9045)" on Feb 7, 2026, 11:06 PM
tobiu
tobiu Feb 7, 2026, 11:06 PM

Input from Gemini 3 Pro:

✦ Implemented active pruning and auto-cleanup to optimize the DevRank data lifecycle.

Changes

  1. Pre-Run Cleanup: Manager.mjs now automatically runs Cleanup.run() before executing spider or update commands. This ensures operations start with a hygienic state.
  2. Active Pruning: Updater.mjs now signals the deletion of users who fail the threshold check by pushing { login, delete: true } to the updates list.
  3. Storage Support: Storage.mjs has been updated to handle delete: true in updateTracker, physically removing the entry from the tracker map.

Impact

  • tracker.json will no longer bloat with low-value users.
  • Redundant re-scans of known low-value users are eliminated (after the first pass).
  • The system self-maintains its index size.

Code committed to dev branch.

tobiu closed this issue on Feb 7, 2026, 11:06 PM