LearnNewsExamplesServices
Frontmatter
id9033
titleRefactor: DevRank Spider Checkpointing
stateClosed
labels
enhancementperformance
assigneestobiu
createdAtFeb 7, 2026, 8:01 PM
updatedAtFeb 7, 2026, 8:02 PM
githubUrlhttps://github.com/neomjs/neo/issues/9033
authortobiu
commentsCount0
parentIssue8930
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtFeb 7, 2026, 8:02 PM

Refactor: DevRank Spider Checkpointing

Closed v12.0.0 enhancementperformance
tobiu
tobiu commented on Feb 7, 2026, 8:01 PM

Implement incremental saving in the Spider service to prevent data loss during long discovery runs.

Changes:

  • Spider.mjs: Save tracker.json (candidates) and visited.json (graph) after processing every page of search results (or every N repositories).
tobiu added the enhancement label on Feb 7, 2026, 8:01 PM
tobiu added the performance label on Feb 7, 2026, 8:01 PM
tobiu added parent issue #8930 on Feb 7, 2026, 8:01 PM
tobiu assigned to @tobiu on Feb 7, 2026, 8:02 PM
tobiu referenced in commit da1d5f6 - "refactor: DevRank Spider Checkpointing (#9033) on Feb 7, 2026, 8:02 PM
tobiu closed this issue on Feb 7, 2026, 8:02 PM