LearnNewsExamplesServices
Frontmatter
id17043
titleMemoryCoreRecorderService identity-projection spec is flaky — third CI occurrence in one day
stateClosed
labels
bugaitestingagent-os
assigneesneo-gpt-emmy
createdAtAug 12, 2026, 11:59 PM
updatedAtAug 14, 2026, 11:19 AM
githubUrlhttps://github.com/neomjs/neo/issues/17043
authorneo-opus-vega
commentsCount2
parentIssuenull
subIssues[]
subIssuesCompleted0
subIssuesTotal0
contentTrust
projected
quarantined0
signals[]
blockedBy[]
blocking[]
closedAtAug 14, 2026, 11:19 AM

MemoryCoreRecorderService identity-projection spec is flaky — third CI occurrence in one day

Closed Backlog/active-chunk-15 bugaitestingagent-os
neo-opus-vega
neo-opus-vega commented on Aug 12, 2026, 11:59 PM

Context

test/playwright/unit/ai/services/memory-core/MemoryCoreRecorderService.spec.mjs:704independently downgrades the identity projection when its writer status is partial — flaked for the third time on 2026-08-12, each time recovering on retry while costing a full red/rerun cycle on an unrelated PR.

Evidence

  • Third occurrence: run 31643257591 (PR #17040, a diff that does not touch Memory Core at all): first attempt failed expect(metrics.reembedRatio).toMatchObject({status: 'partial', reason: 'embedding-identity-writer-partial'}) at line 732, passed on in-run retry (1 flaky), and its worker collateral produced 1 error was not a part of any test + 1 did not run, turning a 13,000-pass run red.
  • Two earlier same-day occurrences were absorbed as rerun-and-pass (recorded in Memory Core session context); the standing commitment was that a third occurrence earns this ticket.

The Problem

The assertion expects the reembedRatio projection to be partial at the observation moment; intermittently the projection reads ok, which suggests the fixture observes the projection before (or after) the writer-status downgrade settles — an ordering/timing dependency inside the fixture, not a production defect signal so far.

The Fix (owner to verify, not prescribe)

Make the arm deterministic: either drive the writer-status transition synchronously through an injected seam, or await the exact settlement signal the projection derives from before asserting. If investigation instead reveals a real race in the projection derivation, that becomes the finding and the fix moves to production code.

Acceptance Criteria

  • Root cause named (fixture ordering vs production race) with evidence.
  • The spec passes 50 consecutive local iterations (--repeat-each) after the fix.
  • No production behavior change without its own justification.

Related

PR #17040 (victim run) · epic-adjacent CI hygiene

Origin Session ID: 379c88ee-52c5-41ad-8973-8f28ebc8cbd6

tobiu referenced in commit ac57942 - "test(ai): isolate Memory Core config fixture (#17043) (#17105)" on Aug 14, 2026, 11:19 AM
tobiu closed this issue on Aug 14, 2026, 11:19 AM