LearnNewsExamplesServices
Frontmatter
id7453
titleUpdate robots.txt for SEO
stateClosed
labels
enhancementai
assigneestobiu
createdAtOct 10, 2025, 10:20 PM
updatedAtNov 11, 2025, 1:27 PM
githubUrlhttps://github.com/neomjs/neo/issues/7453
authortobiu
commentsCount1
parentIssue7446
subIssues[]
subIssuesCompleted0
subIssuesTotal0
blockedBy[]
blocking[]
closedAtNov 11, 2025, 1:27 PM

Update robots.txt for SEO

Closed v11.1.0 enhancementai
tobiu
tobiu commented on Oct 10, 2025, 10:20 PM

The robots.txt file gives instructions to web crawlers about which pages they can or cannot crawl. It should also point to the location of our sitemap.

Acceptance Criteria

  1. Create or update the robots.txt file in the apps/portal/ directory.
  2. Ensure the file includes a Sitemap: directive pointing to the absolute URL of the sitemap.xml file (e.g., Sitemap: https://neomjs.com/sitemap.xml).
  3. Optionally, this process can be automated as part of the generate-seo-files.mjs build script.
tobiu assigned to @tobiu on Oct 10, 2025, 10:20 PM
tobiu added the enhancement label on Oct 10, 2025, 10:20 PM
tobiu added the ai label on Oct 10, 2025, 10:20 PM
tobiu added parent issue #7446 on Oct 10, 2025, 10:20 PM
tobiu
tobiu Nov 11, 2025, 1:27 PM

resolved.

tobiu closed this issue on Nov 11, 2025, 1:27 PM