Skip to content

llms.txt and SKILL.md direct AI agents to dead skills.sentry.dev entry points (/workflows, /features 404) #19182

Description

@wallidsaydi-creator

Dead agent-skill links in docs.sentry.io/llms.txt and SKILL.mdskills.sentry.dev/workflows and /features return 404

Summary

docs.sentry.io/llms.txt (lines 183–186) and the repo-root SKILL.md both direct AI agents to browse the Sentry skill library at skills.sentry.dev. Two of the four advertised entry points are dead:

Advertised URL Status Where it's advertised
https://skills.sentry.dev/ 200 llms.txt, SKILL.md
https://skills.sentry.dev/instrument 200 llms.txt, SKILL.md
https://skills.sentry.dev/workflows 404 llms.txt L185, SKILL.md L23
https://skills.sentry.dev/features 404 llms.txt L186, SKILL.md L24

SKILL.md L22 also links https://skills.sentry.dev/sdks, which 301-redirects to /instrument (working, but a redirect where a canonical link is intended).

Why this matters for agent-facing docs

llms.txt exists specifically so coding agents fetch current, verified instructions instead of hallucinating. When an agent follows the published "Workflows" / "Features" entry points and hits a bare 404s from Vercel, it either dead-ends or improvises — the exact failure mode this file is designed to prevent. The same dead paths are also embedded in the deployed skill index itself (skills.sentry.dev/ root, "Entry Points" table), which is served from the sentry-for-ai repo.

Root cause

scripts/generate-llms-txt.mjs — the AGENT_SKILLS template literal (lines 179–193) hardcodes the /workflows and /features URLs. This block is injected verbatim into both public/llms.txt and public/md-exports/index.md (see assembly at lines 245–285), so both outputs inherit the dead links. The served skill tree no longer contains workflows/features as top-level routes — the current skills are the flat sentry-* set (sentry-instrument, sentry-debug-issue, sentry-create-alert, sentry-otel-exporter-setup, …).

Fix

Replace the two dead links with canonical paths that exist today (all verified 200 just now):

--- a/scripts/generate-llms-txt.mjs
+++ b/scripts/generate-llms-txt.mjs
@@ -189,8 +189,9 @@
 Browse the skill library:
 - [All Skills](https://skills.sentry.dev/): Full skill index with SDK setup, workflows, and feature configuration
 - [SDK Setup](https://skills.sentry.dev/instrument): Detect your platform and install Sentry with the right features
-- [Workflows](https://skills.sentry.dev/workflows): Debug production issues, review code, upgrade SDKs
-- [Features](https://skills.sentry.dev/features): AI monitoring, alerts, OpenTelemetry setup
+- [Debug Issues](https://skills.sentry.dev/sentry-debug-issue/SKILL.md): Debug production issues, review code
+- [Create Alerts](https://skills.sentry.dev/sentry-create-alert/SKILL.md): Workflow-engine alerts and automations
+- [OTel Setup](https://skills.sentry.dev/sentry-otel-exporter-setup/SKILL.md): OpenTelemetry Collector + Sentry Exporter
 
 Source: https://github.com/getsentry/sentry-for-ai`;

Same change for SKILL.md (lines 21–24), which additionally fixes /sdks/instrument:

--- a/SKILL.md
+++ b/SKILL.md
@@ -19,9 +19,9 @@
 
 If the plugin is not available, fetch skills directly:
 - **Full skill index**: https://skills.sentry.dev
-- **SDK setup** (detect platform and install): https://skills.sentry.dev/sdks
-- **Debugging workflows** (fix issues, review code): https://skills.sentry.dev/workflows
-- **Feature setup** (AI monitoring, alerts, OTel): https://skills.sentry.dev/features
+- **SDK setup** (detect platform and install): https://skills.sentry.dev/instrument
+- **Debugging workflows** (fix issues, review code): https://skills.sentry.dev/sentry-debug-issue/SKILL.md
+- **Feature setup** (AI monitoring, alerts, OTel): https://skills.sentry.dev/sentry-create-alert/SKILL.md
 
 Source repo: https://github.com/getsentry/sentry-for-ai

Verification

  • 404s confirmed deterministic: 3 passes, browser + curl UAs, x-vercel-cache: MISS from origin (not edge variance)
  • All replacement URLs return 200: /, /instrument, /sentry-debug-issue/SKILL.md, /sentry-create-alert/SKILL.md, /sentry-otel-exporter-setup/SKILL.md
  • AGENT_SKILLS injection into both outputs verified in generator source (lines 251, 281)

Happy to open a PR with this diff.


Context: I audit AI-agent tooling and documentation drift — recent work includes cloudflare/cloudflare-docs#32985 (merged: llms.txt hub link generation fix) and the Codex TOML fix in upstash/context7#3060 (shipped in #3075). I also build FreshContext packs — repo-specific agent-context files that pin current docs and deprecated-pattern traps.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions