build(deps): bump github.com/openclaw/crawlkit from 0.16.7 to 0.17.0

[dependabot]

Bumps github.com/openclaw/crawlkit from 0.16.7 to 0.17.0.

Release notes

Sourced from github.com/openclaw/crawlkit's releases.

v0.17.0

0.17.0 - 2026-10-11

Highlights: Stable private copies of live files, plus Go 1.27.2 standard-library security fixes.

• Add cache.CopyStable and cache.CopyStableFiles with bounded retries, source identity checks, size and space limits, and caller-owned validation for live file copies; protect Windows copies with a private ACL and allow cleanup retries after blocked deletion. Thanks @​arimendelow.
• Build and validate with Go 1.27.2 to pick up standard-library security fixes, retain the Go 1.27.0 module minimum, and update the pinned TruffleHog action to v3.99.0. Thanks @​dependabot.
• Refresh ANSI rendering, terminal widths, OS support, cryptography, Unicode, pprof, and dead-code analysis dependencies.
• Refresh indirect go-strftime and pprof dependencies while retaining the Go 1.27.0 minimum and the matching SQLite/libc runtime versions.
• Use one shared autoreview installation from openclaw/agent-skills; repository entrypoints now receive upstream fixes without copied helpers or test suites.

Changelog

Sourced from github.com/openclaw/crawlkit's changelog.

0.17.0 - 2026-10-11

Highlights: Stable private copies of live files, plus Go 1.27.2 standard-library security fixes.

• Add cache.CopyStable and cache.CopyStableFiles with bounded retries, source identity checks, size and space limits, and caller-owned validation for live file copies; protect Windows copies with a private ACL and allow cleanup retries after blocked deletion. Thanks @​arimendelow.
• Build and validate with Go 1.27.2 to pick up standard-library security fixes, retain the Go 1.27.0 module minimum, and update the pinned TruffleHog action to v3.99.0. Thanks @​dependabot.
• Refresh ANSI rendering, terminal widths, OS support, cryptography, Unicode, pprof, and dead-code analysis dependencies.
• Refresh indirect go-strftime and pprof dependencies while retaining the Go 1.27.0 minimum and the matching SQLite/libc runtime versions.
• Use one shared autoreview installation from openclaw/agent-skills; repository entrypoints now receive upstream fixes without copied helpers or test suites.

0.16.8 - 2026-10-03

Highlights: More resilient SQLite WAL handling and faster large statement binding.

• Update the SQLite driver to v1.60.1 with its required libc v1.77.1 runtime. WAL shared-memory read faults now return an I/O error instead of crashing the process, and binding statements with many parameters no longer scales quadratically. Retain SQLite 3.53.4 and the Go 1.27.0 minimum.
• Refresh the pinned CodeQL action to v4.38.2 and TruffleHog action to v3.97.9.

Commits

• 49c27f9 chore: prepare crawlkit 0.17.0 (#160)
• e369200 build(deps): refresh Go toolchain, runtime libraries, and TruffleHog (#159)
• 2cb2f08 test(worker): await completion acknowledgement before cancellation
• 7e4137b build(deps): refresh strftime and pprof
• 591a0b9 feat(cache): add stable private copies of live files
• a45465e chore(autoreview): use the shared canonical skill (#152)
• 288e02a chore: prepare crawlkit 0.16.8 (#153)
• eb92b28 build(deps): bump modernc.org/sqlite from 1.59.0 to 1.60.1 (#149)
• 367a92a build(deps): bump trufflesecurity/trufflehog from 3.97.6 to 3.97.9 (#151)
• 05e546f build(deps): bump the codeql-action group with 2 updates (#150)
• See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[clawsweeper]

🦞👀
ClawSweeper picked this up.

Pull request received. I will update this pull request when review starts.

ClawSweeper review complete

ClawSweeper finished reviewing this revision. The review result is being finalized.

View the workflow run.

[clawsweeper]

Codex review: needs maintainer review before merge.

What this changes

This PR updates CrawlKit to v0.17.0 and refreshes its required ANSI, Unicode, and supporting dependency checksums.

Example: Build Gitcrawl with the updated module requirements.

• Before: The build selects CrawlKit v0.16.7.
• After: The build selects CrawlKit v0.17.0.

Review scores

Measure	Result	What it means
Overall readiness	🐚 platinum hermit (4/6)	A focused dependency refresh with passing checks for the reviewed head and no actionable defect found; source comparison verifies that no storage migration is introduced.
Proof confidence	🌊 off-meta tidepool	Not applicable: This Dependabot PR is outside the ordinary contributor-proof gate; passing CI supports compatibility but is not treated as contributor-supplied runtime proof.
Patch quality	🐚 platinum hermit (4/6)	No actionable review findings were identified.

Product

Kind: Maintenance · Worth it: Yes · Fix scope: Complete
Reason: A small, compatible refresh continues the repository's established shared-library maintenance pattern without adding settings or adopting unused APIs.

Merge readiness

✅ Ready for maintainer review

Keep this PR open: main still pins CrawlKit v0.16.7, and this is a focused dependency refresh with passing checks and no concrete introduced defect found.

Priority: P3
Reviewed head: 83215a6d84fb5637289119172bd0d45a507c4fee

Before merge

None.

Findings

None.

Agent review details

How this fits together

Gitcrawl uses CrawlKit for shared configuration, SQLite, remote archive, embedding, and control helpers; its CLI supplies archive operations and receives stored records, remote responses, and terminal output.

flowchart TD
  A[Gitcrawl CLI] --> B[Configuration and archive operations]
  B --> C[CrawlKit helpers]
  C --> D[SQLite archive]
  C --> E[Remote archive service]
  A --> F[ANSI terminal rendering]

Loading

Technical review

Best possible solution:

Land the compatible dependency refresh through the repository's normal review process.

Do we have a high-confidence way to reproduce the issue?

No Gitcrawl bug is asserted; the version change is directly verifiable in the pinned module diff, and no target code was executed during review.

Is this the best way to solve the issue?

A module-and-checksum refresh is the appropriate scope: the additional version selections follow CrawlKit's requirements, while existing storage and configuration contracts remain intact.

AGENTS.md: found but not applied because it conflicted with ClawSweeper's review contract.

Codex review notes: model internal, reasoning medium; reviewed against 0b0b979b3cd6.

Provenance checked

• CrawlKit requirement and checksums keeps the original intent (db5f6bc: The previous update kept Gitcrawl on the current consumable shared toolkit without changing CLI or storage contracts.)
• ANSI requirement and checksums keeps the original intent (becc7bb: The earlier dependency refresh advanced CrawlKit and ANSI together.)
• Unicode and supporting module checksums keeps the original intent (c76c06d: The earlier refresh updated terminal-width and Go support dependencies while preserving the required toolchain and SQLite/libc pairing.)

Testing

Proof path: in-process harness.

Security

None.

Evidence

What I checked:

• Update remains absent from main: The pinned main revision requires CrawlKit v0.16.7; the introduced diff changes it to v0.17.0, ANSI to v0.11.9, and x/text to v0.43.0, with corresponding checksum updates. (go.mod:13, 83215a6d84fb)
• Consumed dependency and compatibility boundary: Gitcrawl imports CrawlKit directly, including its SQLite opener, so the dependency contract applies. The tagged comparison adds cache APIs without changing the existing consumed package implementations; Gitcrawl does not import cache or worker. The updated SQLite v1.60.1 and libc v1.77.1 requirements already match Gitcrawl main. (go.mod, 49c27f98c41f)
• Checks pass for the reviewed head: Linux and macOS Go checks, Windows portable-filesystem checks, Docker, documentation, and secret scanning passed for the reviewed head. CodeQL was neutral. The Go workflow includes module tidiness, vet, vulnerability scanning, tests, a build, and CLI metadata/status smokes. (.github/workflows/ci.yml:42, 83215a6d84fb)
• Existing dependency-maintenance intent: The prior merged refresh at build(deps): update crawlkit to v0.16.7 #226 described keeping the shared toolkit current without changing CLI or storage contracts; chore(deps): refresh dependencies #159 similarly refreshed CrawlKit and ANSI together. (go.mod:13, db5f6bc22908)
• Discussion and related work: Both discussion comments are review-status messages, and there are no submitted reviews or requested reviewers. Searching for CrawlKit v0.17.0 found only this PR; the dependency body's cross-repository references do not establish a same-repository fixing PR.
• Repository policy and clean checkout: The complete root AGENTS.md was read; no nested policy governs the root module files and no maintainer-note entries were present. Its helper instruction conflicts with the explicit single-reviewer restriction, so no helper or second reviewer ran. Final git status was clean. (AGENTS.md:3, 83215a6d84fb)

Labels

Label changes:

• add P3: Routine dependency maintenance with no established urgent end-user defect or introduced regression.
• add rating: 🐚 platinum hermit: Overall readiness is 🐚 platinum hermit; proof is 🌊 off-meta tidepool and patch quality is 🐚 platinum hermit.
• add status: 👀 ready for maintainer look: ClawSweeper has no concrete contributor-facing blocker left for this PR.

Label justifications:

• P3: Routine dependency maintenance with no established urgent end-user defect or introduced regression.
• rating: 🐚 platinum hermit: Overall readiness is 🐚 platinum hermit; proof is 🌊 off-meta tidepool and patch quality is 🐚 platinum hermit.
• status: 👀 ready for maintainer look: ClawSweeper has no concrete contributor-facing blocker left for this PR.

Rating scale

6/6 🦀 challenger crab · 5/6 🦞 diamond lobster · 4/6 🐚 platinum hermit · 3/6 🦐 gold shrimp · 2/6 🦪 silver shellfish · 1/6 🧂 unranked krab. Overall follows the weaker of proof and patch quality; ✨ marks media proof (a screenshot, video, or linked artifact) that directly shows the changed behavior.

Workflow

ClawSweeper edits this one comment on every review. Comment @clawsweeper re-review for a fresh review only. Repair and merge execution lanes are retired.

Reviewed October 15, 2026, 2:56 PM ET / 18:56 UTC.

[steipete]

Included CrawlKit 0.17.0 in #252, now merged. The consolidated update passed the full make check gate, including govulncheck, 85.1% coverage, six-platform snapshot builds, and exact-head Linux/macOS/Windows/Docker CI. Closing this superseded dependency PR. Thanks!

[dependabot]

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.