Skip to content

Add code coverage measurement to test suite - #7

Open
devin-ai-integration[bot] wants to merge 3 commits into
mainfrom
devin/1769122552-add-code-coverage
Open

devin-ai-integration[bot] wants to merge 3 commits into
mainfrom
devin/1769122552-add-code-coverage

Conversation

@devin-ai-integration

@devin-ai-integration devin-ai-integration Bot commented Jan 22, 2026 •

Copy link
Copy Markdown

Summary

This PR adds code coverage measurement for the AgentLab test suite. Changes include:

  • Added coverage[toml]>=7.0 as a dev dependency in pyproject.toml
  • Added coverage configuration in pyproject.toml to measure code in src/ while excluding test files and virtual environments
  • Updated CI workflow to run tests with coverage and upload HTML reports as artifacts
  • Added run-coverage and test-coverage Makefile targets for local coverage measurement
  • Updated uv.lock to include the coverage dependency

Review & Testing Checklist for Human

  • Download the coverage artifact from CI and confirm the HTML report is readable and shows expected coverage data for src/ directory
  • Test locally with make run-coverage (after setting up miniwob) to confirm local coverage workflow works
  • Verify the coverage report excludes test files and virtual environments as configured

Notes

The .gitignore already contained entries for coverage output files (htmlcov/, .coverage, .coverage.*), so no changes were needed there.

The CI workflow uses uv run python -m coverage to invoke coverage, which is the correct approach for uv-managed environments.

Link to Devin run: https://app.devin.ai/sessions/e7687644a2fd497894c556f314e79818
Requested by: shayan@cognition.ai

- Add coverage[toml]>=7.0 to dev dependencies in pyproject.toml
- Add coverage configuration (source, omit, report, html) to pyproject.toml
- Update CI workflow to run tests with coverage and upload HTML reports
- Add run-coverage and test-coverage targets to Makefile for local use

Co-Authored-By: shayan@cognition.ai <shayan@cognition.ai>
@devin-ai-integration

Copy link
Copy Markdown
Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

devin-ai-integration Bot and others added 2 commits January 22, 2026 23:00
Co-Authored-By: shayan@cognition.ai <shayan@cognition.ai>
Co-Authored-By: shayan@cognition.ai <shayan@cognition.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants