Repository navigation

Implement automated eval test suite for Angular Skills - #17007

Closed

zdrawku with Copilot wants to merge 23 commits into

masterfrom

copilot/implement-automated-eval-test-suite

Closed

Implement automated eval test suite for Angular Skills#17007
zdrawku with Copilot wants to merge 23 commits into
masterfrom
copilot/implement-automated-eval-test-suite

Commits on Mar 8, 2026
- Initial plan
  Copilot
  committed
  5b7cca0
- feat: scaffold eval test suite with three skill tasks and CI workflow
  
  Copilot
  and
  zdrawku
  committed
  23aecf0
- refactor: improve regex readability in grader scripts per code review
  
  Copilot
  and
  zdrawku
  committed
  ac1335a
- fix: add explicit permissions to skill-eval workflow (CodeQL alert)
  
  Copilot
  and
  zdrawku
  committed
  f807aa3
Commits on Mar 9, 2026
- Merge branch 'master' into copilot/implement-automated-eval-test-suite
  kdinev
  authored
  c183089
- fix: replace skill-eval package dep with self-contained local runner
  
  Copilot
  and
  kdinev
  committed
  6e7b838
Commits on Mar 10, 2026
- fix: emit passRate/passAtK in result JSON so CI summary shows actual scores
  
  Copilot
  and
  kdinev
  committed
  b2047d8
- Update evals/tasks/component-combo-reactive-form/solution/solve.sh
  
  kdinev
  and
  Copilot
  authored
  1691296
- Update .github/workflows/skill-eval.yml
  
  kdinev
  and
  Copilot
  authored
  2df335e
- fix: tighten grader checks per review feedback
  
  Copilot
  and
  kdinev
  committed
  b22b13f
- Merge branch 'master' into copilot/implement-automated-eval-test-suite
  kdinev
  authored
  c684351
- Update Node.js version in skill-eval workflow
  kdinev
  authored
  94d4bf8
- Update skill-eval.yml
  kdinev
  authored
  18f3e25
- Remove eval dependencies installation step
  kdinev
  authored
  568b04d
- Merge branch 'master' into copilot/implement-automated-eval-test-suite
  kdinev
  authored
  5da6711
- feat: add copilot-cli and gemini-cli agent modes to eval runner
  
  Copilot
  and
  kdinev
  committed
  b181ca0
- fix: use read -ra for safe array parsing, add TRIALS guard
  
  Copilot
  and
  kdinev
  committed
  665264b
- Update skill-eval.yml
  kdinev
  authored
  b3fa973
- rework CI workflow to always run against both copilot and gemini agents
  
  Copilot
  and
  kdinev
  committed
  1330989
- add agent prompt files, switch CI to npm scripts, clean up README
  
  Copilot
  and
  kdinev
  committed
  a9da524
Commits on Mar 11, 2026
- Merge branch 'master' into copilot/implement-automated-eval-test-suite
  kdinev
  authored
  566551b
- fix: agent eval CI failures - return 0 in agent mode, fix Gemini --yolo flag
  
  Copilot
  and
  kdinev
  committed
  148691b
Commits on Mar 24, 2026
- Merge branch 'master' into copilot/implement-automated-eval-test-suite
  kdinev
  authored
  59bcc87

Commits

Commits on Mar 8, 2026

Commits on Mar 9, 2026

Commits on Mar 10, 2026

Commits on Mar 11, 2026

Commits on Mar 24, 2026