Repository navigation
Commit 9be051b
feat(gooddata-eval): add the agentic what-if-analysis evaluator (#1799)
Scores the what-if skill end to end. MAQL correctness is scoped to adjustments on the
expected measure, so two independent checks can no longer each be satisfied by a
different wrong condition and pass the item between them.
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>1 parent 782acee commit 9be051b
5 files changed
Lines changed: 1047 additions & 0 deletions
File tree
- packages/gooddata-eval
- src/gooddata_eval
- cli
- core/agentic
- tests
Lines changed: 13 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
| 23 | + | |
23 | 24 | | |
24 | 25 | | |
25 | 26 | | |
| |||
47 | 48 | | |
48 | 49 | | |
49 | 50 | | |
| 51 | + | |
50 | 52 | | |
51 | 53 | | |
52 | 54 | | |
| |||
265 | 267 | | |
266 | 268 | | |
267 | 269 | | |
| 270 | + | |
| 271 | + | |
| 272 | + | |
| 273 | + | |
| 274 | + | |
| 275 | + | |
| 276 | + | |
| 277 | + | |
| 278 | + | |
| 279 | + | |
| 280 | + | |
268 | 281 | | |
269 | 282 | | |
270 | 283 | | |
| |||
0 commit comments