Skip to content

Improve pytest parsing for beginner-friendly evaluation feedback - #25

Open
NickK21 wants to merge 1 commit into
mainfrom
beginner-friendly-eval-messages
Open

Improve pytest parsing for beginner-friendly evaluation feedback#25
NickK21 wants to merge 1 commit into
mainfrom
beginner-friendly-eval-messages

Conversation

@NickK21

@NickK21 NickK21 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Summary

  • extracts pytest parsing into a dedicated parser
  • preserves real pytest assertion, collection, and runtime messages instead of collapsing them into generic output
  • normalizes failure targets and test names
  • captures expected, received, and rawout in a more structured way
  • codewit.us now depends on stable structured failure data to generate beginner-friendly Outcome messages
  • fixes the old problem where useful pytest details were getting buried, truncated, or reduced to noisy output

@NickK21
NickK21 requested review from DAC098 and kbuffardi August 13, 2026 00:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant