Skip to content

Conversation

evouga
Copy link
Collaborator

@evouga evouga commented Sep 7, 2025

Attempt to fix #503

  • Requires input validator programs to return 43 on validation failure
  • Clearly distinguishes the input validator rejecting a test case from failing to operate properly
  • Clarifies that invalid_input must be cleanly rejected by at least one input validator (the others can do anything)

I've also moved the rationale for the strange exit codes to the Input Validator section (since it's earlier in the spec) and added a note that CTD and VIVA don't follow the exit code convention.

Clearly distinguish input validator rejecting a test case from failing to operate properly
Clarify the invalid input must be cleanly rejected by at least one input validator
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

When is a testcase rejected?
1 participant