john-slop/tests/fixtures/evaluation
Dandaedre 81a09af61e
test: enforce heuristic false-positive sign-off
2026-09-29 17:47:13 +02:00
..
README.md test: enforce heuristic false-positive sign-off 2026-09-29 17:47:13 +02:00
assistant.md test: add reviewed heuristic corpus 2026-09-29 15:31:46 +02:00
example.rs test: add reviewed heuristic corpus 2026-09-29 15:31:46 +02:00
manifest.toml test: enforce heuristic false-positive sign-off 2026-09-29 17:47:13 +02:00
negative-assistant.md test: enforce heuristic false-positive sign-off 2026-09-29 17:47:13 +02:00
negative-prompt.md test: enforce heuristic false-positive sign-off 2026-09-29 17:47:13 +02:00
negative-source.rs test: enforce heuristic false-positive sign-off 2026-09-29 17:47:13 +02:00
negative-style.md test: enforce heuristic false-positive sign-off 2026-09-29 17:47:13 +02:00
negative.md test: add reviewed heuristic corpus 2026-09-29 15:31:46 +02:00
prompt.md test: add reviewed heuristic corpus 2026-09-29 15:31:46 +02:00
signoff.toml test: enforce heuristic false-positive sign-off 2026-09-29 17:47:13 +02:00
style.md test: add reviewed heuristic corpus 2026-09-29 15:31:46 +02:00
typography.md test: add reviewed heuristic corpus 2026-09-29 15:31:46 +02:00

README.md

Evaluation fixtures

These short fixtures were authored specifically for John Slop and are distributed under the repository's MIT license. They label observable rule signals only; no label claims that a human or an AI system authored the text.

This is a characterization corpus for regression testing, not a representative benchmark. Additions require review for provenance, licensing, expected rule IDs, and realistic negative examples.

Manifest schema 2 records which rule each clean case was reviewed as a realistic near miss for. Together the negative cases must cover every enabled shipped rule. signoff.toml binds the release decision to the SHA-256 digest of the exact heuristic catalog; changing defaults invalidates the automated gate until a reviewer reruns the corpus, assesses limitations, and explicitly renews it.