Audit rundown goals and expand corpus
Beffroi/beffroi-tools/pipeline/head This commit looks good Details

This commit is contained in:
Dandaedre 2026-11-03 18:26:32 +01:00
parent f1657fb59a
commit 41dc17c2c7
4 changed files with 87 additions and 9 deletions

View File

@ -43,5 +43,50 @@
"bytes": 7229,
"retrieved": "2026-11-03",
"redistributed": false
},
{
"file": "events-authority-1.xlsx",
"page": "https://eventsauthority.com/corporate-event-planning/run-show-template/",
"url": "https://eventsauthority.com/downloads/sup_run_of_show_template/run-of-show.xlsx",
"sha256": "322de39018d1944c3a6c099ffd457d64338ad74012a775f13749bf67d99eee6d",
"bytes": 8174,
"retrieved": "2026-11-03",
"redistributed": false
},
{
"file": "arena-takeover-1.csv",
"page": "https://arenatakeover.com/resources.html",
"url": "https://arenatakeover.com/assets/downloads/run-of-show-template.csv",
"sha256": "bf068c3d03ce7d298b3301cb1e00ca28b2cf0418c06e2240ee9b118c48aff990",
"bytes": 1892,
"retrieved": "2026-11-03",
"redistributed": false
},
{
"file": "lasso-broadcast-1.csv",
"page": "https://www.lasso.io/rundown-templates/",
"url": "https://hi.lasso.io/hubfs/Rundown%20Templates/rundown-template-broadcast.csv",
"sha256": "b4dd8f5e6a28af6aba780e2bb8647b35ebaac59d8e6071da56ea3dc19d928890",
"bytes": 925,
"retrieved": "2026-11-03",
"redistributed": false
},
{
"file": "lasso-corporate-1.csv",
"page": "https://www.lasso.io/rundown-templates/",
"url": "https://hi.lasso.io/hubfs/Rundown%20Templates/rundown-template-corporate-run-of-show.csv",
"sha256": "d0b6767af5e5cb5b3c9fcd94509384016dd531d4633124311147a709c11bd72f",
"bytes": 1473,
"retrieved": "2026-11-03",
"redistributed": false
},
{
"file": "tavco-1.xlsx",
"page": "https://theavcompany.com/blog/run-of-show",
"url": "https://static1.squarespace.com/static/555c8055e4b0dc59ec841b7e/t/5a678909652dea7d6ea44dd0/1516734729883/TAVCO+Run+of+Show+Template.xlsx",
"sha256": "8b922ad110fe98962c428f1a7cb4c0a977f637aa42cb99929b6e7afdb30cf1b0",
"bytes": 113304,
"retrieved": "2026-11-03",
"redistributed": false
}
]

View File

@ -1,11 +1,35 @@
# Rundown converter development plan
Status: first XLSX/CSV implementation is available with a shared core, CLI and
egiu interface. User-facing scope and current limitations are in
Status: the XLSX/CSV release candidate is available with a shared core, CLI and
egui interface. User-facing scope and current limitations are in
[Rundown converter](rundown-converter.md); [corpus findings](rundown-corpus.md)
record real inputs and unresolved questions. Unchecked tasks below remain future
work; broader design requirements are not claims of implemented support.
## Completion audit
Audited against the `0.3.0-rc.1` source and documentation on 2026-11-03. The
five required workflow stages and the requested shared CLI/GUI review experience
are implemented. Remaining work is acceptance hardening, explicitly unsupported
schedule models, packaging and stretch goals.
| Area | Status | Evidence or remaining work |
| --- | --- | --- |
| 1. Whole-column inference | Complete | Header/data evidence, manual mapping and whole-column contradictions are implemented and tested. |
| 2. Untimed gaps | Complete | Named and inferred gaps enter the IR; keep/extend previous/add to next resolutions are available. |
| 3. Complete IR | Complete for supported single-day schedules | Explicit and inferred timing provenance, notes, metadata, corrections and exclusions are retained. |
| 4. Consistency checks | Complete for supported single-track schedules | Conflicting triples, backward/negative timing, overlaps and gap boundaries block export. |
| 5. Ontime output | Complete | Native Ontime JSON, neutral JSON and normalized XLSX share the validated IR; native parsing was checked against Ontime 4.15.1. |
| CLI and desktop review | Complete for the release-candidate workflow | Inspect/validate/convert, Setup/Review/Results, mapping, row editing, profiles, remembered resolutions and pending/recheck behavior are present. Recent-file persistence and broader native/platform interaction checks remain. |
| Public evaluation corpus | Expanded, still not a benchmark | Ten external files now cover XLSX and CSV successes, deliberate failures and manual-resolution cases. A fully reviewed expected-result matrix and held-out accuracy exercise remain. |
| PDF input | Trial complete; importer paused | The bounded 17-page experiment recovered tables but could not establish dependable sequential timers. |
| Parallel tracks and midnight/day rollover | Unsupported by design | These require explicit models; current behavior stops instead of guessing. |
| Portable release bundles | Open | Workspace builds include the converter, but release packaging is still reporter-oriented. |
| XLSX re-export stretch goal | Complete | Writes Ontime-importable normalized columns. |
| Typst/PDF report stretch goal | Open | No report exporter is implemented. |
| Buffer-adjustment stretch goal | Open | No proposal, feasibility or redistribution workflow is implemented. |
| ODS | Intentionally excluded | Ontime's file importer does not expose ODS upload; XLSX is the supported spreadsheet export. |
## Architecture
Workspace member: `crates/rundown-converter/`, with binaries
@ -258,8 +282,7 @@ errors must remain visible with direct corrective actions.
- [x] Merge schedule preview and row corrections with All rows / Included rows /
Needs attention filters, preserving ignored rows for restoration and displaying
attached notes individually without duplicating their timers.
- [ ] Add recent-file persistence, direct start/end/title editing and
comprehensive native GUI interaction checks.
- [ ] Add recent-file persistence and comprehensive native GUI interaction checks.
- [ ] Inventory supplied examples by format/layout; record intended interpretations
and the user's Ontime version. Decide first-release input coverage from these.
- [ ] Build sanitized fixtures and an expected-result matrix before tuning rules.
@ -304,7 +327,7 @@ errors must remain visible with direct corrective actions.
- [ ] Stretch: add Typst source/PDF reports.
- [ ] Stretch: add explicit buffer adjustment, before/after review, feasibility
checks and revalidation, with the cases listed above.
- [ ] Commit each completed implementation task with its validation summary.
- [x] Commit each completed implementation task with its validation summary.
## Documentation conventions

View File

@ -333,9 +333,8 @@ as notes. Unmerged untimed directions need explicit classification.
A full-width merged text band is treated as a section/footnote and recorded in
the IR. Nonempty unmerged text in a time column is a contradiction, not silently
ignored. Missing end/duration in a start-only schedule remains unresolved.
Recent-file persistence, direct start/end/title editing and portable release
bundles remain future work. JSON profiles provide the same supported resolution
decisions in both interfaces.
Recent-file persistence and portable release bundles remain future work. JSON
profiles provide the same supported resolution decisions in both interfaces.
## Stretch goal: reserve buffer time

View File

@ -1,7 +1,8 @@
# Rundown evaluation corpus
The first implementation was evaluated on two supplied XLSX workbooks (three
sheets), two supplied PDFs, and five downloaded public XLSX workbooks. Source
sheets), two supplied PDFs, seven downloaded public XLSX workbooks and three
public CSV files. Source
originals remain in ignored `rundowns/` and `downloads/rundown-corpus/`; they are
not redistributed in Git. Automated regression tests use synthetic data.
@ -111,11 +112,21 @@ or contact details are redistributed.
| [Joinways](https://joinways.app/solutions/run-of-show-example) | AM/PM times, section labels embedded in the clock column, parallel setup tasks. Unmerged labels require explicit row classifications before column inference can succeed; overlaps then require separate tracks. |
| [LiveFocus](https://livefocus.net/guides/event-run-of-show-template) | Three sheets, cached formula durations in minutes and fractional-day clocks. Minute units are inferred from start/end pairs. Blank formula rows and full-width merged footer are structural. The completed example reports overlapping activities. |
| [Novus](https://examples.novusstreamsolutions.com/templates/planning/event-run-of-show-csv) | String clock times and two-part durations. Whole-column comparison with start/end pairs establishes `hh:mm`; the populated XLSX sheet converts without a profile. |
| [Events Authority](https://eventsauthority.com/corporate-event-planning/run-show-template/) | Two sheets, a title block, Excel clock values and chained formulas. The main schedule infers start/end/title and validates nine events plus one gap after its total row is explicitly ignored. The preparation sheet is correctly kept separate. |
| [Arena Takeover](https://arenatakeover.com/resources.html) | A sports cue sheet mixes countdowns (`T-30:00`), elapsed time, quarter clock, halftime and final-game tokens in one clock column. It fails whole-column validation instead of pretending these are one wall-clock schedule; durations also require an explicit unit. |
| [LASSO broadcast](https://www.lasso.io/rundown-templates/) | A compact broadcast CSV uses `Item` as its title header and `mm:ss` durations. Manual mapping reaches IR construction, where a cue without a duration remains an actionable blocker. |
| [LASSO corporate](https://www.lasso.io/rundown-templates/) | A conference CSV interleaves timed cues with session headings and end markers. Manual mapping exposes those rows for classification and leaves the final missing duration unresolved rather than silently dropping it. |
| [The AV Company](https://theavcompany.com/blog/run-of-show) | Instructions, blank template and populated example sheets, with a two-level visual header, Excel fractional-day durations, continuation notes and a final `--` marker. Explicit header/column choices and three row classifications produce a valid 20-event schedule. The workbook also contains formatting far beyond the visible data columns, which remains harmless but verbose in inference evidence. |
Two additional institutional sources (Moira Shire and Monash University) rejected
requests with HTTP 403. A speaker toolkit page exposed no direct workbook link.
No authentication or access restrictions were bypassed.
The second search deliberately retained cases that fail or need review. They add
relative sports clocks, broadcast `mm:ss`, structural session rows, two-level
headers, preparation sheets and wide production metadata; a corpus of only
successful single-track schedules would not exercise the converter's stop rules.
## Ontime verification
Generated native JSON was run through Ontime's actual rundown parser and metadata