Run smoke tests against a built quarto (binary mode) - #14706

Draft

cderv wants to merge 64 commits into

mainfrom

test/smoke-tests-built-version

Commits on Sep 9, 2026

Add plan for running smoke tests against a built Quarto version

claude
authored and
cderv
committed
01419f9
Revise built-version test plan per maintainer decisions

claude
authored and
cderv
committed
0929a57
Add binary-mode classification results for all 133 smoke test files

claude
authored and
cderv
committed
dca3286
Rewrite built-version test plan as grounded v2 design

claude
authored and
cderv
committed
26c200e
Fold adversarial review findings into built-version test plan (v3)

claude
authored and
cderv
committed
d32aa4d
Relax dev-only quarto-required fixtures and fix drafts-env env mutation

claude
authored and
cderv
committed
302dacf
Add binary mode (QUARTO_TEST_BIN) to the smoke test harness

claude
authored and
cderv
committed
fe74931
Migrate direct quarto() call sites to the runQuarto dispatch helper

claude
authored and
cderv
committed
fc68b34
Add built-version smoke testing CI: parameterize test-smokes.yml, add weekly workflow

claude
authored and
cderv
committed
ec1c50e
Apply binary-mode env hygiene to subprocess-spawning tests

claude
authored and
cderv
committed
49efd63
Fix binary-mode issues found by code review

claude
authored and
cderv
committed
7242576
Allow partial runs of the built-version smoke workflow via a buckets input

claude
authored and
cderv
committed
477c30d
Extract shared build-dist-tarball composite action

claude
authored and
cderv
committed
f662c9e
Add nightly mode: test the signed artifacts of a no-publish create-release run

claude
authored and
cderv
committed
ebaa61c
Document nightly mode and shared build action in the plan

claude
authored and
cderv
committed
5f51b85
Add isBinaryMode()/quartoTestBin() predicates for readable mode checks

claude
authored and
cderv
committed
db39e30
Doc audit for binary-mode testing (part 1)

claude
authored and
cderv
committed
783ca7f
Add architecture diagrams for the test harness and CI modes

claude
authored and
cderv
committed
0f8db07
Simplify built-version workflow: schedule uses nightly artifacts, gh CLI resolution

claude
authored and
cderv
committed
53b5d52
Plan: record that the weekly schedule uses nightly mode

claude
authored and
cderv
committed
c17f4f8
Built-version testing goes daily with three-OS coverage

claude
authored and
cderv
committed
52042a2
Document the macOS-runner policy on the runners input

claude
authored and
cderv
committed
5557cec
docs: purge stale weekly-cron wording after workflow_run migration

claude
authored and
cderv
committed
d095fc6
Use gh api for release-tag preflight check
cderv
committed
b67212d
docs: add built-version testing architecture doc with design decision records

claude
authored and
cderv
committed
cb41c6c
docs: add practical when-to-trigger guidance for built-version modes

claude
authored and
cderv
committed
d35cb96
ci: harden built-version workflows against review findings

claude
authored and
cderv
committed
68027c5
tests: sanitize env for QUARTO_TEST_BIN --version probes

claude
authored and
cderv
committed
0c7195b
docs: drop the historical plan doc, point to the ADR instead
cderv
committed
f9906c0
tests: surface swallowed failures in custom-execute tests

claude
authored and
cderv
committed
45a5045
tests: make editor-support and logging json-stream tests failable

claude
authored and
cderv
committed
82fda18
tests: close silent-green paths found by testQuartoCmd call-site audit

claude
authored and
cderv
committed
63890ef
tests: fix latent bugs the hardening commits surfaced
cderv
committed
14d039a
tests: stop teardown ENOENT from masking render-failure reports
cderv
committed
51ca96e
tests: clean prepost artifacts in setup so verifyPath proves creation
cderv
committed
d2018f4
tests: split runQuarto by mode and add withCwd for chdir safety
cderv
committed
d518f52
ci: TEMP push trigger + small bucket for branch shakedown
cderv
committed
d095740
ci: remove PR-branch shakedown scaffolding from built-version workflow
cderv
committed
b1287c2
tests: create the caller log even when a built quarto logs nothing
cderv
committed
d1c7c23
tests: keep a failed process-tree kill from crashing the test process
cderv
committed
c7bcb27
tests: tolerate a torn log line so a timeout reports as a timeout
cderv
committed
4c1faae
tests: fall back to a direct kill when taskkill cannot be spawned
cderv
committed
84f026e
tests: strip a torn log line at the source instead of loosening the reader
cderv
committed
39c3434
ci: run smoke + playwright + ff-matrix legs against the built quarto

claude
authored and
cderv
committed
e729525
docs: propagate the multi-leg built-version CI change everywhere it is described

claude
authored and
cderv
committed
4756973
ci: apply multi-persona review findings to the multi-leg built-version CI

claude
authored and
cderv
committed
d475c52
ci: gate julia-engine subtree tests out of binary mode + follow-up plan

claude
authored and
cderv
committed
64e9a9f
Cap dist-tarball artifact retention and skip re-compression
cderv
committed
43668f8
Scope tarball retention cap to the intra-run build path
cderv
committed
f49f957

Commits on Sep 10, 2026

Commits on Sep 11, 2026

ci: clarify built-version dispatch buckets input description
cderv
committed
1c4c9c5