Skip to content

ci: check each release page for a Cloudflare challenge instead of version.txt - #470

Merged
anurag629 merged 1 commit into
developfrom
fix/release-smoke-test
Nov 6, 2026
Merged

anurag629 merged 1 commit into
developfrom
fix/release-smoke-test

Conversation

@anurag629

Copy link
Copy Markdown
Member

What and why

Every release since v0.8.0 has ended with a failed Release workflow, v0.11.1 included. The smoke test's "Homepage reachable" step gets a 403 from Cloudflare, so sync-develop is skipped and develop has to be fast-forwarded by hand.

#196 skips the checks when Cloudflare challenges the runner, but it asks /version.txt, and Bot Fight Mode only challenges the HTML pages. So that request got a 200, the deploy check passed ("Live on 9dd359e" on v0.11.1), and the homepage then got 403 with cf-mitigated: challenge.

Now the deploy is still checked through version.txt (with the same challenge check, in case that ever changes), and each page is judged by its own response: 200 passes, a Cloudflare challenge becomes a notice, anything else fails.

Once a RELEASE_TOKEN secret is in place (see the comment in sync-develop), develop syncs on its own after a release. Until then that job runs and warns, so develop still gets synced by hand.

How I tested this

  • Ran both steps locally against production: the v0.11.1 merge SHA passes, a wrong SHA fails, /, /json-formatter and /sitemap.xml pass with 200, and a missing page fails with 404.
  • Ran the same two steps on a GitHub runner from a throwaway branch (since deleted): the deploy check printed "Live on 9dd359e", all three pages came back 403 with cf-mitigated: challenge, the step left one notice for them, and the job passed.

@anurag629
anurag629 merged commit bbd06a2 into develop Nov 6, 2026
3 checks passed
@anurag629
anurag629 deleted the fix/release-smoke-test branch November 6, 2026 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant