Skip to content

CI: raise Nightly job timeout to 180 minutes - #1968

Merged
bghgary merged 2 commits into
BabylonJS:masterfrom
bkaradzic-microsoft:ci/nightly-timeout
Oct 26, 2026
Merged

bghgary merged 2 commits into
BabylonJS:masterfrom
bkaradzic-microsoft:ci/nightly-timeout

Conversation

@bkaradzic-microsoft

@bkaradzic-microsoft bkaradzic-microsoft commented Oct 24, 2026 •

Copy link
Copy Markdown
Member

Problem

The BabylonNative Nightly CI pipeline hasn't published a build since #1889 landed:

Run BN commit Nightly job Packaged VisualizationTests
61289 (last success) bac047b 59 min (just under the limit) 34 min
61325 (manual) c181462 cancelled at 60 min, during UnitTests 39 min
61329 (scheduled) c181462 cancelled at 60 min, during Upload Playground 38 min

The Nightly job has no timeoutInMinutes, so Azure applies its 60-minute default. As more validation tests are enabled, the packaged visualization run has grown, and the job now overruns before publishing BabylonNativeNightlyPlayground.

Babylon.js CI only uses fully succeeded nightly runs, so it is still testing against bac047b. That is why BabylonJS/Babylon.js#19041 keeps failing on "GUI Gradient Linear with transparency", which #1889 addresses. Each failure re-runs the whole native suite 3 times, which then hits B.js's own 90-minute limit.

Fix

Set timeoutInMinutes: 180 on the Nightly job.

Run 61329 also had an unrelated agent-lost failure on Android macOS JavaScriptCore during the ccache restore.

The Nightly job has no explicit timeout, so it gets Azure's 60 minute default.
Packaged VisualizationTests grew from ~34 to ~39 min, and both nightly runs
with BabylonJS#1889 (61325, 61329) were cancelled before uploading the Playground
artifact Babylon.js CI consumes.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 60c2ec68-6de1-445d-9fc9-b699db737eae
Copilot AI balanced review requested due to automatic review settings October 24, 2026 00:34
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 60c2ec68-6de1-445d-9fc9-b699db737eae
@bkaradzic-microsoft bkaradzic-microsoft changed the title CI: raise Nightly job timeout to 90 minutes CI: raise Nightly job timeout to 180 minutes Oct 24, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The timeout is correctly scoped to the Nightly job, with no changes to validation or artifact-publishing behavior.

No open issues 🎉

What changed in this PR

Raises the Nightly CI job timeout so longer validation runs can finish and publish packages consumed by Babylon.js.

Changes:

  • Sets the Nightly job timeout to 180 minutes.
  • Adds a comment explaining why the default 60-minute limit is insufficient.
File Description
nightly.yml Increases the Nightly job timeout and documents the reason.

Review effort: Balanced

@bghgary
bghgary merged commit 71df4c9 into BabylonJS:master Oct 26, 2026
27 checks passed
bkaradzic-microsoft added a commit to bkaradzic-microsoft/BabylonNative that referenced this pull request Oct 26, 2026
Matches the Nightly job timeout (BabylonJS#1968).

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 60c2ec68-6de1-445d-9fc9-b699db737eae
bkaradzic-microsoft added a commit that referenced this pull request Oct 26, 2026
`Ubuntu_Clang_JSC` routinely takes **28–29 minutes** (about 10 minutes
of build plus about 19 minutes of validation) against the 30-minute job
timeout in `build-linux.yml`:

| PR run | Ubuntu_Clang_JSC |
|---|---|
| #1971 | 28m ✅ |
| #1964 | 29m ✅ |
| #1965 | 28m ✅ |
| #1967 | **cancelled at 30m26s**, after `Run complete. ran=577
passed=577 failed=0` |

Any slightly slower runner cancels the job, and more re-enabled
validation tests will push it past the limit every time. This PR sets a
180-minute limit for every Linux engine, matching the Nightly job
timeout (#1968).

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 60c2ec68-6de1-445d-9fc9-b699db737eae
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants