Skip to content

[pull] master from apify:master - #276

Merged
pull[bot] merged 2 commits into
code:masterfrom
apify:master
Aug 28, 2026
Merged

[pull] master from apify:master#276
pull[bot] merged 2 commits into
code:masterfrom
apify:master

Conversation

@pull

@pull pull Bot commented Aug 28, 2026

Copy link
Copy Markdown

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.4)

Can you help keep this open source service alive? 💖 Please sponsor : )

barjin and others added 2 commits August 28, 2026 09:21
Skipped requests now get the full `Request` instead of just a URL
string, so `userData` and other metadata survive a skip; the `Request`
is built lazily so crawlers that don't use `onSkippedRequest` pay
nothing for it.

Closes #3867 
Closes #3801
)

Restores the #3923 fix that the v4 rebase silently reverted. The
enqueueLinks split (#4010) predates #3923 and its diff carried a pre-fix
copy of `resolveBaseUrlForEnqueueLinksFiltering`; when the rebase
replayed it over the fixed base, the rerere cache (seeded from the old
merge branch, which had resolved this exact conflict toward v4) applied
that resolution again, so the fix disappeared without ever showing a
conflict. The result: with `strategy: 'same-domain'` and a cross-domain
redirect, the `undefined` baseUrl built no strategy patterns and every
link on the redirected page got enqueued.

The regression test runs the real CheerioCrawler path with an http
client that reports an off-domain load. An audit of all v3 fixes since
3.14 against master found no other fix dropped by the rebase.

Closes #4070
@pull pull Bot locked and limited conversation to collaborators Aug 28, 2026
@pull pull Bot added the ⤵️ pull label Aug 28, 2026
@pull
pull Bot merged commit bd4771e into code:master Aug 28, 2026
@pull
pull Bot had a problem deploying to github-pages August 28, 2026 11:45 Failure
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants