Skip to content

防封禁导致漏爬 #642

Description

@LittleTransparent

get_one_page中的防封禁逻辑,会导致当前页提前退出,后半页漏爬

经测试,将相关逻辑移出for循环,即爬取整页后再暂停休息,即可避免漏爬

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions