Skip to content

Add PESY and PAGE journals, decrease threads from 10 to 5 - #157

Merged
mcbrandt13 merged 3 commits into
masterfrom
DIS-301
Sep 9, 2026
Merged

Add PESY and PAGE journals, decrease threads from 10 to 5#157
mcbrandt13 merged 3 commits into
masterfrom
DIS-301

Conversation

@mcbrandt13

Copy link
Copy Markdown
Contributor

Adds the configs for new PLoS journals Ecosystems, and Aging and Health. Slight refactor in check_for_amended_articles() because the entire update process would fail if it encountered an issue with a single article. Now it prints a message and continues with updates for the rest of the articles. We also were seeing problems with the pqdm threadcount at 10 so I lowered it to 5 to avoid more empty responses from rhino when fetching article data.

Comment thread allofplos/elements/journal.py Outdated
@benjaminkreen

Copy link
Copy Markdown

return ((file_, filename_to_doi(file_))
this is the function raising the issue, so i'm assuming there's a malformed filename already in the existing corpus, ya?

@mcbrandt13

Copy link
Copy Markdown
Contributor Author

🤷 It occurs in allofplos_upload and when I run allofplos locally.

@benjaminkreen
benjaminkreen self-requested a review September 9, 2026 19:22

@benjaminkreen benjaminkreen left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Offending doi found: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0336448&type=manuscript see line 55. Your change should fix things.

@mcbrandt13
mcbrandt13 merged commit a89dd4f into master Sep 9, 2026
@mcbrandt13
mcbrandt13 deleted the DIS-301 branch September 9, 2026 20:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants