Skip to content

Botocore cannot be upgraded #52524

Closed
Closed

Description

@potiuk

The aiobotoocore is consistently behind botocore and we never can upgrade to latest version

However we have tests that are testing the latest version

Activity

  1. converted this from a draft issue on Jun 30, 2025
  2. eladkal commented on Jul 1, 2025

    @eladkal
    Contributor

    cc @o-nikolas @vincbeck can you take a look?

  3. potiuk commented on Jul 1, 2025

    @potiuk
    MemberAuthor

    I don't think we can do anything about it - to be honest. We have been discussing that one multiple times and the current way where we test and run airflow in two modes:

    a) with aiobotocore and "compatible botocore"
    b) with latest botocore (but excluding async tests)

    I don't think we can do anything else - other than hoping that some day asyncio will be included in botocore.

  4. potiuk commented on Jul 1, 2025

    @potiuk
    MemberAuthor

    So this really depends on "async" functionality in "botocore" -> this is really "hard" dependency

  5. o-nikolas commented on Jul 2, 2025

    @o-nikolas
    Contributor

    @potiuk @eladkal

    Some time ago we met with the folks who maintain aiobotocore and discussed us possibly helping with releases. It never quite came to fruition, but we could try revive that connection if it would be worth the effort. But testing latest without async tests might still be the most reliable since none of us are maintainers of aiobotocore and can't cut releases ourselves, we can only help out to try facilitate testing and packaging.

  6. potiuk commented on Jul 2, 2025

    @potiuk
    MemberAuthor

    Yeah. Also according to classification done by @eladkal in the initial script boto/botocore is usually yellow - i.e. it's catching up regularly (that's how the whole thing is designed) so this is more of "we know we are always a bit behind, but we know we will eventually catch up".

  7. eladkal commented on Jul 2, 2025

    @eladkal
    Contributor

    Yeah I agree. looks resonable given the circumstances.

    Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions