Skip to content

chore(deps): update tokenizers requirement from >=0.20 to >=0.23.2 - #7

Closed
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/tokenizers-gte-0.23.2
Closed

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/tokenizers-gte-0.23.2

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Oct 4, 2026

Copy link
Copy Markdown
Contributor

Updates the requirements on tokenizers to permit the latest version.

Release notes

Sourced from tokenizers's releases.

v0.23.2

This is the last v0 release, we are moving to v1!!

More details coming soon 👀

What's Changed

New Contributors

Full Changelog: huggingface/tokenizers@v0.23.1...v0.23.2

Commits
  • 88a4498 add lock
  • e4ea65f real release
  • 7c5964b add lock
  • bc405ad push rc0
  • d582781 Add a ParityBpeTrainer example and list it in the trainers API docs (#2217)
  • 447890f fix(python): pin the ruff rule set so a ruff release can't redden main (#2292)
  • 68b3ab7 chore(node): take node security alerts from 33 to 0 (#2287)
  • 74ef81f ci: pin every action to one SHA, drop stale audit suppressions (#2291)
  • b26727f chore(node): drop 8 unused devDependencies (#2286)
  • 7c7cfd8 chore: remove stale examples (kills 50% of dependabot traffic) (#2285)
  • Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [tokenizers](https://github.com/huggingface/tokenizers) to permit the latest version.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Commits](huggingface/tokenizers@v0.20.0...v0.23.2)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-version: 0.23.2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Oct 4, 2026
@corolin

corolin commented Oct 13, 2026

Copy link
Copy Markdown
Owner

Superseded and consolidated into main (commit 4db028e)

@corolin corolin closed this Oct 13, 2026
@corolin
corolin deleted the dependabot/pip/tokenizers-gte-0.23.2 branch October 13, 2026 01:30
@dependabot @github

dependabot Bot commented on behalf of github Oct 13, 2026

Copy link
Copy Markdown
Contributor Author

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant