Skip to content

chore(deps-dev): bump @huggingface/tokenizers from 0.1.3 to 0.2.0 - #69

Open
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/npm_and_yarn/huggingface/tokenizers-0.2.0
Open

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/npm_and_yarn/huggingface/tokenizers-0.2.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Sep 16, 2026

Copy link
Copy Markdown
Contributor

Bumps @huggingface/tokenizers from 0.1.3 to 0.2.0.

Commits
  • e480fc0 🔖 @​huggingface/tokenizers@​0.2.0
  • 4ddbf8e Avoid quadratic suffix materialization in Unigram tokenization (#34)
  • abdc740 Fix kimi linear tokenizer regex (#35)
  • 8235ffd Fix Angular bundler compatibility (#32)
  • af45330 Merge pull request #24 from huggingface/nico/regex-discrepancies-with-python-23
  • 83e6bad Merge branch 'main' into nico/regex-discrepancies-with-python-23
  • 3029328 Run tests on internal workers
  • d24f000 cleanup
  • ae07e54 increase default test timeout
  • 4ee2f73 reduce size
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [@huggingface/tokenizers](https://github.com/huggingface/tokenizers.js) from 0.1.3 to 0.2.0.
- [Commits](huggingface/tokenizers.js@v0.1.3...v0.2.0)

---
updated-dependencies:
- dependency-name: "@huggingface/tokenizers"
  dependency-version: 0.2.0
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code labels Sep 16, 2026
@dependabot
dependabot Bot requested review from a team as code owners September 16, 2026 15:55
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code labels Sep 16, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file javascript Pull requests that update javascript code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants