testing/py3-tokenizers: upgrade to 0.20.1 (!74092) · Merge requests · alpine / aports · GitLab

Patrycja Rosa requested to merge ptrcnull/aports:py3-tokenizers-0.20.1 into master Oct 24, 2024

https://github.com/huggingface/tokenizers/releases/tag/v0.20.1