testing/py3-tokenizers: upgrade to 0.20.0 (!70508) · Merge requests · alpine / aports · GitLab

Patrycja Rosa requested to merge ptrcnull/aports:py3-tokenizers-0.20.0 into master Aug 14, 2024

https://github.com/huggingface/tokenizers/releases/tag/v0.20.0