testing/py3-tokenizers: upgrade to 0.15.1 (!59559) · Merge requests · alpine / aports · GitLab

Celeste requested to merge Celeste/aports:upgrade-py3-tokenizers into master Jan 25, 2024

https://github.com/huggingface/tokenizers/releases/tag/v0.15.1