testing/py3-tokenizers: upgrade to 0.15.2 (!60908) · Merge requests · alpine / aports · GitLab

Patrycja Rosa requested to merge ptrcnull/aports:py3-tokenizers-0.15.2 into master Feb 15, 2024

https://github.com/huggingface/tokenizers/releases/tag/v0.15.2