Skip to content

testing/py3-tokenizers: upgrade to 0.13.3

Patrycja Rosa requested to merge ptrcnull/aports:py3-tokenizers-0.13.3 into master

https://github.com/huggingface/tokenizers/releases/tag/python-v0.13.3

really big release, but doesn't seem to have any breaking changes

Merge request reports