/backend/venv/lib/python3.9/site-packages/tokenizers/

9 directories 3 files 9.0 MiB total
List Grid
Name
Size Modified
Up
__pycache__/
decoders/
implementations/
models/
normalizers/
pre_tokenizers/
processors/
tools/
trainers/
__init__.py
2.6 KiB
__init__.pyi
39 KiB
tokenizers.abi3.so
8.9 MiB