Spaces:
Running
Running
Commit History
py : make convert-pt-to-ggml.py backwards compatible with older vocab.json tokenizer files (#1001)
83e4988
unverified
minor : improve C++ and Python style (#768)
3ebe4d6
unverified
AsukaMinato
commited on
models : change convert-pt-to-ggml to use .tiktoken tokenizer files (#725)
a7879d3
unverified
Ivan Gorin
commited on
models : add usage comments to the HF convert script (#157)
8528ec5
unverified
models : simplify the conversion script
1ffa4c8
unverified
minor : remove one more redundant line
6f3392b
unverified
minor : fix double float32 conversion in python script
e6c2e3e
unverified
Add enconding parameter to vocab.json opening to fix errors
bf50d62
Joonas Pihlajamaa
commited on