Commit History

Merge branch 'main' of https://huggingface.co/spaces/toksuite/quick-tokenizer-accuracy
b1c588a

Gül Sena Altıntaş commited on

Merged readme
c34a637

Gül Sena Altıntaş commited on

Updated hf paths for toksuite models
5d0049d

Gül Sena Altıntaş commited on

Update README.md
4bdfefb
verified

gsaltintas commited on

- Added summary that could be directly copy pasted into sheets
9cada5f

Gül Sena Altıntaş commited on

- Save with prefix
b3de8c3

Gül Sena Altıntaş commited on

Fixed issue with tokenmonster and tekken tokenizers
431425d

Gül Sena Altıntaş commited on

UI updates
41156f1

Gül Sena Altıntaş commited on

Now accepts multiline!
15729bc

Gül Sena Altıntaş commited on

Fixed Farsi copy-paste error, Coding [WIP]
279fdab

Gül Sena Altıntaş commited on

- Removed header
93f64e6

Gül Sena Altıntaş commited on

Updated app for summary markdown tables
6c9db61

Gül Sena Altıntaş commited on

Fixed hf issue, fixed OOM
6383574

Gül Sena Altıntaş commited on

Fixed issue with job_id
fb396ec

Gül Sena Altıntaş commited on

Improved serving script
889a42a

Gül Sena Altıntaş commited on

Killarney script
1d3a5fe

Gül Sena Altıntaş commited on

Fixed supertoken tokenizer loading
cb0e70e

Gül Sena Altıntaş commited on

Updated script a bit
aebf6ac

Gül Sena Altıntaş commited on

Added app
7ebe82f

Gül Sena Altıntaş commited on

initial commit
b318650
verified

gsaltintas commited on