Hugging Face's logo

internlm
/
internlm-xcomposer2d5-7b

Visual Question Answering
Transformers
PyTorch
internlm2
feature-extraction
custom_code
Model card Files
xet
Community
23

tokenizer in InternLMXComposer2ForCausalLM is always None

#3
by kkkknddnjfks - opened
Discussion
kkkknddnjfks

https://huggingface.co/internlm/internlm-xcomposer2d5-7b/blob/eb12cdf26df23c26b0f485bbb8c674d7ceb3a02e/modeling_internlm_xcomposer2.py#L103

image.png

kkkknddnjfks changed discussion title from tokensizer in InternLMXComposer2ForCausalLM is always None to tokenizer in InternLMXComposer2ForCausalLM is always None
RBBB1122

Hello, have you solved this problem? I am also stuck with this “None”.

Sign up or log in to comment