danielhanchen commited on
Commit
0dae584
·
verified ·
1 Parent(s): 424cfcf

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +1 -0
  2. README.md +192 -0
  3. added_tokens.json +28 -0
  4. chat_template.jinja +120 -0
  5. chat_template.json +4 -0
  6. config.json +71 -0
  7. generation_config.json +14 -0
  8. merges.txt +0 -0
  9. model-00001-of-00096.safetensors +3 -0
  10. model-00002-of-00096.safetensors +3 -0
  11. model-00003-of-00096.safetensors +3 -0
  12. model-00004-of-00096.safetensors +3 -0
  13. model-00005-of-00096.safetensors +3 -0
  14. model-00006-of-00096.safetensors +3 -0
  15. model-00007-of-00096.safetensors +3 -0
  16. model-00008-of-00096.safetensors +3 -0
  17. model-00009-of-00096.safetensors +3 -0
  18. model-00010-of-00096.safetensors +3 -0
  19. model-00011-of-00096.safetensors +3 -0
  20. model-00012-of-00096.safetensors +3 -0
  21. model-00013-of-00096.safetensors +3 -0
  22. model-00014-of-00096.safetensors +3 -0
  23. model-00015-of-00096.safetensors +3 -0
  24. model-00016-of-00096.safetensors +3 -0
  25. model-00017-of-00096.safetensors +3 -0
  26. model-00018-of-00096.safetensors +3 -0
  27. model-00019-of-00096.safetensors +3 -0
  28. model-00020-of-00096.safetensors +3 -0
  29. model-00021-of-00096.safetensors +3 -0
  30. model-00022-of-00096.safetensors +3 -0
  31. model-00023-of-00096.safetensors +3 -0
  32. model-00024-of-00096.safetensors +3 -0
  33. model-00025-of-00096.safetensors +3 -0
  34. model-00026-of-00096.safetensors +3 -0
  35. model-00027-of-00096.safetensors +3 -0
  36. model-00028-of-00096.safetensors +3 -0
  37. model-00029-of-00096.safetensors +3 -0
  38. model-00030-of-00096.safetensors +3 -0
  39. model-00031-of-00096.safetensors +3 -0
  40. model-00032-of-00096.safetensors +3 -0
  41. model-00033-of-00096.safetensors +3 -0
  42. model-00034-of-00096.safetensors +3 -0
  43. model-00035-of-00096.safetensors +3 -0
  44. model-00036-of-00096.safetensors +3 -0
  45. model-00037-of-00096.safetensors +3 -0
  46. model-00038-of-00096.safetensors +3 -0
  47. model-00039-of-00096.safetensors +3 -0
  48. model-00040-of-00096.safetensors +3 -0
  49. model-00041-of-00096.safetensors +3 -0
  50. model-00042-of-00096.safetensors +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,192 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - unsloth
4
+ base_model:
5
+ - Qwen/Qwen3-VL-235B-A22B-Instruct
6
+ license: apache-2.0
7
+ ---
8
+ > [!NOTE]
9
+ > Includes Unsloth **chat template fixes**! <br> For `llama.cpp`, use `--jinja`
10
+ >
11
+
12
+ <div>
13
+ <p style="margin-top: 0;margin-bottom: 0;">
14
+ <em><a href="https://docs.unsloth.ai/basics/unsloth-dynamic-v2.0-gguf">Unsloth Dynamic 2.0</a> achieves superior accuracy & outperforms other leading quants.</em>
15
+ </p>
16
+ <div style="display: flex; gap: 5px; align-items: center; ">
17
+ <a href="https://github.com/unslothai/unsloth/">
18
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/unsloth%20new%20logo.png" width="133">
19
+ </a>
20
+ <a href="https://discord.gg/unsloth">
21
+ <img src="https://github.com/unslothai/unsloth/raw/main/images/Discord%20button.png" width="173">
22
+ </a>
23
+ <a href="https://docs.unsloth.ai/">
24
+ <img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
25
+ </a>
26
+ </div>
27
+ </div>
28
+
29
+ <a href="https://chat.qwenlm.ai/" target="_blank" style="margin: 2px;">
30
+ <img alt="Chat" src="https://img.shields.io/badge/%F0%9F%92%9C%EF%B8%8F%20Qwen%20Chat%20-536af5" style="display: inline-block; vertical-align: middle;"/>
31
+ </a>
32
+
33
+
34
+ # Qwen3-VL-235B-A22B-Instruct
35
+
36
+
37
+ Meet Qwen3-VL — the most powerful vision-language model in the Qwen series to date.
38
+
39
+ This generation delivers comprehensive upgrades across the board: superior text understanding & generation, deeper visual perception & reasoning, extended context length, enhanced spatial and video dynamics comprehension, and stronger agent interaction capabilities.
40
+
41
+ Available in Dense and MoE architectures that scale from edge to cloud, with Instruct and reasoning‑enhanced Thinking editions for flexible, on‑demand deployment.
42
+
43
+
44
+ #### Key Enhancements:
45
+
46
+ * **Visual Agent**: Operates PC/mobile GUIs—recognizes elements, understands functions, invokes tools, completes tasks.
47
+
48
+ * **Visual Coding Boost**: Generates Draw.io/HTML/CSS/JS from images/videos.
49
+
50
+ * **Advanced Spatial Perception**: Judges object positions, viewpoints, and occlusions; provides stronger 2D grounding and enables 3D grounding for spatial reasoning and embodied AI.
51
+
52
+ * **Long Context & Video Understanding**: Native 256K context, expandable to 1M; handles books and hours-long video with full recall and second-level indexing.
53
+
54
+ * **Enhanced Multimodal Reasoning**: Excels in STEM/Math—causal analysis and logical, evidence-based answers.
55
+
56
+ * **Upgraded Visual Recognition**: Broader, higher-quality pretraining is able to “recognize everything”—celebrities, anime, products, landmarks, flora/fauna, etc.
57
+
58
+ * **Expanded OCR**: Supports 32 languages (up from 19); robust in low light, blur, and tilt; better with rare/ancient characters and jargon; improved long-document structure parsing.
59
+
60
+ * **Text Understanding on par with pure LLMs**: Seamless text–vision fusion for lossless, unified comprehension.
61
+
62
+
63
+ #### Model Architecture Updates:
64
+
65
+ <p align="center">
66
+ <img src="https://qianwen-res.oss-accelerate.aliyuncs.com/Qwen3-VL/qwen3vl_arc.jpg" width="80%"/>
67
+ <p>
68
+
69
+
70
+ 1. **Interleaved-MRoPE**: Full‑frequency allocation over time, width, and height via robust positional embeddings, enhancing long‑horizon video reasoning.
71
+
72
+ 2. **DeepStack**: Fuses multi‑level ViT features to capture fine‑grained details and sharpen image–text alignment.
73
+
74
+ 3. **Text–Timestamp Alignment:** Moves beyond T‑RoPE to precise, timestamp‑grounded event localization for stronger video temporal modeling.
75
+
76
+ This is the weight repository for Qwen3-VL-235B-A22B-Instruct.
77
+
78
+
79
+ ---
80
+
81
+ ## Model Performance
82
+
83
+ **Multimodal performance**
84
+
85
+ ![](https://qianwen-res.oss-accelerate.aliyuncs.com/Qwen3-VL/table_nothinking_vl.jpg)
86
+
87
+ **Pure text performance**
88
+ ![](https://qianwen-res.oss-accelerate.aliyuncs.com/Qwen3-VL/table_nothinking_text.jpg)
89
+
90
+ ## Quickstart
91
+
92
+ Below, we provide simple examples to show how to use Qwen3-VL with 🤖 ModelScope and 🤗 Transformers.
93
+
94
+ The code of Qwen3-VL has been in the latest Hugging Face transformers and we advise you to build from source with command:
95
+ ```
96
+ pip install git+https://github.com/huggingface/transformers
97
+ # pip install transformers==4.57.0 # currently, V4.57.0 is not released
98
+ ```
99
+
100
+ ### Using 🤗 Transformers to Chat
101
+
102
+ Here we show a code snippet to show how to use the chat model with `transformers`:
103
+
104
+ ```python
105
+ from transformers import Qwen3VLMoeForConditionalGeneration, AutoProcessor
106
+
107
+ # default: Load the model on the available device(s)
108
+ model = Qwen3VLMoeForConditionalGeneration.from_pretrained(
109
+ "Qwen/Qwen3-VL-235B-A22B-Instruct", dtype="auto", device_map="auto"
110
+ )
111
+
112
+ # We recommend enabling flash_attention_2 for better acceleration and memory saving, especially in multi-image and video scenarios.
113
+ # model = Qwen3VLMoeForConditionalGeneration.from_pretrained(
114
+ # "Qwen/Qwen3-VL-235B-A22B-Instruct",
115
+ # dtype=torch.bfloat16,
116
+ # attn_implementation="flash_attention_2",
117
+ # device_map="auto",
118
+ # )
119
+
120
+ processor = AutoProcessor.from_pretrained("Qwen/Qwen3-VL-235B-A22B-Instruct")
121
+
122
+ messages = [
123
+ {
124
+ "role": "user",
125
+ "content": [
126
+ {
127
+ "type": "image",
128
+ "image": "https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-VL/assets/demo.jpeg",
129
+ },
130
+ {"type": "text", "text": "Describe this image."},
131
+ ],
132
+ }
133
+ ]
134
+
135
+ # Preparation for inference
136
+ inputs = processor.apply_chat_template(
137
+ messages,
138
+ tokenize=True,
139
+ add_generation_prompt=True,
140
+ return_dict=True,
141
+ return_tensors="pt"
142
+ )
143
+
144
+ # Inference: Generation of the output
145
+ generated_ids = model.generate(**inputs, max_new_tokens=128)
146
+ generated_ids_trimmed = [
147
+ out_ids[len(in_ids) :] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
148
+ ]
149
+ output_text = processor.batch_decode(
150
+ generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
151
+ )
152
+ print(output_text)
153
+ ```
154
+
155
+
156
+
157
+ ## Citation
158
+
159
+ If you find our work helpful, feel free to give us a cite.
160
+
161
+ ```
162
+ @misc{qwen3technicalreport,
163
+ title={Qwen3 Technical Report},
164
+ author={Qwen Team},
165
+ year={2025},
166
+ eprint={2505.09388},
167
+ archivePrefix={arXiv},
168
+ primaryClass={cs.CL},
169
+ url={https://arxiv.org/abs/2505.09388},
170
+ }
171
+
172
+ @article{Qwen2.5-VL,
173
+ title={Qwen2.5-VL Technical Report},
174
+ author={Bai, Shuai and Chen, Keqin and Liu, Xuejing and Wang, Jialin and Ge, Wenbin and Song, Sibo and Dang, Kai and Wang, Peng and Wang, Shijie and Tang, Jun and Zhong, Humen and Zhu, Yuanzhi and Yang, Mingkun and Li, Zhaohai and Wan, Jianqiang and Wang, Pengfei and Ding, Wei and Fu, Zheren and Xu, Yiheng and Ye, Jiabo and Zhang, Xi and Xie, Tianbao and Cheng, Zesen and Zhang, Hang and Yang, Zhibo and Xu, Haiyang and Lin, Junyang},
175
+ journal={arXiv preprint arXiv:2502.13923},
176
+ year={2025}
177
+ }
178
+
179
+ @article{Qwen2VL,
180
+ title={Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution},
181
+ author={Wang, Peng and Bai, Shuai and Tan, Sinan and Wang, Shijie and Fan, Zhihao and Bai, Jinze and Chen, Keqin and Liu, Xuejing and Wang, Jialin and Ge, Wenbin and Fan, Yang and Dang, Kai and Du, Mengfei and Ren, Xuancheng and Men, Rui and Liu, Dayiheng and Zhou, Chang and Zhou, Jingren and Lin, Junyang},
182
+ journal={arXiv preprint arXiv:2409.12191},
183
+ year={2024}
184
+ }
185
+
186
+ @article{Qwen-VL,
187
+ title={Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond},
188
+ author={Bai, Jinze and Bai, Shuai and Yang, Shusheng and Wang, Shijie and Tan, Sinan and Wang, Peng and Lin, Junyang and Zhou, Chang and Zhou, Jingren},
189
+ journal={arXiv preprint arXiv:2308.12966},
190
+ year={2023}
191
+ }
192
+ ```
added_tokens.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</think>": 151668,
3
+ "</tool_call>": 151658,
4
+ "</tool_response>": 151666,
5
+ "<think>": 151667,
6
+ "<tool_call>": 151657,
7
+ "<tool_response>": 151665,
8
+ "<|box_end|>": 151649,
9
+ "<|box_start|>": 151648,
10
+ "<|endoftext|>": 151643,
11
+ "<|file_sep|>": 151664,
12
+ "<|fim_middle|>": 151660,
13
+ "<|fim_pad|>": 151662,
14
+ "<|fim_prefix|>": 151659,
15
+ "<|fim_suffix|>": 151661,
16
+ "<|im_end|>": 151645,
17
+ "<|im_start|>": 151644,
18
+ "<|image_pad|>": 151655,
19
+ "<|object_ref_end|>": 151647,
20
+ "<|object_ref_start|>": 151646,
21
+ "<|quad_end|>": 151651,
22
+ "<|quad_start|>": 151650,
23
+ "<|repo_name|>": 151663,
24
+ "<|video_pad|>": 151656,
25
+ "<|vision_end|>": 151653,
26
+ "<|vision_pad|>": 151654,
27
+ "<|vision_start|>": 151652
28
+ }
chat_template.jinja ADDED
@@ -0,0 +1,120 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- if tools %}
2
+ {{- '<|im_start|>system\n' }}
3
+ {%- if messages[0].role == 'system' %}
4
+ {%- if messages[0].content is string %}
5
+ {{- messages[0].content }}
6
+ {%- else %}
7
+ {%- for content in messages[0].content %}
8
+ {%- if 'text' in content %}
9
+ {{- content.text }}
10
+ {%- endif %}
11
+ {%- endfor %}
12
+ {%- endif %}
13
+ {{- '\n\n' }}
14
+ {%- endif %}
15
+ {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
16
+ {%- for tool in tools %}
17
+ {{- "\n" }}
18
+ {{- tool | tojson }}
19
+ {%- endfor %}
20
+ {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
21
+ {%- else %}
22
+ {%- if messages[0].role == 'system' %}
23
+ {{- '<|im_start|>system\n' }}
24
+ {%- if messages[0].content is string %}
25
+ {{- messages[0].content }}
26
+ {%- else %}
27
+ {%- for content in messages[0].content %}
28
+ {%- if 'text' in content %}
29
+ {{- content.text }}
30
+ {%- endif %}
31
+ {%- endfor %}
32
+ {%- endif %}
33
+ {{- '<|im_end|>\n' }}
34
+ {%- endif %}
35
+ {%- endif %}
36
+ {%- set image_count = namespace(value=0) %}
37
+ {%- set video_count = namespace(value=0) %}
38
+ {%- for message in messages %}
39
+ {%- if message.role == "user" %}
40
+ {{- '<|im_start|>' + message.role + '\n' }}
41
+ {%- if message.content is string %}
42
+ {{- message.content }}
43
+ {%- else %}
44
+ {%- for content in message.content %}
45
+ {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}
46
+ {%- set image_count.value = image_count.value + 1 %}
47
+ {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}
48
+ <|vision_start|><|image_pad|><|vision_end|>
49
+ {%- elif content.type == 'video' or 'video' in content %}
50
+ {%- set video_count.value = video_count.value + 1 %}
51
+ {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}
52
+ <|vision_start|><|video_pad|><|vision_end|>
53
+ {%- elif 'text' in content %}
54
+ {{- content.text }}
55
+ {%- endif %}
56
+ {%- endfor %}
57
+ {%- endif %}
58
+ {{- '<|im_end|>\n' }}
59
+ {%- elif message.role == "assistant" %}
60
+ {{- '<|im_start|>' + message.role + '\n' }}
61
+ {%- if message.content is string %}
62
+ {{- message.content }}
63
+ {%- else %}
64
+ {%- for content_item in message.content %}
65
+ {%- if 'text' in content_item %}
66
+ {{- content_item.text }}
67
+ {%- endif %}
68
+ {%- endfor %}
69
+ {%- endif %}
70
+ {%- if message.tool_calls %}
71
+ {%- for tool_call in message.tool_calls %}
72
+ {%- if (loop.first and message.content) or (not loop.first) %}
73
+ {{- '\n' }}
74
+ {%- endif %}
75
+ {%- if tool_call.function %}
76
+ {%- set tool_call = tool_call.function %}
77
+ {%- endif %}
78
+ {{- '<tool_call>\n{"name": "' }}
79
+ {{- tool_call.name }}
80
+ {{- '", "arguments": ' }}
81
+ {%- if tool_call.arguments is string %}
82
+ {{- tool_call.arguments }}
83
+ {%- else %}
84
+ {{- tool_call.arguments | tojson }}
85
+ {%- endif %}
86
+ {{- '}\n</tool_call>' }}
87
+ {%- endfor %}
88
+ {%- endif %}
89
+ {{- '<|im_end|>\n' }}
90
+ {%- elif message.role == "tool" %}
91
+ {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
92
+ {{- '<|im_start|>user' }}
93
+ {%- endif %}
94
+ {{- '\n<tool_response>\n' }}
95
+ {%- if message.content is string %}
96
+ {{- message.content }}
97
+ {%- else %}
98
+ {%- for content in message.content %}
99
+ {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}
100
+ {%- set image_count.value = image_count.value + 1 %}
101
+ {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}
102
+ <|vision_start|><|image_pad|><|vision_end|>
103
+ {%- elif content.type == 'video' or 'video' in content %}
104
+ {%- set video_count.value = video_count.value + 1 %}
105
+ {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}
106
+ <|vision_start|><|video_pad|><|vision_end|>
107
+ {%- elif 'text' in content %}
108
+ {{- content.text }}
109
+ {%- endif %}
110
+ {%- endfor %}
111
+ {%- endif %}
112
+ {{- '\n</tool_response>' }}
113
+ {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
114
+ {{- '<|im_end|>\n' }}
115
+ {%- endif %}
116
+ {%- endif %}
117
+ {%- endfor %}
118
+ {%- if add_generation_prompt %}
119
+ {{- '<|im_start|>assistant\n' }}
120
+ {%- endif %}
chat_template.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n"
3
+ }
4
+
config.json ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3VLMoeForConditionalGeneration"
4
+ ],
5
+ "image_token_id": 151655,
6
+ "model_type": "qwen3_vl_moe",
7
+ "pad_token_id": 151654,
8
+ "text_config": {
9
+ "attention_bias": false,
10
+ "attention_dropout": 0.0,
11
+ "bos_token_id": 151643,
12
+ "decoder_sparse_step": 1,
13
+ "torch_dtype": "bfloat16",
14
+ "eos_token_id": 151645,
15
+ "head_dim": 128,
16
+ "hidden_act": "silu",
17
+ "hidden_size": 4096,
18
+ "initializer_range": 0.02,
19
+ "intermediate_size": 12288,
20
+ "max_position_embeddings": 262144,
21
+ "mlp_only_layers": [],
22
+ "model_type": "qwen3_vl_moe_text",
23
+ "moe_intermediate_size": 1536,
24
+ "norm_topk_prob": true,
25
+ "num_attention_heads": 64,
26
+ "num_experts": 128,
27
+ "num_experts_per_tok": 8,
28
+ "num_hidden_layers": 94,
29
+ "num_key_value_heads": 4,
30
+ "rms_norm_eps": 1e-06,
31
+ "rope_scaling": {
32
+ "mrope_interleaved": true,
33
+ "mrope_section": [
34
+ 24,
35
+ 20,
36
+ 20
37
+ ],
38
+ "rope_type": "default"
39
+ },
40
+ "rope_theta": 5000000,
41
+ "router_aux_loss_coef": 0.001,
42
+ "use_cache": true,
43
+ "vocab_size": 151936
44
+ },
45
+ "tie_word_embeddings": false,
46
+ "transformers_version": "4.57.1",
47
+ "unsloth_fixed": true,
48
+ "video_token_id": 151656,
49
+ "vision_config": {
50
+ "deepstack_visual_indexes": [
51
+ 8,
52
+ 16,
53
+ 24
54
+ ],
55
+ "depth": 27,
56
+ "hidden_act": "gelu_pytorch_tanh",
57
+ "hidden_size": 1152,
58
+ "in_channels": 3,
59
+ "initializer_range": 0.02,
60
+ "intermediate_size": 4304,
61
+ "model_type": "qwen3_vl_moe",
62
+ "num_heads": 16,
63
+ "num_position_embeddings": 2304,
64
+ "out_hidden_size": 4096,
65
+ "patch_size": 16,
66
+ "spatial_merge_size": 2,
67
+ "temporal_patch_size": 2
68
+ },
69
+ "vision_end_token_id": 151653,
70
+ "vision_start_token_id": 151652
71
+ }
generation_config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 151643,
3
+ "pad_token_id": 151643,
4
+ "do_sample": true,
5
+ "eos_token_id": [
6
+ 151645,
7
+ 151643
8
+ ],
9
+ "top_p": 0.8,
10
+ "top_k": 20,
11
+ "temperature": 0.7,
12
+ "repetition_penalty": 1.0,
13
+ "transformers_version": "4.56.0"
14
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model-00001-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:653f9eb2cb34123094e6aebae19c7297480bb6ab4652d030b85ffe628b37ce44
3
+ size 2541132904
model-00002-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4843ea66ec15ae8e430a72f362dd8111a653aa471ed755f819a2f4572542cd37
3
+ size 4975511472
model-00003-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ef180b000f822b2b4fa21e91d13140527700c07b83b1621c6d2f1746d5c5f58
3
+ size 4975511472
model-00004-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6265b7743cb6ee994092f5525c4c1bd9aaaa57efdc52a232bb47d444c193d90d
3
+ size 4975511472
model-00005-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:608355fa25e5045fc761350b8dfea91d079ad307784999bfcf406f2f1b34c874
3
+ size 4975511472
model-00006-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d484036acbd73140fb2affdc84f09f37ee945ad28bb810ea163c9ea27e4e15d
3
+ size 4975511472
model-00007-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4dc37910cb21693a32c888a92a60e701e7d6f6f5b915ab6dab521720e123206
3
+ size 4975511472
model-00008-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb851441ed96599d2d6a237435a82abdc2bb414288226788e447f31cf475c12e
3
+ size 4975511472
model-00009-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:162f7810db2662ef8a9bc7c315b95add787c89d3c65831b883fa641964771e9c
3
+ size 4975511472
model-00010-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14ef0332e5ee5b53d54a7030f3ef3ec16a2e38eb5935c688684521bacb21a047
3
+ size 4975511472
model-00011-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a2ac3445964788c604c9c36b6bf5e633ef7381c9f78793129dd12db5a8a4679
3
+ size 4975511456
model-00012-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41dfefb33249567ff31ea44aab7f3dd829a4609fb652c19b0179d257cf0dccb7
3
+ size 4975511480
model-00013-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:390e8b94d934ab20b088cc2aed84b3329874ea1d41a07015febb3e96bfb32e42
3
+ size 4975511480
model-00014-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e8145be0f41a1d749179b4d693482bf979195ba37cfee725e60660ac01cf967
3
+ size 4975511480
model-00015-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da9cd66512ddd6b5e76fb53299771c49d09f04123876b5d399a3f2564098add1
3
+ size 4975511480
model-00016-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1aa42065cfd4e1017f68539e839b41ed8599d1b9005cd1ef5cbf2c3e222f5a40
3
+ size 4975511480
model-00017-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6db58041fb9dead9e8749806a3dcecc08ef2bdd6b4dd2509742f6f01a684c920
3
+ size 4975511480
model-00018-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42f0a74c2606830a36dc45c39e9ec2292f6dc79a5bdc60091c74758d6a0d097e
3
+ size 4975511480
model-00019-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78bf3554d904a297970067109ef9ddcb90f145901fba9595f9b1cfce2ddefaa6
3
+ size 4975511480
model-00020-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:180a53f13a72c8efd9fe86e88c4abf67284841b22adbc9f62d6f34ddb9441f12
3
+ size 4975511480
model-00021-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be489520239801c3f05aac4fab2e630a7467b42bebaf215c5e6f5f827cde5f08
3
+ size 4975511480
model-00022-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:059ea1f88bbc1f45d3b8100367d6080a8d33f22d29547caefb6f69b7bbd13c70
3
+ size 4975511480
model-00023-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16baffc13da71c452d396a77698d0995ae34c2d2bf03088024aa1c02c2337f58
3
+ size 4975511480
model-00024-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4d9c994392c0b7464b11f14fc7aa2ebda15fb2f460bb29c3d9925ff5e5c7ec8
3
+ size 4975511480
model-00025-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83163f8d43f237b36e722dc8da1014c0aeffac89c2d0f69cc81ca0bc92cdc13e
3
+ size 4975511480
model-00026-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3bc9997cee98c3eb337465f7c00c743cf6fe88ac8fe61d1436f5d99a0f70d16
3
+ size 4975511480
model-00027-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2cfe3b20e573fc9e3d994d6d16675b9cf14110a84ec0e97d8d9e0e093abd1ea8
3
+ size 4975511480
model-00028-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00ff7ef557b9916ef7f3326beb30ede83582ccf4196965504c652db8a223c813
3
+ size 4975511480
model-00029-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0103b70edf4b9c06ff6573aab9f768660c226ce290136b59a20acd60c95b7b03
3
+ size 4975511480
model-00030-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b2ff6f48497424581937f7448c784d2e658a1148c7821da6b2d44646479f035
3
+ size 4975511480
model-00031-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9e5ccc1c697f558208d74a4f5bfd4cf6b0330f3d1311bbb8c10457b03e267b5
3
+ size 4975511480
model-00032-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:720121772b27c48b8d9c1d9661e871e5d4e9121178489078c291d9e61db69e8c
3
+ size 4975511480
model-00033-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25490e8a2ba5bcfe4e874ffa2c473df815d458c9bd33c35b9b4aec1308b61c46
3
+ size 4975511480
model-00034-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4ed64a8a92e55ba55c62a4a95925d7e246a250e2a3a6dc188ef65727021ac63
3
+ size 4975511480
model-00035-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82e241c0e0150e4e41db03fee5d146aebdb8ca4966e16df3c311b0d34b2e4de3
3
+ size 4975511480
model-00036-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7923d3d437049c547f2a2e808c2d088d91457775011ed0f9ee4ba39d9d168287
3
+ size 4975511480
model-00037-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f403b9f646f660192dd66061cf3169467ed472173ef2ea7d4eb00ac7d01bc378
3
+ size 4975511480
model-00038-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a77ae95989a417efb8570fba891e48adc164c3223757ad7b87f375957b0d9e2e
3
+ size 4975511480
model-00039-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0144f08c11893cbada6e966d5b60a2c1bc947094f12dfa47626f9822e184173e
3
+ size 4975511480
model-00040-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5d618aeb416bf1872d18c0db0dac5c9c83a3104929f9a3fdf11945bd67eda24
3
+ size 4975511480
model-00041-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a804bab7879ac3e7288e2f1703566ace0b776609fdc82c5d8d74cbe502fc086
3
+ size 4975511480
model-00042-of-00096.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89d10fd2f6f23c829432c31aa8331a4a512bc13675ef92df561067c0450e0215
3
+ size 4975511480