view post Post 4075 I am very sad to say that the budget in creating of SnowflakeCore-G1 1b and 7b MoE models ran out and I can't pre-train them anymore.
view post Post 521 the training for SnowflakeCore-G1-1B and 7B would be retaken because now I implemented DeepSpeed and management to use two gpus.
i3-Series Note: The models are listed in the default order set by Hugging Face, so the latest model appears at the botSeries i3-lab/i3-tiny Text Generation • 711k • Updated Oct 17, 2025 • 31 • 1 i3-lab/i3-12m Text Generation • 12.7M • Updated Oct 23, 2025 • 65 • 3 i3-lab/i3-22m Text Generation • 22.6M • Updated Oct 31, 2025 • 16 • 2 i3-lab/i3-80m Text Generation • 82.8M • Updated Nov 30, 2025 • 73 • 7
i3-Nano Sleeping I3 BERT 📊 Predict missing words in sentences i3-lab/i3-BERT-v1 Updated 20 days ago i3-lab/i3-BERT-v2 Fill-Mask • Updated 16 days ago • 27 Sleeping I3 CLIP 🏢
i3-Series Note: The models are listed in the default order set by Hugging Face, so the latest model appears at the botSeries i3-lab/i3-tiny Text Generation • 711k • Updated Oct 17, 2025 • 31 • 1 i3-lab/i3-12m Text Generation • 12.7M • Updated Oct 23, 2025 • 65 • 3 i3-lab/i3-22m Text Generation • 22.6M • Updated Oct 31, 2025 • 16 • 2 i3-lab/i3-80m Text Generation • 82.8M • Updated Nov 30, 2025 • 73 • 7
i3-Nano Sleeping I3 BERT 📊 Predict missing words in sentences i3-lab/i3-BERT-v1 Updated 20 days ago i3-lab/i3-BERT-v2 Fill-Mask • Updated 16 days ago • 27 Sleeping I3 CLIP 🏢