Building on HF

13 6 54

Kshitij Thakkar PRO

kshitijthakkar

SaylorTwift's profile picture

agenticai54's profile picture

r4yd3n's profile picture

Mandark-droid
kshitij-thakkar-2061b924

AI & ML interests

AI observability + MoE efficiency engineer. Building tools that make GenAI traceable, measurable, and production-ready.

Recent Activity

liked a Space 6 days ago

julien-c/statement-of-purpose

published an article 8 days ago

Scaling Mixture of Experts: Architecture Search for Billion-Parameter Language Models

updated a collection 8 days ago

Large MoE Architecture Search (1B-2B)

View all activity

Organizations

kshitijthakkar 's collections 5

Large MoE Architecture Search (1B-2B)

Systematic search for 1B-2B MoE models. Best: bs=1, ctx=2048 achieves 0.32 loss. Top-8 routing beats top-2.

kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs4-ctx1024

Updated 10 days ago • 25
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx2048

Updated 10 days ago • 26
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx1024

Updated 10 days ago • 23
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs1-ctx2048

Updated 10 days ago • 34

OutageOdyssey

My submission to Agents-MCP-Hackathon

Paused

6

Outage Odyssey

🦀

6

Transform boring incidents into fun learning experiences.

Loggenix-MOE

Collection of Loggenix Models, Eval Dataset, Demo Playground. Soon will add the training dataset.

Runtime error

2

Loggenix Moe 0.3B A0.1B Demo

🏢

2

Demo Space for my model loggenix-moe-0.3B-A0.1B
kshitijthakkar/loggenix-synthetic-ai-tasks-eval-with-outputs

Viewer • Updated Sep 3, 2025 • 28 • 15
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v6-with-outputs

Viewer • Updated Sep 3, 2025 • 170 • 14
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v5-with-outputs-v7-sft-v1

Viewer • Updated Sep 12, 2025 • 170 • 15

Mobile MoE Architecture Search

32 MoE models from 41 experiments exploring expert count, routing, and learning rates for mobile deployment.

kshitijthakkar/moe-141m-89m-8x2-10L-small-250m-8exp

Updated 15 days ago • 48
kshitijthakkar/moe-161m-123m-4x2-12L-4exp-large-experts

Updated 15 days ago • 25
kshitijthakkar/moe-198m-114m-8x2-12L-8exp-balanced

Updated 15 days ago • 36
kshitijthakkar/moe-202m-104m-12x2-10L-medium-300m-12exp

Updated 15 days ago • 40

TraceMind-AI

Collection of my submissions to MCP-1st-Birthday:- TraceMind Agent and MCP Server and smoltrace datasets generated for running evals using smoltrace.

Running

10

TraceMind MCP Server

🤖

10

MCP server for agent evaluation with Gemini 2.5 Flash
Running

21

TraceMind AI

🧠

21

AI agent evaluation with MCP-powered intelligence
MCP-1st-Birthday/smoltrace-recruitment-tasks

Viewer • Updated Nov 20, 2025 • 101 • 21
MCP-1st-Birthday/smoltrace-smart-home-tasks

Viewer • Updated Nov 20, 2025 • 100 • 13

Large MoE Architecture Search (1B-2B)

Systematic search for 1B-2B MoE models. Best: bs=1, ctx=2048 achieves 0.32 loss. Top-8 routing beats top-2.

kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs4-ctx1024

Updated 10 days ago • 25
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx2048

Updated 10 days ago • 26
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs2-ctx1024

Updated 10 days ago • 23
kshitijthakkar/moe-1083m-781m-16x8-8L-large-moe-1.3b-bs1-ctx2048

Updated 10 days ago • 34

Mobile MoE Architecture Search

32 MoE models from 41 experiments exploring expert count, routing, and learning rates for mobile deployment.

kshitijthakkar/moe-141m-89m-8x2-10L-small-250m-8exp

Updated 15 days ago • 48
kshitijthakkar/moe-161m-123m-4x2-12L-4exp-large-experts

Updated 15 days ago • 25
kshitijthakkar/moe-198m-114m-8x2-12L-8exp-balanced

Updated 15 days ago • 36
kshitijthakkar/moe-202m-104m-12x2-10L-medium-300m-12exp

Updated 15 days ago • 40

OutageOdyssey

My submission to Agents-MCP-Hackathon

Paused

6

Outage Odyssey

🦀

6

Transform boring incidents into fun learning experiences.

TraceMind-AI

Collection of my submissions to MCP-1st-Birthday:- TraceMind Agent and MCP Server and smoltrace datasets generated for running evals using smoltrace.

Running

10

TraceMind MCP Server

🤖

10

MCP server for agent evaluation with Gemini 2.5 Flash
Running

21

TraceMind AI

🧠

21

AI agent evaluation with MCP-powered intelligence
MCP-1st-Birthday/smoltrace-recruitment-tasks

Viewer • Updated Nov 20, 2025 • 101 • 21
MCP-1st-Birthday/smoltrace-smart-home-tasks

Viewer • Updated Nov 20, 2025 • 100 • 13

Loggenix-MOE

Collection of Loggenix Models, Eval Dataset, Demo Playground. Soon will add the training dataset.

Runtime error

2

Loggenix Moe 0.3B A0.1B Demo

🏢

2

Demo Space for my model loggenix-moe-0.3B-A0.1B
kshitijthakkar/loggenix-synthetic-ai-tasks-eval-with-outputs

Viewer • Updated Sep 3, 2025 • 28 • 15
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v6-with-outputs

Viewer • Updated Sep 3, 2025 • 170 • 14
kshitijthakkar/loggenix-synthetic-ai-tasks-eval_v5-with-outputs-v7-sft-v1

Viewer • Updated Sep 12, 2025 • 170 • 15

Kshitij Thakkar PRO

AI & ML interests

Recent Activity

Organizations

kshitijthakkar 's collections 5

Outage Odyssey

Loggenix Moe 0.3B A0.1B Demo

TraceMind MCP Server

TraceMind AI

Outage Odyssey

TraceMind MCP Server

TraceMind AI

Loggenix Moe 0.3B A0.1B Demo