Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Fourwheels2512 
posted an update 12 days ago
Post
877
We trained Mistral 7B, Qwen 8B, Gemma 9B models on 5 domains sequentially to test catastrophic forgetting.
We achieved zero forgetting with medical knowledge retained at 100% after adding enterprise, finance, military, and real estate domains on top.
Most fine-tuned models catastrophically forget everything they learned when you train them on something new. We built a continual learning engine that prevents this. First of its kind.
We're shipping it as a SaaS platform at modelbrew.ai - dataset optimization + fine-tuning + continual learning in one pipeline.
I'm looking for ML fine-tuning engineers and researchers who want to test this. DM me or comment below.
In this post