flwrlabs/medical-meadow-medical-flashcards
Viewer • Updated • 34k • 124
How to use ethicalabs/Flwr-Qwen3-0.6B-Medical-PEFT with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-0.6B")
model = PeftModel.from_pretrained(base_model, "ethicalabs/Flwr-Qwen3-0.6B-Medical-PEFT")This PEFT adapter has been trained by using Flower, a friendly federated AI framework.
The adapter and benchmark results will be submitted to the FlowerTune LLM Medical Leaderboard.
Please check the following GitHub project for details on how to reproduce training and evaluation steps (Work in progress):