tdro-llm/finetune_data
Viewer • Updated • 11 • 53
How to use tdro-llm/s2-tdro-Qwen1.5-0.5B-top70 with sentence-transformers:
from sentence_transformers import SentenceTransformer
model = SentenceTransformer("tdro-llm/s2-tdro-Qwen1.5-0.5B-top70")
sentences = [
"That is a happy person",
"That is a happy dog",
"That is a very happy person",
"Today is a sunny day"
]
embeddings = model.encode(sentences)
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]tDRO: Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval. Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou and Songlin Hu.
This is a fine-tuned tDRO optimized retriever with Dataset Selection Top-70% of tdro-llm/finetune_data.
Base model
Qwen/Qwen1.5-0.5B