UME-R1 is a framework designed to endow multimodal embedding models with the flexibility to switch between discriminative and generative embeddings
Zhibin Lan
zhibinlan
AI & ML interests
None yet
Recent Activity
updated a dataset 2 days ago
zhibinlan/OCRMT30K published a dataset 2 days ago
zhibinlan/OCRMT30K updated a collection 27 days ago
UME-R1Organizations
None yet
LLaVE is a series of large language and vision embedding models trained on a variety of multimodal embedding datasets
-
zhibinlan/LLaVE-0.5B
Image-Text-to-Text • 0.9B • Updated • 33 • 7 -
zhibinlan/LLaVE-2B
Image-Text-to-Text • 2B • Updated • 112 • 45 -
zhibinlan/LLaVE-7B
Image-Text-to-Text • 8B • Updated • 47 • 5 -
LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning
Paper • 2503.04812 • Published • 17
UME-R1 is a framework designed to endow multimodal embedding models with the flexibility to switch between discriminative and generative embeddings
LLaVE is a series of large language and vision embedding models trained on a variety of multimodal embedding datasets
-
zhibinlan/LLaVE-0.5B
Image-Text-to-Text • 0.9B • Updated • 33 • 7 -
zhibinlan/LLaVE-2B
Image-Text-to-Text • 2B • Updated • 112 • 45 -
zhibinlan/LLaVE-7B
Image-Text-to-Text • 8B • Updated • 47 • 5 -
LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning
Paper • 2503.04812 • Published • 17