VELO: A Vector Database-Assisted Cloud-Edge Collaborative LLM QoS Optimization Framework
Zhi Yao, Zhiqing Tang, Jiong Lou, Ping Shen, Weijia Jia
2024 IEEE International Conference on Web Services (ICWS)