efficient inference
1 stories tagged “efficient inference”.
-
ColNanoVDR: Optimal Transport-Based Document-Free Query Distillation for Multi-Vector Visual Document Retrieval
ColNanoVDR distills 4.5B-8.8B multi-vector visual retrievers into a 149M text-only query encoder, keeping 93-9…