Big step for open multimodal retrieval:
webAI’s ColVec1.1 models are now natively supported in
@huggingface Sentence Transformers.
Developers can load our 4B and 8B models directly through the new MultiVectorEncoder interface to search visual documents, images, PDFs, charts, tables, and complex layouts without relying on OCR-first pipelines.
The 8B model currently leads ViDoRe V3, while the 4B model delivers the best published result in its size class.
State-of-the-art retrieval, now accessible through one of the most widely used embedding libraries in AI.
Huge thanks to the
@huggingface and
@tomaarsen and the Sentence Transformers teams for helping bring multi-vector retrieval into the broader ecosystem.
Available now.
🚨I've just released Sentence Transformers v6.0!
MultiVectorEncoder joins the family: ColBERT-style late interaction models are now a first-class model type, for training, inference & interpretation, alongside dense, sparse & reranker models.
Big thread 🧵