Locally Hosted Transformers + Weaviate
Hugging Face's Transformers library can be used with a wide range of models for natural language processing. Weaviate seamlessly integrates with the Transformers library, allowing users to leverage compatible models directly from the Weaviate Database.
These integrations empower developers to build sophisticated AI-driven applications with ease.
Integrations with Hugging Face Transformers
Section titled “Integrations with Hugging Face Transformers”Weaviate integrates with compatible Hugging Face Transformers models by spinning them up in containers. This allows users to host their own models and use them with Weaviate.
Embedding models for vector search
Section titled “Embedding models for vector search”
Transformers-compatible embedding models transform text data into vector embeddings, capturing meaning and context.
Weaviate integrates with Hugging Face Transformers' embedding models to enable seamless vectorization of data. This integration allows users to perform semantic and hybrid search operations without the need for additional preprocessing or data transformation steps.
Hugging Face Transformers embedding integration page
Reranker models
Section titled “Reranker models”
Transformers-compatible reranker models are designed to improve the relevance and ranking of search results.
The Weaviate reranker integration allows users to easily refine their search results with a locally hosted Hugging Face Transformers reranker model.
Hugging Face Transformers reranker integration page
Summary
Section titled “Summary”These integrations enable developers to leverage powerful Hugging Face Transformers models from directly within Weaviate.
In turn, they simplify the process of building AI-driven applications to speed up your development process, so that you can focus on creating innovative solutions.
Get started
Section titled “Get started”A locally hosted Weaviate instance is required for these integrations so that you can host your own Hugging Face Transformers models.
Go to the relevant integration page to learn how to configure Weaviate with the Hugging Face Transformers models and start using them in your applications.
- Text Embeddings
- Text Embeddings (custom image)
- Multimodal Embeddings
- Multimodal Embeddings (custom image)
- Reranker
Questions and feedback
Section titled “Questions and feedback”Have a question or feedback? Here's how to reach us.