Hugging Face
All functionality related to the Hugging Face Platform.
Installation
Most of the Hugging Face integrations are available in the langchain-huggingface
package.
pip install langchain-huggingface
Chat models
Models from Hugging Face
We can use the Hugging Face
LLM classes or directly use the ChatHuggingFace
class.
See a usage example.
from langchain_huggingface import ChatHuggingFace
API Reference:
LLMs
Hugging Face Local Pipelines
Hugging Face models can be run locally through the HuggingFacePipeline
class.
See a usage example.
from langchain_huggingface import HuggingFacePipeline
API Reference:
Embedding Models
HuggingFaceEmbeddings
See a usage example.
from langchain_huggingface import HuggingFaceEmbeddings
API Reference:
HuggingFaceInstructEmbeddings
See a usage example.
from langchain_community.embeddings import HuggingFaceInstructEmbeddings
API Reference:
HuggingFaceBgeEmbeddings
BGE models on the HuggingFace are the best open-source embedding models. BGE model is created by the Beijing Academy of Artificial Intelligence (BAAI).
BAAI
is a private non-profit organization engaged in AI research and development.
See a usage example.
from langchain_community.embeddings import HuggingFaceBgeEmbeddings
API Reference:
Hugging Face Text Embeddings Inference (TEI)
Hugging Face Text Embeddings Inference (TEI) is a toolkit for deploying and serving open-source text embeddings and sequence classification models.
TEI
enables high-performance extraction for the most popular models, includingFlagEmbedding
,Ember
,GTE
andE5
.
We need to install huggingface-hub
python package.
pip install huggingface-hub
See a usage example.
from langchain_community.embeddings import HuggingFaceHubEmbeddings
API Reference:
Document Loaders
Hugging Face dataset
Hugging Face Hub is home to over 75,000 datasets in more than 100 languages that can be used for a broad range of tasks across NLP, Computer Vision, and Audio. They used for a diverse range of tasks such as translation, automatic speech recognition, and image classification.
We need to install datasets
python package.
pip install datasets
See a usage example.
from langchain_community.document_loaders.hugging_face_dataset import HuggingFaceDatasetLoader
API Reference:
Tools
Hugging Face Hub Tools
Hugging Face Tools support text I/O and are loaded using the
load_huggingface_tool
function.
We need to install several python packages.
pip install transformers huggingface_hub
See a usage example.
from langchain.agents import load_huggingface_tool