Label Studio
Label Studio is an open-source data labeling platform that provides LangChain with flexibility when it comes to labeling data for fine-tuning large language models (LLMs). It also enables the preparation of custom training data and the collection and evaluation of responses through human feedback.
Installation and Setup
See the Label Studio installation guide for installation options.
We need to install the label-studio and label-studio-sdk-python Python packages:
pip install label-studio label-studio-sdk
Callbacks
See a usage example.
from langchain.callbacks import LabelStudioCallbackHandler