LLMonitor
LLMonitor is an open-source observability platform that provides cost and usage analytics, user tracking, tracing and evaluation tools.
Installation and Setupβ
Create an account on llmonitor.com, then copy your new app's tracking id
.
Once you have it, set it as an environment variable by running:
export LLMONITOR_APP_ID="..."
Callbacksβ
See a usage example.
from langchain.callbacks import LLMonitorCallbackHandler