Konko
Konko API is a fully managed Web API designed to help application developers:
- Select the right open source or proprietary LLMs for their application
- Build applications faster with integrations to leading application frameworks and fully managed APIs
- Fine tune smaller open-source LLMs to achieve industry-leading performance at a fraction of the cost
- Deploy production-scale APIs that meet security, privacy, throughput, and latency SLAs without infrastructure set-up or administration using Konko AI's SOC 2 compliant, multi-cloud infrastructure
This example goes over how to use LangChain to interact with Konko
completion models
To run this notebook, you'll need Konko API key. Sign in to our web app to create an API key to access models
Set Environment Variables
- You can set environment variables for
- KONKO_API_KEY (Required)
- OPENAI_API_KEY (Optional)
- In your current shell session, use the export command:
export KONKO_API_KEY={your_KONKO_API_KEY_here}
export OPENAI_API_KEY={your_OPENAI_API_KEY_here} #Optional
Calling a model
Find a model on the Konko overview page
Another way to find the list of models running on the Konko instance is through this endpoint.
From here, we can initialize our model:
from langchain.llms import Konko
llm = Konko(model="mistralai/mistral-7b-v0.1", temperature=0.1, max_tokens=128)
input_ = """You are a helpful assistant. Explain Big Bang Theory briefly."""
print(llm.invoke(input_))
API Reference:
Answer:
The Big Bang Theory is a theory that explains the origin of the universe. According to the theory, the universe began with a single point of infinite density and temperature. This point is called the singularity. The singularity exploded and expanded rapidly. The expansion of the universe is still continuing.
The Big Bang Theory is a theory that explains the origin of the universe. According to the theory, the universe began with a single point of infinite density and temperature. This point is called the singularity. The singularity exploded and expanded rapidly. The expansion of the universe is still continuing.
Question