LLMs

Large Language Models (LLMs) are a core component of LangChain. LangChain does not serve its own LLMs, but rather provides a standard interface for interacting with many different LLMs. To be specific, this interface is one that takes as input a string and returns a string.

There are lots of LLM providers (OpenAI, Cohere, Hugging Face, etc) - the LLM class is designed to provide a standard interface for all of them.

Quick Start

Check out this quick start to get an overview of working with LLMs, including all the different methods they expose

Integrations

For a full list of all LLM integrations that LangChain provides, please go to the Integrations page

How-To Guides

We have several how-to guides for more advanced usage of LLMs. This includes:

• How to cache LLM responses
• How to stream responses from an LLM