Fireworks

tip

See this section for general instructions on installing integration packages.

npm

npm install @langchain/community

Yarn

yarn add @langchain/community

pnpm

pnpm add @langchain/community

You can use models provided by Fireworks AI as follows:

import { Fireworks } from "@langchain/community/llms/fireworks";

const model = new Fireworks({
  temperature: 0.9,
  // In Node.js defaults to process.env.FIREWORKS_API_KEY
  apiKey: "YOUR-API-KEY",
});

API Reference:

• Fireworks from @langchain/community/llms/fireworks

Behind the scenes, Fireworks AI uses the OpenAI SDK and OpenAI compatible API, with some caveats:

• Certain properties are not supported by the Fireworks API, see here.
• Generation using multiple prompts is not supported.