Aquileo | Chat model integrations

Chat models are language models that use a sequence of messages as inputs and return messages as outputs .

Install and use

See this section for general instructions on installing LangChain packages.

OpenAI

Install:

npm install @langchain/openai @langchain/core

yarn add @langchain/openai @langchain/core

pnpm add @langchain/openai @langchain/core

Add environment variables:

OPENAI_API_KEY=your-api-key

Instantiate the model:

import { ChatOpenAI } from "@langchain/openai";

const model = new ChatOpenAI({ model: "gpt-5.4-mini" });

await model.invoke("Hello, world!")

Anthropic

Install:

npm i @langchain/anthropic @langchain/core

yarn add @langchain/anthropic @langchain/core

pnpm add @langchain/anthropic @langchain/core

Add environment variables:

ANTHROPIC_API_KEY=your-api-key

Instantiate the model:

import { ChatAnthropic } from "@langchain/anthropic";

const model = new ChatAnthropic({
model: "claude-sonnet-4-6",
temperature: 0
});

await model.invoke("Hello, world!")

Google Gemini

Install:

npm install @langchain/google @langchain/core

yarn add @langchain/google @langchain/core

pnpm add @langchain/google @langchain/core

Add environment variables:

GOOGLE_API_KEY=your-api-key

Instantiate the model:

import { ChatGoogle } from "@langchain/google";

const model = new ChatGoogle("gemini-2.5-flash");

await model.invoke("Hello, world!")

MistralAI

Install:

npm install @langchain/mistralai @langchain/core

yarn add @langchain/mistralai @langchain/core

pnpm add @langchain/mistralai @langchain/core

Add environment variables:

MISTRAL_API_KEY=your-api-key

Instantiate the model:

import { ChatMistralAI } from "@langchain/mistralai";

const model = new ChatMistralAI({
model: "mistral-large-latest",
temperature: 0
});

await model.invoke("Hello, world!")

Groq

Install:

npm install @langchain/groq @langchain/core

yarn add @langchain/groq @langchain/core

pnpm add @langchain/groq @langchain/core

Add environment variables:

GROQ_API_KEY=your-api-key

Instantiate the model:

import { ChatGroq } from "@langchain/groq";

const model = new ChatGroq({
model: "openai/gpt-oss-120b",
temperature: 0
});

await model.invoke("Hello, world!")

Featured models

While these LangChain classes support the indicated advanced feature, you may need to refer to provider-specific documentation to learn which hosted models or backends support the feature.

Model	Stream	Tool Calling	`withStructuredOutput()`	`Multimodal`
`ChatOpenAI`	✅	✅	✅	✅
`ChatAnthropic`	✅	✅	✅	✅
`ChatBedrockConverse`	✅	✅	✅	✅
`ChatGroq`	✅	✅	✅	❌
`ChatOllama`	✅	✅	✅	✅
`ChatMistralAI`	✅	✅	✅	✅
`ChatCohere`	✅	✅	✅	❌
`ChatXAI`	✅	✅	✅	❌
`ChatGoogle`	✅	✅	✅	✅
`ChatCloudflareWorkersAI`	✅	❌	❌	✅
`ChatFireworks`	✅	✅	✅	❌
`ChatTogetherAI`	✅	✅	✅	✅
`ChatPerplexity`	✅	❌	✅	❌

See the full list of chat model integrations below for more options.

Routers & proxies

Routers and proxies give you access to models from multiple providers through a single API and credential. They can simplify billing, let you switch between models without changing integrations, and offer features like automatic fallbacks.

Provider	Integration	Description
OpenRouter	`ChatOpenRouter`	Unified access to models from OpenAI, Anthropic, Google, Meta, and more
FuturMix	`ChatOpenAI`	Unified AI gateway for 22+ models with OpenAI-compatible API and 99.99% SLA

Chat Completions API

Certain model providers offer endpoints that are compatible with OpenAI’s (legacy) Chat Completions API. In such case, you can use ChatOpenAI with a custom base_url to connect to these endpoints. Note that features built on top of the Chat Completions API may not be fully supported by ChatOpenAI; in such cases, consider using a provider-specific class if available.

All chat models

Model	Stream	Tool Calling	`withStructuredOutput()`	`Multimodal`	Downloads
`AzureChatOpenAI`	✅	✅	✅	✅
`ChatOpenAI`	✅	✅	✅	✅
`ChatAnthropic`	✅	✅	✅	✅
`ChatGoogleGenerativeAI`	✅	✅	✅	✅
`ChatBedrockConverse`	✅	✅	✅	✅
`ChatVertexAI`	✅	✅	✅	✅
`ChatGroq`	✅	✅	✅	❌
`ChatOllama`	✅	✅	✅	✅
`ChatMistralAI`	✅	✅	✅	✅
`ChatCohere`	✅	✅	✅	❌
`ChatXAI`	✅	✅	✅	❌
`ChatDeepSeek`	✅	✅	✅	❌
`ChatGoogle`	✅	✅	✅	✅
`ChatOpenRouter`	✅	✅	✅	✅
`ChatCerebras`	✅	✅	✅	❌
`ChatBaiduQianfan`
`ChatCloudflareWorkersAI`	✅	❌	❌	✅
`ChatWatsonx`	✅	✅	✅	✅
`ChatFireworks`	✅	✅	✅	❌
`ChatYandexGPT`
`ChatTogetherAI`	✅	✅	✅	✅
`ChatPerplexity`	✅	❌	✅	❌
`FuturMix`	✅	✅	✅	✅	N/A
`FakeListChatModel`					N/A

If you’d like to contribute an integration, see Contributing integrations.

Connect these docs to Claude, VSCode, and more via MCP for real-time answers.

Edit this page on GitHub or file an issue.

Popular Providers

General integrations

RAG integrations

Chat model integrations

Install and use

Featured models

Routers & proxies

Chat Completions API

All chat models

​Install and use

​Featured models

​Routers & proxies

​Chat Completions API

​All chat models

Install and use

Featured models

Routers & proxies

Chat Completions API

All chat models