Local

The Local LLM integration allows you to connect to your preferred particular models and use them directly in StackAI projects.

Once connected, Local Models behave like any other LLM provider in StackAI and can be selected inside AI Agent nodes in your workflows.

For detailed instructions on setting up and managing Local Model connections, see the full guide:

Local LLM Setup Guide

Usage Overview

1. Click New Connection to create a Local Model connection.

2. Enter the endpoint details for the server hosting your model.

3. Use Test Connection to verify the connection is Healthy.

4. Select the connection when configuring an AI Agent node in your workflow.

After the connection is created, it will appear in the connection dropdown when selecting Local as the AI Provider.

Workspace Setup

Workspace administrators can configure default Local Model connections and control provider access in the workspace settings.

For detailed instructions on:

• Creating default connections

• Enabling or disabling AI Providers

• Managing connections across the workspace

• Disabling StackAI-managed API keys

See the full guide: Local LLM Setup Guide