Contact Us

Buyer's guide36 min read

Self-hosted AI agents in 2026: 10 you can run on your own servers, and what they send home

You want an agent that reads your records and acts on them, and the data can't go to a vendor's cloud, because a client contract or a regulator says so. Installing the agent on your own servers is the easy part. Whether the setup stays private depends on where the model runs and what the software sends home by default. The lists ranking for this search raise both in general, but none gives a single tool's defaults, or the setting that stops them.

We checked the 34 tools named on those pages, and on one list of on-premises platforms, against five rules a tool could fail. Ten passed. Where to start:

  • Your operations team wants to build agents on a canvas: n8n or Dify. Both install on your own servers, both connect to a model you run through Ollama, and both can stop an agent until a person approves. n8n's licence limits it to your own internal business use, and Dify's free edition runs one workspace.
  • Your developers will write the agent: LangGraph. It's an MIT-licensed library that runs inside your own code and can pause a run until a person resumes it.
  • You already run UiPath, IBM or Automation Anywhere: that vendor's on-premises edition. All three now run agents on your own infrastructure with a documented approval step. None of them publishes an on-premises price.

Meronym builds agents for clients, sometimes on n8n and UiPath, and sells none of the tools in this list. We have no referral, reseller or partner deal with the companies that make them. Our own custom build is the last entry, labelled, with its drawback. We read each tool's documentation, licence and pricing page on 27 and 29 September 2026; we didn't install them.

What "self-hosted" covers for an agent, and why it isn't the same as private

An agent has three parts, and each one can sit inside your network or outside it.

The three parts of a self-hosted AI agent
PartWhere it can runWhat to check
The agent software: the builder, framework or platformYour servers or your cloud account, for every tool in this listWhat its licence allows, and what it sends home by default
The model it callsA public API; a provider's service in your own cloud account; or an open-weight model on hardware you controlWhere prompts and tool results go, and what the provider keeps
Everything else it sends outUpdate checks, telemetry, licence checks, plugin marketplacesThe setting that stops each one

The pages ranking for this search blur the first two rows. openclaw-ai.net's self-hosting guide rates the privacy of every tool in its table "100% local", while its own setup offers "Cloud APIs (easiest): Claude (Anthropic), GPT (OpenAI), Gemini (Google), DeepSeek". Fastio's platform list says in its FAQ that "Many teams self-host the agent logic but call external APIs for inference to avoid GPU costs." Only OpenHands' list says it outright: "Self-hosting the agent does not automatically mean prompts, code context, or logs never leave the environment."

So a private AI agent needs all three parts inside your control. The software runs on your infrastructure, the model runs where your data is allowed to go, and nothing else leaves without your say-so. Self-hosting covers the first part only.

When another guide is a better fit

  • Developers who want a coding agent in their repository. OpenHands' list of seven open-source coding agents is the better page; coding agents do a different job from the business agents here.
  • Someone after a personal assistant on a laptop. The r/opensource thread that tops this search starts from one: Observer AI, a screen-watching agent its developer runs on Ollama. This list is for a business's servers.
  • A business whose data may go to a vendor's cloud. A hosted agent is less work to run. Our lists of AI agents for business and enterprise AI agents cover them, with each vendor's data terms.

How we chose the ten

We started from every product that one of these pages gives an entry of its own, meaning its own heading or table row in a list:

  • the four lists on the first page for this search, from OpenHands, Fastio, openclaw-ai.net and ClawTank;
  • VDF AI's list of 15 on-premises platforms, the one list we could read from a search for on-premises agent platforms (SourceForge's category page blocked our browser, and Shakudo's page is a guide to its own product);
  • the three forum threads on the page, each about its poster's own product.

That makes 34 products. Two pages name tools without giving them an entry, and those names aren't counted. haimaker's guide, also on the first page, is a setup guide rather than a list: Ollama and OpenClaw appear in its setup steps, and both are counted from the lists. VDF's fifteenth entry is a stack of open-source parts rather than a product; its text names OpenClaw, which ClawTank's list gives an entry, beside Nous Research's Hermes Agent and NVIDIA's NemoClaw, which no page does.

A tool stays on the list only if it passes all five rules:

  1. It runs agents that act. Its own pages sell building or running agents that choose and call tools. Model runners, chat apps, coding agents and storage are out, and so is NVIDIA AI Enterprise: its reason is with the drops below, and NIM, the serving software that comes with it, is in the model section with the runners.
  2. Someone other than its maker lists it. A page other than its maker's gives it an entry. openclaw-ai.net is OpenClaw's community site, so it counts for the other tools on its list but not for OpenClaw.
  3. You can run all of it yourself, today. The maker documents installing the part that runs agents on your own servers or cloud account, the licence or plan allows internal business use, it's released for production rather than as a preview or beta, and it had a release between 29 March and 29 September 2026. The production test applies to the part that runs agents and to its approval step, so a preview elsewhere in a product doesn't fail it: n8n's newer agents section is a preview, and its AI Agent node isn't. Each entry below names the release that meets the date test.
  4. The model can stay inside. The maker documents connecting a model you host, through a local runner such as Ollama or your own endpoint.
  5. A person can step in. The maker documents a named step where the agent, or the workflow it runs in, stops and waits for a person. These don't count: a review before the agent ships, monitoring afterwards, and "human in the loop" that doesn't say where the agent waits.

Ten passed and 24 didn't. Each drop below is listed with a rule it fails, not with every rule it fails.

34 products: the 24 drops by the rule each is listed under, and the ten that passed

  • 1. It runs agents that act

    14 dropped

    Coding agents, model runners, storage, and model-serving software

  • 2. Someone other than its maker lists it

    3 dropped

    Named only on their makers' own list or threads

  • 3. You can run all of it yourself, today

    4 dropped

    A beta, maintenance mode, a technology preview, and no agents in the self-managed product

  • 4. The model can stay inside

    None dropped here
  • 5. A person can step in

    3 dropped

    No named step where the agent waits

  • Passed all five

    10
Each drop is counted under the rule the table below lists for it, not under every rule it fails.
The 24 we dropped, with a rule each one fails
ProductRuleWhy
OpenHands, OpenCode, Cline, Aider, Goose, Kilo Code, Tabby1Coding agents, which OpenHands' list covers
AI Agent Host1Claude Code in a Docker developer environment, also a coding agent
Ollama, LocalAI, Jan.ai, text-generation-webui1They run models or chat with them; see the model section
Fastio1Storage for agents, not an agent
NVIDIA AI Enterprise1Model-serving software sold per GPU, whose agent library works alongside other frameworks; see the model section
VDF AI2Named only on its own list
Observer AI2Named only in its developer's own thread
ai-agent-automation2Named only in its developer's own thread
AutoGPT3Its platform is still released as a beta
Microsoft AutoGen3In maintenance mode, with no release since 30 September 2025
Red Hat OpenShift AI3Its agent layer is a Technology Preview that Red Hat doesn't recommend for production
Appian3Its self-managed AI features list no agents
LocalAGI5No approval step in its documentation
DataRobot5Approvals only before an agent ships
C3 AI5"optional human review", with no named step where an agent waits

Source: each product's own pages, read on 27 and 29 September 2026, with the ones behind the drops linked below. Checked as of September 2026.

Where the drops' reasons come from:

  • AutoGPT's repository tags its latest release autogpt-platform-beta-v0.8.1.
  • AutoGen's README says it "is now in maintenance mode" and points new users to Microsoft Agent Framework.
  • Red Hat's OGX guide says "Red Hat does not recommend using them in production" of Technology Preview features, OGX included.
  • Appian's self-managed AI page lists no AI agents among its features.
  • LocalAGI's README describes no approval step.
  • DataRobot's platform overview names "approval workflows and versioning before an agent ships".
  • C3 AI's agentic process automation page offers "optional human review".
  • For DataRobot and C3 AI we read the overview and product pages, not every page of their documentation; a named step documented deeper in would change their result.
  • NVIDIA AI Enterprise is a subscription sold per GPU for serving, tuning and guarding models. NVIDIA's AI Enterprise page says its tools "provide support for each step" of training and deploying agents, and VDF's entry calls NVIDIA "the infrastructure and acceleration layer underneath many enterprise AI systems". Its agent library, the NeMo Agent Toolkit, works "side-by-side with agentic frameworks" such as LangChain and CrewAI, and none of these pages gives it an entry, so it isn't among the 34.

We read Automation Anywhere's documentation through the Internet Archive's copies from April, May and June 2026, because its docs site doesn't render in our browser. Flowise's pricing page redirects to a sign-in page, so no Flowise price appears here.

What to check before you pick a self-hosted AI agent

These are the questions to put to any tool you run yourself, including ones not on this list.

  • What it sends home. n8n's docs say it plainly: "By default, a self-hosted n8n instance sends data to n8n's servers." Ask for the full list and the setting that stops each item; the table further down has them for the seven tools here whose code is public, and marks the three vendors that don't say.
  • What the licence lets you do. n8n's licence covers "your own internal business purposes", and Dify's forbids running a multi-tenant service without its written permission. If you'll offer the agent to your own customers, check this before anything else.
  • Where the model runs. Every tool here can call a cloud API. The setup is only private once it points at a model you run, or at a provider's service in your own cloud account whose terms you've read.
  • Where a person approves, and what happens when no response arrives. Dify's approval step times out after "3 days" by default and then takes a timeout branch, or ends the run if there isn't one. Ask what the agent does while it waits.
  • Whether users are kept apart. Langflow doesn't isolate users within one process, and its code editor runs arbitrary Python with full access to the host. OpenClaw's docs say "One trust boundary per gateway." Plan one install per team that shouldn't see the other's data.
  • Who keeps it maintained. Look for a release in the last six months. AutoGen's README says it "is now in maintenance mode".
  • What the paid tier adds. CrewAI's approvals for production are "Webhook-based (Enterprise)", and Automation Anywhere's approval task needs its Enterprise Platform licence.
  • What the hardware must hold. OpenAI's gpt-oss-20b runs "within 16GB of memory"; gpt-oss-120b needs "a single 80GB GPU".
  • Which licence checks need the internet. LangGraph's standalone server needs "Egress to https://beacon.langchain.com from your network" unless it runs in air-gapped mode, and n8n's paid licence keys have to reach n8n's licence server every day, carrying "data like the number of production executions".

The ten self-hosted AI agents, by kind of tool

The ten fall into four kinds, and the kind decides more than the product: who builds the agent, what you install, and where the approval sits. Within each kind the tools aren't ranked. Every entry has the same fields in the same order, and our own build comes last.

Visual builders you run on your own servers

For an operations team that wants to draw an agent's steps rather than code them. All four connect to a model you run through Ollama.

n8n: best for an operations team that already automates workflows and wants an agent step inside them

What it is and what you run. A workflow automation tool with an AI Agent node. n8n's hosting docs say "You can self-host n8n on your own infrastructure, on-premises, or in a private cloud, using Docker Compose, one-line setup, or other deployment methods." Its latest release, 2.41.3, came out on 25 September 2026. Its newer "Build and manage agents" section is still marked Preview, and n8n's agents docs say those agents "aren't ready for self-hosted Enterprise yet"; the approval step below belongs to the AI Agent node inside a workflow.

Licence and price. n8n's licence says "You may use or modify the software only for your own internal business purposes or for non-commercial or personal use", and "we do not call ourselves open source". The self-hosted Community Edition is free, according to n8n's hosting documentation. The self-hosted Business plan was "$800 /mo, billed annually" for 40,000 executions on n8n's pricing page on 27 September 2026, in US dollars; other reads of the page have shown this plan's price in euros. Enterprise is priced on request.

Where the model runs. Its Ollama Chat Model node connects the agent to a model you run yourself.

Where a person approves. "You can require human approval before an AI Agent executes a specific tool," say n8n's docs. The reviewer sees "which tool the AI wants to use and with what parameters", in Slack, Telegram or n8n's own chat. A denial stops the action and tells the agent it was refused.

What it sends home. Update notices, workflow templates and diagnostics until three settings turn them off, and on paid plans a daily licence check that carries usage counts (the table below has both).

Pros
  • Approval before a named tool runs, with its parameters shown to the reviewer
  • Free to self-host for your own business
Cons
  • The licence rules out letting your customers connect their accounts and build workflows
  • Sends diagnostics to n8n until you switch them off

For the parts n8n's own nodes can't reach, see our n8n automation agency page.

Dify: best for a team building several AI apps on one platform, with approvals that go out by email

What it is and what you run. "Dify is an open-source LLM app development platform," says its README. It runs with Docker Compose, and its install guide asks for "CPU >= 2 Core" and "RAM >= 4 GiB". Its latest release, 1.17.1, came out on 10 September 2026.

Licence and price. Dify's licence is a modified Apache 2.0, which allows commercial use with two conditions:

  • no multi-tenant service without Dify's written permission, where a tenant is a workspace: "you may not use the Dify source code to operate a multi-tenant environment";
  • the logo stays: "you may not remove or modify the LOGO or copyright information in the Dify console or applications".

Its pricing page aims the free Community edition at "open-source enthusiasts, individual developers, and non-commercial projects", with a "Single Workspace". Enterprise, with a commercial licence and multiple workspaces, is "Custom". Fastio's list calls Dify's self-hosting "free without restrictions"; the licence says otherwise.

Where the model runs. Dify's official Ollama plugin: "Ollama runs open models locally on macOS, Windows, and Linux".

Where a person approves. Dify's Human Input node pauses a workflow and sends a request form by web app or email, where "Anyone with the link can respond, no Dify account required". The request closes at the first answer. If no response arrives before the timeout ("The default is 3 days"), the workflow follows the timeout branch, and "If no timeout branch is connected, the workflow ends."

What it sends home. Its default Docker settings check updates.dify.ai, use Dify's plugin marketplace, and leave the telemetry of the bundled vector database on (the table below has the settings).

Pros
  • Approvals can go by email to someone with no Dify account
  • You design what happens when no response arrives
Cons
  • Anyone holding the email's link can answer the request
  • The free edition runs one workspace, and the Dify logo has to stay

Flowise: best for building and testing an agent visually, with approval on its tools

What it is and what you run. A visual builder whose README sums it up as "Build AI Agents, Visually", installed with npm install -g flowise or Docker Compose. Its latest release, 3.1.4, came out on 29 July 2026. Workday announced on 14 August 2025 that it "has acquired Flowise", and its chief technology officer spoke of "investing in its open-source foundation".

Licence and price. Apache 2.0, except the enterprise folder and files with their own copyright notice, which fall under a commercial licence. Flowise's pricing page redirected us to a sign-in page, in our browser and in the Internet Archive's copy of 2 September 2026, so no price is public.

Where the model runs. Its ChatOllama node connects to a model you run.

Where a person approves. "The Human Input node allows execution to be paused and only resumed after a human has provided feedback to either approve or reject the action," say Flowise's docs. You can also switch on "Require Human Input" for an agent's tools.

What it sends home. Anonymous telemetry, on until you set DISABLE_FLOWISE_TELEMETRY to true; the line sits commented out in its Docker settings file. Flowise's Spanish telemetry page says it never collects node inputs, outputs, messages or credentials. The English telemetry page no longer opens, and the English list of settings leaves the switch out.

Pros
  • Approve or reject before an agent's tool runs
  • Apache 2.0 for everything outside the enterprise folder
Cons
  • No public price for the paid tiers
  • The English docs leave out its telemetry switch

Langflow: best for developers who want a visual canvas with Python underneath

What it is and what you run. A visual builder for flows and agents with a Python code editor built in. It installs with uv pip install langflow -U or as a Docker container, per its README. Its latest release, 1.12.4, came out on 29 September 2026.

Licence and price. MIT, and free.

Where the model runs. "Basic Ollama support is available in all Langflow installations through the core Language Model component," say Langflow's docs.

Where a person approves. "Human-in-the-Loop (HITL) pauses a flow, creates a checkpoint, and waits for a human decision," per the docs. It works through the Human Input component, or by setting the Agent component to require approval for its tools. The feature arrived in version 1.11.

What it sends home. Anonymous telemetry on feature usage and performance; DO_NOT_TRACK=True stops it (docs).

Pros
  • Approval on an agent's tools, with a checkpoint saved
  • MIT licence, no paid tier needed
Cons
  • The code editor runs arbitrary Python with full access to the host
  • No isolation between users in one process; sign-in and permissions have to be added outside its container

Langflow's security page is the source for both drawbacks: the editor has "full access to the host Langflow backend process, filesystem, and network", and "Langflow neither enforces isolation between users within a single Langflow process, nor restricts access to the local disk or network resources."

Frameworks your developers code against

For teams that will write the agent in Python and want it inside their own application. Both are MIT-licensed libraries, and both work with a model served by Ollama.

LangGraph: best for developers who want to control every step of the agent in code

What it is and what you run. A library from LangChain for building agents as graphs of steps, installed with pip install -U langgraph and run inside your own code. The library's latest release, 1.2.12, came out on 21 September 2026. LangChain also offers a standalone Agent Server that runs "using Docker, Docker Compose, or Kubernetes without the LangSmith control plane", with PostgreSQL and Redis.

Licence and price. The library is MIT and free. The standalone server needs a licence key from LangChain, whose price isn't on the pages we read.

Where the model runs. Any model LangChain connects to, including Ollama, which LangChain's docs say "allows you to run open-weight large language models (LLMs), such as gpt-oss, locally."

Where a person approves. "Interrupts allow you to pause graph execution at specific points and wait for external input before continuing," say LangGraph's docs. The graph's state is saved, and it "waits indefinitely until you resume execution."

What it sends home. Nothing is stated for the library on the pages we read. The standalone server needs "Egress to https://beacon.langchain.com from your network" for licence checks and usage reporting, unless it runs in air-gapped mode.

Pros
  • A pause that waits as long as the reviewer needs, with the state saved
  • The library runs in your code with no key
Cons
  • The standalone server reports to LangChain unless it runs air-gapped
  • LangChain says not to run the standalone server in serverless environments

CrewAI: best for developers building several agents that share one job

What it is and what you run. "CrewAI is an open-source Python framework with high-level abstractions and low-level APIs for building production-ready multi-agent workflows," says its README. It installs with uv tool install crewai and runs in your own code; the latest release, 1.15.23, came out on 28 September 2026.

Licence and price. The framework is MIT and free. The paid Enterprise plan is "Custom" priced on CrewAI's pricing page, which says you can "Deploy on CrewAI cloud, your own VPC, or your own infrastructure".

Where the model runs. CrewAI's docs have a section on "Using Local Models with Ollama".

Where a person approves. Two ways, per its docs. A @human_feedback decorator in flows is for "Local development, console-based review, synchronous workflows". For "Production deployments", approval is "Webhook-based (Enterprise)".

What it sends home. "CrewAI uses anonymous telemetry to collect usage data," says the README's telemetry section, and it's on by default. Setting CREWAI_DISABLE_TELEMETRY to true turns it off, and per the telemetry docs a value it doesn't recognise leaves telemetry on.

Pros
  • Local models through Ollama are documented
  • Approvals in code while you build
Cons
  • Approvals for production need the paid Enterprise plan
  • A mistyped off switch leaves telemetry running

An assistant that acts on its own

OpenClaw: best for a team assistant that works through your chat apps and the tools on its host

What it is and what you run. An open-source assistant you run on your own hardware, which acts through the chat platforms you connect and runs commands on its host. Its README says "State, memory, and credentials live on your hardware." It installs with a script for macOS, Linux and Windows, and released v2026.9.6 on 23 September 2026.

Licence and price. MIT, from the OpenClaw Foundation. It "has no paid tier, hosted service, or token".

Where the model runs. OpenClaw's local models docs say it "can install and manage a local model or connect to a server you already run", with LM Studio and Ollama as options, and warn that "Local models do not provide hosted providers' safety filters." The README's other line still applies: "Your prompts go to the model provider and chat platforms you configure".

Where a person approves. On its host, "Commands run only when policy + allowlist + (optional) user approval all agree," per OpenClaw's approval docs. Its advanced approval docs put approval buttons in Discord, Slack and Telegram; on Microsoft Teams, a person approves by typing /approve in the same chat.

What it sends home. A daily update check, and nothing else by default. The README says "by default OpenClaw itself phones home for nothing but a daily version check, anonymous feature statistics are opt-in, and update.checkOnStart: false disables both". Its telemetry docs list what the check carries, and the table below has it.

Pros
  • Sends nothing home but a daily update check, and that can be switched off
  • Approvals from the chat apps your team already uses
Cons
  • Tools run on the host for the main session unless you set up sandboxing
  • One install is one trust boundary, not a wall between users who shouldn't see each other's data

Both drawbacks are OpenClaw's own words. The README says "Tools run on the host for the main session unless you configure sandboxing." The security docs add that "OpenClaw is not a hostile multi-tenant security boundary for mutually adversarial users sharing one agent or gateway."

Automation platforms that install on premises

For companies that already run one of these for robots or workflows and now want agents inside the same walls. None of the three publishes an on-premises price, and none says on the pages we read what it sends home.

UiPath Automation Suite: best for companies already running UiPath robots on their own Kubernetes

What it is and what you run. UiPath's announcement of 20 May 2026 says that with "the April 2026 release of UiPath Automation Suite", "The full UiPath agentic automation stack ... now available on-premises, on the Kubernetes infrastructure customers already operate on: AKS, EKS, and OpenShift."

Licence and price. Standard and Enterprise are "Contact Sales for pricing" on UiPath's pricing page, which lists Standard as "Hosted in one of our available regions or on your own premise".

Where the model runs. "In self-hosted mode, the models themselves stay inside as well." UiPath recommends "self-hosted open-source models (GPT-OSS, GLM, Qwen), or bring your own".

Where a person approves. A Maestro user task: "The process execution pauses at this step until an assignee has completed the task." The user task docs exist for Automation Suite as well as the cloud.

What it sends home. Not stated on the pages we read. Ask UiPath for the list of outbound calls an on-premises install makes.

Pros
  • Agents, robots and approvals on one on-premises platform
  • Self-hosted models documented, so prompts can stay inside
Cons
  • Conversational agents come on premises only with "the October 2026 LTS release"
  • No published price

For the agent side of a UiPath estate, see our UiPath consultant page.

IBM watsonx Orchestrate: best for companies on Red Hat OpenShift that want IBM's agent tooling inside

What it is and what you run. IBM's agent platform, installed on IBM Software Hub or Cloud Pak for Data. IBM's install page describes Software Hub as running "on Red Hat OpenShift". The latest on-premises release is 5.4.0 Patch 5, from 20 August 2026, per the release notes.

Licence and price. No on-premises price is published. The cloud plans on IBM's pricing page start at $567 a month (Essentials).

Where the model runs. Any model registered as a "virtual model", including through Ollama or Red Hat OpenShift AI. And "If you self-host an LLM or use a model proxy or gateway as a pass-through to another provider, you can use OpenAI chat completion compatibility," per IBM's model docs. A fresh on-premises install has no default model, and creating an agent before you set one fails "with no additional diagnostic information".

Where a person approves. Agentic workflows are the tool when "Human-in-the-loop interaction is needed for approvals or decision-making," say IBM's developer docs, and they can run for "minutes, hours, or even days". A user activity step collects a form from the people you name, such as approvers.

What it sends home. Not stated on the pages we read.

Pros
  • Agents and approval steps in the same on-premises install
  • Connects to a model you host through Ollama or your own endpoint
Cons
  • The on-premises edition "is usually one release behind" IBM's cloud
  • IBM's tested model pairings are all hosted services, such as "gpt-oss-120b via Groq or AWS Bedrock"

IBM's feature parity page, updated 29 September 2026, marks most on-premises features "Partial support", agentic workflows included, and gives AgentOps and "Governing assets with AI Gateway" "No support".

Automation Anywhere AI Agent Studio: best for companies already running Automation 360 on premises

What it is and what you run. The AI agent and AI skills part of Automation 360. Its release notes for v.34 mark features for "Cloud and On-Premises", and those for v.39, updated 6 April 2026 and the newest we could read, say a new capability "is supported in Task Bots for both Cloud and On-Premises environments". We read these through the Internet Archive.

Licence and price. "Access to AI Agent Studio is included with the Enterprise Platform that enables AI Agents," with usage drawn from "Automation AI credits", per the AI Agent Studio FAQ. No price is published.

Where the model runs. The FAQ asks whether it connects to "models hosted on private, customer infrastructure" and answers: "Yes, you can define and connect to your own custom models."

Where a person approves. "You can configure an approval task to share requests with decision makers before the process automation is completed," per the approval task docs. You set the number of approvals required, when the task expires, and the labels on its approve and decline buttons. The task sits at the end of a process automation, and its user configurations page shows it waiting, as "Waiting Approval (1/2)" for example, until it's "Approved" or "Declined". What a decline does next is for whoever builds the process: the page advises that "if the approver rejects, it could loop back to the requestor to adjust the data and resubmit". The approval task needs the Enterprise Platform licence, on premises too.

What it sends home. Not stated on the pages we read.

Pros
  • Custom models on your own infrastructure are documented
  • Agents and approvals under one licence
Cons
  • Once a connection uses a custom model, only its name and description can be changed
  • The approval step needs the Enterprise Platform licence

The first drawback comes from the custom model API page, updated 10 April 2026: the call that redefines a model "updates only custom models that have no associated Model connections", and a second call changes the name and description.

Our custom build

Meronym's custom agent: best for a business that wants the agent built into its own systems, with the approvals and what leaves agreed before the build

This entry is ours.

What it is and what you run. We build the agent for you, "in your cloud tenancy by default, in the region you choose, and on-premises where the data cannot leave your network", as our enterprise AI development services page puts it. A first agent runs in its narrow version four to six weeks after the two-week scope.

Licence and price. A build, not a download. Our scope takes two weeks, costs $4k–$12k credited against the build, and ends in a fixed quote, as our AI agent development services page sets out. One agent in your cloud tenancy is $8k–$35k as a pilot and $16k–$82k in production; on-premises work is quoted apart.

Where the model runs. The enterprise AI page adds that models run "through the provider's service in your account or as open-weight models you host", and that the provider agreement's retention and training terms are checked before any of your data is sent. For the open-weight ones, the AI agent development services page names Hugging Face, vLLM and Ollama.

Where a person approves. Written rules for "what the agent may do alone, what needs a person, and what it must refuse outright, agreed with your risk owner during scope", with approval gates, a queue, a kill switch and a rollback path, as the AI agent development services page sets out.

What it sends home. The architecture records every external model, telemetry and logging destination before the build. This guide does not claim one universal configuration for every client environment.

What it has done. This guide does not cite a published client result for our entry.

Pros
  • Built into your own systems, with the approval rules agreed before the build
  • In your tenancy by default, on premises where the data can't leave
Cons
  • A build with a price and weeks we don't publish yet, while the tools above install for nothing or a licence fee
  • No client result to show here yet

The ten side by side

The ten self-hosted AI agents compared, with our custom build
ToolKindWhat you runLicence and priceModel you hostWhere a person approvesA documented limit
n8nVisual builderCommunity Edition on your serversn8n's own licence; Community free; Business $800 a month billed yearly (in US dollars, 27 September); Enterprise on requestOllama Chat Model nodeBefore an AI Agent tool runsYour own internal business use only
DifyVisual builderDocker Compose, 2 CPU cores, 4 GiB RAMModified Apache 2.0; Community free, one workspace; Enterprise customOllama pluginHuman Input node, 3-day default timeoutNo multi-tenant service without permission
FlowiseVisual buildernpm or Docker ComposeApache 2.0, enterprise folder commercial; no public priceChatOllama nodeHuman Input node, or on an agent's toolsPaid prices behind a sign-in
LangflowVisual builderuv or DockerMIT, freeCore Language Model componentHuman Input component, or on an agent's toolsNo isolation between users
LangGraphFrameworkA library in your code; optional server with PostgreSQL and RedisMIT, free; server needs a licence keyThrough LangChain, Ollama includedInterruptsThe server reports to LangChain unless air-gapped
CrewAIFrameworkA library in your code; Enterprise on your infrastructureMIT, free; Enterprise customOllamaA decorator in code; webhooks on EnterpriseProduction approvals need Enterprise
OpenClawAssistantAn installer on macOS, Linux or WindowsMIT, free, no paid tierA local model it installs, or your own model serverCommand approvals, from chat appsOne trust boundary per install
UiPath Automation SuiteAutomation platformKubernetes: AKS, EKS or OpenShiftOn requestSelf-hosted GPT-OSS, GLM, Qwen, or your ownMaestro user taskConversational agents from the October 2026 LTS
IBM watsonx OrchestrateAutomation platformIBM Software Hub on OpenShiftOn request on premisesOllama or your own endpointUser activity in an agentic workflowUsually one release behind the cloud
Automation Anywhere AI Agent StudioAutomation platformAutomation 360 on premisesEnterprise Platform licence and AI credits; not publishedCustom models on your infrastructureApproval task at the end of a processA custom model in use can't be redefined
Meronym's custom buildBuilt for youYour cloud tenancy, or on premises$8k–$35k pilot, $16k–$82k productionThe provider's service in your account, or open-weight modelsApproval gates agreed at scopeA build, with weeks to wait

Source: each tool's documentation, licence and pricing page, linked in its entry, read on 27 and 29 September 2026. Checked as of September 2026.

What each self-hosted AI agent sends home, and how to stop it

A self-hosted agent that calls home isn't private until the calls are switched off. Hand this table to whoever installs the tool: it gives each one's default, from its own docs or config file, and the setting that stops it.

What each self-hosted AI agent sends home by default
ToolWhat it sends by defaultHow to stop it
n8nUpdate notices, workflow templates and diagnostics, to n8n's servers. Paid licence keys must also reach n8n's licence server daily to stay active, and that check carries data such as the number of production executionsN8N_DIAGNOSTICS_ENABLED=false, N8N_VERSION_NOTIFICATIONS_ENABLED=false and N8N_TEMPLATES_ENABLED=false, and unset the diagnostics settings; the paid licence check has to run for the key to stay active
DifyIts default settings check updates.dify.ai for updates, use marketplace.dify.ai for plugins, and set WEAVIATE_DISABLE_TELEMETRY=false for the bundled vector databaseChange CHECK_UPDATE_URL, MARKETPLACE_ENABLED and WEAVIATE_DISABLE_TELEMETRY; the file gives the values, not instructions
FlowiseAnonymous telemetryDISABLE_FLOWISE_TELEMETRY=true
LangflowAnonymous telemetry on feature usage and performanceDO_NOT_TRACK=True
LangGraphThe library: nothing stated. The standalone server: licence checks and usage reports to beacon.langchain.comAir-gapped mode, on the standalone server
CrewAIAnonymous usage telemetry; with share_crew on, detailed data including task outputsCREWAI_DISABLE_TELEMETRY=true, or set OTEL_SDK_DISABLED
OpenClawA daily update check carrying the OpenClaw version, operating system, Node.js version, CPU architecture and request surface, with no install or machine identifier; recorded checks add an approximate location and are kept three months. Feature statistics only if you opt inupdate.checkOnStart: false, or OPENCLAW_NO_AUTO_UPDATE=1; DO_NOT_TRACK doesn't stop the daily check
UiPath, IBM, Automation AnywhereNot stated on the pages we readAsk for the list of outbound calls an on-premises install makes
Meronym's custom buildDocumented for the client's architecture; no universal default claimedAgreed at scope

Source: the docs linked in each entry above; Dify's settings from its .env.example file, read on 29 September 2026; n8n's switches from its isolation guide and its licence check from the FAQ on its pricing page; OpenClaw's from its telemetry docs. We read the docs; we didn't watch the network traffic. Checked as of September 2026.

Where a vendor's docs say nothing, ask for the list of hosts an on-premises install calls, block everything else at your firewall, and read the firewall's log in the first week. Six of the seven tools here whose code is public send something home by default, so assume the three vendors' editions do too until they tell you otherwise.

Where the model runs, and what a private one costs

Every tool above can call a cloud API, a provider's service in your own cloud account, or a model on your own hardware. Only the last keeps prompts from leaving, and it's the one you pay for by the hour whether or not it's busy.

Running it yourself takes two things.

  • A runtime to serve the model. Ollama and LocalAI are MIT-licensed and vLLM is Apache 2.0, all free. NVIDIA's own serving software, NIM, comes with NVIDIA AI Enterprise, which NVIDIA's price list puts at "$4,500 / GPU" for a year's subscription, or "$1 / hour / GPU + CSP Instance Cost(s)" on the cloud marketplaces.
  • An open-weight model and a GPU that holds it. OpenAI's gpt-oss models are Apache 2.0, and their model cards say quantisation makes "gpt-oss-120b run on a single 80GB GPU (like NVIDIA H100 or AMD MI300X) and the gpt-oss-20b model run within 16GB of memory" (120b, 20b).

One NVIDIA H100 with 80 GB, rented on demand from Lambda, costs $3.29 an hour before tax: $2,401.70 a month if it runs all the time. The table sets that against the API bill for the same work: 10,000 support tickets a month, each the worked ticket from our AI agent cost guide, with nothing cached.

That ticket takes four model calls: three that each call a tool, and one that writes the reply. Every call re-sends 1,500 tokens of instructions, 1,000 tokens describing four tools and the customer's 500-token message, plus everything so far. Each tool call is 200 output tokens and brings back a 500-token result, and the reply is 400 tokens. That comes to 16,200 input tokens and 1,000 output tokens a ticket. Anthropic adds its own tool-use prompt to every call, 354 tokens on Claude Sonnet 5 and 496 on Claude Haiku 4.5, so their tickets are larger; OpenAI and Google publish no equivalent figure, so their rows leave it out.

One rented GPU against the API bill for 10,000 tickets a month
Model through its APIPrice per million tokens, input and outputTokens a ticket, input and output10,000 tickets a monthThe GPU costsThe GPU breaks even at
Claude Sonnet 5$2 and $1017,616 and 1,000$452.325.3 times as much53,097 tickets a month
GPT-6 Sol$2 and $1016,200 and 1,000$424.005.7 times as much56,644 tickets a month
Claude Haiku 4.5$1 and $518,184 and 1,000$231.8410.4 times as much103,593 tickets a month
Gemini 3.8 Flash, to 31 December 2026$0.75 and $3.7516,200 and 1,000$159.0015.1 times as much151,050 tickets a month
Gemini 3.8 Flash, from 1 January 2027$1.50 and $7.5016,200 and 1,000$318.007.6 times as much75,525 tickets a month
GPT-6 Luna$0.10 and $0.5016,200 and 1,000$21.20113.3 times as much1,132,877 tickets a month

Source: Lambda's on-demand price for one H100 PCIe, read on 29 September 2026; the model prices and the ticket from our AI agent cost guide, whose prices were read on 27 September 2026; our arithmetic, at 730 hours a month. Checked as of September 2026.

10,000 tickets a month through each model's API, against one rented GPU

One H100 rented on demand, all month: $2,401.70

  • Claude Sonnet 5

    $452.32

    The GPU breaks even at 53,097 tickets a month

  • GPT-6 Sol

    $424.00

    Breaks even at 56,644 tickets a month

  • Claude Haiku 4.5

    $231.84

    Breaks even at 103,593 tickets a month

  • Gemini 3.8 Flash, to 31 December 2026

    $159.00

    Breaks even at 151,050 tickets a month

  • Gemini 3.8 Flash, from 1 January 2027

    $318.00

    Breaks even at 75,525 tickets a month

  • GPT-6 Luna

    $21.20

    Breaks even at 1,132,877 tickets a month

At this volume every API bill is a fraction of the GPU's month. The case for running the model yourself is the data, not the price.

Three things the table doesn't settle:

  • The break-even is price only. At Sonnet 5's break-even, the GPU would serve about 376 tokens a second around the clock, counting input and output together; about 20 of those a second are output it has to generate. At GPT-6 Luna's, it would be about 7,415. Even the table's 10,000 tickets a month assume one GPU keeps up with about 70 tokens a second on average, and tickets don't arrive evenly. This guide does not claim a measured throughput for gpt-oss-120b on one H100; benchmark it at your expected concurrency before relying on the comparison. Past the server's tested ceiling you need more capacity, and the break-even moves.
  • They're different models. gpt-oss-120b isn't Claude Sonnet 5 or GPT-6 Sol, so test it on your own cases before you count the saving.
  • Operations work is not counted. A team member still patches, monitors and restarts the GPU server, and that time is outside the table.

The case for running the model yourself anyway is the data, not the price: when the data can't leave the building, the API isn't an option at any price. Some on this results page say fully local is practical now. Simon Høiberg's video, "Can we actually self-host AI agents now?", has chapters on open models such as Qwen3-Coder and GLM-5.1, and a reader in the r/opensource thread wants "an application I can run locally with all the data staying on my device". The middle route keeps the model in your own cloud account through the provider's service, at API-style prices under the provider's data terms. Our LLM development services page works that break-even out at scope.

Which self-hosted AI agent to start with

Pick the kind first:

  • if your operations team will build it, start with n8n or Dify;
  • if your developers will, start with LangGraph or CrewAI;
  • if you already run UiPath, IBM or Automation Anywhere, ask that vendor for the on-premises edition and the list of outbound calls it makes.

Before the first run, switch off what the tool sends home, using the table above.

Run the model yourself when the data can't leave, or when your volume passes the break-even for the model you'd otherwise call. Below that, keep the model in your own cloud account, or call the API under terms you've read.

If none of these fits, or your team would prefer help owning the build, send us the job instead: use the Scope an agent button at the end of this page.

FAQs

FAQ

Can I run an AI agent locally?

Yes. Every tool in this list runs on your own servers, and each can use a model you run yourself. The model sets the hardware: OpenAI's gpt-oss-20b runs within 16 GB of memory, and gpt-oss-120b needs a single 80 GB GPU such as an NVIDIA H100.

What AI models can I self host?

Open-weight models, whose weights you download and run on your own hardware. OpenAI's gpt-oss-120b and gpt-oss-20b are published under Apache 2.0, and UiPath's on-premises release recommends GPT-OSS, GLM and Qwen. Read each model's own terms before you build on it: IBM's model docs note that gpt-oss-120b comes with third-party terms that may impose use restrictions.

How can I have my own AI agent?

There are three routes, depending on who will build it: a visual builder your operations team draws the agent in, a framework your developers write it with, or a firm that builds it into your systems for you. Whichever you take, run it on a server you control, connect it to a model, and put an approval step before any tool that changes a record. Dify, for example, asks for at least two CPU cores and 4 GiB of memory, connects to a local model through its Ollama plugin, and pauses for a person with its Human Input node.

What is a private AI agent?

An agent whose software, model and outbound calls all stay inside your control: it runs on your servers or cloud account, the model runs where your data is allowed to go, and nothing else leaves without your say-so. Self-hosting the software covers only the first of the three. Six of the seven tools in this list whose code is public send something home by default.

Can AI agents run on premise?

Yes. UiPath's Automation Suite, IBM watsonx Orchestrate on IBM Software Hub and Automation Anywhere's Automation 360 all run agents on your own infrastructure, and so do the seven tools here whose code is public. The catches are the vendors' own: UiPath's conversational agents come on premises only with its October 2026 LTS release, IBM's on-premises edition is usually a release behind its cloud, Automation Anywhere's approval step needs its Enterprise Platform licence, and none of the three publishes an on-premises price.

Can I offer a self-hosted agent tool to my own customers?

Check the licence first. n8n's covers your own internal business use, not letting customers connect their accounts and build workflows. Dify forbids a multi-tenant service without its written permission and requires its logo to stay. AutoGPT's platform code is licensed so that it can't be sold as a competing hosted service. LangGraph's library, CrewAI, Langflow and OpenClaw are MIT-licensed and carry no such limit. Flowise is Apache 2.0 apart from its enterprise folder, which falls under a commercial licence, and LangGraph's standalone server needs a licence key from LangChain.

Written by

Hina Ejaz

Content writer

Hina Ejaz has been a content writer for about seven years, and has written about AI for the last four.

Scope an agent for your own environment

Tell us the job, the systems it touches and where the data has to stay. An engineer replies within two business days, says whether one of these tools will do it, and if none will, what we would build and where it would run.