Home chevron_right Linux
LINUX GUIDES

Local AI for
Linux.

Linux gives you maximum control and performance for local AI. Pick your preferred inference engine and get up and running fast.

macOS Windows

Step 1 · Pick Your Tool

START HERE: Choose Your Engine

The best ways to run AI locally on Linux.

terminal
CLI · Open Source

Ollama

The fastest, easiest way to get up and running via command line.
grid_view
GUI · Easy

LM Studio

Beautiful graphical interface with a built-in model browser.
speed
Pro · Max Speed

llama.cpp

Maximum performance and full control for advanced users.

All Linux Tutorials

LINUX 7 MIN READ

Run Ollama on Linux: The Definitive Guide

Deploy Ollama as a background systemd service on Ubuntu/Debian. Full setup for NVIDIA CUDA and AMD ROCm.

Read Guide arrow_forward
LINUX 6 MIN READ

Setup LM Studio on Linux (Ubuntu/Debian)

Install the LM Studio AppImage on Linux to get a beautiful graphical interface for your local AI models.

Read Guide arrow_forward
LINUX 15 MIN READ

Local Llama 3 on Linux

Deploy Meta's Llama 3 model locally on Linux using llama.cpp with full CUDA support. This guide covers compilation, quantization, and running the model from the command line.

Read Guide arrow_forward
LINUX 12 MIN READ

High-Throughput Serving with vLLM on Ubuntu

For enterprise-grade performance, deploy vLLM on Linux to serve models with PagedAttention and maximum token throughput.

Read Guide arrow_forward