Local and self-hosted AI you can run on your own hardware

Open-weight models are now good enough that keeping inference in-house is a practical choice rather than a compromise. These projects cover local model runners, private assistants and the self-hosted infrastructure around them.

The argument for running AI locally used to be ideological and is now mostly commercial: no per-token bill, no data leaving the network, and no vendor deprecating the model your product depends on. Regulated industries reached that conclusion first; everyone else is arriving via the invoice.

What the category still lacks is the boring layer — updates, monitoring, access control, backups. The runners work. Turning a runner into something a team can depend on is where the open problems are, and several projects below are attempts at exactly that.

Projects in this topic

23 analysed projects match this topic.

Developer Tools
Featured

Developer-first ai agent layer for macos

Skip weeks of custom work by starting from a working ai agent foundation.

ai agentmacosswift
Beginner · AI application
TOOL-46336View details
Developer Tools
Featured

Developer-first whoop layer for bluetooth

Skip weeks of custom work by starting from a working whoop foundation.

whoopbluetoothdata privacy
Beginner · Developer library
TOOL-74071View details

Questions people ask

What hardware do I need to run a useful local model?
A recent laptop with 16–32 GB of unified memory handles small and mid-size models well enough for assistants and code completion. Serving a team is a different question and usually means a GPU box.
Is self-hosting actually cheaper?
Above a steady volume, yes — the crossover is usually earlier than people expect for high-frequency, low-complexity calls. Below it, an API is cheaper than the time you will spend on operations.
Can I self-host and still use a hosted model for hard requests?
That hybrid is the common production pattern: route the bulk locally and escalate the small share that needs a frontier model. Several routing projects in this list exist for exactly that split.

Related collections

All collections

Other topics

Updated: 2026-08-17