Open source / beta / built from source

Metal-first MoE inference for Apple Silicon.

Hebrus runs a deliberately small set of qualified model artifacts. Its AUTO planner chooses resident Metal or bounded SSD expert streaming against the machine and workload it can actually admit.

Explore the repositoryRead the support contract Hebrus 0.3.0 release
Hebrus / AUTOCapability admission
  1. 01
    Validate artifactExact inventory, geometry, byte ranges and digest
  2. 02
    Plan the working setModel state, context, Metal headroom and live pressure
  3. 03
    Resolve executionResident Metal or a bounded SSD expert cache
Unsupported combinationsRejected

Qualified, not universal.

Hebrus supports exact artifacts and hardware profiles—not arbitrary GGUFs, model families or Macs. Unsupported combinations fail closed.

Current support

A narrow matrix you can inspect.

Each row requires Apple Metal and the exact embedded ExpertMajor v2 store. Minimum memory is a qualified floor, not a promise that every context or workload fits.

Qualified Hebrus model support
ModelArtifactMinimum memoryQualified AUTO path
Qwen3.6-35B-A3B Stable Affine420.81 GB16 GiBGuarded SSD at 16 GiB through a 128K prompt plus 128 decode tokens. Higher-memory paths follow separate admission gates.
DeepSeek V4 Flash86.72 GB64 GiBAUTO selects resident or SSD streaming after admission.
GLM 5.2262.15 GB64 GiBAUTO uses SSD streaming; resident requests are rejected.
Authoritative runtime contract Benchmark evidence index

Runtime contract

One engine, five frontends.

The CLI, local server, alpha agent, benchmark and evaluation tools share the same runtime and machine-readable capability document.

Open the engine reference
hebrus

Interactive and one-shot CLI

hebrus-server

Local HTTP server with model-specific protocol limits

hebrus-agent

Alpha agent frontend

hebrus-bench

Benchmark frontend

hebrus-eval

Evaluation frontend

Model-free start

Build, then ask the binary what it supports.

The repository documents Xcode Command Line Tools as the build prerequisite. These commands compile Hebrus and print its build and capability documents without downloading a model.

git clone https://github.com/andreaborio/hebrus.git
cd hebrus
git checkout v0.3.0
make -j
./hebrus --build-info
./hebrus --capabilities=json

Prefer a desktop interface?

Hebrus Studio is the companion macOS app.

Explore Hebrus StudioStudio source