Sovereign AI
infrastructure.

from openai import OpenAI
client = OpenAI(
    base_url="https://inferx.intra.example/api",  # ← the change
    api_key=os.environ["INFERX_API_KEY"],
)
# Anthropic SDKs and claude-code work the same way via /anthropic/v1
# every request lands in the dashboard: cost · P50/P95/P99 · errors▌

Drop-in for both OpenAI and Anthropic SDKs, streaming included — with per-key budgets, rate limits, and model allowlists.

$ export HF_ENDPOINT=https://models.intra.example

# everything downstream just works — no client patches
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B")
# served from your registry; cached from upstream or fully air-gapped▌

Wire-compatible with the Hugging Face Hub API — including git clone and multi-gigabyte LFS transfers.

# your laptop → a GPU environment, through the DevSpace bastion
$ ssh alice+jupyter@bastion.intra.example
(jupyter) $ nvidia-smi --query-gpu=name --format=csv,noheader
NVIDIA A100-SXM4-80GB
# idle for 2h → scaled to zero, PVC intact, GPU back in the pool▌

Native SSH UX — shell, SCP, and port forwarding — authenticated by your uploaded key, no kubectl anywhere.

$ ./install/00-preflight.sh                      # read-only validation
$ ./install/03-install-cluster.sh --cluster site-a
ok  k8s · cilium · longhorn · cert-manager · envoy-gateway · authentik
# Ctrl-C and re-run is the documented recovery path
# same bundle, same registry, same result — across sites and months▌

Content-addressed bundles: re-packing a version bump moves only changed layers. One registry serves many clusters.