CosmicAC Logo

Welcome

Self-hosted GPU compute. Run GPU Container jobs and serve open-source language models on your own Kubernetes cluster.

CosmicAC is a self-hosted platform for GPU compute. You deploy it on your own Kubernetes cluster, then use it to run GPU Container jobs and serve open-source language models through a single API endpoint.

Because CosmicAC runs entirely on your infrastructure, your data, models, and inference traffic never leave your cluster.

CosmicAC job types

CosmicAC runs two kinds of job. Choose the one that fits your task.

GPU Container Job

An isolated virtual machine (VM) with whole GPUs attached via PCI passthrough and full shell access.

Managed Inference

An OpenAI-compatible API that serves open-source language models.

Get started

Deploy CosmicAC, then connect the CLI to start running jobs.

Deploy CosmicAC

Prepare your Kubernetes cluster and deploy CosmicAC on it.

Install the CLI

Install the CosmicAC CLI to interact with CosmicAC services from your terminal.

Once you have CosmicAC running, start here:

Create a GPU Container job

Launch your first GPU Container and open a shell into it.

Get a Managed Inference API key

Create a key and send your first chat-completion request.

Learn the concepts

Understand how CosmicAC runs jobs and serves models on your cluster.

Architecture

How the control plane and workloads fit together on your cluster.

GPU Container Job

Isolated GPU VMs and how they work.

Managed Inference

How model serving works end to end.

Guides

Follow step-by-step instructions for common tasks.

GPU Container guides

Create, access, and work with GPU Container jobs.

Managed Inference guides

Connect a client to Managed Inference and send requests.

Operations

Monitor, scale, upgrade, back up, and troubleshoot your deployment.

Reference

Look up commands, configuration options, and release details.

CLI commands

Every CosmicAC CLI command, with usage and examples.

Configuration reference

Every platform and job configuration option.

Release notes

What changed in each release.

Introduction

Next Page

On this page

CosmicAC job typesGet startedLearn the conceptsGuidesReference