Skip to main content
Applies to: Embedded ❌, Enterprise ✅ Slurm is the workload manager most GPU clusters run to schedule and account for jobs — queueing work across shared nodes, enforcing fair-share and priority policies between teams, and tracking GPU-hour usage per job. That makes it the de facto standard in AI training infrastructure, where expensive GPU nodes are shared across many training and data jobs instead of dedicated to one team. GPU-focused cloud providers (“Neoclouds”) such as CoreWeave and Nebius run Slurm-based scheduling across their Kubernetes clusters for exactly this reason. Slurm shows up for LanceDB Enterprise in two related ways. Its own pods — query nodes, plan executors, and background job workers alike — can run as Slurm-scheduled jobs rather than plain Kubernetes pods, under the same scheduling and accounting as everything else on the cluster. And in the multicloud case, when the remote cloud is a Neocloud, Slurm is commonly how the dispatched GPU work actually gets scheduled there.

​
How it fits together

Scheduling LanceDB’s pods through Slurm puts them under the same scheduler as GPU training jobs, so the cluster’s capacity is accounted for consistently regardless of which one is using it — Slurm’s fair-share and priority policies apply to LanceDB the same way they apply to a training job, including preemption when training needs the capacity back.

​
Why it matters

Most GPU infrastructure already runs Slurm for training. Deploying LanceDB Enterprise into that same infrastructure, under the same scheduler, means it can share capacity with training workloads safely — queued, accounted, and preemptible like everything else — instead of requiring a separate, dedicated pool of nodes carved out just for LanceDB. Combined with multicloud dispatch, that makes it practical to keep your primary deployment wherever it already lives and still reach GPU capacity on a Neocloud built around Slurm, only for the work that needs it. Contact us to learn more about running LanceDB Enterprise on a Slurm-scheduled cluster.

​
What to read next

Multicloud

The cross-cloud dispatch model this page’s Neocloud case builds on.

Architecture

The query, executor, cache and jobs fleets this scheduling applies to.