Loading
Preparing infrastructure view...
Home / Infrastructure design / GPU as a service
Accelerators shared properly across many users
One pool of GPUs, partitioned and scheduled so a dozen teams can use it without one of them quietly taking all of it.
What it is
GPU as a service, in plain terms
One pool of GPUs, partitioned and scheduled so a dozen teams can use it without one of them quietly taking all of it.
Partitioning
MIG or vGPU slices, sized to the kind of work each team does.
Quotas and fair share
Guaranteed floors and burst ceilings per team.
Chargeback
Usage attributed per project, ready for internal billing.
Isolation
Teams cannot see or disturb each other's work.
How it works
How gpu as a service is delivered
- 01Partition to the workWhole GPUs for training, MIG slices for many small jobs, vGPU for notebooks. Mixing them is the point.
- 02Quotas that are enforcedEach team gets a guaranteed floor and a burst ceiling, applied by the scheduler rather than by email.
- 03Preemption with rulesLow-priority work yields, and everybody knows in advance which work that is.
- 04Pack the poolBin packing and reservations together keep utilisation high without starving interactive users.
- 05Chargeback makes it realGPU hours per project, including idle time, reported where the budget holders can see it.
In the field
GPU as a service on site
What the work looks like once it is on the floor.
Detail
What is included
| Partitioning | Whole GPU, MIG slices or vGPU, per pool. |
|---|---|
| Scheduling | Queues with fair share, preemption and priority classes. |
| Quotas | Per team, per project, enforced rather than requested. |
| Reporting | GPU hours per project, with idle time visible. |
| Access | Notebooks, batch jobs or an API, depending on the audience. |
Watch
Watch: how we approach gpu as a service
Watch
FILMFilm GPU as a service walkthrough · 2:05
Support
Common questions
How is it priced?↓
Fixed price against a defined scope. Ongoing operation is quoted separately as a monthly service.
Do you supply the hardware?↓
We specify it and can procure it, but it stays on your balance sheet.
Can a partner sell this under their own name?↓
Yes. Design and build are delivered white-label where a partner holds the customer.
Next step
Tell us what you are building and we will tell you what it needs.
An hour with our engineers, no charge. Bring a floor plan, a workload, or just the problem.