Dremio Usage on Kubernetes
Dremio on Kubernetes usage is measured in Dremio Consumption Units (DCUs), which are consumed only when Dremio engines are running. Understanding how DCUs are calculated helps you optimize costs and monitor your Dremio instance effectively.
How Usage is Calculated
The number of DCUs consumed by each engine depends on two factors:
- How long the engine and its replicas have been running.
- The size of the engine.
DCU consumption for an engine is calculated as:
Total uptime / 60 * DCU consumption per hour
Where:
Total uptime- The total time the engine was running, measured in 5-minute increments and rounded down to the nearest multiple of 5.DCU consumption per hour- The DCU consumption rate per hour for the engine size. In Dremio Software, 1 DCU corresponds to 1 vCPU-hour.
Example
A cluster has two Dremio engines:
- Engine A, which has 15 cores running on a single executor
- Engine B, which has 120 cores running across 8 executors
Suppose that between 8 a.m. and 9 a.m. one day:
-
Engine A runs for 43 minutes, but the engine's uptime is rounded down to only 40 minutes.
The total usage for Engine A for this hour is
(floor(43)/60)*6 = (40/60)*6 = 4 DCUs. -
Engine B runs for 51 minutes
The total usage for Engine B for this hour is
(floor(51)/60)*120 = (50/60)*120 = 100 DCUs.
In total, this cluster would be billed for 104 DCUs of usage for the period between 8-9 a.m.