On this page

    Runtime Filtering

    Runtime filtering improves query performance by dynamically applying dimension table filters to joined fact tables. By default, runtime filtering is enabled for partitioned columns and disabled for non-partitioned columns.

    To enable runtime filtering for both partitioned and non-partitioned columns:

    • Enable both the planner.filter.runtime_filter and exec.non_partitioned_parquet.enable_runtime_filter support keys.

    To disable runtime filtering for both partioned and non-partitioned columns:

    • Disable the planner.filter.runtime_filter support key.

    Runtime Filtering Example

    The following query joins multiple partitioned and non-partitioned columns:

    • Partitioned columns: ptcol1, ptcol2
    • Non-partitioned columns: regcol1, regcol2
    select 
       t1.ptcol1, t1.ptcol2, 
       t1.regcol1, t1.regcol2, 
       t1.regcol3, 
       t1.othcol, t2.t2col 
    from table1 t1 inner join table2 t2 on 
        (t1.ptcol1 = t2.ptcol1 and t1.ptcol2 = t2.ptcol2 and 
         t1.regcol1 = t2.regcol1 and t1.regcol2 = t2.regcol2)
    where t1.regcol3 = "highly_selective_val";