4.4.1 Release Notes

Fixed Issues in 4.4.1

Slow sorts in some circumstances when micro-spilling is disabled and batch sizes are especially small
Addressed by resizing record batches during spilling despite uneven incoming batches.

IllegalStateException: Inconsistent row count error while joining two Hive data sets using complex data in Parquet format
Fixed by handling non-existing Parquet columns.

TOTAL_SPILLED_DATA_SIZE is 0 after an external sort with micro-spilling enabled
Fixed by updating the metric for total spill size.