Release 409 (3 Mar 2023)#
General#
- Add support for dropping nested fields with a - DROP COLUMNstatement. (#15975)
- Add queue, analysis, planning, and execution time to the output of - EXPLAIN ANALYZE. (#16329)
- Add support for executing table functions with any number of table arguments. (#1839) 
- Improve output of - EXPLAINqueries to show statistics when a query contains aggregations. (#16201)
- Improve performance of queries with aggregations containing a - DISTINCTclause using table statistics. This can be configured with the- optimizer.mark-distinct-strategyconfiguration property, and the- optimizer.use-mark-distinctconfiguration property is now deprecated in favor of it. (#15927)
- Improve performance of LIKE expressions with patterns constructed dynamically. (#15999) 
- Remove the - distributed-index-joins-enabledconfiguration property and related functionality. (#15375)
- Fix failure when using non-comparable and non-sortable values as part of a - VALUESexpression. (#16242)
BigQuery connector#
Cassandra connector#
- Add support for - TIMEtype. (#13063)
ClickHouse connector#
Delta Lake connector#
Hive connector#
- Add support for the Hadoop - DefaultCodecto Hive formats. (#16250)
- Add a native CSV file format reader and writer. These can be disabled with the - csv_native_reader_enabledand- csv_native_writer_enabledsession properties or the- csv.native-reader.enabledand- csv.native-writer.enabledconfiguration properties. (#15918)
- Add a native JSON file format reader and writer. These can be disabled with the - json_native_reader_enabledand- json_native_writer_enabledsession properties or the- json.native-reader.enabledand- json.native-writer.enabledconfiguration properties. (#15918)
- Add a native text file format reader and writer. These can be disabled with the - text_file_native_reader_enabledand- text_file_native_writer_enabledsession properties or the- text-file.native-reader.enabledand- text-file.native-writer.enabledconfiguration properties. (#15918)
- Add a native sequence file format reader and writer. These can be disabled with the - sequence_file_native_reader_enabledand- sequence_file_native_writer_enabledsession properties or the- sequence-file.native-reader.enabledand- sequence-file.native-writer.enabledconfiguration properties. (#15918)
- Add a native regex file format reader. The reader can be disabled with the - regex_native_reader_enabledsession property or the- regex.native-reader.enabledconfiguration property. (#15918)
- Add - regexand- regex_case_insensitivetable properties for the- REGEXformat. (#16271)
- Improve performance of queries which read from partitioned Hive tables and write to partitioned tables when statistics are not available for the source tables. (#16229) 
- Improve query performance when only table statistics generated by Apache Spark are available. This can be disabled via the - hive.metastore.thrift.use-spark-table-statistics-fallbackconfiguration property. (#16120)
- Fix incorrectly ignoring computed table statistics in - ANALYZE. (#15995)
- Fix query failure when reading Parquet files generated by Kafka Connect. (#16264) 
Hudi connector#
- Fix query failure when reading Parquet files generated by Kafka Connect. (#16264) 
Iceberg connector#
- Add support for dropping nested fields with a - DROP COLUMNstatement. (#15975)
- Add support for Iceberg table sort orders. Tables can have a list of - sorted_bycolumns which are used to order files written to the table. (#14891)
- Fix query failure when reading nested columns on a table with equality delete files. (#14836) 
- Fix query failure when reading Parquet files generated by Kafka Connect. (#16264) 
SQL Server connector#
- Add support for pushing down joins using - =and- !=predicates over text columns if the column uses a case-sensitive collation within SQL Server. (#16185)