Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release notes for 0.216 #12081

Closed
14 tasks done
mbasmanova opened this issue Dec 15, 2018 · 14 comments
Closed
14 tasks done

Release notes for 0.216 #12081

mbasmanova opened this issue Dec 15, 2018 · 14 comments

Comments

@mbasmanova
Copy link
Contributor

mbasmanova commented Dec 15, 2018 •
edited by electrum
Loading

Andrii Rosa

  • all checked
  • 12-17 11:13:19 a91bef2 Pick max distinct values in ExchangeStatsRule
  • 12-18 10:16:21 f9c887e Add additional zero and unknown checks in PlanNodeStatsEstimateMath
  • 12-18 10:17:07 5f6be90 Replace differenceInStats with subtract and symmetricDifference
  • 12-18 12:38:35 d6d2ca5 Do not change explicitly selected join distribution type
  • 12-20 15:45:08 568d4ae Remove unused field from FragmentProperties
  • 12-20 15:45:08 a9d13dd Refactor PlanFragmenter

Dain Sundstrom

  • all checked
  • 12-15 15:17:14 da6c63c add config for whether or not wait for final stats after query failed
  • 12-15 15:17:14 e60baed add test for testDefaults
  • 12-15 15:17:14 e6f6507 fix the client hang problem after query failed
  • 12-15 15:17:14 e850e16 Remove config for whether or not wait for final status for failed query
  • 12-15 15:17:14 f5df4c9 add test for query.wait-stats-after-failed-enabled
  • 12-17 22:20:23 8284c09 Fix this leak when adding listeners in a constructor
  • 12-17 22:20:23 d883ecb Immediately fire current state in StateMachine addStateChangeListener
  • 12-17 22:34:37 7f45d08 Remove unused testing QueryStats constructor
  • 12-17 22:34:38 00e579f Fix query execution time calculation
  • 12-17 22:34:38 5d0fdd2 Improve QueryStateMachine test stats coverage
  • 12-17 22:34:38 803ee6e Simplify and cleanup QueryStateMachine
  • 12-17 22:50:28 90dae1b Move QueryStateMachine timings to new QueryStateTimer
  • 12-17 22:50:29 b9d8db7 Produce all query timings for query regardless of state

David Phillips

  • all checked
  • 01-03 01:16:40 6d85fc1 Simplify Docker instructions for product-tests
  • 01-03 01:35:41 ef16eb8 Cleanup code in FileSingleStreamSpiller
  • 01-03 01:45:11 b6addd4 Avoid query failures during partition pruning
  • 01-04 17:17:38 4e46ee1 Fix GROUP BY over EXTRACT test to not constant-fold
  • 12-17 18:31:30 311618c Fix potential overflow in position size calculation
  • 12-17 18:31:30 535ba62 Add generics for alternatingNullValues helper
  • 12-17 18:31:30 84235b0 Include nulls in dictionary block logical size
  • 12-17 21:27:39 24f279a Make ConnectorBucketNodeMap a top level class
  • 12-17 21:27:39 3239311 Check for negative buckets in ConnectorBucketNodeMap
  • 12-17 21:27:39 79a5e21 Cleanup warnings in HiveNodePartitioningProvider
  • 12-18 14:59:44 0195ffd Use list instead of map for bucket-to-node
  • 12-18 16:19:15 a618212 Remove unused PUBLIC token from parser
  • 12-27 15:37:11 3df20da Simplify BucketSplitInfo creation expression
  • 12-29 01:57:10 43bd519 Add support for query pushdown to S3 using S3 Select
  • 12-30 16:48:26 8b2d263 Fix Kudu build to not enable Javadoc by default
  • 12-31 03:59:45 7599a11 Update to Airlift 0.178
  • 12-31 03:59:45 f98f3af Validate Joda-Time bridge in plugin class loaders

Grzegorz Kokosiński

  • all checked
  • 01-02 01:01:12 80a2180 Replace this lambda with a method reference
  • 01-03 09:18:50 12a0753 Allow cassandra to override default protocol version
  • 01-04 05:25:18 7c7084d Move tests out of big_query test group
  • 01-04 05:26:31 6dc08b6 Run sphinx-build in parallel
  • 12-15 04:37:21 4662eb4 Fix Kudu example configuration docs
  • 12-15 04:37:21 cdd456f Fix typo in product test group name
  • 12-20 16:14:36 6c58f69 Update to Kudu client 1.8.0
  • 12-20 16:14:36 895f759 Emit Kudu table property number_of_replicas in SHOW CREATE TABLE

Haozhun Jin

  • all checked
  • 12-16 20:01:19 b845cd6 Add block/position convention to all distinct from operators
  • 12-17 17:58:15 8ac4b84 Use JVM time zone rules in Joda
  • 12-21 02:02:40 f4103ea Add joda-to-java-time-bridge dependency in example connector

Karol Sobczak

  • all checked
  • 01-07 04:19:57 fe6635b Push predicates through windows for predicates on partition symbols
  • 01-07 04:21:27 b1bb391 Fix Count(*) on empty relation returns NULL when optimize_mixed_distinct_aggregation is turned on.
  • 12-18 05:34:58 15f6462 Rename page to resultPage
  • 12-18 05:34:58 2226f67 Use simple memory context for tracking page processor memory
  • 12-18 05:34:58 2aa311c Port PageProcessor to WorkProcessor
  • 12-18 05:34:58 6a260d5 Rename pageBuilderMemoryContext to outputMemoryContext
  • 12-18 05:34:58 e4018cf Remove PageProcessorOutput
  • 12-18 05:34:58 efd0834 Update retained size in PageProcessor less eagerly
  • 12-18 05:34:58 f73f8f0 Rename isUnloadedLazyBlock to isNotLoadedLazyBlock

Maria Basmanova

  • all checked
  • 12-17 13:26:43 2a60cf7 Restrict SHOW STATS to predicates that can be pushed down
  • 12-17 13:26:43 ba9e151 Refactor TestShowStats
  • 12-17 13:26:43 d25723b Reject SHOW STATS with a non-* column list
  • 12-17 13:26:43 f01261e Remove SHOW STATS ON table syntax
  • 12-19 06:23:03 0005ede Fix a typo in the description of the bing_tile_at function

Martin Traverso

  • all checked
  • 12-15 21:49:34 e2ec641 Fix Live Plan UI for index joins
  • 12-15 21:51:11 28ec8f4 Add millisecond function
  • 12-15 21:51:11 a590838 Add missing tests to DateTimeFunctions
  • 12-15 21:56:43 834b01c Correct read time stats in ParquetPageSource

Nezih Yigitbasi

  • all checked
  • 01-02 15:59:28 52e332c Mark fields as final
  • 01-02 15:59:28 5d231d1 Remove unused parameter from TestingPrestoClient::convertToRowValue
  • 01-02 15:59:28 bd96c0f Simplify assertions
  • 01-07 13:14:50 93f7571 Update kafka docs
  • 12-16 00:46:45 d882abc Add suppressed exceptions to tear down exceptions in verifier
  • 12-19 16:08:48 0bfe80b Fail loudly with corrupted Parquet statistics

Piotr Findeisen

  • all checked
  • 01-01 17:43:53 eea9e8d Remove obsolete test files
  • 01-01 17:48:42 e80bd99 Fix a typo in requireNonNull() message
  • 01-01 18:46:09 0122984 Remove unused connectorId from TpchTableHandle
  • 01-01 18:46:09 fa5cf88 Remove useless "tpch:" from TpchTableHandle toString
  • 01-04 06:25:03 54d46f3 Remove node_id column from system.runtime.queries
  • 01-07 05:07:57 03df34f Enable char predicates to be pushed down
  • 12-15 01:39:13 d452a6d Retain last entry when reading node.properties
  • 12-15 01:40:15 e351a2a Add missing @nullable annotations
  • 12-15 01:40:28 7895cdd Add basic TupleDomain#toString
  • 12-17 17:30:16 81b0521 Skip all-false nullness array in ArrayBlockBuilder
  • 12-18 08:31:10 0715fbb Fix double planning in assertPlannerWarnings
  • 12-20 02:50:44 4d29122 Leave trace in logs when query is moved to RESERVED_POOL
  • 12-20 14:17:22 6876461 Change representation of EnforceSingleRowNode in EXPLAIN
  • 12-22 11:03:44 5c0d510 Remove incorrect quotes from SQL snippet
  • 12-30 12:01:38 7d48abc Report attempted allocation when memory limit exceeded

Rebecca Schlussel

  • all checked
  • 12-18 10:48:03 4cb4d19 Fix SemiTransactionalHiveMetastore error message
  • 12-18 23:09:29 bf50f82 Fix typo in variable name
  • 12-20 16:08:31 73862a6 Add mongo tests to travis build
  • 12-20 16:08:31 de61e7d Remove unnecessary properties from mongo session

Shixuan Fan

  • all checked
  • 01-02 13:04:39 6774e47 Remove code duplication between executeQueryControl and executeQueryTest
  • 01-02 13:04:39 b712beb Add option to skip dropping temporary tables upon checksum failure

Wenlei Xie

  • all checked
  • 12-15 18:48:35 2598dce Add minor state check to PartitionedLookupSourceFactory
  • 12-16 18:35:51 786ccbd Add empty check for types in ORC file
  • 12-21 18:05:36 9ba5ed7 Remove PartitionedLookupSourceFactory specific methods from interface
  • 12-24 14:09:37 080a6a1 Support lambda in aggregation functions

yingsu00

  • all checked
  • 12-19 18:52:38 1dec59f Fix ARRAY_DISTINCT wrong results on NULL and 0
  • 12-21 15:49:02 c5f521e Fix bug in ARRAY_INTERSECT
  • 12-31 03:50:19 ce75666 Change ARRAY_INTERSECT to use TypedSet
@martint
Copy link
Contributor

martint commented Dec 16, 2018 •
edited
Loading 

* Add :func:`milliseconds` function (issue #9524).
* Fix accounting of time spent reading Parquet data.

For reference: #11514

Web UI

* Fix failure when rendering live plan view for queries involving index joins (issue #12054).

@haozhun
Copy link
Contributor

haozhun commented Dec 17, 2018 •
edited
Loading

#11891

General
-------
* Fix rare (but practical) incorrect query result for queries involving timestamp,
  when the time zone database embedded in the version of Joda-Time
  that presto depends on does not match the time zone database used by the JVM 
  that Presto is running in.

SPI
---
* All connectors that uses Joda-Time are now required to declare a ``runtime`` dependency on
  `joda-to-java-time-bridge <https://github.com/airlift/joda-to-java-time-bridge/>`_.

@nezihyigitbasi
Copy link
Contributor

nezihyigitbasi commented Dec 19, 2018 •
edited
Loading

#12036

Hive Changes
--------------
* Queries reading Parquet files will now fail by default if statistics 
  in those Parquet files are corrupt (e.g., min > max). 
  To disable this behavior ``hive.parquet.fail-on-corrupted-statistics`` 
  config property or the ``parquet_fail_with_corrupted_statistics`` session 
  property can be set to false.

@shixuan-fan
Copy link
Contributor

#9169

Verifier
--------
* Add config run-teardown-on-result-mismatch. When set to false, 
  temporary table will not be dropped after checksum failure to 
  facilitate debugging.

@wenleix
Copy link
Contributor

wenleix commented Jan 4, 2019

#12084

SPI
-------------------
* Support lambda in aggregation functions.

@dain
Copy link
Contributor

dain commented Jan 7, 2019 

General
-------
* Immediately return final results to client for a failed query.

@kokosing
Copy link
Contributor

kokosing commented Jan 8, 2019 

Kudu Changes
--------------
 * Update Kudu client to 1.8.0
 * Emit Kudu table property ``number_of_replicas`` in ``SHOW CREATE TABLE``

Cassandra Changes
--------------------
 * Add ``cassandra.splits-per-node`` and ``cassandra.protocol-version`` configuration properties. That makes possible to connector to Cassandra service older than 2.1.5.

@findepi
Copy link
Contributor

findepi commented Jan 8, 2019 

MySQL, PostgreSQL, Redshift, and SQL Server Changes
-------------
* Add support for predicate pushdown for ``char(x)`` columns.

#12104

``system`` Catalog Changes
--------------
* Remove ``node_id`` column from ``system.runtime.queries`` table.

#12131

@sopel39
Copy link
Contributor

sopel39 commented Jan 8, 2019 •
edited
Loading 

General
-------

* Support for predicate pushdown on partition symbols for window operators.
* Fix count(*) aggregate on empty relation when optimize_mixed_distinct_aggregation is enabled.
* Improve performance of table scan on structured types by removing unnecessary memory accounting.

#10767
#12115
#12034

@mbasmanova
Copy link
Contributor Author 

General
--------

* Remove SHOW STATS ON syntax
* Restrict WHERE clause in SHOW STATS to filters that can be pushed down

@mbasmanova mbasmanova mentioned this issue Jan 8, 2019
Merged
@electrum
Copy link
Contributor

electrum commented Jan 9, 2019

Add link before section header in connector/hive.rst:

.. _s3selectpushdown:

Release notes:

Hive Connector Changes
----------------------

* Add support for :ref:`s3selectpushdown`, which enables pushing down
  projections and predicates into S3 for text files.

SPI Changes
-----------

* Make ``ConnectorBucketNodeMap`` a top level class.
* Use list instead of map for bucket-to-node mapping.

.. note::

    This is a backwards incompatible change with the previous connector SPI.
    If you have written a connector that uses bucketing, you will need to
    update your code before deploying this release.

@yingsu00
Copy link
Contributor 

General
----------------------

* Fix incorrect results on ARRAY_INTERSECT and ARRAY_DISTINCT when 0 and NULL are both present.
* Performance improvement on ARRAY_INTERSECT.

@mbasmanova
Copy link
Contributor Author

@electrum David, I don't understand what you mean by "Add link before section header in connector/hive.rst:". Could you clarify?

@mbasmanova
Copy link
Contributor Author

The release is complete.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests