Merge pull request #1564 from BlazingDB/branch-21.06

21.06 Release

CHANGELOG.md

@@ -1,3 +1,37 @@
+# BlazingSQL 21.06.00 (June 10th, 2021)
+
+
+## New Features
+- #1471 Unbounded partitioned windows 
+- #1445 Support for CURRENT_DATE, CURRENT_TIME and CURRENT_TIMESTAMP
+- #1505 Support for right outer join
+- #1523 Support for DURATION type
+- #1552 Support for concurrency in E2E tests
+
+## Improvements
+- #1464 Better Support for unsigned types in C++ side
+- #1511 Folder refactoring related to caches, kernels, execution_graph, BlazingTable
+- #1522 Improve data loading when the algebra contains only BindableScan/Scan and Limit
+- #1524 Enable support for spdlog 1.8.5
+- #1547 Update RAPIDS version references
+- #1539 Support ORDERing by null values
+- #1551 Support for spdlog 1.8.5
+- #1553 multiple columns inside COUNT() statement
+
+## Bug Fixes
+- #1455 Support for IS NOT FALSE condition
+- #1502 Fix IS NOT DISTINCT FROM with joins
+- #1475 Fix wrong results from timestampdiff/add
+- #1528 Fixed build issues due to cudf aggregation API change 
+- #1540 Comparing param set to true for e2e
+- #1543 Enables provider unit_tests
+- #1548 Fix orc statistic building
+- #1550 Fix Decimal/Fixed Point issue
+- #1519 Fix for max_bytes_chunk_read param to csv files
+- #1559 Fix `ucx-py` versioning specs
+- #1557 Reading chunks of max bytes for csv files
+
+
 # BlazingSQL 0.19.0 (April 21, 2021)
 
 ## New Features
@@ -8,6 +42,7 @@
 - #1396 Create tables from other RDBMS
 - #1427 Support for CONCAT alias operator
 - #1424 Add get physical plan with explain
+- #1472 Implement predicate pushdown for data providers
 
 ## Improvements
 - #1325 Refactored CacheMachine.h and CacheMachine.cpp 
@@ -23,8 +58,10 @@
 - #1444 Updating GCP to >= version
 - #1349 Add e2e test for Hive Partitioned Data
 - #1447 Improve getting estimated output num rows
-- #1473 Added Warning to Window Functions 
+- #1473 Added Warning to Window Functions
+- #1482 Improve test script for blazingsql-testing-file
 - #1480 Improve dependencies script
+- #1433 Adding ArrowCacheData, refactoring CacheData files
 
 ## Bug Fixes
 - #1335 Fixing uninitialized var in orc metadata and handling the parseMetadata exceptions properly
@@ -105,6 +142,7 @@
 - #1320 Revamping cache logger
 - #1323 Made progress bar update continuously and stay after query is done 
 - #1336 Improvements for the cache API
+- #1483 Improve dependencies script
 
 ## Bug Fixes
 - #1249 Fix compilation with cuda 11
@@ -372,3 +410,5 @@
 - #931 Add script for error messages validation.
 - #932 Import pydrill and pyspark only when its generator or full mode.
 - #1031 adding notebooks into BlazingSQL Tests
+- #1486 Define generic templates for E2E Testing framework.
+- #1542 Cleaning code on E2E Test framework.

README.md

@@ -70,7 +70,7 @@ bc.sql('SELECT passenger_count, trip_distance FROM taxi LIMIT 2')
 ## Documentation
 You can find our full documentation at [docs.blazingdb.com](https://docs.blazingdb.com/docs).
 
-# Prerequisites 
+# Prerequisites
 * [Anaconda or Miniconda](https://docs.conda.io/projects/conda/en/latest/user-guide/install/linux.html) installed
 * OS Support
   * Ubuntu 16.04/18.04 LTS
@@ -84,7 +84,6 @@ You can find our full documentation at [docs.blazingdb.com](https://docs.blazing
 * Python Support
   * 3.7
   * 3.8
-
 # Install Using Conda
 BlazingSQL can be installed with conda ([miniconda](https://conda.io/miniconda.html), or the full [Anaconda distribution](https://www.anaconda.com/download)) from the [blazingsql](https://anaconda.org/blazingsql/) channel:
 
@@ -96,7 +95,7 @@ Where $CUDA_VERSION is 10.1, 10.2 or 11.0  and $PYTHON_VERSION is 3.7 or 3.8
 *For example for CUDA 10.1 and Python 3.7:*
 ```bash
 conda install -c blazingsql -c rapidsai -c nvidia -c conda-forge -c defaults blazingsql python=3.7 cudatoolkit=10.1
-``` 
+```
 
 ## Nightly Version
 For nightly version cuda 11+ are only supported, see https://github.com/rapidsai/cudf#cudagpu-requirements
@@ -118,14 +117,14 @@ This is the recommended way of building all of the BlazingSQL components and dep
 ```bash
 conda create -n bsql python=$PYTHON_VERSION
 conda activate bsql
-./dependencies.sh 0.19 $CUDA_VERSION
+./dependencies.sh 21.06 $CUDA_VERSION
 ```
 Where $CUDA_VERSION is is 10.1, 10.2 or 11.0 and $PYTHON_VERSION is 3.7 or 3.8
 *For example for CUDA 10.1 and Python 3.7:*
 ```bash
 conda create -n bsql python=3.7
 conda activate bsql
-./dependencies.sh 0.19 10.1
+./dependencies.sh 21.06 10.1
 ```
 
 ### Build
@@ -150,14 +149,14 @@ For nightly version cuda 11+ are only supported, see https://github.com/rapidsai
 ```bash
 conda create -n bsql python=$PYTHON_VERSION
 conda activate bsql
-./dependencies.sh 0.20 $CUDA_VERSION nightly
+./dependencies.sh 21.08 $CUDA_VERSION nightly
 ```
 Where $CUDA_VERSION is 11.0 or 11.2 and $PYTHON_VERSION is 3.7 or 3.8
 *For example for CUDA 11.2 and Python 3.8:*
 ```bash
 conda create -n bsql python=3.8
 conda activate bsql
-./dependencies.sh 0.20 11.2 nightly
+./dependencies.sh 21.08 11.2 nightly
 ```
 
 ### Build

algebra/blazingdb-calcite-application/src/main/java/com/blazingdb/calcite/application/RelationalAlgebraGenerator.java

@@ -4,6 +4,7 @@
 import com.blazingdb.calcite.rules.ProjectFilterTransposeRule;
 import com.blazingdb.calcite.rules.ProjectTableScanRule;
 import com.blazingdb.calcite.rules.ProjectJoinTransposeRule;
+import com.blazingdb.calcite.rules.ReduceExpressionsRule;
 import com.blazingdb.calcite.schema.BlazingSchema;
 import com.blazingdb.calcite.schema.BlazingTable;
 
@@ -27,7 +28,6 @@
 import org.apache.calcite.rel.rules.FilterProjectTransposeRule;
 import org.apache.calcite.rel.rules.ProjectMergeRule;
 import org.apache.calcite.rel.rules.AggregateReduceFunctionsRule;
-import org.apache.calcite.rel.rules.ReduceExpressionsRule;
 import org.apache.calcite.rel.rules.ProjectToWindowRule;
 import org.apache.calcite.rex.RexExecutorImpl;
 import org.apache.calcite.rel.type.RelDataTypeSystem;