Task Executor, UCX, ORC Metadata, Progress Bar and more!
New SQL Functions
The following SQL commands are now supported:
- REGEXP_REPLACE
- INITCAP
New Features
- New centralized task executor for all query execution
- New pinned memory buffer pool for improved performance in communication
- New host memory buffer pool for improved performance in caching data to system memory
- Support for UCX communications which enables usage of high performance communication hardware such as using InfiniBand
- Creating table from ORC files now collects metadata from ORC files and can perform predicate pushdown on metadata
- Progress bar when executing queries
- Added ability to try to retry tasks when getting out of memory errors
- Added ability to get maximum gpu memory used
Improvements
- Improved support for concurrent queries
- Improvements to query execution logs
- Added/improved communication logs
- Added ability to disable logs
- Improved storage plugin output messages
- Improved support for creating tables from JSON files
Bug Fixes
- Fixed distribution so that its evenly distributes data loading based off of rowgroups
- Fixed cython exception handling
- Support FileSystems (GS, S3) when extension of the files are not provided
- Fixed issue when creating tables from a local dir relative path
- Misc bug fixes
Codebase improvements
- Code base clean up, improved code organization and refactoring
- No longer depending on gtest for runtime
- Reduced number of compilation warnings