You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Following a major internal refactor of the planner in version 0.12, this version will primarily be bug fixes and performance focused.
There were so many changes in 0.12 that even with a comprehensive test suite, there are likely to be bugs not caught in the regression testing.
Similarly, with the volume of code changed in 0.12, it will not be the most efficient code to perform the tasks. Although out of the blocks, 0.12 is generally faster than 0.11 due to the structural changes, this doesn't mean there are no significant opportunities for improvements.
Minor new functionality may be introduced in v0.13, but it's focus is on improving existing functionality.
It is anticipated that 0.14 will start to look at prepositioning changes for the execution engine changes planned for 0.15 (which is likely to be another extended development cycle).
0.14 may include a rewrite of the INNER JOIN execution, whilst Pyarrow does do this well per execution, it makes a number of assumptions which appear to materially impact performance.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Following a major internal refactor of the planner in version 0.12, this version will primarily be bug fixes and performance focused.
There were so many changes in 0.12 that even with a comprehensive test suite, there are likely to be bugs not caught in the regression testing.
Similarly, with the volume of code changed in 0.12, it will not be the most efficient code to perform the tasks. Although out of the blocks, 0.12 is generally faster than 0.11 due to the structural changes, this doesn't mean there are no significant opportunities for improvements.
Minor new functionality may be introduced in v0.13, but it's focus is on improving existing functionality.
It is anticipated that 0.14 will start to look at prepositioning changes for the execution engine changes planned for 0.15 (which is likely to be another extended development cycle).
0.14 may include a rewrite of the INNER JOIN execution, whilst Pyarrow does do this well per execution, it makes a number of assumptions which appear to materially impact performance.
Beta Was this translation helpful? Give feedback.
All reactions