Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-674] Add translate expression support #672

Merged
merged 10 commits into from
Jan 7, 2022

Conversation

PHILO-HE
Copy link
Collaborator

@PHILO-HE PHILO-HE commented Jan 4, 2022

No description provided.

@PHILO-HE
Copy link
Collaborator Author

PHILO-HE commented Jan 4, 2022

This PR depends on oap-project/arrow#68.

@PHILO-HE
Copy link
Collaborator Author

PHILO-HE commented Jan 4, 2022

UT passed. And reverted the changes for arrow branch.

@PHILO-HE PHILO-HE changed the title Add translate expression support [NSE-674] Add translate expression support Jan 5, 2022
@github-actions
Copy link

github-actions bot commented Jan 5, 2022

#674

@PHILO-HE
Copy link
Collaborator Author

PHILO-HE commented Jan 5, 2022

Will port the function to WSCG.

@PHILO-HE
Copy link
Collaborator Author

PHILO-HE commented Jan 5, 2022

Re-triggered jenkins unit tests.

@PHILO-HE
Copy link
Collaborator Author

PHILO-HE commented Jan 5, 2022

The jenkins unit tests already passed.

@zhouyuan zhouyuan merged commit 3668484 into oap-project:master Jan 7, 2022
zhouyuan pushed a commit to zhouyuan/native-sql-engine that referenced this pull request Jan 7, 2022
* Initial commit

* Add StringTranslate for subquery checking

* Code refactor

* Change arrow branch for unit test [will revert at last]

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit bf74356.

* Port the function to wscg

* Change arrow branch for unit test [will revert at last]

* Format native code

* Fix a bug

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit 3a53fa2.
zhouyuan added a commit that referenced this pull request Jan 9, 2022
* Use Hadoop 3.2 as default hadoop.version (#652)

* [NSE-661] Add left/right trim in WSCG

* [NSE-675] Add instr expression support (#676)

* Initial commit

* Add the support in wscg

* [NSE-674] Add translate expression support (#672)

* Initial commit

* Add StringTranslate for subquery checking

* Code refactor

* Change arrow branch for unit test [will revert at last]

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit bf74356.

* Port the function to wscg

* Change arrow branch for unit test [will revert at last]

* Format native code

* Fix a bug

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit 3a53fa2.

* [NSE-681] Add floor & ceil expression support (#682)

* Initial commit

* Add ceil expression support

* Change arrow branch for unit test [will revert at last]

* Revert "Change arrow branch for unit test [will revert at last]"

This reverts commit 5fb2f4b.

* [NSE-647] Leverage buffered write in shuffle  (#648)

Closes #647

* [NSE-400] Native Arrow Row to columnar support (#637)

* Support ArrowRowToColumnar Optimization

* Replace expired code

* Add the code to convert recordbatch to columnarBatch

* Add unit test on java size

* Update the unit tests

* Fix the bug when reading decimal value from unsafeRow

* Use ArrowRowToColumnarExec instead of RowToArrowColumnarExec

* Use clang-format to standardize the CPP code format

* enable arrowRowToColumnarExec

* Add the metrics for ArrowRowToColumnarExec

* Add the metrics for ArrowRowToColumnarExec and unsupport Codegen

* Add parameter 'spark.oap.sql.columnar.rowtocolumnar' to control ArrowRowToColumnarExec

* Remove useless code

* Release arrowbuf after return recordbatch

* Fix the processTime metric for ArrowRowToColumnarExec

* Refine the code of ArrowRowToColumnar operator

* Add more metrics to detect the elapse time of each action

* Small fix about allocating buffer for unsafeRow

* Remove useless code

* Remove useless metrics for ArrowRowToColumnarExec

* Fall back to use java RowToColumnarExec when the row is not unsafeRow Type

* Fix the bug for decimal format

* fix format

Co-authored-by: Yuan Zhou <[email protected]>

* fix leakage in rowtocolumn (#683)

Signed-off-by: Yuan Zhou <[email protected]>

Co-authored-by: Wei-Ting Chen <[email protected]>
Co-authored-by: PHILO-HE <[email protected]>
Co-authored-by: Hongze Zhang <[email protected]>
Co-authored-by: haojinIntel <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants