Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GLUTEN-7313][VL] Explicit Arrow transitions, part 1: add LoadArrowDataExec / OffloadArrowDataExec #7343

Merged
merged 6 commits into from
Sep 26, 2024
Merged

[GLUTEN-7313][VL] Explicit Arrow transitions, part 1: add LoadArrowDataExec / OffloadArrowDataExec #7343

merged 6 commits into from
Sep 26, 2024

Conversation

zhztheplayer
Copy link
Member

Part of #7313

For example:

Plan before:

VeloxColumnarToRowExec
+- ^(2) FilterExecTransformer (isnotnull(Name#165) AND (Name#165 = Peter))
   +- ^(2) InputIteratorTransformer[Name#165, Language#166]
      +- ArrowFileScan arrowcsv [Name#165,Language#166]

Plan after:

VeloxColumnarToRowExec
+- ^(2) FilterExecTransformer (isnotnull(Name#165) AND (Name#165 = Peter))
   +- ^(2) InputIteratorTransformer[Name#165, Language#166]
      +- OffloadArrowData
         +- ArrowFileScan arrowcsv [Name#165,Language#166]

SQL UI after:

image

@github-actions GitHub Actions
Copy link

#7313

@github-actions GitHub Actions
Copy link

Run Gluten Clickhouse CI

@github-actions github-actions bot added CORE works for Gluten Core VELOX and removed CLICKHOUSE labels Sep 25, 2024
@github-actions GitHub Actions
Copy link

Run Gluten Clickhouse CI

@github-actions GitHub Actions
Copy link

Run Gluten Clickhouse CI

@github-actions GitHub Actions
Copy link

Run Gluten Clickhouse CI

@github-actions GitHub Actions
Copy link

Run Gluten Clickhouse CI

@github-actions GitHub Actions
Copy link

Run Gluten Clickhouse CI

@github-actions GitHub Actions
Copy link

Run Gluten Clickhouse CI

@zhztheplayer zhztheplayer changed the title [GLUTEN-7313][VL] Explicit Arrow transitions, Part 1: Add LoadArrowDataExec / OffloadArrowDataExec [GLUTEN-7313][VL] Explicit Arrow transitions, part 1: Add LoadArrowDataExec / OffloadArrowDataExec Sep 26, 2024
@zhztheplayer zhztheplayer merged commit 84da616 into apache:main Sep 26, 2024
46 of 47 checks passed
@zhztheplayer zhztheplayer changed the title [GLUTEN-7313][VL] Explicit Arrow transitions, part 1: Add LoadArrowDataExec / OffloadArrowDataExec [GLUTEN-7313][VL] Explicit Arrow transitions, part 1: add LoadArrowDataExec / OffloadArrowDataExec Sep 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@JkSelf JkSelf JkSelf approved these changes

Assignees
No one assigned
Labels
CORE works for Gluten Core VELOX
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@zhztheplayer @JkSelf