Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add clickHouse Bulk Insert #172

Merged
merged 2 commits into from
Nov 4, 2023

Conversation

iNikitaGricenko
Copy link
Contributor

What changes are being made and why?

Implemented Bulk Insert #167

How the changes have been QAed?

id: clickhouse
namespace: dev
tasks:
id: insert
    type: io.kestra.plugin.jdbc.clickhouse.BulkInsert
    from: "{{ outputs.query.uri }}"
    chunk: 1000 # The size of chunk for every bulk request, default 1000
    columns: array of strings # If not provided, ? count need to match the from number of cols
    url: jdbc:clickhouse://127.0.0.1:56982/
    username: clickhouse
    password: ch_passwd
    sql: |
      INSERT INTO YourTable SETTINGS async_insert=1, wait_for_async_insert=1 values( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ? )

@anna-geller
Copy link
Member

TODO: fix CI and QA on the preview. I can't QA locally due to Plugin Scanner warnings for JDBC plugins

@tchiotludo tchiotludo merged commit 770f859 into kestra-io:master Nov 4, 2023
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

3 participants