Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support UUID type #46

Closed
ancoron opened this issue Oct 17, 2024 · 1 comment · Fixed by #114
Closed

Support UUID type #46

ancoron opened this issue Oct 17, 2024 · 1 comment · Fixed by #114
Labels
enhancement New feature or request

Comments

@ancoron
Copy link

ancoron commented Oct 17, 2024

It would be nice to also allow supporting the UUID type as specified here (for interoperability):
@aykut-bozkurt
Copy link
Member

aykut-bozkurt commented Oct 18, 2024 •
edited
Loading

We use arrow, in memory columnar format, as intermediate format. UUID arrow arrays are not yet supported to be written into parquet file. But there is some PR to enable extension type concept in arrow spec. After extension types are supported, we can natively write uuid and json to parquet. (they are serialized as text for now)

@marcoslot marcoslot added the enhancement New feature or request label Oct 22, 2024
aykut-bozkurt added a commit that referenced this issue Mar 6, 2025
@aykut-bozkurt
Support uuid, json, jsonb natively
457c806 
Arrow supports extension types with new major version 54. They can correctly convert
uuid and json arrow arrays from/to parquet. This PR uses this fact to natively read/write
these types from/to parquet to/from postgres.

Closes #46.
@aykut-bozkurt aykut-bozkurt mentioned this issue Mar 6, 2025
Merged
aykut-bozkurt added a commit that referenced this issue Mar 7, 2025
@aykut-bozkurt
Support uuid, json, jsonb natively
854b607 
Arrow supports extension types with new major version 54. They can correctly convert
uuid and json arrow arrays from/to parquet. This PR uses this fact to natively read/write
these types from/to parquet to/from postgres.

Closes #46.
aykut-bozkurt added a commit that referenced this issue Mar 11, 2025
@aykut-bozkurt
Support uuid, json, jsonb natively (#114)
5766819 
Arrow supports extension types with new major version 54. They can correctly convert
uuid and json arrow arrays from/to parquet. This PR uses this fact to natively read/write
these types from/to parquet to/from postgres.

Closes #46.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Support uuid, json, jsonb natively CrunchyData/pg_parquet
3 participants
@marcoslot @ancoron @aykut-bozkurt