From 203892f2fd3be8484461ff50b01f0c1026fc5684 Mon Sep 17 00:00:00 2001 From: Akira Ajisaka Date: Fri, 10 Nov 2023 20:31:06 +0900 Subject: [PATCH] [minor][doc] Fix Iceberg config in README --- README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 87b7ae13..07be2cfb 100644 --- a/README.md +++ b/README.md @@ -546,7 +546,8 @@ group by 1 - the latest connector for iceberg in AWS marketplace uses Ver 0.14.0 for Glue 3.0, and Ver 1.2.1 for Glue 4.0 where Kryo serialization fails when writing iceberg, use "org.apache.spark.serializer.JavaSerializer" for spark.serializer instead, more info [here](https://github.com/apache/iceberg/pull/546) - For Athena version 2: The adapter is compatible with the Iceberg Connector from AWS Marketplace with Glue 3.0 as Fulfillment option and 0.12.0-2 (Feb 14, 2022) as Software version) - For Glue 4.0, to add the following configurations in dbt-profile: -```--conf spark.sql.catalog.glue_catalog=org.apache.iceberg.spark.SparkCatalog +``` + --conf spark.sql.catalog.glue_catalog=org.apache.iceberg.spark.SparkCatalog --conf spark.sql.catalog.glue_catalog.warehouse=s3:// --conf spark.sql.catalog.glue_catalog.catalog-impl=org.apache.iceberg.aws.glue.GlueCatalog --conf spark.sql.catalog.glue_catalog.io-impl=org.apache.iceberg.aws.s3.S3FileIO