refined-quill-24998
02/02/2023, 7:22 AMCREATE TABLE `t_temp_table_iceberg`
(
`col1` string,
`col2` double,
`col3` string,
`col4` BOOLEAN,
`col5` BOOLEAN
)
PARTITIONED BY(
col1,
col2
)
LOCATION '<s3://bucket-name/iceberg_location/>'
TBLPROPERTIES (
'table_type'='ICEBERG',
'format'='parquet'
)
Tried to deploy the same in pulumi but the table is created with wrong format similar like Hive table with partitions and not able to access in Athena( Not an issue with permissions verified). Can anyone help me with it.
t_temp_table_iceberg = aws.glue.CatalogTable(
resource_name="t_temp_table_iceberg",
name="t_temp_table_iceberg",
database_name=self.glue_catalog_iceberg_catalog_db.name,
parameters={
"table_type": 'ICEBERG',
"format": "parquet"
},
storage_descriptor=aws.glue.CatalogTableStorageDescriptorArgs(
columns=[
aws.glue.CatalogTableStorageDescriptorColumnArgs(
name="col1",
type="string",
),
aws.glue.CatalogTableStorageDescriptorColumnArgs(
name="col2",
type="double",
),
aws.glue.CatalogTableStorageDescriptorColumnArgs(
comment="",
name="col3",
type="String",
),
aws.glue.CatalogTableStorageDescriptorColumnArgs(
comment="",
name="col4",
type="Boolean",
),
aws.glue.CatalogTableStorageDescriptorColumnArgs(
comment="",
name="col5",
type="Boolean",
),
aws.glue.CatalogTableStorageDescriptorColumnArgs(
comment="",
name="Substituted",
type="Boolean",
), ],
location=f"s3://{self.curated_bucket_name}/iceberg_location/",
),
partition_keys=[
aws.glue.CatalogTablePartitionKeyArgs(
name="col1",
type="",
comment="",
),
aws.glue.CatalogTablePartitionKeyArgs(
name="col2",
type="",
comment="",
)
],
)
No matter how you like to participate in developer communities, Pulumi wants to meet you there. If you want to meet other Pulumi users to share use-cases and best practices, contribute code or documentation, see us at an event, or just tell a story about something cool you did with Pulumi, you are part of our community.
Powered by