Query engine flink 1.12 iceberg 0.13.2 Question As we know, position delete files should keep the file path and position. In rewriting v2 tables, iceberg would validateNoNewDeletesForDataFiles and would use the new position delete files' lower_bounds/upper_bounds for paths, to check whether the new...

Apache Iceberg version 1.1.0 (latest release) Query engine None Please describe the bug 🐞 There's no engines tab (may it exists before).

Apache Iceberg version None Query engine None Please describe the bug 🐞 Fanout writer, and several other pieces of code. Use StructCopy to copy partition data. The implementation accidentally copies Array references for Fixed data types which will lead to errors when containers are re-used and a Fix...

Feature Request / Improvement For the flink doc, the right navigation section is very long. But I am unable to to scroll down it. Query engine Flink

Hello. I am using AWS Glue 3.0 in a Docker container and I am getting an error. Iceberg table creation is working but throws an error when trying to insert data. The same code works in Glue (when running in AWS) java.lang.ClassCastException: org.apache.iceberg.spark.source.SerializableTableWithSi...

Feature Request / Improvement Merge Writes as well as some inserts end up generating many files with our default write distirbution mode of None. While this is the cheapest method and is our old default behavior, we now have several reasons to default to Range (or Hash). Spark AQE now has both skew...

Feature Request / Improvement In order to mimic HMS behavior to facilitate migration, Nessie should store his table in the namespace location if the namespace have it. Currently Nessie store it on the default warehouse location so it's impossible without specifing the location directly on the create...

Apache Iceberg version 1.1.0 (latest release) Query engine Spark Please describe the bug 🐞 This is a serious bug I debugged together with @dramaticlly, it will make metadata deletes fail silently if certain partitions exist. Setup We have a table that is partitioned by two date integers, a and b. T...

Apache Iceberg version 1.1.0 (latest release) Query engine Spark Please describe the bug 🐞 Problem When running periodic maintenance on iceberg tables, RewriteDataFiles/system.rewrite_data_files spark action causes the maintenance operations to take longer and longer over time as new files get added...

Query engine Spark Question I have a situation where I need to make high(ish)-frequency writes to a single iceberg table in multiple Spark jobs, and multiple times per job -- I run into hive metastore locks leading to failures and need to fine tune lock timeout settings and retries. Note: My hive me...