[Bug] TIMESTAMP(9) write to PostponeBucketTable fails with 'file.format.per.level' = '0:avro'

[lvyanquan]

Search before asking

• I searched in the issues and found nothing similar.

Paimon version

1.4

Compute Engine

Flink

Minimal reproduce step

CREATE TABLE T (k INT, v TIMESTAMP(9), PRIMARY KEY (k) NOT ENFORCED)
WITH ('bucket' = '-2',
'file.format.per.level' = '0:avro',
'postpone.batch-write-fixed-bucket' = 'false');

INSERT INTO T VALUES (1, TIMESTAMP '2025-06-11 16:35:45.123456789'), (2, CAST(NULL AS TIMESTAMP(9)));

What doesn't meet your expectations?

Exception happened.

Anything else?

Error message:

Caused by: java.lang.IllegalArgumentException: Avro does not support TIMESTAMP type with precision: 9, it only supports precision less than 6.
        at org.apache.paimon.format.avro.AvroSchemaConverter.convertToSchema(AvroSchemaConverter.java:121)
        at org.apache.paimon.format.avro.AvroSchemaConverter.convertToSchema(AvroSchemaConverter.java:190)
        at org.apache.paimon.format.avro.AvroSchemaConverter.convertToSchema(AvroSchemaConverter.java:63)
        at org.apache.paimon.format.avro.AvroFileFormat$RowAvroWriterFactory.lambda$new$433a2ff1$1(AvroFileFormat.java:123)
        at org.apache.paimon.format.avro.AvroWriterFactory.create(AvroWriterFactory.java:46)
        at org.apache.paimon.format.avro.AvroFileFormat$RowAvroWriterFactory.create(AvroFileFormat.java:138)
        at org.apache.paimon.io.SingleFileWriter.<init>(SingleFileWriter.java:87)
        at org.apache.paimon.io.StatsCollectingSingleFileWriter.<init>(StatsCollectingSingleFileWriter.java:52)
        at org.apache.paimon.io.KeyValueDataFileWriter.<init>(KeyValueDataFileWriter.java:91)
        at org.apache.paimon.io.KeyValueDataFileWriterImpl.<init>(KeyValueDataFileWriterImpl.java:51)
        at org.apache.paimon.io.KeyValueFileWriterFactory.createDataFileWriter(KeyValueFileWriterFactory.java:176)
        at org.apache.paimon.io.KeyValueFileWriterFactory.lambda$createRollingMergeTreeFileWriter$0(KeyValueFileWriterFactory.java:103)
        at org.apache.paimon.io.RollingFileWriterImpl.openCurrentWriter(RollingFileWriterImpl.java:120)
        at org.apache.paimon.io.RollingFileWriterImpl.write(RollingFileWriterImpl.java:74)
        at org.apache.paimon.utils.SinkWriter$DirectSinkWriter.write(SinkWriter.java:75)
        at org.apache.paimon.postpone.PostponeBucketWriter.write(PostponeBucketWriter.java:108)
        at org.apache.paimon.postpone.PostponeBucketWriter.write(PostponeBucketWriter.java:55)
        at org.apache.paimon.operation.AbstractFileStoreWrite.write(AbstractFileStoreWrite.java:171)
        at org.apache.paimon.table.sink.TableWriteImpl.writeAndReturn(TableWriteImpl.java:191)
        at org.apache.paimon.table.sink.TableWriteImpl.writeAndReturn(TableWriteImpl.java:179)
        at org.apache.paimon.flink.sink.StoreSinkWriteImpl.write(StoreSinkWriteImpl.java:108)
        at org.apache.paimon.flink.sink.RowDataStoreWriteOperator.write(RowDataStoreWriteOperator.java:61)

Are you willing to submit a PR?

• I'm willing to submit a PR!

[ArnavBalyan]

Hi thx for reporting, this is expected, avro does not support precision above 6, TIMESTAMP (9) was requested. Ideally the table creation should not silently be supported for this case and fail at create time, instead of insert time failure. Will patch it