SQLite to DuckDB Database Verification Error Persists in v25.0-rc1

[Navoei]

Upon verification of the database after the main copy operation is complete, the process fails with the error below.

CoreProtect Version: v25.0-rc1
Server Version: Purpur 26.2-2619

[22:30:42 INFO]: CoreProtect - Database migration failed: Verification batch size mismatch in block after 604570000/1004656952 verified rows: source SQLite [size=10000, previousRowId=612338206, lastRowId=612348206], target DuckDB [size=3248, previousRowId=612338206, lastRowId=612341454]
[22:30:42 WARN]: java.sql.SQLException: Verification batch size mismatch in block after 604570000/1004656952 verified rows: source SQLite [size=10000, previousRowId=612338206, lastRowId=612348206], target DuckDB [size=3248, previousRowId=612338206, lastRowId=612341454]
[22:30:42 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.verifyMigration(DatabaseMigration.java:305)
[22:30:42 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.performMigration(DatabaseMigration.java:162)
[22:30:42 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.lambda$runCommand$0(DatabaseMigration.java:111)
[22:30:42 WARN]:        at java.base/java.lang.Thread.run(Thread.java:1474)

[Navoei]

Got a slightly different error after increasing the amount of threads for DuckDB to 6.

[08:39:55] [CoreProtect-Database-Migration/INFO]: CoreProtect - Verification progress [#######-------------] 36.7% (603,880,096/1,645,450,156) | block 603,880,000/1,004,964,919 | 430,590 records/s | ETA 40m 18s.
[08:39:59] [CoreProtect-Database-Migration/INFO]: CoreProtect - Database migration failed: Unable to read DuckDB migration cursor for block: Invalid Input Error: Invalid result set
[08:39:59] [CoreProtect-Database-Migration/WARN]: java.sql.SQLException: Unable to read DuckDB migration cursor for block: Invalid Input Error: Invalid result set
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration$CanonicalReader.cursorException(DatabaseMigration.java:1194)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration$RowCursor.nextBatch(DatabaseMigration.java:1278)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.verifyMigration(DatabaseMigration.java:299)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.performMigration(DatabaseMigration.java:162)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.lambda$runCommand$0(DatabaseMigration.java:111)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at java.base/java.lang.Thread.run(Thread.java:1474)
[08:39:59] [CoreProtect-Database-Migration/WARN]: Caused by: java.sql.SQLException: Invalid Input Error: Invalid result set
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at org.duckdb.DuckDBNative.duckdb_jdbc_fetch(Native Method)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at org.duckdb.DuckDBResultSet.fetchChunk(DuckDBResultSet.java:1458)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at org.duckdb.DuckDBResultSet.next(DuckDBResultSet.java:83)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration$CanonicalReader.readRows(DatabaseMigration.java:1157)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration$RowCursor.nextBatch(DatabaseMigration.java:1266)
[08:39:59] [CoreProtect-Database-Migration/WARN]: 	... 4 more

[agoniaprivat]

I also recive errors.

[03:13:03 INFO]: CoreProtect - Migrated art_map: 94 records.
[03:13:08 INFO]: CoreProtect - Copy progress [--------------------] 0.1% (3,130,094/4,811,434,898) | block 3,130,000/2,851,668,412 | 624,324 records/s | ETA 128m 21s.
[03:13:13 INFO]: CoreProtect - Copy progress [--------------------] 0.1% (6,290,094/4,811,434,898) | block 6,290,000/2,851,668,412 | 627,196 records/s | ETA 127m 41s.
[03:13:14 INFO]: CoreProtect - Database migration failed: Appender error, catalog: 'null', schema: 'main', table: 'co_block', message: Failed to append: Failed to commit: Failed to create checkpoint because of error: could not allocate block of size 1004.0 KiB (487.5 MiB/488.2 MiB used)
[03:13:14 INFO]: 
[03:13:14 INFO]: Possible solutions:
[03:13:14 INFO]: * Reducing the number of threads (SET threads=X)
[03:13:14 INFO]: * Disabling insertion-order preservation (SET preserve_insertion_order=false)
[03:13:14 INFO]: * Increasing the memory limit (SET memory_limit='...GB')
[03:13:14 INFO]: 
[03:13:14 INFO]: See also https://duckdb.org/docs/stable/guides/performance/how_to_tune_workloads
[03:13:14 WARN]: java.sql.SQLException: Appender error, catalog: 'null', schema: 'main', table: 'co_block', message: Failed to append: Failed to commit: Failed to create checkpoint because of error: could not allocate block of size 1004.0 KiB (487.5 MiB/488.2 MiB used)
[03:13:14 WARN]: 
[03:13:14 WARN]: Possible solutions:
[03:13:14 WARN]: * Reducing the number of threads (SET threads=X)
[03:13:14 WARN]: * Disabling insertion-order preservation (SET preserve_insertion_order=false)
[03:13:14 WARN]: * Increasing the memory limit (SET memory_limit='...GB')
[03:13:14 WARN]: 
[03:13:14 WARN]: See also https://duckdb.org/docs/stable/guides/performance/how_to_tune_workloads
[03:13:14 WARN]:        at org.duckdb.DuckDBAppender.flush(DuckDBAppender.java:257)
[03:13:14 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration$MigrationTarget.writeDuckDB(DatabaseMigration.java:1531)
[03:13:14 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration$MigrationTarget.write(DatabaseMigration.java:1424)
[03:13:14 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.copyTables(DatabaseMigration.java:229)
[03:13:14 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.performMigration(DatabaseMigration.java:160)
[03:13:14 WARN]:        at CoreProtect-25.0-rc1.jar//net.coreprotect.utility.extensions.DatabaseMigration.lambda$runCommand$0(DatabaseMigration.java:111)
[03:13:14 WARN]:        at java.base/java.lang.Thread.run(Thread.java:1474)