Repository navigation

[Read] Implementation of Hash Bucketing and Batch Processing - #4

Open

TTTechnoPro wants to merge 314 commits into

mainfrom

test/read-batch+hashbucketing

Open

[Read] Implementation of Hash Bucketing and Batch Processing#4
TTTechnoPro wants to merge 314 commits into
mainfrom
test/read-batch+hashbucketing

This pull request is big! We're only showing the most recent 250 commits

Commits on Oct 28, 2024
- Spark: Flaky test due temp directory (#10811)
  manuzhang
  authored
  47eac52
- Core: Add portable Roaring bitmap for row positions (#11372)
  aokolnychyi
  authored
  1e3ee1e
Commits on Oct 29, 2024
Commits on Oct 30, 2024
- GCS: Refresh vended credentials (#11282)
  nastra
  authored
  5359bea
- Docs: Add 21 blogs / fix one broken link (#11424)
  AlexMercedCoder
  authored
  bedc711
- AWS: Refresh vended credentials (#11389)
  nastra
  authored
  9e895cb
- Build: Bump Hadoop to 3.4.1 (#11428)
  Fokko
  authored
  7c39086
- Core: Remove credentials from LoadViewResponse (#11432)
  nastra
  authored
  dec84c0
- OpenAPI: Remove credentials from LoadViewResult (#11433)
  nastra
  authored
  f4b36a5
- API: Add compatibility checks for Schemas with default values (#11434)
  
  authored
  91e04c9
Commits on Oct 31, 2024
Commits on Nov 1, 2024
- Core: Use RoaringPositionBitmap in position index (#11441)
  aokolnychyi
  authored
  caf424a
Commits on Nov 2, 2024
Commits on Nov 4, 2024
Commits on Nov 5, 2024
Commits on Nov 6, 2024
Commits on Nov 7, 2024
- API: Removes Explicit Parameterization of Schema Tests (#11444)
  RussellSpitzer
  authored
  11e7230
- Docs: Fix verifying release candidate with Spark and Flink (#11461)
  manuzhang
  authored
  5c8a5d6
Commits on Nov 8, 2024
Commits on Nov 11, 2024
- Build: Bump mkdocs-redirects from 1.2.1 to 1.2.2 (#11511)
  dependabot[bot]
  authored
  ea21a53
- Build: Bump mkdocs-material from 9.5.43 to 9.5.44 (#11510)
  dependabot[bot]
  authored
  aa0aeb0
- Build: Bump software.amazon.awssdk:bom from 2.29.6 to 2.29.9 (#11509)
  dependabot[bot]
  authored
  981f1ea
- Docs: Update multi-engine support after 1.7.0 release (#11503)
  manuzhang
  authored
  d1fd492
- Spark: Fix typo in Spark ddl comment (#11517)
  
  hantangwangd
  and
  hantangwangd
  authored
  5530605
- Core: Support commits with DVs (#11495)
  aokolnychyi
  authored
  af3fbfe
- Kafka Connect: fix Hadoop dependency exclusion (#11516)
  bryanck
  authored
  11d21b2
Commits on Nov 12, 2024
Commits on Nov 13, 2024
Commits on Nov 14, 2024
- Spark 3.4: Support Spark Column Stats (#11532)
  saitharun15
  authored
  9923ac9
- Docs: Fix rendering lists (#11546)
  manuzhang
  authored
  daa24f9
- Build: Bump kafka from 3.8.1 to 3.9.0 (#11508)
  dependabot[bot]
  authored
  071d9e2
- Support WASB scheme in ADLSFileIO (#11504)
  mrcnc
  authored
  0963485
- Docs: 4 Spaces are Requried for Sublists (#11549)
  RussellSpitzer
  authored
  0a705b0
Commits on Nov 15, 2024
Commits on Nov 17, 2024
Commits on Nov 18, 2024
Commits on Nov 19, 2024
- Core: Inherited classes from SnapshotProducer has TableOperations redundantly as member (#11578)
  gaborkaszab
  authored
  e71e3cb
- Revert "Core: Use encoding/decoding methods for namespaces and deprecate Spli…" (#11574)
  nastra
  authored
  3badfe0
Commits on Nov 20, 2024
Commits on Nov 21, 2024
Commits on Nov 22, 2024
Commits on Nov 23, 2024
Commits on Nov 25, 2024
Commits on Nov 26, 2024
- Build: Delete branch automatically on PR merge (#11635)
  manuzhang
  authored
  430ebff
- Flink: Test both "new" Flink Avro planned reader and "deprecated" Avro reader (#11430)
  jbonofre
  authored
  f356087
Commits on Nov 27, 2024
Commits on Nov 28, 2024
- Docs: Add RisingWave (#11642)
  
  hengm3467
  and
  Fokko
  authored
  3a8bf57
- REST: Docker file for REST Catalog Fixture (#11283)
  ajantha-bhat
  authored
  163e206
- Core: Propagate custom metrics reporter when table is created/replaced through Transaction (#11671)
  nastra
  authored
  a95943e
- Spark: remove ROW_POSITION from project schema (#11610)
  huaxingao
  authored
  8e0031c
- Default to `overwrite` when operation is missing (#11421)
  
  Fokko
  and
  RussellSpitzer
  authored
  3a04257
- Core,API: Set `503: added_snapshot_id` as required (#11626)
  Fokko
  authored
  8fccdec
Commits on Nov 29, 2024
- Add GitHub Action to publish the `docker-rest-fixture` container (#11632)
  sungwy
  authored
  7c7b4ba
- Core, GCS, Spark: Replace wrong order of assertion (#11677)
  ebyhr
  authored
  e770fac
Commits on Dec 1, 2024
- REST: Clean up `iceberg-rest-fixture` docker image naming (#11676)
  ajantha-bhat
  authored
  f978fe5
Commits on Dec 2, 2024
Commits on Dec 3, 2024
- Spark: Remove extra columns for ColumnarBatch (#11551)
  huaxingao
  authored
  af8e3f5
- Spark: Add view support to SparkSessionCatalog (#11388)
  nastra
  authored
  6501d29
Commits on Dec 4, 2024
Commits on Dec 6, 2024
Commits on Dec 7, 2024
- Spark 3.3,3.4: Align RewritePositionDeleteFilesSparkAction filter with Spark case sensitivity (#11710)
  huaxingao
  authored
  deeb04b
Commits on Dec 9, 2024
Commits on Dec 10, 2024
- Core, Flink, Spark: Drop deprecated APIs scheduled for removal in 1.8.0 (#11721)
  findepi
  authored
  28e8180
- Flink: Fix range distribution npe when value is null (#11662)
  Guosmilesmile
  authored
  ac6509a
Commits on Dec 11, 2024
Commits on Dec 12, 2024
Commits on Dec 13, 2024
- GCS: Suppress JavaUtilDate in OAuth2RefreshCredentialsHandler (#11773)
  ebyhr
  authored
  540d6a6
Commits on Dec 14, 2024
- Flink: Add RowConverter for Iceberg Source (#11301)
  
  abharath9
  and
  Bharath Kumar Avusherla
  authored
  c2fd77a
Commits on Dec 15, 2024
- Spark 3.5: Fix assertion mismatch in PartitionedWritesTestBase/TestRewritePositionDeleteFilesAction (#11748)
  wzx140
  authored
  bcf7b63
- Build: Bump nessie from 0.101.0 to 0.101.2 (#11791)
  dependabot[bot]
  authored
  fd739b3
Commits on Dec 16, 2024
Commits on Dec 17, 2024
Commits on Dec 18, 2024
- Flink: make `StatisticsOrRecord` to be correctly serialized and deser… (#11557)
  
  huyuanfeng2018
  and
  huyuanfeng
  authored
  e3628c1
- Spark 3.4,3.5: Use correct identifier in view DESCRIBE cmd (#11751)
  Ppei-Wang
  authored
  b428fbc
- Use try-with-resources in TestParallelIterable (#11810)
  sopel39
  authored
  204a49c
- Spark 3.5: Support default values in Parquet reader (#11803)
  rdblue
  authored
  7e1a4c9
- Data: Fix Parquet and Avro defaults date/time representation (#11811)
  rdblue
  authored
  d0effc6
- Revert "Support WASB scheme in ADLSFileIO (#11504)" (#11812)
  mrcnc
  authored
  91a1505
Commits on Dec 19, 2024
Commits on Dec 20, 2024
Commits on Dec 21, 2024
- Spark: Test reading default values in Spark (#11832)
  rdblue
  authored
  cd187c5
Commits on Dec 22, 2024
Commits on Dec 23, 2024
- Doc: Add status page for different implementations. (#11772)
  
  liurenjie1024
  and
  Fokko
  authored
  55f10ca
- Upgrade to Gradle 8.12 (#11861)
  jbonofre
  authored
  ca3db93
- Build: Fix ignoring `.asf.yaml` in PR (#11860)
  manuzhang
  authored
  dbd7d1c
Commits on Dec 24, 2024
Commits on Dec 25, 2024
- Core: Replace deprecated Schema.toString with SchemaFormatter (#11867)
  ebyhr
  authored
  4eb9f7f
- Build: Fix ignoring `license-check.yml` in PR (#11873)
  manuzhang
  authored
  bb27030
Commits on Dec 26, 2024
- API: Replace deprecated `asList` with `asInstanceOf` (#11875)
  ebyhr
  authored
  fc3f705
Commits on Dec 27, 2024
- Flink: Avoid RANGE mode broken chain when write parallelism changes (#11702)
  
  huyuanfeng2018
  and
  huyuanfeng
  authored
  de54a08
Commits on Dec 28, 2024
- Update `README.md` with `iceberg-cpp` (#11882)
  gabeiglio
  authored
  607e2fb
Commits on Dec 29, 2024
Commits on Dec 30, 2024
- Revert "Hive: close the fileIO client when closing the hive catalog (#10771)" (#11858)
  Fokko
  authored
  e3f50e5
Commits on Jan 2, 2025
- Docs: Add history to Hive's metadata tables (#11902)
  okumin
  authored
  ab6365d
Commits on Jan 3, 2025
Commits on Jan 4, 2025
- Kafka-connect-runtime: remove code duplications in integration tests (#11883)
  
  wombatu-kun
  and
  Vova Kolmakov
  authored
  fcd5dd9
Commits on Jan 5, 2025
- Work in progress HashBucketing and Batch Processing
  Dylan Nguyen
  committed
  2247f59
- Merge branch 'apache:main' into test/read-batch+hashbucketing
  TTTechnoPro
  authored
  7d38197

Commits

Commits on Oct 28, 2024

Commits on Oct 29, 2024

Commits on Oct 30, 2024

Commits on Oct 31, 2024

Commits on Nov 1, 2024

Commits on Nov 2, 2024

Commits on Nov 4, 2024

Commits on Nov 5, 2024

Commits on Nov 6, 2024

Commits on Nov 7, 2024

Commits on Nov 8, 2024

Commits on Nov 11, 2024

Commits on Nov 12, 2024

Commits on Nov 13, 2024

Commits on Nov 14, 2024

Commits on Nov 15, 2024

Commits on Nov 17, 2024

Commits on Nov 18, 2024

Commits on Nov 19, 2024

Commits on Nov 20, 2024

Commits on Nov 21, 2024

Commits on Nov 22, 2024

Commits on Nov 23, 2024

Commits on Nov 25, 2024