Code

Feature/single source exec#56

Code

Closed

mertak-synnada wants to merge 47 commits intoapache_mainsynnada-ai/datafusion-upstream:apache_mainfrom chore/single-source-execsynnada-ai/datafusion-upstream:chore/single-source-execCopy head branch name to clipboard

+4,309-2,977

Commits

Commits on Jan 7, 2025

• unify ParquetExec, AvroExec, ArrowExec, NDJsonExec, MemoryExec into one DataSourceExec plan

  mertak-synnada

  committed
  5b1714c

  Copy full SHA for 5b1714c

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  mertak-synnada

  committed
  d2fe022

  Copy full SHA for d2fe022

• fix license headers

  mertak-synnada

  committed
  70505b3

  Copy full SHA for 70505b3

• fix compile errors on documents

  mertak-synnada

  committed
  00db759

  Copy full SHA for 00db759

• separate non-parquet code

  mertak-synnada

  committed
  cea3ecd

  Copy full SHA for cea3ecd

Commits on Jan 8, 2025

• format code

  mertak-synnada

  committed
  2331577

  Copy full SHA for 2331577

• fix typo

  mertak-synnada

  committed
  15b812f

  Copy full SHA for 15b812f

• fix imports

  mertak-synnada

  committed
  f020bd2

  Copy full SHA for f020bd2

• fix clippy

  Show description for a7a5bd8
  mertak-synnada

  committed
  a7a5bd8

  Copy full SHA for a7a5bd8

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  Show description for 94a306f
  mertak-synnada

  committed
  94a306f

  Copy full SHA for 94a306f

• add comment to the example

  mertak-synnada

  committed
  d69b012

  Copy full SHA for d69b012

• fix cargo docs

  mertak-synnada

  committed
  f14a6d8

  Copy full SHA for f14a6d8

• change MemoryExec with MemorySourceConfig

  mertak-synnada

  committed
  8040147

  Copy full SHA for 8040147

Commits on Jan 10, 2025

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  Show description for f540df0
  mertak-synnada

  committed
  f540df0

  Copy full SHA for f540df0

• merge fixes

  mertak-synnada

  committed
  ddb221d

  Copy full SHA for ddb221d

• change MemoryExec to DataSourceExec

  mertak-synnada

  committed
  069d28c

  Copy full SHA for 069d28c

Commits on Jan 15, 2025

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  Show description for 78dfce8
  mertak-synnada

  committed
  78dfce8

  Copy full SHA for 78dfce8

• fix merge conflicts

  mertak-synnada

  committed
  cb6a5ff

  Copy full SHA for cb6a5ff

• apply some syntactic sugars

  mertak-synnada

  committed
  4acb2fc

  Copy full SHA for 4acb2fc

• fix imports and comment line

  mertak-synnada

  committed
  ff68caa

  Copy full SHA for ff68caa

• simplify some lines

  mertak-synnada

  committed
  7a62190

  Copy full SHA for 7a62190

• rename source_config as file_source

  mertak-synnada

  committed
  fd37183

  Copy full SHA for fd37183

• format code

  mertak-synnada

  committed
  cf13028

  Copy full SHA for cf13028

• format code

  mertak-synnada

  committed
  201d8a0

  Copy full SHA for 201d8a0

• make memory metrics default behavior

  mertak-synnada

  committed
  7edc80f

  Copy full SHA for 7edc80f

Commits on Jan 16, 2025

• remove unnecessary cfg check

  mertak-synnada

  committed
  fe25de3

  Copy full SHA for fe25de3

• format code

  mertak-synnada

  committed
  2452825

  Copy full SHA for 2452825

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  mertak-synnada

  committed
  e084359

  Copy full SHA for e084359

• remove ParquetExec strings

  mertak-synnada

  committed
  a4d5da3

  Copy full SHA for a4d5da3

• fix documents and imports

  mertak-synnada

  committed
  a6c018e

  Copy full SHA for a6c018e

• fix imports

  mertak-synnada

  committed
  104c428

  Copy full SHA for 104c428

Commits on Jan 17, 2025

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  Show description for 38134d3
  mertak-synnada

  committed
  38134d3

  Copy full SHA for 38134d3

Commits on Jan 20, 2025

• add constraints and fix tests

  mertak-synnada

  committed
  4af421e

  Copy full SHA for 4af421e

• delete redundant file

  mertak-synnada

  committed
  91110cc

  Copy full SHA for 91110cc

• make metrics and statistics a part of File type specific configurations

  Show description for 6c76b3f
  mertak-synnada

  committed
  6c76b3f

  Copy full SHA for 6c76b3f

• format code

  mertak-synnada

  committed
  12f0ac8

  Copy full SHA for 12f0ac8

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  Show description for f528bf5
  mertak-synnada

  committed
  f528bf5

  Copy full SHA for f528bf5

• fix tests

  mertak-synnada

  committed
  887922d

  Copy full SHA for 887922d

• format code

  mertak-synnada

  committed
  91fb10e

  Copy full SHA for 91fb10e

Commits on Jan 21, 2025

• split repartitioning into DataSourceExec and FileSourceConfig parts

  mertak-synnada

  committed
  cb8c2ae

  Copy full SHA for cb8c2ae

• move properties into DataSourceExec and split eq_properties and output_partitioning in DataSource trait

  mertak-synnada

  committed
  64ccad7

  Copy full SHA for 64ccad7

• clone source with Arc

  mertak-synnada

  committed
  aa047d7

  Copy full SHA for aa047d7

• return file type as enum and do not downcast if not necessary

  Show description for 93888a7
  mertak-synnada

  committed
  93888a7

  Copy full SHA for 93888a7

• Merge branch 'refs/heads/apache_main' into chore/single-source-exec

  Show description for 44f21a2
  mertak-synnada

  committed
  44f21a2

  Copy full SHA for 44f21a2

• format code

  mertak-synnada

  committed
  aabcd04

  Copy full SHA for aabcd04

• re-add deprecated plans in order to support backward compatibility

  mertak-synnada

  committed
  18da494

  Copy full SHA for 18da494

• reduce diff

  mertak-synnada

  committed
  82b5257

  Copy full SHA for 82b5257