Code

Features/372 data layout#423

Code

Merged

coquelin77 merged 45 commits intomasterhelmholtz-analytics/heat:masterfrom features/372-data_layouthelmholtz-analytics/heat:features/372-data_layoutCopy head branch name to clipboardDec 10, 2019

+356-25

Commits

Commits on Oct 28, 2019

• Added dndarray property 'stride' (same as torch.Tensor.stride).

  ClaudiaComito

  committed
  93a8ccc

  Copy full SHA for 93a8ccc

Commits on Nov 20, 2019

• Merge branch 'master' into features/372-data_layout

  ClaudiaComito

  committed
  6df3bed

  Copy full SHA for 6df3bed

• Implemented tensor property strides (numpy-like), added to docs.

  ClaudiaComito

  committed
  c2faa47

  Copy full SHA for c2faa47

Commits on Nov 21, 2019

• Merge branch 'master' into features/372-data_layout

  ClaudiaComito

  committed
  8cb873c

  Copy full SHA for 8cb873c

Commits on Nov 22, 2019

• First pass of column-first memory layout, single-node only.

  ClaudiaComito

  committed
  7c12fe5

  Copy full SHA for 7c12fe5

Commits on Nov 23, 2019

• Implemented stride_tricks.sanitize_memory_layout, first pass.

  ClaudiaComito

  committed
  b01511b

  Copy full SHA for b01511b

Commits on Nov 25, 2019

• Property DNDarray.strides now gets the correct information from the underlying torch tensor and no longer gets the wrong info from from the numpyfied DNDarray

  ClaudiaComito

  committed
  d01d14d

  Copy full SHA for d01d14d

• Moved sanitize_memory_layout from stride_tricks to module memory.

  ClaudiaComito

  committed
  5b6276d

  Copy full SHA for 5b6276d

• Implemented memory.sanitize_memory_layout.

  ClaudiaComito

  committed
  2d0596d

  Copy full SHA for 2d0596d

• Introduced attribute order in factories.array, enables specification of memory layout (row- or column-major).

  ClaudiaComito

  committed
  5ace9e1

  Copy full SHA for 5ace9e1

• sanitize_memory_layout(), moved tests for least likely occurrencies to the bottom

  ClaudiaComito

  committed
  89caeaa

  Copy full SHA for 89caeaa

• Fixed typos.

  ClaudiaComito

  committed
  bfaec9c

  Copy full SHA for bfaec9c

Commits on Nov 27, 2019

• Merge branch 'master' into features/372-data_layout

  ClaudiaComito

  committed
  d619ce6

  Copy full SHA for d619ce6

• ht.array, docs and examples for attribute "order" defining memory layout.

  ClaudiaComito

  committed
  a60482f

  Copy full SHA for a60482f

• Expanded documentation to sanitize_memory_layout().

  ClaudiaComito

  committed
  dba61a2

  Copy full SHA for dba61a2

• Keyword argument order introduced for all factories (except those creating 1D list).

  ClaudiaComito

  committed
  90b6e16

  Copy full SHA for 90b6e16

Commits on Nov 28, 2019

• Typo.

  ClaudiaComito

  committed
  12934d1

  Copy full SHA for 12934d1

• Implemented function assertTrue_memory_layout()

  ClaudiaComito

  committed
  c442fa8

  Copy full SHA for c442fa8

• Modified sanitize_memory_layout() to address tensors with unknown/wrong layout (e.g. from tensor creation with ndmin > tensor.shape).

  ClaudiaComito

  committed
  1da8a74

  Copy full SHA for 1da8a74

Commits on Nov 29, 2019

• sanitize_memory_layout(), removed unnecessary checks (ndim < 2 and strides already matching requested order), removed "NotImplementedError" for order K.

  ClaudiaComito

  committed
  bb9a2b6

  Copy full SHA for bb9a2b6

• Added keyword argument order in factories calls.

  ClaudiaComito

  committed
  c62974b

  Copy full SHA for c62974b

• First draft of function test_sanitize_memory_layout()

  ClaudiaComito

  committed
  e18eee6

  Copy full SHA for e18eee6

• Modified row_major, column_major condition to allow for shape=1 along a given dimension

  ClaudiaComito

  committed
  c725a8b

  Copy full SHA for c725a8b

• Added memory layout test for 5D tensor, non distributed, shape contains 1.

  ClaudiaComito

  committed
  76a1617

  Copy full SHA for 76a1617

• Added memory layout test for non distributed tensor after reduction operation

  ClaudiaComito

  committed
  5628fac

  Copy full SHA for 5628fac

• Removed test for non distributed tensor after reduction operation, not relevant for now

  ClaudiaComito

  committed
  932a85e

  Copy full SHA for 932a85e

• Implemented tests for sanitize_memory_layout()

  ClaudiaComito

  committed
  c3ede72

  Copy full SHA for c3ede72

• In assert_array_equal(), Allreduce running on self._comm, not on self.comm.

  ClaudiaComito

  committed
  5beea49

  Copy full SHA for 5beea49

Commits on Dec 2, 2019

• Removing unused variable.

  ClaudiaComito

  committed
  43df1ab

  Copy full SHA for 43df1ab

• Fixed error that messed up column-major memory layout for ndim>3

  ClaudiaComito

  committed
  e47ac20

  Copy full SHA for e47ac20

• Fixed and expanded tests for sanitize_memory_layout

  ClaudiaComito

  committed
  3a096ad

  Copy full SHA for 3a096ad

• Fixed wrong variable reference after pre-commit

  ClaudiaComito

  committed
  814caa9

  Copy full SHA for 814caa9

• pre-commit changes

  ClaudiaComito

  committed
  b659576

  Copy full SHA for b659576

• Improved docs.

  ClaudiaComito

  committed
  eea901b

  Copy full SHA for eea901b

Commits on Dec 6, 2019

• Extending BasicTest in TestMemory

  ClaudiaComito

  committed
  c38dede

  Copy full SHA for c38dede

• Merge branch 'master' into features/372-data_layout

  coquelin77

  authored
  eca64fa

  Copy full SHA for eca64fa

Commits on Dec 7, 2019

• Re-adding assertTrue_memory_layout to BasicTest

  ClaudiaComito

  committed
  e7d0090

  Copy full SHA for e7d0090

Commits on Dec 9, 2019

• Function test_dndarray.test_stride_and_strides(), first pass,

  ClaudiaComito

  committed
  3bb13ba

  Copy full SHA for 3bb13ba

• Added float32, row-major and float64, column-major stride tests

  ClaudiaComito

  committed
  218345b

  Copy full SHA for 218345b

• test_stride_and_strides: Added test cases for distributed tensors in row-major and column-major order

  ClaudiaComito

  committed
  d3a7499

  Copy full SHA for d3a7499

• pre-commit reformatting

  ClaudiaComito

  committed
  ae00b59

  Copy full SHA for ae00b59

• Added function test_basic_test.test_assertTrue_memory_layout()

  ClaudiaComito

  committed
  fbe9738

  Copy full SHA for fbe9738

• Merge branch 'master' into features/372-data_layout

  ClaudiaComito

  committed
  c21d6be

  Copy full SHA for c21d6be

Commits on Dec 10, 2019

• dndrray.strides, replaced np.array(...)*itemsize with list comprehension.

  ClaudiaComito

  committed
  38802e8

  Copy full SHA for 38802e8

• pre-commit minor changes

  ClaudiaComito

  committed
  46fbc2e

  Copy full SHA for 46fbc2e