Code

Refactor flashloader#329

Code

Merged

zain-sohail merged 80 commits intov1_feature_branchOpenCOMPES/sed:v1_feature_branchfrom refactor-flashloaderOpenCOMPES/sed:refactor-flashloaderCopy head branch name to clipboardJun 30, 2024

+1,830-963

Commits

Commits on Mar 27, 2024

• major refactor to flash code

  zain-sohail

  committed
  58dbcd7

• update dataframe class to be able to use index and dataset keys

  zain-sohail

  committed
  f376387

• minor changes introduced

  zain-sohail

  committed
  08e8d9f

• change majorly the class with a new initialize method. now save parquet accepts parquet_paths which is useful for loading only subset of files

  zain-sohail

  committed
  5c9a04c

• now uses a simpler notation and save_parquet method after loading dataframes

  zain-sohail

  committed
  ff5dd07

• methods made more consistent and fixing the get_index_dataset_key

  zain-sohail

  committed
  7852aaf

• include steinn's proposed solution to pulse_id channel being empty

  zain-sohail

  committed
  ac9abea

• include unit tests and fixtures. still many to be done. needs to move to appropriate directory

  zain-sohail

  committed
  41fd70d

• add more tests, simplify logic on dataframe class

  zain-sohail

  committed
  da00635

• remove the gmdTunnel channel because the datafile is not correct. Replace with pulserSignAdc

  zain-sohail

  committed
  8b39bdb

• major structure changes

  zain-sohail

  committed
  e1b9a9f

• docstrings etc

  zain-sohail

  committed
  cd85dfd

• updated buffer creation etc. tests won't work currently

  zain-sohail

  committed
  f6ca14e

• fix linting errors and comment out tests for now

  zain-sohail

  committed
  c9f1fcc

• fix the error of getting wrong attribute in loader, and fix parquet loading/creation

  zain-sohail

  committed
  1398bf2

• fix lint error

  zain-sohail

  committed
  eb72230

• cleaning up the classes

  zain-sohail

  committed
  4d950db

• add back easy access apis

  zain-sohail

  committed
  b8bfdf0

• small fix

  zain-sohail

  committed
  1f95408

• small fix

  zain-sohail

  committed
  8f551d0

• small fix

  zain-sohail

  committed
  c85fdec

• fix error with pickling

  zain-sohail

  committed
  0a7e836

• use old cfg

  zain-sohail

  committed
  4a787eb

• docstrings fixes

  zain-sohail

  committed
  084f407

• fix tests

  zain-sohail

  committed
  73802fa

• fix certain problems with df_electron and add comphrehensive tests for DataFrameCreator

  zain-sohail

  committed
  70a3c5b

• add tests

  zain-sohail

  committed
  77bf46b

• buffer handler tests

  zain-sohail

  committed
  d8cc6f6

• ruff formated

  zain-sohail

  committed
  09cffec

• add parquethandler tests

  zain-sohail

  committed
  0f23ddb

• further tests

  zain-sohail

  committed
  ac4f8cd

• fixes

  zain-sohail

  committed
  1519752

• fix the lint error

  zain-sohail

  committed
  d31e6b1

• fix parse_metadata

  zain-sohail

  committed
  ed18a5c

• put everything in one file

  zain-sohail

  committed
  ce8134f

• reoder

  zain-sohail

  committed
  08a2adc

• update interface from suggestions

  zain-sohail

  committed
  74b41dc

• limit the cores used

  zain-sohail

  committed
  b937db8

• change interface of parquethandler to suggested

  zain-sohail

  committed
  9dc69aa

Commits on Mar 28, 2024

• fix bug for df indexing

  zain-sohail

  committed
  09a93d3

Commits on Apr 18, 2024

• merge main branch

  zain-sohail

  committed
  55cfa0c

Commits on Apr 27, 2024

• Merge branch 'main' into refactor-flashloader

  zain-sohail

  committed
  4b3e6f7

• lint fix

  zain-sohail

  committed
  d316137

• update dataframe saving and loading from parquet behavior

  zain-sohail

  committed
  c00207d

Commits on May 19, 2024

• remove saving/loading of parquets

  zain-sohail

  committed
  89130b0

• add instrument option

  zain-sohail

  committed
  dbef804

• fix tests

  zain-sohail

  committed
  afd9772

• fix tests

  zain-sohail

  committed
  b9fce76

• fix tests

  zain-sohail

  committed
  6400878

• fix tests

  zain-sohail

  committed
  7129f57

Commits on Jun 5, 2024

• Merge branch 'main' into refactor-flashloader

  zain-sohail

  authored
  bc53214

• - added retrocompabtibility for older buffer files that have sectorID saved

  Show description for 02aee6e
  zain-sohail

  committed
  02aee6e

• fix ruff settings

  zain-sohail

  committed
  2142c11

• update tests

  zain-sohail

  committed
  79922ef

• make small change to check actions status

  zain-sohail

  committed
  02ae74e

• bring back types

  zain-sohail

  committed
  f520310

• fix small error

  zain-sohail

  committed
  4c7d069

Commits on Jun 6, 2024

• move utility func test to utility tests

  zain-sohail

  committed
  9f6a31b

Commits on Jun 10, 2024

• seperate to different modules

  zain-sohail

  committed
  f4a30e0

• add time_elapsed method

  zain-sohail

  committed
  08f8f13

• fix test issues

  zain-sohail

  committed
  fa68746

• add tests for elapsed time

  zain-sohail

  committed
  cb884dd

• fix main loader tests

  zain-sohail

  committed
  ae26555

• fix sxp loader tests

  zain-sohail

  committed
  04714bc

• fix tests

  zain-sohail

  committed
  6589595

Commits on Jun 12, 2024

• fix minor issue with repr html

  zain-sohail

  committed
  1b73b76

• add available runs property

  zain-sohail

  committed
  852a867

Commits on Jun 13, 2024

• Merge branch 'main' into refactor-flashloader

  zain-sohail

  authored
  f010a2e

Commits on Jun 18, 2024

• Merge branch 'main' into refactor-flashloader

  zain-sohail

  authored
  8dd5e6a

Commits on Jun 24, 2024

• Merge branch 'v1_feature_branch' into refactor-flashloader

  zain-sohail

  committed
  cd6fbf0

• add back annotations

  zain-sohail

  committed
  147e913

• use index and dataset keys

  zain-sohail

  committed
  f2a26b9

Commits on Jun 26, 2024

• Merge remote-tracking branch 'origin/v1_feature_branch' into refactor-flashloader

  rettigl

  committed
  ebd2b32

Commits on Jun 28, 2024

• remove nans from all electron channels

  zain-sohail

  committed
  d131fe4

• use pd import, load h5 file inside df creator

  zain-sohail

  committed
  194c874

• update comments to explain the code

  zain-sohail

  committed
  af33740

• make review changes

  zain-sohail

  committed
  50f7ee1

• fix tests with review comments

  zain-sohail

  committed
  65d909d

• fix dropna

  zain-sohail

  committed
  b7537a8

Commits on Jun 30, 2024

• fix minor stuff and add test to see if exception handling works in parallel

  zain-sohail

  committed
  b0b090d