Refactor SEG-Y export to optimize memory usage.#109

Merged

tasansal merged 46 commits intomainfrom feature/refactor_segy_export

Nov 26, 2022

+564-303

Commits on Nov 15, 2022

generalize on disk binary concat
Altay Sansal
committed
add missing return hint and doc
Altay Sansal
committed
streamline byteorder and dtypes
Altay Sansal
committed
use new concat function
Altay Sansal
committed
pre-process for writing segy
Altay Sansal
committed
update docs for ieee32 -> float32

tasansal
authored and
Altay Sansal
committed
update tests for ieee32 -> float32

tasansal
authored and
Altay Sansal
committed
type annotation backward compat for 3.8

tasansal
authored and
Altay Sansal
committed
ensure fp32 before ibm float conversion

tasansal
authored and
Altay Sansal
committed
avoid copy in trace preprocess

tasansal
authored and
Altay Sansal
committed
import only what's necessary

tasansal
authored and
Altay Sansal
committed
new 3d export with memory optimizations

tasansal
authored and
Altay Sansal
committed
remove parallel jit target because Dask uses threading

tasansal
authored and
Altay Sansal
committed
open first file only once

tasansal
authored and
Altay Sansal
committed
generalize on disk binary concat
Altay Sansal
committed
add missing return hint and doc
Altay Sansal
committed
streamline byteorder and dtypes
Altay Sansal
committed
use new concat function
Altay Sansal
committed
pre-process for writing segy
Altay Sansal
committed
update docs for ieee32 -> float32

tasansal
authored and
Altay Sansal
committed
type annotation backward compat for 3.8

tasansal
authored and
Altay Sansal
committed
ensure fp32 before ibm float conversion

tasansal
authored and
Altay Sansal
committed
avoid copy in trace preprocess

tasansal
authored and
Altay Sansal
committed
import only what's necessary

tasansal
authored and
Altay Sansal
committed
new 3d export with memory optimizations

tasansal
authored and
Altay Sansal
committed
remove parallel jit target because Dask uses threading

tasansal
authored and
Altay Sansal
committed
open first file only once

tasansal
authored and
Altay Sansal
committed
fuse segy export prep functions

tasansal
authored and
Altay Sansal
committed
user temp dir for block data
Altay Sansal
committed
set mdio version to unknown if its not installed (i.e. dev environment)
Altay Sansal
committed
add graphviz and minor tweaks
Altay Sansal
committed
newer cut logic
Altay Sansal
committed

Commits on Nov 16, 2022

bugfix byteorder detection for struct arrays
Altay Sansal
committed
lint whitespace
Altay Sansal
committed
tree reduction to merge files while exporting
Altay Sansal
committed

Commits on Nov 17, 2022

switch to uuid4 due to uuid1 conflicts
Altay Sansal
committed
streamline block to partial segy writer
Altay Sansal
committed
add mdio to python source env var
Altay Sansal
committed

Commits on Nov 18, 2022

improve clarity and refactor
Altay Sansal
committed
auto chunk logic for segy export
Altay Sansal
committed
fix to_segy return type
Altay Sansal
committed
python3.8 typing backward compat
tasansal
committed

Commits on Nov 19, 2022

Commits on Nov 22, 2022

handle edge case when dimension size is smaller than the chunks
tasansal
committed