Create dedicated notebooks/scripts for generating organized dataset

[leewujung]

This follows from #3:

In 2022, @ldr426 created notebooks under ./docs/source/gsoc/2022 that contain data pulling components as part of showing viz functionalities.

This year let's create dedicated notebooks or scripts for pulling large volumes of data and keep them in s3 bucket for developing viz access/plotting/optimization.

A few things to note:

• Current notebooks create MVBS from each .raw files separately and use xr.open_mfdataset to combine them for viz. The final version of notebooks/scripts this year should combine multiple EchoData objects before calibration and computing MVBS to generate organized data.
• The above hinges on 2 critical echopype updates @lsetiawan will be working on in May-June 2023:
  • overhauling combine_echodata (which is for combining the EchoData objects efficiency as zarr stores)
  • optimize efficiency in compute_MVBS
• For organized MVBS dataset, see Why this sonar trajectory is wiggly and its speed changes so fast？ #28 (comment) for current caveat that the lat/lon interpolated to Sv are discarded when computing MVBS.

Reference issues

• OOI Datasets Requests #42
• Ship survey datasets #43

[ldr426]

See details for datasets last year

Category	Resolution
OOI 2017 Aug	1 day with 1 min along ping_time, 1 m for depth (OOI 2017 Aug)
Hake Survey	1 day with 10 min along ping_time, 5 m for depth (Hake Survey)
OOI 2017 Aug	30 days with 30 mins along ping_time, 1 m for depth (OOI 2017 Aug)
Hake Survey	10 days with 30 mins along ping_time, 5 m for depth (Hake Survey)
OOI 2017 Aug	2 hr in raw resolution (with 1 sec along ping_time, 0.2 m for depth) (OOI 2017 Aug)
Hake Survey	2 hr in raw resolution (with 2 secs along ping_time, 0.2 m for depth) (hake survey)

[ldr426]

Data got on EBS now:

Moored (30 days, 2017-08-01 to 2017-08-31)

Range meter bin (m)	Ping time bin (s)
1	1800
1	600
1	300
1	60
0.5	600
0.5	300
0.5	60
0.2	300
0.2	60
0.2	1 (08/01 - 08/20, no concatenated data generated)

Ship (10 days, 2017-07-24 to 2017-08-02)

Range meter bin (m)	Ping time bin (s)
5	1800
5	600
1	600
1	300
1	60
0.2	300
0.2	60
0.2	2 (no concatenated data generated)

[ldr426]

Data generating examples (will add annotations and comments later):
Moored_Echosounder_Data_Generate.ipynb
Pacific_Hake_Survey_Data_Generate.ipynb
Google Drive

[leewujung]

We can close this now that #42 and #43 are both closed. See #92 for summary and links.