retrieve cmems insitu data on FTP via cmc instead of ftplib

[veenstrajelmer]

Currently retrieving CMEMS insitu data directly from FTP, since these datasets cannot be subsetted via copernicus-marine-client yet. Also, sonarcloud complains about security issues with FTP protocol and in theory this can be resolved with FTP_TLS but that fails with CMEMS FTP. An alternative is to approach the copernicus-marine-client by forcing the ftp service.

This works quite nicely:

import copernicus_marine_client as cmc
import warnings
with warnings.catch_warnings():
    warnings.filterwarnings(action="ignore", module="versions_verifier", category=DeprecationWarning)
    cmc.get(
        dataset_id="cmems_obs-ins_glo_phy-ssh_my_na_PT1H",
        force_service="ftp",
        filter="Core/INSITU_GLO_PHY_SSH_DISCRETE_MY_013_053/cmems_obs-ins_glo_phy-ssh_my_na_PT1H/index_history.txt",
        output_directory=".",
        overwrite_output_data=True,
        force_download=True,
        no_directories=True,
        # show_outputnames=True,
        # overwrite_output_data=True,
    )

Is it still worth to implement? It is expected that insitu data will be available via cmc subset from mid 2024 or maybe March 2024.

Also, setting disable_progress_bar=True hangs the retrieval process, so it seems to be less stable. Furthermore, the retrieval process seems slower.

[veenstrajelmer]

Won't do, we will wait for the data to be available via copernicus-marine-client instead. In the meantime the sonarcloud quality gate will fail on the FTP security issues.

[veenstrajelmer]

Update 8-4-2024: ftp was discontinued, so we have to find a solution anyway. This will be done in #817