Download through theia error

[SandroProv]

Hi,

I tried to use the function (using Ubuntu 18.04), but unfortunately keep running into trouble. Downloading Sentinel-2 as in the readme example works well (python ./theia_download.py -l 'Toulouse' -c SENTINEL2 -a config_theia.cfg -d 2016-09-01 -f 2016-10-01) but it does not work for the SpotWorldHeritage (and seems not to be related to no images being available for Toulouse for that period):

_python ./theia_download.py -l 'Toulouse' -c SpotWorldHeritage -a config_theia.cfg -d 2006-01-01 -f 2007-01-01
Get theia single sign on token
Done
https://theia.cnes.fr/atdistrib/resto2/api/collections/SpotWorldHeritage/search.json?q=Toulouse&startDate=2006-01-01&maxRecords=500&completionDate=2007-01-01
curl -k -o search.json "https://theia.cnes.fr/atdistrib/resto2/api/collections/SpotWorldHeritage/search.json?q=Toulouse&startDate=2006-01-01&maxRecords=500&completionDate=2007-01-01"
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 44 100 44 0 0 106 0 --:--:-- --:--:-- --:--:-- 106

no product corresponds to selection criteria_

Using an example under "## Other options" I get (does that actually really relate to SPOT5 or rather 4?):

python theia_download.py -l 'Toulouse' -a config_landsat.cfg -c SpotWorldHeritage -p SPOT4 -d 2005-11-01 -f 2006-12-01
Get theia single sign on token
Done
Authentification is probably wrong
check password file
password should only contain alpha-numerics

Would be glad about help on how to fix and proceed.

Thanks!

Sandro

[olivierhagolle]

Hi Sandro,
i am very sorry, I had not seen this message when you sent it two months ago. I just noticed it today.

Please update the tool and use :
python theia_download.py -l 'Toulouse' -a config_theia.cfg -c SWH1 -p SPOT5 -p SPOT4 -d 2005-11-01 -f 2006-12-01, as Toulouse data are in the old format collection, whose name is "SWH1" in the data base.
Olivier

[SandroProv]

Hi Olivier,

Many thanks for that!

It works for Toulouse now, but if I change the location it doesn't work once again even if I there are clearly images that exist it would always return:

no product corresponds to selection criteria

My queries were:

python theia_download.py -l 'Burkina Faso' -a config_theia.cfg -c SWH1 -p SPOT5 -d 2005-11-01 -f 2012-12-01

python theia_download.py -l 'Burkina Faso' -a config_theia.cfg -c SpotWorldHeritage -p SPOT5 -d 2005-11-01 -f 2012-12-01

python theia_download.py -l 'Ouagadougou' -a config_theia.cfg -c SWH1 -p SPOT5 -d 2005-11-01 -f 2012-12-01

python theia_download.py -l 'Ouagadougou' -a config_theia.cfg -c SpotWorldHeritage -p SPOT5 -d 2005-11-01 -f 2012-12-01

In fact, I have verified on the CNES Theia homepage that such images exist and for collection it says "SPOTWORLDHERITAGE" which is why I believe that in this case "-c SpotWorldHeritage" would be appropriate.

I would be grateful if you could explain the logic and what I am doing wrong.

Many thanks!
Sandro

[olivierhagolle]

Hi Sandro
If you look at the home page of https://theia.cnes.fr, you will see that Theia data exist in two different formats, depending on the production date. The oldest products, in France, were produced with the old format, and the exploitation team hasn't made the conversion yet.

So for Ouagadougou, the following command works, I just tested it
python theia_download.py -l 'Ouagadougou' -a config_theia.cfg -c SPOTWORLDHERITAGE -p SPOT5 -d 2005-11-01 -f 2012-12-01

Sorry for the complexity, but SpotWorldHeritage products are not much downloaded, so the teams are not very keen on updating their formats.

Best regards,
Olivier

[MicheleColauzzi]

Dear Olivier

I have been using the Theia satellite management and download service for almost two years.
For downloading operations I use theia_download (python, github).
Since about 20 days I have not been able to download the files. The procedure appears to start regularly but stops immediately without completing the download.
Here is an example of the command:

./theia_download.py -t T32TPQ -c SENTINEL2 -a ./config_theia.cfg -d 2020-06-01 -f 2020-06-15 -m 80

A file is produced with the message:
{"ErrorMessage": "Not Found", "ErrorCode": 404}

How should I proceed to restore the service?

I thank you for your work.
Best regards.
Michele Colauzzi

[olivierhagolle]

Hi Michele, the issue is on CNES side, the teams are on it to understand what’s happening and correct it, sorry for the inconvenience Olivier De : Michele <[email protected]> Envoyé : jeudi 9 juillet 2020 18:05 À : olivierhagolle/theia_download <[email protected]> Cc : Hagolle Olivier <[email protected]>; Comment <[email protected]> Objet : Re: [olivierhagolle/theia_download] Download through theia error (#12) Dear Olivier I have been using the Theia satellite management and download service for almost two years. For downloading operations I use theia_download (python, github). Since about 20 days I have not been able to download the files. The procedure appears to start regularly but stops immediately without completing the download. Here is an example of the command: ./theia_download.py -t T32TPQ -c SENTINEL2 -a ./config_theia.cfg -d 2020-06-01 -f 2020-06-15 -m 80 A file is produced with the message: {"ErrorMessage": "Not Found", "ErrorCode": 404} How should I proceed to restore the service? I thank you for your work. Best regards. Michele Colauzzi — You are receiving this because you commented. Reply to this email directly, view it on GitHub<#12 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABFNSJYMXJ2WUHZRRICRCE3R2XTBLANCNFSM4JY6YAVQ>.

[MicheleColauzzi]

Dear Olivier, Thank you for your prompt reply ! I'm confident that the problem will be solved. Kind regards Michele Il giorno gio 9 lug 2020 alle ore 19:23 Olivier Hagolle < [email protected]> ha scritto:

…

Hi Michele, the issue is on CNES side, the teams are on it to understand what’s happening and correct it, sorry for the inconvenience Olivier De : Michele ***@***.***> Envoyé : jeudi 9 juillet 2020 18:05 À : olivierhagolle/theia_download ***@***.***> Cc : Hagolle Olivier ***@***.***>; Comment < ***@***.***> Objet : Re: [olivierhagolle/theia_download] Download through theia error (#12) Dear Olivier I have been using the Theia satellite management and download service for almost two years. For downloading operations I use theia_download (python, github). Since about 20 days I have not been able to download the files. The procedure appears to start regularly but stops immediately without completing the download. Here is an example of the command: ./theia_download.py -t T32TPQ -c SENTINEL2 -a ./config_theia.cfg -d 2020-06-01 -f 2020-06-15 -m 80 A file is produced with the message: {"ErrorMessage": "Not Found", "ErrorCode": 404} How should I proceed to restore the service? I thank you for your work. Best regards. Michele Colauzzi — You are receiving this because you commented. Reply to this email directly, view it on GitHub< #12 (comment)>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/ABFNSJYMXJ2WUHZRRICRCE3R2XTBLANCNFSM4JY6YAVQ>. — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#12 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABL5X5Q4QHOSLRUIK4PNON3R2X4HZANCNFSM4JY6YAVQ> .

--

______________________ Michele Colauzzi Via Adua 5, 35141 PD mob. 338 7770686338

[olivierhagolle]

The issue was solved last Friday. Hope it works for you !
Olivier

[geopanda1]

Dear all,

I am also experiencing the same error as Michele #12 (comment) when I try the first example (and others):
Running
python ./theia_download.py -l 'Toulouse' -c SENTINEL2 -a config_theia.cfg -d 2016-09-01 -f 2016-10-01
results in
{'ErrorMessage': 'Not Found', 'ErrorCode': 404}
If relevant: I am running python 3.6.12 on Ubuntu 20.4.1 LTS. I have also restricted my password to only letters und digits as this has been a source of error before (#6).
Does anyone has any advice on how this could be fixed?

Kind regards
Andi

[olivierhagolle]

Hi, this new problem is with the data server, and not with the download code. The incident will be investigated shortly !
Sorry for this.

[wicand00]

Same here trying to download Landsat:
"Get theia single sign on token
Done
Authentification is probably wrong
check password file
password should only contain alpha-numerics"

Password only contains alpha-numerics and the download of S2 works if I replace "Landsat" by "SENTINEL2" and "config_landsat.cfg" by "config_theia.cfg". Any idea if it will be solved for Landsat too?