ERROR Gone (410)

[agenteo]

Summary

I am seeing a bunch of errors that prevent images downloads and I'd like to learn what they are about.

Context

Running the following command: ./icloudpd-1.25.0-macos-amd64 --directory /Volumes/externalDisk/iCloudDownloads/ --username [email protected]

I see the following error messages:

2024-12-22 21:20:50 DEBUG    Downloading /Volumes/externalDisk/iCloudDownloads/2023/10/30/IMG_1110.PNG...
2024-12-22 21:20:50 ERROR    Gone (410)
2024-12-22 21:20:50 ERROR    Error downloading IMG_1110.PNG, retrying after 5 seconds...
2024-12-22 21:20:55 ERROR    Gone (410)
2024-12-22 21:20:55 ERROR    Error downloading IMG_1110.PNG, retrying after 10 seconds...
2024-12-22 21:21:05 ERROR    Gone (410)
2024-12-22 21:21:05 ERROR    Error downloading IMG_1110.PNG, retrying after 15 seconds...
2024-12-22 21:21:20 ERROR    Gone (410)
2024-12-22 21:21:20 ERROR    Error downloading IMG_1110.PNG, retrying after 20 seconds...
2024-12-22 21:21:41 ERROR    Gone (410)
2024-12-22 21:21:41 ERROR    Error downloading IMG_1110.PNG, retrying after 25 seconds...

The script moves on to the next file but the same error is triggered. I noticed killing and restarting the script helps.

Is this an HTTP 410? Why would the image be gone? I am the only owner of this iCloud account and I am not deleting these photos from anywhere else.

Thanks for the clarification!

[iowk]

This is because icloudpd fetches 100 download urls per request, and start downloading the files one by one.

However, the url can expire after several hours. Downloading from the expired url causes Gone (410) error.

For example, if it takes too long to download the first 80 photos, Gone (410) error occurs for the 81st ~ 100th photos.

To fix this, we will have to fix pyicloud_ipd/photos.py to refetch the urls when expired.