Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disk space warning from --xattrs when plenty of space is left. #14970

Closed
4 of 8 tasks
NickSto opened this issue Dec 13, 2017 · 3 comments
Closed
4 of 8 tasks

Disk space warning from --xattrs when plenty of space is left. #14970

NickSto opened this issue Dec 13, 2017 · 3 comments

Comments

@NickSto
Copy link

NickSto commented Dec 13, 2017

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.12.10. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

  • I've verified and I assure that I'm running youtube-dl 2017.12.10

Before submitting an issue make sure you have:

  • At least skimmed through the README, most notably the FAQ and BUGS sections
  • Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

  • Bug report (encountered problems with youtube-dl)
  • Site support request (request for adding support for a new site)
  • Feature request (request for a new functionality)
  • Question
  • Other

Description of your issue, suggested solution and other information

Hi, I've been downloading some videos from a playlist using the --xattrs option, but I keep having an issue where youtube-dl reports:
WARNING: There's no disk space left or disk quota exceeded. Extended attributes are not written.
..even though it actually did write the attributes, and there's gigs of disk space available.

I haven't been able to go through all the videos where it reports this to check that they all got the attributes, but I've checked a few.

It was concerning until I realized it's a false positive. I started Googling for any info on the error and checked here, but it seems no one's filed the issue. Thought I'd let people know this is happening.

Technical details

It first occurred when running this command:
$ youtube-dl --no-mtime --xattrs --playlist-reverse -f 22 -o '%(playlist_index)s - %(title)s [src %(uploader_id)s] [posted %(upload_date)s] [id %(id)s].%(ext)s' https://www.youtube.com/user/pbsideachannel

One of the videos it happened on is: https://www.youtube.com/watch?v=0coyhlG4HK4

Also, it's repeatable: it happens every time I attempt to download this video, even outside a playlist:
$ youtube-dl --no-mtime --xattrs "https://www.youtube.com/watch?v=0coyhlG4HK4" -o "%(title)s [src %(uploader_id)s] [posted %(upload_date)s] [id %(id)s].%(ext)s"

But the attributes are actually written:

$ attr -l '300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4'
Attribute "dublincore.format" has a 21 byte value for 300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4
Attribute "dublincore.date" has a 10 byte value for 300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4
Attribute "dublincore.title" has a 64 byte value for 300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4
Attribute "xdg.referrer.url" has a 43 byte value for 300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4
Attribute "dublincore.contributor" has a 16 byte value for 300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4
$ attr -g xdg.referrer.url '300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4'
Attribute "xdg.referrer.url" had a 43 byte value for 300 - Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].mp4:
https://www.youtube.com/watch?v=0coyhlG4HK4

I'm on Ubuntu 16.04.3, 64-bit, and the drives in question (it happened on multiple) are all ext4-formatted. One of them has almost half a terabyte free.

This is the line in /etc/fstab for one of the drives it occurred on:
/dev/mapper/ubuntu--vg-root / ext4 discard,noatime,nodiratime,errors=remount-ro 0 1

Here's the verbose version of the output:

$ youtube-dl -v --no-mtime --xattrs "https://www.youtube.com/watch?v=0coyhlG4HK4" -o "%(title)s [src %(uploader_id)s] [posted %(upload_date)s] [id %(id)s].%(ext)s"
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '--no-mtime', '--xattrs', 'https://www.youtube.com/watch?v=0coyhlG4HK4', '-o', '%(title)s [src %(uploader_id)s] [posted %(upload_date)s] [id %(id)s].%(ext)s']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.12.10
[debug] Python version 3.5.2 - Linux-4.10.0-42-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: ffmpeg 2.8.11-0ubuntu0.16.04.1, ffprobe 2.8.11-0ubuntu0.16.04.1
[debug] Proxy map: {}
[youtube] 0coyhlG4HK4: Downloading webpage
[youtube] 0coyhlG4HK4: Downloading video info webpage
[youtube] 0coyhlG4HK4: Extracting video information
[youtube] 0coyhlG4HK4: Downloading MPD manifest
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://r4---sn-n4v7knlz.googlevideo.com/videoplayback?keepalive=yes&mm=31&ipbits=0&ei=0gMxWoTIOoKw-gPOs6-YBA&ms=au&itag=248&mt=1513161599&mv=m&sparams=aitags%2Cclen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Crequiressl%2Csource%2Cexpire&gir=yes&signature=6C588BAEB6752ED25AB3AD72C05D1D9B065D46D0.39AA10AC14995FE067858292BF38499B0B1010A5&ip=67.174.242.16&requiressl=yes&aitags=133%2C134%2C135%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278&id=o-AKdIQc_DnJX37rshWpwsSazuJw-4eYHUMt4ovqUfpFHm&lmt=1476404256720851&source=youtube&dur=890.764&key=yt6&mn=sn-n4v7knlz&initcwndbps=1595000&mime=video%2Fwebm&pl=22&clen=229121220&expire=1513183283&ratebypass=yes'
[download] Destination: Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].f248.webm
[download] 100% of 218.51MiB in 02:13
[debug] Invoking downloader on 'https://r4---sn-n4v7knlz.googlevideo.com/videoplayback?keepalive=yes&mm=31&ipbits=0&ei=0gMxWoTIOoKw-gPOs6-YBA&ms=au&itag=251&mt=1513161599&mv=m&sparams=clen%2Cdur%2Cei%2Cgir%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Ckeepalive%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Crequiressl%2Csource%2Cexpire&gir=yes&signature=C92C64F40832FB0ABD2DA853E8E2EAD48FC6183F.84853AD08A5E711AB3A9D51A38BA5306475EF3DE&ip=67.174.242.16&requiressl=yes&id=o-AKdIQc_DnJX37rshWpwsSazuJw-4eYHUMt4ovqUfpFHm&lmt=1476400343326805&source=youtube&dur=890.801&key=yt6&mn=sn-n4v7knlz&initcwndbps=1595000&mime=audio%2Fwebm&pl=22&clen=14448445&expire=1513183283&ratebypass=yes'
[download] Destination: Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].f251.webm
[download] 100% of 13.78MiB in 00:05
[ffmpeg] Merging formats into "Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].webm"
[debug] ffmpeg command line: ffmpeg -y -i 'file:Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].f248.webm' -i 'file:Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].f251.webm' -c copy -map 0:v:0 -map 1:a:0 'file:Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].temp.webm'
Deleting original file Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].f248.webm (pass -k to keep)
Deleting original file Is Reading a Form of Writing _ BOOK CLUB - Pierre Menard, Borges [src pbsideachannel] [posted 20161013] [id 0coyhlG4HK4].f251.webm (pass -k to keep)
[metadata] Writing metadata to file's xattrs
WARNING: There's no disk space left or disk quota exceeded. Extended attributes are not written.
@dstftw
Copy link
Collaborator

dstftw commented Dec 13, 2017

This is what seftattr returns when it hits ext4 4KiB xattr data limit. In your case it fails at writing user.dublincore.description as total size of xattrs exceeds 4KiB.

@NickSto
Copy link
Author

NickSto commented Dec 14, 2017

Oh wow, okay, now I understand.

Is it maybe possible to tell it to try again w/o the description, or just omit it in the first place? Maybe as an option? I don't really care about the description, but it's nice to have the rest.

Actually, this sounds like something simple enough that I could maybe make the change.

@rolandog
Copy link

rolandog commented Nov 7, 2021

I tried using with the --xattr-set-filesize option, but I still got the same error.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants