Save user uploads as WACZs

[bensteinberg]

This is a first cut at preserving user uploads as WACZ files rather than WARCs. I'm not sure which Linear ticket is the best one to link here. I'm making this a draft for now.

This works, in the sense that it produces a valid WACZ that replayweb.page can play back, but it does not yet play back in Perma; the error message, from wabac.js. is e.g.

Archived Page Not Found

Sorry, this page was not found in this archive:

file:///8MXD-LZ6V/upload.jpg?version=040666551871161394
...

(That page is in fact in the archive.)

I'm guessing I need a slightly different set of options to py-wacz.

[bensteinberg]

Apart from getting this to work, the main question is what the metadata should look like.

[bensteinberg]

I think the problem here is that the CDX index is broken, because the entries for file:/// URIs are getting rewritten to reduce consecutive slashes to one; I think this is down to cdxj_indexer just using surt on the URL, rather than doing what warcio does with getSurt(), in the Scoop context:

    if (!url.startsWith("https:") && !url.startsWith("http:")) {
      return url;
    }

I'm going to see if I can demonstrate this. If this is the problem, I'm not sure where to make a fix.