tools: add rws_files

[Totktonada]

A simple crawler for https://rws.tarantool.org.

[LeonidVas]

Hi! Thank you for the patch.

• for consistency, we can call the tool rws_files. Up to you.
• created file does not have any permissions (---------- 1 leonid users 21454627 Oct 24 18:32 rws-files.txt)
• what do you think about adding several options to the CLI (--workers, --file, --quiet, --help)

[Totktonada]

• for consistency, we can call the tool rws_files. Up to you.

Personally I prefer tool names that doesn't require pressing the Shift key.

I had an idea that there is no consistency with rws_backup.sh, because I have no .lua at the end. But that's really has no much value for me, I'll just rename the tool to rws_files.

• created file does not have any permissions (---------- 1 leonid users 21454627 Oct 24 18:32 rws-files.txt)

It is due to tarantool/tarantool#7981.

I had an idea that it is a developer tool and unlikely someone will use an old tarantool version. Anyway, it is easy to workaround. I'll do.

• what do you think about adding several options to the CLI (--workers, --file, --quiet, --help)

I don't mind, but I wouldn't go there within this pull request if you don't insist.

[LeonidVas]

• for consistency, we can call the tool rws_files. Up to you.

Personally I prefer tool names that doesn't require pressing the Shift key.

I had an idea that there is no consistency with rws_backup.sh, because I have no .lua at the end. But that's really has no much value for me, I'll just rename the tool to rws_files.

ok.

• created file does not have any permissions (---------- 1 leonid users 21454627 Oct 24 18:32 rws-files.txt)

It is due to tarantool/tarantool#7981.

I had an idea that it is a developer tool and unlikely someone will use an old tarantool version. Anyway, it is easy to workaround. I'll do.

I'm just using tarantool from the system (arch linux) and I think I'm not alone)

• what do you think about adding several options to the CLI (--workers, --file, --quiet, --help)

I don't mind, but I wouldn't go there within this pull request if you don't insist.

I would be happy to have options --help and --quiet.

[Totktonada]

@LeonidVas I've updated the patch according to the comments (except decoupling HTML parsing from the main worker logic).

[Totktonada]

CI says:

GitHub Actions has encountered an internal error when running your job.

I don't know a reason.