Skip to content

Latest commit

 

History

History
98 lines (63 loc) · 2.91 KB

README.md

File metadata and controls

98 lines (63 loc) · 2.91 KB
Raw

DeviantArt Archiver

Archive any DeviantArt user/group galleries and favourites locally.

(Sane download timeouts are set to 6 seconds.)

Note: Recent DeviantArt network changes to DoS detection has necessitated a very low frequency of API calls.

Install

npm i -g da-archiver

Command example

da-archiver -b ~/da/archives/ -u myuser1 f!myuser2withoutfavs -g mygroup1

Command args

  • -u: usernames (space separated) [optional]
  • -g: groups (space separated) [optional]
  • -b: basefolder [optional]
  • -q: quitEarly [optional]

Notes:

You must provide at least -u or -g; or both.

-q quits archiving as soon as existing DeviantArt files are detected. (Recommended)

Command arg modifiers

  • prefix with g!<username>: avoid archiving the username's gallery.
    • Eg. g!hyung86 = "don't download hyung86 gallery"
  • prefix with f!<username>: avoid archiving the username's favourites.
    • Eg. f!hyung86 = "don't download hyung86 favourites"

Archive folder structure

This tool expects a filesystem structure of a "base" folder, under which each user/group's archive is kept inside its own folder, organized by the user's image gallery (under its own folder) and favourites (under its _favourites subfolder).

Eg:

~/da                    <--root folder of all DeviantArt users
~/da/user1              <--user1 gallery folder
~/da/user1/_favourites  <--user1 favourites folder

Debug logs

This package uses debug.

  • main
  • downloader
  • favs:http
  • fav:http
  • fav:process
  • gallery
  • group
  • * for all debug loggers

Eg. PowerShell env:

$env:DEBUG='*';da-archiver ...

$env:DEBUG='downloader,fav*';da-archiver ...

Tools (power-user bonus)

If you git clone this repo, there are a few helper tools for "bonus discovery" features. These scripts are found in the ./src/tools folder.

Note: argument order matters, all required!!

These scripts can be run like such, for example (in Powershell):

update-best-galleries (tools:ubg)

npm run tools:ubg -- {root_folder} {best_users.md}

node .\src\tools\update-best-galleries {root_folder} {best_users.md}

  • Updates the galleries of your "best"/top users by tracking them in a formatted markdown list:

discover-popular (tools:dp)

npm run tools:dp -- {root_folder} {discover_archive_file.txt}

node .\src\tools\discover-popular {root_folder} {discover_archive_file.txt}

  • Scrapes your existing users' favourites, to see which ones are "popular" on DeviantArt, and store user list in a file:

sample-art (tools:sa)

npm run tools:sa -- {root_folder} {discover_archive_file.txt}

node .\src\tools\sample-art {root_folder} {discover_archive_file.txt}

  • Downloads one sample image from each users' gallery which is listed in this text file (i.e. to get a feel for their art style):