archive-websites

Send queer-related websites regularly to the Internet Archive

How it works

• Fetch list of queer related items from Wikidata that have an official website:

  • the item neeeds to be (P31/P279) either Q64606659, Q61710689 or Q105321449 and needs to have a (P856) website.

• Use this list of URLs (data/urls.txt) as input for a sophisticated bash script (incl. parallel jobs and logging) that sends websites to the Internet Archive using the Save Now API.

  • Download spn.sh file from the wayback-machine-spn-scripts repository:

  wget https://raw.githubusercontent.com/overcast07/wayback-machine-spn-scripts/main/spn.sh
  chmod a+x spn.sh

• Every push to main starts the workflow to archive all URLs in data/urls.txt

  • Internet Archive access key and secret (find here) are stored as repository variables.

Using spn.sh

• Example: overcast07/wayback-machine-spn-scripts#5