feat: add script to compute stats for multi-language forms

[timotheeg]

Context

Adding the script I used to compute multi-language stats for @pearlyong . Below were her requirements:

• how many forms use another language apart from english
• number of submissions for these forms
• what languages are being used
• which agencies primarily
• some examples of these forms would be great
• any other related data you think might be interesting!

Detecting language is hard, especially since many forms use multiple languages for the same text blocks. Singapore has 4 primary languages though, so the script attempts to look for these specifically. Chinese and Tamil are easy to identify, thanks to dedicated unicode character ranges. Distinguishing English and Malay is harder since they both use latin characters. For these 2, the script uses a very crude heuristic to locate words from these languages that we see frequently in forms.

Anything with no language match is categorized as unknown, and is likely English with "funky words", like this form.

The scripts outputs some form counts, overall and by language, and then generates more details reports (with agency name, and number of submissions) for 2 categories:

1. Forms where multiple languages are detected
2. Form where only one language is detected, and it is not English

The results are printed to stdout as TSV content, so they can be copy/pasted into excel of google docs. Example report here.

Install and run

cd scripts/multi-language-stats
cp .env.template .env.production

# edit .env.production with the correct URI

npm install
npm run get_data

[mantariksh]

thanks Tim! previously we've only documented scripts for database migrations but I think this could come in really useful in future

[mantariksh]

@timotheeg btw the "feat" in the title needs to be lowercase haha

[timotheeg]

Thanks!

I forced push to add some edits and update the commit title too.

I had to submit the first commit with --no-verify btw, because after doing the linting and prettier, the precommit hook complained with the error below, which is a false positive 😢

Found patterns for AWS_ACCESS_KEY_ID/AWS_SECRET_ACCESS_KEY