AMS migration: assist and provide feedback (4/n)

[bassosimone]

Following up from #456. These are the remaining task:

• stop using ams-pg.ooni.org for integration testing and use ams-pg-test.ooni.org instead:
  • github.com/ooni/probe-engine
  • github.com/measurement-kit/measurement-kit (all: stop using ams-pg.ooni.org for integration testing measurement-kit/measurement-kit#1933)
  • github.com/ooni/e2etesting (Start probing the testing cloudfronted endpoint e2etesting#23) [❓]
  • github.com/ooni/probe-android
  • github.com/ooni/probe-ios

List above poised to shrink/grow as the time progresses. See also #437.

[bassosimone]

Regarding the old collector onion addresses:

• ams-ps.ooni.nu is bouncer.ooni.io
• mia-ps2.ooni.nu exposes hcn5nqahdkds6cjv.onion (which was previously announced by the bouncer as a valid collector)
• ams-p2.ooni.nu exposes jehhrikjjqrlpufu.onion (which was previously announced by the bouncer as a valid collector)

This should inform our future actions.

[bassosimone]

I've chosen not to merge ooni/probe-android#383 and ooni/probe-ios#397 as explained above. The last piece of work here concerns whether to change ooni/e2etesting. Since we're not using explicit names in ooni/e2etesting for quite some time now, and since we wanted to have periodic testing of our production infra, I would say it's actually fine for us to continue doing so. As such, this issue can now be declared complete. 🥳 🥳 🥳 🥳

[bassosimone]

As discussed with @FedericoCeratto, we want to test the testing infra in github.com/ooni/e2etesting.

[bassosimone]

This is the current situation in terms of clients listing only clients with 1% or more measurements:

software_name	software_version	platform	count	percentage
ooniprobe	2.1.0	linux	574591	47.933993
ooniprobe	2.3.0	macos	211476	17.641921
ooniprobe-android	2.7.0	android	57621	4.806905
ooniprobe-desktop	3.0.4	windows	52483	4.378279
ooniprobe-cli	3.0.9	linux	50971	4.252144
ooniprobe	2.2.0	macos	36698	3.061450
ooniprobe	2.2.0	linux	34772	2.900778
ooniprobe	2.3.0	lepidopter	29610	2.470149
ooniprobe-cli	3.0.7-beta.1	linux	26895	2.243656
ooniprobe	2.1.0	macos	20913	1.744621
ooniprobe-desktop	3.0.4	macos	17326	1.445384
ooniprobe-cli	3.0.0	linux	16770	1.399000
ooniprobe	2.2.0	lepidopter	13401	1.117949

Computed using this query:

SELECT 
      software_name
    , software_version
    , platform
    , count(*) 
FROM 
    fastpath
WHERE
        test_start_time > NOW() - interval '7 day'
    AND test_name <> 'ndt'
GROUP BY
      software_name
    , software_version
    , platform
;

We exclude ndt because we have many tests running it using an old version of measurement_kit. A good question is whether we should break this legacy use case (I think we really should not).

[bassosimone]

With the merging of ooni/e2etesting#26, we're really done here.