Search Tests

Firefox tracks unique search codes from its search providers. Iris has tests that confirm these codes are correct per local and region. Iris also has tests that check the functionality of the search features in Firefox.

---

Search code tests as part of the update tests

Because it is critical that the search codes are correct, the Iris team built the search code tests into the batch script for running the update tests. To run the update tests please follow the instructions here. A simple example:

./tools/run_update_suite.sh --locales=fr,en-US --versions=64.0b10,62.0b2 --channel=beta

would be the equivalent to running each of the following:

iris -o -f 64.0b10 -l fr -u beta -t manual_update,default_search_code_google
iris -o -f 64.0b10 -l fr -u beta -t background_update,default_search_code_google
iris -o -f 62.0b2 -l ru -u beta -t manual_update,default_search_code_yandex
iris -o -f 62.0b2 -l ru -u beta -t background_update,default_search_code_yandex

Notice that testing the Russian locale runs the default_search_code_yandex test instead of default_search_code_google test. This is as expected.

Stand alone search code testing

It is, of course, possible to run the search code tests without depending on the update tests. At the command line:

• iris Will open control center where the search tests can be selected and run.
• iris -d search will run all of the tests in the 'search' test suite, including the search code tests.
• iris -t default_search_code_google will run only the google search code test.

Supported locales

Per the Search - Release testing requirements, Iris supports the following regions for search code testing:

• P1: United States (en-US), Germany (de), France (fr), Poland (pl) and Russia (ru)
• P2: Brazil (br), India (in), Japan (ja), Spain (es-ES), United Kingdom (en-GB), Indonesia (id) and Canada (ca)

Note: When the default_search_code_google test is run against en-US, Iris will run the search code checks against en-US, ca (Canada), id (Indonesia) and in (India) as these regions primarily use Firefox en-US build.

Supported channels

Iris supports testing on all update channels including the staging channels. One exception is esr; Iris will not support esr until Fx68 is merged to that channel.

Status of test case automation development

Each of the search code critical tests can be run in Iris now. The remaining tests in the search functionality test suite are complete as of 20190320. They will be merged to the Iris master branch on 20190322.