Add integration tests for the remote inference feature (#1073)

* Add remote inference integration tests for OpenAI and Cohere

Signed-off-by: Ryan Bogan <[email protected]>

* Change edits model test

Signed-off-by: Ryan Bogan <[email protected]>

* Change loop number in edits test

Signed-off-by: Ryan Bogan <[email protected]>

* Change edits model test again

Signed-off-by: Ryan Bogan <[email protected]>

* Fix spotless

Signed-off-by: Ryan Bogan <[email protected]>

* Refactoring

Signed-off-by: Ryan Bogan <[email protected]>

* Fix typo

Signed-off-by: Ryan Bogan <[email protected]>

* Remove env vars

Signed-off-by: Peter Zhu <[email protected]>

* Removing unnecessary comments

Signed-off-by: Ryan Bogan <[email protected]>

* Rebase with 2.x and remove set up for master key

Signed-off-by: Ryan Bogan <[email protected]>

* Remove print line

Signed-off-by: Ryan Bogan <[email protected]>

* Add throttling check

Signed-off-by: Ryan Bogan <[email protected]>

* Minor change for assert statement

Signed-off-by: Ryan Bogan <[email protected]>

* Test changes

Signed-off-by: Ryan Bogan <[email protected]>

* Uncomment delete connector test

Signed-off-by: Ryan Bogan <[email protected]>

---------

Signed-off-by: Ryan Bogan <[email protected]>
Signed-off-by: Peter Zhu <[email protected]>
Co-authored-by: Peter Zhu <[email protected]>
(cherry picked from commit 3e56ad5)

.github/workflows/CI-workflow.yml

@@ -35,7 +35,6 @@ jobs:
           role-to-assume: ${{ secrets.ML_ROLE }}
           aws-region: us-west-2
 
-      # ml-commons
       - name: Checkout MLCommons
         uses: actions/checkout@v2