Code

TPU Multi-Host Support#1913

Code

Merged

kevin85421 merged 16 commits intoray-project:masterray-project/kuberay:masterfrom ryanaoleary:tpu-hostsCopy head branch name to clipboardFeb 22, 2024

+173-3

Commits

Commits on Jan 19, 2024

• multihost pods

  richardsliu

  committed
  6cd70c3

  Copy full SHA for 6cd70c3

Commits on Jan 20, 2024

• pod deletion logic

  richardsliu

  committed
  4151150

  Copy full SHA for 4151150

Commits on Jan 23, 2024

• rename method

  richardsliu

  committed
  8c6ddfe

  Copy full SHA for 8c6ddfe

Commits on Feb 6, 2024

• Reconcile pods for multihost group when NumOfHosts > 1

  ryanaoleary

  committed
  389340e

  Copy full SHA for 389340e

• Add multihost groups to delete for autoscaler

  ryanaoleary

  committed
  906c8fb

  Copy full SHA for 906c8fb

Commits on Feb 7, 2024

• Added tests for multi-host pod reconciliation

  ryanaoleary

  committed
  5928e59

  Copy full SHA for 5928e59

• Remove unnecessary Log.Info statement

  ryanaoleary

  committed
  dd7976a

  Copy full SHA for dd7976a

• Merge branch 'master' into tpu-hosts

  Show description for 834fe3a
  ryanaoleary

  authored
  834fe3a

  Copy full SHA for 834fe3a

• Added ctx to buildWorkerPod

  ryanaoleary

  committed
  63ad728

  Copy full SHA for 63ad728

• Change usages of 'MultihostGroup' to MultihostReplica

  ryanaoleary

  committed
  026f143

  Copy full SHA for 026f143

Commits on Feb 20, 2024

• Remove multihostReplicasToDelete

  ryanaoleary

  committed
  dc561a9

  Copy full SHA for dc561a9

• Remove utils.RayNodeHostIndexKey

  ryanaoleary

  committed
  34e0bd9

  Copy full SHA for 34e0bd9

Commits on Feb 21, 2024

• Remove unnecessary if statement

  ryanaoleary

  committed
  6a83a5d

  Copy full SHA for 6a83a5d

• Remove multi-host replica logic

  ryanaoleary

  committed
  0b5af18

  Copy full SHA for 0b5af18

• Remove tests for multi-host labels and replica deletion

  ryanaoleary

  committed
  bda00a4

  Copy full SHA for bda00a4

Commits on Feb 22, 2024

• Scale using numExpectedPods rather than full replicas for multi-host groups

  ryanaoleary

  committed
  b038e4b

  Copy full SHA for b038e4b