Skip to content

Commit

Permalink
Use a different way of updating instance group setting
Browse files Browse the repository at this point in the history
  • Loading branch information
kthui committed May 23, 2023
1 parent 4f0a9c2 commit cc65910
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/backend_model.cc
Original file line number Diff line number Diff line change
Expand Up @@ -274,7 +274,7 @@ TritonModel::UpdateInstanceGroup(const inference::ModelConfig& new_model_config)
// holding off new inference requests, and then commit the changes.
std::unique_ptr<std::lock_guard<std::mutex>> lock;
RETURN_IF_ERROR(scheduler_->Update(&lock));
config_.mutable_instance_group()->Swap(model_config.mutable_instance_group());
*config_.mutable_instance_group() = model_config.instance_group();
RETURN_IF_ERROR(CommitInstances());

return Status::Success;
Expand Down

0 comments on commit cc65910

Please sign in to comment.