Skip to content

Commit

Permalink
Replace FORCE_DEVICE with INC_TARGET_DEVICE [transformers] (#2005)
Browse files Browse the repository at this point in the history
Signed-off-by: Kaihui-intel <[email protected]>
  • Loading branch information
Kaihui-intel authored Sep 14, 2024
1 parent 443d007 commit 906333a
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions neural_compressor/transformers/quantization/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -353,9 +353,9 @@ def convert_to_quantized_model(model, config, device="cpu"):
import intel_extension_for_pytorch

assert hasattr(torch, "xpu") and torch.xpu.is_available(), "There is no xpu device in this system!"
os.environ["FORCE_DEVICE"] = "cpu"
os.environ["INC_TARGET_DEVICE"] = "cpu"
logger.info(
"Set the environment variable FORCE_DEVICE='cpu' to ensure the quantization process occurs on the CPU."
"Set the environment variable INC_TARGET_DEVICE='cpu' to ensure the quantization process occurs on the CPU."
)

orig_dtype = torch.float32
Expand Down

0 comments on commit 906333a

Please sign in to comment.