Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update tensorflow conda environment #1968

Merged

Conversation

christopherwoodall
Copy link
Contributor

Update to fix audio poisoning scenarios.

Error

File "/workspace/armory/baseline_models/tf_graph/audio_resnet50.py", line 62, in train_step
model.optimizer.apply_gradients(zip(gradients, model.trainable_variables))
File "/opt/conda/lib/python3.9/site-packages/keras/optimizers/optimizer_experimental/optimizer.py", line 1140, in apply_gradients
return super().apply_gradients(grads_and_vars, name=name)
File "/opt/conda/lib/python3.9/site-packages/keras/optimizers/optimizer_experimental/optimizer.py", line 634, in apply_gradients
i
teration = self._internal_apply_gradients(grads_and_vars)
File "/opt/conda/lib/python3.9/site-packages/keras/optimizers/optimizer_experimental/optimizer.py", line 1166, in _internal_apply_gradients
return tf.__internal__.distribute.interim.maybe_merge_call(
File "/opt/conda/lib/python3.9/site-packages/keras/optimizers/optimizer_experimental/optimizer.py", line 1216, in _distributed_apply_gradients_fn
distribution.extended.update(
File "/opt/conda/lib/python3.9/site-packages/keras/optimizers/optimizer_experimental/optimizer.py", line 1211, in apply_grad_to_update_var
return self._update_step_xla(grad, var, id(self._var_key(var)))
Node: 'StatefulPartitionedCall_66'
libdevice not found at ./libdevice.10.bc
[[{{node StatefulPartitionedCall_66}}]] [Op:__inference_train_step_195557]

@christopherwoodall
Copy link
Contributor Author

FYSA: Adding open keras and tensorflow issues for tracking.

@christopherwoodall christopherwoodall self-assigned this Aug 7, 2023
@christopherwoodall christopherwoodall marked this pull request as draft August 7, 2023 15:05
@christopherwoodall christopherwoodall marked this pull request as ready for review August 8, 2023 12:54
docker/Dockerfile-pytorch-deepspeech Outdated Show resolved Hide resolved
environment.yml Show resolved Hide resolved
@christopherwoodall christopherwoodall changed the title WIP: Update tensorflow conda environment Update tensorflow conda environment Aug 8, 2023
Copy link
Contributor

@swsuggs swsuggs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good, thanks for taking care of this Chris

@swsuggs swsuggs merged commit 325f489 into twosixlabs:develop Aug 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants