v0.28.0: Keras 2.11+ optimizers, faster reducescatter, fixes for latest TensorFlow, CUDA, NCCL #3920
maxhgerlach
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Added
get_local_and_global_gradients
to PartialDistributedGradientTape to retrieve local and non-local gradients separately. (#3859)Changed
tf.logical_and
within allreducetf.cond
runs on CPU. (#3885)CUDA_VISIBLE_DEVICES
environment variable is no longer passed to remote nodes. (#3865)Fixed
This discussion was created from the release v0.28.0: Keras 2.11+ optimizers, faster reducescatter, fixes for latest TensorFlow, CUDA, NCCL.
Beta Was this translation helpful? Give feedback.
All reactions