Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…

… add-dy-decode
PaddlePaddle · Oct 14, 2020 · b4a6148 · b4a6148 · paddle-bot-old · Oct 15, 2020
2 parents 10f6bee + 338c765
commit b4a6148
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/python/paddle/nn/layer/norm.py b/python/paddle/nn/layer/norm.py
@@ -994,6 +994,11 @@ class SyncBatchNorm(_BatchNormBase):
     - :math:`\\gamma` : trainable scale parameter vector
     - :math:`\\beta` : trainable shift parameter vector 
 
+    Note:
+        If you want to use container to pack your model and has ``SyncBatchNorm`` in the 
+        evaluation phase, please use ``nn.LayerList`` or ``nn.Sequential`` instead of 
+        ``list`` to pack the model. 
+
     Parameters:
         num_features(int): Indicate the number of channels of the input ``Tensor``.
         epsilon(float, optional): The small value added to the variance to prevent division by zero. Default: 1e-5.