[cherry-pick 2.2]Refactor Heterogenous Pipeline Parameter Server#37446

Merged

fuyinno4 merged 12 commits intoPaddlePaddle:release/2.2from zmxdream:cherry_fix_heterps

Nov 23, 2021

+4,106-767

Commits on Nov 22, 2021

bug fix for DeserializeSelectedRows. test=develop (PaddlePaddle#36520 )
zmxdream
committed
fix SerializeSelectedRows (PaddlePaddle#36543 )
zmxdream
committed
[Heterps]Refactor Heter Pipeline Parameter Server (PaddlePaddle#36845 )
zmxdream
committed
Fix unit test for send_and_recv_cpu & send_and_recv_gpu (PaddlePaddle#37129 )
zmxdream
committed
[heterps]fix ut for heter_pipeline_trainer.cc (PaddlePaddle#37136 )
zmxdream
committed
[heterps]bug fix for local training with --heter_worker_num (PaddlePaddle#37166 )
zmxdream
committed
[heterps]Refactor heterogenous worker (PaddlePaddle#37244 )
zmxdream
committed
[heterps]add heterps mode judgement (PaddlePaddle#37298 )
zmxdream
committed
[heterps]change default executor for heter trainer (PaddlePaddle#37314 )
zmxdream
committed
[heterps]remove api for heter pipeline ps (PaddlePaddle#37396 )
zmxdream
committed
fix code style. test=release/2.2
zmxdream
committed

Commits on Nov 23, 2021

fix CMakeLists. test=develop (PaddlePaddle#37454 )
zmxdream
committed