Code

Switch Apex with Pytorch#336

Code

Merged

okuchaiev merged 19 commits intoNVIDIA:masterNVIDIA/NeMo:masterfrom blisc:u_switch_apex_ddp_to_torchblisc/NeMo:u_switch_apex_ddp_to_torchCopy head branch name to clipboardFeb 14, 2020

+523-295

Commits

Commits on Feb 6, 2020

• stage 1 of switch DDP

  Show description for 672fd49
  blisc

  committed
  672fd49

• Merge remote-tracking branch 'nvidia/master' into u_switch_apex_ddp_to_torch

  Show description for 675b0fe
  blisc

  committed
  675b0fe

Commits on Feb 7, 2020

• switch from apex to torch

  Show description for d535720
  blisc

  committed
  d535720

• simplify contextmangaer

  Show description for a9be01a
  blisc

  committed
  a9be01a

• cleaner version with exitstack as opposed to nested with statements

  Show description for 71d4bff
  blisc

  committed
  71d4bff

Commits on Feb 8, 2020

• isort; update changelog

  Show description for 7235317
  blisc

  committed
  7235317

• update ZerosLikeNM to be NonTrainable

  Show description for f627f44
  blisc

  committed
  f627f44

• style

  Show description for b85cb40
  blisc

  committed
  b85cb40

Commits on Feb 10, 2020

• Merge remote-tracking branch 'nvidia/master' into u_switch_apex_ddp_to_torch

  Show description for b765575
  blisc

  committed
  b765575

Commits on Feb 13, 2020

• merge with master

  Show description for ef77ffc
  blisc

  committed
  ef77ffc

• weight sharing fix attempt

  Show description for c61ea90
  blisc

  committed
  c61ea90

• isorT

  Show description for f1a57bb
  blisc

  committed
  f1a57bb

• update DDP call

  Show description for dabaea2
  blisc

  committed
  dabaea2

• update unittests

  Show description for 4eb90b5
  blisc

  committed
  4eb90b5

• Merge remote-tracking branch 'nvidia/master' into u_switch_apex_ddp_to_torch

  Show description for 9fc14d7
  blisc

  committed
  9fc14d7

• make VoidType always return SAME; update tie weights test

  Show description for a71da02
  blisc

  committed
  a71da02

• fix nlp examples; do right typing

  Show description for 74ad50c
  blisc

  committed
  74ad50c

• isort

  Show description for 390c410
  blisc

  committed
  390c410

• small update

  Show description for 8c26247
  blisc

  committed
  8c26247