From 960646c365230e6628d5651fd5118d9b7eaa02a1 Mon Sep 17 00:00:00 2001
From: "pre-commit-ci[bot]"
 <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Date: Mon, 2 Aug 2021 08:01:13 +0000
Subject: [PATCH] [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci
---
 .github/ISSUE_TEMPLATE/bug_report.md      |  20 +-
 .github/ISSUE_TEMPLATE/feature_request.md |   3 +-
 CHANGELOG.md                              | 918 ++++++++++------------
 dockers/README.md                         |  31 +-
 pl_examples/README.md                     |  13 +-
 pl_examples/basic_examples/README.md      |  26 +-
 tests/README.md                           |   6 +
 7 files changed, 486 insertions(+), 531 deletions(-)

diff --git a/.github/ISSUE_TEMPLATE/bug_report.md b/.github/ISSUE_TEMPLATE/bug_report.md
index 92f292d7bbb565..3a94ef67589108 100644
--- a/.github/ISSUE_TEMPLATE/bug_report.md
+++ b/.github/ISSUE_TEMPLATE/bug_report.md
@@ -4,8 +4,8 @@ about: Create a report to help us improve
 title: ''
 labels: bug / fix, help wanted
 assignees: ''
-
 ---
+
 ## 🐛 Bug
 
 <!-- A clear and concise description of what the bug is. -->
@@ -46,15 +46,15 @@ python collect_env_details.py
 You can also fill out the list below manually.
 -->
 
- - PyTorch Lightning Version (e.g., 1.3.0):
- - PyTorch Version (e.g., 1.8)
- - Python version:
- - OS (e.g., Linux):
- - CUDA/cuDNN version:
- - GPU models and configuration:
- - How you installed PyTorch (`conda`, `pip`, source):
- - If compiling from source, the output of `torch.__config__.show()`:
- - Any other relevant information:
+- PyTorch Lightning Version (e.g., 1.3.0):
+- PyTorch Version (e.g., 1.8)
+- Python version:
+- OS (e.g., Linux):
+- CUDA/cuDNN version:
+- GPU models and configuration:
+- How you installed PyTorch (`conda`, `pip`, source):
+- If compiling from source, the output of `torch.__config__.show()`:
+- Any other relevant information:
 
 ### Additional context
 
diff --git a/.github/ISSUE_TEMPLATE/feature_request.md b/.github/ISSUE_TEMPLATE/feature_request.md
index c73cda501eabab..fd91ee6f644712 100644
--- a/.github/ISSUE_TEMPLATE/feature_request.md
+++ b/.github/ISSUE_TEMPLATE/feature_request.md
@@ -4,7 +4,6 @@ about: Suggest an idea for this project
 title: ''
 labels: enhancement, help wanted
 assignees: ''
-
 ---
 
 ## 🚀 Feature
@@ -27,7 +26,7 @@ assignees: ''
 
 <!-- Add any other context or screenshots about the feature request here. -->
 
----
+______________________________________________________________________
 
 #### If you enjoy Lightning, check out our other projects! ⚡
 
diff --git a/CHANGELOG.md b/CHANGELOG.md
index 5b2d8491eba9ad..2bc21cf75d4c93 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -4,19 +4,15 @@ All notable changes to this project will be documented in this file.
 
 The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
-
-## [unReleased] - 2021-MM-DD
+## \[unReleased\] - 2021-MM-DD
 
 ### Added
 
 - Added `state_id` property to the `Callback` base class ([#6886](https://github.com/PyTorchLightning/pytorch-lightning/pull/6886))
 
-
--
-
-
 -
 
+*
 
 -
 
@@ -24,74 +20,51 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Replace `iteration_count` and other index attributes in the loops with progress dataclasses ([#8477](https://github.com/PyTorchLightning/pytorch-lightning/pull/8477))
 
-
 - Load ckpt path when model provided in validate/test/predict ([#8352](https://github.com/PyTorchLightning/pytorch-lightning/pull/8352)))
 
-
-
 - Saved checkpoints will no longer use the type of a `Callback` as the key to avoid issues with unpickling ([#6886](https://github.com/PyTorchLightning/pytorch-lightning/pull/6886))
 
-
 - Improved string conversion for `ResultCollection` ([#8622](https://github.com/PyTorchLightning/pytorch-lightning/pull/8622))
 
-
 -
 
 ### Deprecated
 
 - Deprecated `LightningModule.model_size` ([#8343](https://github.com/PyTorchLightning/pytorch-lightning/pull/8343))
 
-
 -
 
+*
 
 -
 
-
--
-
-
--
+*
 
 ### Removed
 
 - Removed deprecated `metrics` ([#8586](https://github.com/PyTorchLightning/pytorch-lightning/pull/8586/))
 
-
 - Removed the deprecated `outputs` argument in both the `LightningModule.on_train_epoch_end` and `Callback.on_train_epoch_end` hooks ([#8587](https://github.com/PyTorchLightning/pytorch-lightning/pull/8587))
 
-
-
 - Delete the deprecated `TrainerLoggingMixin` class ([#8609](https://github.com/PyTorchLightning/pytorch-lightning/pull/8609))
 
-
-
 - Removed the deprecated `optimizer_idx` from `training_step` as an accepted argument in manual optimization ([#8576](https://github.com/PyTorchLightning/pytorch-lightning/pull/8576))
 
-
-
-
 ### Fixed
 
 - Fixed `trainer.fit_loop.split_idx` always returning `None` ([#8601](https://github.com/PyTorchLightning/pytorch-lightning/pull/8601))
 
-
 - Fixed references for `ResultCollection.extra` ([#8622](https://github.com/PyTorchLightning/pytorch-lightning/pull/8622))
 
-
 - Fixed reference issues during epoch end result collection ([#8621](https://github.com/PyTorchLightning/pytorch-lightning/pull/8621))
 
-
 - Fixed horovod auto-detection when horovod is not installed and the launcher is `mpirun` ([#8610](https://github.com/PyTorchLightning/pytorch-lightning/pull/8610))
 
-
 - Fixed an issue with `training_step` outputs not getting collected correctly for `training_epoch_end` ([#8613](https://github.com/PyTorchLightning/pytorch-lightning/pull/8613))
 
-
 -
 
-
-## [1.4.0] - 2021-07-27
+## \[1.4.0\] - 2021-07-27
 
 ### Added
 
@@ -104,14 +77,14 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added `ModelPruning(prune_on_train_epoch_end=True|False)` to choose when to apply pruning ([#7704](https://github.com/PyTorchLightning/pytorch-lightning/pull/7704))
 - Added support for checkpointing based on a provided time interval during training ([#7515](https://github.com/PyTorchLightning/pytorch-lightning/pull/7515))
 - Progress tracking
-  * Added dataclasses for progress tracking ([#6603](https://github.com/PyTorchLightning/pytorch-lightning/pull/6603),
+  - Added dataclasses for progress tracking ([#6603](https://github.com/PyTorchLightning/pytorch-lightning/pull/6603),
     [#7574](https://github.com/PyTorchLightning/pytorch-lightning/pull/7574),
     [#8140](https://github.com/PyTorchLightning/pytorch-lightning/pull/8140),
     [#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
-  * Add `{,load_}state_dict` to the progress tracking dataclasses ([#8140](https://github.com/PyTorchLightning/pytorch-lightning/pull/8140))
-  * Connect the progress tracking dataclasses to the loops ([#8244](https://github.com/PyTorchLightning/pytorch-lightning/pull/8244),
+  - Add `{,load_}state_dict` to the progress tracking dataclasses ([#8140](https://github.com/PyTorchLightning/pytorch-lightning/pull/8140))
+  - Connect the progress tracking dataclasses to the loops ([#8244](https://github.com/PyTorchLightning/pytorch-lightning/pull/8244),
     [#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
-  * Do not reset the progress tracking dataclasses total counters ([#8475](https://github.com/PyTorchLightning/pytorch-lightning/pull/8475))
+  - Do not reset the progress tracking dataclasses total counters ([#8475](https://github.com/PyTorchLightning/pytorch-lightning/pull/8475))
 - Added support for passing a `LightningDataModule` positionally as the second argument to `trainer.{validate,test,predict}` ([#7431](https://github.com/PyTorchLightning/pytorch-lightning/pull/7431))
 - Added argument `trainer.predict(ckpt_path)` ([#7430](https://github.com/PyTorchLightning/pytorch-lightning/pull/7430))
 - Added `clip_grad_by_value` support for TPUs ([#7025](https://github.com/PyTorchLightning/pytorch-lightning/pull/7025))
@@ -130,12 +103,12 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added the `on_before_optimizer_step` hook ([#8048](https://github.com/PyTorchLightning/pytorch-lightning/pull/8048))
 - Added IPU Accelerator ([#7867](https://github.com/PyTorchLightning/pytorch-lightning/pull/7867))
 - Fault-tolerant training
-    * Added `{,load_}state_dict` to `ResultCollection` ([#7948](https://github.com/PyTorchLightning/pytorch-lightning/pull/7948))
-    * Added `{,load_}state_dict` to `Loops` ([#8197](https://github.com/PyTorchLightning/pytorch-lightning/pull/8197))
-    * Set `Loop.restarting=False` at the end of the first iteration ([#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
-    * Save the loops state with the checkpoint (opt-in) ([#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
-    * Save a checkpoint to restore the state on exception (opt-in) ([#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
-    * Added `state_dict` and `load_state_dict` utilities for `CombinedLoader` + utilities for dataloader ([#8364](https://github.com/PyTorchLightning/pytorch-lightning/pull/8364))
+  - Added `{,load_}state_dict` to `ResultCollection` ([#7948](https://github.com/PyTorchLightning/pytorch-lightning/pull/7948))
+  - Added `{,load_}state_dict` to `Loops` ([#8197](https://github.com/PyTorchLightning/pytorch-lightning/pull/8197))
+  - Set `Loop.restarting=False` at the end of the first iteration ([#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
+  - Save the loops state with the checkpoint (opt-in) ([#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
+  - Save a checkpoint to restore the state on exception (opt-in) ([#8362](https://github.com/PyTorchLightning/pytorch-lightning/pull/8362))
+  - Added `state_dict` and `load_state_dict` utilities for `CombinedLoader` + utilities for dataloader ([#8364](https://github.com/PyTorchLightning/pytorch-lightning/pull/8364))
 - Added `rank_zero_only` to `LightningModule.log` function ([#7966](https://github.com/PyTorchLightning/pytorch-lightning/pull/7966))
 - Added `metric_attribute` to `LightningModule.log` function ([#7966](https://github.com/PyTorchLightning/pytorch-lightning/pull/7966))
 - Added a warning if `Trainer(log_every_n_steps)` is a value too high for the training dataloader ([#7734](https://github.com/PyTorchLightning/pytorch-lightning/pull/7734))
@@ -167,7 +140,6 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added private `prevent_trainer_and_dataloaders_deepcopy` context manager on the `LightningModule` ([#8472](https://github.com/PyTorchLightning/pytorch-lightning/pull/8472))
 - Added support for providing callables to the Lightning CLI instead of types ([#8400](https://github.com/PyTorchLightning/pytorch-lightning/pull/8400))
 
-
 ### Changed
 
 - Decoupled device parsing logic from Accelerator connector to Trainer ([#8180](https://github.com/PyTorchLightning/pytorch-lightning/pull/8180))
@@ -181,33 +153,33 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - `ModelCheckpoint` now runs at the end of the training epoch by default ([#8389](https://github.com/PyTorchLightning/pytorch-lightning/pull/8389))
 - `EarlyStopping` now runs at the end of the training epoch by default ([#8286](https://github.com/PyTorchLightning/pytorch-lightning/pull/8286))
 - Refactored Loops
-    * Moved attributes `global_step`, `current_epoch`, `max/min_steps`, `max/min_epochs`, `batch_idx`, and `total_batch_idx` to TrainLoop ([#7437](https://github.com/PyTorchLightning/pytorch-lightning/pull/7437))
-    * Refactored result handling in training loop ([#7506](https://github.com/PyTorchLightning/pytorch-lightning/pull/7506))
-    * Moved attributes `hiddens` and `split_idx` to TrainLoop ([#7507](https://github.com/PyTorchLightning/pytorch-lightning/pull/7507))
-    * Refactored the logic around manual and automatic optimization inside the optimizer loop ([#7526](https://github.com/PyTorchLightning/pytorch-lightning/pull/7526))
-    * Simplified "should run validation" logic ([#7682](https://github.com/PyTorchLightning/pytorch-lightning/pull/7682))
-    * Simplified logic for updating the learning rate for schedulers ([#7682](https://github.com/PyTorchLightning/pytorch-lightning/pull/7682))
-    * Removed the `on_epoch` guard from the "should stop" validation check ([#7701](https://github.com/PyTorchLightning/pytorch-lightning/pull/7701))
-    * Refactored internal loop interface; added new classes `FitLoop`, `TrainingEpochLoop`, `TrainingBatchLoop` ([#7871](https://github.com/PyTorchLightning/pytorch-lightning/pull/7871), [#8077](https://github.com/PyTorchLightning/pytorch-lightning/pull/8077))
-    * Removed `pytorch_lightning/trainer/training_loop.py` ([#7985](https://github.com/PyTorchLightning/pytorch-lightning/pull/7985))
-    * Refactored evaluation loop interface; added new classes `DataLoaderLoop`, `EvaluationLoop`, `EvaluationEpochLoop` ([#7990](https://github.com/PyTorchLightning/pytorch-lightning/pull/7990), [#8077](https://github.com/PyTorchLightning/pytorch-lightning/pull/8077))
-    * Removed `pytorch_lightning/trainer/evaluation_loop.py` ([#8056](https://github.com/PyTorchLightning/pytorch-lightning/pull/8056))
-    * Restricted public access to several internal functions ([#8024](https://github.com/PyTorchLightning/pytorch-lightning/pull/8024))
-    * Refactored trainer `_run_*` functions and separate evaluation loops ([#8065](https://github.com/PyTorchLightning/pytorch-lightning/pull/8065))
-    * Refactored prediction loop interface; added new classes `PredictionLoop`, `PredictionEpochLoop` ([#7700](https://github.com/PyTorchLightning/pytorch-lightning/pull/7700), [#8077](https://github.com/PyTorchLightning/pytorch-lightning/pull/8077))
-    * Removed `pytorch_lightning/trainer/predict_loop.py` ([#8094](https://github.com/PyTorchLightning/pytorch-lightning/pull/8094))
-    * Moved result teardown to the loops ([#8245](https://github.com/PyTorchLightning/pytorch-lightning/pull/8245))
-    * Improve `Loop` API to better handle children `state_dict` and `progress` ([#8334](https://github.com/PyTorchLightning/pytorch-lightning/pull/8334))
+  - Moved attributes `global_step`, `current_epoch`, `max/min_steps`, `max/min_epochs`, `batch_idx`, and `total_batch_idx` to TrainLoop ([#7437](https://github.com/PyTorchLightning/pytorch-lightning/pull/7437))
+  - Refactored result handling in training loop ([#7506](https://github.com/PyTorchLightning/pytorch-lightning/pull/7506))
+  - Moved attributes `hiddens` and `split_idx` to TrainLoop ([#7507](https://github.com/PyTorchLightning/pytorch-lightning/pull/7507))
+  - Refactored the logic around manual and automatic optimization inside the optimizer loop ([#7526](https://github.com/PyTorchLightning/pytorch-lightning/pull/7526))
+  - Simplified "should run validation" logic ([#7682](https://github.com/PyTorchLightning/pytorch-lightning/pull/7682))
+  - Simplified logic for updating the learning rate for schedulers ([#7682](https://github.com/PyTorchLightning/pytorch-lightning/pull/7682))
+  - Removed the `on_epoch` guard from the "should stop" validation check ([#7701](https://github.com/PyTorchLightning/pytorch-lightning/pull/7701))
+  - Refactored internal loop interface; added new classes `FitLoop`, `TrainingEpochLoop`, `TrainingBatchLoop` ([#7871](https://github.com/PyTorchLightning/pytorch-lightning/pull/7871), [#8077](https://github.com/PyTorchLightning/pytorch-lightning/pull/8077))
+  - Removed `pytorch_lightning/trainer/training_loop.py` ([#7985](https://github.com/PyTorchLightning/pytorch-lightning/pull/7985))
+  - Refactored evaluation loop interface; added new classes `DataLoaderLoop`, `EvaluationLoop`, `EvaluationEpochLoop` ([#7990](https://github.com/PyTorchLightning/pytorch-lightning/pull/7990), [#8077](https://github.com/PyTorchLightning/pytorch-lightning/pull/8077))
+  - Removed `pytorch_lightning/trainer/evaluation_loop.py` ([#8056](https://github.com/PyTorchLightning/pytorch-lightning/pull/8056))
+  - Restricted public access to several internal functions ([#8024](https://github.com/PyTorchLightning/pytorch-lightning/pull/8024))
+  - Refactored trainer `_run_*` functions and separate evaluation loops ([#8065](https://github.com/PyTorchLightning/pytorch-lightning/pull/8065))
+  - Refactored prediction loop interface; added new classes `PredictionLoop`, `PredictionEpochLoop` ([#7700](https://github.com/PyTorchLightning/pytorch-lightning/pull/7700), [#8077](https://github.com/PyTorchLightning/pytorch-lightning/pull/8077))
+  - Removed `pytorch_lightning/trainer/predict_loop.py` ([#8094](https://github.com/PyTorchLightning/pytorch-lightning/pull/8094))
+  - Moved result teardown to the loops ([#8245](https://github.com/PyTorchLightning/pytorch-lightning/pull/8245))
+  - Improve `Loop` API to better handle children `state_dict` and `progress` ([#8334](https://github.com/PyTorchLightning/pytorch-lightning/pull/8334))
 - Refactored logging
-    * Renamed and moved `core/step_result.py` to `trainer/connectors/logger_connector/result.py` ([#7736](https://github.com/PyTorchLightning/pytorch-lightning/pull/7736))
-    * Dramatically simplify the `LoggerConnector` ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
-    * `trainer.{logged,progress_bar,callback}_metrics` are now updated on-demand ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
-    * Completely overhaul the `Result` object in favor of `ResultMetric` ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
-    * Improve epoch-level reduction time and overall memory usage ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
-    * Allow passing `self.log(batch_size=...)` ([#7891](https://github.com/PyTorchLightning/pytorch-lightning/pull/7891))
-    * Each of the training loops now keeps its own results collection ([#7891](https://github.com/PyTorchLightning/pytorch-lightning/pull/7891))
-    * Remove `EpochResultStore` and `HookResultStore` in favor of `ResultCollection` ([#7909](https://github.com/PyTorchLightning/pytorch-lightning/pull/7909))
-    * Remove `MetricsHolder` ([#7909](https://github.com/PyTorchLightning/pytorch-lightning/pull/7909))
+  - Renamed and moved `core/step_result.py` to `trainer/connectors/logger_connector/result.py` ([#7736](https://github.com/PyTorchLightning/pytorch-lightning/pull/7736))
+  - Dramatically simplify the `LoggerConnector` ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
+  - `trainer.{logged,progress_bar,callback}_metrics` are now updated on-demand ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
+  - Completely overhaul the `Result` object in favor of `ResultMetric` ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
+  - Improve epoch-level reduction time and overall memory usage ([#7882](https://github.com/PyTorchLightning/pytorch-lightning/pull/7882))
+  - Allow passing `self.log(batch_size=...)` ([#7891](https://github.com/PyTorchLightning/pytorch-lightning/pull/7891))
+  - Each of the training loops now keeps its own results collection ([#7891](https://github.com/PyTorchLightning/pytorch-lightning/pull/7891))
+  - Remove `EpochResultStore` and `HookResultStore` in favor of `ResultCollection` ([#7909](https://github.com/PyTorchLightning/pytorch-lightning/pull/7909))
+  - Remove `MetricsHolder` ([#7909](https://github.com/PyTorchLightning/pytorch-lightning/pull/7909))
 - Moved `ignore_scalar_return_in_dp` warning suppression to the DataParallelPlugin class ([#7421](https://github.com/PyTorchLightning/pytorch-lightning/pull/7421/))
 - Changed the behaviour when logging evaluation step metrics to no longer append `/epoch_*` to the metric name ([#7351](https://github.com/PyTorchLightning/pytorch-lightning/pull/7351))
 - Raised `ValueError` when a `None` value is `self.log`-ed ([#7771](https://github.com/PyTorchLightning/pytorch-lightning/pull/7771))
@@ -262,7 +234,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 ### Removed
 
-- Dropped official support/testing for PyTorch <1.6 ([#8288](https://github.com/PyTorchLightning/pytorch-lightning/pull/8288))
+- Dropped official support/testing for PyTorch \<1.6 ([#8288](https://github.com/PyTorchLightning/pytorch-lightning/pull/8288))
 - Removed `ProfilerConnector` ([#7654](https://github.com/PyTorchLightning/pytorch-lightning/pull/7654))
 - Pruned deprecated classif. metrics from `pytorch_lightning.metrics.functional.classification` ([#7499](https://github.com/PyTorchLightning/pytorch-lightning/pull/7499))
 - Removed deprecated data parallel classes `LightningDataParallel` and `LightningDistributedDataParallel` from `pytorch_lightning.overrides.data_parallel` ([#7510](https://github.com/PyTorchLightning/pytorch-lightning/pull/7510))
@@ -305,7 +277,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed hash of LightningEnum to work with value instead of name([#8421](https://github.com/PyTorchLightning/pytorch-lightning/pull/8421)).
 - Fixed `move_data_to_device` to return the batch if the object `to` function didn't return `self` ([#8433](https://github.com/PyTorchLightning/pytorch-lightning/pull/8433))
 - Fixed progress bar updates for Pod Training ([#8258](https://github.com/PyTorchLightning/pytorch-lightning/pull/8258))
-- Fixed clearing dataloader references before attaching new dataloaders in consecutive `Trainer.{fit,validate,test,predict}´ runs ([#8442](https://github.com/PyTorchLightning/pytorch-lightning/pull/8442))
+- Fixed clearing dataloader references before attaching new dataloaders in consecutive \`Trainer.{fit,validate,test,predict}´ runs ([#8442](https://github.com/PyTorchLightning/pytorch-lightning/pull/8442))
 - Fixed memory leaks on GPU by moving `optimizer_states`, `ResultCollection.extra`, `ResultMetric` attributes, and `LoggerConnector` metrics to `cpu`. Also, delete the DDP wrapper on `teardown` ([#8490](https://github.com/PyTorchLightning/pytorch-lightning/pull/8490))
 - Fixed `SWA` callback using LightningModule `prevent_trainer_and_dataloaders_deepcopy` to avoid OOM ([#8472](https://github.com/PyTorchLightning/pytorch-lightning/pull/8472))
 - Fixed `ModelPruning` callback `on_save_checkpoint` to avoid making a `deepcopy` potentially leading to OOM ([#8472](https://github.com/PyTorchLightning/pytorch-lightning/pull/8472))
@@ -320,8 +292,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `lr_scheduler` with metric (e.g. `torch.optim.lr_scheduler.ReduceLROnPlateau`) when using `automatic_optimization = False` ([#7643](https://github.com/PyTorchLightning/pytorch-lightning/pull/7643))
 - Fixed `DeepSpeed` breaking with no schedulers ([#8580](https://github.com/PyTorchLightning/pytorch-lightning/pull/8580))
 
-
-## [1.3.8] - 2021-07-01
+## \[1.3.8\] - 2021-07-01
 
 ### Fixed
 
@@ -335,8 +306,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed NCCL error when selecting non-consecutive device ids ([#8165](https://github.com/PyTorchLightning/pytorch-lightning/pull/8165))
 - Fixed SWA to also work with `IterableDataset` ([#8172](https://github.com/PyTorchLightning/pytorch-lightning/pull/8172))
 
-
-## [1.3.7] - 2021-06-22
+## \[1.3.7\] - 2021-06-22
 
 ### Fixed
 
@@ -347,8 +317,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed moving the best score to device in `EarlyStopping` callback for TPU devices ([#7959](https://github.com/PyTorchLightning/pytorch-lightning/pull/7959))
 - Fixes access to `callback_metrics` in ddp_spawn ([#7916](https://github.com/PyTorchLightning/pytorch-lightning/pull/7916))
 
-
-## [1.3.6] - 2021-06-15
+## \[1.3.6\] - 2021-06-15
 
 ### Fixed
 
@@ -357,8 +326,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed setting `worker_init_fn` to seed dataloaders correctly when using DDP ([#7942](https://github.com/PyTorchLightning/pytorch-lightning/pull/7942))
 - Fixed `BaseFinetuning` callback to properly handle parent modules w/ parameters ([#7931](https://github.com/PyTorchLightning/pytorch-lightning/pull/7931))
 
-
-## [1.3.5] - 2021-06-08
+## \[1.3.5\] - 2021-06-08
 
 ### Added
 
@@ -376,16 +344,14 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Move `training_output` validation to after `train_step_end` ([#7868](https://github.com/PyTorchLightning/pytorch-lightning/pull/7868))
 
-
-## [1.3.4] - 2021-06-01
+## \[1.3.4\] - 2021-06-01
 
 ### Fixed
 
 - Fixed info message when max training time reached ([#7780](https://github.com/PyTorchLightning/pytorch-lightning/pull/7780))
 - Fixed missing `__len__` method to `IndexBatchSamplerWrapper` ([#7681](https://github.com/PyTorchLightning/pytorch-lightning/pull/7681))
 
-
-## [1.3.3] - 2021-05-27
+## \[1.3.3\] - 2021-05-27
 
 ### Changed
 
@@ -400,8 +366,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed global step update when the epoch is skipped ([#7677](https://github.com/PyTorchLightning/pytorch-lightning/pull/7677))
 - Fixed training loop total batch counter when accumulate grad batches was enabled ([#7692](https://github.com/PyTorchLightning/pytorch-lightning/pull/7692))
 
-
-## [1.3.2] - 2021-05-18
+## \[1.3.2\] - 2021-05-18
 
 ### Changed
 
@@ -414,8 +379,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed setting correct `DistribType` for `ddp_cpu` (spawn) backend ([#7492](https://github.com/PyTorchLightning/pytorch-lightning/pull/7492))
 - Fixed incorrect number of calls to LR scheduler when `check_val_every_n_epoch > 1` ([#7032](https://github.com/PyTorchLightning/pytorch-lightning/pull/7032))
 
-
-## [1.3.1] - 2021-05-11
+## \[1.3.1\] - 2021-05-11
 
 ### Fixed
 
@@ -423,8 +387,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `Trainer.current_epoch` not getting restored after tuning ([#7434](https://github.com/PyTorchLightning/pytorch-lightning/pull/7434))
 - Fixed local rank displayed in console log ([#7395](https://github.com/PyTorchLightning/pytorch-lightning/pull/7395))
 
-
-## [1.3.0] - 2021-05-06
+## \[1.3.0\] - 2021-05-06
 
 ### Added
 
@@ -435,10 +398,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added utils for NaN/Inf detection for gradients and parameters ([#6834](https://github.com/PyTorchLightning/pytorch-lightning/pull/6834))
 - Added more explicit exception message when trying to execute `trainer.test()` or `trainer.validate()` with `fast_dev_run=True` ([#6667](https://github.com/PyTorchLightning/pytorch-lightning/pull/6667))
 - Added `LightningCLI` class to provide simple reproducibility with minimum boilerplate training CLI (
-    [#4492](https://github.com/PyTorchLightning/pytorch-lightning/pull/4492),
-    [#6862](https://github.com/PyTorchLightning/pytorch-lightning/pull/6862),
-    [#7156](https://github.com/PyTorchLightning/pytorch-lightning/pull/7156),
-    [#7299](https://github.com/PyTorchLightning/pytorch-lightning/pull/7299))
+  [#4492](https://github.com/PyTorchLightning/pytorch-lightning/pull/4492),
+  [#6862](https://github.com/PyTorchLightning/pytorch-lightning/pull/6862),
+  [#7156](https://github.com/PyTorchLightning/pytorch-lightning/pull/7156),
+  [#7299](https://github.com/PyTorchLightning/pytorch-lightning/pull/7299))
 - Added `gradient_clip_algorithm` argument to Trainer for gradient clipping by value ([#6123](https://github.com/PyTorchLightning/pytorch-lightning/pull/6123)).
 - Added a way to print to terminal without breaking up the progress bar ([#5470](https://github.com/PyTorchLightning/pytorch-lightning/pull/5470))
 - Added support to checkpoint after training steps in `ModelCheckpoint` callback ([#6146](https://github.com/PyTorchLightning/pytorch-lightning/pull/6146))
@@ -461,8 +424,8 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added support for DDP communication hooks ([#6736](https://github.com/PyTorchLightning/pytorch-lightning/pull/6736))
 - Added `artifact_location` argument to `MLFlowLogger` which will be passed to the `MlflowClient.create_experiment` call ([#6677](https://github.com/PyTorchLightning/pytorch-lightning/pull/6677))
 - Added `model` parameter to precision plugins' `clip_gradients` signature (
-    [#6764](https://github.com/PyTorchLightning/pytorch-lightning/pull/6764),
-    [#7231](https://github.com/PyTorchLightning/pytorch-lightning/pull/7231))
+  [#6764](https://github.com/PyTorchLightning/pytorch-lightning/pull/6764),
+  [#7231](https://github.com/PyTorchLightning/pytorch-lightning/pull/7231))
 - Added `is_last_batch` attribute to `Trainer` ([#6825](https://github.com/PyTorchLightning/pytorch-lightning/pull/6825))
 - Added `LightningModule.lr_schedulers()` for manual optimization  ([#6567](https://github.com/PyTorchLightning/pytorch-lightning/pull/6567))
 - Added `MpModelWrapper` in TPU Spawn ([#7045](https://github.com/PyTorchLightning/pytorch-lightning/pull/7045))
@@ -479,11 +442,11 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added warning when missing `Callback` and using `resume_from_checkpoint` ([#7254](https://github.com/PyTorchLightning/pytorch-lightning/pull/7254))
 - DeepSpeed single file saving ([#6900](https://github.com/PyTorchLightning/pytorch-lightning/pull/6900))
 - Added Training type Plugins Registry (
-    [#6982](https://github.com/PyTorchLightning/pytorch-lightning/pull/6982),
-    [#7063](https://github.com/PyTorchLightning/pytorch-lightning/pull/7063),
-    [#7214](https://github.com/PyTorchLightning/pytorch-lightning/pull/7214),
-    [#7224](https://github.com/PyTorchLightning/pytorch-lightning/pull/7224)
-)
+  [#6982](https://github.com/PyTorchLightning/pytorch-lightning/pull/6982),
+  [#7063](https://github.com/PyTorchLightning/pytorch-lightning/pull/7063),
+  [#7214](https://github.com/PyTorchLightning/pytorch-lightning/pull/7214),
+  [#7224](https://github.com/PyTorchLightning/pytorch-lightning/pull/7224)
+  )
 - Add `ignore` param to `save_hyperparameters` ([#6056](https://github.com/PyTorchLightning/pytorch-lightning/pull/6056))
 
 ### Changed
@@ -492,11 +455,11 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Changed `EarlyStopping` callback from by default running `EarlyStopping.on_validation_end` if only training is run. Set `check_on_train_epoch_end` to run the callback at the end of the train epoch instead of at the end of the validation epoch ([#7069](https://github.com/PyTorchLightning/pytorch-lightning/pull/7069))
 - Renamed `pytorch_lightning.callbacks.swa` to `pytorch_lightning.callbacks.stochastic_weight_avg` ([#6259](https://github.com/PyTorchLightning/pytorch-lightning/pull/6259))
 - Refactor `RunningStage` and `TrainerState` usage (
-    [#4945](https://github.com/PyTorchLightning/pytorch-lightning/pull/4945),
-    [#7173](https://github.com/PyTorchLightning/pytorch-lightning/pull/7173))
-    * Added `RunningStage.SANITY_CHECKING`
-    * Added `TrainerFn.{FITTING,VALIDATING,TESTING,PREDICTING,TUNING}`
-    * Changed `trainer.evaluating` to return `True` if validating or testing
+  [#4945](https://github.com/PyTorchLightning/pytorch-lightning/pull/4945),
+  [#7173](https://github.com/PyTorchLightning/pytorch-lightning/pull/7173))
+  - Added `RunningStage.SANITY_CHECKING`
+  - Added `TrainerFn.{FITTING,VALIDATING,TESTING,PREDICTING,TUNING}`
+  - Changed `trainer.evaluating` to return `True` if validating or testing
 - Changed `setup()` and `teardown()` stage argument to take any of `{fit,validate,test,predict}` ([#6386](https://github.com/PyTorchLightning/pytorch-lightning/pull/6386))
 - Changed profilers to save separate report files per state and rank ([#6621](https://github.com/PyTorchLightning/pytorch-lightning/pull/6621))
 - The trainer no longer tries to save a checkpoint on exception or run callback's `on_train_end` functions ([#6864](https://github.com/PyTorchLightning/pytorch-lightning/pull/6864))
@@ -513,9 +476,9 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Removed ModelSummary validation from train loop on_trainer_init ([#6610](https://github.com/PyTorchLightning/pytorch-lightning/pull/6610))
 - Moved `save_function` to accelerator ([#6689](https://github.com/PyTorchLightning/pytorch-lightning/pull/6689))
 - Updated DeepSpeed ZeRO ([#6546](https://github.com/PyTorchLightning/pytorch-lightning/pull/6546),
-    [#6752](https://github.com/PyTorchLightning/pytorch-lightning/pull/6752),
-    [#6142](https://github.com/PyTorchLightning/pytorch-lightning/pull/6142),
-    [#6321](https://github.com/PyTorchLightning/pytorch-lightning/pull/6321))
+  [#6752](https://github.com/PyTorchLightning/pytorch-lightning/pull/6752),
+  [#6142](https://github.com/PyTorchLightning/pytorch-lightning/pull/6142),
+  [#6321](https://github.com/PyTorchLightning/pytorch-lightning/pull/6321))
 - Improved verbose logging for `EarlyStopping` callback ([#6811](https://github.com/PyTorchLightning/pytorch-lightning/pull/6811))
 - Run ddp_spawn dataloader checks on Windows ([#6930](https://github.com/PyTorchLightning/pytorch-lightning/pull/6930))
 - Updated mlflow with using `resolve_tags` ([#6746](https://github.com/PyTorchLightning/pytorch-lightning/pull/6746))
@@ -545,20 +508,20 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Deprecated `@auto_move_data` in favor of `trainer.predict` ([#6993](https://github.com/PyTorchLightning/pytorch-lightning/pull/6993))
 - Deprecated `Callback.on_load_checkpoint(checkpoint)` in favor of `Callback.on_load_checkpoint(trainer, pl_module, checkpoint)` ([#7253](https://github.com/PyTorchLightning/pytorch-lightning/pull/7253))
 - Deprecated metrics in favor of `torchmetrics` (
-    [#6505](https://github.com/PyTorchLightning/pytorch-lightning/pull/6505),
-    [#6530](https://github.com/PyTorchLightning/pytorch-lightning/pull/6530),
-    [#6540](https://github.com/PyTorchLightning/pytorch-lightning/pull/6540),
-    [#6547](https://github.com/PyTorchLightning/pytorch-lightning/pull/6547),
-    [#6515](https://github.com/PyTorchLightning/pytorch-lightning/pull/6515),
-    [#6572](https://github.com/PyTorchLightning/pytorch-lightning/pull/6572),
-    [#6573](https://github.com/PyTorchLightning/pytorch-lightning/pull/6573),
-    [#6584](https://github.com/PyTorchLightning/pytorch-lightning/pull/6584),
-    [#6636](https://github.com/PyTorchLightning/pytorch-lightning/pull/6636),
-    [#6637](https://github.com/PyTorchLightning/pytorch-lightning/pull/6637),
-    [#6649](https://github.com/PyTorchLightning/pytorch-lightning/pull/6649),
-    [#6659](https://github.com/PyTorchLightning/pytorch-lightning/pull/6659),
-    [#7131](https://github.com/PyTorchLightning/pytorch-lightning/pull/7131),
-)
+  [#6505](https://github.com/PyTorchLightning/pytorch-lightning/pull/6505),
+  [#6530](https://github.com/PyTorchLightning/pytorch-lightning/pull/6530),
+  [#6540](https://github.com/PyTorchLightning/pytorch-lightning/pull/6540),
+  [#6547](https://github.com/PyTorchLightning/pytorch-lightning/pull/6547),
+  [#6515](https://github.com/PyTorchLightning/pytorch-lightning/pull/6515),
+  [#6572](https://github.com/PyTorchLightning/pytorch-lightning/pull/6572),
+  [#6573](https://github.com/PyTorchLightning/pytorch-lightning/pull/6573),
+  [#6584](https://github.com/PyTorchLightning/pytorch-lightning/pull/6584),
+  [#6636](https://github.com/PyTorchLightning/pytorch-lightning/pull/6636),
+  [#6637](https://github.com/PyTorchLightning/pytorch-lightning/pull/6637),
+  [#6649](https://github.com/PyTorchLightning/pytorch-lightning/pull/6649),
+  [#6659](https://github.com/PyTorchLightning/pytorch-lightning/pull/6659),
+  [#7131](https://github.com/PyTorchLightning/pytorch-lightning/pull/7131),
+  )
 - Deprecated the `LightningModule.datamodule` getter and setter methods; access them through `Trainer.datamodule` instead ([#7168](https://github.com/PyTorchLightning/pytorch-lightning/pull/7168))
 - Deprecated the use of `Trainer(gpus="i")` (string) for selecting the i-th GPU; from v1.5 this will set the number of GPUs instead of the index ([#6388](https://github.com/PyTorchLightning/pytorch-lightning/pull/6388))
 
@@ -573,8 +536,8 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Removed passing a `ModelCheckpoint` instance to `Trainer(checkpoint_callback)` ([#6166](https://github.com/PyTorchLightning/pytorch-lightning/pull/6166))
 - Removed deprecated Trainer argument `enable_pl_optimizer` and `automatic_optimization` ([#6163](https://github.com/PyTorchLightning/pytorch-lightning/pull/6163))
 - Removed deprecated metrics ([#6161](https://github.com/PyTorchLightning/pytorch-lightning/pull/6161))
-    * from `pytorch_lightning.metrics.functional.classification` removed `to_onehot`, `to_categorical`, `get_num_classes`, `roc`, `multiclass_roc`, `average_precision`, `precision_recall_curve`, `multiclass_precision_recall_curve`
-    * from `pytorch_lightning.metrics.functional.reduction` removed `reduce`, `class_reduce`
+  - from `pytorch_lightning.metrics.functional.classification` removed `to_onehot`, `to_categorical`, `get_num_classes`, `roc`, `multiclass_roc`, `average_precision`, `precision_recall_curve`, `multiclass_precision_recall_curve`
+  - from `pytorch_lightning.metrics.functional.reduction` removed `reduce`, `class_reduce`
 - Removed deprecated `ModelCheckpoint` arguments `prefix`, `mode="auto"` ([#6162](https://github.com/PyTorchLightning/pytorch-lightning/pull/6162))
 - Removed `mode='auto'` from `EarlyStopping` ([#6167](https://github.com/PyTorchLightning/pytorch-lightning/pull/6167))
 - Removed `epoch` and `step` arguments from `ModelCheckpoint.format_checkpoint_name()`, these are now included in the `metrics` argument ([#7344](https://github.com/PyTorchLightning/pytorch-lightning/pull/7344))
@@ -625,19 +588,19 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed custom init args for `WandbLogger` ([#6989](https://github.com/PyTorchLightning/pytorch-lightning/pull/6989))
 - Fixed a bug where an error would be raised if the train dataloader sometimes produced None for a batch ([#7342](https://github.com/PyTorchLightning/pytorch-lightning/pull/7342))
 - Fixed examples (
-    [#6600](https://github.com/PyTorchLightning/pytorch-lightning/pull/6600),
-    [#6638](https://github.com/PyTorchLightning/pytorch-lightning/pull/6638),
-    [#7096](https://github.com/PyTorchLightning/pytorch-lightning/pull/7096),
-    [#7246](https://github.com/PyTorchLightning/pytorch-lightning/pull/7246),
-    [#6357](https://github.com/PyTorchLightning/pytorch-lightning/pull/6357),
-    [#6476](https://github.com/PyTorchLightning/pytorch-lightning/pull/6476),
-    [#6294](https://github.com/PyTorchLightning/pytorch-lightning/pull/6294),
-    [#6373](https://github.com/PyTorchLightning/pytorch-lightning/pull/6373),
-    [#6088](https://github.com/PyTorchLightning/pytorch-lightning/pull/6088),
-    [#7398](https://github.com/PyTorchLightning/pytorch-lightning/pull/7398)
-)
+  [#6600](https://github.com/PyTorchLightning/pytorch-lightning/pull/6600),
+  [#6638](https://github.com/PyTorchLightning/pytorch-lightning/pull/6638),
+  [#7096](https://github.com/PyTorchLightning/pytorch-lightning/pull/7096),
+  [#7246](https://github.com/PyTorchLightning/pytorch-lightning/pull/7246),
+  [#6357](https://github.com/PyTorchLightning/pytorch-lightning/pull/6357),
+  [#6476](https://github.com/PyTorchLightning/pytorch-lightning/pull/6476),
+  [#6294](https://github.com/PyTorchLightning/pytorch-lightning/pull/6294),
+  [#6373](https://github.com/PyTorchLightning/pytorch-lightning/pull/6373),
+  [#6088](https://github.com/PyTorchLightning/pytorch-lightning/pull/6088),
+  [#7398](https://github.com/PyTorchLightning/pytorch-lightning/pull/7398)
+  )
 - Resolved schedule step bug for PyTorch Profiler ([#6674](https://github.com/PyTorchLightning/pytorch-lightning/pull/6674),
-    [#6681](https://github.com/PyTorchLightning/pytorch-lightning/pull/6681))
+  [#6681](https://github.com/PyTorchLightning/pytorch-lightning/pull/6681))
 - Updated logic for checking TPUs availability ([#6767](https://github.com/PyTorchLightning/pytorch-lightning/pull/6767))
 - Resolve TPU miss rendezvous ([#6781](https://github.com/PyTorchLightning/pytorch-lightning/pull/6781))
 - Fixed auto-scaling mode when calling tune method on trainer ([#7321](https://github.com/PyTorchLightning/pytorch-lightning/pull/7321))
@@ -653,11 +616,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `set_default_tensor_type` to `torch.DoubleTensor` with precision=64 ([#7108](https://github.com/PyTorchLightning/pytorch-lightning/pull/7108))
 - Fixed `NeptuneLogger.log_text(step=None)` ([#7194](https://github.com/PyTorchLightning/pytorch-lightning/pull/7194))
 - Fixed importing torchtext batch ([#6365](https://github.com/PyTorchLightning/pytorch-lightning/pull/6365),
-    [#6323](https://github.com/PyTorchLightning/pytorch-lightning/pull/6323),
-    [#6211](https://github.com/PyTorchLightning/pytorch-lightning/pull/6211))
+  [#6323](https://github.com/PyTorchLightning/pytorch-lightning/pull/6323),
+  [#6211](https://github.com/PyTorchLightning/pytorch-lightning/pull/6211))
 
-
-## [1.2.9] - 2021-04-20
+## \[1.2.9\] - 2021-04-20
 
 ### Fixed
 
@@ -665,8 +627,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed multi-gpu join for Horovod ([#6954](https://github.com/PyTorchLightning/pytorch-lightning/pull/6954))
 - Fixed parsing for pre-release package versions ([#6999](https://github.com/PyTorchLightning/pytorch-lightning/pull/6999))
 
-
-## [1.2.8] - 2021-04-14
+## \[1.2.8\] - 2021-04-14
 
 ### Added
 
@@ -687,11 +648,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed DDP_SPAWN compatibility with bug_report_model.py ([#6892](https://github.com/PyTorchLightning/pytorch-lightning/pull/6892))
 - Fixed bug where `BaseFinetuning.flatten_modules()` was duplicating leaf node parameters ([#6879](https://github.com/PyTorchLightning/pytorch-lightning/pull/6879))
 - Set better defaults for `rank_zero_only.rank` when training is launched with SLURM and torchelastic:
-    * Support SLURM and torchelastic global rank environment variables ([#5715](https://github.com/PyTorchLightning/pytorch-lightning/pull/5715))
-    * Remove hardcoding of local rank in accelerator connector ([#6878](https://github.com/PyTorchLightning/pytorch-lightning/pull/6878))
+  - Support SLURM and torchelastic global rank environment variables ([#5715](https://github.com/PyTorchLightning/pytorch-lightning/pull/5715))
+  - Remove hardcoding of local rank in accelerator connector ([#6878](https://github.com/PyTorchLightning/pytorch-lightning/pull/6878))
 
-
-## [1.2.7] - 2021-04-06
+## \[1.2.7\] - 2021-04-06
 
 ### Fixed
 
@@ -703,8 +663,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug where `TensorBoardLogger` would give a warning and not log correctly to a symbolic link `save_dir` ([#6730](https://github.com/PyTorchLightning/pytorch-lightning/pull/6730))
 - Fixed bug where `predict` could not be used when `progress_bar_refresh_rate=0` ([#6884](https://github.com/PyTorchLightning/pytorch-lightning/pull/6884))
 
-
-## [1.2.6] - 2021-03-30
+## \[1.2.6\] - 2021-03-30
 
 ### Changed
 
@@ -722,8 +681,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug where gradients were disabled after calling `Trainer.predict` ([#6657](https://github.com/PyTorchLightning/pytorch-lightning/pull/6657))
 - Fixed bug where no TPUs were detected in a TPU pod env ([#6719](https://github.com/PyTorchLightning/pytorch-lightning/pull/6719))
 
-
-## [1.2.5] - 2021-03-23
+## \[1.2.5\] - 2021-03-23
 
 ### Changed
 
@@ -737,8 +695,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed duplicate logs appearing in console when using the python logging module ([#6275](https://github.com/PyTorchLightning/pytorch-lightning/pull/6275))
 - Added Autocast in validation, test and predict modes for Native AMP ([#6565](https://github.com/PyTorchLightning/pytorch-lightning/pull/6565))
 
-
-## [1.2.4] - 2021-03-16
+## \[1.2.4\] - 2021-03-16
 
 ### Changed
 
@@ -756,8 +713,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed an exception in the layer summary when the model contains torch.jit scripted submodules ([#6511](https://github.com/PyTorchLightning/pytorch-lightning/pull/6511))
 - Fixed when Train loop config was run during `Trainer.predict` ([#6541](https://github.com/PyTorchLightning/pytorch-lightning/pull/6541))
 
-
-## [1.2.3] - 2021-03-09
+## \[1.2.3\] - 2021-03-09
 
 ### Fixed
 
@@ -773,8 +729,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Ensure that clip gradients is only called if the value is greater than 0 ([#6330](https://github.com/PyTorchLightning/pytorch-lightning/pull/6330)
 - Fixed `Trainer` not resetting `lightning_optimizers` when calling `Trainer.fit()` multiple times ([#6372](https://github.com/PyTorchLightning/pytorch-lightning/pull/6372))
 
-
-## [1.2.2] - 2021-03-02
+## \[1.2.2\] - 2021-03-02
 
 ### Added
 
@@ -794,8 +749,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Prevent `WandbLogger` from dropping values ([#5931](https://github.com/PyTorchLightning/pytorch-lightning/pull/5931))
 - Fixed error thrown when using valid distributed mode in multi node ([#6297](https://github.com/PyTorchLightning/pytorch-lightning/pull/6297)
 
-
-## [1.2.1] - 2021-02-23
+## \[1.2.1\] - 2021-02-23
 
 ### Fixed
 
@@ -804,8 +758,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed error message for AMP + CPU incompatibility ([#6107](https://github.com/PyTorchLightning/pytorch-lightning/pull/6107))
 - Disabled batch transfer in DP mode ([#6093](https://github.com/PyTorchLightning/pytorch-lightning/pull/6093))
 
-
-## [1.2.0] - 2021-02-18
+## \[1.2.0\] - 2021-02-18
 
 ### Added
 
@@ -829,8 +782,8 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added missing val/test hooks in `LightningModule` ([#5467](https://github.com/PyTorchLightning/pytorch-lightning/pull/5467))
 - The `Recall` and `Precision` metrics (and their functional counterparts `recall` and `precision`) can now be generalized to Recall@K and Precision@K with the use of `top_k` parameter ([#4842](https://github.com/PyTorchLightning/pytorch-lightning/pull/4842))
 - Added `ModelPruning` Callback ([#5618](https://github.com/PyTorchLightning/pytorch-lightning/pull/5618),
-    [#5825](https://github.com/PyTorchLightning/pytorch-lightning/pull/5825),
-    [#6045](https://github.com/PyTorchLightning/pytorch-lightning/pull/6045))
+  [#5825](https://github.com/PyTorchLightning/pytorch-lightning/pull/5825),
+  [#6045](https://github.com/PyTorchLightning/pytorch-lightning/pull/6045))
 - Added `PyTorchProfiler` ([#5560](https://github.com/PyTorchLightning/pytorch-lightning/pull/5560))
 - Added compositional metrics ([#5464](https://github.com/PyTorchLightning/pytorch-lightning/pull/5464))
 - Added Trainer method `predict(...)` for high performence predictions ([#5579](https://github.com/PyTorchLightning/pytorch-lightning/pull/5579))
@@ -838,7 +791,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added AUC/AUROC class interface ([#5479](https://github.com/PyTorchLightning/pytorch-lightning/pull/5479))
 - Added `PredictLoop` object ([#5752](https://github.com/PyTorchLightning/pytorch-lightning/pull/5752))
 - Added `QuantizationAwareTraining` callback ([#5706](https://github.com/PyTorchLightning/pytorch-lightning/pull/5706),
-    [#6040](https://github.com/PyTorchLightning/pytorch-lightning/pull/6040))
+  [#6040](https://github.com/PyTorchLightning/pytorch-lightning/pull/6040))
 - Added `LightningModule.configure_callbacks` to enable the definition of model-specific callbacks ([#5621](https://github.com/PyTorchLightning/pytorch-lightning/pull/5621))
 - Added `dim` to `PSNR` metric for mean-squared-error reduction ([#5957](https://github.com/PyTorchLightning/pytorch-lightning/pull/5957))
 - Added promxial policy optimization template to pl_examples ([#5394](https://github.com/PyTorchLightning/pytorch-lightning/pull/5394))
@@ -850,14 +803,14 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added `PL_TORCH_DISTRIBUTED_BACKEND` env variable to select backend ([#5981](https://github.com/PyTorchLightning/pytorch-lightning/pull/5981))
 - Added `Trainer` flag to activate Stochastic Weight Averaging (SWA) `Trainer(stochastic_weight_avg=True)` ([#6038](https://github.com/PyTorchLightning/pytorch-lightning/pull/6038))
 - Added DeepSpeed integration ([#5954](https://github.com/PyTorchLightning/pytorch-lightning/pull/5954),
-    [#6042](https://github.com/PyTorchLightning/pytorch-lightning/pull/6042))
+  [#6042](https://github.com/PyTorchLightning/pytorch-lightning/pull/6042))
 
 ### Changed
 
 - Changed `stat_scores` metric now calculates stat scores over all classes and gains new parameters, in line with the new `StatScores` metric ([#4839](https://github.com/PyTorchLightning/pytorch-lightning/pull/4839))
 - Changed `computer_vision_fine_tunning` example to use `BackboneLambdaFinetuningCallback` ([#5377](https://github.com/PyTorchLightning/pytorch-lightning/pull/5377))
 - Changed `automatic casting` for LoggerConnector `metrics` ([#5218](https://github.com/PyTorchLightning/pytorch-lightning/pull/5218))
-- Changed `iou` [func] to allow float input ([#4704](https://github.com/PyTorchLightning/pytorch-lightning/pull/4704))
+- Changed `iou` \[func\] to allow float input ([#4704](https://github.com/PyTorchLightning/pytorch-lightning/pull/4704))
 - Metric `compute()` method will no longer automatically call `reset()` ([#5409](https://github.com/PyTorchLightning/pytorch-lightning/pull/5409))
 - Set PyTorch 1.4 as min requirements, also for testing and examples `torchvision>=0.5` and `torchtext>=0.5` ([#5418](https://github.com/PyTorchLightning/pytorch-lightning/pull/5418))
 - Changed `callbacks` argument in `Trainer` to allow `Callback` input ([#5446](https://github.com/PyTorchLightning/pytorch-lightning/pull/5446))
@@ -869,24 +822,24 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Made `LightningModule.global_rank`, `LightningModule.local_rank` and `LightningModule.logger` read-only properties ([#5730](https://github.com/PyTorchLightning/pytorch-lightning/pull/5730))
 - Forced `ModelCheckpoint` callbacks to run after all others to guarantee all states are saved to the checkpoint ([#5731](https://github.com/PyTorchLightning/pytorch-lightning/pull/5731))
 - Refactored Accelerators and Plugins:
-    * Added base classes for plugins ([#5715](https://github.com/PyTorchLightning/pytorch-lightning/pull/5715))
-    * Added parallel plugins for DP, DDP, DDPSpawn, DDP2 and Horovod ([#5714](https://github.com/PyTorchLightning/pytorch-lightning/pull/5714))
-    * Precision Plugins ([#5718](https://github.com/PyTorchLightning/pytorch-lightning/pull/5718))
-    * Added new Accelerators for CPU, GPU and TPU ([#5719](https://github.com/PyTorchLightning/pytorch-lightning/pull/5719))
-    * Added RPC and Sharded plugins ([#5732](https://github.com/PyTorchLightning/pytorch-lightning/pull/5732))
-    * Added missing `LightningModule`-wrapper logic to new plugins and accelerator ([#5734](https://github.com/PyTorchLightning/pytorch-lightning/pull/5734))
-    * Moved device-specific teardown logic from training loop to accelerator ([#5973](https://github.com/PyTorchLightning/pytorch-lightning/pull/5973))
-    * Moved accelerator_connector.py to the connectors subfolder ([#6033](https://github.com/PyTorchLightning/pytorch-lightning/pull/6033))
-    * Trainer only references accelerator ([#6039](https://github.com/PyTorchLightning/pytorch-lightning/pull/6039))
-    * Made parallel devices optional across all plugins ([#6051](https://github.com/PyTorchLightning/pytorch-lightning/pull/6051))
-    * Cleaning ([#5948](https://github.com/PyTorchLightning/pytorch-lightning/pull/5948),
-        [#5949](https://github.com/PyTorchLightning/pytorch-lightning/pull/5949),
-        [#5950](https://github.com/PyTorchLightning/pytorch-lightning/pull/5950))
+  - Added base classes for plugins ([#5715](https://github.com/PyTorchLightning/pytorch-lightning/pull/5715))
+  - Added parallel plugins for DP, DDP, DDPSpawn, DDP2 and Horovod ([#5714](https://github.com/PyTorchLightning/pytorch-lightning/pull/5714))
+  - Precision Plugins ([#5718](https://github.com/PyTorchLightning/pytorch-lightning/pull/5718))
+  - Added new Accelerators for CPU, GPU and TPU ([#5719](https://github.com/PyTorchLightning/pytorch-lightning/pull/5719))
+  - Added RPC and Sharded plugins ([#5732](https://github.com/PyTorchLightning/pytorch-lightning/pull/5732))
+  - Added missing `LightningModule`-wrapper logic to new plugins and accelerator ([#5734](https://github.com/PyTorchLightning/pytorch-lightning/pull/5734))
+  - Moved device-specific teardown logic from training loop to accelerator ([#5973](https://github.com/PyTorchLightning/pytorch-lightning/pull/5973))
+  - Moved accelerator_connector.py to the connectors subfolder ([#6033](https://github.com/PyTorchLightning/pytorch-lightning/pull/6033))
+  - Trainer only references accelerator ([#6039](https://github.com/PyTorchLightning/pytorch-lightning/pull/6039))
+  - Made parallel devices optional across all plugins ([#6051](https://github.com/PyTorchLightning/pytorch-lightning/pull/6051))
+  - Cleaning ([#5948](https://github.com/PyTorchLightning/pytorch-lightning/pull/5948),
+    [#5949](https://github.com/PyTorchLightning/pytorch-lightning/pull/5949),
+    [#5950](https://github.com/PyTorchLightning/pytorch-lightning/pull/5950))
 - Enabled `self.log` in callbacks ([#5094](https://github.com/PyTorchLightning/pytorch-lightning/pull/5094))
 - Renamed xxx_AVAILABLE as protected ([#5082](https://github.com/PyTorchLightning/pytorch-lightning/pull/5082))
 - Unified module names in Utils ([#5199](https://github.com/PyTorchLightning/pytorch-lightning/pull/5199))
 - Separated utils: imports & enums ([#5256](https://github.com/PyTorchLightning/pytorch-lightning/pull/5256)
-    [#5874](https://github.com/PyTorchLightning/pytorch-lightning/pull/5874))
+  [#5874](https://github.com/PyTorchLightning/pytorch-lightning/pull/5874))
 - Refactor: clean trainer device & distributed getters ([#5300](https://github.com/PyTorchLightning/pytorch-lightning/pull/5300))
 - Simplified training phase as LightningEnum ([#5419](https://github.com/PyTorchLightning/pytorch-lightning/pull/5419))
 - Updated metrics to use LightningEnum ([#5689](https://github.com/PyTorchLightning/pytorch-lightning/pull/5689))
@@ -906,10 +859,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Deprecated `LightningDistributedDataParallel` in favor of new wrapper module `LightningDistributedModule` ([#5185](https://github.com/PyTorchLightning/pytorch-lightning/pull/5185))
 - Deprecated `LightningDataParallel` in favor of new wrapper module `LightningParallelModule` ([#5670](https://github.com/PyTorchLightning/pytorch-lightning/pull/5670))
 - Renamed utils modules ([#5199](https://github.com/PyTorchLightning/pytorch-lightning/pull/5199))
-    * `argparse_utils` >> `argparse`
-    * `model_utils` >> `model_helpers`
-    * `warning_utils` >> `warnings`
-    * `xla_device_utils` >> `xla_device`
+  - `argparse_utils` >> `argparse`
+  - `model_utils` >> `model_helpers`
+  - `warning_utils` >> `warnings`
+  - `xla_device_utils` >> `xla_device`
 - Deprecated using `'val_loss'` to set the `ModelCheckpoint` monitor ([#6012](https://github.com/PyTorchLightning/pytorch-lightning/pull/6012))
 - Deprecated `.get_model()` with explicit `.lightning_module` property ([#6035](https://github.com/PyTorchLightning/pytorch-lightning/pull/6035))
 - Deprecated Trainer attribute `accelerator_backend` in favor of `accelerator` ([#6034](https://github.com/PyTorchLightning/pytorch-lightning/pull/6034))
@@ -943,23 +896,21 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed synchronization issues with TPU training ([#6027](https://github.com/PyTorchLightning/pytorch-lightning/pull/6027))
 - Fixed `hparams.yaml` saved twice when using `TensorBoardLogger` ([#5953](https://github.com/PyTorchLightning/pytorch-lightning/pull/5953))
 - Fixed basic examples ([#5912](https://github.com/PyTorchLightning/pytorch-lightning/pull/5912),
-    [#5985](https://github.com/PyTorchLightning/pytorch-lightning/pull/5985))
+  [#5985](https://github.com/PyTorchLightning/pytorch-lightning/pull/5985))
 - Fixed `fairscale` compatible with PT 1.8 ([#5996](https://github.com/PyTorchLightning/pytorch-lightning/pull/5996))
 - Ensured `process_dataloader` is called when `tpu_cores > 1` to use Parallel DataLoader ([#6015](https://github.com/PyTorchLightning/pytorch-lightning/pull/6015))
 - Attempted SLURM auto resume call when non-shell call fails ([#6002](https://github.com/PyTorchLightning/pytorch-lightning/pull/6002))
 - Fixed wrapping optimizers upon assignment ([#6006](https://github.com/PyTorchLightning/pytorch-lightning/pull/6006))
 - Fixed allowing hashing of metrics with lists in their state ([#5939](https://github.com/PyTorchLightning/pytorch-lightning/pull/5939))
 
-
-## [1.1.8] - 2021-02-08
+## \[1.1.8\] - 2021-02-08
 
 ### Fixed
 
 - Separate epoch validation from step validation ([#5208](https://github.com/PyTorchLightning/pytorch-lightning/pull/5208))
 - Fixed `toggle_optimizers` not handling all optimizer parameters ([#5775](https://github.com/PyTorchLightning/pytorch-lightning/pull/5775))
 
-
-## [1.1.7] - 2021-02-03
+## \[1.1.7\] - 2021-02-03
 
 ### Fixed
 
@@ -971,8 +922,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Remove unnecessary intermediate layers in Dockerfiles ([#5697](https://github.com/PyTorchLightning/pytorch-lightning/pull/5697))
 - Fixed auto learning rate ordering ([#5638](https://github.com/PyTorchLightning/pytorch-lightning/pull/5638))
 
-
-## [1.1.6] - 2021-01-26
+## \[1.1.6\] - 2021-01-26
 
 ### Changed
 
@@ -991,8 +941,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed tensor printing in `trainer.test()` ([#5138](https://github.com/PyTorchLightning/pytorch-lightning/pull/5138))
 - Fixed not using dataloader when `hparams` present ([#4559](https://github.com/PyTorchLightning/pytorch-lightning/pull/4559))
 
-
-## [1.1.5] - 2021-01-19
+## \[1.1.5\] - 2021-01-19
 
 ### Fixed
 
@@ -1001,8 +950,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `reinit_scheduler_properties` with correct optimizer ([#5519](https://github.com/PyTorchLightning/pytorch-lightning/pull/5519))
 - Fixed `val_check_interval` with `fast_dev_run` ([#5540](https://github.com/PyTorchLightning/pytorch-lightning/pull/5540))
 
-
-## [1.1.4] - 2021-01-12
+## \[1.1.4\] - 2021-01-12
 
 ### Added
 
@@ -1020,7 +968,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Check environ before selecting a seed to prevent warning message ([#4743](https://github.com/PyTorchLightning/pytorch-lightning/pull/4743))
 - Fixed signature mismatch in `model_to_device` of `DDPCPUHPCAccelerator` ([#5505](https://github.com/PyTorchLightning/pytorch-lightning/pull/5505))
 
-## [1.1.3] - 2021-01-05
+## \[1.1.3\] - 2021-01-05
 
 ### Added
 
@@ -1045,8 +993,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `LightningOptimizer` AMP bug ([#5191](https://github.com/PyTorchLightning/pytorch-lightning/pull/5191))
 - Fixed casted key to string in `_flatten_dict` ([#5354](https://github.com/PyTorchLightning/pytorch-lightning/pull/5354))
 
-
-## [1.1.2] - 2020-12-23
+## \[1.1.2\] - 2020-12-23
 
 ### Added
 
@@ -1067,8 +1014,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Updated `DALIClassificationLoader` to not use deprecated arguments ([#4925](https://github.com/PyTorchLightning/pytorch-lightning/pull/4925))
 - Corrected call to `torch.no_grad` ([#5124](https://github.com/PyTorchLightning/pytorch-lightning/pull/5124))
 
-
-## [1.1.1] - 2020-12-15
+## \[1.1.1\] - 2020-12-15
 
 ### Added
 
@@ -1092,13 +1038,12 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Do not warn when the `name` key is used in the `lr_scheduler` dict ([#5057](https://github.com/PyTorchLightning/pytorch-lightning/pull/5057))
 - Check if optimizer supports closure ([#4981](https://github.com/PyTorchLightning/pytorch-lightning/pull/4981))
 - Add deprecated metric utility functions back to functional (
-    [#5067](https://github.com/PyTorchLightning/pytorch-lightning/pull/5067),
-    [#5068](https://github.com/PyTorchLightning/pytorch-lightning/pull/5068))
+  [#5067](https://github.com/PyTorchLightning/pytorch-lightning/pull/5067),
+  [#5068](https://github.com/PyTorchLightning/pytorch-lightning/pull/5068))
 - Allow any input in `to_onnx` and `to_torchscript` ([#4378](https://github.com/PyTorchLightning/pytorch-lightning/pull/4378))
 - Fixed `DDPHPCAccelerator` hangs in DDP construction by calling `init_device` ([#5157](https://github.com/PyTorchLightning/pytorch-lightning/pull/5157))
 
-
-## [1.1.0] - 2020-12-09
+## \[1.1.0\] - 2020-12-09
 
 ### Added
 
@@ -1110,11 +1055,11 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added option to log momentum ([#4384](https://github.com/PyTorchLightning/pytorch-lightning/pull/4384))
 - Added `current_score` to `ModelCheckpoint.on_save_checkpoint` ([#4721](https://github.com/PyTorchLightning/pytorch-lightning/pull/4721))
 - Added logging using `self.log` in train and evaluation for epoch end hooks (
-    [#4552](https://github.com/PyTorchLightning/pytorch-lightning/pull/4552),
-    [#4495](https://github.com/PyTorchLightning/pytorch-lightning/pull/4495),
-    [#4439](https://github.com/PyTorchLightning/pytorch-lightning/pull/4439),
-    [#4684](https://github.com/PyTorchLightning/pytorch-lightning/pull/4684),
-    [#4913](https://github.com/PyTorchLightning/pytorch-lightning/pull/4913))
+  [#4552](https://github.com/PyTorchLightning/pytorch-lightning/pull/4552),
+  [#4495](https://github.com/PyTorchLightning/pytorch-lightning/pull/4495),
+  [#4439](https://github.com/PyTorchLightning/pytorch-lightning/pull/4439),
+  [#4684](https://github.com/PyTorchLightning/pytorch-lightning/pull/4684),
+  [#4913](https://github.com/PyTorchLightning/pytorch-lightning/pull/4913))
 - Added ability for DDP plugin to modify optimizer state saving ([#4675](https://github.com/PyTorchLightning/pytorch-lightning/pull/4675))
 - Added `prefix` argument in loggers ([#4557](https://github.com/PyTorchLightning/pytorch-lightning/pull/4557))
 - Added printing of total num of params, trainable and non-trainable params in ModelSummary ([#4521](https://github.com/PyTorchLightning/pytorch-lightning/pull/4521))
@@ -1122,17 +1067,16 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added custom `Apex` and `NativeAMP` as `Precision plugins` ([#4355](https://github.com/PyTorchLightning/pytorch-lightning/pull/4355))
 - Added `DALI MNIST` example ([#3721](https://github.com/PyTorchLightning/pytorch-lightning/pull/3721))
 - Added `sharded plugin` for DDP for multi-gpu training memory optimizations (
-    [#4639](https://github.com/PyTorchLightning/pytorch-lightning/pull/4639),
-    [#4686](https://github.com/PyTorchLightning/pytorch-lightning/pull/4686),
-    [#4737](https://github.com/PyTorchLightning/pytorch-lightning/pull/4737),
-    [#4773](https://github.com/PyTorchLightning/pytorch-lightning/pull/4773))
+  [#4639](https://github.com/PyTorchLightning/pytorch-lightning/pull/4639),
+  [#4686](https://github.com/PyTorchLightning/pytorch-lightning/pull/4686),
+  [#4737](https://github.com/PyTorchLightning/pytorch-lightning/pull/4737),
+  [#4773](https://github.com/PyTorchLightning/pytorch-lightning/pull/4773))
 - Added `experiment_id` to the NeptuneLogger ([#3462](https://github.com/PyTorchLightning/pytorch-lightning/pull/3462))
 - Added `Pytorch Geometric` integration example with Lightning ([#4568](https://github.com/PyTorchLightning/pytorch-lightning/pull/4568))
 - Added `all_gather` method to `LightningModule` which allows gradient based tensor synchronizations for use-cases such as negative sampling. ([#5012](https://github.com/PyTorchLightning/pytorch-lightning/pull/5012))
 - Enabled `self.log` in most functions ([#4969](https://github.com/PyTorchLightning/pytorch-lightning/pull/4969))
 - Added changeable extension variable for `ModelCheckpoint` ([#4977](https://github.com/PyTorchLightning/pytorch-lightning/pull/4977))
 
-
 ### Changed
 
 - Tuner algorithms will be skipped if `fast_dev_run=True` ([#3903](https://github.com/PyTorchLightning/pytorch-lightning/pull/3903))
@@ -1144,7 +1088,6 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Updated `fast_dev_run` to accept integer representing num_batches ([#4629](https://github.com/PyTorchLightning/pytorch-lightning/pull/4629))
 - Refactored optimizer ([#4658](https://github.com/PyTorchLightning/pytorch-lightning/pull/4658))
 
-
 ### Deprecated
 
 - Deprecated `prefix` argument in `ModelCheckpoint` ([#4765](https://github.com/PyTorchLightning/pytorch-lightning/pull/4765))
@@ -1165,8 +1108,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed allowing logger to support indexing ([#4595](https://github.com/PyTorchLightning/pytorch-lightning/pull/4595))
 - Fixed DDP and manual_optimization ([#4976](https://github.com/PyTorchLightning/pytorch-lightning/pull/4976))
 
-
-## [1.0.8] - 2020-11-24
+## \[1.0.8\] - 2020-11-24
 
 ### Added
 
@@ -1183,7 +1125,6 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Do not override `PYTHONWARNINGS` ([#4700](https://github.com/PyTorchLightning/pytorch-lightning/pull/4700))
 - Changed `init_ddp_connection` moved from `DDP` to `DDPPlugin` ([#4407](https://github.com/PyTorchLightning/pytorch-lightning/pull/4407))
 
-
 ### Fixed
 
 - Fixed checkpoint `hparams` dict casting when `omegaconf` is available ([#4770](https://github.com/PyTorchLightning/pytorch-lightning/pull/4770))
@@ -1193,7 +1134,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `torchtext` data to GPU ([#4785](https://github.com/PyTorchLightning/pytorch-lightning/pull/4785))
 - Fixed a crash bug in MLFlow logger ([#4716](https://github.com/PyTorchLightning/pytorch-lightning/pull/4716))
 
-## [1.0.7] - 2020-11-17
+## \[1.0.7\] - 2020-11-17
 
 ### Added
 
@@ -1204,7 +1145,6 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Change Metrics `persistent` default mode to `False` ([#4685](https://github.com/PyTorchLightning/pytorch-lightning/pull/4685))
 - LoggerConnector log_metrics will use `total_batch_idx` instead of `global_step` when logging on `training step` ([#4738](https://github.com/PyTorchLightning/pytorch-lightning/pull/4738))
 
-
 ### Fixed
 
 - Prevent crash if `sync_dist=True` on CPU ([#4626](https://github.com/PyTorchLightning/pytorch-lightning/pull/4626))
@@ -1213,8 +1153,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Allowing decorate model init with saving `hparams` inside ([#4662](https://github.com/PyTorchLightning/pytorch-lightning/pull/4662))
 - Fixed `split_idx` set by `LoggerConnector` in `on_trainer_init` to `Trainer`  ([#4697](https://github.com/PyTorchLightning/pytorch-lightning/pull/4697))
 
-
-## [1.0.6] - 2020-11-11
+## \[1.0.6\] - 2020-11-11
 
 ### Added
 
@@ -1224,15 +1163,14 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added congratulations at the end of our notebooks ([#4555](https://github.com/PyTorchLightning/pytorch-lightning/pull/4555))
 - Added parameters `move_metrics_to_cpu` in Trainer to disable gpu leak ([#4592](https://github.com/PyTorchLightning/pytorch-lightning/pull/4592))
 
-
 ### Changed
 
 - Changed `fsspec` to tuner ([#4458](https://github.com/PyTorchLightning/pytorch-lightning/pull/4458))
 - Unify SLURM/TorchElastic under backend plugin ([#4578](https://github.com/PyTorchLightning/pytorch-lightning/pull/4578),
-        [#4580](https://github.com/PyTorchLightning/pytorch-lightning/pull/4580),
-        [#4581](https://github.com/PyTorchLightning/pytorch-lightning/pull/4581),
-        [#4582](https://github.com/PyTorchLightning/pytorch-lightning/pull/4582),
-        [#4583](https://github.com/PyTorchLightning/pytorch-lightning/pull/4583))
+  [#4580](https://github.com/PyTorchLightning/pytorch-lightning/pull/4580),
+  [#4581](https://github.com/PyTorchLightning/pytorch-lightning/pull/4581),
+  [#4582](https://github.com/PyTorchLightning/pytorch-lightning/pull/4582),
+  [#4583](https://github.com/PyTorchLightning/pytorch-lightning/pull/4583))
 
 ### Fixed
 
@@ -1246,7 +1184,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed multi test dataloaders dict `AttributeError` error ([#4480](https://github.com/PyTorchLightning/pytorch-lightning/pull/4480))
 - Fixed show progress bar only for `progress_rank 0` on `DDP_SLURM` ([#4437](https://github.com/PyTorchLightning/pytorch-lightning/pull/4437))
 
-## [1.0.5] - 2020-11-03
+## \[1.0.5\] - 2020-11-03
 
 ### Added
 
@@ -1276,11 +1214,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed TorchScript trace method's data to device and docstring ([#4360](https://github.com/PyTorchLightning/pytorch-lightning/pull/4360))
 - Fixed CSV logger warning ([#4419](https://github.com/PyTorchLightning/pytorch-lightning/pull/4419))
 - Fixed skip DDP parameter sync ([#4301](https://github.com/PyTorchLightning/pytorch-lightning/pull/4301))
-- Fixed `WandbLogger` _sanitize_callable function ([#4422](https://github.com/PyTorchLightning/pytorch-lightning/pull/4422))
+- Fixed `WandbLogger` \_sanitize_callable function ([#4422](https://github.com/PyTorchLightning/pytorch-lightning/pull/4422))
 - Fixed `AMP Native` `_unscale` gradient ([#4441](https://github.com/PyTorchLightning/pytorch-lightning/pull/4441))
 
-
-## [1.0.4] - 2020-10-27
+## \[1.0.4\] - 2020-10-27
 
 ### Added
 
@@ -1317,7 +1254,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `ModelCheckpoint` don't increase current_epoch and global_step when not training ([#4291](https://github.com/PyTorchLightning/pytorch-lightning/pull/4291))
 - Fixed `COMET_EXPERIMENT_KEY` environment variable usage in comet logger ([#4230](https://github.com/PyTorchLightning/pytorch-lightning/pull/4230))
 
-## [1.0.3] - 2020-10-20
+## \[1.0.3\] - 2020-10-20
 
 ### Added
 
@@ -1333,8 +1270,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed `hparams` assign in init ([#4189](https://github.com/PyTorchLightning/pytorch-lightning/pull/4189))
 - Fixed overwrite check for model hooks ([#4010](https://github.com/PyTorchLightning/pytorch-lightning/pull/4010))
 
-
-## [1.0.2] - 2020-10-15
+## \[1.0.2\] - 2020-10-15
 
 ### Added
 
@@ -1351,23 +1287,21 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 ### Fixed
 
 - Fixed the `self.log` problem in `validation_step()` ([#4169](https://github.com/PyTorchLightning/pytorch-lightning/pull/4169))
-- Fixed `hparams` saving - save the state when `save_hyperparameters()` is called [in `__init__`] ([#4163](https://github.com/PyTorchLightning/pytorch-lightning/pull/4163))
+- Fixed `hparams` saving - save the state when `save_hyperparameters()` is called \[in `__init__`\] ([#4163](https://github.com/PyTorchLightning/pytorch-lightning/pull/4163))
 - Fixed runtime failure while exporting `hparams` to yaml ([#4158](https://github.com/PyTorchLightning/pytorch-lightning/pull/4158))
 
-
-## [1.0.1] - 2020-10-14
+## \[1.0.1\] - 2020-10-14
 
 ### Added
 
 - Added getstate/setstate method for torch.save serialization ([#4127](https://github.com/PyTorchLightning/pytorch-lightning/pull/4127))
 
-
-## [1.0.0] - 2020-10-13
+## \[1.0.0\] - 2020-10-13
 
 ### Added
 
 - Added Explained Variance Metric + metric fix ([#4013](https://github.com/PyTorchLightning/pytorch-lightning/pull/4013))
-- Added Metric <-> Lightning Module integration tests ([#4008](https://github.com/PyTorchLightning/pytorch-lightning/pull/4008))
+- Added Metric \<-> Lightning Module integration tests ([#4008](https://github.com/PyTorchLightning/pytorch-lightning/pull/4008))
 - Added parsing OS env vars in `Trainer` ([#4022](https://github.com/PyTorchLightning/pytorch-lightning/pull/4022))
 - Added classification metrics ([#4043](https://github.com/PyTorchLightning/pytorch-lightning/pull/4043))
 - Updated explained variance metric ([#4024](https://github.com/PyTorchLightning/pytorch-lightning/pull/4024))
@@ -1377,23 +1311,23 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added `LightningModule.toggle_optimizer` ([#4058](https://github.com/PyTorchLightning/pytorch-lightning/pull/4058))
 - Added `LightningModule.manual_backward` ([#4063](https://github.com/PyTorchLightning/pytorch-lightning/pull/4063))
 - Added `output` argument to `*_batch_end` hooks ([#3965](https://github.com/PyTorchLightning/pytorch-lightning/pull/3965),
-    [#3966](https://github.com/PyTorchLightning/pytorch-lightning/pull/3966))
+  [#3966](https://github.com/PyTorchLightning/pytorch-lightning/pull/3966))
 - Added `output` argument to `*_epoch_end` hooks ([#3967](https://github.com/PyTorchLightning/pytorch-lightning/pull/3967))
 
 ### Changed
 
 - Integrated metrics API with self.log ([#3961](https://github.com/PyTorchLightning/pytorch-lightning/pull/3961))
 - Decoupled Apex ([#4052](https://github.com/PyTorchLightning/pytorch-lightning/pull/4052),
-        [#4054](https://github.com/PyTorchLightning/pytorch-lightning/pull/4054),
-        [#4055](https://github.com/PyTorchLightning/pytorch-lightning/pull/4055),
-        [#4056](https://github.com/PyTorchLightning/pytorch-lightning/pull/4056),
-        [#4058](https://github.com/PyTorchLightning/pytorch-lightning/pull/4058),
-        [#4060](https://github.com/PyTorchLightning/pytorch-lightning/pull/4060),
-        [#4061](https://github.com/PyTorchLightning/pytorch-lightning/pull/4061),
-        [#4062](https://github.com/PyTorchLightning/pytorch-lightning/pull/4062),
-        [#4063](https://github.com/PyTorchLightning/pytorch-lightning/pull/4063),
-        [#4064](https://github.com/PyTorchLightning/pytorch-lightning/pull/4064),
-        [#4065](https://github.com/PyTorchLightning/pytorch-lightning/pull/4065))
+  [#4054](https://github.com/PyTorchLightning/pytorch-lightning/pull/4054),
+  [#4055](https://github.com/PyTorchLightning/pytorch-lightning/pull/4055),
+  [#4056](https://github.com/PyTorchLightning/pytorch-lightning/pull/4056),
+  [#4058](https://github.com/PyTorchLightning/pytorch-lightning/pull/4058),
+  [#4060](https://github.com/PyTorchLightning/pytorch-lightning/pull/4060),
+  [#4061](https://github.com/PyTorchLightning/pytorch-lightning/pull/4061),
+  [#4062](https://github.com/PyTorchLightning/pytorch-lightning/pull/4062),
+  [#4063](https://github.com/PyTorchLightning/pytorch-lightning/pull/4063),
+  [#4064](https://github.com/PyTorchLightning/pytorch-lightning/pull/4064),
+  [#4065](https://github.com/PyTorchLightning/pytorch-lightning/pull/4065))
 - Renamed all backends to `Accelerator` ([#4066](https://github.com/PyTorchLightning/pytorch-lightning/pull/4066))
 - Enabled manual returns ([#4089](https://github.com/PyTorchLightning/pytorch-lightning/pull/4089))
 
@@ -1412,8 +1346,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed to print scaler value in progress bar ([#4053](https://github.com/PyTorchLightning/pytorch-lightning/pull/4053))
 - Fixed mismatch between docstring and code regarding when `on_load_checkpoint` hook is called ([#3996](https://github.com/PyTorchLightning/pytorch-lightning/pull/3996))
 
-
-## [0.10.0] - 2020-10-07
+## \[0.10.0\] - 2020-10-07
 
 ### Added
 
@@ -1435,137 +1368,137 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 ### Changed
 
 - Refactored accelerator backends:
-   * moved TPU `xxx_step` to backend ([#3118](https://github.com/PyTorchLightning/pytorch-lightning/pull/3118))
-   * refactored DDP backend `forward` ([#3119](https://github.com/PyTorchLightning/pytorch-lightning/pull/3119))
-   * refactored GPU backend `__step` ([#3120](https://github.com/PyTorchLightning/pytorch-lightning/pull/3120))
-   * refactored Horovod backend ([#3121](https://github.com/PyTorchLightning/pytorch-lightning/pull/3121),
-        [#3122](https://github.com/PyTorchLightning/pytorch-lightning/pull/3122))
-   * remove obscure forward call in eval + CPU backend `___step` ([#3123](https://github.com/PyTorchLightning/pytorch-lightning/pull/3123))
-   * reduced all simplified forward ([#3126](https://github.com/PyTorchLightning/pytorch-lightning/pull/3126))
-   * added hook base method ([#3127](https://github.com/PyTorchLightning/pytorch-lightning/pull/3127))
-   * refactor eval loop to use hooks - use `test_mode` for if so we can split later ([#3129](https://github.com/PyTorchLightning/pytorch-lightning/pull/3129))
-   * moved `___step_end` hooks ([#3130](https://github.com/PyTorchLightning/pytorch-lightning/pull/3130))
-   * training forward refactor ([#3134](https://github.com/PyTorchLightning/pytorch-lightning/pull/3134))
-   * training AMP scaling refactor ([#3135](https://github.com/PyTorchLightning/pytorch-lightning/pull/3135))
-   * eval step scaling factor ([#3136](https://github.com/PyTorchLightning/pytorch-lightning/pull/3136))
-   * add eval loop object to streamline eval loop ([#3138](https://github.com/PyTorchLightning/pytorch-lightning/pull/3138))
-   * refactored dataloader process hook ([#3139](https://github.com/PyTorchLightning/pytorch-lightning/pull/3139))
-   * refactored inner eval loop ([#3141](https://github.com/PyTorchLightning/pytorch-lightning/pull/3141))
-   * final inner eval loop hooks ([#3154](https://github.com/PyTorchLightning/pytorch-lightning/pull/3154))
-   * clean up hooks in `run_evaluation` ([#3156](https://github.com/PyTorchLightning/pytorch-lightning/pull/3156))
-   * clean up data reset ([#3161](https://github.com/PyTorchLightning/pytorch-lightning/pull/3161))
-   * expand eval loop out ([#3165](https://github.com/PyTorchLightning/pytorch-lightning/pull/3165))
-   * moved hooks around in eval loop ([#3195](https://github.com/PyTorchLightning/pytorch-lightning/pull/3195))
-   * remove `_evaluate` fx ([#3197](https://github.com/PyTorchLightning/pytorch-lightning/pull/3197))
-   * `Trainer.fit` hook clean up ([#3198](https://github.com/PyTorchLightning/pytorch-lightning/pull/3198))
-   * DDPs train hooks ([#3203](https://github.com/PyTorchLightning/pytorch-lightning/pull/3203))
-   * refactor DDP backend ([#3204](https://github.com/PyTorchLightning/pytorch-lightning/pull/3204),
-        [#3207](https://github.com/PyTorchLightning/pytorch-lightning/pull/3207),
-        [#3208](https://github.com/PyTorchLightning/pytorch-lightning/pull/3208),
-        [#3209](https://github.com/PyTorchLightning/pytorch-lightning/pull/3209),
-        [#3210](https://github.com/PyTorchLightning/pytorch-lightning/pull/3210))
-   * reduced accelerator selection ([#3211](https://github.com/PyTorchLightning/pytorch-lightning/pull/3211))
-   * group prepare data hook ([#3212](https://github.com/PyTorchLightning/pytorch-lightning/pull/3212))
-   * added data connector ([#3285](https://github.com/PyTorchLightning/pytorch-lightning/pull/3285))
-   * modular is_overridden ([#3290](https://github.com/PyTorchLightning/pytorch-lightning/pull/3290))
-   * adding `Trainer.tune()` ([#3293](https://github.com/PyTorchLightning/pytorch-lightning/pull/3293))
-   * move `run_pretrain_routine` -> `setup_training` ([#3294](https://github.com/PyTorchLightning/pytorch-lightning/pull/3294))
-   * move train outside of setup training ([#3297](https://github.com/PyTorchLightning/pytorch-lightning/pull/3297))
-   * move `prepare_data` to data connector ([#3307](https://github.com/PyTorchLightning/pytorch-lightning/pull/3307))
-   * moved accelerator router ([#3309](https://github.com/PyTorchLightning/pytorch-lightning/pull/3309))
-   * train loop refactor - moving train loop to own object ([#3310](https://github.com/PyTorchLightning/pytorch-lightning/pull/3310),
-        [#3312](https://github.com/PyTorchLightning/pytorch-lightning/pull/3312),
-        [#3313](https://github.com/PyTorchLightning/pytorch-lightning/pull/3313),
-        [#3314](https://github.com/PyTorchLightning/pytorch-lightning/pull/3314))
-   * duplicate data interface definition up into DataHooks class ([#3344](https://github.com/PyTorchLightning/pytorch-lightning/pull/3344))
-   * inner train loop ([#3359](https://github.com/PyTorchLightning/pytorch-lightning/pull/3359),
-        [#3361](https://github.com/PyTorchLightning/pytorch-lightning/pull/3361),
-        [#3362](https://github.com/PyTorchLightning/pytorch-lightning/pull/3362),
-        [#3363](https://github.com/PyTorchLightning/pytorch-lightning/pull/3363),
-        [#3365](https://github.com/PyTorchLightning/pytorch-lightning/pull/3365),
-        [#3366](https://github.com/PyTorchLightning/pytorch-lightning/pull/3366),
-        [#3367](https://github.com/PyTorchLightning/pytorch-lightning/pull/3367),
-        [#3368](https://github.com/PyTorchLightning/pytorch-lightning/pull/3368),
-        [#3369](https://github.com/PyTorchLightning/pytorch-lightning/pull/3369),
-        [#3370](https://github.com/PyTorchLightning/pytorch-lightning/pull/3370),
-        [#3371](https://github.com/PyTorchLightning/pytorch-lightning/pull/3371),
-        [#3372](https://github.com/PyTorchLightning/pytorch-lightning/pull/3372),
-        [#3373](https://github.com/PyTorchLightning/pytorch-lightning/pull/3373),
-        [#3374](https://github.com/PyTorchLightning/pytorch-lightning/pull/3374),
-        [#3375](https://github.com/PyTorchLightning/pytorch-lightning/pull/3375),
-        [#3376](https://github.com/PyTorchLightning/pytorch-lightning/pull/3376),
-        [#3385](https://github.com/PyTorchLightning/pytorch-lightning/pull/3385),
-        [#3388](https://github.com/PyTorchLightning/pytorch-lightning/pull/3388),
-        [#3397](https://github.com/PyTorchLightning/pytorch-lightning/pull/3397))
-   * all logging related calls in a connector ([#3395](https://github.com/PyTorchLightning/pytorch-lightning/pull/3395))
-   * device parser ([#3400](https://github.com/PyTorchLightning/pytorch-lightning/pull/3400),
-        [#3405](https://github.com/PyTorchLightning/pytorch-lightning/pull/3405))
-   * added model connector ([#3407](https://github.com/PyTorchLightning/pytorch-lightning/pull/3407))
-   * moved eval loop logging to loggers ([#3408](https://github.com/PyTorchLightning/pytorch-lightning/pull/3408))
-   * moved eval loop (#3412[#3408](https://github.com/PyTorchLightning/pytorch-lightning/pull/3408))
-   * trainer/separate argparse ([#3421](https://github.com/PyTorchLightning/pytorch-lightning/pull/3421),
-        [#3428](https://github.com/PyTorchLightning/pytorch-lightning/pull/3428),
-        [#3432](https://github.com/PyTorchLightning/pytorch-lightning/pull/3432))
-   * move `lr_finder` ([#3434](https://github.com/PyTorchLightning/pytorch-lightning/pull/3434))
-   * organize args (#[#3435](https://github.com/PyTorchLightning/pytorch-lightning/pull/3435),
-        [#3442](https://github.com/PyTorchLightning/pytorch-lightning/pull/3442),
-        [#3447](https://github.com/PyTorchLightning/pytorch-lightning/pull/3447),
-        [#3448](https://github.com/PyTorchLightning/pytorch-lightning/pull/3448),
-        [#3449](https://github.com/PyTorchLightning/pytorch-lightning/pull/3449),
-        [#3456](https://github.com/PyTorchLightning/pytorch-lightning/pull/3456))
-   * move specific accelerator code ([#3457](https://github.com/PyTorchLightning/pytorch-lightning/pull/3457))
-   * group connectors ([#3472](https://github.com/PyTorchLightning/pytorch-lightning/pull/3472))
-   * accelerator connector methods x/n ([#3469](https://github.com/PyTorchLightning/pytorch-lightning/pull/3469),
-        [#3470](https://github.com/PyTorchLightning/pytorch-lightning/pull/3470),
-        [#3474](https://github.com/PyTorchLightning/pytorch-lightning/pull/3474))
-   * merge backends x/n ([#3476](https://github.com/PyTorchLightning/pytorch-lightning/pull/3476),
-        [#3477](https://github.com/PyTorchLightning/pytorch-lightning/pull/3477),
-        [#3478](https://github.com/PyTorchLightning/pytorch-lightning/pull/3478),
-        [#3480](https://github.com/PyTorchLightning/pytorch-lightning/pull/3480),
-        [#3482](https://github.com/PyTorchLightning/pytorch-lightning/pull/3482))
-   * apex plugin ([#3502](https://github.com/PyTorchLightning/pytorch-lightning/pull/3502))
-   * precision plugins ([#3504](https://github.com/PyTorchLightning/pytorch-lightning/pull/3504))
-   * Result - make monitor default to `checkpoint_on` to simplify ([#3571](https://github.com/PyTorchLightning/pytorch-lightning/pull/3571))
-   * reference to the Trainer on the `LightningDataModule` ([#3684](https://github.com/PyTorchLightning/pytorch-lightning/pull/3684))
-   * add `.log` to lightning module ([#3686](https://github.com/PyTorchLightning/pytorch-lightning/pull/3686),
-        [#3699](https://github.com/PyTorchLightning/pytorch-lightning/pull/3699),
-        [#3701](https://github.com/PyTorchLightning/pytorch-lightning/pull/3701),
-        [#3704](https://github.com/PyTorchLightning/pytorch-lightning/pull/3704),
-        [#3715](https://github.com/PyTorchLightning/pytorch-lightning/pull/3715))
-   * enable tracking original metric when step and epoch are both true ([#3685](https://github.com/PyTorchLightning/pytorch-lightning/pull/3685))
-   * deprecated results obj, added support for simpler comms ([#3681](https://github.com/PyTorchLightning/pytorch-lightning/pull/3681))
-   * move backends back to individual files ([#3712](https://github.com/PyTorchLightning/pytorch-lightning/pull/3712))
-   * fixes logging for eval steps ([#3763](https://github.com/PyTorchLightning/pytorch-lightning/pull/3763))
-   * decoupled DDP, DDP spawn ([#3733](https://github.com/PyTorchLightning/pytorch-lightning/pull/3733),
-        [#3766](https://github.com/PyTorchLightning/pytorch-lightning/pull/3766),
-        [#3767](https://github.com/PyTorchLightning/pytorch-lightning/pull/3767),
-        [#3774](https://github.com/PyTorchLightning/pytorch-lightning/pull/3774),
-        [#3802](https://github.com/PyTorchLightning/pytorch-lightning/pull/3802),
-        [#3806](https://github.com/PyTorchLightning/pytorch-lightning/pull/3806),
-        [#3817](https://github.com/PyTorchLightning/pytorch-lightning/pull/3817),
-        [#3819](https://github.com/PyTorchLightning/pytorch-lightning/pull/3819),
-        [#3927](https://github.com/PyTorchLightning/pytorch-lightning/pull/3927))
-   * remove weight loading hack for ddp_cpu ([#3808](https://github.com/PyTorchLightning/pytorch-lightning/pull/3808))
-   * separate `torchelastic` from DDP ([#3810](https://github.com/PyTorchLightning/pytorch-lightning/pull/3810))
-   * separate SLURM from DDP ([#3809](https://github.com/PyTorchLightning/pytorch-lightning/pull/3809))
-   * decoupled DDP2 ([#3816](https://github.com/PyTorchLightning/pytorch-lightning/pull/3816))
-   * bug fix with logging val epoch end + monitor ([#3812](https://github.com/PyTorchLightning/pytorch-lightning/pull/3812))
-   * callback system and init DDP ([#3836](https://github.com/PyTorchLightning/pytorch-lightning/pull/3836))
-   * adding compute environments ([#3837](https://github.com/PyTorchLightning/pytorch-lightning/pull/3837), [#3842](https://github.com/PyTorchLightning/pytorch-lightning/pull/3842))
-   * epoch can now log independently ([#3843](https://github.com/PyTorchLightning/pytorch-lightning/pull/3843))
-   * test selecting the correct backend. temp backends while slurm and TorchElastic are decoupled ([#3848](https://github.com/PyTorchLightning/pytorch-lightning/pull/3848))
-   * fixed `init_slurm_connection` causing hostname errors ([#3856](https://github.com/PyTorchLightning/pytorch-lightning/pull/3856))
-   * moves init apex from LM to apex connector ([#3923](https://github.com/PyTorchLightning/pytorch-lightning/pull/3923))
-   * moves sync bn to each backend ([#3925](https://github.com/PyTorchLightning/pytorch-lightning/pull/3925))
-   * moves configure ddp to each backend ([#3924](https://github.com/PyTorchLightning/pytorch-lightning/pull/3924))
+  - moved TPU `xxx_step` to backend ([#3118](https://github.com/PyTorchLightning/pytorch-lightning/pull/3118))
+  - refactored DDP backend `forward` ([#3119](https://github.com/PyTorchLightning/pytorch-lightning/pull/3119))
+  - refactored GPU backend `__step` ([#3120](https://github.com/PyTorchLightning/pytorch-lightning/pull/3120))
+  - refactored Horovod backend ([#3121](https://github.com/PyTorchLightning/pytorch-lightning/pull/3121),
+    [#3122](https://github.com/PyTorchLightning/pytorch-lightning/pull/3122))
+  - remove obscure forward call in eval + CPU backend `___step` ([#3123](https://github.com/PyTorchLightning/pytorch-lightning/pull/3123))
+  - reduced all simplified forward ([#3126](https://github.com/PyTorchLightning/pytorch-lightning/pull/3126))
+  - added hook base method ([#3127](https://github.com/PyTorchLightning/pytorch-lightning/pull/3127))
+  - refactor eval loop to use hooks - use `test_mode` for if so we can split later ([#3129](https://github.com/PyTorchLightning/pytorch-lightning/pull/3129))
+  - moved `___step_end` hooks ([#3130](https://github.com/PyTorchLightning/pytorch-lightning/pull/3130))
+  - training forward refactor ([#3134](https://github.com/PyTorchLightning/pytorch-lightning/pull/3134))
+  - training AMP scaling refactor ([#3135](https://github.com/PyTorchLightning/pytorch-lightning/pull/3135))
+  - eval step scaling factor ([#3136](https://github.com/PyTorchLightning/pytorch-lightning/pull/3136))
+  - add eval loop object to streamline eval loop ([#3138](https://github.com/PyTorchLightning/pytorch-lightning/pull/3138))
+  - refactored dataloader process hook ([#3139](https://github.com/PyTorchLightning/pytorch-lightning/pull/3139))
+  - refactored inner eval loop ([#3141](https://github.com/PyTorchLightning/pytorch-lightning/pull/3141))
+  - final inner eval loop hooks ([#3154](https://github.com/PyTorchLightning/pytorch-lightning/pull/3154))
+  - clean up hooks in `run_evaluation` ([#3156](https://github.com/PyTorchLightning/pytorch-lightning/pull/3156))
+  - clean up data reset ([#3161](https://github.com/PyTorchLightning/pytorch-lightning/pull/3161))
+  - expand eval loop out ([#3165](https://github.com/PyTorchLightning/pytorch-lightning/pull/3165))
+  - moved hooks around in eval loop ([#3195](https://github.com/PyTorchLightning/pytorch-lightning/pull/3195))
+  - remove `_evaluate` fx ([#3197](https://github.com/PyTorchLightning/pytorch-lightning/pull/3197))
+  - `Trainer.fit` hook clean up ([#3198](https://github.com/PyTorchLightning/pytorch-lightning/pull/3198))
+  - DDPs train hooks ([#3203](https://github.com/PyTorchLightning/pytorch-lightning/pull/3203))
+  - refactor DDP backend ([#3204](https://github.com/PyTorchLightning/pytorch-lightning/pull/3204),
+    [#3207](https://github.com/PyTorchLightning/pytorch-lightning/pull/3207),
+    [#3208](https://github.com/PyTorchLightning/pytorch-lightning/pull/3208),
+    [#3209](https://github.com/PyTorchLightning/pytorch-lightning/pull/3209),
+    [#3210](https://github.com/PyTorchLightning/pytorch-lightning/pull/3210))
+  - reduced accelerator selection ([#3211](https://github.com/PyTorchLightning/pytorch-lightning/pull/3211))
+  - group prepare data hook ([#3212](https://github.com/PyTorchLightning/pytorch-lightning/pull/3212))
+  - added data connector ([#3285](https://github.com/PyTorchLightning/pytorch-lightning/pull/3285))
+  - modular is_overridden ([#3290](https://github.com/PyTorchLightning/pytorch-lightning/pull/3290))
+  - adding `Trainer.tune()` ([#3293](https://github.com/PyTorchLightning/pytorch-lightning/pull/3293))
+  - move `run_pretrain_routine` -> `setup_training` ([#3294](https://github.com/PyTorchLightning/pytorch-lightning/pull/3294))
+  - move train outside of setup training ([#3297](https://github.com/PyTorchLightning/pytorch-lightning/pull/3297))
+  - move `prepare_data` to data connector ([#3307](https://github.com/PyTorchLightning/pytorch-lightning/pull/3307))
+  - moved accelerator router ([#3309](https://github.com/PyTorchLightning/pytorch-lightning/pull/3309))
+  - train loop refactor - moving train loop to own object ([#3310](https://github.com/PyTorchLightning/pytorch-lightning/pull/3310),
+    [#3312](https://github.com/PyTorchLightning/pytorch-lightning/pull/3312),
+    [#3313](https://github.com/PyTorchLightning/pytorch-lightning/pull/3313),
+    [#3314](https://github.com/PyTorchLightning/pytorch-lightning/pull/3314))
+  - duplicate data interface definition up into DataHooks class ([#3344](https://github.com/PyTorchLightning/pytorch-lightning/pull/3344))
+  - inner train loop ([#3359](https://github.com/PyTorchLightning/pytorch-lightning/pull/3359),
+    [#3361](https://github.com/PyTorchLightning/pytorch-lightning/pull/3361),
+    [#3362](https://github.com/PyTorchLightning/pytorch-lightning/pull/3362),
+    [#3363](https://github.com/PyTorchLightning/pytorch-lightning/pull/3363),
+    [#3365](https://github.com/PyTorchLightning/pytorch-lightning/pull/3365),
+    [#3366](https://github.com/PyTorchLightning/pytorch-lightning/pull/3366),
+    [#3367](https://github.com/PyTorchLightning/pytorch-lightning/pull/3367),
+    [#3368](https://github.com/PyTorchLightning/pytorch-lightning/pull/3368),
+    [#3369](https://github.com/PyTorchLightning/pytorch-lightning/pull/3369),
+    [#3370](https://github.com/PyTorchLightning/pytorch-lightning/pull/3370),
+    [#3371](https://github.com/PyTorchLightning/pytorch-lightning/pull/3371),
+    [#3372](https://github.com/PyTorchLightning/pytorch-lightning/pull/3372),
+    [#3373](https://github.com/PyTorchLightning/pytorch-lightning/pull/3373),
+    [#3374](https://github.com/PyTorchLightning/pytorch-lightning/pull/3374),
+    [#3375](https://github.com/PyTorchLightning/pytorch-lightning/pull/3375),
+    [#3376](https://github.com/PyTorchLightning/pytorch-lightning/pull/3376),
+    [#3385](https://github.com/PyTorchLightning/pytorch-lightning/pull/3385),
+    [#3388](https://github.com/PyTorchLightning/pytorch-lightning/pull/3388),
+    [#3397](https://github.com/PyTorchLightning/pytorch-lightning/pull/3397))
+  - all logging related calls in a connector ([#3395](https://github.com/PyTorchLightning/pytorch-lightning/pull/3395))
+  - device parser ([#3400](https://github.com/PyTorchLightning/pytorch-lightning/pull/3400),
+    [#3405](https://github.com/PyTorchLightning/pytorch-lightning/pull/3405))
+  - added model connector ([#3407](https://github.com/PyTorchLightning/pytorch-lightning/pull/3407))
+  - moved eval loop logging to loggers ([#3408](https://github.com/PyTorchLightning/pytorch-lightning/pull/3408))
+  - moved eval loop (#3412[#3408](https://github.com/PyTorchLightning/pytorch-lightning/pull/3408))
+  - trainer/separate argparse ([#3421](https://github.com/PyTorchLightning/pytorch-lightning/pull/3421),
+    [#3428](https://github.com/PyTorchLightning/pytorch-lightning/pull/3428),
+    [#3432](https://github.com/PyTorchLightning/pytorch-lightning/pull/3432))
+  - move `lr_finder` ([#3434](https://github.com/PyTorchLightning/pytorch-lightning/pull/3434))
+  - organize args (#[#3435](https://github.com/PyTorchLightning/pytorch-lightning/pull/3435),
+    [#3442](https://github.com/PyTorchLightning/pytorch-lightning/pull/3442),
+    [#3447](https://github.com/PyTorchLightning/pytorch-lightning/pull/3447),
+    [#3448](https://github.com/PyTorchLightning/pytorch-lightning/pull/3448),
+    [#3449](https://github.com/PyTorchLightning/pytorch-lightning/pull/3449),
+    [#3456](https://github.com/PyTorchLightning/pytorch-lightning/pull/3456))
+  - move specific accelerator code ([#3457](https://github.com/PyTorchLightning/pytorch-lightning/pull/3457))
+  - group connectors ([#3472](https://github.com/PyTorchLightning/pytorch-lightning/pull/3472))
+  - accelerator connector methods x/n ([#3469](https://github.com/PyTorchLightning/pytorch-lightning/pull/3469),
+    [#3470](https://github.com/PyTorchLightning/pytorch-lightning/pull/3470),
+    [#3474](https://github.com/PyTorchLightning/pytorch-lightning/pull/3474))
+  - merge backends x/n ([#3476](https://github.com/PyTorchLightning/pytorch-lightning/pull/3476),
+    [#3477](https://github.com/PyTorchLightning/pytorch-lightning/pull/3477),
+    [#3478](https://github.com/PyTorchLightning/pytorch-lightning/pull/3478),
+    [#3480](https://github.com/PyTorchLightning/pytorch-lightning/pull/3480),
+    [#3482](https://github.com/PyTorchLightning/pytorch-lightning/pull/3482))
+  - apex plugin ([#3502](https://github.com/PyTorchLightning/pytorch-lightning/pull/3502))
+  - precision plugins ([#3504](https://github.com/PyTorchLightning/pytorch-lightning/pull/3504))
+  - Result - make monitor default to `checkpoint_on` to simplify ([#3571](https://github.com/PyTorchLightning/pytorch-lightning/pull/3571))
+  - reference to the Trainer on the `LightningDataModule` ([#3684](https://github.com/PyTorchLightning/pytorch-lightning/pull/3684))
+  - add `.log` to lightning module ([#3686](https://github.com/PyTorchLightning/pytorch-lightning/pull/3686),
+    [#3699](https://github.com/PyTorchLightning/pytorch-lightning/pull/3699),
+    [#3701](https://github.com/PyTorchLightning/pytorch-lightning/pull/3701),
+    [#3704](https://github.com/PyTorchLightning/pytorch-lightning/pull/3704),
+    [#3715](https://github.com/PyTorchLightning/pytorch-lightning/pull/3715))
+  - enable tracking original metric when step and epoch are both true ([#3685](https://github.com/PyTorchLightning/pytorch-lightning/pull/3685))
+  - deprecated results obj, added support for simpler comms ([#3681](https://github.com/PyTorchLightning/pytorch-lightning/pull/3681))
+  - move backends back to individual files ([#3712](https://github.com/PyTorchLightning/pytorch-lightning/pull/3712))
+  - fixes logging for eval steps ([#3763](https://github.com/PyTorchLightning/pytorch-lightning/pull/3763))
+  - decoupled DDP, DDP spawn ([#3733](https://github.com/PyTorchLightning/pytorch-lightning/pull/3733),
+    [#3766](https://github.com/PyTorchLightning/pytorch-lightning/pull/3766),
+    [#3767](https://github.com/PyTorchLightning/pytorch-lightning/pull/3767),
+    [#3774](https://github.com/PyTorchLightning/pytorch-lightning/pull/3774),
+    [#3802](https://github.com/PyTorchLightning/pytorch-lightning/pull/3802),
+    [#3806](https://github.com/PyTorchLightning/pytorch-lightning/pull/3806),
+    [#3817](https://github.com/PyTorchLightning/pytorch-lightning/pull/3817),
+    [#3819](https://github.com/PyTorchLightning/pytorch-lightning/pull/3819),
+    [#3927](https://github.com/PyTorchLightning/pytorch-lightning/pull/3927))
+  - remove weight loading hack for ddp_cpu ([#3808](https://github.com/PyTorchLightning/pytorch-lightning/pull/3808))
+  - separate `torchelastic` from DDP ([#3810](https://github.com/PyTorchLightning/pytorch-lightning/pull/3810))
+  - separate SLURM from DDP ([#3809](https://github.com/PyTorchLightning/pytorch-lightning/pull/3809))
+  - decoupled DDP2 ([#3816](https://github.com/PyTorchLightning/pytorch-lightning/pull/3816))
+  - bug fix with logging val epoch end + monitor ([#3812](https://github.com/PyTorchLightning/pytorch-lightning/pull/3812))
+  - callback system and init DDP ([#3836](https://github.com/PyTorchLightning/pytorch-lightning/pull/3836))
+  - adding compute environments ([#3837](https://github.com/PyTorchLightning/pytorch-lightning/pull/3837), [#3842](https://github.com/PyTorchLightning/pytorch-lightning/pull/3842))
+  - epoch can now log independently ([#3843](https://github.com/PyTorchLightning/pytorch-lightning/pull/3843))
+  - test selecting the correct backend. temp backends while slurm and TorchElastic are decoupled ([#3848](https://github.com/PyTorchLightning/pytorch-lightning/pull/3848))
+  - fixed `init_slurm_connection` causing hostname errors ([#3856](https://github.com/PyTorchLightning/pytorch-lightning/pull/3856))
+  - moves init apex from LM to apex connector ([#3923](https://github.com/PyTorchLightning/pytorch-lightning/pull/3923))
+  - moves sync bn to each backend ([#3925](https://github.com/PyTorchLightning/pytorch-lightning/pull/3925))
+  - moves configure ddp to each backend ([#3924](https://github.com/PyTorchLightning/pytorch-lightning/pull/3924))
 - Deprecation warning ([#3844](https://github.com/PyTorchLightning/pytorch-lightning/pull/3844))
 - Changed `LearningRateLogger` to `LearningRateMonitor` ([#3251](https://github.com/PyTorchLightning/pytorch-lightning/pull/3251))
 - Used `fsspec` instead of `gfile` for all IO ([#3320](https://github.com/PyTorchLightning/pytorch-lightning/pull/3320))
-    * Swaped `torch.load` for `fsspec` load in DDP spawn backend ([#3787](https://github.com/PyTorchLightning/pytorch-lightning/pull/3787))
-    * Swaped `torch.load` for `fsspec` load in cloud_io loading ([#3692](https://github.com/PyTorchLightning/pytorch-lightning/pull/3692))
-    * Added support for `to_disk()` to use remote filepaths with `fsspec` ([#3930](https://github.com/PyTorchLightning/pytorch-lightning/pull/3930))
-    * Updated model_checkpoint's to_yaml to use `fsspec` open ([#3801](https://github.com/PyTorchLightning/pytorch-lightning/pull/3801))
-    * Fixed `fsspec` is inconsistent when doing `fs.ls` ([#3805](https://github.com/PyTorchLightning/pytorch-lightning/pull/3805))
+  - Swaped `torch.load` for `fsspec` load in DDP spawn backend ([#3787](https://github.com/PyTorchLightning/pytorch-lightning/pull/3787))
+  - Swaped `torch.load` for `fsspec` load in cloud_io loading ([#3692](https://github.com/PyTorchLightning/pytorch-lightning/pull/3692))
+  - Added support for `to_disk()` to use remote filepaths with `fsspec` ([#3930](https://github.com/PyTorchLightning/pytorch-lightning/pull/3930))
+  - Updated model_checkpoint's to_yaml to use `fsspec` open ([#3801](https://github.com/PyTorchLightning/pytorch-lightning/pull/3801))
+  - Fixed `fsspec` is inconsistent when doing `fs.ls` ([#3805](https://github.com/PyTorchLightning/pytorch-lightning/pull/3805))
 - Refactor `GPUStatsMonitor` to improve training speed ([#3257](https://github.com/PyTorchLightning/pytorch-lightning/pull/3257))
 - Changed IoU score behavior for classes absent in target and pred ([#3098](https://github.com/PyTorchLightning/pytorch-lightning/pull/3098))
 - Changed IoU `remove_bg` bool to `ignore_index` optional int ([#3098](https://github.com/PyTorchLightning/pytorch-lightning/pull/3098))
@@ -1577,15 +1510,15 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Enable `None` model checkpoint default ([#3669](https://github.com/PyTorchLightning/pytorch-lightning/pull/3669))
 - Skipped `best_model_path` if `checkpoint_callback` is `None` ([#2962](https://github.com/PyTorchLightning/pytorch-lightning/pull/2962))
 - Used `raise .. from ..` to explicitly chain exceptions ([#3750](https://github.com/PyTorchLightning/pytorch-lightning/pull/3750))
--  Mocking loggers ([#3596](https://github.com/PyTorchLightning/pytorch-lightning/pull/3596),
-    [#3617](https://github.com/PyTorchLightning/pytorch-lightning/pull/3617),
-    [#3851](https://github.com/PyTorchLightning/pytorch-lightning/pull/3851),
-    [#3859](https://github.com/PyTorchLightning/pytorch-lightning/pull/3859),
-    [#3884](https://github.com/PyTorchLightning/pytorch-lightning/pull/3884),
-    [#3853](https://github.com/PyTorchLightning/pytorch-lightning/pull/3853),
-    [#3910](https://github.com/PyTorchLightning/pytorch-lightning/pull/3910),
-    [#3889](https://github.com/PyTorchLightning/pytorch-lightning/pull/3889),
-    [#3926](https://github.com/PyTorchLightning/pytorch-lightning/pull/3926))
+- Mocking loggers ([#3596](https://github.com/PyTorchLightning/pytorch-lightning/pull/3596),
+  [#3617](https://github.com/PyTorchLightning/pytorch-lightning/pull/3617),
+  [#3851](https://github.com/PyTorchLightning/pytorch-lightning/pull/3851),
+  [#3859](https://github.com/PyTorchLightning/pytorch-lightning/pull/3859),
+  [#3884](https://github.com/PyTorchLightning/pytorch-lightning/pull/3884),
+  [#3853](https://github.com/PyTorchLightning/pytorch-lightning/pull/3853),
+  [#3910](https://github.com/PyTorchLightning/pytorch-lightning/pull/3910),
+  [#3889](https://github.com/PyTorchLightning/pytorch-lightning/pull/3889),
+  [#3926](https://github.com/PyTorchLightning/pytorch-lightning/pull/3926))
 - Write predictions in LightningModule instead of EvalResult [#3882](https://github.com/PyTorchLightning/pytorch-lightning/pull/3882)
 
 ### Deprecated
@@ -1597,19 +1530,19 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 ### Removed
 
 - Removed experimental Metric API ([#3943](https://github.com/PyTorchLightning/pytorch-lightning/pull/3943),
-        [#3949](https://github.com/PyTorchLightning/pytorch-lightning/pull/3949),
-        [#3946](https://github.com/PyTorchLightning/pytorch-lightning/pull/3946)), listed changes before final removal:
-    * Added `EmbeddingSimilarity` metric ([#3349](https://github.com/PyTorchLightning/pytorch-lightning/pull/3349), [#3358](https://github.com/PyTorchLightning/pytorch-lightning/pull/3358))
-    * Added hooks to metric module interface ([#2528](https://github.com/PyTorchLightning/pytorch-lightning/pull/2528))
-    * Added error when AUROC metric is used for multiclass problems ([#3350](https://github.com/PyTorchLightning/pytorch-lightning/pull/3350))
-    * Fixed `ModelCheckpoint` with `save_top_k=-1` option not tracking the best models when a monitor metric is available ([#3735](https://github.com/PyTorchLightning/pytorch-lightning/pull/3735))
-    * Fixed counter-intuitive error being thrown in `Accuracy` metric for zero target tensor ([#3764](https://github.com/PyTorchLightning/pytorch-lightning/pull/3764))
-    * Fixed aggregation of metrics ([#3517](https://github.com/PyTorchLightning/pytorch-lightning/pull/3517))
-    * Fixed Metric aggregation ([#3321](https://github.com/PyTorchLightning/pytorch-lightning/pull/3321))
-    * Fixed RMSLE metric ([#3188](https://github.com/PyTorchLightning/pytorch-lightning/pull/3188))
-    * Renamed `reduction` to `class_reduction` in classification metrics ([#3322](https://github.com/PyTorchLightning/pytorch-lightning/pull/3322))
-    * Changed `class_reduction` similar to sklearn for classification metrics ([#3322](https://github.com/PyTorchLightning/pytorch-lightning/pull/3322))
-    * Renaming of precision recall metric ([#3308](https://github.com/PyTorchLightning/pytorch-lightning/pull/3308))
+  [#3949](https://github.com/PyTorchLightning/pytorch-lightning/pull/3949),
+  [#3946](https://github.com/PyTorchLightning/pytorch-lightning/pull/3946)), listed changes before final removal:
+  - Added `EmbeddingSimilarity` metric ([#3349](https://github.com/PyTorchLightning/pytorch-lightning/pull/3349), [#3358](https://github.com/PyTorchLightning/pytorch-lightning/pull/3358))
+  - Added hooks to metric module interface ([#2528](https://github.com/PyTorchLightning/pytorch-lightning/pull/2528))
+  - Added error when AUROC metric is used for multiclass problems ([#3350](https://github.com/PyTorchLightning/pytorch-lightning/pull/3350))
+  - Fixed `ModelCheckpoint` with `save_top_k=-1` option not tracking the best models when a monitor metric is available ([#3735](https://github.com/PyTorchLightning/pytorch-lightning/pull/3735))
+  - Fixed counter-intuitive error being thrown in `Accuracy` metric for zero target tensor ([#3764](https://github.com/PyTorchLightning/pytorch-lightning/pull/3764))
+  - Fixed aggregation of metrics ([#3517](https://github.com/PyTorchLightning/pytorch-lightning/pull/3517))
+  - Fixed Metric aggregation ([#3321](https://github.com/PyTorchLightning/pytorch-lightning/pull/3321))
+  - Fixed RMSLE metric ([#3188](https://github.com/PyTorchLightning/pytorch-lightning/pull/3188))
+  - Renamed `reduction` to `class_reduction` in classification metrics ([#3322](https://github.com/PyTorchLightning/pytorch-lightning/pull/3322))
+  - Changed `class_reduction` similar to sklearn for classification metrics ([#3322](https://github.com/PyTorchLightning/pytorch-lightning/pull/3322))
+  - Renaming of precision recall metric ([#3308](https://github.com/PyTorchLightning/pytorch-lightning/pull/3308))
 
 ### Fixed
 
@@ -1653,23 +1586,23 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixes incorrect `batch_sizes` when Dataloader returns a dict with multiple tensors ([#3668](https://github.com/PyTorchLightning/pytorch-lightning/pull/3668))
 - Fixed unexpected signature for `validation_step` ([#3947](https://github.com/PyTorchLightning/pytorch-lightning/pull/3947))
 
-## [0.9.0] - 2020-08-20
+## \[0.9.0\] - 2020-08-20
 
 ### Added
 
 - Added SyncBN for DDP ([#2801](https://github.com/PyTorchLightning/pytorch-lightning/pull/2801),
-     [#2838](https://github.com/PyTorchLightning/pytorch-lightning/pull/2838))
+  [#2838](https://github.com/PyTorchLightning/pytorch-lightning/pull/2838))
 - Added basic `CSVLogger` ([#2721](https://github.com/PyTorchLightning/pytorch-lightning/pull/2721))
 - Added SSIM metrics ([#2671](https://github.com/PyTorchLightning/pytorch-lightning/pull/2671))
 - Added BLEU metrics ([#2535](https://github.com/PyTorchLightning/pytorch-lightning/pull/2535))
 - Added support to export a model to ONNX format ([#2596](https://github.com/PyTorchLightning/pytorch-lightning/pull/2596))
 - Added support for `Trainer(num_sanity_val_steps=-1)` to check all validation data before training ([#2246](https://github.com/PyTorchLightning/pytorch-lightning/pull/2246))
 - Added struct. output:
-  * tests for val loop flow ([#2605](https://github.com/PyTorchLightning/pytorch-lightning/pull/2605))
-  * `EvalResult` support for train and val. loop ([#2615](https://github.com/PyTorchLightning/pytorch-lightning/pull/2615),
-       [#2651](https://github.com/PyTorchLightning/pytorch-lightning/pull/2651))
-  * weighted average in results obj ([#2930](https://github.com/PyTorchLightning/pytorch-lightning/pull/2930))
-  * fix result obj DP auto reduce ([#3013](https://github.com/PyTorchLightning/pytorch-lightning/pull/3013))
+  - tests for val loop flow ([#2605](https://github.com/PyTorchLightning/pytorch-lightning/pull/2605))
+  - `EvalResult` support for train and val. loop ([#2615](https://github.com/PyTorchLightning/pytorch-lightning/pull/2615),
+    [#2651](https://github.com/PyTorchLightning/pytorch-lightning/pull/2651))
+  - weighted average in results obj ([#2930](https://github.com/PyTorchLightning/pytorch-lightning/pull/2930))
+  - fix result obj DP auto reduce ([#3013](https://github.com/PyTorchLightning/pytorch-lightning/pull/3013))
 - Added class `LightningDataModule` ([#2668](https://github.com/PyTorchLightning/pytorch-lightning/pull/2668))
 - Added support for PyTorch 1.6 ([#2745](https://github.com/PyTorchLightning/pytorch-lightning/pull/2745))
 - Added call DataModule hooks implicitly in trainer ([#2755](https://github.com/PyTorchLightning/pytorch-lightning/pull/2755))
@@ -1692,10 +1625,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Truncated long version numbers in progress bar ([#2594](https://github.com/PyTorchLightning/pytorch-lightning/pull/2594))
 - Enabling val/test loop disabling ([#2692](https://github.com/PyTorchLightning/pytorch-lightning/pull/2692))
 - Refactored into `accelerator` module:
-    * GPU training ([#2704](https://github.com/PyTorchLightning/pytorch-lightning/pull/2704))
-    * TPU training ([#2708](https://github.com/PyTorchLightning/pytorch-lightning/pull/2708))
-    * DDP(2) backend ([#2796](https://github.com/PyTorchLightning/pytorch-lightning/pull/2796))
-    * Retrieve last logged val from result by key ([#3049](https://github.com/PyTorchLightning/pytorch-lightning/pull/3049))
+  - GPU training ([#2704](https://github.com/PyTorchLightning/pytorch-lightning/pull/2704))
+  - TPU training ([#2708](https://github.com/PyTorchLightning/pytorch-lightning/pull/2708))
+  - DDP(2) backend ([#2796](https://github.com/PyTorchLightning/pytorch-lightning/pull/2796))
+  - Retrieve last logged val from result by key ([#3049](https://github.com/PyTorchLightning/pytorch-lightning/pull/3049))
 - Using `.comet.config` file for `CometLogger` ([#1913](https://github.com/PyTorchLightning/pytorch-lightning/pull/1913))
 - Updated hooks arguments - breaking for `setup` and `teardown` ([#2850](https://github.com/PyTorchLightning/pytorch-lightning/pull/2850))
 - Using `gfile` to support remote directories ([#2164](https://github.com/PyTorchLightning/pytorch-lightning/pull/2164))
@@ -1712,11 +1645,11 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 ### Removed
 
 - Removed deprecated: ([#2760](https://github.com/PyTorchLightning/pytorch-lightning/pull/2760))
-    * core decorator `data_loader`
-    * Module hook `on_sanity_check_start` and loading `load_from_metrics`
-    * package `pytorch_lightning.logging`
-    * Trainer arguments: `show_progress_bar`, `num_tpu_cores`, `use_amp`, `print_nan_grads`
-    * LR Finder argument `num_accumulation_steps`
+  - core decorator `data_loader`
+  - Module hook `on_sanity_check_start` and loading `load_from_metrics`
+  - package `pytorch_lightning.logging`
+  - Trainer arguments: `show_progress_bar`, `num_tpu_cores`, `use_amp`, `print_nan_grads`
+  - LR Finder argument `num_accumulation_steps`
 
 ### Fixed
 
@@ -1754,7 +1687,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed automatic batch scaling not working with half precision ([#3045](https://github.com/PyTorchLightning/pytorch-lightning/pull/3045))
 - Fixed setting device to root gpu ([#3042](https://github.com/PyTorchLightning/pytorch-lightning/pull/3042))
 
-## [0.8.5] - 2020-07-09
+## \[0.8.5\] - 2020-07-09
 
 ### Added
 
@@ -1780,9 +1713,9 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed Trainer `.fit()` returning last not best weights in "ddp_spawn" ([#2565](https://github.com/PyTorchLightning/pytorch-lightning/pull/2565))
 - Fixed passing (do not pass) TPU weights back on test ([#2566](https://github.com/PyTorchLightning/pytorch-lightning/pull/2566))
 - Fixed DDP tests and `.test()` ([#2512](https://github.com/PyTorchLightning/pytorch-lightning/pull/2512),
-     [#2570](https://github.com/PyTorchLightning/pytorch-lightning/pull/2570))
+  [#2570](https://github.com/PyTorchLightning/pytorch-lightning/pull/2570))
 
-## [0.8.4] - 2020-07-01
+## \[0.8.4\] - 2020-07-01
 
 ### Added
 
@@ -1802,15 +1735,14 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed TPU saving dir ([fc26078e](https://github.com/PyTorchLightning/pytorch-lightning/commit/fc26078e395f8a001f4c6dd7b3fe7ca202f914a3), [04e68f02](https://github.com/PyTorchLightning/pytorch-lightning/commit/04e68f022fc03dd5f1555ee86dea997d42a448ad))
 - Fixed logging on rank 0 only ([#2425](https://github.com/PyTorchLightning/pytorch-lightning/pull/2425))
 
-
-## [0.8.3] - 2020-06-29
+## \[0.8.3\] - 2020-06-29
 
 ### Fixed
 
 - Fixed AMP wrong call ([593837e](https://github.com/PyTorchLightning/pytorch-lightning/commit/593837e1da24ff6c942b24ed803fc1496a304609))
 - Fixed batch typo ([92d1e75](https://github.com/PyTorchLightning/pytorch-lightning/commit/92d1e75b2638a493d9d21ed5fe00a22093888285))
 
-## [0.8.2] - 2020-06-28
+## \[0.8.2\] - 2020-06-28
 
 ### Added
 
@@ -1821,7 +1753,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Changed epoch indexing from 0 instead of 1 ([#2289](https://github.com/PyTorchLightning/pytorch-lightning/pull/2289))
 - Refactor Model `backward` ([#2276](https://github.com/PyTorchLightning/pytorch-lightning/pull/2276))
 - Refactored `training_batch` + tests to verify correctness ([#2327](https://github.com/PyTorchLightning/pytorch-lightning/pull/2327),
-     [#2328](https://github.com/PyTorchLightning/pytorch-lightning/pull/2328))
+  [#2328](https://github.com/PyTorchLightning/pytorch-lightning/pull/2328))
 - Refactored training loop ([#2336](https://github.com/PyTorchLightning/pytorch-lightning/pull/2336))
 - Made optimization steps for hooks ([#2363](https://github.com/PyTorchLightning/pytorch-lightning/pull/2363))
 - Changed default apex level to 'O2' ([#2362](https://github.com/PyTorchLightning/pytorch-lightning/pull/2362))
@@ -1834,10 +1766,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Fixed parsing TPU arguments and TPU tests ([#2094](https://github.com/PyTorchLightning/pytorch-lightning/pull/2094))
 - Fixed number batches in case of multiple dataloaders and `limit_{*}_batches` ([#1920](https://github.com/PyTorchLightning/pytorch-lightning/pull/1920),
-     [#2226](https://github.com/PyTorchLightning/pytorch-lightning/pull/2226))
+  [#2226](https://github.com/PyTorchLightning/pytorch-lightning/pull/2226))
 - Fixed an issue with forward hooks not being removed after model summary ([#2298](https://github.com/PyTorchLightning/pytorch-lightning/pull/2298))
 - Fix for `load_from_checkpoint()` not working with absolute path on Windows ([#2294](https://github.com/PyTorchLightning/pytorch-lightning/pull/2294))
-- Fixed an issue how _has_len handles `NotImplementedError` e.g. raised by `torchtext.data.Iterator` ([#2293](https://github.com/PyTorchLightning/pytorch-lightning/pull/2293)), ([#2307](https://github.com/PyTorchLightning/pytorch-lightning/pull/2307))
+- Fixed an issue how \_has_len handles `NotImplementedError` e.g. raised by `torchtext.data.Iterator` ([#2293](https://github.com/PyTorchLightning/pytorch-lightning/pull/2293)), ([#2307](https://github.com/PyTorchLightning/pytorch-lightning/pull/2307))
 - Fixed `average_precision` metric ([#2319](https://github.com/PyTorchLightning/pytorch-lightning/pull/2319))
 - Fixed ROC metric for CUDA tensors ([#2304](https://github.com/PyTorchLightning/pytorch-lightning/pull/2304))
 - Fixed lost compatibility with custom datatypes implementing `.to` ([#2335](https://github.com/PyTorchLightning/pytorch-lightning/pull/2335))
@@ -1850,37 +1782,37 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed use model ref for tear down ([#2360](https://github.com/PyTorchLightning/pytorch-lightning/pull/2360))
 - Fixed logger crash on DDP ([#2388](https://github.com/PyTorchLightning/pytorch-lightning/pull/2388))
 - Fixed several issues with early stopping and checkpoint callbacks ([#1504](https://github.com/PyTorchLightning/pytorch-lightning/pull/1504),
-     [#2391](https://github.com/PyTorchLightning/pytorch-lightning/pull/2391))
+  [#2391](https://github.com/PyTorchLightning/pytorch-lightning/pull/2391))
 - Fixed loading past checkpoints from v0.7.x ([#2405](https://github.com/PyTorchLightning/pytorch-lightning/pull/2405))
 - Fixed loading model without arguments ([#2403](https://github.com/PyTorchLightning/pytorch-lightning/pull/2403))
 - Fixed Windows compatibility issue ([#2358](https://github.com/PyTorchLightning/pytorch-lightning/pull/2358))
 
-## [0.8.1] - 2020-06-19
+## \[0.8.1\] - 2020-06-19
 
 ### Fixed
 
 - Fixed the `load_from_checkpoint` path detected as URL bug ([#2244](https://github.com/PyTorchLightning/pytorch-lightning/pull/2244))
 - Fixed hooks - added barrier ([#2245](https://github.com/PyTorchLightning/pytorch-lightning/pull/2245),
-     [#2257](https://github.com/PyTorchLightning/pytorch-lightning/pull/2257),
-     [#2260](https://github.com/PyTorchLightning/pytorch-lightning/pull/220))
+  [#2257](https://github.com/PyTorchLightning/pytorch-lightning/pull/2257),
+  [#2260](https://github.com/PyTorchLightning/pytorch-lightning/pull/220))
 - Fixed `hparams` - remove frame inspection on `self.hparams` ([#2253](https://github.com/PyTorchLightning/pytorch-lightning/pull/2253))
 - Fixed setup and on fit calls ([#2252](https://github.com/PyTorchLightning/pytorch-lightning/pull/2252))
 - Fixed GPU template ([#2255](https://github.com/PyTorchLightning/pytorch-lightning/pull/2255))
 
-## [0.8.0] - 2020-06-18
+## \[0.8.0\] - 2020-06-18
 
 ### Added
 
 - Added `overfit_batches`, `limit_{val|test}_batches` flags (overfit now uses training set for all three) ([#2213](https://github.com/PyTorchLightning/pytorch-lightning/pull/2213))
 - Added metrics
-  * Base classes ([#1326](https://github.com/PyTorchLightning/pytorch-lightning/pull/1326),
-       [#1877](https://github.com/PyTorchLightning/pytorch-lightning/pull/1877))
-  * Sklearn metrics classes ([#1327](https://github.com/PyTorchLightning/pytorch-lightning/pull/1327))
-  * Native torch metrics ([#1488](https://github.com/PyTorchLightning/pytorch-lightning/pull/1488),
-       [#2062](https://github.com/PyTorchLightning/pytorch-lightning/pull/2062))
-  * docs for all Metrics ([#2184](https://github.com/PyTorchLightning/pytorch-lightning/pull/2184),
-       [#2209](https://github.com/PyTorchLightning/pytorch-lightning/pull/2209))
-  * Regression metrics ([#2221](https://github.com/PyTorchLightning/pytorch-lightning/pull/2221))
+  - Base classes ([#1326](https://github.com/PyTorchLightning/pytorch-lightning/pull/1326),
+    [#1877](https://github.com/PyTorchLightning/pytorch-lightning/pull/1877))
+  - Sklearn metrics classes ([#1327](https://github.com/PyTorchLightning/pytorch-lightning/pull/1327))
+  - Native torch metrics ([#1488](https://github.com/PyTorchLightning/pytorch-lightning/pull/1488),
+    [#2062](https://github.com/PyTorchLightning/pytorch-lightning/pull/2062))
+  - docs for all Metrics ([#2184](https://github.com/PyTorchLightning/pytorch-lightning/pull/2184),
+    [#2209](https://github.com/PyTorchLightning/pytorch-lightning/pull/2209))
+  - Regression metrics ([#2221](https://github.com/PyTorchLightning/pytorch-lightning/pull/2221))
 - Allow dataloaders without sampler field present ([#1907](https://github.com/PyTorchLightning/pytorch-lightning/pull/1907))
 - Added option `save_last` to save the model at the end of every epoch in `ModelCheckpoint` ([#1908](https://github.com/PyTorchLightning/pytorch-lightning/pull/1908))
 - Early stopping checks `on_validation_end` ([#1458](https://github.com/PyTorchLightning/pytorch-lightning/pull/1458))
@@ -1910,23 +1842,23 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 ### Deprecated
 
 - Deprecated flags: ([#2213](https://github.com/PyTorchLightning/pytorch-lightning/pull/2213))
-  * `overfit_pct` in favour of `overfit_batches`
-  * `val_percent_check` in favour of `limit_val_batches`
-  * `test_percent_check` in favour of `limit_test_batches`
+  - `overfit_pct` in favour of `overfit_batches`
+  - `val_percent_check` in favour of `limit_val_batches`
+  - `test_percent_check` in favour of `limit_test_batches`
 - Deprecated `ModelCheckpoint`'s attributes `best` and `kth_best_model` ([#1799](https://github.com/PyTorchLightning/pytorch-lightning/pull/1799))
-- Dropped official support/testing for older PyTorch versions <1.3 ([#1917](https://github.com/PyTorchLightning/pytorch-lightning/pull/1917))
+- Dropped official support/testing for older PyTorch versions \<1.3 ([#1917](https://github.com/PyTorchLightning/pytorch-lightning/pull/1917))
 - Deprecated Trainer `proc_rank` in favour of `global_rank` ([#2166](https://github.com/PyTorchLightning/pytorch-lightning/pull/2166),
-     [#2269](https://github.com/PyTorchLightning/pytorch-lightning/pull/2269))
+  [#2269](https://github.com/PyTorchLightning/pytorch-lightning/pull/2269))
 
 ### Removed
 
 - Removed unintended Trainer argument `progress_bar_callback`, the callback should be passed in by `Trainer(callbacks=[...])` instead ([#1855](https://github.com/PyTorchLightning/pytorch-lightning/pull/1855))
 - Removed obsolete `self._device` in Trainer ([#1849](https://github.com/PyTorchLightning/pytorch-lightning/pull/1849))
 - Removed deprecated API ([#2073](https://github.com/PyTorchLightning/pytorch-lightning/pull/2073))
-   * Packages: `pytorch_lightning.pt_overrides`, `pytorch_lightning.root_module`
-   * Modules: `pytorch_lightning.logging.comet_logger`, `pytorch_lightning.logging.mlflow_logger`, `pytorch_lightning.logging.test_tube_logger`, `pytorch_lightning.overrides.override_data_parallel`, `pytorch_lightning.core.model_saving`, `pytorch_lightning.core.root_module`
-   * Trainer arguments: `add_row_log_interval`, `default_save_path`, `gradient_clip`, `nb_gpu_nodes`, `max_nb_epochs`, `min_nb_epochs`, `nb_sanity_val_steps`
-   * Trainer attributes: `nb_gpu_nodes`, `num_gpu_nodes`, `gradient_clip`, `max_nb_epochs`, `min_nb_epochs`, `nb_sanity_val_steps`, `default_save_path`, `tng_tqdm_dic`
+  - Packages: `pytorch_lightning.pt_overrides`, `pytorch_lightning.root_module`
+  - Modules: `pytorch_lightning.logging.comet_logger`, `pytorch_lightning.logging.mlflow_logger`, `pytorch_lightning.logging.test_tube_logger`, `pytorch_lightning.overrides.override_data_parallel`, `pytorch_lightning.core.model_saving`, `pytorch_lightning.core.root_module`
+  - Trainer arguments: `add_row_log_interval`, `default_save_path`, `gradient_clip`, `nb_gpu_nodes`, `max_nb_epochs`, `min_nb_epochs`, `nb_sanity_val_steps`
+  - Trainer attributes: `nb_gpu_nodes`, `num_gpu_nodes`, `gradient_clip`, `max_nb_epochs`, `min_nb_epochs`, `nb_sanity_val_steps`, `default_save_path`, `tng_tqdm_dic`
 
 ### Fixed
 
@@ -1947,9 +1879,9 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed an issue with the model summary and `example_input_array` depending on a specific ordering of the submodules in a LightningModule ([#1773](https://github.com/PyTorchLightning/pytorch-lightning/pull/1773))
 - Fixed Tpu logging ([#2230](https://github.com/PyTorchLightning/pytorch-lightning/pull/2230))
 - Fixed Pid port + duplicate `rank_zero` logging ([#2140](https://github.com/PyTorchLightning/pytorch-lightning/pull/2140),
-     [#2231](https://github.com/PyTorchLightning/pytorch-lightning/pull/2231))
+  [#2231](https://github.com/PyTorchLightning/pytorch-lightning/pull/2231))
 
-## [0.7.6] - 2020-05-16
+## \[0.7.6\] - 2020-05-16
 
 ### Added
 
@@ -1962,9 +1894,9 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added option to provide seed to random generators to ensure reproducibility ([#1572](https://github.com/PyTorchLightning/pytorch-lightning/pull/1572))
 - Added override for hparams in `load_from_ckpt` ([#1797](https://github.com/PyTorchLightning/pytorch-lightning/pull/1797))
 - Added support multi-node distributed execution under `torchelastic` ([#1811](https://github.com/PyTorchLightning/pytorch-lightning/pull/1811),
-     [#1818](https://github.com/PyTorchLightning/pytorch-lightning/pull/1818))
+  [#1818](https://github.com/PyTorchLightning/pytorch-lightning/pull/1818))
 - Added using `store_true` for bool args ([#1822](https://github.com/PyTorchLightning/pytorch-lightning/pull/1822),
-     [#1842](https://github.com/PyTorchLightning/pytorch-lightning/pull/1842))
+  [#1842](https://github.com/PyTorchLightning/pytorch-lightning/pull/1842))
 - Added dummy logger for internally disabling logging for some features ([#1836](https://github.com/PyTorchLightning/pytorch-lightning/pull/1836))
 
 ### Changed
@@ -2002,7 +1934,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed native amp + ddp ([#1788](https://github.com/PyTorchLightning/pytorch-lightning/pull/1788))
 - Fixed `hparam` logging with metrics ([#1647](https://github.com/PyTorchLightning/pytorch-lightning/pull/1647))
 
-## [0.7.5] - 2020-04-27
+## \[0.7.5\] - 2020-04-27
 
 ### Changed
 
@@ -2018,8 +1950,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed CPU DDP breaking change and DDP change ([#1635](https://github.com/PyTorchLightning/pytorch-lightning/pull/1635))
 - Tested pickling ([#1636](https://github.com/PyTorchLightning/pytorch-lightning/pull/1636))
 
-
-## [0.7.4] - 2020-04-26
+## \[0.7.4\] - 2020-04-26
 
 ### Added
 
@@ -2034,12 +1965,12 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added [Horovod](http://horovod.ai) support as a distributed backend `Trainer(distributed_backend='horovod')` ([#1529](https://github.com/PyTorchLightning/pytorch-lightning/pull/1529))
 - Added support for 8 core distributed training on Kaggle TPU's ([#1568](https://github.com/PyTorchLightning/pytorch-lightning/pull/1568))
 - Added support for native AMP ([#1561](https://github.com/PyTorchLightning/pytorch-lightning/pull/1561),
-    [#1580](https://github.com/PyTorchLightning/pytorch-lightning/pull/1580))
+  [#1580](https://github.com/PyTorchLightning/pytorch-lightning/pull/1580))
 
 ### Changed
 
 - Changed the default behaviour to no longer include a NaN check with each training iteration ([#1475](https://github.com/PyTorchLightning/pytorch-lightning/pull/1475))
-- Decoupled the progress bar from trainer` it is a callback now and can be customized or even be replaced entirely ([#1450](https://github.com/PyTorchLightning/pytorch-lightning/pull/1450)).
+- Decoupled the progress bar from trainer\` it is a callback now and can be customized or even be replaced entirely ([#1450](https://github.com/PyTorchLightning/pytorch-lightning/pull/1450)).
 - Changed lr schedule step interval behavior to update every backwards pass instead of every forwards pass ([#1477](https://github.com/PyTorchLightning/pytorch-lightning/pull/1477))
 - Defines shared proc. rank, remove rank from instances (e.g. loggers) ([#1408](https://github.com/PyTorchLightning/pytorch-lightning/pull/1408))
 - Updated semantic segmentation example with custom U-Net and logging ([#1371](https://github.com/PyTorchLightning/pytorch-lightning/pull/1371))
@@ -2066,12 +1997,12 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug that caused the `callbacks` Trainer argument to reference a global variable ([#1534](https://github.com/PyTorchLightning/pytorch-lightning/pull/1534)).
 - Fixed a bug that set all boolean CLI arguments from `Trainer.add_argparse_args` always to True ([#1571](https://github.com/PyTorchLightning/pytorch-lightning/pull/1571))
 - Fixed do not copy the batch when training on a single GPU ([#1576](https://github.com/PyTorchLightning/pytorch-lightning/pull/1576),
-    [#1579](https://github.com/PyTorchLightning/pytorch-lightning/pull/1579))
+  [#1579](https://github.com/PyTorchLightning/pytorch-lightning/pull/1579))
 - Fixed soft checkpoint removing on DDP ([#1408](https://github.com/PyTorchLightning/pytorch-lightning/pull/1408))
 - Fixed automatic parser bug ([#1585](https://github.com/PyTorchLightning/pytorch-lightning/pull/1585))
 - Fixed bool conversion from string ([#1606](https://github.com/PyTorchLightning/pytorch-lightning/pull/1606))
 
-## [0.7.3] - 2020-04-09
+## \[0.7.3\] - 2020-04-09
 
 ### Added
 
@@ -2085,8 +2016,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed gradient clipping ([#1438](https://github.com/PyTorchLightning/pytorch-lightning/pull/1438))
 - Fixed pretty print ([#1441](https://github.com/PyTorchLightning/pytorch-lightning/pull/1441))
 
-
-## [0.7.2] - 2020-04-07
+## \[0.7.2\] - 2020-04-07
 
 ### Added
 
@@ -2156,12 +2086,12 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug that would cause `trainer.test()` to run on the validation set when overloading `validation_epoch_end` and `test_end` ([#1353](https://github.com/PyTorchLightning/pytorch-lightning/pull/1353))
 - Fixed `WandbLogger.watch` - use of the watch method without importing `wandb` ([#1311](https://github.com/PyTorchLightning/pytorch-lightning/pull/1311))
 - Fixed `WandbLogger` to be used with 'ddp' - allow reinits in sub-processes ([#1149](https://github.com/PyTorchLightning/pytorch-lightning/pull/1149),
-     [#1360](https://github.com/PyTorchLightning/pytorch-lightning/pull/1360))
+  [#1360](https://github.com/PyTorchLightning/pytorch-lightning/pull/1360))
 - Made `training_epoch_end` behave like `validation_epoch_end` ([#1357](https://github.com/PyTorchLightning/pytorch-lightning/pull/1357))
 - Fixed `fast_dev_run` running validation twice ([#1365](https://github.com/PyTorchLightning/pytorch-lightning/pull/1365))
 - Fixed pickle error from quick patch `__code__` ([#1352](https://github.com/PyTorchLightning/pytorch-lightning/pull/1352))
 - Fixed memory leak on GPU0 ([#1094](https://github.com/PyTorchLightning/pytorch-lightning/pull/1094),
-     [#1349](https://github.com/PyTorchLightning/pytorch-lightning/pull/1349))
+  [#1349](https://github.com/PyTorchLightning/pytorch-lightning/pull/1349))
 - Fixed checkpointing interval ([#1272](https://github.com/PyTorchLightning/pytorch-lightning/pull/1272))
 - Fixed validation and training loops run the partial dataset ([#1192](https://github.com/PyTorchLightning/pytorch-lightning/pull/1192))
 - Fixed running `on_validation_end` only on main process in DDP ([#1125](https://github.com/PyTorchLightning/pytorch-lightning/pull/1125))
@@ -2170,13 +2100,13 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed Tensorboard logger error: lightning_logs directory not exists in multi-node DDP on nodes with rank != 0 ([#1377](https://github.com/PyTorchLightning/pytorch-lightning/pull/1377))
 - Fixed `Unimplemented backend XLA` error on TPU ([#1387](https://github.com/PyTorchLightning/pytorch-lightning/pull/1387))
 
-## [0.7.1] - 2020-03-07
+## \[0.7.1\] - 2020-03-07
 
 ### Fixed
 
 - Fixes `print` issues and `data_loader` ([#1080](https://github.com/PyTorchLightning/pytorch-lightning/pull/1080))
 
-## [0.7.0] - 2020-03-06
+## \[0.7.0\] - 2020-03-06
 
 ### Added
 
@@ -2193,7 +2123,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added `train_dataloader`, `val_dataloader` and `test_dataloader` arguments to `Trainer.fit()`, for alternative data parsing ([#759](https://github.com/PyTorchLightning/pytorch-lightning/pull/759))
 - Added Tensor Processing Unit (TPU) support ([#868](https://github.com/PyTorchLightning/pytorch-lightning/pull/868))
 - Added semantic segmentation example ([#751](https://github.com/PyTorchLightning/pytorch-lightning/pull/751),[#876](https://github.com/PyTorchLightning/pytorch-lightning/pull/876),
-     [#881](https://github.com/PyTorchLightning/pytorch-lightning/pull/881))
+  [#881](https://github.com/PyTorchLightning/pytorch-lightning/pull/881))
 - Split callbacks in multiple files ([#849](https://github.com/PyTorchLightning/pytorch-lightning/pull/849))
 - Support for user defined callbacks ([#889](https://github.com/PyTorchLightning/pytorch-lightning/pull/889) and [#950](https://github.com/PyTorchLightning/pytorch-lightning/pull/950))
 - Added support for multiple loggers to be passed to `Trainer` as an iterable (e.g. list, tuple, etc.) ([#903](https://github.com/PyTorchLightning/pytorch-lightning/pull/903))
@@ -2201,10 +2131,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Added support for logging `hparams` as dict ([#1029](https://github.com/PyTorchLightning/pytorch-lightning/pull/1029))
 - Checkpoint and early stopping now work without val. step ([#1041](https://github.com/PyTorchLightning/pytorch-lightning/pull/1041))
 - Support graceful training cleanup after Keyboard Interrupt ([#856](https://github.com/PyTorchLightning/pytorch-lightning/pull/856),
-     [#1019](https://github.com/PyTorchLightning/pytorch-lightning/pull/1019))
+  [#1019](https://github.com/PyTorchLightning/pytorch-lightning/pull/1019))
 - Added type hints for function arguments ([#912](https://github.com/PyTorchLightning/pytorch-lightning/pull/912), )
 - Added default `argparser` for `Trainer` ([#952](https://github.com/PyTorchLightning/pytorch-lightning/pull/1023),
-     [#1023](https://github.com/PyTorchLightning/pytorch-lightning/pull/1023))
+  [#1023](https://github.com/PyTorchLightning/pytorch-lightning/pull/1023))
 - Added TPU gradient clipping ([#963](https://github.com/PyTorchLightning/pytorch-lightning/pull/963))
 - Added max/min number of steps in `Trainer` ([#728](https://github.com/PyTorchLightning/pytorch-lightning/pull/728))
 
@@ -2229,10 +2159,10 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Deprecated `pytorch_lightning.logging` ([#767](https://github.com/PyTorchLightning/pytorch-lightning/pull/767))
 - Deprecated `LightningModule.load_from_metrics` in favour of `LightningModule.load_from_checkpoint` ([#995](https://github.com/PyTorchLightning/pytorch-lightning/pull/995),
-     [#1079](https://github.com/PyTorchLightning/pytorch-lightning/pull/1079))
+  [#1079](https://github.com/PyTorchLightning/pytorch-lightning/pull/1079))
 - Deprecated `@data_loader` decorator ([#926](https://github.com/PyTorchLightning/pytorch-lightning/pull/926))
 - Deprecated model steps `training_end`, `validation_end` and `test_end` ([#1051](https://github.com/PyTorchLightning/pytorch-lightning/pull/1051),
-     [#1056](https://github.com/PyTorchLightning/pytorch-lightning/pull/1056))
+  [#1056](https://github.com/PyTorchLightning/pytorch-lightning/pull/1056))
 
 ### Removed
 
@@ -2254,7 +2184,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed comet logger to log after train ([#892](https://github.com/PyTorchLightning/pytorch-lightning/pull/892))
 - Remove deprecated args to learning rate step function ([#890](https://github.com/PyTorchLightning/pytorch-lightning/pull/890))
 
-## [0.6.0] - 2020-01-21
+## \[0.6.0\] - 2020-01-21
 
 ### Added
 
@@ -2311,7 +2241,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug where checkpoint writing could exit before completion, giving incomplete checkpoints ([#689](https://github.com/PyTorchLightning/pytorch-lightning/pull/689))
 - Fixed a bug where `on_train_end` was not called when ealy stopping ([#723](https://github.com/PyTorchLightning/pytorch-lightning/pull/723))
 
-## [0.5.3] - 2019-11-06
+## \[0.5.3\] - 2019-11-06
 
 ### Added
 
@@ -2353,7 +2283,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug when using the `log_gpu_memory='min_max'` option in `Trainer`
 - Fixed a bug where checkpointing would sometimes erase the current directory
 
-## [0.5.2] - 2019-10-10
+## \[0.5.2\] - 2019-10-10
 
 ### Added
 
@@ -2375,7 +2305,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed callback metric errors in DDP
 - Fixed a bug where `TestTubeLogger` didn't log to the correct directory
 
-## [0.5.1] - 2019-10-05
+## \[0.5.1\] - 2019-10-05
 
 ### Added
 
@@ -2402,7 +2332,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug where gradient norms were alwasy zero using `track_grad_norm`
 - Fixed a bug which causes a crash when logging memory
 
-## [0.5.0] - 2019-09-26
+## \[0.5.0\] - 2019-09-26
 
 ### Changed
 
@@ -2417,7 +2347,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Fixed a bug with tensorboard logging in multi-gpu setup
 
-## [0.4.9] - 2019-09-16
+## \[0.4.9\] - 2019-09-16
 
 ### Added
 
@@ -2438,7 +2368,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug where data types that implement `.to` but not `.cuda` would not be properly moved onto the GPU
 - Fixed a bug where data would not be re-shuffled every epoch when using a `DistributedSampler`
 
-## [0.4.8] - 2019-08-31
+## \[0.4.8\] - 2019-08-31
 
 ### Added
 
@@ -2450,7 +2380,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Fixed a bug when setting `nb_sanity_val_steps = 0`
 
-## [0.4.7] - 2019-08-24
+## \[0.4.7\] - 2019-08-24
 
 ### Changed
 
@@ -2467,7 +2397,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug when loading data as a tuple
 - Fixed a bug where `AttributeError` could be suppressed by the `Trainer`
 
-## [0.4.6] - 2019-08-15
+## \[0.4.6\] - 2019-08-15
 
 ### Added
 
@@ -2478,13 +2408,13 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Fixed a bug where returning just an optimizer list (i.e. without schedulers) from `configure_optimizers` would throw an `Exception`
 
-## [0.4.5] - 2019-08-13
+## \[0.4.5\] - 2019-08-13
 
 ### Added
 
 - Added `optimizer_step` method that can be overridden to change the standard optimizer behaviour
 
-## [0.4.4] - 2019-08-12
+## \[0.4.4\] - 2019-08-12
 
 ### Added
 
@@ -2501,25 +2431,25 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 - Fixed a bug where a warning would show when using `lr_scheduler` in `torch>1.1.0`
 - Fixed a bug where an `Exception` would be thrown if using `torch.DistributedDataParallel` without using a `DistributedSampler`, this now throws a `Warning` instead
 
-## [0.4.3] - 2019-08-10
+## \[0.4.3\] - 2019-08-10
 
 ### Fixed
 
 - Fixed a bug where accumulate gradients would scale the loss incorrectly
 
-## [0.4.2] - 2019-08-08
+## \[0.4.2\] - 2019-08-08
 
 ### Changed
 
 - Changed install requirement to `torch==1.2.0`
 
-## [0.4.1] - 2019-08-08
+## \[0.4.1\] - 2019-08-08
 
 ### Changed
 
 - Changed install requirement to `torch==1.1.0`
 
-## [0.4.0] - 2019-08-08
+## \[0.4.0\] - 2019-08-08
 
 ### Added
 
@@ -2538,7 +2468,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Fixed issues with reducing outputs from generative models (such as images and text)
 
-## [0.3.6] - 2019-07-25
+## \[0.3.6\] - 2019-07-25
 
 ### Added
 
@@ -2548,16 +2478,16 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 
 - Fixed a bug where `Experiment` object was not process safe, potentially causing logs to be overwritten
 
-## [0.3.5] - 2019-07-25
+## \[0.3.5\] - 2019-07-25
 
-## [0.3.4] - 2019-07-22
+## \[0.3.4\] - 2019-07-22
 
-## [0.3.3] - 2019-07-22
+## \[0.3.3\] - 2019-07-22
 
-## [0.3.2] - 2019-07-21
+## \[0.3.2\] - 2019-07-21
 
-## [0.3.1] - 2019-07-21
+## \[0.3.1\] - 2019-07-21
 
-## [0.2.x] - 2019-07-09
+## \[0.2.x\] - 2019-07-09
 
-## [0.1.x] - 2019-06-DD
+## \[0.1.x\] - 2019-06-DD
diff --git a/dockers/README.md b/dockers/README.md
index c747b3af795000..6ab45b49a51548 100644
--- a/dockers/README.md
+++ b/dockers/README.md
@@ -20,7 +20,9 @@ docker image build \
     --build-arg PYTORCH_VERSION=1.8 \
     .
 ```
+
 or nightly version from Conda
+
 ```bash
 git clone <git-repository>
 docker image build \
@@ -48,6 +50,7 @@ docker image rm pytorch-lightning:latest
 ## Run docker image with GPUs
 
 To run docker image with access to you GPUs you need to install
+
 ```bash
 # Add the package repositories
 distribution=$(. /etc/os-release;echo $ID$VERSION_ID)
@@ -69,17 +72,17 @@ docker run --rm -it --gpus all pytorchlightning/pytorch_lightning:base-cuda-py3.
 Inspiration comes from https://u.group/thinking/how-to-put-jupyter-notebooks-in-a-dockerfile
 
 1. Build the docker image:
-    ```bash
-    docker image build \
-        -t pytorch-lightning:v1.3.1 \
-        -f dockers/nvidia/Dockerfile \
-        --build-arg LIGHTNING_VERSION=1.3.1 \
-        .
-    ```
-2. start the server and map ports:
-    ```bash
-    docker run --rm -it --runtime=nvidia -e NVIDIA_VISIBLE_DEVICES=all -p 8888:8888 pytorch-lightning:v1.3.1
-    ```
-3. Connect in local browser:
-    - copy the generated path e.g. `http://hostname:8888/?token=0719fa7e1729778b0cec363541a608d5003e26d4910983c6`
-    - replace the `hostname` by `localhost`
+   ```bash
+   docker image build \
+       -t pytorch-lightning:v1.3.1 \
+       -f dockers/nvidia/Dockerfile \
+       --build-arg LIGHTNING_VERSION=1.3.1 \
+       .
+   ```
+1. start the server and map ports:
+   ```bash
+   docker run --rm -it --runtime=nvidia -e NVIDIA_VISIBLE_DEVICES=all -p 8888:8888 pytorch-lightning:v1.3.1
+   ```
+1. Connect in local browser:
+   - copy the generated path e.g. `http://hostname:8888/?token=0719fa7e1729778b0cec363541a608d5003e26d4910983c6`
+   - replace the `hostname` by `localhost`
diff --git a/pl_examples/README.md b/pl_examples/README.md
index e09c79e081c25b..c6d729c9aef33e 100644
--- a/pl_examples/README.md
+++ b/pl_examples/README.md
@@ -1,19 +1,22 @@
 # Examples
+
 Our most robust examples showing all sorts of implementations
 can be found in our sister library [lightning-bolts](https://lightning-bolts.readthedocs.io/en/latest/convolutional.html#gpt-2).
 
----
+______________________________________________________________________
 
 ## Basic examples
+
 In this folder we add 3 simple examples:
 
-* [MNIST Classifier](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pl_examples/basic_examples/simple_image_classifier.py) (defines the model inside the `LightningModule`).
-* [Image Classifier](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pl_examples/basic_examples/backbone_image_classifier.py) (trains arbitrary datasets with arbitrary backbones).
-* [Autoencoder](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pl_examples/basic_examples/autoencoder.py) (shows how the `LightningModule` can be used as a system)
+- [MNIST Classifier](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pl_examples/basic_examples/simple_image_classifier.py) (defines the model inside the `LightningModule`).
+- [Image Classifier](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pl_examples/basic_examples/backbone_image_classifier.py) (trains arbitrary datasets with arbitrary backbones).
+- [Autoencoder](https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pl_examples/basic_examples/autoencoder.py) (shows how the `LightningModule` can be used as a system)
 
----
+______________________________________________________________________
 
 ## Domain examples
+
 This folder contains older examples. You should instead use the examples
 in [lightning-bolts](https://lightning-bolts.readthedocs.io/en/latest/convolutional.html#gpt-2)
 for advanced use cases.
diff --git a/pl_examples/basic_examples/README.md b/pl_examples/basic_examples/README.md
index bd8dfd7426eb8b..fd7824140d470f 100644
--- a/pl_examples/basic_examples/README.md
+++ b/pl_examples/basic_examples/README.md
@@ -1,8 +1,11 @@
 ## Basic Examples
+
 Use these examples to test how lightning works.
 
 #### MNIST
+
 Trains MNIST where the model is defined inside the `LightningModule`.
+
 ```bash
 # cpu
 python simple_image_classifier.py
@@ -14,17 +17,23 @@ python simple_image_classifier.py --trainer.gpus 2
 python simple_image_classifier.py --trainer.gpus 2 --trainer.accelerator 'dp'
 ```
 
----
+______________________________________________________________________
+
 #### MNIST with DALI
+
 The MNIST example above using [NVIDIA DALI](https://developer.nvidia.com/DALI).
 Requires NVIDIA DALI to be installed based on your CUDA version, see [here](https://docs.nvidia.com/deeplearning/dali/user-guide/docs/installation.html).
+
 ```bash
 python dali_image_classifier.py
 ```
 
----
+______________________________________________________________________
+
 #### Image classifier
+
 Generic image classifier with an arbitrary backbone (ie: a simple system)
+
 ```bash
 # cpu
 python backbone_image_classifier.py
@@ -36,9 +45,12 @@ python backbone_image_classifier.py --trainer.gpus 2
 python backbone_image_classifier.py --trainer.gpus 2 --trainer.accelerator 'dp'
 ```
 
----
+______________________________________________________________________
+
 #### Autoencoder
+
 Showing the power of a system... arbitrarily complex training loops
+
 ```bash
 # cpu
 python autoencoder.py
@@ -49,12 +61,14 @@ python autoencoder.py --trainer.gpus 2
 # dataparallel
 python autoencoder.py --trainer.gpus 2 --trainer.accelerator 'dp'
 ```
----
+
+______________________________________________________________________
+
 # Multi-node example
 
 This demo launches a job using 2 GPUs on 2 different nodes (4 GPUs total).
 To run this demo do the following:
 
 1. Log into the jumphost node of your SLURM-managed cluster.
-2. Create a conda environment with Lightning and a GPU PyTorch version.
-3. Choose a script to submit
+1. Create a conda environment with Lightning and a GPU PyTorch version.
+1. Choose a script to submit
diff --git a/tests/README.md b/tests/README.md
index 01d0d835f9fe77..fc63d353ebeca7 100644
--- a/tests/README.md
+++ b/tests/README.md
@@ -1,9 +1,11 @@
 # PyTorch-Lightning Tests
+
 Most PL tests train a full MNIST model under various trainer conditions (ddp, ddp2+amp, etc...).
 This provides testing for most combinations of important settings.
 The tests expect the model to perform to a reasonable degree of testing accuracy to pass.
 
 ## Running tests
+
 ```bash
 git clone https://github.com/PyTorchLightning/pytorch-lightning
 cd pytorch-lightning
@@ -23,6 +25,7 @@ such as Horovod, FairScale, NVIDIA/apex, NVIDIA/DALI, etc.
 You can rely on our CI to make sure all these tests pass.
 
 ## Running Coverage
+
 Make sure to run coverage on a GPU machine with at least 2 GPUs and NVIDIA apex installed.
 
 ```bash
@@ -41,11 +44,14 @@ coverage xml
 ## Building test image
 
 You can build it on your own, note it takes lots of time, be prepared.
+
 ```bash
 git clone <git-repository>
 docker image build -t pytorch_lightning:devel-torch1.9 -f dockers/cuda-extras/Dockerfile --build-arg TORCH_VERSION=1.9 .
 ```
+
 To build other versions, select different Dockerfile.
+
 ```bash
 docker image list
 docker run --rm -it pytorch_lightning:devel-torch1.9 bash