CIFAR10_Classification_Inceptionv3.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/YenaChoi00/ML-Final-Project/blob/main/CIFAR10_Classification_Inceptionv3.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# ***Final Project***\n",
        "---\n",
        "\n",
        "In this project, you will develop a convolutional neural network (CNN) to perform classification, and test it out on the CIFAR-10 dataset.\n",
        "\n",
        "\n",
        "The given code is a simple implement for the CIFAR-10 classification. \n",
        "\n",
        "The goal of the final project is to check whether you understand important concepts for training CNN such as:\n",
        "\n",
        "*   Network architecture\n",
        "*   Optimization\n",
        "*   Loss function\n",
        "*   Data preprocessing\n",
        "*   Regularization\n",
        "*   ...\n",
        "\n",
        "Therefore, you can **modify the given code to improve the performance** of the network **except for the dataset (i.e. trainset and testset)**.\n",
        "\n",
        "You should **upload your code and your report** including an explaination of your code and what you have changed or added."
      ],
      "metadata": {
        "id": "8H2mplXJU1d6"
      }
    },
    {
      "cell_type": "code",
      "execution_count": 2,
      "metadata": {
        "id": "Fr9zgCgCmdNq"
      },
      "outputs": [],
      "source": [
        "# AS usual, a bit of setup\n",
        "# If you need other libraries, you should import the libraries.\n",
        "\n",
        "import os, sys\n",
        "import torch\n",
        "from torch import nn\n",
        "from torch.nn import functional as F\n",
        "\n",
        "import torchvision\n",
        "import torchvision.transforms as transforms\n",
        "import torchvision.datasets as datasets\n",
        "\n",
        "import matplotlib.pyplot as plt\n",
        "import numpy as np"
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Inception v3\n",
        "\n",
        "from collections import namedtuple\n",
        "\n",
        "import torch\n",
        "import torch.nn as nn\n",
        "import torch.nn.functional as F\n",
        "\n",
        "__all__ = ['Inception3', 'inception_v3']\n",
        "\n",
        "_InceptionOutputs = namedtuple('InceptionOutputs', ['logits', 'aux_logits'])"
      ],
      "metadata": {
        "id": "DjpqX-21Wk1X"
      },
      "execution_count": 3,
      "outputs": []
    },
    {
      "cell_type": "code",
      "execution_count": 4,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "V9pg5nB1pXEO",
        "outputId": "5072ac88-e9d8-4a6d-f9b2-6f2ebb177560"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "cuda\n"
          ]
        }
      ],
      "source": [
        "# Set the device\n",
        "device = 'cuda' if torch.cuda.is_available() else 'cpu'\n",
        "print(device)"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Data Loader**\n",
        "\n",
        "You can load the CIFAR-10 dataset using the library `torchvision.datasets`\n",
        "\n",
        "The details of CIFAR-10 dataset can be found in https://www.cs.toronto.edu/~kriz/cifar.html\n",
        "\n",
        "`transforms_cifar10` is used to assemble several transforms for data preprossing."
      ],
      "metadata": {
        "id": "q-G1AJVsbqwc"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "# Inception V3\n",
        "# incremental training comments out that line of code.\n",
        "\n",
        "# Device configuration\n",
        "device = torch.device('cuda' if torch.cuda.is_available() else 'cpu')\n",
        "\n",
        "WORK_DIR = './data'\n",
        "NUM_EPOCHS = 5\n",
        "BATCH_SIZE = 4\n",
        "#LEARNING_RATE = 0.01\n",
        "\n",
        "MODEL_PATH = './model'\n",
        "MODEL_NAME = 'Inception_v3.pth'\n",
        "\n",
        "# Create model\n",
        "if not os.path.exists(MODEL_PATH):\n",
        "  os.makedirs(MODEL_PATH)\n",
        "\"\"\"\n",
        "#AUGMENTATIONS\n",
        "transform = transforms.Compose([\n",
        "  transforms.RandomCrop(32, padding=4),\n",
        "  #torchvision.transforms.ColorJitter(brightness=0.2, contrast=0.4, saturation=0.5, hue=0.1),\n",
        "  transforms.RandomHorizontalFlip(),\n",
        "  torchvision.transforms.RandomVerticalFlip(),\n",
        "  # torchvision.transforms.RandomAffine(degrees=0, translate=(0.2,0.2), scale=None,shear=50, resample=False, fillcolor=0),\n",
        "  torchvision.transforms.RandomRotation((20), resample=False,expand=False, center=None),\n",
        "  transforms.ToTensor(),\n",
        "  transforms.Normalize([0.4913997551666284, 0.48215855929893703, 0.4465309133731618], [0.24703225141799082, 0.24348516474564, 0.26158783926049628])\n",
        "])\n",
        "\"\"\"\n",
        "transforms_cifar10 = transforms.Compose([transforms.RandomCrop(32, padding=4),\n",
        "                                  transforms.ToTensor(),\n",
        "                                  transforms.Normalize((0.5, 0.5, 0.5), (0.5, 0.5, 0.5))\n",
        "                                 ])\n",
        "\n",
        "# Load data\n",
        "dataset = torchvision.datasets.CIFAR10(root=WORK_DIR,\n",
        "                                        download=True,\n",
        "                                        train=True,\n",
        "                                        transform=transforms_cifar10)\n",
        "\n",
        "dataset_loader = torch.utils.data.DataLoader(dataset=dataset,\n",
        "                                             batch_size=BATCH_SIZE,\n",
        "                                             shuffle=True)\n",
        "\n",
        "\n",
        "classes = (\"plane\", \"car\", \"bird\", \"cat\", \"deer\", \"dog\", \"frog\", \"horse\", \"ship\", \"truck\")"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ZqxeIaFDUGOn",
        "outputId": "5536c4aa-dad0-438e-82ef-d02c592f19a4"
      },
      "execution_count": 7,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to ./data/cifar-10-python.tar.gz\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stderr",
          "text": [
            "100%|██████████| 170498071/170498071 [00:05<00:00, 28803727.45it/s]\n"
          ]
        },
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Extracting ./data/cifar-10-python.tar.gz to ./data\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "# Train dataset\n",
        "trainset = datasets.CIFAR10(root='./data', train=True, download=True, transform=transforms_cifar10)\n",
        "trainloader = torch.utils.data.DataLoader(trainset, batch_size=4, shuffle=True, num_workers=2)\n",
        "\n",
        "# Test dataset\n",
        "testset = datasets.CIFAR10(root='./data', train=False, download=True, transform=transforms_cifar10)\n",
        "testloader = torch.utils.data.DataLoader(testset, batch_size=4, shuffle=False, num_workers=2)"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "KayCQLMfbPfC",
        "outputId": "9e97740f-533e-4a6e-ef9f-9dc0910aa936"
      },
      "execution_count": 8,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Files already downloaded and verified\n",
            "Files already downloaded and verified\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 9,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 211
        },
        "id": "d7JdtMAzoCac",
        "outputId": "96b2c573-d1ab-410d-bed2-51db9c8f1d23"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "plane  deer   dog horse\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 640x480 with 1 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAh8AAACwCAYAAACviAzDAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjcuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/bCgiHAAAACXBIWXMAAA9hAAAPYQGoP6dpAABHfklEQVR4nO29eXRc1ZX/u++9Vbcmqao0WJJlSR6wwQZsBhsbAZ2BuEPoPAKBXxJ4dGMSXrLothPA69cBkg55nW7avO73GpJeDnndPxqS16FJkx+QbtKBRcwU+HkAgwFjPMu2bGuwhlKVSjXc4bw/aO7ZewsJmVgl29qftbTWPTq36p577jlXR+e7B0MppUAQBEEQBKFCmFPdAEEQBEEQphey+BAEQRAEoaLI4kMQBEEQhIoiiw9BEARBECqKLD4EQRAEQagosvgQBEEQBKGiyOJDEARBEISKIosPQRAEQRAqiiw+BEEQBEGoKLL4EARBEAShokza4mP9+vUwZ84ciEajsGLFCtiyZctkXUoQBEEQhFMIYzJyu/ziF7+Am266CX7yk5/AihUr4IEHHoDHH38cdu3aBQ0NDeN+1vd9OHr0KFRXV4NhGCe6aYIgCIIgTAJKKcjlctDc3Aym+RF7G2oSWL58uVq9enVQ9jxPNTc3q3Xr1n3kZzs7OxUAyI/8yI/8yI/8yM8p+NPZ2fmRf+tDcIIpl8uwdetWuPvuu4PfmaYJK1euhI0bN446v1QqQalUCsrqvzZi7rjjDohEIie6eYIgCIIgTAKlUgnuv/9+qK6u/shzT/jio6+vDzzPg8bGRvL7xsZG2Llz56jz161bB3/5l3856veRSEQWH4IgCIJwijERk4kp93a5++67YWhoKPjp7Oyc6iYJgiAIgjCJnPCdj/r6erAsC3p6esjve3p6oKmpadT5ssMhCIIgCNOLE77zYds2LF26FDZs2BD8zvd92LBhA7S3t5/oywmCIAiCcIpxwnc+AADWrl0Lq1atgmXLlsHy5cvhgQcegHw+D1/96ld/7+9+9fnfkjLWlgyT6kzKZ2WFPse+V6F1mOJ6FfteA316PG1LeYqUfeLV7NOTDVZGpyrls1N1pcXuMQceKX/1y9cHx5++7NOk7p6/0bY2HR17WHvoutTFTWDe2VvfeQs+Dt///vfHrPswOyDh1GS85wxAn/Wff/kaUqfQRDg22EfqWupnkLLnusFxLpcldW2z5wXHmcwQqTN8h5TPmN0aHB/u7iJ1qdoa3TY2DxxHf080SndzLTotwbP08a7uXlK3+d19wfGxwQFSN1IukbLy9cRULrsIwvfpO6RcLo95rmVZpKzQ+8Zx+NmUO7/7nTHrDu7bHBy/tY2+b3Ij9L6GssXg2LYTpK5cxvdZJHWXXnoWKbe26c9aVoHUmYb+81cssn5lz9YOp4Ljvt48qctmM8FxbX2c1NXUasPLqkQNqXtvRwcp54r6e6wwvX4kXKWvf2yY1PX15WhbI7oNxRK/Lz1H9uw8Bh+Xj5rTE2FSFh9f+cpX4NixY3DPPfdAd3c3nH/++fDMM8+MMkIVBEEQBGH6MSmLDwCANWvWwJo1aybr6wVBEARBOEWZcm8XQRAEQRCmF5O28zFZ1FdHSTkU0rdgMEsOn5tVGGPbanhI12RmFKM0UFpmdiXk+lS3G+/64/pFM/1RIXsRi2mwfjXVR8+Z3RYcH9u3l9TVJHRfuk31pM5lfee6tA2CMBlEo3T8Yu29upraNITtGP1sRM+hcJi+JyxTvyfS6fS4bXCMcHCcqqV2JaGQnvsGCx9tWlpPt8M2/VKTTqgRV9sqZAsj9PrIsILbHvCQ1aSWvqbIZ11kDwNA35v8e/k1yiVtH8JehWCa7Bfj0N+vbXaiEfp8+jPUjmEQ2eUoReuqcAArZiu3ecu7pKwMbevTPLOK1EVs3QeeS21HfEX7y/f0MwqHad+l0vp7DdYeO4zGqKL9mhkYJOW8j+xcqmj/RBP6e5RN7XXKis4Lv6z7y/XofZjmyfMnX3Y+BEEQBEGoKLL4EARBEAShopw8ezATJBXhcgVyO7VoXShE11bhsN5ONZn7rO+h7TIml3A3NaX0tqjL6lzkXquMsWUX7srKRQ3cOsNia0T0vcqj129uaiPlGqW36PYfoLKL6entuWiYbs+5zE3YQ9f0/MmXYNaupS57RaYD+WjdbDHJykJ9a7Bt67BFh3wR3fbhIeqeWY222JuqqBwwyFwV8WXi42xpc2xbb88Xi3Tr1/kov0YEdp3kW+qOT5+t46JtdNY239dbuJ5Ht3O5NPjz/+/HE27fRFFje5xDsjpF6kw2h3A/JxJUksFzOMS0A5NJJMNlfVXboi6zBmqRyf53s9F44Z70/P+8EUc/k8wIlV2ISz7rcz6WDNQHVoieWyho11L+DsPjjn8vl3rwy8i2Wd9xHWYcsESTrqHPcvf+g6SMXYiB3bOL3GvTKeq+mhuibtSvvabfeZdeuojUVcX0+A6H+TygbffRe7R+Bg2WOYw8b7HbLQBAPq8/l2fzMF7Fxhbyv2avXygW9D0PZ+l7yjLpyekaLdmYJp0H3tje2BVHdj4EQRAEQagosvgQBEEQBKGiyOJDEARBEISKcsrZfFQlqVbojaPl2kz7xmHKLab9h5BdBTMHGdcNlts/+MhPl7viYbsSx6fim8PEbhI2mWmwhtLXKFhUR1wwj4YXVshNboSHlTa17huKJEmdOcrVVrfXqIBwaLLnYzK91EU2IOO5DVqjAunTZxJCDzvBvieKbISKJXrPEZu6wvnI3c1jthrhmNZducsjtusYbVs0tpsltl/6KBSzlwmH9Gf5NWgo/7HtCyYLbk6Em+czyyjPHOdkZnRhoHdDOE5DYIfjdOxbKDx1lNltlQta4B/o76fXR3M6zlxJuZVUZljbeeQLNAS27489v0z2Lgoht0/f4e6hE5sjAPTZ+sw9E7//TGZ/xlM/jEepqO+ru4uG9s4OUXdaz9fXqUnT51M9Q8+nwgida6ZFbbP6+nV4+q1v0JDuZy9sDo5n1FWTOsXGTzSK3pVh+gz6B7r1eTYdW6WCvueDB/eTOl/R555MaZfdqgR1C25A0cFr43TuDw9TGxAD2eW4bPxmWdqBqUR2PgRBEARBqCiy+BAEQRAEoaLI4kMQBEEQhIpyytl8ZErcrxyFO3ZZDJAS1buonQDV9LCvNLf54GANdHTIC9w+FpsCadL8cz6PjYzvi9Vg24ARpt3OXEBtPmag0L/hbpqSfHCX1iCLLh0KvsdtAfSxx+PPTwIWC9scYfEFHFfHMBjPJofbUYwKT43sV+qS1Ce+sV778x/sOEK/x+Jhi9F38vDUyM6Dx85QyOYjxOw4eIwSbJ9RZHFGxosJEmJ9idPUOyxOjGXZ6DzaVh6qeTJwRtkb4Jgt9DmX2STCc5hbxMQaZwXHkbln0soI1eld0G0oMXsZ19HXKFj7SN3Bra8ExzUxOp/q6+tIOYtsPspFbu+lbQH46yXE7G5iIf28hkbomMBDPxSiPWIaY8fn4DEucEhun/2/6vOYIONw5GhXcOwqGtNm2Yr5pFws6medp+Yg0Nyq5+WhzqOkbsSjdhQOsok5epSGM2+ekQ6O58+h8ZHicfr8YnFtS8Kf14Iz9Hiqq28gdV1Htc3Jzl0FUjd/QTMpj+T0jTbW0nQXyZi+fmQm/VwqTeOXDOS1bd/uDjpGI+bEbcUmG9n5EARBEAShosjiQxAEQRCEinLKyS7ZMt0uPK5MsShbJbAdZGOM44/8Xlan8HpuVDbacb5T8e8ZG+XpLfZYHQ0vnEqm6fdG9Lasn6YZOsuAttgtuh3n8dDwOMvjOK6AJwqLtYc/EzuCw+GzrXEkcyiXttW2WUhu1NOzGtOkDksALns+qSgNjey6ervXY2t6x0XutNxtGo0Di2XLLLtUSimV9TVGuUoirZC7z6ZS1I0Qu3L2D2ZIHR6/xTK9vudNPNz7x8UbJZPpY4tlBeWyFHkX8LD6yJ12JJImdWWTZaD1tSRS8qg8YEVQxtvZdIt9/vBMfY0D79Fr9FM3d6ug+9JwqFyCQ/677J4TzM0TZ2blEJfzcTNzUzmQv5uwmy6f+UpNXIo7c5GWC9rmURnKYi68PUe1RPHqyztJ3THkphthn/PptAQH/b3IDNIxMTSon20iSkM4RKmnNNhobpaLVD7p6+/V38lcWfuPaSmlXKZjO5+nfdfVrcdIYxO9r47Ow8FxJjtA6mpradvLPmofy3hrAuugKUR2PgRBEARBqCiy+BAEQRAEoaLI4kMQBEEQhIpyytl8NDIbhxBKY23xcOrMUICk4OZGBGqMYwDwmXskdt/kGr43Tlh0XFaj4kgbY57LG+SV9DXmt84mdSOdNDV1N9KMzRjX+1Aadh46m9l84PDh5nHovB8Xn7mAAtN2sWbNnwEucdsIHp7aNPW9NNZQV9t3dnXqa7DvmTWrkZQPHtBuy0pRPR23bzy3YO4uy92EMVyzx+OFh3c3DDp+k0ntWtrb10vqHGR/4LBxb5oTT5/+cRnvnvl/SqbJ7abQ3GMuuyPZXHDsZPOkTlFPW6hGbqhhl42tgu6v4Y43SN2MgnZlP7uVvqdcNt8Ttn5GnkHfWznk3jsyyGxFQmw8W+idwiwy8OOyQsyOw6JlYvPBwtbjz/J3GvB5Og6Lz9PurMqitjSOQ9teLOtn1HuMjlELpYlomjmT1Nk2td+Jo1D6cRZWv/eYHhNvv0NDr7fMpnYUytB2FOEwnQd7OrRNSkNDK6nLj+hnOzhI73FkhIbnz5f0mLD3URfiWEL3u2XTZ9Cdo2EAYigU/BBy6QYA6O+j9ipTiex8CIIgCIJQUWTxIQiCIAhCRTnlZJe4T7chTQ9l+mQuczwQJ83sOHbG0FFur8bY8onLI1bi7c1xXAFHSzJMDkAyA9+qd4r6s+ewKHmZjh2kXHa11KJmN5G6VAS5pLLOKjMXVc/UZWVOvqvtKFnqOJbJ+DmPSnw66rnrPigM0wiwCmWdTFRR10DXpduX2A1VmXRaGehZOiyrLZYZiszl0uRSGBqjio0JPA7LTHLI56n7X0NDOjiOxahLM46k2NXLsraO6wB+Yhgvsy+XWXjGTuKWy7bGDSRPlD367MpFOp6NEV1f2r+b1B1668XguNmi76KWOu3OW3PWGaSu8wiTQ/ceCI5jcTq2lrRpl/hyiUpERZdG8EQ79aAUy/CKBr9lsb5iZUDSHFOvwTD0MzF4tmCe/no8TNTv7B0SidBxWEI35rIos/hZjifTAQA0omywHpOIdqKIz29t7yB1nkUjnrbN1t/jsOjPHqAsyHEazqDzkL5Gx0E6n0IhKoP7SDbr6tlO6uob9byc0Ug/l6Ce9NDdnQmOh3P0nZKqoRmCpxLZ+RAEQRAEoaLI4kMQBEEQhIpy3IuPl19+Ga666ipobm4GwzDgqaeeIvVKKbjnnntg5syZEIvFYOXKlbBnz54P/zJBEARBEKYdx23zkc/n4bzzzoOvfe1rcO21146q/9u//Vv40Y9+BD/96U9h7ty58L3vfQ+uuOIK2LFjB0R5zNqPQbmYIWUT+cz6IebiyPRJxxzbjsJCdSZbkxlce0fXNEaZJqD2sGtgd02uVPKMoVjvt5hfcHWNdgNraaOuZnteeZmUFy3/ZHDcMdRF6pSrbQEiFh0KXCP2kE2KNyrI8omHu50qFtLdR/YH3PsPhxrnjq1llg3WNLWGPtibod/jaR16xkyqyw9naV9i18UyD52PxpNtU20bt91ndi4+GxPYrsNXdASFUPhnHgZ9ZISmBU1Wa5di7jI8OIzCxLPQzPwZTAajw6vrvvPYPZtR2peRuL4vk70LHND35Xo5Upf36Pwu92mdvmfHZnpu967geN5cqu83zJ0XHM8+71JS19lHr+m5Otto7sgBUlfdpG2zzp8/i9TlbOoO3t2jQ4339lGbAuxWzr2kXZ+FzldjP1sP2X+ZYf6emHiGaxwWweBZdhX921BC4ed9lz4fu0qfy7NEc1fbujo9b99++x1Sh6fbUJa6pL766rukvGe3nu/V1dQN1whrG4x9+46Rus5O/Uxcj7k3s/lEakt0rHcfzATHhSx9Bi2t9N1k2sgIxKT35TiTHyZhohz34uPKK6+EK6+88kPrlFLwwAMPwF/8xV/A1VdfDQAAP/vZz6CxsRGeeuopuP7663+/1gqCIAiCcMpzQm0+Ojo6oLu7G1auXBn8LpVKwYoVK2Djxo0f+plSqQTZbJb8CIIgCIJw+nJCFx/d3d0AQN2bPih/UMdZt24dpFKp4Ke1tfVDzxMEQRAE4fRgyuN83H333bB27dqgnM1mx12AWEzTs5CYyWNneEwzx27eYaZdKhKumtl8MHsI09JtiEVoyN4YipMQYjYukWqtxUUjtI7r+1ZEXyMcp+fObNQ68Iwm2lf7WWroAtIjG2bSc+fM1bEI8kNUq1Q+FYnLKMw0t5uYDHyg/WGwZxLCIjazyTHJmKDfa7Aw7S045sUQjfNRVa194pvPrCd1Xp5qsm9u16HYjxW5zZDWdtMxOpaqU9puoKOzh36OxaPAdkAesw/xXPRMmJbsjNBzk6g9kaYqUrf1BR3vwHGZvg+T/9wzJRrHwkZzz+a2NCXanmEXhSxncWrcfp2GvIq9Q5wEtd3AY29omKYvr0bzqbFlAak76w+uCI7TNVSHTybpvJzVpP9BSySoLp9F7wI1nCF1NXOpDUhs1sLguAjUjqKrQxv68wgtsXQtKTfU6jK36xjo13YLwz10jhg8Hs94ePp5KZ+2ta+f7ngPD+lzbdaeOa06BkeExanhaQeGM/p7nQIN6Z6I6mfJQ6YXC3TuHdqn/3lWiv4jnUxqO5zqJI2jkc3oOC0We/fwOWygp2QYzH4R2wCGaZyP+noa6COR1OObmbJALIH7ko7tSnNCdz6a/stQqqeHvkR7enqCOk4kEoFkMkl+BEEQBEE4fTmhi4+5c+dCU1MTbNiwIfhdNpuFzZs3Q3t7+4m8lCAIgiAIpyjHLbsMDw/D3r17g3JHRwds27YNamtroa2tDW6//Xb467/+a1iwYEHgatvc3AzXXHPNCWlwPEy3TBXo7amaerp9ChHqlmahLdxEIkHqcMZDm0spcbo1nUDb8Qm2UxOP63KMXT9qa/kkEqVbZ0aIu/7q+zJ5BtOy3lL24rQ/alYsIeWOt3S49YVfuobUmUg+2fK/XiR15TKVFXxTn+sB3b6cDHgobZ6xGEstNhsT2DW6UKDb+Px78HZ4rU2llQVLLgqO3+qmobS9At3PxO6toTCVyRzUzzPq06Qum9fbsi7TiEIW3VLG96VYqGgsMc5rpVvz3R3v0e81MsFx70AGKHis0X71PNqXk8GxTIaUbTQPQnzbOjx2KHYedttFoevTFp3f8y+dR8rFknaLLfr0mu3nXRwcX/YHnyR1dej9M9jH5AnmWhqN6vdPnEkQXT2DwXFueJDUlQs07LZx5tLg+JyLL6N1MT0Oa5P0HTbvrHPpubZ+H3ksfoCL5KzBQzRM/KG9+2GiqLD+nmiIPoPDhztJ+Viv7r/qKvquTiW1zDCjgc5Z7rCwf79uXxV752eQFMdDHQCTRMgbmHkXF/MoDQPLkJxAf1dKDnV5VyyTr4/kUsPkUr8eI8kU/ZtTl6b3FYnp9jQ10b+JNfU62/JvfkmfZaU57sXH66+/Dp/+9KeD8gf2GqtWrYJHHnkEvv3tb0M+n4dvfOMbkMlk4LLLLoNnnnnmhMT4EARBEATh1Oe4Fx+f+tSnRhl2YgzDgB/84Afwgx/84PdqmCAIgiAIpyeS20UQBEEQhIoy5a62x4td3UDKrbO1Xnv24vNIXbKWurthvT9iU5sLvJdTZimTHRbC1wpr/Q3bcQAAVMW0tsqlJjVOyeBx2pFm7TNtsIxSZ4dZuuk0c6HrG9gaHD/99L+TulJR2y24itqVuEzYVJa+Fysy+cPGtNjzYRp+ydF2JwZVZEkK8HLZYXUs5L3Sz7InQ20astu1q+Jvtx0gdc0NNaSskGtcyGSpzW19zUQVHROHew4Hx3aM2gilquj4PXasV59r02eAwybbJtWvZzXTe75wuXaxDu+iIbnDb2sbIe5Yi0OdTxZ9GWrjEDZwqHx6Hy5P546qeUoEE2n4A29TGxg/TjX0mTO0HVCczaeerB53vf0ZUlef020vMXf0WJrGPnJMrbePlJir7Qi6rzJ9LzQl6BjtPKzHaLGW3sec87TNUirJ7CZq6Xv0cJd2H2VRwKGmTp87bwa1IWhacCZMlFxJzxFP0eeTG6FjNozez60tdB7MmtUcHNtRape0c+dO+r05bWeBbVcAaAoHxezqXPbOxyYgfN/fQfZXA1lq14FtPkyWVCPMxm8ZXYS/7wykNpjs75M7Qm3wZqSRrU8NHRNlb/Ld5SeK7HwIgiAIglBRZPEhCIIgCEJFkcWHIAiCIAgV5ZSz+Th7xUpSvujiFcFxikdHZWmjc8gHvMTCOB9Bmmd2OE/qDObdE0Whz9tm0ZgKCqWNHvGpFld09TWLPE6EQ9tTdrUGWmChfgfyWlsO56hWOvjeLlIO12r9epDFDHCK+nvDEWpjwUxiwHW0BmlUIC2zz+04eD3SPfmzxGtqk+USDzO7BQ+F6B7M0OfuhXU5EaHa8rFeaiuRSiMbEBa+G8eqOHroMKnDrUlWUZuPeua/nxvQz4Cb3Shb17XV0e858ywa/6EqrXX7GY10ztghHRehzELcO+Wx066fKPIlOtYtJH1zex2H20nhFPLM5sM2tW2PU6SxILY+/xwpz5ut53QkT+fpwR5d7h6g+n7rsK57Zzu1K/FYugK7WtsxDO0/QOoMFE48HadxLGoj9J2WV/qa+959i9TVL7wwOK6J0rFEvwWgiN43ERaswkHdnmFh622WXh5yY8cAMoy5+js9OoDrG2iLeo/oeRkymQ0eele+s/0dUrdv3z5S9pDthj9O7A4eF4aX8dDjzp4emsWFMrNdCetyiL17DJ+eWyY2IcwGBdmuZVF8EgAANUJf1glTPxOP2dIUHLH5EARBEARhmiKLD0EQBEEQKsopJ7vs2k9DwnqW3g+b20YlkLMXnUXK0TgKIazodpQd1V1RZTA3T7atH3L11nD/ob2kbhBlDM320kyxpYwO0e2M0C3+0nCOlL1hfQ1VpFtlflm3x/Ho9pzHQnJH580OjuMm3SItm1oe4FlAHSYDKbRF6Ll80/bEkx+h1w9bdK8Tb6G6rO3YbVkxl75yifZ7V1mHcY4wcacworfnZ9ZQKeNAB322LspmDCbd4h4c0s992KVb9fVNeszmhuh2ama4l5TjSvdJiLlYR23dB4vn0+zFb727g5R//ewbuhCmLqAWeiW4LpUniu7kh9V3eJhrNfb/RyW2/22gbW0WiR18pfvLZCH2o4qO58zBQ8HxrAR1jV6+Qsu8nccypC68Q78LXvzdK6Suu5f25QULtYsqU4igZoaWwnJ5Og+GC/R7quP6w002kyqRPOpz6XaYfo+B+iDBMsUqpccWD0MQ4mkPxuG/XX1rcFws0j5/YuBRUj5wQEthcSZjdqHMuke76BzxWPtomgYmu6CQ9yEmzyrmxe2psSVHnIHWZyELRkZ0v9cmaL8Cy2yez+B3wyihOThymXSSzdLUDwP9KBN0iV6jbPLvnTpk50MQBEEQhIoiiw9BEARBECqKLD4EQRAEQagop5zNx0AXtfk44mmdzOk+QOrswS5SHslqu4rBHqrZF1Go5PIgdUl1S1SftJTWzULMfSuGdGePuV1ZSA8cpTsnmG+rrXVfN8pCgiPdzmXuh4MFalOQzWqXUM9lLqlFreEXClTPL5RoORLW91UuTr72z8OieywUsYlCqJss/TTWfbl9ijVKS9X0DVG7mwRKId8/cIjUzUjS8OojyFUxxET8EnLBDCnqupnr1qnEd3d0kLqLzmM2S8j/mbud4rH2/AsvkLq9h+nzGijr/vJDNPU7ThegWChmJoNPCmUW1lqhq1oG1dNBsWc5jluuQucq5sYYZm9BH6UduPDcZaQuhFzS//ln1E7hv3328uB42XlLSd2+/dQFdEatTgsft+hzfrPzSHDcl6Uu3bUs7UAo1hQczz9vOanrzyM38k76LjSizDasSqeFcJmNmYlCmFvMNsIfxxaCk+vR9/I//+eTpO7JJ39Jyo6j53DfCJ2XrqttHAz2J8yyaJm6zLL7QvfCw/FzQxw8nAxmEELsB5nNSTyi+/mCM2iY+EyJ/n04Slz96fgNhXR76lpoiPt4K30XWTN0uT9D7UGODVK7sqlEdj4EQRAEQagosvgQBEEQBKGinHKyy1IW1TByTMsnw+9Rl8Jtv9tEyrG4dpfkmQDjaLs5xtzrqlJ0W6thVktwnGfyQOeAbk+ZZR4thfT1wwnq9hpi7mRv73w3OM6xrJfp2nRwnGVZQAf7eki5Gt1LiEVc9VA0ybLDMj6WqURTRG6NiklNkwF3heZ7/hbahhy1ZYq2RXlUQ5v1c7JJb2EeG6Huh3W12mXW7aPyxJHDnaSsqnT207YZNGNoMq63UK0s3ULOH9Pf86X/7dOkbjhHJbSd+7T0U2IufVUo0mQv+1zRTLO26giWHnMzNVFG3FiEuhcbJi1PBoq5z3r4+TEpxWJu5XgbnWfgDSO3SmAZTBWTDhIou/AZc+eRuu17dQTY2jq6jT53js4WfP6SBaTuwvPPJWUc3fJAB416+792I4nPpPfoxui7yK3TGV5VQxOpq8vqbfzBPrrdHmYZt/M5fS4XUkwkhYVYFtlieezowpy1d3wrOB4YyJC6mTPpnDnnnE8Gx/E4HXeHDx8NjjdveoPUZbP0XYmHTFV1FamLIH9sh2e/9ugLx0JSdzJeTerOPHO+vkYNjUh7dK9+jy+YO5PU7e6k7xTqCswyqZtabiuM0HnQ0LiIlBeercda7zH63GuRW+7zz/wMphLZ+RAEQRAEoaLI4kMQBEEQhIoiiw9BEARBECrKKWfzcfb51IXNL6Mw5CzktBOmbmlWtdbwTeZqZiA3xiIL6Rypolke7ZTW119+jmbEfHaztjMZcalr14Jzzg+OL7/8HFJXGKYuUbv37w6Ok6ytzWmt10ZiVL+umUl1aOVpLdNlodjdqL6vGHNxdFye0VSXHWfyw6vH4lST5tlow0i3Vz5zq0R6usmX1wYd8gf7tUacAaot57u0Jrt//35SN9DH3P9CWgsPVVFdPIEMVupS1KahZaEOfx8GanOyew91zyyh9llJ6m6XRZqwb7PMvSzWuBvS7fEUHaNFFA4aFH0GsRjVuicDbvNhYDsObtvDHq6J7tNidh0h7E/LPHQjrH+WL9aaeT2yrwIAKOb0M6phtggtrTpUfg2z++k6Sm2EYsgeLMGycSciel6OsLnmV9H2VM3W9mcuexeE88jtn4UWTyWp/cMACi/gDVOboZiv2+MUqY1HiadaSNP3DyYa0+Ppf/yPfyR1s1qoPUQVyvAcZ++CHMo6/tA/UbuF+x9YT6+JQpj/9//+LVI3s1HbZ/R2U1s5z6fvw1QqHRzPmd1G6s6cPyc4NsK0rT9+4IHg+L2NL5K6gwMsezoZl/R5lcraXi8WpekTrr36RlI+a6FuzwjLnl5G78YHHxCbD0EQBEEQphGy+BAEQRAEoaLI4kMQBEEQhIpyytl8dNc3kzKWdktMqywWqaaWH9J67dBRem4efXaon8bO8Fl8gaZWrbPu2LmL1B3tR3E+mA981aEDwfGcWbNIXSx+Bikf2KP9wz2H2hfEk1oPVS61a1E+tU8BpF06LPSvh/R1GoYYwGU2Hy7ye+cp7CeDeITaTQBLte6hdOGex0Ov6zW1HWb2Dz79nqGsfkbhMO07H93ngWNUO42y/koZesyo7rdI3ZnnavueRWfMJ3UdB3W6gL0dNO25W0VjBti2trkoKfrcHdB2QR4LOx6Nspggln7uhkXvGacZN4r0Hove5IfV5/E5TGSgwe04eLyOcBilSGfpC8Ihfa7r0HmpPFo+s0XP7zltdJ5edrEOYR4LU5uPbE7bbR1lcWEG2btpwTxt65OupfY755yr7b22bqNjyWEGKz4Od87sZYbR+06xecDDq9fW6Tg1g/00NoSP0kvYbF763A5nHGbN0u/u889fTOriCdqXjqvHms/m7Ix6bVdy/Q1fJnVPPPEUKR/r0+/jSy9rJ3UrLjo/OHbZu5qHacd/AjxmH1dCcZgKivbrTV//P4Lj/6uTpgb57fZXSDmEbPDOXXgmqevu0TYpN3/tBlJ38SXnkbJf0n/3aqtoPKlKpEiYKLLzIQiCIAhCRTmuxce6devgoosugurqamhoaIBrrrkGdu2i//kXi0VYvXo11NXVQVVVFVx33XXQ09MzxjcKgiAIgjDdOC7Z5aWXXoLVq1fDRRddBK7rwne+8x347Gc/Czt27IBE4n031jvuuAN+/etfw+OPPw6pVArWrFkD1157Lbz66qsnpME/++lPSNlHYWjtEN3ysll46CjKflpmWVz7BvQ2aVcfzQAZS1C3tNheFOKYbXHPmT0nOD7cSbOU7tz+ZnB8tGMvqZu/gG6z2WG9nZpz6DZfJqdlGJO5BVts29oYR1rxURhyLl2Mll1Qplhv8sOr+0zaMXzq0lcqITmJufvZYb01HLbpmHDK1LXUQuH6E2yr3o9q2ePCS1aSulihm5QbXP2sP3vJBaRu9ry5wXHNLOqCOYBkn9191NX2WIHJJ2iLO2wzV1LkQuyPI1EBABgoY6gZYtv4WLJi0dSdEg+lfeLh292mGlt24Zmhceh8LruE0GctYNmmS0yOzOtt66oY7YTlS7Wr/8IzaFjrgoOkOSZrLFy8hJRrqvUW++Ax+s/ZOWfr8ZIboPLNXib/RdBcjPu0f3p69GdT9bWkzmGunFE0T2bUUxnIR3OmXGLzJzTx/1+HslrO6WSuxwsWUNkZZzPmyo6HZLJ0MkHqZs2kIeaz2UxwHItQN1gX3ReXY3kZu4Bz2cVB2cIdlgm6sVnP969/czWpe20X7YO9+3U244b6RlJ3abuW+/7oyk+ROtel7w1w0bP16ThUMPnv7olyXIuPZ555hpQfeeQRaGhogK1bt8InPvEJGBoagoceeggeffRRuPzy99NLP/zww7Bo0SLYtGkTXHzxxSeu5YIgCIIgnJL8XjYfQ0PvG1jV1r6/qt66dSs4jgMrV+r/EhcuXAhtbW2wcePGD/2OUqkE2WyW/AiCIAiCcPrysRcfvu/D7bffDpdeeimce+77EQG7u7vBtm1Ip9Pk3MbGRuju7v6Qb3nfjiSVSgU/ra2tH3qeIAiCIAinBx/b1Xb16tWwfft2eOWVVz765HG4++67Ye3atUE5m82OuwBxynRn5J0d2iW1uYmG6F0w7yxSjiJN2GDpuIeOaFfJQ500lHZDI21PycP6Ol2/RZFLm2FStzQbhU3ew2w+Dhym9iFdnTqtdrqKapVgIDdT5l5nMrsXEpLa53ofsgdhdhM+sxNwkN2Jw+omgwKzcwkZ1CbFw6YK3D0T23mwugJzqQuhMeEqeo1yWbehuYWOgfAw7cu6grbDCbOw/nHk7pZuoqGZUw3aBbPwHjXejkWom5yNXIH5o8RaLvMMhzKz1QihcOIms7HAYfWtMHNltSbfM99kr6R4VNtccJsuk4VFD6MQ6hb7vyqMwt8rg3ZeXNH+cYZ6g+NsTy+pq27U75hZbdQ2wnG03h9O15A6O0LbXkCpzRWzt0pYuq3xGhquvJihNgUtKJx5fz91yc8jt9yZ1bQ9ZY/O9xB6tvFqlmYA2ZgVhqmtXKnMw6vDmGQy+t29afMWUtfWRueXYWJbNfouMNFY52Mgxf7xtVG483CIzksPTSL1kT6oui9Nk84LG487i4UhUHo+LTmPuhf/yfVXk/Lf/z8PBsfJKJ0H13z+D4Pjlhl0TDhFagdkGnqs+ey9ye3+ppKP9TZZs2YNPP300/Dyyy9DC/KJb2pqgnK5DJlMhux+9PT0QFNT04d8E0AkEoFIJPKhdYIgCIIgnH4cl+yilII1a9bAk08+Cc8//zzMnTuX1C9duhTC4TBs2LAh+N2uXbvg0KFD0N7ezr9OEARBEIRpyHHtfKxevRoeffRR+NWvfgXV1dWBHUcqlYJYLAapVApuueUWWLt2LdTW1kIymYRvfvOb0N7efsI8XbDkAQAQQ1kew1HqdnXg0GFSHspkguMicyXN5nSdV6JbU7kMjU7o+khOYa62VkJv89VU023zmiqdvfK1zdT1+NAhKsPMRtEAq5H77n9dVLeFuVUWfLoFZ5PtZrrWLCOpxWOurR6PeIpc+krMXXUyMNgWu8/2RS2saPksiily0+PbwkaIuaiiXTemxAGgjKI8e+cQygIKAFCDNu9GmBt3d7d2eezM0Ki7b76nbaGyRSaBsICeYZStlkcCxVk4sfwAAFDFolJ6Lpbt2JY20my8CmQv5oQsugsaCqFtc+Y2bdvM1Ra505rMHdxHdXz0VlfT740ndJ/09x0idUVL991QkWb5Vcj9Oz5AJZBqlu11GEmXwwbLMBvT55pzziZ1Z8+7kJQLaCIUh/pJnRHXMp1iLvlV7F2J8VkU1TCSvmLVdLwUhjJjfg/nE3/wyeD4of/3IVIXYtf84hev0gUmI3qm/sWoiK9MGrSQe61p07GF3ygGc0FlajYYaF7w7Mouev/wUAe08bStN9/8v5Pygnk6mu7sVhpZ1wA9F8Ps3RwymJyE2qeYLHXKyi4PPvi+JvWpT32K/P7hhx+Gm2++GQAA7r//fjBNE6677joolUpwxRVXwI9//OMT0lhBEARBEE59jmvxofhy8EOIRqOwfv16WL9+/cdulCAIgiAIpy+S20UQBEEQhIpyymW1PXiAZgY0kdvp8BDV4atZpsSaGl3moZpDM3X44RBz7aIGBgAlpCfz0N5hFK7aMGhdNKr1x7hN9b+F86jx7gfh6gEARph7KNEcmc2J79Oyh8KSWyEeald/j8/zHfKYxsj1zQpz44gTD28PzxCM74W725WQTUOhSDPFhsfRfUeFmEf6qM2uUc3sec4+U2u0Fy1eSOoicW0bcHiI2nxkCzqUfzhOQ2CHDDruDKTbMxkcfNR2/h8Ff+4+Ci/uMrsO7IbqsXngsrDSk4Fv8sy1yI2RuTBbYf76QvYqzBbKAv29MdZ7DXW031tR1up0mmb9jSD34/6eDKkbymhbHzNE6xLNdNe4XK2vORyhbrB9zfo9YaVYmO8MtSca6deh2SNx6pIfKej3ncnsZcJxlsEZPWtuF4BD1SejdEyWzYmH675tzdeDY9ukY+mN16kN3OWfuig4rmeh4bFNl23RZ1nPnteiM1H24GqWARyNEYP5p5smLeNdf64AGCS1AZsjBv4cfZaxOO3LKz736eD4rTffIHWDA9o1e1YLtQdJp2j/+Lh9E1ArpgrZ+RAEQRAEoaLI4kMQBEEQhIoiiw9BEARBECrKKWfzcc5CmnoZp4K2DKq31aWp/zyGa3xRpB9HmL2DwXzHlaF1X5fFuXYU1k5ZWnj0vdEItUexDHoN/FmewhmHBebxL7jE5+J4JuyeDXwfPA07i/thIpsCw5j88OqeS6Mx8JDhOM4Fj3mBT7ZYXA/el4BsYoDp0ArZBvhM2963bx8pt8/Wdh4lZp+SGdJhpY14mtTNaNSRf/P9VJN2WRh7bHPhcJuGcfrDYzFtcDhvi8csQOPXZJ2uKhAjwFfseSE7F4fH7mBjNGzqORTmQVsc9Nkyi3mRnk3K0YZFwbFKpkmdGdH2O36OpnooxfWYNVpo6PWRJLURKqBUC8MsBkefo/t5iNnk5FjagSKa8CazgWlDdmQJZuNRZLZqRRyCn71DcnkU50jRz8Wr2TvWG/vdYIf0Na677gpSt2fPe/SaWW0L5brUls9DYezzOfqe+MIVnyDlCLLxihrUXqZc0PcSClN7mfB4dm3sJYvf3SazJXQ9fc/83eMzGxA7pvtyIEf7+Te/fTk4PueCZaSumg/1IrJlYTGQuK3jVCI7H4IgCIIgVBRZfAiCIAiCUFFOOdnljNk0KyjJ0MkkCINtj2E3KC672Ei+GbXFH6LdZKLtXZNt/RqorBTPKIjCopdZON8QbysOoc7ORfuiZbY1z93AsNucw9qq+I0iXJfLMPh7Jl92iUWY9GXSbWMPpbXlbrhhLDswN9NyibcdbVuz/ogh1+hyibrIHjl0hH2PzqBcKNEQ97mcdpOLRqncZoewXMJcfd0CK6Pnx6VBVPYcLvfRlppITgrzTLHo/xGXuW275uQ/96ZZdH7PnqXdXgf6jpE6nBIBAMBB89t1WebaKr2l3bbkXHrNi1eQcg/Kqt3DXL5DSBJx6+iYLEX0e8Fhz9ll89LJawmgwLIOj+S0zFHK0zHgu/RchWSQRJKGe7fDOLUCGwQ8Q3FI3xeX10J4HrCxpdyJu19nMlo+6e3tInW1aSpLuSUtpwwO01D1PpIy8jnaH2fMXkDKYRSCf/+et+k10HsMh/EHoOMFAMBCaSrw+x8AIIr6mcsaFsqabbI0Bz57JmUksZ254ExS9862HcFxPkv7I9yUJmUXhXhQwNz1eUiFKUR2PgRBEARBqCiy+BAEQRAEoaLI4kMQBEEQhIpyytl89PcPkDK26xilXxtUf8P2EDz8MlZkfYPZWPAItVir45WobDBdHtuA8FDeXCvEbeXhjsn3MHfe8VImjwoffhzhsh1kW+JVwOXSYXYTsQTTYJF7W3GE6uImsqNwy9RlzWDrbRuF7K6K0fGDU3cX89StcvasVlI+2nU0ON5j0fZURfQ1/CjVlp2Sbp9XpvosAA8pr9seCrGQ/8iV1GHumfEECxGO7Jscj55bKmtbhHiMfq4SbnpX3/g1Uq5vbAiOB4fo3O86TN2dO/ftD47VCHXBXLjkvOB4/oVLSZ3F9P0MGt9ljz6Dsq+frc9CcONU9MYws9cpMlsNNPeKI3Ss57N6rI3kaV2pTO+rOq3TMFSx8OplNPZHhqnNEvPyBAO13QzTOYJt3pKxNK3jgf6P9cBY9PT2BcdNTc2krqW5iZTDqG89h9u5YLs62tZ4goaqL6H3SCTCUjY4us5gYf2ZyRD0DyJ3X/Z3JWLrslOizz0eRyk9wiz1hUefpe/r7ykVaQOuvmplcDyc7Sd1b2w9SsrJZDI4Vsx13eJhCaaQk6clgiAIgiBMC2TxIQiCIAhCRTnlZJdCiW5VhfF2mcHkAItFokNbTsx7lbhdmTyjKwv5h7caDbb1aqEtSu7OSzLOutzNlUWiwxErmbRDXOFYpEKTReKk0S7Hdu3i0VhNtg1pWigT6nG4131cIm6G/sKhQ7WAJSTWzxbo9iVCtK22otuiMYXkFD9N6rKelieiNn0+GeQOCQDwi6deD47PbaNugxedq6PyXlRH5ZrhoQy6Po1wyl368POz+PNBmWptvrXKnm0ZRUAss0iyWIZx2LZwJeS26hYabTSHnqXVQLfmZ8+kUURnL74wOMYusQAAIeQOWWAuxM4QdV10sezK3iFY5uSRY/F8N9hc41lScfM89n4JISkwnWZRb9k1LZQdm7vd55Gcw9tjsBeggyQapVhEZyT3+d4ov+0Jg7N6t7VRl+owy06LM84WCjQyKX6nJZMJUpfPZ0h5eFjPU/6O272/Nzju6aOfyxeo1HPoiHYNLo0Kb4AjitLPLV6oo8zOm0Wzz9oWbU+qVktGqaokqWtoqg+Oe/upPNzTQ13QsZu5U6Ry8XCeym9Tiex8CIIgCIJQUWTxIQiCIAhCRZHFhyAIgiAIFeWUs/lobGhgv0E6uMVcxFgZZyrkmT8d5MIWYhrsqCDk2NOW1eJPcpsP7D7rusx9ll0CuzWOdrXFodeZq+2ozIn8mzUlZD8znovu+9dBYaUrYPNxZjW1zegq9tITlHZhSzDX6DoUmr0mTTXYap+6azZXaU39Z6++Q+qef09rqeUi1UpzA7Q9YdQ/yQTVhC8EfY3hLOs7T+vgjsuy0RrUnRbbAZWKzN4APWebucSWRqh9ioXsD3iofAfp4iXmhsttEyaDvkJ27MowcxtkbsvhqNb/IzF6Lh7d3GPYZPcVRmUejhqf6/hj24OMSt8QobYbEdT2ZDXV97EtyahMqGyellC49QJz88TZuXmGZIOF8seuv/ydge+Ehyg4Dm99YvPB4feFXeRzzL7KtvX3RCJ0fg8P0/mNM1zkh+l49l09EIZZdtz9HZ2kbKLsuCGLu8RrRnI0A++hg9q9uDZOXbpVmd7XQH8mOG5opn/nPPRMfvviFlJ34CC9ZgK594Ys2q8RNg6nEtn5EARBEAShosjiQxAEQRCEiiKLD0EQBEEQKsopZ/ORSCTGrON2HFx3xXYUvA6QfmuHabfwMOnYQsMfpftqjW20zQf+Bqox8tDV2D6Fa7BYH+VaKb8m1oz5ubi/eEhuxW1FTKRnV2DJOjdFxeSZ0QwpW4aOzTAqxHNJ1xnDNNxzCOh97u7VOuzG13eQuiODWk82FH1eVTZ9XrNm6FDkV3xmCamrSegOGx6mtiLK0vqsMnjKehbyGdnalFkadvws7TCNA2BYtOwg3d5nsURcNJ59Frqah/KfDErMBsXDtljsvkxFn7uL0sQ7JovvgmJVWDxWBhvQOEW6z2w+wugadpy2B78XTDafx7Pb8pnNiYOuWSjTGBelMn3ugMOQm9wmRo8t12DvmzC9ZnUUpYUPsZg6Jd2GIrN94u/c8Zg1qyU4jkZZTBvWzzjsx+y5c0idjx6f79P5XF9fR8o4/HpdHX1erXN0iPcViqawBzZnAPUtjsMCAGCHtQ2K57C4OSVt1+GWqI1Hpp++C0p5bbPjMtuaXEbbQkXD9G/gSL6PlMPIPsVic8YDPmanDtn5EARBEAShohzX4uPBBx+EJUuWQDKZhGQyCe3t7fCb3/wmqC8Wi7B69Wqoq6uDqqoquO6666CnZ+xEQ4IgCIIgTD+OS3ZpaWmB++67DxYsWABKKfjpT38KV199Nbz55ptwzjnnwB133AG//vWv4fHHH4dUKgVr1qyBa6+9Fl599dUT1mAuK+BtP74FyKUMLNnwc/G2KFccXBbCnMgwXL3B26usDrdnlKzBwBl6fcVCRaPv4S50hQJ1t6OZfOlWdAhtr+ZyNMR02eFh21GIZTX5YbaTPt1KrLOZ+x8KCz40RN0zE1HdP2ka0RhGSvShPPaqzoR6bJD2QcjUzyDMHmZjPf3iy5bpcNGFoSOkbtjR7altaCF1holDndMtdtdhW/f4+XFJD0fuZ8/HZW2343oe4AyqAAAjKKy0w7Z+7fDYLoYninSSup0aZd2GUpH2j1OgGV9dNNYd7h+PXAyrmMtnnGXDrraRXAG0D4rItZVLKdhtucRkMT6fSPNCTF5DlWGWqTbPZBgsxTEFGCwbZ2ymGYpNJqFhV1uPtTWEXFJ52gX+bhyPGS0XTPhc4fTnuBYfV111FSnfe++98OCDD8KmTZugpaUFHnroIXj00Ufh8ssvBwCAhx9+GBYtWgSbNm2Ciy+++MS1WhAEQRCEU5aPbfPheR489thjkM/nob29HbZu3QqO48DKlSuDcxYuXAhtbW2wcePGMb+nVCpBNpslP4IgCIIgnL4c9+LjnXfegaqqKohEInDrrbfCk08+CWeffTZ0d3eDbduQTqfJ+Y2NjdDd3T3m961btw5SqVTw09raOua5giAIgiCc+hy3q+1ZZ50F27Ztg6GhIfjlL38Jq1atgpdeeuljN+Duu++GtWvXBuVsNjvuAoS7hGI7Cm7jwQmNk+4eu7bm80xLZnYViSrtnsnDDSvkNsfDCZvIVoSHgh+lCeP2sfTXuK2KCb085fZ4brnYLTjE3Ot4PxM3Qu6mPAmkYvS+TJO7jOm+dZlmb6A07KEkfQbeMLWJOdKrbT4U83QNG7oPYmymGA7V9EvD2l6kK0sX205C91coQQ2wSzAnOC6wkOkWD92P3TOZXYeD/A8NNg/K7Ln7aDz7Bh+HyAaFje0Qdz+cBDzmPhtL6LlmMzd7z6dujUXk5qgcatOQRp+N2sxVko19A83NsMHd7vUzUKxfcyj1u+PS8cGfl4vml1ekY12hZxK2qZ1NiJlbYVd/bmfiYLsyls6B23Uo1D7DpM8Ajyffov3B3z+CMFGOe/Fh2zbMnz8fAACWLl0Kr732Gvzwhz+Er3zlK1AulyGTyZDdj56eHmhqahrz+yKRyEkVb14QBEEQhMnl947z4fs+lEolWLp0KYTDYdiwYUNQt2vXLjh06BC0t7f/vpcRBEEQBOE04bh2Pu6++2648soroa2tDXK5HDz66KPw4osvwrPPPgupVApuueUWWLt2LdTW1kIymYRvfvOb0N7eLp4ugiAIgiAEHNfio7e3F2666Sbo6uqCVCoFS5YsgWeffRb+8A//EAAA7r//fjBNE6677joolUpwxRVXwI9//OMT2uD/82//7xP6fcLJicHisKRqaFyNkTKKy8LiT5RK2mbHYZt7ieoUKS+/UNsXZZyDpK5tzix9DZZe/r391Hbj0H4d26M5SvX1gtKaeU839eYqJLW+7rp0OjJTFhKA2vWYDQGK2+CXWCwIZm9QzqOQz9xGCNkJhFlMB1WB8Ooes3MpIruKiE07xPe4DZNuXyxEpVwLhZHnNg08zgZ50iw2DrbzsA36uQiyiXFYKnMzTM/F9hkus08pl/QzyQ7QdOk8PlEspm2auN1WeUTbN3mKXsNgphol1AZmdgMqpE8ORagNlSFBsoWPyXEtPh566KFx66PRKKxfvx7Wr1//ezVKEARBEITTF1m2CoIgCIJQUU65rLbC9OBo9zFStlj21SjykFI8Y6eht5vNEpUVohEaZvoLn1gUHM9pqaeNMPU1uo5RuaSjo4uUPV+v4z22po8jqScSrSZ1KGkrRGzaNuVRl28sK3BZCnvMOmyLnYfVx2pKjLnPzpilM31yh+qR4WGYbGzmWmqh+7TYPbPbIjKMZ9BKB91NNE4lGW9UxlnkdsokK+xK7/P0CUgWMpgkZDAX1UhUl8M2P1fLZkaI3jOXVkJIdukbHCB1BeR6bPMQ7gXmKo5C1yuLpbBQ+ppxno2Wa4OCMEFk50MQBEEQhIoiiw9BEARBECqKLD4EQRAEQagohvqo3O4VJpvNQiqVgrvuuksinwqCIAjCKUKpVIL77rsPhoaGIJlMjnuu7HwIgiAIglBRZPEhCIIgCEJFkcWHIAiCIAgVRRYfgiAIgiBUFFl8CIIgCIJQUU66CKcfON/gxEuCIAiCIJzcfPB3eyJOtCedq+3hw4ehtbX1o08UBEEQBOGko7OzE1paWsY956RbfPi+D0ePHgWlFLS1tUFnZ+dH+gtPR7LZLLS2tkr/jIH0z/hI/4yP9M/4SP+MzXTuG6UU5HI5aG5uBtMc36rjpJNdTNOElpYWyGbfT+SVTCan3QM8HqR/xkf6Z3ykf8ZH+md8pH/GZrr2TSqV+uiTQAxOBUEQBEGoMLL4EARBEAShopy0i49IJALf//73Jb/LGEj/jI/0z/hI/4yP9M/4SP+MjfTNxDjpDE4FQRAEQTi9OWl3PgRBEARBOD2RxYcgCIIgCBVFFh+CIAiCIFQUWXwIgiAIglBRZPEhCIIgCEJFOWkXH+vXr4c5c+ZANBqFFStWwJYtW6a6SRVn3bp1cNFFF0F1dTU0NDTANddcA7t27SLnFItFWL16NdTV1UFVVRVcd9110NPTM0Utnlruu+8+MAwDbr/99uB3071/jhw5An/8x38MdXV1EIvFYPHixfD6668H9UopuOeee2DmzJkQi8Vg5cqVsGfPnilsceXwPA++973vwdy5cyEWi8EZZ5wBf/VXf0WSYk2n/nn55ZfhqquugubmZjAMA5566ilSP5G+GBgYgBtvvBGSySSk02m45ZZbYHh4uIJ3MXmM1z+O48Cdd94JixcvhkQiAc3NzXDTTTfB0aNHyXeczv1z3KiTkMcee0zZtq3++Z//Wb377rvq61//ukqn06qnp2eqm1ZRrrjiCvXwww+r7du3q23btqk/+qM/Um1tbWp4eDg459Zbb1Wtra1qw4YN6vXXX1cXX3yxuuSSS6aw1VPDli1b1Jw5c9SSJUvUbbfdFvx+OvfPwMCAmj17trr55pvV5s2b1f79+9Wzzz6r9u7dG5xz3333qVQqpZ566in11ltvqS984Qtq7ty5qlAoTGHLK8O9996r6urq1NNPP606OjrU448/rqqqqtQPf/jD4Jzp1D//+Z//qb773e+qJ554QgGAevLJJ0n9RPric5/7nDrvvPPUpk2b1O9+9zs1f/58dcMNN1T4TiaH8fonk8molStXql/84hdq586dauPGjWr58uVq6dKl5DtO5/45Xk7Kxcfy5cvV6tWrg7Lneaq5uVmtW7duCls19fT29ioAUC+99JJS6v0BHw6H1eOPPx6c89577ykAUBs3bpyqZlacXC6nFixYoJ577jn1yU9+Mlh8TPf+ufPOO9Vll102Zr3v+6qpqUn93d/9XfC7TCajIpGI+td//ddKNHFK+fznP6++9rWvkd9de+216sYbb1RKTe/+4X9cJ9IXO3bsUACgXnvtteCc3/zmN8owDHXkyJGKtb0SfNjijLNlyxYFAOrgwYNKqenVPxPhpJNdyuUybN26FVauXBn8zjRNWLlyJWzcuHEKWzb1DA0NAQBAbW0tAABs3boVHMchfbVw4UJoa2ubVn21evVq+PznP0/6AUD659///d9h2bJl8KUvfQkaGhrgggsugH/6p38K6js6OqC7u5v0TyqVghUrVkyL/rnkkktgw4YNsHv3bgAAeOutt+CVV16BK6+8EgCkfzAT6YuNGzdCOp2GZcuWBeesXLkSTNOEzZs3V7zNU83Q0BAYhgHpdBoApH84J11W276+PvA8DxobG8nvGxsbYefOnVPUqqnH9324/fbb4dJLL4Vzzz0XAAC6u7vBtu1gcH9AY2MjdHd3T0ErK89jjz0Gb7zxBrz22muj6qZ7/+zfvx8efPBBWLt2LXznO9+B1157Db71rW+BbduwatWqoA8+bK5Nh/656667IJvNwsKFC8GyLPA8D+6991648cYbAQCmff9gJtIX3d3d0NDQQOpDoRDU1tZOu/4qFotw5513wg033BBktpX+oZx0iw/hw1m9ejVs374dXnnllaluyklDZ2cn3HbbbfDcc89BNBqd6uacdPi+D8uWLYO/+Zu/AQCACy64ALZv3w4/+clPYNWqVVPcuqnn3/7t3+DnP/85PProo3DOOefAtm3b4Pbbb4fm5mbpH+Fj4zgOfPnLXwalFDz44INT3ZyTlpNOdqmvrwfLskZ5JPT09EBTU9MUtWpqWbNmDTz99NPwwgsvQEtLS/D7pqYmKJfLkMlkyPnTpa+2bt0Kvb29cOGFF0IoFIJQKAQvvfQS/OhHP4JQKASNjY3Tun9mzpwJZ599NvndokWL4NChQwAAQR9M17n253/+53DXXXfB9ddfD4sXL4Y/+ZM/gTvuuAPWrVsHANI/mIn0RVNTE/T29pJ613VhYGBg2vTXBwuPgwcPwnPPPRfsegBI/3BOusWHbduwdOlS2LBhQ/A73/dhw4YN0N7ePoUtqzxKKVizZg08+eST8Pzzz8PcuXNJ/dKlSyEcDpO+2rVrFxw6dGha9NVnPvMZeOedd2Dbtm3Bz7Jly+DGG28Mjqdz/1x66aWjXLN3794Ns2fPBgCAuXPnQlNTE+mfbDYLmzdvnhb9MzIyAqZJX4GWZYHv+wAg/YOZSF+0t7dDJpOBrVu3Buc8//zz4Ps+rFixouJtrjQfLDz27NkDv/3tb6Guro7UT/f+GcVUW7x+GI899piKRCLqkUceUTt27FDf+MY3VDqdVt3d3VPdtIryp3/6pyqVSqkXX3xRdXV1BT8jIyPBObfeeqtqa2tTzz//vHr99ddVe3u7am9vn8JWTy3Y20Wp6d0/W7ZsUaFQSN17771qz5496uc//7mKx+PqX/7lX4Jz7rvvPpVOp9WvfvUr9fbbb6urr776tHUl5axatUrNmjUrcLV94oknVH19vfr2t78dnDOd+ieXy6k333xTvfnmmwoA1N///d+rN998M/DWmEhffO5zn1MXXHCB2rx5s3rllVfUggULThtX0vH6p1wuqy984QuqpaVFbdu2jbyvS6VS8B2nc/8cLyfl4kMppf7hH/5BtbW1Kdu21fLly9WmTZumukkVBwA+9Ofhhx8OzikUCurP/uzPVE1NjYrH4+qLX/yi6urqmrpGTzF88THd++c//uM/1LnnnqsikYhauHCh+sd//EdS7/u++t73vqcaGxtVJBJRn/nMZ9SuXbumqLWVJZvNqttuu021tbWpaDSq5s2bp7773e+SPxbTqX9eeOGFD33frFq1Sik1sb7o7+9XN9xwg6qqqlLJZFJ99atfVblcbgru5sQzXv90dHSM+b5+4YUXgu84nfvneDGUQuH8BEEQBEEQJpmTzuZDEARBEITTG1l8CIIgCIJQUWTxIQiCIAhCRZHFhyAIgiAIFUUWH4IgCIIgVBRZfAiCIAiCUFFk8SEIgiAIQkWRxYcgCIIgCBVFFh+CIAiCIFQUWXwIgiAIglBRZPEhCIIgCEJF+f8BINnb6FgP4l0AAAAASUVORK5CYII=\n"
          },
          "metadata": {}
        }
      ],
      "source": [
        "# Examples of dataset\n",
        "\n",
        "def imshow(img):\n",
        "  img = img /2 + 0.5\n",
        "  npimg = img.numpy()\n",
        "  plt.imshow(np.transpose(npimg, (1, 2, 0)))\n",
        "\n",
        "dataiter = iter(trainloader)\n",
        "imgs, labels = next(dataiter)\n",
        "\n",
        "imshow(torchvision.utils.make_grid(imgs))\n",
        "print(' '.join('%5s' % classes[labels[j]] for j in range(4)))"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Your own CNN**\n",
        "\n",
        "You can implement your own network using libraries such as `torch.nn`and `torch.nn.functional`.\n",
        "\n",
        "`SimpleNet` and `VGG11` are examples to help your understand the implementation of the network.\n",
        "\n",
        "So, you can modify the given codes or create another awesome neural network for CIFAR-10 classification."
      ],
      "metadata": {
        "id": "Y77itjthc5Xh"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def inception_v3(pretrained=False, **kwargs):\n",
        "  \n",
        "  if pretrained:\n",
        "    if 'transform_input' not in kwargs:\n",
        "      kwargs['transform_input'] = True\n",
        "    if 'aux_logits' in kwargs:\n",
        "      original_aux_logits = kwargs['aux_logits']\n",
        "      kwargs['aux_logits'] = True\n",
        "    else:\n",
        "      original_aux_logits = True\n",
        "    model = Inception3(**kwargs)\n",
        "    if not original_aux_logits:\n",
        "      model.aux_logits = False\n",
        "    return model\n",
        "\n",
        "  return Inception3(**kwargs)"
      ],
      "metadata": {
        "id": "I2WAdiwjXsK9"
      },
      "execution_count": 10,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "def inception_v3(pretrained=False, **kwargs):\n",
        "  if pretrained:\n",
        "    if 'transform_input' not in kwargs:\n",
        "      kwargs['transform_input'] = True\n",
        "    if 'aux_logits' in kwargs:\n",
        "      original_aux_logits = kwargs['aux_logits']\n",
        "      kwargs['aux_logits'] = True\n",
        "    else:\n",
        "      original_aux_logits = True\n",
        "    model = Inception3(**kwargs)\n",
        "    if not original_aux_logits:\n",
        "      model.aux_logits = False\n",
        "    return model\n",
        "\n",
        "  return Inception3(**kwargs)\n"
      ],
      "metadata": {
        "id": "3mDF5zjjV7YH"
      },
      "execution_count": 11,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# Inception V3\n",
        "class Inception3(nn.Module):\n",
        "\n",
        "  def __init__(self, num_classes=10, aux_logits=True, transform_input=True):\n",
        "    super(Inception3, self).__init__()\n",
        "    self.aux_logits = aux_logits\n",
        "    self.transform_input = transform_input\n",
        "    self.Conv2d_4a_3x3 = BasicConv2d(3, 32, kernel_size=3,padding=1)\n",
        "    self.Mixed_5b = InceptionA(32, pool_features=8)\n",
        "    self.Mixed_5c = InceptionA(64, pool_features=72)\n",
        "    self.Mixed_6a = InceptionB(128)\n",
        "    self.Mixed_6b = InceptionC(256, channels_7x7=64)\n",
        "    if aux_logits:\n",
        "      self.AuxLogits = InceptionAux(512, num_classes)\n",
        "    self.Mixed_7a = InceptionD(512)\n",
        "    self.fc = nn.Linear(768, num_classes)\n",
        "\n",
        "    for m in self.modules():\n",
        "      if isinstance(m, nn.Conv2d) or isinstance(m, nn.Linear):\n",
        "        import scipy.stats as stats\n",
        "        stddev = m.stddev if hasattr(m, 'stddev') else 0.1\n",
        "        X = stats.truncnorm(-2, 2, scale=stddev)\n",
        "        values = torch.as_tensor(X.rvs(m.weight.numel()), dtype=m.weight.dtype)\n",
        "        values = values.view(m.weight.size())\n",
        "        with torch.no_grad():\n",
        "          m.weight.copy_(values)\n",
        "      elif isinstance(m, nn.BatchNorm2d):\n",
        "        nn.init.constant_(m.weight, 1)\n",
        "        nn.init.constant_(m.bias, 0)\n",
        "\n",
        "  def forward(self, x):\n",
        "    global aux\n",
        "    print(x.shape) \n",
        "    x = self.Conv2d_4a_3x3(x)\n",
        "    x = self.Mixed_5b(x)\n",
        "    x = self.Mixed_5c(x)\n",
        "    x = self.Mixed_6a(x)\n",
        "    x = self.Mixed_6b(x)\n",
        "    if self.training and self.aux_logits:\n",
        "      aux = self.AuxLogits(x)\n",
        "    x = self.Mixed_7a(x)\n",
        "    x = F.adaptive_avg_pool2d(x, (1, 1))\n",
        "    x = F.dropout(x, training=self.training)\n",
        "    x = torch.flatten(x, 1)\n",
        "    x = self.fc(x)\n",
        "    print(x.shape)\n",
        "    if self.training and self.aux_logits:\n",
        "      return _InceptionOutputs(x, aux)\n",
        "    return x"
      ],
      "metadata": {
        "id": "N7tFHhXaTKxN"
      },
      "execution_count": 12,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "class InceptionA(nn.Module):\n",
        "\n",
        "  def __init__(self, in_channels, pool_features):\n",
        "    super(InceptionA, self).__init__()\n",
        "    self.branch1x1 = BasicConv2d(in_channels, 8, kernel_size=1)\n",
        "\n",
        "    self.branch5x5_1 = BasicConv2d(in_channels, 8, kernel_size=1)\n",
        "    self.branch5x5_2 = BasicConv2d(8, 16, kernel_size=5, padding=2)\n",
        "\n",
        "    self.branch3x3dbl_1 = BasicConv2d(in_channels, 8, kernel_size=1)\n",
        "    self.branch3x3dbl_2 = BasicConv2d(8, 16, kernel_size=3, padding=1)\n",
        "    self.branch3x3dbl_3 = BasicConv2d(16, 32, kernel_size=3, padding=1)\n",
        "\n",
        "    self.branch_pool = BasicConv2d(in_channels, pool_features, kernel_size=1)\n",
        "\n",
        "  def forward(self, x):\n",
        "    branch1x1 = self.branch1x1(x)\n",
        "\n",
        "    branch5x5 = self.branch5x5_1(x)\n",
        "    branch5x5 = self.branch5x5_2(branch5x5)\n",
        "\n",
        "    branch3x3dbl = self.branch3x3dbl_1(x)\n",
        "    branch3x3dbl = self.branch3x3dbl_2(branch3x3dbl)\n",
        "    branch3x3dbl = self.branch3x3dbl_3(branch3x3dbl)\n",
        "\n",
        "    branch_pool = F.avg_pool2d(x, kernel_size=3, stride=1, padding=1)\n",
        "    branch_pool = self.branch_pool(branch_pool)\n",
        "\n",
        "    outputs = [branch1x1, branch5x5, branch3x3dbl, branch_pool]\n",
        "    return torch.cat(outputs, 1)"
      ],
      "metadata": {
        "id": "8y4488P8T9EP"
      },
      "execution_count": 13,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "class InceptionB(nn.Module):\n",
        "\n",
        "  def __init__(self, in_channels):\n",
        "    super(InceptionB, self).__init__()\n",
        "    self.branch3x3 = BasicConv2d(in_channels, 32, kernel_size=3, stride=2)\n",
        "\n",
        "    self.branch3x3dbl_1 = BasicConv2d(in_channels, 32, kernel_size=1)\n",
        "    self.branch3x3dbl_2 = BasicConv2d(32, 64, kernel_size=3, padding=1)\n",
        "    self.branch3x3dbl_3 = BasicConv2d(64, 96, kernel_size=3, stride=2)\n",
        "\n",
        "  def forward(self, x):\n",
        "    branch3x3 = self.branch3x3(x)\n",
        "\n",
        "    branch3x3dbl = self.branch3x3dbl_1(x)\n",
        "    branch3x3dbl = self.branch3x3dbl_2(branch3x3dbl)\n",
        "    branch3x3dbl = self.branch3x3dbl_3(branch3x3dbl)\n",
        "\n",
        "    branch_pool = F.max_pool2d(x, kernel_size=3, stride=2)\n",
        "\n",
        "    outputs = [branch3x3, branch3x3dbl, branch_pool]\n",
        "    return torch.cat(outputs, 1)"
      ],
      "metadata": {
        "id": "OtP2nwjNT_tU"
      },
      "execution_count": 14,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "class InceptionC(nn.Module):\n",
        "\n",
        "  def __init__(self, in_channels, channels_7x7):\n",
        "    super(InceptionC, self).__init__()\n",
        "    self.branch1x1 = BasicConv2d(in_channels, 128, kernel_size=1)\n",
        "\n",
        "    c7 = channels_7x7\n",
        "    self.branch7x7_1 = BasicConv2d(in_channels, c7, kernel_size=1)\n",
        "    self.branch7x7_2 = BasicConv2d(c7, c7, kernel_size=(1, 7), padding=(0, 3))\n",
        "    self.branch7x7_3 = BasicConv2d(c7, 128, kernel_size=(7, 1), padding=(3, 0))\n",
        "\n",
        "    self.branch7x7dbl_1 = BasicConv2d(in_channels, c7, kernel_size=1)\n",
        "    self.branch7x7dbl_2 = BasicConv2d(c7, c7, kernel_size=(7, 1), padding=(3, 0))\n",
        "    self.branch7x7dbl_3 = BasicConv2d(c7, c7, kernel_size=(1, 7), padding=(0, 3))\n",
        "    self.branch7x7dbl_4 = BasicConv2d(c7, c7, kernel_size=(7, 1), padding=(3, 0))\n",
        "    self.branch7x7dbl_5 = BasicConv2d(c7, 128, kernel_size=(1, 7), padding=(0, 3))\n",
        "\n",
        "    self.branch_pool = BasicConv2d(in_channels, 128, kernel_size=1)\n",
        "\n",
        "  def forward(self, x):\n",
        "    branch1x1 = self.branch1x1(x)\n",
        "\n",
        "    branch7x7 = self.branch7x7_1(x)\n",
        "    branch7x7 = self.branch7x7_2(branch7x7)\n",
        "    branch7x7 = self.branch7x7_3(branch7x7)\n",
        "\n",
        "    branch7x7dbl = self.branch7x7dbl_1(x)\n",
        "    branch7x7dbl = self.branch7x7dbl_2(branch7x7dbl)\n",
        "    branch7x7dbl = self.branch7x7dbl_3(branch7x7dbl)\n",
        "    branch7x7dbl = self.branch7x7dbl_4(branch7x7dbl)\n",
        "    branch7x7dbl = self.branch7x7dbl_5(branch7x7dbl)\n",
        "\n",
        "    branch_pool = F.avg_pool2d(x, kernel_size=3, stride=1, padding=1)\n",
        "    branch_pool = self.branch_pool(branch_pool)\n",
        "\n",
        "    outputs = [branch1x1, branch7x7, branch7x7dbl, branch_pool]\n",
        "    return torch.cat(outputs, 1)"
      ],
      "metadata": {
        "id": "xwr8vUzpUCJF"
      },
      "execution_count": 15,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "class InceptionD(nn.Module):\n",
        "\n",
        "  def __init__(self, in_channels):\n",
        "    super(InceptionD, self).__init__()\n",
        "    self.branch3x3_1 = BasicConv2d(in_channels, 32, kernel_size=1)\n",
        "    self.branch3x3_2 = BasicConv2d(32,64, kernel_size=3, stride=2)\n",
        "\n",
        "    self.branch7x7x3_1 = BasicConv2d(in_channels, 32, kernel_size=1)\n",
        "    self.branch7x7x3_2 = BasicConv2d(32,64, kernel_size=(1, 7), padding=(0, 3))\n",
        "    self.branch7x7x3_3 = BasicConv2d(64, 128, kernel_size=(7, 1), padding=(3, 0))\n",
        "    self.branch7x7x3_4 = BasicConv2d(128,192, kernel_size=3, stride=2)\n",
        "\n",
        "  def forward(self, x):\n",
        "    branch3x3 = self.branch3x3_1(x)\n",
        "    branch3x3 = self.branch3x3_2(branch3x3)\n",
        "\n",
        "    branch7x7x3 = self.branch7x7x3_1(x)\n",
        "    branch7x7x3 = self.branch7x7x3_2(branch7x7x3)\n",
        "    branch7x7x3 = self.branch7x7x3_3(branch7x7x3)\n",
        "    branch7x7x3 = self.branch7x7x3_4(branch7x7x3)\n",
        "\n",
        "    branch_pool = F.max_pool2d(x, kernel_size=3, stride=2)\n",
        "    outputs = [branch3x3, branch7x7x3, branch_pool]\n",
        "    return torch.cat(outputs, 1)\n",
        "class BasicConv2d(nn.Module):\n",
        "\n",
        "  def __init__(self, in_channels, out_channels, **kwargs):\n",
        "    super(BasicConv2d, self).__init__()\n",
        "    self.conv = nn.Conv2d(in_channels, out_channels, bias=False, **kwargs)\n",
        "    self.bn = nn.BatchNorm2d(out_channels, eps=0.001)\n",
        "\n",
        "  def forward(self, x):\n",
        "    x = self.conv(x)\n",
        "    x = self.bn(x)\n",
        "    return F.relu(x, inplace=True)"
      ],
      "metadata": {
        "id": "cq17lv8jX_Is"
      },
      "execution_count": 16,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "class InceptionAux(nn.Module):\n",
        "\n",
        "  def __init__(self, in_channels, num_classes):\n",
        "    super(InceptionAux, self).__init__()\n",
        "    self.conv0 = BasicConv2d(in_channels, 128, kernel_size=1)\n",
        "    self.conv1 = BasicConv2d(128, 512, kernel_size=5)\n",
        "    self.conv1.stddev = 0.01\n",
        "    self.fc = nn.Linear(512, num_classes)\n",
        "    self.fc.stddev = 0.001\n",
        "\n",
        "  def forward(self, x):\n",
        "    x = F.avg_pool2d(x, kernel_size=3, stride=3)\n",
        "    x = self.conv0(x)\n",
        "    x = self.conv1(x)\n",
        "    x = F.adaptive_avg_pool2d(x, (1, 1))\n",
        "    x = torch.flatten(x, 1)\n",
        "    x = self.fc(x)\n",
        "    return x"
      ],
      "metadata": {
        "id": "pBKV9H3pX7Vr"
      },
      "execution_count": 17,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "class BasicConv2d(nn.Module):\n",
        "\n",
        "  def __init__(self, in_channels, out_channels, **kwargs):\n",
        "    super(BasicConv2d, self).__init__()\n",
        "    self.conv = nn.Conv2d(in_channels, out_channels, bias=False, **kwargs)\n",
        "    self.bn = nn.BatchNorm2d(out_channels, eps=0.001)\n",
        "\n",
        "  def forward(self, x):\n",
        "    x = self.conv(x)\n",
        "    x = self.bn(x)\n",
        "    return F.relu(x, inplace=True)"
      ],
      "metadata": {
        "id": "dBJ9XGCqX7Uk"
      },
      "execution_count": 18,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Loss function and optimizer**\n",
        "\n",
        "Set the **loss function and optimizer** for training CNN.\n",
        "You can modify the loss function or optimizer for better performance."
      ],
      "metadata": {
        "id": "SXLnGlLgdyZ2"
      }
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "oB0f6C2npeoj"
      },
      "outputs": [],
      "source": [
        "# Loss function and optimizer\n",
        "#loss_fun = nn.CrossEntropyLoss()\n",
        "#optimizer = torch.optim.Adam(net.parameters(), lr=0.001)\n",
        "#scheduler = torch.optim.lr_scheduler.StepLR(optimizer, step_size=10, gamma=0.1)"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Train the network**\n",
        "\n",
        "Train your own network using the above loss function and optimizer."
      ],
      "metadata": {
        "id": "DInMRCnReWno"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "import os\n",
        "import time\n",
        "\n",
        "import torch\n",
        "import torch.utils.data\n",
        "import torchvision\n",
        "from torchvision import transforms\n",
        "\n",
        "# Total parameters\n",
        "model = inception_v3().to(device)\n",
        "pytorch_total_params = sum(p.numel() for p in model.parameters())\n",
        "pytorch_total_params"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "6mPPZXuqUuNs",
        "outputId": "aa589991-2e91-4256-fe4d-5939c681d9fb"
      },
      "execution_count": 19,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "2534260"
            ]
          },
          "metadata": {},
          "execution_count": 19
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "## Main 함수"
      ],
      "metadata": {
        "id": "kzv9QBVPXejH"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "def main():\n",
        "  print(f\"Train numbers:{len(dataset)}\")\n",
        "  LEARNING_RATE = 0.001\n",
        "  MOMENTUM=0.9\n",
        "  # first train run this line\n",
        "  #model = inception_v3().to(device)\n",
        "  print(model)\n",
        "  #model_save_name = 'Inception_v3e1.pth'\n",
        "  #model.load_state_dict(torch.load(MODEL_NAME))\n",
        "  # Load model\n",
        "  #if device == 'cuda':\n",
        "\n",
        "    #model = torch.load(MODEL_PATH + MODEL_NAME).to(device)\n",
        "  #else:\n",
        "    #model = torch.load(MODEL_PATH + MODEL_NAME, map_location='cpu')\n",
        "  # cast\n",
        "  cast = torch.nn.CrossEntropyLoss().to(device)\n",
        "  # Optimization\n",
        "  optimizer = torch.optim.SGD(\n",
        "    model.parameters(),\n",
        "    lr=LEARNING_RATE,\n",
        "    momentum=MOMENTUM)\n",
        "  step = 1\n",
        "  loss_values=[]\n",
        "  for epoch in range(1, NUM_EPOCHS + 1):\n",
        "    print(loss_values)\n",
        "    model.train()\n",
        "    running_loss = 0.0\n",
        "    \n",
        "    # cal one epoch time\n",
        "    start = time.time()\n",
        "    correct = 0\n",
        "    total = 0\n",
        "    for images, labels in dataset_loader:\n",
        "      images = images.to(device)\n",
        "      print(images.shape)\n",
        "      labels = labels.to(device)\n",
        "      \n",
        "      outputs, aux_outputs = model(images)\n",
        "      loss1 = cast(outputs, labels)\n",
        "      loss2 = cast(aux_outputs, labels)\n",
        "      loss = loss1 + 0.4*loss2\n",
        "      running_loss =+ loss.item() * images.size(0)\n",
        "\n",
        "      optimizer.zero_grad()\n",
        "      loss.backward()\n",
        "      optimizer.step()\n",
        "      print(\"epoch: \", epoch)\n",
        "      print(f\"Step [{step * BATCH_SIZE}/{NUM_EPOCHS * len(dataset)}], \"\n",
        "            f\"Loss: {loss.item():.8f}.\")\n",
        "      print(\"Running Loss=\",running_loss)\n",
        "      step += 1\n",
        "      # equal prediction and acc\n",
        "      _, predicted = torch.max(outputs.data, 1)\n",
        "      # val_loader total\n",
        "      total += labels.size(0)\n",
        "      # add correct\n",
        "      correct += (predicted == labels).sum().item()\n",
        "\n",
        "      print(f\"Acc: {correct / total:.4f}.\")\n",
        "        # cal train one epoch time\n",
        "    end = time.time()\n",
        "    loss_values.append(running_loss / len(dataset_loader))\n",
        "    \n",
        "    print(f\"Epoch [{epoch}/{NUM_EPOCHS}], \"\n",
        "          f\"time: {end - start} sec!\")\n",
        "\n",
        "    # Save the model checkpoint\n",
        "    if epoch%20==0:\n",
        "    #   LEARNING_RATE=LEARNING_RATE/10\n",
        "    #   torch.save(model, MODEL_PATH + '/' + MODEL_NAME)\n",
        "\n",
        "      model_save_name = 'Inception_v3_CIFAR10_32BATCH_lr0.001_crop_bflip_rot'+str(epoch)+'.pth'   #WE keep changing this and saving states ,can be found in excel sheet attached\n",
        "      torch.save(model.state_dict(), model_save_name)\n",
        "    print(\"epoch completed and model copy completed\")\n",
        "    \n",
        "  torch.save(model,MODEL_NAME)\n",
        "  print(f\"Model save to {MODEL_PATH + '/' + MODEL_NAME}.\")"
      ],
      "metadata": {
        "id": "LsgAc4Z4XdV-"
      },
      "execution_count": 20,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "if __name__ == '__main__':\n",
        "  main()"
      ],
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "MM1SxzJAXYJ_",
        "outputId": "78d08683-fd77-4418-aab8-1a397582bc1c"
      },
      "execution_count": 21,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\u001b[1;30;43m스트리밍 출력 내용이 길어서 마지막 5000줄이 삭제되었습니다.\u001b[0m\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247148/250000], Loss: 1.11342728.\n",
            "Running Loss= 4.453709125518799\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247152/250000], Loss: 0.64436114.\n",
            "Running Loss= 2.577444553375244\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247156/250000], Loss: 1.31063175.\n",
            "Running Loss= 5.242527008056641\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247160/250000], Loss: 1.02748287.\n",
            "Running Loss= 4.109931468963623\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247164/250000], Loss: 1.57642460.\n",
            "Running Loss= 6.305698394775391\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247168/250000], Loss: 2.42426348.\n",
            "Running Loss= 9.697053909301758\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247172/250000], Loss: 1.46261430.\n",
            "Running Loss= 5.850457191467285\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247176/250000], Loss: 2.20457983.\n",
            "Running Loss= 8.818319320678711\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247180/250000], Loss: 0.37453884.\n",
            "Running Loss= 1.4981553554534912\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247184/250000], Loss: 0.68829679.\n",
            "Running Loss= 2.7531871795654297\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247188/250000], Loss: 1.74516475.\n",
            "Running Loss= 6.980659008026123\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247192/250000], Loss: 1.31203067.\n",
            "Running Loss= 5.248122692108154\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247196/250000], Loss: 1.74615788.\n",
            "Running Loss= 6.984631538391113\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247200/250000], Loss: 0.48745751.\n",
            "Running Loss= 1.9498300552368164\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247204/250000], Loss: 1.42897737.\n",
            "Running Loss= 5.715909481048584\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247208/250000], Loss: 2.04590583.\n",
            "Running Loss= 8.183623313903809\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247212/250000], Loss: 1.35605407.\n",
            "Running Loss= 5.424216270446777\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247216/250000], Loss: 1.19304705.\n",
            "Running Loss= 4.772188186645508\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247220/250000], Loss: 1.49594069.\n",
            "Running Loss= 5.983762741088867\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247224/250000], Loss: 1.70927465.\n",
            "Running Loss= 6.837098598480225\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247228/250000], Loss: 1.25934505.\n",
            "Running Loss= 5.037380218505859\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247232/250000], Loss: 0.75695008.\n",
            "Running Loss= 3.0278003215789795\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247236/250000], Loss: 1.85580587.\n",
            "Running Loss= 7.423223495483398\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247240/250000], Loss: 1.24335814.\n",
            "Running Loss= 4.973432540893555\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247244/250000], Loss: 0.38094962.\n",
            "Running Loss= 1.5237984657287598\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247248/250000], Loss: 1.34304214.\n",
            "Running Loss= 5.37216854095459\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247252/250000], Loss: 1.68666577.\n",
            "Running Loss= 6.7466630935668945\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247256/250000], Loss: 2.95918870.\n",
            "Running Loss= 11.83675479888916\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247260/250000], Loss: 1.44311690.\n",
            "Running Loss= 5.772467613220215\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247264/250000], Loss: 0.64882064.\n",
            "Running Loss= 2.595282554626465\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247268/250000], Loss: 1.45773911.\n",
            "Running Loss= 5.83095645904541\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247272/250000], Loss: 0.78622776.\n",
            "Running Loss= 3.144911050796509\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247276/250000], Loss: 0.51760674.\n",
            "Running Loss= 2.0704269409179688\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247280/250000], Loss: 0.65801436.\n",
            "Running Loss= 2.6320574283599854\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247284/250000], Loss: 0.84399652.\n",
            "Running Loss= 3.375986099243164\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247288/250000], Loss: 2.60920954.\n",
            "Running Loss= 10.436838150024414\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247292/250000], Loss: 0.22787054.\n",
            "Running Loss= 0.9114821553230286\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247296/250000], Loss: 1.93443775.\n",
            "Running Loss= 7.737751007080078\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247300/250000], Loss: 1.46919239.\n",
            "Running Loss= 5.876769542694092\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247304/250000], Loss: 3.53585792.\n",
            "Running Loss= 14.143431663513184\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247308/250000], Loss: 0.85836208.\n",
            "Running Loss= 3.433448314666748\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247312/250000], Loss: 1.13423967.\n",
            "Running Loss= 4.536958694458008\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247316/250000], Loss: 2.95540333.\n",
            "Running Loss= 11.821613311767578\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247320/250000], Loss: 1.84302616.\n",
            "Running Loss= 7.372104644775391\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247324/250000], Loss: 2.43044424.\n",
            "Running Loss= 9.721776962280273\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247328/250000], Loss: 0.86777663.\n",
            "Running Loss= 3.47110652923584\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247332/250000], Loss: 2.80838394.\n",
            "Running Loss= 11.233535766601562\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247336/250000], Loss: 1.86692500.\n",
            "Running Loss= 7.467700004577637\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247340/250000], Loss: 0.86372912.\n",
            "Running Loss= 3.454916477203369\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247344/250000], Loss: 1.16824949.\n",
            "Running Loss= 4.672997951507568\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247348/250000], Loss: 1.13693988.\n",
            "Running Loss= 4.547759532928467\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247352/250000], Loss: 2.28365374.\n",
            "Running Loss= 9.134614944458008\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247356/250000], Loss: 0.40334198.\n",
            "Running Loss= 1.6133679151535034\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247360/250000], Loss: 0.96287191.\n",
            "Running Loss= 3.851487636566162\n",
            "Acc: 0.6164.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247364/250000], Loss: 1.00469995.\n",
            "Running Loss= 4.018799781799316\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247368/250000], Loss: 0.53735310.\n",
            "Running Loss= 2.1494123935699463\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247372/250000], Loss: 2.49578071.\n",
            "Running Loss= 9.983122825622559\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247376/250000], Loss: 1.51576710.\n",
            "Running Loss= 6.063068389892578\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247380/250000], Loss: 2.20240951.\n",
            "Running Loss= 8.809638023376465\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247384/250000], Loss: 0.48556346.\n",
            "Running Loss= 1.942253828048706\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247388/250000], Loss: 1.49742317.\n",
            "Running Loss= 5.989692687988281\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247392/250000], Loss: 1.74542332.\n",
            "Running Loss= 6.981693267822266\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247396/250000], Loss: 1.23230302.\n",
            "Running Loss= 4.9292120933532715\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247400/250000], Loss: 0.29552281.\n",
            "Running Loss= 1.182091236114502\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247404/250000], Loss: 0.46567219.\n",
            "Running Loss= 1.8626887798309326\n",
            "Acc: 0.6165.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247408/250000], Loss: 0.71030200.\n",
            "Running Loss= 2.841207981109619\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247412/250000], Loss: 0.63079906.\n",
            "Running Loss= 2.523196220397949\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247416/250000], Loss: 0.30287391.\n",
            "Running Loss= 1.2114956378936768\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247420/250000], Loss: 1.79628444.\n",
            "Running Loss= 7.185137748718262\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247424/250000], Loss: 1.89115679.\n",
            "Running Loss= 7.564627170562744\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247428/250000], Loss: 0.45802146.\n",
            "Running Loss= 1.8320858478546143\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247432/250000], Loss: 0.78138191.\n",
            "Running Loss= 3.1255276203155518\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247436/250000], Loss: 1.27956998.\n",
            "Running Loss= 5.118279933929443\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247440/250000], Loss: 0.69825852.\n",
            "Running Loss= 2.793034076690674\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247444/250000], Loss: 1.64667726.\n",
            "Running Loss= 6.586709022521973\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247448/250000], Loss: 0.71577644.\n",
            "Running Loss= 2.8631057739257812\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247452/250000], Loss: 1.75556612.\n",
            "Running Loss= 7.02226448059082\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247456/250000], Loss: 0.79329681.\n",
            "Running Loss= 3.173187255859375\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247460/250000], Loss: 1.64415395.\n",
            "Running Loss= 6.576615810394287\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247464/250000], Loss: 1.91330409.\n",
            "Running Loss= 7.653216361999512\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247468/250000], Loss: 1.72052455.\n",
            "Running Loss= 6.882098197937012\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247472/250000], Loss: 1.88740933.\n",
            "Running Loss= 7.549637317657471\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247476/250000], Loss: 3.11647940.\n",
            "Running Loss= 12.465917587280273\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247480/250000], Loss: 0.78199637.\n",
            "Running Loss= 3.1279854774475098\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247484/250000], Loss: 0.60958570.\n",
            "Running Loss= 2.438342809677124\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247488/250000], Loss: 0.41563940.\n",
            "Running Loss= 1.662557601928711\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247492/250000], Loss: 2.00489473.\n",
            "Running Loss= 8.01957893371582\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247496/250000], Loss: 1.77464843.\n",
            "Running Loss= 7.098593711853027\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247500/250000], Loss: 0.47254372.\n",
            "Running Loss= 1.8901748657226562\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247504/250000], Loss: 1.58063698.\n",
            "Running Loss= 6.322547912597656\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247508/250000], Loss: 1.45533550.\n",
            "Running Loss= 5.8213419914245605\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247512/250000], Loss: 2.44708276.\n",
            "Running Loss= 9.788331031799316\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247516/250000], Loss: 0.43972513.\n",
            "Running Loss= 1.75890052318573\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247520/250000], Loss: 2.61204171.\n",
            "Running Loss= 10.448166847229004\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247524/250000], Loss: 0.97574365.\n",
            "Running Loss= 3.9029746055603027\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247528/250000], Loss: 1.67518795.\n",
            "Running Loss= 6.700751781463623\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247532/250000], Loss: 0.88208771.\n",
            "Running Loss= 3.528350830078125\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247536/250000], Loss: 1.77630973.\n",
            "Running Loss= 7.105238914489746\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247540/250000], Loss: 1.44128299.\n",
            "Running Loss= 5.765131950378418\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247544/250000], Loss: 3.34392118.\n",
            "Running Loss= 13.37568473815918\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247548/250000], Loss: 1.92779756.\n",
            "Running Loss= 7.711190223693848\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247552/250000], Loss: 1.40358329.\n",
            "Running Loss= 5.614333152770996\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247556/250000], Loss: 1.32095337.\n",
            "Running Loss= 5.2838134765625\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247560/250000], Loss: 1.05255866.\n",
            "Running Loss= 4.210234642028809\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247564/250000], Loss: 1.58299279.\n",
            "Running Loss= 6.331971168518066\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247568/250000], Loss: 0.89065623.\n",
            "Running Loss= 3.562624931335449\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247572/250000], Loss: 1.36500847.\n",
            "Running Loss= 5.460033893585205\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247576/250000], Loss: 1.35503697.\n",
            "Running Loss= 5.420147895812988\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247580/250000], Loss: 2.75121832.\n",
            "Running Loss= 11.004873275756836\n",
            "Acc: 0.6166.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247584/250000], Loss: 1.19772458.\n",
            "Running Loss= 4.790898323059082\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247588/250000], Loss: 0.83508146.\n",
            "Running Loss= 3.3403258323669434\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247592/250000], Loss: 2.19400644.\n",
            "Running Loss= 8.776025772094727\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247596/250000], Loss: 0.88033140.\n",
            "Running Loss= 3.5213255882263184\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247600/250000], Loss: 0.99980736.\n",
            "Running Loss= 3.9992294311523438\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247604/250000], Loss: 1.06392932.\n",
            "Running Loss= 4.2557172775268555\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247608/250000], Loss: 1.58960378.\n",
            "Running Loss= 6.358415126800537\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247612/250000], Loss: 1.90524495.\n",
            "Running Loss= 7.6209797859191895\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247616/250000], Loss: 2.25409794.\n",
            "Running Loss= 9.01639175415039\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247620/250000], Loss: 0.69539535.\n",
            "Running Loss= 2.781581401824951\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247624/250000], Loss: 0.75317562.\n",
            "Running Loss= 3.012702465057373\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247628/250000], Loss: 1.26486838.\n",
            "Running Loss= 5.059473514556885\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247632/250000], Loss: 0.69469815.\n",
            "Running Loss= 2.7787926197052\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247636/250000], Loss: 2.41198683.\n",
            "Running Loss= 9.647947311401367\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247640/250000], Loss: 1.83976173.\n",
            "Running Loss= 7.359046936035156\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247644/250000], Loss: 0.83604783.\n",
            "Running Loss= 3.344191312789917\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247648/250000], Loss: 1.02516079.\n",
            "Running Loss= 4.100643157958984\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247652/250000], Loss: 0.53565979.\n",
            "Running Loss= 2.14263916015625\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247656/250000], Loss: 0.69764799.\n",
            "Running Loss= 2.7905919551849365\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247660/250000], Loss: 1.49690104.\n",
            "Running Loss= 5.987604141235352\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247664/250000], Loss: 1.21435189.\n",
            "Running Loss= 4.857407569885254\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247668/250000], Loss: 4.12908983.\n",
            "Running Loss= 16.516359329223633\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247672/250000], Loss: 2.21254516.\n",
            "Running Loss= 8.850180625915527\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247676/250000], Loss: 1.25477171.\n",
            "Running Loss= 5.019086837768555\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247680/250000], Loss: 1.78417802.\n",
            "Running Loss= 7.136712074279785\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247684/250000], Loss: 1.21397781.\n",
            "Running Loss= 4.8559112548828125\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247688/250000], Loss: 1.24623120.\n",
            "Running Loss= 4.984924793243408\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247692/250000], Loss: 0.52148616.\n",
            "Running Loss= 2.085944652557373\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247696/250000], Loss: 1.01020014.\n",
            "Running Loss= 4.04080057144165\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247700/250000], Loss: 2.13789463.\n",
            "Running Loss= 8.551578521728516\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247704/250000], Loss: 1.50249684.\n",
            "Running Loss= 6.0099873542785645\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247708/250000], Loss: 1.18267107.\n",
            "Running Loss= 4.730684280395508\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247712/250000], Loss: 2.02009511.\n",
            "Running Loss= 8.0803804397583\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247716/250000], Loss: 1.70825338.\n",
            "Running Loss= 6.833013534545898\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247720/250000], Loss: 1.69557011.\n",
            "Running Loss= 6.782280445098877\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247724/250000], Loss: 2.00876236.\n",
            "Running Loss= 8.035049438476562\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247728/250000], Loss: 1.69236529.\n",
            "Running Loss= 6.769461154937744\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247732/250000], Loss: 0.51728433.\n",
            "Running Loss= 2.0691373348236084\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247736/250000], Loss: 1.56620240.\n",
            "Running Loss= 6.264809608459473\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247740/250000], Loss: 2.22570252.\n",
            "Running Loss= 8.902810096740723\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247744/250000], Loss: 2.43728447.\n",
            "Running Loss= 9.749137878417969\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247748/250000], Loss: 1.20034575.\n",
            "Running Loss= 4.801383018493652\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247752/250000], Loss: 0.75599068.\n",
            "Running Loss= 3.0239627361297607\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247756/250000], Loss: 0.77127337.\n",
            "Running Loss= 3.0850934982299805\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247760/250000], Loss: 0.85827601.\n",
            "Running Loss= 3.4331040382385254\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247764/250000], Loss: 1.70928204.\n",
            "Running Loss= 6.837128162384033\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247768/250000], Loss: 1.37922311.\n",
            "Running Loss= 5.516892433166504\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247772/250000], Loss: 2.45487547.\n",
            "Running Loss= 9.819501876831055\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247776/250000], Loss: 0.68588531.\n",
            "Running Loss= 2.7435412406921387\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247780/250000], Loss: 2.62084126.\n",
            "Running Loss= 10.483365058898926\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247784/250000], Loss: 1.16012764.\n",
            "Running Loss= 4.640510559082031\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247788/250000], Loss: 1.55171204.\n",
            "Running Loss= 6.20684814453125\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247792/250000], Loss: 1.98870707.\n",
            "Running Loss= 7.954828262329102\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247796/250000], Loss: 1.51710880.\n",
            "Running Loss= 6.068435192108154\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247800/250000], Loss: 0.64951992.\n",
            "Running Loss= 2.5980796813964844\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247804/250000], Loss: 2.84734368.\n",
            "Running Loss= 11.389374732971191\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247808/250000], Loss: 1.38326395.\n",
            "Running Loss= 5.533055782318115\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247812/250000], Loss: 1.05509198.\n",
            "Running Loss= 4.220367908477783\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247816/250000], Loss: 0.82583165.\n",
            "Running Loss= 3.3033266067504883\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247820/250000], Loss: 2.15791368.\n",
            "Running Loss= 8.631654739379883\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247824/250000], Loss: 1.54732609.\n",
            "Running Loss= 6.189304351806641\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247828/250000], Loss: 2.30756617.\n",
            "Running Loss= 9.230264663696289\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247832/250000], Loss: 1.26358712.\n",
            "Running Loss= 5.054348468780518\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247836/250000], Loss: 1.83310735.\n",
            "Running Loss= 7.3324294090271\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247840/250000], Loss: 1.59252954.\n",
            "Running Loss= 6.370118141174316\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247844/250000], Loss: 0.74597585.\n",
            "Running Loss= 2.983903408050537\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247848/250000], Loss: 1.50644302.\n",
            "Running Loss= 6.0257720947265625\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247852/250000], Loss: 1.12120521.\n",
            "Running Loss= 4.48482084274292\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247856/250000], Loss: 1.45653200.\n",
            "Running Loss= 5.826128005981445\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247860/250000], Loss: 2.47951698.\n",
            "Running Loss= 9.918067932128906\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247864/250000], Loss: 1.13111889.\n",
            "Running Loss= 4.524475574493408\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247868/250000], Loss: 1.09181321.\n",
            "Running Loss= 4.367252826690674\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247872/250000], Loss: 1.11283386.\n",
            "Running Loss= 4.451335430145264\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247876/250000], Loss: 0.96808887.\n",
            "Running Loss= 3.8723554611206055\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247880/250000], Loss: 1.72507787.\n",
            "Running Loss= 6.900311470031738\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247884/250000], Loss: 1.50369298.\n",
            "Running Loss= 6.014771938323975\n",
            "Acc: 0.6167.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247888/250000], Loss: 1.27371454.\n",
            "Running Loss= 5.094858169555664\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247892/250000], Loss: 2.32594204.\n",
            "Running Loss= 9.303768157958984\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247896/250000], Loss: 0.57317704.\n",
            "Running Loss= 2.292708158493042\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247900/250000], Loss: 2.80102062.\n",
            "Running Loss= 11.204082489013672\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247904/250000], Loss: 0.84240401.\n",
            "Running Loss= 3.3696160316467285\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247908/250000], Loss: 0.34571153.\n",
            "Running Loss= 1.3828461170196533\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247912/250000], Loss: 2.58833432.\n",
            "Running Loss= 10.353337287902832\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247916/250000], Loss: 0.96942234.\n",
            "Running Loss= 3.8776893615722656\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247920/250000], Loss: 0.98386842.\n",
            "Running Loss= 3.935473680496216\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247924/250000], Loss: 0.90473676.\n",
            "Running Loss= 3.6189470291137695\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247928/250000], Loss: 0.35735267.\n",
            "Running Loss= 1.429410696029663\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247932/250000], Loss: 0.51311809.\n",
            "Running Loss= 2.0524723529815674\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247936/250000], Loss: 1.56420398.\n",
            "Running Loss= 6.2568159103393555\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247940/250000], Loss: 1.70722449.\n",
            "Running Loss= 6.828897953033447\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247944/250000], Loss: 0.44904375.\n",
            "Running Loss= 1.7961750030517578\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247948/250000], Loss: 1.55010140.\n",
            "Running Loss= 6.200405597686768\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247952/250000], Loss: 1.31159842.\n",
            "Running Loss= 5.24639368057251\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247956/250000], Loss: 1.10302091.\n",
            "Running Loss= 4.412083625793457\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247960/250000], Loss: 0.73027807.\n",
            "Running Loss= 2.921112298965454\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247964/250000], Loss: 1.61123252.\n",
            "Running Loss= 6.444930076599121\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247968/250000], Loss: 1.69404721.\n",
            "Running Loss= 6.776188850402832\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247972/250000], Loss: 0.90617478.\n",
            "Running Loss= 3.624699115753174\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247976/250000], Loss: 1.20985711.\n",
            "Running Loss= 4.839428424835205\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247980/250000], Loss: 1.19062841.\n",
            "Running Loss= 4.762513637542725\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247984/250000], Loss: 1.11409581.\n",
            "Running Loss= 4.456383228302002\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247988/250000], Loss: 1.71090412.\n",
            "Running Loss= 6.843616485595703\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247992/250000], Loss: 2.42070627.\n",
            "Running Loss= 9.682825088500977\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [247996/250000], Loss: 1.24392915.\n",
            "Running Loss= 4.975716590881348\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248000/250000], Loss: 2.14192629.\n",
            "Running Loss= 8.567705154418945\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248004/250000], Loss: 2.45527935.\n",
            "Running Loss= 9.821117401123047\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248008/250000], Loss: 1.71022272.\n",
            "Running Loss= 6.840890884399414\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248012/250000], Loss: 3.03282619.\n",
            "Running Loss= 12.131304740905762\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248016/250000], Loss: 1.76861811.\n",
            "Running Loss= 7.074472427368164\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248020/250000], Loss: 1.25682318.\n",
            "Running Loss= 5.027292728424072\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248024/250000], Loss: 2.02015328.\n",
            "Running Loss= 8.080613136291504\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248028/250000], Loss: 0.54298383.\n",
            "Running Loss= 2.1719353199005127\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248032/250000], Loss: 4.37084055.\n",
            "Running Loss= 17.483362197875977\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248036/250000], Loss: 1.29734230.\n",
            "Running Loss= 5.189369201660156\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248040/250000], Loss: 0.71649885.\n",
            "Running Loss= 2.865995407104492\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248044/250000], Loss: 1.84606767.\n",
            "Running Loss= 7.384270668029785\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248048/250000], Loss: 3.47756100.\n",
            "Running Loss= 13.91024398803711\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248052/250000], Loss: 4.27341080.\n",
            "Running Loss= 17.093643188476562\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248056/250000], Loss: 2.13767743.\n",
            "Running Loss= 8.55070972442627\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248060/250000], Loss: 1.38197279.\n",
            "Running Loss= 5.527891159057617\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248064/250000], Loss: 1.79403806.\n",
            "Running Loss= 7.176152229309082\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248068/250000], Loss: 0.97717285.\n",
            "Running Loss= 3.90869140625\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248072/250000], Loss: 1.71292233.\n",
            "Running Loss= 6.851689338684082\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248076/250000], Loss: 1.06963766.\n",
            "Running Loss= 4.278550624847412\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248080/250000], Loss: 1.91550171.\n",
            "Running Loss= 7.662006855010986\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248084/250000], Loss: 2.22963285.\n",
            "Running Loss= 8.91853141784668\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248088/250000], Loss: 2.16956758.\n",
            "Running Loss= 8.67827033996582\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248092/250000], Loss: 1.48936343.\n",
            "Running Loss= 5.957453727722168\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248096/250000], Loss: 1.46743357.\n",
            "Running Loss= 5.869734287261963\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248100/250000], Loss: 1.97919428.\n",
            "Running Loss= 7.91677713394165\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248104/250000], Loss: 1.56787586.\n",
            "Running Loss= 6.271503448486328\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248108/250000], Loss: 1.40888798.\n",
            "Running Loss= 5.635551929473877\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248112/250000], Loss: 1.50340140.\n",
            "Running Loss= 6.01360559463501\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248116/250000], Loss: 1.22843337.\n",
            "Running Loss= 4.91373348236084\n",
            "Acc: 0.6168.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248120/250000], Loss: 0.28834581.\n",
            "Running Loss= 1.1533832550048828\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248124/250000], Loss: 0.37011117.\n",
            "Running Loss= 1.4804446697235107\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248128/250000], Loss: 0.88665652.\n",
            "Running Loss= 3.546626091003418\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248132/250000], Loss: 1.92027473.\n",
            "Running Loss= 7.681098937988281\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248136/250000], Loss: 2.64245510.\n",
            "Running Loss= 10.569820404052734\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248140/250000], Loss: 1.71844411.\n",
            "Running Loss= 6.873776435852051\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248144/250000], Loss: 0.41711554.\n",
            "Running Loss= 1.6684621572494507\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248148/250000], Loss: 0.92508572.\n",
            "Running Loss= 3.700342893600464\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248152/250000], Loss: 1.31996751.\n",
            "Running Loss= 5.27987003326416\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248156/250000], Loss: 1.67583776.\n",
            "Running Loss= 6.703351020812988\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248160/250000], Loss: 1.04345822.\n",
            "Running Loss= 4.173832893371582\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248164/250000], Loss: 1.27364731.\n",
            "Running Loss= 5.0945892333984375\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248168/250000], Loss: 1.36881030.\n",
            "Running Loss= 5.475241184234619\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248172/250000], Loss: 0.91698074.\n",
            "Running Loss= 3.6679229736328125\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248176/250000], Loss: 2.52692342.\n",
            "Running Loss= 10.107693672180176\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248180/250000], Loss: 0.45648003.\n",
            "Running Loss= 1.8259201049804688\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248184/250000], Loss: 1.53933716.\n",
            "Running Loss= 6.1573486328125\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248188/250000], Loss: 0.51244915.\n",
            "Running Loss= 2.0497965812683105\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248192/250000], Loss: 0.56694281.\n",
            "Running Loss= 2.2677712440490723\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248196/250000], Loss: 3.37173533.\n",
            "Running Loss= 13.48694133758545\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248200/250000], Loss: 1.25897098.\n",
            "Running Loss= 5.035883903503418\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248204/250000], Loss: 1.41536391.\n",
            "Running Loss= 5.6614556312561035\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248208/250000], Loss: 1.80765712.\n",
            "Running Loss= 7.230628490447998\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248212/250000], Loss: 1.21042979.\n",
            "Running Loss= 4.841719150543213\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248216/250000], Loss: 1.39820802.\n",
            "Running Loss= 5.592832088470459\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248220/250000], Loss: 0.75744355.\n",
            "Running Loss= 3.0297741889953613\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248224/250000], Loss: 1.10562253.\n",
            "Running Loss= 4.422490119934082\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248228/250000], Loss: 1.96814036.\n",
            "Running Loss= 7.872561454772949\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248232/250000], Loss: 1.27543962.\n",
            "Running Loss= 5.1017584800720215\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248236/250000], Loss: 2.01294303.\n",
            "Running Loss= 8.051772117614746\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248240/250000], Loss: 1.51620007.\n",
            "Running Loss= 6.064800262451172\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248244/250000], Loss: 1.46139407.\n",
            "Running Loss= 5.845576286315918\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248248/250000], Loss: 1.55107987.\n",
            "Running Loss= 6.204319477081299\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248252/250000], Loss: 0.70557922.\n",
            "Running Loss= 2.822316884994507\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248256/250000], Loss: 1.24323070.\n",
            "Running Loss= 4.9729228019714355\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248260/250000], Loss: 1.39792395.\n",
            "Running Loss= 5.591695785522461\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248264/250000], Loss: 1.14651716.\n",
            "Running Loss= 4.586068630218506\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248268/250000], Loss: 2.47770309.\n",
            "Running Loss= 9.910812377929688\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248272/250000], Loss: 0.56174564.\n",
            "Running Loss= 2.2469825744628906\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248276/250000], Loss: 0.62883013.\n",
            "Running Loss= 2.5153205394744873\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248280/250000], Loss: 2.35866451.\n",
            "Running Loss= 9.43465805053711\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248284/250000], Loss: 1.01152158.\n",
            "Running Loss= 4.046086311340332\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248288/250000], Loss: 0.92693079.\n",
            "Running Loss= 3.7077231407165527\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248292/250000], Loss: 3.82237768.\n",
            "Running Loss= 15.289510726928711\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248296/250000], Loss: 2.30004621.\n",
            "Running Loss= 9.20018482208252\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248300/250000], Loss: 1.64310575.\n",
            "Running Loss= 6.572422981262207\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248304/250000], Loss: 1.28226566.\n",
            "Running Loss= 5.129062652587891\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248308/250000], Loss: 1.22888434.\n",
            "Running Loss= 4.915537357330322\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248312/250000], Loss: 2.01450467.\n",
            "Running Loss= 8.058018684387207\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248316/250000], Loss: 2.10365820.\n",
            "Running Loss= 8.414632797241211\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248320/250000], Loss: 1.71571732.\n",
            "Running Loss= 6.8628692626953125\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248324/250000], Loss: 1.17588520.\n",
            "Running Loss= 4.703540802001953\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248328/250000], Loss: 2.23242450.\n",
            "Running Loss= 8.92969799041748\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248332/250000], Loss: 0.67855716.\n",
            "Running Loss= 2.714228630065918\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248336/250000], Loss: 0.72621810.\n",
            "Running Loss= 2.904872417449951\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248340/250000], Loss: 1.41880131.\n",
            "Running Loss= 5.675205230712891\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248344/250000], Loss: 2.53254557.\n",
            "Running Loss= 10.130182266235352\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248348/250000], Loss: 0.46390349.\n",
            "Running Loss= 1.8556139469146729\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248352/250000], Loss: 2.53867555.\n",
            "Running Loss= 10.154702186584473\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248356/250000], Loss: 1.31084430.\n",
            "Running Loss= 5.243377208709717\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248360/250000], Loss: 1.81303382.\n",
            "Running Loss= 7.252135276794434\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248364/250000], Loss: 0.45645639.\n",
            "Running Loss= 1.825825572013855\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248368/250000], Loss: 1.36496997.\n",
            "Running Loss= 5.4598798751831055\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248372/250000], Loss: 1.69430709.\n",
            "Running Loss= 6.777228355407715\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248376/250000], Loss: 2.62798834.\n",
            "Running Loss= 10.511953353881836\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248380/250000], Loss: 3.27947760.\n",
            "Running Loss= 13.117910385131836\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248384/250000], Loss: 0.52996820.\n",
            "Running Loss= 2.119872808456421\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248388/250000], Loss: 2.53094578.\n",
            "Running Loss= 10.123783111572266\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248392/250000], Loss: 2.07158279.\n",
            "Running Loss= 8.286331176757812\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248396/250000], Loss: 1.65176511.\n",
            "Running Loss= 6.607060432434082\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248400/250000], Loss: 4.30040884.\n",
            "Running Loss= 17.201635360717773\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248404/250000], Loss: 4.01098251.\n",
            "Running Loss= 16.043930053710938\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248408/250000], Loss: 1.11867988.\n",
            "Running Loss= 4.474719524383545\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248412/250000], Loss: 3.34577894.\n",
            "Running Loss= 13.383115768432617\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248416/250000], Loss: 0.99049091.\n",
            "Running Loss= 3.961963653564453\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248420/250000], Loss: 0.71404505.\n",
            "Running Loss= 2.856180191040039\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248424/250000], Loss: 1.30244160.\n",
            "Running Loss= 5.209766387939453\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248428/250000], Loss: 1.72330165.\n",
            "Running Loss= 6.893206596374512\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248432/250000], Loss: 1.32976329.\n",
            "Running Loss= 5.3190531730651855\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248436/250000], Loss: 2.05675697.\n",
            "Running Loss= 8.227027893066406\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248440/250000], Loss: 0.70905626.\n",
            "Running Loss= 2.8362250328063965\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248444/250000], Loss: 1.10205889.\n",
            "Running Loss= 4.408235549926758\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248448/250000], Loss: 1.62596846.\n",
            "Running Loss= 6.503873825073242\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248452/250000], Loss: 2.84243631.\n",
            "Running Loss= 11.369745254516602\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248456/250000], Loss: 0.50394523.\n",
            "Running Loss= 2.0157809257507324\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248460/250000], Loss: 1.10095954.\n",
            "Running Loss= 4.403838157653809\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248464/250000], Loss: 0.52395707.\n",
            "Running Loss= 2.0958282947540283\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248468/250000], Loss: 0.82074523.\n",
            "Running Loss= 3.2829809188842773\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248472/250000], Loss: 1.45428872.\n",
            "Running Loss= 5.817154884338379\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248476/250000], Loss: 2.77119112.\n",
            "Running Loss= 11.08476448059082\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248480/250000], Loss: 1.13659608.\n",
            "Running Loss= 4.546384334564209\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248484/250000], Loss: 0.90777493.\n",
            "Running Loss= 3.6310997009277344\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248488/250000], Loss: 2.35953808.\n",
            "Running Loss= 9.438152313232422\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248492/250000], Loss: 0.32054356.\n",
            "Running Loss= 1.2821742296218872\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248496/250000], Loss: 1.91623616.\n",
            "Running Loss= 7.664944648742676\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248500/250000], Loss: 2.07937980.\n",
            "Running Loss= 8.317519187927246\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248504/250000], Loss: 1.27319980.\n",
            "Running Loss= 5.092799186706543\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248508/250000], Loss: 1.08745849.\n",
            "Running Loss= 4.349833965301514\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248512/250000], Loss: 1.55859387.\n",
            "Running Loss= 6.234375476837158\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248516/250000], Loss: 1.07335234.\n",
            "Running Loss= 4.29340934753418\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248520/250000], Loss: 1.66502297.\n",
            "Running Loss= 6.660091876983643\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248524/250000], Loss: 0.73212337.\n",
            "Running Loss= 2.9284934997558594\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248528/250000], Loss: 1.78397357.\n",
            "Running Loss= 7.135894298553467\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248532/250000], Loss: 2.37980819.\n",
            "Running Loss= 9.519232749938965\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248536/250000], Loss: 2.23854303.\n",
            "Running Loss= 8.954172134399414\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248540/250000], Loss: 0.99290228.\n",
            "Running Loss= 3.971609115600586\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248544/250000], Loss: 1.58639872.\n",
            "Running Loss= 6.345594882965088\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248548/250000], Loss: 1.78058887.\n",
            "Running Loss= 7.1223554611206055\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248552/250000], Loss: 0.75174898.\n",
            "Running Loss= 3.006995916366577\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248556/250000], Loss: 1.05295599.\n",
            "Running Loss= 4.2118239402771\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248560/250000], Loss: 2.14785671.\n",
            "Running Loss= 8.591426849365234\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248564/250000], Loss: 1.03119898.\n",
            "Running Loss= 4.124795913696289\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248568/250000], Loss: 1.43823063.\n",
            "Running Loss= 5.752922534942627\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248572/250000], Loss: 1.13483453.\n",
            "Running Loss= 4.539338111877441\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248576/250000], Loss: 3.56337357.\n",
            "Running Loss= 14.253494262695312\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248580/250000], Loss: 2.28104520.\n",
            "Running Loss= 9.124180793762207\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248584/250000], Loss: 1.21095836.\n",
            "Running Loss= 4.8438334465026855\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248588/250000], Loss: 1.06940103.\n",
            "Running Loss= 4.277604103088379\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248592/250000], Loss: 1.01744461.\n",
            "Running Loss= 4.0697784423828125\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248596/250000], Loss: 0.71136057.\n",
            "Running Loss= 2.845442295074463\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248600/250000], Loss: 1.33172143.\n",
            "Running Loss= 5.32688570022583\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248604/250000], Loss: 1.18906128.\n",
            "Running Loss= 4.756245136260986\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248608/250000], Loss: 2.52004004.\n",
            "Running Loss= 10.080160140991211\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248612/250000], Loss: 0.77685899.\n",
            "Running Loss= 3.107435941696167\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248616/250000], Loss: 2.30567098.\n",
            "Running Loss= 9.222683906555176\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248620/250000], Loss: 2.21263790.\n",
            "Running Loss= 8.85055160522461\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248624/250000], Loss: 2.24122119.\n",
            "Running Loss= 8.964884757995605\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248628/250000], Loss: 1.27116537.\n",
            "Running Loss= 5.084661483764648\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248632/250000], Loss: 3.40984464.\n",
            "Running Loss= 13.639378547668457\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248636/250000], Loss: 2.57151580.\n",
            "Running Loss= 10.286063194274902\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248640/250000], Loss: 1.93206954.\n",
            "Running Loss= 7.728278160095215\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248644/250000], Loss: 0.87455225.\n",
            "Running Loss= 3.498208999633789\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248648/250000], Loss: 0.19773912.\n",
            "Running Loss= 0.7909564971923828\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248652/250000], Loss: 1.12492311.\n",
            "Running Loss= 4.499692440032959\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248656/250000], Loss: 1.20669270.\n",
            "Running Loss= 4.826770782470703\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248660/250000], Loss: 1.18229771.\n",
            "Running Loss= 4.729190826416016\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248664/250000], Loss: 1.11959314.\n",
            "Running Loss= 4.478372573852539\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248668/250000], Loss: 2.48174310.\n",
            "Running Loss= 9.926972389221191\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248672/250000], Loss: 1.85148597.\n",
            "Running Loss= 7.405943870544434\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248676/250000], Loss: 1.07364488.\n",
            "Running Loss= 4.29457950592041\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248680/250000], Loss: 1.82407832.\n",
            "Running Loss= 7.296313285827637\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248684/250000], Loss: 0.68412745.\n",
            "Running Loss= 2.7365097999572754\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248688/250000], Loss: 0.71802205.\n",
            "Running Loss= 2.8720881938934326\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248692/250000], Loss: 1.26748681.\n",
            "Running Loss= 5.069947242736816\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248696/250000], Loss: 2.37862515.\n",
            "Running Loss= 9.514500617980957\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248700/250000], Loss: 3.59618282.\n",
            "Running Loss= 14.38473129272461\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248704/250000], Loss: 0.19141567.\n",
            "Running Loss= 0.765662670135498\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248708/250000], Loss: 0.86064541.\n",
            "Running Loss= 3.4425816535949707\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248712/250000], Loss: 1.61518574.\n",
            "Running Loss= 6.460742950439453\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248716/250000], Loss: 1.11177230.\n",
            "Running Loss= 4.447089195251465\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248720/250000], Loss: 1.15998328.\n",
            "Running Loss= 4.639933109283447\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248724/250000], Loss: 2.55115461.\n",
            "Running Loss= 10.204618453979492\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248728/250000], Loss: 1.76471591.\n",
            "Running Loss= 7.058863639831543\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248732/250000], Loss: 1.31973112.\n",
            "Running Loss= 5.278924465179443\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248736/250000], Loss: 1.22840285.\n",
            "Running Loss= 4.91361141204834\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248740/250000], Loss: 0.77944171.\n",
            "Running Loss= 3.117766857147217\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248744/250000], Loss: 1.26757097.\n",
            "Running Loss= 5.070283889770508\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248748/250000], Loss: 1.03919530.\n",
            "Running Loss= 4.156781196594238\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248752/250000], Loss: 1.70821702.\n",
            "Running Loss= 6.8328680992126465\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248756/250000], Loss: 1.84180093.\n",
            "Running Loss= 7.367203712463379\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248760/250000], Loss: 1.82822371.\n",
            "Running Loss= 7.312894821166992\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248764/250000], Loss: 1.16863859.\n",
            "Running Loss= 4.674554347991943\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248768/250000], Loss: 1.26858854.\n",
            "Running Loss= 5.07435417175293\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248772/250000], Loss: 1.60547161.\n",
            "Running Loss= 6.421886444091797\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248776/250000], Loss: 0.65423900.\n",
            "Running Loss= 2.6169559955596924\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248780/250000], Loss: 1.78872514.\n",
            "Running Loss= 7.154900550842285\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248784/250000], Loss: 1.27035463.\n",
            "Running Loss= 5.081418514251709\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248788/250000], Loss: 1.49733496.\n",
            "Running Loss= 5.989339828491211\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248792/250000], Loss: 1.52202463.\n",
            "Running Loss= 6.088098526000977\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248796/250000], Loss: 2.01883221.\n",
            "Running Loss= 8.075328826904297\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248800/250000], Loss: 0.65712917.\n",
            "Running Loss= 2.628516674041748\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248804/250000], Loss: 1.91400170.\n",
            "Running Loss= 7.656006813049316\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248808/250000], Loss: 1.61811757.\n",
            "Running Loss= 6.472470283508301\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248812/250000], Loss: 0.59539181.\n",
            "Running Loss= 2.3815672397613525\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248816/250000], Loss: 0.85359657.\n",
            "Running Loss= 3.41438627243042\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248820/250000], Loss: 1.18184233.\n",
            "Running Loss= 4.72736930847168\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248824/250000], Loss: 2.52028561.\n",
            "Running Loss= 10.08114242553711\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248828/250000], Loss: 0.76781088.\n",
            "Running Loss= 3.0712435245513916\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248832/250000], Loss: 1.23655581.\n",
            "Running Loss= 4.946223258972168\n",
            "Acc: 0.6173.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248836/250000], Loss: 2.92116308.\n",
            "Running Loss= 11.684652328491211\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248840/250000], Loss: 2.64513898.\n",
            "Running Loss= 10.58055591583252\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248844/250000], Loss: 1.78473854.\n",
            "Running Loss= 7.138954162597656\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248848/250000], Loss: 1.15867782.\n",
            "Running Loss= 4.634711265563965\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248852/250000], Loss: 0.95266092.\n",
            "Running Loss= 3.8106436729431152\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248856/250000], Loss: 2.03178644.\n",
            "Running Loss= 8.127145767211914\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248860/250000], Loss: 1.19019055.\n",
            "Running Loss= 4.7607622146606445\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248864/250000], Loss: 0.49394491.\n",
            "Running Loss= 1.97577965259552\n",
            "Acc: 0.6173.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248868/250000], Loss: 1.53092384.\n",
            "Running Loss= 6.123695373535156\n",
            "Acc: 0.6173.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248872/250000], Loss: 1.64389896.\n",
            "Running Loss= 6.575595855712891\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248876/250000], Loss: 1.57967615.\n",
            "Running Loss= 6.318704605102539\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248880/250000], Loss: 1.89737403.\n",
            "Running Loss= 7.58949613571167\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248884/250000], Loss: 1.13428330.\n",
            "Running Loss= 4.53713321685791\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248888/250000], Loss: 2.53790236.\n",
            "Running Loss= 10.151609420776367\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248892/250000], Loss: 1.20677185.\n",
            "Running Loss= 4.82708740234375\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248896/250000], Loss: 1.39125526.\n",
            "Running Loss= 5.56502103805542\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248900/250000], Loss: 0.92100358.\n",
            "Running Loss= 3.684014320373535\n",
            "Acc: 0.6173.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248904/250000], Loss: 1.87394547.\n",
            "Running Loss= 7.495781898498535\n",
            "Acc: 0.6173.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248908/250000], Loss: 2.09553862.\n",
            "Running Loss= 8.38215446472168\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248912/250000], Loss: 3.24021196.\n",
            "Running Loss= 12.960847854614258\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248916/250000], Loss: 1.47965050.\n",
            "Running Loss= 5.918601989746094\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248920/250000], Loss: 2.55130672.\n",
            "Running Loss= 10.20522689819336\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248924/250000], Loss: 0.48356542.\n",
            "Running Loss= 1.934261679649353\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248928/250000], Loss: 0.72475684.\n",
            "Running Loss= 2.8990273475646973\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248932/250000], Loss: 1.27301800.\n",
            "Running Loss= 5.092072010040283\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248936/250000], Loss: 2.42560172.\n",
            "Running Loss= 9.702406883239746\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248940/250000], Loss: 1.55332351.\n",
            "Running Loss= 6.21329402923584\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248944/250000], Loss: 1.07136774.\n",
            "Running Loss= 4.285470962524414\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248948/250000], Loss: 2.00870180.\n",
            "Running Loss= 8.034807205200195\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248952/250000], Loss: 2.65727139.\n",
            "Running Loss= 10.629085540771484\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248956/250000], Loss: 1.88331103.\n",
            "Running Loss= 7.5332441329956055\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248960/250000], Loss: 3.10951233.\n",
            "Running Loss= 12.43804931640625\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248964/250000], Loss: 0.95614982.\n",
            "Running Loss= 3.824599266052246\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248968/250000], Loss: 2.41352081.\n",
            "Running Loss= 9.654083251953125\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248972/250000], Loss: 2.09919167.\n",
            "Running Loss= 8.396766662597656\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248976/250000], Loss: 2.76712751.\n",
            "Running Loss= 11.068510055541992\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248980/250000], Loss: 1.47344792.\n",
            "Running Loss= 5.893791675567627\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248984/250000], Loss: 1.33120513.\n",
            "Running Loss= 5.324820518493652\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248988/250000], Loss: 0.78778666.\n",
            "Running Loss= 3.151146650314331\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248992/250000], Loss: 0.15088914.\n",
            "Running Loss= 0.6035565733909607\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [248996/250000], Loss: 3.51392865.\n",
            "Running Loss= 14.05571460723877\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249000/250000], Loss: 2.04627514.\n",
            "Running Loss= 8.185100555419922\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249004/250000], Loss: 2.94348550.\n",
            "Running Loss= 11.773941993713379\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249008/250000], Loss: 2.10505533.\n",
            "Running Loss= 8.420221328735352\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249012/250000], Loss: 1.49413300.\n",
            "Running Loss= 5.976531982421875\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249016/250000], Loss: 3.82604933.\n",
            "Running Loss= 15.304197311401367\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249020/250000], Loss: 1.43798232.\n",
            "Running Loss= 5.75192928314209\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249024/250000], Loss: 1.02740979.\n",
            "Running Loss= 4.1096391677856445\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249028/250000], Loss: 0.82730353.\n",
            "Running Loss= 3.3092141151428223\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249032/250000], Loss: 0.89740634.\n",
            "Running Loss= 3.589625358581543\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249036/250000], Loss: 1.69673812.\n",
            "Running Loss= 6.786952495574951\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249040/250000], Loss: 0.67183709.\n",
            "Running Loss= 2.6873483657836914\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249044/250000], Loss: 1.03275394.\n",
            "Running Loss= 4.131015777587891\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249048/250000], Loss: 2.31684732.\n",
            "Running Loss= 9.267389297485352\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249052/250000], Loss: 1.32191300.\n",
            "Running Loss= 5.287652015686035\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249056/250000], Loss: 1.60858631.\n",
            "Running Loss= 6.434345245361328\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249060/250000], Loss: 1.83098996.\n",
            "Running Loss= 7.323959827423096\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249064/250000], Loss: 1.47337580.\n",
            "Running Loss= 5.893503189086914\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249068/250000], Loss: 1.23199689.\n",
            "Running Loss= 4.927987575531006\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249072/250000], Loss: 1.93521810.\n",
            "Running Loss= 7.740872383117676\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249076/250000], Loss: 1.80610633.\n",
            "Running Loss= 7.224425315856934\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249080/250000], Loss: 1.87234831.\n",
            "Running Loss= 7.48939323425293\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249084/250000], Loss: 2.27558041.\n",
            "Running Loss= 9.10232162475586\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249088/250000], Loss: 0.99262297.\n",
            "Running Loss= 3.970491886138916\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249092/250000], Loss: 1.73809326.\n",
            "Running Loss= 6.952373027801514\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249096/250000], Loss: 2.21709871.\n",
            "Running Loss= 8.86839485168457\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249100/250000], Loss: 1.54471111.\n",
            "Running Loss= 6.178844451904297\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249104/250000], Loss: 0.79563582.\n",
            "Running Loss= 3.1825432777404785\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249108/250000], Loss: 0.58388931.\n",
            "Running Loss= 2.335557222366333\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249112/250000], Loss: 1.46496451.\n",
            "Running Loss= 5.85985803604126\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249116/250000], Loss: 1.35074162.\n",
            "Running Loss= 5.402966499328613\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249120/250000], Loss: 1.89700031.\n",
            "Running Loss= 7.588001251220703\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249124/250000], Loss: 1.74102306.\n",
            "Running Loss= 6.964092254638672\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249128/250000], Loss: 1.15137780.\n",
            "Running Loss= 4.60551118850708\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249132/250000], Loss: 1.22359753.\n",
            "Running Loss= 4.894390106201172\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249136/250000], Loss: 1.78488648.\n",
            "Running Loss= 7.139545917510986\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249140/250000], Loss: 1.20035017.\n",
            "Running Loss= 4.801400661468506\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249144/250000], Loss: 0.90664405.\n",
            "Running Loss= 3.6265761852264404\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249148/250000], Loss: 0.88658309.\n",
            "Running Loss= 3.546332359313965\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249152/250000], Loss: 2.83936906.\n",
            "Running Loss= 11.357476234436035\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249156/250000], Loss: 2.20554972.\n",
            "Running Loss= 8.822198867797852\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249160/250000], Loss: 1.96406519.\n",
            "Running Loss= 7.856260776519775\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249164/250000], Loss: 0.64054978.\n",
            "Running Loss= 2.562199115753174\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249168/250000], Loss: 1.66671658.\n",
            "Running Loss= 6.666866302490234\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249172/250000], Loss: 1.97819436.\n",
            "Running Loss= 7.912777423858643\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249176/250000], Loss: 0.89683193.\n",
            "Running Loss= 3.587327718734741\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249180/250000], Loss: 2.22249889.\n",
            "Running Loss= 8.889995574951172\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249184/250000], Loss: 0.78763068.\n",
            "Running Loss= 3.1505227088928223\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249188/250000], Loss: 3.10678554.\n",
            "Running Loss= 12.427142143249512\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249192/250000], Loss: 2.02547002.\n",
            "Running Loss= 8.101880073547363\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249196/250000], Loss: 4.49703074.\n",
            "Running Loss= 17.988122940063477\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249200/250000], Loss: 0.60304046.\n",
            "Running Loss= 2.4121618270874023\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249204/250000], Loss: 1.50312567.\n",
            "Running Loss= 6.012502670288086\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249208/250000], Loss: 2.23697376.\n",
            "Running Loss= 8.947895050048828\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249212/250000], Loss: 2.26280212.\n",
            "Running Loss= 9.05120849609375\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249216/250000], Loss: 1.64223325.\n",
            "Running Loss= 6.568933010101318\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249220/250000], Loss: 1.94714630.\n",
            "Running Loss= 7.788585186004639\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249224/250000], Loss: 1.02049959.\n",
            "Running Loss= 4.081998348236084\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249228/250000], Loss: 0.66084814.\n",
            "Running Loss= 2.643392562866211\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249232/250000], Loss: 0.49305910.\n",
            "Running Loss= 1.9722363948822021\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249236/250000], Loss: 4.01150703.\n",
            "Running Loss= 16.04602813720703\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249240/250000], Loss: 2.14986587.\n",
            "Running Loss= 8.59946346282959\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249244/250000], Loss: 2.16066051.\n",
            "Running Loss= 8.6426420211792\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249248/250000], Loss: 1.64537430.\n",
            "Running Loss= 6.5814971923828125\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249252/250000], Loss: 3.08138561.\n",
            "Running Loss= 12.325542449951172\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249256/250000], Loss: 0.86054277.\n",
            "Running Loss= 3.442171096801758\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249260/250000], Loss: 1.35866117.\n",
            "Running Loss= 5.43464469909668\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249264/250000], Loss: 1.81454515.\n",
            "Running Loss= 7.258180618286133\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249268/250000], Loss: 0.75824189.\n",
            "Running Loss= 3.0329675674438477\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249272/250000], Loss: 1.21653724.\n",
            "Running Loss= 4.866148948669434\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249276/250000], Loss: 1.32162654.\n",
            "Running Loss= 5.286506175994873\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249280/250000], Loss: 1.49102604.\n",
            "Running Loss= 5.964104175567627\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249284/250000], Loss: 1.66819477.\n",
            "Running Loss= 6.672779083251953\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249288/250000], Loss: 0.76708859.\n",
            "Running Loss= 3.068354368209839\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249292/250000], Loss: 1.90949607.\n",
            "Running Loss= 7.637984275817871\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249296/250000], Loss: 2.77998590.\n",
            "Running Loss= 11.119943618774414\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249300/250000], Loss: 0.75150597.\n",
            "Running Loss= 3.00602388381958\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249304/250000], Loss: 1.78557563.\n",
            "Running Loss= 7.142302513122559\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249308/250000], Loss: 1.60887766.\n",
            "Running Loss= 6.435510635375977\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249312/250000], Loss: 1.37553740.\n",
            "Running Loss= 5.50214958190918\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249316/250000], Loss: 2.79840159.\n",
            "Running Loss= 11.19360637664795\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249320/250000], Loss: 1.10728502.\n",
            "Running Loss= 4.429140090942383\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249324/250000], Loss: 3.27818012.\n",
            "Running Loss= 13.112720489501953\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249328/250000], Loss: 1.11279225.\n",
            "Running Loss= 4.451169013977051\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249332/250000], Loss: 0.86421788.\n",
            "Running Loss= 3.456871509552002\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249336/250000], Loss: 2.22003484.\n",
            "Running Loss= 8.880139350891113\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249340/250000], Loss: 1.70915103.\n",
            "Running Loss= 6.836604118347168\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249344/250000], Loss: 1.42764091.\n",
            "Running Loss= 5.710563659667969\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249348/250000], Loss: 0.73138052.\n",
            "Running Loss= 2.9255220890045166\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249352/250000], Loss: 1.22007835.\n",
            "Running Loss= 4.880313396453857\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249356/250000], Loss: 3.21730804.\n",
            "Running Loss= 12.869232177734375\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249360/250000], Loss: 0.81251597.\n",
            "Running Loss= 3.250063896179199\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249364/250000], Loss: 0.85400319.\n",
            "Running Loss= 3.416012763977051\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249368/250000], Loss: 2.88839602.\n",
            "Running Loss= 11.553584098815918\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249372/250000], Loss: 0.66169798.\n",
            "Running Loss= 2.646791934967041\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249376/250000], Loss: 0.70754778.\n",
            "Running Loss= 2.830191135406494\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249380/250000], Loss: 1.02144659.\n",
            "Running Loss= 4.08578634262085\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249384/250000], Loss: 1.61047041.\n",
            "Running Loss= 6.4418816566467285\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249388/250000], Loss: 1.03712177.\n",
            "Running Loss= 4.148487091064453\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249392/250000], Loss: 0.62803203.\n",
            "Running Loss= 2.5121281147003174\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249396/250000], Loss: 1.37037194.\n",
            "Running Loss= 5.48148775100708\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249400/250000], Loss: 1.38889718.\n",
            "Running Loss= 5.555588722229004\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249404/250000], Loss: 0.94267440.\n",
            "Running Loss= 3.770697593688965\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249408/250000], Loss: 1.97822165.\n",
            "Running Loss= 7.912886619567871\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249412/250000], Loss: 1.26214361.\n",
            "Running Loss= 5.048574447631836\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249416/250000], Loss: 1.75415468.\n",
            "Running Loss= 7.016618728637695\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249420/250000], Loss: 0.74600357.\n",
            "Running Loss= 2.9840142726898193\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249424/250000], Loss: 1.36871767.\n",
            "Running Loss= 5.474870681762695\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249428/250000], Loss: 1.41388583.\n",
            "Running Loss= 5.655543327331543\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249432/250000], Loss: 2.10811806.\n",
            "Running Loss= 8.432472229003906\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249436/250000], Loss: 1.61589229.\n",
            "Running Loss= 6.463569164276123\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249440/250000], Loss: 1.34515250.\n",
            "Running Loss= 5.38060998916626\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249444/250000], Loss: 1.01268578.\n",
            "Running Loss= 4.050743103027344\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249448/250000], Loss: 0.75360644.\n",
            "Running Loss= 3.014425754547119\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249452/250000], Loss: 1.47053313.\n",
            "Running Loss= 5.882132530212402\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249456/250000], Loss: 0.92650354.\n",
            "Running Loss= 3.7060141563415527\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249460/250000], Loss: 1.05363417.\n",
            "Running Loss= 4.214536666870117\n",
            "Acc: 0.6169.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249464/250000], Loss: 0.49318638.\n",
            "Running Loss= 1.9727455377578735\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249468/250000], Loss: 1.03867912.\n",
            "Running Loss= 4.154716491699219\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249472/250000], Loss: 1.79238415.\n",
            "Running Loss= 7.169536590576172\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249476/250000], Loss: 1.34049141.\n",
            "Running Loss= 5.361965656280518\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249480/250000], Loss: 1.76240206.\n",
            "Running Loss= 7.04960823059082\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249484/250000], Loss: 1.25984919.\n",
            "Running Loss= 5.0393967628479\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249488/250000], Loss: 0.75745904.\n",
            "Running Loss= 3.0298361778259277\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249492/250000], Loss: 1.22331393.\n",
            "Running Loss= 4.893255710601807\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249496/250000], Loss: 1.58424926.\n",
            "Running Loss= 6.336997032165527\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249500/250000], Loss: 0.87568724.\n",
            "Running Loss= 3.502748966217041\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249504/250000], Loss: 2.53278422.\n",
            "Running Loss= 10.131136894226074\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249508/250000], Loss: 1.83994579.\n",
            "Running Loss= 7.359783172607422\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249512/250000], Loss: 1.06785846.\n",
            "Running Loss= 4.2714338302612305\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249516/250000], Loss: 1.03660798.\n",
            "Running Loss= 4.146431922912598\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249520/250000], Loss: 0.75612664.\n",
            "Running Loss= 3.0245065689086914\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249524/250000], Loss: 0.42117554.\n",
            "Running Loss= 1.6847021579742432\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249528/250000], Loss: 1.59745741.\n",
            "Running Loss= 6.389829635620117\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249532/250000], Loss: 1.57998204.\n",
            "Running Loss= 6.319928169250488\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249536/250000], Loss: 0.97297800.\n",
            "Running Loss= 3.8919119834899902\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249540/250000], Loss: 2.63132095.\n",
            "Running Loss= 10.525283813476562\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249544/250000], Loss: 3.10582256.\n",
            "Running Loss= 12.423290252685547\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249548/250000], Loss: 0.90041441.\n",
            "Running Loss= 3.6016576290130615\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249552/250000], Loss: 0.48448732.\n",
            "Running Loss= 1.937949299812317\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249556/250000], Loss: 0.95728624.\n",
            "Running Loss= 3.8291449546813965\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249560/250000], Loss: 1.37832284.\n",
            "Running Loss= 5.513291358947754\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249564/250000], Loss: 1.80396366.\n",
            "Running Loss= 7.215854644775391\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249568/250000], Loss: 2.68445778.\n",
            "Running Loss= 10.737831115722656\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249572/250000], Loss: 1.55586815.\n",
            "Running Loss= 6.223472595214844\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249576/250000], Loss: 0.77333158.\n",
            "Running Loss= 3.0933263301849365\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249580/250000], Loss: 1.88212085.\n",
            "Running Loss= 7.5284833908081055\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249584/250000], Loss: 1.01587570.\n",
            "Running Loss= 4.063502788543701\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249588/250000], Loss: 2.62568927.\n",
            "Running Loss= 10.50275707244873\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249592/250000], Loss: 0.93148303.\n",
            "Running Loss= 3.7259321212768555\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249596/250000], Loss: 1.16849613.\n",
            "Running Loss= 4.673984527587891\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249600/250000], Loss: 1.29434133.\n",
            "Running Loss= 5.177365303039551\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249604/250000], Loss: 0.59944844.\n",
            "Running Loss= 2.397793769836426\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249608/250000], Loss: 1.90569043.\n",
            "Running Loss= 7.6227617263793945\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249612/250000], Loss: 1.58677149.\n",
            "Running Loss= 6.347085952758789\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249616/250000], Loss: 1.36918461.\n",
            "Running Loss= 5.476738452911377\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249620/250000], Loss: 1.79512548.\n",
            "Running Loss= 7.180501937866211\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249624/250000], Loss: 1.88016152.\n",
            "Running Loss= 7.520646095275879\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249628/250000], Loss: 1.25762594.\n",
            "Running Loss= 5.030503749847412\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249632/250000], Loss: 0.77579039.\n",
            "Running Loss= 3.103161573410034\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249636/250000], Loss: 0.55552679.\n",
            "Running Loss= 2.222107172012329\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249640/250000], Loss: 2.00908971.\n",
            "Running Loss= 8.036358833312988\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249644/250000], Loss: 1.01464427.\n",
            "Running Loss= 4.058577060699463\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249648/250000], Loss: 1.14898467.\n",
            "Running Loss= 4.595938682556152\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249652/250000], Loss: 3.39456177.\n",
            "Running Loss= 13.5782470703125\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249656/250000], Loss: 1.04281116.\n",
            "Running Loss= 4.1712446212768555\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249660/250000], Loss: 1.01009858.\n",
            "Running Loss= 4.040394306182861\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249664/250000], Loss: 2.94559097.\n",
            "Running Loss= 11.782363891601562\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249668/250000], Loss: 1.95308733.\n",
            "Running Loss= 7.812349319458008\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249672/250000], Loss: 1.94793105.\n",
            "Running Loss= 7.79172420501709\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249676/250000], Loss: 3.01352072.\n",
            "Running Loss= 12.054082870483398\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249680/250000], Loss: 0.93471318.\n",
            "Running Loss= 3.7388527393341064\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249684/250000], Loss: 0.77565718.\n",
            "Running Loss= 3.102628707885742\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249688/250000], Loss: 1.25609398.\n",
            "Running Loss= 5.024375915527344\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249692/250000], Loss: 2.12320256.\n",
            "Running Loss= 8.492810249328613\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249696/250000], Loss: 1.26885056.\n",
            "Running Loss= 5.07540225982666\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249700/250000], Loss: 1.37890792.\n",
            "Running Loss= 5.515631675720215\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249704/250000], Loss: 1.81554568.\n",
            "Running Loss= 7.262182712554932\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249708/250000], Loss: 1.70092547.\n",
            "Running Loss= 6.803701877593994\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249712/250000], Loss: 1.97822618.\n",
            "Running Loss= 7.912904739379883\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249716/250000], Loss: 2.59478712.\n",
            "Running Loss= 10.379148483276367\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249720/250000], Loss: 1.09535897.\n",
            "Running Loss= 4.381435871124268\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249724/250000], Loss: 0.66661817.\n",
            "Running Loss= 2.6664726734161377\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249728/250000], Loss: 1.52365732.\n",
            "Running Loss= 6.094629287719727\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249732/250000], Loss: 1.38139606.\n",
            "Running Loss= 5.5255842208862305\n",
            "Acc: 0.6170.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249736/250000], Loss: 1.19209456.\n",
            "Running Loss= 4.768378257751465\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249740/250000], Loss: 0.63308579.\n",
            "Running Loss= 2.5323431491851807\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249744/250000], Loss: 1.26572108.\n",
            "Running Loss= 5.062884330749512\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249748/250000], Loss: 1.10645020.\n",
            "Running Loss= 4.425800800323486\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249752/250000], Loss: 0.69680965.\n",
            "Running Loss= 2.787238597869873\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249756/250000], Loss: 1.07820868.\n",
            "Running Loss= 4.312834739685059\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249760/250000], Loss: 1.21484017.\n",
            "Running Loss= 4.859360694885254\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249764/250000], Loss: 1.37427080.\n",
            "Running Loss= 5.4970831871032715\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249768/250000], Loss: 1.95961094.\n",
            "Running Loss= 7.838443756103516\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249772/250000], Loss: 1.82951093.\n",
            "Running Loss= 7.3180437088012695\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249776/250000], Loss: 1.44097745.\n",
            "Running Loss= 5.763909816741943\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249780/250000], Loss: 2.31842089.\n",
            "Running Loss= 9.273683547973633\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249784/250000], Loss: 0.47645077.\n",
            "Running Loss= 1.9058030843734741\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249788/250000], Loss: 0.66870582.\n",
            "Running Loss= 2.67482328414917\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249792/250000], Loss: 1.03983712.\n",
            "Running Loss= 4.159348487854004\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249796/250000], Loss: 1.42668211.\n",
            "Running Loss= 5.706728458404541\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249800/250000], Loss: 1.78616846.\n",
            "Running Loss= 7.144673824310303\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249804/250000], Loss: 0.98358124.\n",
            "Running Loss= 3.9343249797821045\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249808/250000], Loss: 2.23795772.\n",
            "Running Loss= 8.951830863952637\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249812/250000], Loss: 1.01725399.\n",
            "Running Loss= 4.069015979766846\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249816/250000], Loss: 1.05024815.\n",
            "Running Loss= 4.200992584228516\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249820/250000], Loss: 1.01238751.\n",
            "Running Loss= 4.0495500564575195\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249824/250000], Loss: 2.36594963.\n",
            "Running Loss= 9.463798522949219\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249828/250000], Loss: 0.51316857.\n",
            "Running Loss= 2.0526742935180664\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249832/250000], Loss: 0.47282755.\n",
            "Running Loss= 1.891310214996338\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249836/250000], Loss: 2.15232015.\n",
            "Running Loss= 8.609280586242676\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249840/250000], Loss: 1.71212387.\n",
            "Running Loss= 6.8484954833984375\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249844/250000], Loss: 1.16013014.\n",
            "Running Loss= 4.6405205726623535\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249848/250000], Loss: 1.85294127.\n",
            "Running Loss= 7.411765098571777\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249852/250000], Loss: 2.86968184.\n",
            "Running Loss= 11.478727340698242\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249856/250000], Loss: 0.91391528.\n",
            "Running Loss= 3.655661106109619\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249860/250000], Loss: 2.96215510.\n",
            "Running Loss= 11.848620414733887\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249864/250000], Loss: 1.26948071.\n",
            "Running Loss= 5.077922821044922\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249868/250000], Loss: 2.89281559.\n",
            "Running Loss= 11.57126235961914\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249872/250000], Loss: 0.95979768.\n",
            "Running Loss= 3.839190721511841\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249876/250000], Loss: 1.14732933.\n",
            "Running Loss= 4.589317321777344\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249880/250000], Loss: 4.69922543.\n",
            "Running Loss= 18.79690170288086\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249884/250000], Loss: 2.50382304.\n",
            "Running Loss= 10.015292167663574\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249888/250000], Loss: 1.77187991.\n",
            "Running Loss= 7.087519645690918\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249892/250000], Loss: 1.42970622.\n",
            "Running Loss= 5.718824863433838\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249896/250000], Loss: 2.91739273.\n",
            "Running Loss= 11.669570922851562\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249900/250000], Loss: 1.46040773.\n",
            "Running Loss= 5.841630935668945\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249904/250000], Loss: 0.53025353.\n",
            "Running Loss= 2.12101411819458\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249908/250000], Loss: 1.48911750.\n",
            "Running Loss= 5.956470012664795\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249912/250000], Loss: 0.55988884.\n",
            "Running Loss= 2.2395553588867188\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249916/250000], Loss: 0.42475110.\n",
            "Running Loss= 1.6990044116973877\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249920/250000], Loss: 1.13378704.\n",
            "Running Loss= 4.5351481437683105\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249924/250000], Loss: 1.98897433.\n",
            "Running Loss= 7.955897331237793\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249928/250000], Loss: 1.63280582.\n",
            "Running Loss= 6.531223297119141\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249932/250000], Loss: 2.23423409.\n",
            "Running Loss= 8.936936378479004\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249936/250000], Loss: 2.49278569.\n",
            "Running Loss= 9.971142768859863\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249940/250000], Loss: 1.44161332.\n",
            "Running Loss= 5.766453266143799\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249944/250000], Loss: 2.59050512.\n",
            "Running Loss= 10.362020492553711\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249948/250000], Loss: 1.64293170.\n",
            "Running Loss= 6.5717267990112305\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249952/250000], Loss: 1.24898624.\n",
            "Running Loss= 4.995944976806641\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249956/250000], Loss: 1.25578678.\n",
            "Running Loss= 5.023147106170654\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249960/250000], Loss: 0.77839690.\n",
            "Running Loss= 3.1135876178741455\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249964/250000], Loss: 1.57446790.\n",
            "Running Loss= 6.2978715896606445\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249968/250000], Loss: 3.01601267.\n",
            "Running Loss= 12.064050674438477\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249972/250000], Loss: 2.35087490.\n",
            "Running Loss= 9.403499603271484\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249976/250000], Loss: 1.38905466.\n",
            "Running Loss= 5.55621862411499\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249980/250000], Loss: 1.51806092.\n",
            "Running Loss= 6.072243690490723\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249984/250000], Loss: 1.25844824.\n",
            "Running Loss= 5.033792972564697\n",
            "Acc: 0.6171.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249988/250000], Loss: 1.05866241.\n",
            "Running Loss= 4.234649658203125\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249992/250000], Loss: 1.12000537.\n",
            "Running Loss= 4.4800214767456055\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [249996/250000], Loss: 2.10708714.\n",
            "Running Loss= 8.428348541259766\n",
            "Acc: 0.6172.\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "epoch:  5\n",
            "Step [250000/250000], Loss: 1.02088058.\n",
            "Running Loss= 4.083522319793701\n",
            "Acc: 0.6172.\n",
            "Epoch [5/5], time: 271.7601659297943 sec!\n",
            "epoch completed and model copy completed\n",
            "Model save to ./model/Inception_v3.pth.\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Test the network**\n",
        "\n",
        "Test the trained network using the testset.\n",
        "\n",
        "Accuracy of the network on the 10,000 test images is the final accuracy of your network. \n",
        "\n",
        "The closer the accuray is to 100%, the better the network classifies the input image."
      ],
      "metadata": {
        "id": "CgDA6_LlfNhE"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "print(model)"
      ],
      "metadata": {
        "id": "sftEW5A9fbLM"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "source": [
        "# Test the trained model with sample\n",
        "dataiter_test = iter(testloader)\n",
        "img_test, labels_test = next(dataiter_test)\n",
        "\n",
        "imshow(torchvision.utils.make_grid(img_test))\n",
        "print('GroundTruth: ', ' '.join('%5s' % classes[labels_test[j]] for j in range(4)))\n",
        "\n",
        "img_test = img_test.to(device)\n",
        "labels_test = labels_test.to(device)\n",
        "\n",
        "# Prediction\n",
        "outputs_test = model(img_test)\n",
        "print(outputs_test)"
      ],
      "metadata": {
        "id": "QGOFj_8OiWMC"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "execution_count": 22,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 266
        },
        "id": "fNfptwqLqpdA",
        "outputId": "5dbc23ec-839c-4c1a-a233-de2f1d767ffc"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "GroundTruth:    cat  ship  ship plane\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "Predicted:   frog  ship  ship plane\n"
          ]
        },
        {
          "output_type": "display_data",
          "data": {
            "text/plain": [
              "<Figure size 640x480 with 1 Axes>"
            ],
            "image/png": "iVBORw0KGgoAAAANSUhEUgAAAh8AAACwCAYAAACviAzDAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjcuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/bCgiHAAAACXBIWXMAAA9hAAAPYQGoP6dpAABHjUlEQVR4nO29e3Rd1XX/O/fj7PN+6HkkWZItY4MN5ukXCvxSEtwCyeBR+LUJlxYn4TaD1k4Bj9sASYHRtNSM9jcKSeuQ0VwC6W0oCfkF0kICITbhkdr4gQ0Yv7Fsy7YeluWjI5332XvdP/LjrDmnsLCMfGTZ8zOGxthLa2vvddZee5+t9Z3zuwyllAJBEARBEIQqYU52AwRBEARBOLuQlw9BEARBEKqKvHwIgiAIglBV5OVDEARBEISqIi8fgiAIgiBUFXn5EARBEAShqsjLhyAIgiAIVUVePgRBEARBqCry8iEIgiAIQlWRlw9BEARBEKrKKXv5WLVqFcyYMQMCgQAsXrwY1q9ff6pOJQiCIAjCFMI4FWu7/PjHP4bbb78dvve978HixYvhscceg2effRZ27twJjY2NY/6t53lw+PBhiEajYBjGRDdNEARBEIRTgFIKhoeHoaWlBUzzY+Y21Clg0aJFatmyZZWy67qqpaVFrVy58mP/tru7WwGA/MiP/MiP/MiP/EzBn+7u7o/9rrdhgikWi7Bp0ya4//77K78zTROWLFkCa9euHbV/oVCAQqFQKav/MxFzzz33gN/vn+jmCYIgCIJwCigUCvDoo49CNBr92H0n/OVjYGAAXNeFZDJJfp9MJmHHjh2j9l+5ciX8zd/8zajf+/1+efkQBEEQhCnGiYRMTHq2y/333w9DQ0OVn+7u7slukiAIgiAIp5AJn/mor68Hy7Kgr6+P/L6vrw+amppG7S8zHIIgCIJwdjHhMx+O48D8+fNh9erVld95ngerV6+Gzs7OiT6dIAiCIAhTjAmf+QAAWLFiBSxduhQWLFgAixYtgsceewwymQx8+ctf/sTH/qj4EGFq8tBDDx237q677iJl13VPdXMqwc4TDdU/6Tk8r4zOT3XSskfLpbL+291795K6ZJNOYfeKRVLXUFtDygG/T+/7CT7ziabC/8u//MuY9XJPnzmMdU/LdT5zGOs6nyin5OXjC1/4Ahw5cgQefPBB6O3thUsuuQReeumlUUGogiAIgiCcfZySlw8AgOXLl8Py5ctP1eEFQRAEQZiiTHq2iyAIgiAIZxenbOZDED4JPP6Cl6ttvf9x5zvxeBF6HMvnVLZdFvORGymQcmooU9nuGxgkdcFouLJdxwx+TIP+j2Gg/zkMwzuRRn+4MzuOIAjCySEzH4IgCIIgVBV5+RAEQRAEoaqI7CKclpgmndRX3sRM8it+mDHUEiy1mB8ju7hIhPA8KmVYln7HLxZLpO7I0XRlO53Jk7pcgaYXZ7JahjH9IVqX0+m1kRD9UGX2GR20/UnUK1l1WhCEk0VmPgRBEARBqCry8iEIgiAIQlWRlw9BEARBEKqKxHwIpyWZbI7+wqOBC7ZlVbYVq7Ns6yO3AQAMg6XworAF0zv+u7jJE0tZvMNIQcdr8LTboK1vs3ypTOp6UMxH/7E0qfPg+Pbq2eERUtePUm8PHuohdefPnknK58xorWxbisaVkLYr1h88xAOVWbeO7q8x+Lsf/KqyPfOcWaQuEY9Vtn0WbY/jo9fWQfWOSfe1UQPdMh1bkbCPlH2WbrttsdRoU5/z2DGa7hxFKc4+Hz2mbbBxiGKayh61wzfH+JeQp01nM1l9Dps+zgOBQGW7yCz3y0Waxh0MBFHbaFtr4zS+SBAmApn5EARBEAShqsjLhyAIgiAIVUVePgRBEARBqCpTLubjR//PZaRsmNhDgeqYZZd6KjgOsrJmXgw4bsAwqQ7OJFBQJW1lbQDd1+do7d9i3WuYSHf2qPZfKtP2eNjXwqDHKbu6ruCNbXntKX1c7suAPSdcl7VV0faY6HMWWd9l0EfJFml//K9n98HJkMrRaxkJhUnZtLWmzvuShG6wDmESPpgo6MMYS2z/GHv33p5Dle3a2lpSFwzocVfIZ0ldyK/rmhrq6SlZ4zNZPbbCjkPqinkdx2CZ9PqMFNh9gdpusLFF41XY2OJhL8ctjOquMfGh9gYceqBwULfP5teO3Xt+W1+/oGOyffU5Ci7/uwApOz79t8xuBmwUQ8RjTkwUV2IAvQZ+dr1w+EomS59TuOUO+zsF7JyogT4W84HjTkpsDNgsdiTo9+vCJPi3fP//XUXKkfpzK9tBi/ZBLBqpbA9zL5z0UVI20djymKmPje73oO0ndQGLfTWiZ/eohyyqcj33uHUeqxvVHnT9TJPHqh3/mvA4NgN/Zt6eMY7p99M+cExUVrTuF6/87LjHPVFk5kMQBEEQhKoiLx+CIAiCIFSVKSe7FFlamh/0dLzJpiRtm8kn+FWLTQsbaKq1wNPSPHZclIJoMUkGzfyC4dHpVCgje2w2ZeyxcxQNPRXsWnTKq4j2LbpsxVI2zWYgSSLg4+mHaHrZph3illjbDX0cxdqO5QHLmpj3WTtWR9vDJJESnpY02NQiKvNpUJPLJ6isxvBa57bsfDoepy4aLH0V0DVIRKl8VCqhc1o0PTMUoavTYtnFYGPCQHqSP0iPY7DGltF1V3xRW5x6PGqml/YPPsvoXU9cd/EhmdNvUgktYOkG+phmVshRCctCfRKwg6SuhFKhTaDnUGVqa6+QFOWyz+z49HFNnl+MrrvB/q9z2bMgm9VtP3rkCKlL1tfo47CLYDn0kW2h9lmsPfh2t9lxCi7tA5xSXGLp4NXAU1T6Klu6D0o+es+4lpZdTB+TXXI0BV25eiVolv0MBXS9SkyqzNvsWYlut2KJjhcTfQnkmEWAhep4+jVfasE0dVnx9GucRs6kuHKZPY/RRzEM/p2ox09NTQ2p8wfZathIavLMceioJ4jMfAiCIAiCUFXk5UMQBEEQhKoiLx+CIAiCIFSVKRfzoVyqqRmu1rS8EtXJrCCLh0DpbzxWA6ckOUybKyta9kronCymAOtvBtO9TRQrYrD0MWVRzTPnapGx9yjVBjNFfdyREVrH7bKjAZQaaFBdMxbS+nXQz9NVmeZI4jpo5+HeKXkTow3+4N/+nZQNdlwfSrWNRGnfzepor2wvvOh8UsekXJJizW3RFdbJWVpamaX31qD0WsdP24NjYhyHxmrU1SCbeB6zxLRdB6dS+ug58mXdnlT6GKlLDQ2R8vBQqrJd4jb2KG6gri5BqmbPojbtPhR/wEM8eKzCWOBUWx8wHdzVsRGOj8e5sDR3NGZ9Jn20eYauMz2WepxnqbeWjjHIs/ivELpnLP4ZcQo665BMnsYJbNr0dmW7xGJXamILdVv8dMDyVHGSEs/jm1A8CI9D8tj4VehvlVf9mA9T0XO6qL0ue265hu7LQJRe57rpSXrcIX0vRLI0HqSY1+PAjdD7yYsnSDmKUsB5W01s91Cg4wVbOgQCbPzykCE0ZngaLC6bLP6tzGJ0iBMCGy8Oem4GgzQuymDxTQa6Fz04fsruySIzH4IgCIIgVBV5+RAEQRAEoapMOdnFZClrfgtNOY2yQGQuhzgNlE15lfG0PptO9Tl0eqppxnmV7XRqgNQNHNVTqD6bTpuboKfdimXa9TlFV47cvl+n3yk/TTstoWnhIpsuHBmiK20e6kPTjgF6TrcnVdlub6JtrYsyxz805W+waUdsSunyNNOTJJel09TFHC1jN8dhqipACNW5c+eQurxichK67n52nfHMucslGTYtGq9t0MfkboR4Wpa5w1pYWmGukzwLFjsi7tu/l9Qd6u+vbA8epS6PuRyVVtyCvn7FHO2PQkGP39Y2OoXd3tZKymGS9sn6Zxyr2oKrp78tlgZroDofk6VKLEXWRW6/VoyOZ0Oh5wZLY/SYuzAgyXMknSJVkZC+33jaNk63tn30XktlqbQymNblINMCi6gLiiXaNtth/YxkF5c5OpfL+nNy92eHuaEqNC49d+Kn2D+OMrA0T9DXz7NoHxQUWrVa0TERZk6lsZCWGby3N5C64oCWYZrnnUfqjCP0uVow9DM3wrSv4ZxO5w2w+8CPJHuzLkLqTJZqi7+eCiF6fhul5Fsldv4ws59AMqvdRmXnbCJe2fb4/cO+9wKevgY8hGAikJkPQRAEQRCqirx8CIIgCIJQVcb98vH666/D9ddfDy0tLWAYBjz//POkXikFDz74IDQ3N0MwGIQlS5bA7t27J6q9giAIgiBMccYd85HJZODiiy+Gr3zlK3DzzTePqv+Hf/gH+M53vgM//OEPoaOjAx544AG45pprYNu2bRAIBD7iiOPDcOiKoWWkeZrMmrlYplqYg+yXXZdb0qIy0+wdZku+eMnvV7Y3/fdaUncYxYBkynw1Wq357T/YT+q6Dh4iZX9Nc2W7NdlB2+rX+miRaZy+SAMpl/Na1zzaf5jUhWp0LMnBkV5Sl2exCcmo1i5DbDVPt6T164ly4f3jm28h5QJLCQ2jNDGeIhZEsQgsSw/S6TQpe2Wtu/rY6qZ2UJeVTT9zjqV1Kw+vSEnHC04LttlxfD68qu7YcSUlpLvmWexTOKbHVk0iQepcpi0HLN13qaM0YObgoX2V7Vkds0idxdJXcRyMxdo6Hol4TOtzD9WxFXht8/gW4ZZBP7NyccwDi9VgfemiFMORYTpeDuC2slgNHH/RFqMxXNxC/Z13361sX3TBBaTOQ5+j4NJxFuBp/yh+JZdlzztbt6dcYlb0Nm1fCaVq47if6sFSS1FcmanY9SmjZx5bzsFg/ZM39LPS51GbdqO+sbKdHaZ9V+raRcplQ98zHvsay2CLd/bcdEoozq+b+TuweB5sBZFnsXxWXtfZtKlQaKKfOder4/6iBv0+MOJ65Wy+snuJPX98KAbEG7UOwydn3C8f1113HVx33XUfWaeUgsceewz++q//Gm688UYAAPi3f/s3SCaT8Pzzz8MXv/jFT9ZaQRAEQRCmPBMa89HV1QW9vb2wZMmSyu/i8TgsXrwY1q5d+5F/UygUIJ1Okx9BEARBEM5cJvTlo7f3d1P3ySRN0Usmk5U6zsqVKyEej1d+2traJrJJgiAIgiCcZky6z8f9998PK1asqJTT6fSYLyD7h6gWVhPR2mCM2S3bTHj2UAzIKGtbZClsMh0xm6V21Wte+Hlluy9F8+f7RvTf7j9E/27/4e7KthWgOd+uFSPlcExrdb4Q3dcOaP3Rz7whAibVNQeKOlaiubWd1OVRfvrevfTlcDBFc8CtaboNMxpoe3yu1gMNd2KsmT2mh1rsPRmrpxGHfuYgsjHO5elMWrZEx8i+vfsq2w7z+WjvmF7Z7uqm8TIvvLSalEum1l0DfuoxEULtCQfp+I3H9HVPxKnXwaWXXkTKDWip9XNap5E6Ey2dbbExgW2kAQBsFLuRa6QxVC3NCb09rZnU8TipbFZr8WFu1TyOf2tyQ+gasXgDhZYZt4L0ceWwWA0HxdMYpQypc/FxXaq9G8wfSCEr9kyGxsT09enj4Dib37VVf2jFfDSKI/RzBZBV/JFUitS9vVXHg4T9tK2zZlKLexvFrxSyw6QuaKMl0QvM64V5m7g4bCBf/dlnPrY89ExR/H9k5M1T5LbsNv1c8WG0TH0D/ac42Kjv77JiZkEO80Gpb6ps53z0y8PuRb46bOmJDHpWqyT1a/J59HPlUdxhOEqfacVhPX4KzGfEDtLnjZXRz267rpHUGT7kC6NovGCUWfNYKAalbNC4kolgQmc+mpp+d4H6+vrI7/v6+ip1HL/fD7FYjPwIgiAIgnDmMqEvHx0dHdDU1ASrV+v/CtPpNLz11lvQ2dk5kacSBEEQBGGKMm7ZZWRkBPbs2VMpd3V1wZYtW6C2thba29vh7rvvhr/7u7+D2bNnV1JtW1pa4KabbpqQBv/0NztI+fxz9fTUZy6oJ3U1FpNd0NSeyabHTDRt7rLULj6F3IWsrQdzdOpKhfQ0thVhlsG1ejozyNIhi2zVyyLKEY3V0Cm4WESX+1ksTfoYtVePounDAJsaP3BMpwX7YnRKsr9nPylHevWUblOMHieIUiB52uLJ8vx//YqUvRJb7RT01HjEoWmDUTR7NmM2tQRvYBbHdc1aiqqtp1OUgbCWSFLbaX+8t72blHNI4mPZtGRqPBamssusdj3127noMtq2MB0/YQutIsumSIvIk7vsUpkli1axBQAoIRvuILNxTiT02OrrpTOYAwN0bAXDehwkm2jfhUL0vhgLP7Lkj3jMth4JbOYQlVL8bBXXAF4hgaVmm3m0Oq7J2ubScxbTemxFw3RfvHpx10F67+3t1uVde6gsd2wgRcojeX2ObOl9UmejsV1kss+F551Lyjd8/trK9jQ2rV8I6P7JZ2jfFTO07TGlZV4jR+WbqsDGs4uurcdXykbPYy7X+Ay2QvEe7TGV3/QGqSsvRPcJGxOKLXfhIPkmD1RCi6BlKiw/PY4XxqucU3nEZc+0KFpF2neILpEAI9oywZekzwXopvvaSA7MH3mX1FlIwvfOpdbrebaKtom+g5zyOJZLOEHG/fKxceNG+MxnPlMpfxivsXTpUnjqqafg61//OmQyGfjqV78KqVQKrrzySnjppZcmxONDEARBEISpz7hfPq666ipQYzgIGYYB3/rWt+Bb3/rWJ2qYIAiCIAhnJrK2iyAIgiAIVWXSU23HS8mhdrGDWa0JZ4tU2ok5bOlsnJbFdETL0hpfvkhjGo5QCR0GhrWOF0pQnbWmQccQZDyaslYP+rhWgJ6j6KNtzWe07pofoceZjrTdLEsJ6y9SrdtAKX1Dg8w2GemqOaQpAgBYLI6iL63ThnuGaHzK9Hqky0+QC++GzVtJOeijemShoPvEcZj9/eULK9v7D9HYjKM99DzzkLW1w9JgswV9TXwBquVedhlNg83n9CBx2HLqs2dqe/wL5tKlu1vqE5XtWIiOCS9Px0R3r7bo7j9G07h7BnRdZoTq+ymWylksoWXq2fhx/LoP3DK9R0olmtYYSmjteR5Qi/A4SxseCxe159AhuszAMb+Oxcqw+6CxjqYJR1A8jWVT7b+I2m6zlGrTpmMrg+JD8myZcVC6vw4cHiBVXQd1TEymSI8ZiLOUx7C+UWgUEkAYjeee/dTm+/BhGofzxhu/rWzPnU3TcBsSOvYpN5IidZk0jRMooXE5MkTHVjXwWTSV00SxPjjtFgDAQzbgNvv/OXKMjv3yQZ0iH/PRe3j4sI57KQbipE4BfRYYvXo5jHALS4ON6fYooM/G4Ah6LqRoLE0eaMxHeUA/nBx275fTOvbHP0gzQks5lioe1OMg1UWff05Qj7Zo83RSZ7HICGXqe6gA41gv4QSRmQ9BEARBEKqKvHwIgiAIglBV5OVDEARBEISqMuViPiJxGvOxqHNxZTtkUS+GYoZqbCZa2tzwUd3XVdq6OtpI7d23vLublCMJ7ScybTrVuhXKF/exOA6voHXWYpHqmLhtAAAW8s54/513SF0M6eChMNUfw8yK/TDyaijzOBekgdayJcBTx6geeWxQl7t6qPdAS1K719oszuZkOdJNr2VtbQ0pt7ZqDf38i2aTOp9fa6Dvb1lP6pIs5TuCfAH6B2hASDimdeC6GP27G679NCmbyAwmHqf6cX2djtEZHKRae9d+PbaGUjSmIT1Ex+9wWscipJhvwyDShMvMP8Dno2PLQeOHLyUQj+m+SzAvmppGGsfhD+kx4wTp+BnJUe17LLoOHqxs7+ulNvY45IKtYA81cbYkQUDHWfhZqIYPma/YzIvBtFmsD9LbbXYOZem/7R2kcVIlZJcdiiZoA4DGy2C7dZOZXOTz+trGovT8l8+/kJQzQzrOJM+8gg4c0LEbH3zwAanLsXie/Ud1rFguS8dWNfA79BooHAPisaA75AVjMl+YER8dJCMLLq5sx+z5pC47rO+vEvOEMvzsq7GonxM+FhuWcfV4MQ3anpKr2+MzqQFQjsWq4docX8pgRLeVL9GQZ8fxR/R3QG2UPjdd9D0zEmSW6cw2PljSxy0bE+/zITMfgiAIgiBUFXn5EARBEAShqkw52WXuBReTcnvHrMp2fYlOG6W69pFyCaXaumU6Tbzo0zfpY85cQOo6LqTH2bRZyyA1Ebpg3uF+nX5nMztdP57+ZplLI2waPYWm52sjdHoM/6nLpJT6BipLFVCK4cAxKpcYaMo9GqHyjW2xVTlR+uEH3QdJXUONlrBmt554iuVYHNpFLafTbAXR6//gzyvb1157Nan79Rptzd6YoO1pDLEVcNGKpgGDSmFJNOUeZdPvAWZLXkZXBaerAgCUUapg706aSnqgX8tiRTZ+7QBtazSqU0sbA3T8lorHt7X3OUzSQ9fdYrJLNKr7KxajfWex1TRHMnpM9PXRtNN8nqV1j8GePp3yGK+hqet4Or6Yp/fIkRG28jKaGo6yvisjS3mDTc1bLMfQsPXf+jO074olLY0NDlK7eXxn8lnqIrO8H85omaOYo3VtDfo619XQ5wtfZXfwmE6xrkvQz7HgYi0JH+yh424oRyWAHQf188Zk8kA1CIepDF5GElrJpfYBgKTSskfvWYOlUQeTWgJNZ+iYPDKkZTODLbdRzNL7yUEyeDFFj1NWug1+dq+l0fM5wFLwwaRlD1kfFLJcatLtG8oxCY/tGkIr+0ZbaQiBhbvLZFITn4swcZ2k2gqCIAiCMMWRlw9BEARBEKqKvHwIgiAIglBVplzMxyXzF5JyOK61b2uY6prcHtpGVtJ7u2ka45U12gIbQnQZ9miYanwBW8cfBJkNecBBaXxsye9pLc2V7W0s9c1hqWZplAbW0UaX0T53jl4KeXCQWiFHYglSPoxsgQ2m5SZqtLY8lKbH4bEAwZA+bm6Y9sfuA7qtQWdi3mfzLN3vwotpiuFnr/5sZbuOWdxfsVinwZpM14wyi+UYinWx2DXANtyKHccDmlI8dExr5jGbLauNkuhmnjeP1DW26ms7eIym2kZZqmvJRTEFivYzTuPzmA7OUzBHMlrrVmyMjmR1XXcPTT3O5+h1L2X1cfnS5iG2FP1YBBN6HLa2nUPPgWJZjvTSZeAHjtK05WRSp1/76+k9nEnpfT22BkC8JknKfr9OT8yzUJpsWV+jQJjGAbkl3XcWW9rdsWh/+Bx9vUoBel8uukzHapw7vYXU5Yv0vuj6QI/ZD3ZuI3WdC/U909ZGj3PgXZrKjseW59KYgmpgszicYFQ/V/GYBACwUc61y+5Lm8VtmUrfp/yeNSxkuc+ejTzqpVTUYz/IUtdtFLuBU7oB6H3pllmsRp4Ga5RBt90XpEFDnqvLDusrn8fKZX3OoqLHMdA5Ai6L4+DXHf2pB5JqKwiCIAjCFEdePgRBEARBqCpTTnYpFJh7I5I9QmHueEjTrvxomi1i0ymvp/71icr29V9YTs+RodO9jl+/s5kmnarqmDmtst0/SN0a82i10abGelI3mKZT2oWiniKcOWsWqTtnlp6qH9r8NqnLDNMpSpxeVmarQ+aQC2UiQV05XUVlqXiNnmosF+lntkzdlwcP98NEMHPOJaT8xdv/b1LOuro9O/fQlT49Q9cFWIpuiU1DDqbQ9LhHr4GLUvwMdqd4wFIn07q/rD46Rg/36z7h49fL674MszTgvbtpSnPXgQOoPXTqt7ZeS0/FAm3b0BBNzzw6oNNiFZNLTCRJGEyeCAfp/ZRA6awBtupvboSlR46BW9LnyTBXYuxmmWer6sYbaBrqNJR2H41TZ8dYvZZkjjKp0vXoxS2hLsnlqMyRRRJAscQ/o762DlstOOCn19aH5IDGGH1uNdTocoBNsTcwiSiGUjuPovEBALD/g32V7aZa+rwZ6ltH21OrU/SLVvW/FhyHyhVOQLfBU3RsBX1aaiobdEwMp6m04qIU2kCcroKcDKNUcsVSdoGnoepxaLH/2S3kbuzYJ953ij2PseziMsdVhdpnsrY6XCRC7Smw7ydUBTaTZ12gzwID5Ysb3sSPCZn5EARBEAShqsjLhyAIgiAIVUVePgRBEARBqCpTLuYjn6U6qw+lTg4fpZoVWDQN1gepynZzgupku7fr1UUPH9xDj5OlsRv7D+6rbF/atIjUTZuudeiWfqrPZvbo9LZaf4LURRNUk/3ggy7d1pZppC6V1ul+JaYb9h2h6YceinEwmJabRTEfhsn0PqCEsf26R1NbHQNZRQ/Q+JiT5X/e9n+Rck0TTZ18Z6uOhygya/Ei0jJdpocqlpZmoU/KdV4X9a1ideao13ZdXyrTazJwFK0sXKbjF4dVJFiadJH5Jg8eRfEHzA56YEBfywKLRSizFWZdFE9ksdiEEF4ZlqVbW2VmQU3yUOn4CYZp2vJYYFvnwaMpUpdOo/RVliZtebQ9+w/pfo6laR/E4wn9d8xOvZBnKZgojsDPLbHD+pkSVHx1XHTXKB4vw55FSvddax2NBwmh+IdMOkXqyizt1EDDsqODxoZt37G3sn3uueeROp5WefiwtikI1NDYiGpgs+ePZehrErBofFOqX9vaD47QdPAjPTROqiaqn1Xzzqfp+j4UE1hg93eJ9Y+JbNJ5zIeJll422YMBx00oxZ4vo9KCcW4rtzPH52Cr0TIvfxwfYrPjmIYeW/w4Pp4Ojg878e7qMvMhCIIgCEJ1kZcPQRAEQRCqirx8CIIgCIJQVaZczEdzPY03CCF/gTXvUsvyGqa9z65F/g9+Zn9sa138SP8+UucVqC9A+znait1i/gahmPYXqE/SOIWjg1qvHUpzTwlShMZG7UtgM607j3w2isz7IMcte9GBy+wk+YLWVctl+h5ah3wRAAAM5J3hGDSGwI80cldRbftk2bxlIym/+94W2h7Qeq3FNGHcX5bNYw/48vJaA7WZNXwgoP/WxyyVHT/T+5EVu6XovjFHjwnTz3xHLH1N8kxnZqsDgBPSfVtiS25nMzoOqFimdUaJeYQjXbrILJZd5AuTGabHCbH4kIa4/ix2iPYzXln84xw/8DVyXXoNbLSUgccs5R1/lJTr6/XyBZEI9SQJBPU54n5mo+9zSFlhnZ71T7ms+zLOPGSwlb/n0jgSW9GyV9DPgrifafbo+rkuvQZFFneTQ/EqoSj16tnfq+O/tn3wK1JXKNCrUkJ+M8ri5uKnHoPFLdioDR6LoxhGS08cOUJjzFLH6BIbu95dX9ne8c5aUjdrll6mYsasuaSupp7G6wGK63A9ZkOOxiWPlbOIbTv7jMyKHfcBXyLBI89uehyLHQePWB5nwsukjvuOoH1PQciHzHwIgiAIglBdxvXysXLlSli4cCFEo1FobGyEm266CXbu3En2yefzsGzZMqirq4NIJAK33HIL9PX1HeeIgiAIgiCcbYxLdnnttddg2bJlsHDhQiiXy/CNb3wD/uAP/gC2bdsG4fDv0sXuueceePHFF+HZZ5+FeDwOy5cvh5tvvhl++9vfTkiDE1E6nWqgKbC0oilrA8fo9FR9VH/csEOnxl1TT6fuO7yP1CVr6HTmdDRdx1e9XL9pe2X7UA+Va6IRPf3u89Gp3/f3UGtk/F7osXfEApJdRjJ0+jRRS9Pkyih9q6ePWp+H0TStzex8QyEqnzh4td4STed1M/pzJhvpVPjJ8sZrr5BylqUcOj6U8hji59TX2VJ0iCueJufDsgsdLwG/HmvcPtwJ0P6xw1oODDh0vPhRSpvNXveNAEr1NVi6X4FO1edRymypxKbxcdoeO47NJ03xVLCf3geJsC7Hw7TvIkEqT/h9aBVOg94IBpMLxqJl2nR9HJPeF42NejVWbinvsOUTHCSnBAK07RbqeMWm+A2LTZajemydDQCQRSsCc5trnJbLV0HODtF75tA+ndo/6KPnTwT1cZJ1CVIXYOMOS7CKraZsh7RN+5GD1C6grbmBlKNF/VnSheqvasvBUgKWPwEA5pw3p7I9ay61IcgOUxnm/bf18hObN1JL+Tde19YH27dtJXXnzr2ElGefp2WZRE2C1GErfWuUZIWvrTdGHQBJ12erTXtl9kWD61x6HBc9871RNvEnjoFlF2PipbhxvXy89NJLpPzUU09BY2MjbNq0CT796U/D0NAQPPHEE/D000/DZz/7uyXPn3zySZg7dy6sW7cOLr/88olruSAIgiAIU5JPFPPx4YJVtf/nv+1NmzZBqVSCJUuWVPaZM2cOtLe3w9q1az/yGIVCAdLpNPkRBEEQBOHM5aRfPjzPg7vvvhuuuOIKmDdvHgAA9Pb2guM4kEgkyL7JZBJ6ez/a+XLlypUQj8crP21tbSfbJEEQBEEQpgAnnWq7bNky2Lp1K7z55pufqAH3338/rFixolJOp9NjvoDY7H3JQ6mlza0dpG4ji91IGVrnVBZdKjterzW2eIzZzgZoTMEMFPMRidPU3yd/8P9VtrMs7TWd07bAWbZUN3dxbkJL2OcH95O6jB+3lca57Ni5m5T7+o7o8w9Ta+ZEQp80FqZpg5aiGqOvqNtrZWk6W0MYpR8GxqMqHp9kA11mvCd3hJRdN1XZjrE4FxulBacHaNzNcJr2ewmlRHosRRU8rtEiuDVxUKcmKx9te9nQ/WyyoI+QozV8bsHtsjRqYrnsZzbOKF4lwFJigyxepTaqx0xbhI7t1mZt88+yZ6GQp8vdm0rHoNgsbiIR0/EYWRruMIpprTrmw2P5xbaj40yCrK1chzbR8gGeYnX4ucH+5VK8jLR5bodfdnUqcvroAG0r2vaxmI+RITp+ew7rGIxkLR0vibC+BtkiS7lk46eMzsrTgqe16ufoebNnkrpLzqflXXu7K9ub39sO1YanlpooLkmZvA7F5LA0+0Qd/e648ip9X86aRb8f3nztN5Xtri76TMtsZs9uFHN24UUXkzr8fWWzJSzcsn5Wuzx9lqXskiUcWEosjgczeIgSt3TH8YI83AvtO8runT/vSKrtxCfGntTLx/Lly+GFF16A119/HVpbtZdFU1MTFItFSKVSZPajr68PmpqaPuJIAH6/H/zMM0EQBEEQhDOXcb3OKKVg+fLl8Nxzz8GaNWugo4O+Sc6fPx98Ph+sXr268rudO3fCgQMHoLOzc2JaLAiCIAjClGZcMx/Lli2Dp59+Gn7+859DNBqtxHHE43EIBoMQj8fhjjvugBUrVkBtbS3EYjH42te+Bp2dnROW6VJ2aZP9KL3s3I52UrdxE52mTfv0qo+eQaeQk9P09N227TQ49lO/92VSXvvfOmUrk6EBsqWinort7+0Gin7XGykxJ0egMkeNqSWaaUF6jqEjWlopWzWkLtlIyy5yzcyx1U3zOeRmyVxUyx6VaEp5vVpko49ORbdEtFxQKH+cn+WJoUrUATYepmmew3mUdurSts6ZO08fp4XKYv1H6FR5P5o6H0nR9LZsVrfBZe6jyqV9GbZ1eu2ci+nqooeHkCNjmspAuaJuey5PP7PFEuP86BqFfTxFVsscDSwVsLmFzjrOmqbdGxv9VJ4YQeN5cJBKBRZzgA2F9ViLsBT4ujpdd7iLyoacfrQSc3ooReo8tArxLLYya6KWrgRtobRpg61mXEbujXy14GyRSnH5gr4O5SK99wxX36eqQI+D0/cTCSoFBh2a2mqjafREhMpt8aguF9k5smxV5mJBt8c06BitiWs5J8RkuoPd9JrgTPsLzpsN1cYwmUxGpEraBz7UWJdJbwZLZzWRe+3scy8idR5yde7p+d+k7tgATU3eXRiqbPcdot5W58zWqb9zL6DnaExq112bpUKXS/SZVipjp2j6LMISo2F+jLSNUsCNMZJrFa8bdQ3wISfe43RcLx+PP/44AABcddVV5PdPPvkkfOlLXwIAgEcffRRM04RbbrkFCoUCXHPNNfDd7353QhorCIIgCMLUZ1wvH2P5wn9IIBCAVatWwapVq066UYIgCIIgnLnI2i6CIAiCIFSVKbeqbdmiOlne1OVAhKWsJajN9YFu7TVy5cIL6HFGtE4WilIb8p5DB0l5z65duj1s9Uosm2XSQ6QuWqf1v6EhFtMQoXmN5517YWV7wzs7SN3b27sq21d+5nOkzudQ/XjvHh0fkmIr6WLb9nyOxk1MT9J4mWBYH7eWpQYqW2uV5eLEaINHD9M+d0s0xiKH0tKy3dSavhal3zUEaCqyr0D7IIjS+HLMYl4prKGzZYeZbXE2p2NHPs3G1gVz9bU8cIBq7UdTOgakwOzUeZ6cjQZXkKVy1qN02kSYfmaXtb13QPfXzoEeUmcE9P0Ua6TxMsEYHRMhlLJby1abjsTpvTcWO3ftqWwnamjMUnOzjk8pMovpUpGOCQ/p5OksjePIofgml6VUW6wvHZ++L/gyDAEUWxNk+fH5rL6HPBZ7EI6wVHaUL+kwS27L0uf3sfPnyzSuw7BwnAs9J7bgP3iUxhplM/TZhOMRmprpatzVwGT5oxaxuGfXB+3qsTgFfs/gFNFikY6f1rYZle0ZM2aQug199L4ooxTwI/0pUncExYds3/4uqevo0PFf55xDY2mSSWoNH8WrEhvsuhdRyi57xvoctiozUii4vToWL5QxhpXA7/bQzVETY6GAkZkPQRAEQRCqirx8CIIgCIJQVeTlQxAEQRCEqjLlYj6sANXCsshSGGulAADtbVS73PW+jn8YylK9KxLWHiFt59Bz7t9FdfpDyBq5s3MRbQ/SfaMtVNOrbdGmbAcGaRxHrkDb44S1T0CsgVoGXxrVn+vIEepdvW//FlLOZLXumxqicR2NDdp7IK5oXvv0CNXwG2NaW/UZVE8vlrS3R5h7/54kTc3UJ+HgARYDgpf9Zv4GXbt0Hv4Qi4Hhb9sZT+vAGRZT4BFvD6qdco26WNBeHm+/+StSdxWyrp/HrJBzcR1H4ZVpbIbB9P08inEYYkvWY7+S/Tv6SN1AjnpV5NES7sFG2s81TYnKtj9G+84KUm05hHwk/CEaZ2JYJ/5omXO+jomprW8kdaGQjrHIsyUJjh0bJOVSSfdJVtH4mRDyio/HqN9CmDksB1Gchc2us4t8Pspleo5SSV+/vMliM5inArYPd5ktegkVbRbjpjzm1VPQ5aPMw2YAjYnhYeprdCyVIuUwun7+KL33q4HF4g9Imd0HYKD7VPEYjzGWrWf7BgJ6TESjNI5tlJcGGgc869NAsWHDx2i84OYBHWf4/jsbSF1tHY1vamrSz/mm5hmsrToepA7FDgIANCSpj4+BljrwmF9I2dPlsqJ9NcpeHXWB4U38PIXMfAiCIAiCUFXk5UMQBEEQhKoy5WQX26DTjoanP4LBUrLqa+n04S5zb2W7f5BO4R619JRTPEKnsebMo2mDe/fpVMUSy8DE6ayzZ9PUqtkdWs/Z30NT3d5//z3angE95e34aZpeDVrd8+D7VL7pGWB20CgV2WKr8za36ZUtp7NZxnZmlx1A08iFPF+dUU9Tl/gU6UnSfi61yk8zG/vMQTzFTBufd/VFGSwzOcugQ76ojm9pzKUWjDGG4d7ud9eTcvewnp5vMKmUgadwXSbJjLDVPHuVlrf2sJThgyh9NBuinzHa3kLKyQ69imwgQaebwUR/y2TMCEsXDaHUW5PZ8yvjxP+vsQO6T4ZHqDQ4MqKvu99PJVecSgoA4CHZrCVJ7cz9KIWYp9YqtrpoJq/7OZ+mckUKST1Hmf18DslCc+dSK3gfWmgTgI5Yi03x43TaQoae/yBbsuHIgG5DsUj7I5vR7RlK0eeNw2Qx3O+r16yBamMoLrvobZ4SaqD7dNR9OGrJV13mKam5Ed23vb00tfbwYVoeCum/9bHU6FhES1bhALVMCNn671yXPl8O9VApefc+/f2Uy60mdWVXn7O+gd7PF154PinPnqXlm4YGKmPG4npJAn+QWSYAW8YayTBl/micAGTmQxAEQRCEqiIvH4IgCIIgVBV5+RAEQRAEoapMuZiPgMl03qLWZ22mtwVYORrVmnUkRvWuOXO0RvvrX/2C1GWHekk5VKctn/ccpKlVba06VqHjvMtInd/R3T2zncY0pAap/fG27Tot2FNUkz54TPdBOkfFuLxLtfd0SscGNDbRlN39R3VdbVuC1B1l6YfgoZRdFtehbB0fUvBoCujJEquhKaANSapd9qCYD57cixXiAovjKDGJGFuPu2PEeHBG7YkaUcrlSFUG6fKmP0HqLJQqeZjZoG8B2pd7bP3JMhEa/xBu02l7DSzFu64hScp+ZJVfHGW/rM/ht5ntNy8j7duy6aPEZLr4WOB+51baNoo74dmPgQDT8DN6jOaGaKxEDhVth/7PZfpoWaEU653bt5G6/fv2Vbb50goKjbWWZho3Vsvs5nPZ7EduAwCkjqUq20eP0VT6XJGOLRe1NcuPk9bxMia7ziF2vXqQfUBvL33eVQWWLu8hm3RVZkvRozHKM0CNUanJel+LpeG+8/amyvbIMRq/UxelsVndPbo+FqffHQ56/nllen1iEWQT76P3hGPTc/j8OnbEMllMIhoT+7reJ3WpYzQO6O2N+tngOPQ7sA3F+bU00++g5hb6/dCS1PXhCE0Lnghk5kMQBEEQhKoiLx+CIAiCIFSVKSe7eGySnbhAshUN08zVL5XSU/V1tZeQus9d+5nK9iUXzyF1P/nZc/Schp4+i8fpdNS0Fu0+GoklSJ1V1lNptU2065s7qLvmUFBPl729ZQup6xlBbns+Op0bb6bpxfWzdL1l0yk4F61UuFNRh8o9vVQCcFDuWy5P050z6BKUPT7d/jqcDEG2Gq0/QKdefWjq3C3R6VQ8CsoGF0iYi586zvbHMGo9SJTSN8LG4Y6ing6POzSFeUdeu5G+X2ZTrcxhtK5NO+Q2d1BpJYEcYf1hmhJrevSeKaFpa8um09QWSpm1WWoid33EqYMGS3E0x5FqixUak93fHnJk7OunEidfNbqA5C6XSYNYnpg5awapa2isp/uiqXqfTeWtBHZ1ZbIP/hzYeRQAYMfOnaQ8khk57r44Xd1jqaQZ9kzLos+cZSv5FtEqyX62Au+BPiozpJDjqeuN40aYIEpspWG8Aq1RZpIekmj4faiAXnecsjsyQvsun9PnPO/cuaTusksWkPKmd7dWttdtoKn0qRHd7y5zvW1s1mmxV155Jamz2TNt337tpL1u3VpSN+98vVJ2jEl4fUwm6+vTzxSejt6U1O6oHR0zSJ3r0t7MDOv7S43n4XiCyMyHIAiCIAhVRV4+BEEQBEGoKvLyIQiCIAhCVZlyMR+uL0HKZhHpUizeAK8cCQDQ0qzTNf/Hp2gabMCnteWO6VRP//z//CIp//S5FyvbA71Ud+4Z0rpZPr+H1DlIjxzMUW1yz36W3oY0T9VAY1BqkjoWwGNanGFQjdpD1tWeQTXqElpNc8ilfxfw0X0DthZPMwZN6Sv59N8qj8aunCwll1le56heG03o+JV8hurFWLN3WeyBy6VL9AtjHBbCStHYBIXsqjNsRdM30Bjdn6V1R0O6fXaSpro1t1KL8A60CnFdnMb2mCjOI8PGRJ6nr6KU2QDTnQNodVObpekFgjQGxY9S2X0+On7GQ24kVdk2me23iyzTd+/eReqGh1Kk7KC4BsdP226jgAy+erDJLPjxmKirpSnfOOwlm6NW8DlU7u6m1tmjFklFw1IxW/0sWr04xVafzQzQ540PfeZyid57ZRSTk2H26mW2QjC1/q5+zAdfKZbEGHAHddSZbAUA8FjKLg4hCobo+P0fV12NdqMHstk4PPcSvXr5vPkLSR126+cxS/V1+j6dOZMul26zmKEZsy+qbLe0U3v+YFDHisVZzAfvu8FBnZ7N4zgaG3QKeDRKjzMqXR7lMbsTZKFAjj/hRxQEQRAEQRgDefkQBEEQBKGqyMuHIAiCIAhVZcrFfBwYoppek6M16hDLZW9uohbHzfU6R/+cma2kDpTOh+45Qi2Nf/DMi6S8aYu2XC7kaR41sRdQ3LZZ7+v6qUWva1LN3Aat8ZUNGrtSNnVdgF9BFouQL+o2KCY828j3w/KYV0ae9nMZZdT7mKexhQTsYombnZ8cJZdqjJZDdc2aBn3dSxGqnZaR7wezAIES/5xI32cr2IOB9FvuY6H40t3ID8K2ma9GULevEKcxBOcktPV5TS0dE5EYvbiRkB4Hfnbh8yiOochs2hWLx7DwfTKOJci5vTqON7CYnfq4fAFcHatgWtz6XJ8jFqP+JQFmVx1BtvEWi2UJofgUHhuxe8cOUh4aHNTbbEl7F1mo+xx6fmwF7x/lkUL7I5vX/hz9g/R5k0W+HxaLW6uJJ0i5iDx3siwuqlzSbfVcHtB0/OtujMOjZaLIsSUJrLT+LLaifVBEz+oyG+tlFr+DY1k8fu+jS1JmMWYGi8MpIr+ZlvYOUgfIR8dgnjom+g7oOjBI6nJF2h58zmicngO3/Rj7DrRZrEY4NkMX2PfB4JDu58N9tD0e83fxm3oMs+E8IcjMhyAIgiAIVWVcLx+PP/44XHTRRRCLxSAWi0FnZyf88pe/rNTn83lYtmwZ1NXVQSQSgVtuuYW4rQmCIAiCIIxLdmltbYVHHnkEZs+eDUop+OEPfwg33ngjbN68GS644AK455574MUXX4Rnn30W4vE4LF++HG6++Wb47W9/O2EN/skaam173fzzK9vntNDUoa69u0n50wvnVbYDbCp6uKin9n7y0gZS9/a2w6ScxassMstyvEImn8bCtsBcAnE9On1YQNJGiU2ZGoaeNi4A/Rw87cq29XEsNqUdCqFpNTZ96fLsQ0MPFZ6+VS7pz+VEEzARWD7aP4k6OuUeCaM0sAL9zFh2Kbvcep1Ni5r6c/F0OxNNRfO0bdNmqXlIFgoxeSIa1RJRMpIgdRG/ltDCzHrd8dNrW0TFEbYyaw5NG/P04gCzCHdQGiGXVvBqtHzqmY8tbIHtOFTKcHzcZv/44NTXQoHJHCjVNshTAdk9nMvo9NHCIL1nD2R1GqzHrNcN9rlw2rDN7m9fQH8ukz09i0V93OFjVEbI50dYWaerc6EygPq9lKOybglov2K5gksXeKqeW+OX2XhWrj6n45sY6XQ8vP76q6Q8VH63sh1mq7+6Bd13XEYtsZWGXSTp8fFbQmOLP3952mm+gFa/Zvn6BpKFfDaV+2oT2ro/wu79kkvvL/x1wWVegzyLTFbHnltILrHZ8gl42QP+d4qnNKOuNZgPgXPymfW6bePZ+frrryflhx9+GB5//HFYt24dtLa2whNPPAFPP/00fPaznwUAgCeffBLmzp0L69atg8svv/yTt1YQBEEQhCnPScd8uK4LzzzzDGQyGejs7IRNmzZBqVSCJUuWVPaZM2cOtLe3w9q1a497nEKhAOl0mvwIgiAIgnDmMu6Xj/feew8ikQj4/X6488474bnnnoPzzz8fent7wXEcSCQSZP9kMgm9bNU9zMqVKyEej1d+2trajruvIAiCIAhTn3Gn2p533nmwZcsWGBoagp/+9KewdOlSeO211066Affffz+sWLGiUk6n02O+gPQco9be//2OTpNzS9PZ3lTvamjS6bWGRbW59Rv1kskvrqEzNQWPao6AdD2uv2HcAtUfFRL1PKYxcj0SL3fvY/qjgdMaLfoZbZbyaCF9PxqlcRMWarulqGbvsjRhD8eWsDiK5iYdaxON0bibt+HkePb7//sk/1I43XjooYfGrH9388bKtsuWVsdLgpdKNFZD8ZgqtH66z0fvLxr7xFJkWXwKDo8oufS+yGV0ewoFalE+jNIYFXP5Dsdo7Ai+9xTLBy+M6GdcmS3RPlSg/YPjPHjcAk4V9xRffJ5io7ggwyuPseepIeCjz9iShdKmPfr88yObAs+gdS6LATHRxeTp3x76nKPjH2hfeuj5aLAoHbzUgsFsEfAlMYFeS9ui/VxA15bHW+FTlsssdoXdFzi2j8eqjRU7wimO6Pgrxc7RPCPCdx834375cBwHZs2aBQAA8+fPhw0bNsC3v/1t+MIXvgDFYhFSqRSZ/ejr64Mm5reB8fv94Pf7j1svCIIgCMKZxSf2+fA8DwqFAsyfPx98Ph+sXr26Urdz5044cOAAdHZ2ftLTCIIgCIJwhjCumY/7778frrvuOmhvb4fh4WF4+umn4Te/+Q28/PLLEI/H4Y477oAVK1ZAbW0txGIx+NrXvgadnZ2S6SIIgiAIQoVxvXz09/fD7bffDj09PRCPx+Giiy6Cl19+GX7/938fAAAeffRRME0TbrnlFigUCnDNNdfAd7/73QltsMuWhe/q09kxhcx2Uvfpy84l5WCiubI9lKfa4Gtvad05xwRbnA8OAOBHy3Vzy95slsakYCykT3JXa+5G7UexGgY3FMDeFH6qleKllwGo9S7XBoeRL4LL9PMCsymO1+h89abmelIXQVbfuWHq0yAIH8f+3e9Vtm3mbWJYWE+nN43jYxbqTui4++L7tMx8PkZG6P1dLOh6j9lTmwa2LKcavuNHfi7TWtg56JL26WPHdHuKLDYMtY/HF2SL9PmCPwuPG8N/yo/jY74fFlo+IZut/j3ssVifkYzunxCLz8OXxGWT9yV2bYslHD+TJ3Vg4r6jYwDHGv2uffoZV2Y+Hy7yqeGxIx66JjzEQin6mQvIct91ecyJPg6PdVLArfNdVMc8SbCNPvsrj40fC/n48O+O5hk3wCdlXC8fTzzxxJj1gUAAVq1aBatWrfpEjRIEQRAE4cxF1nYRBEEQBKGqTLlVbT2LpqwVkd1w3widxnp7J7VY/lxWTysNKzq1eOiYLgciNI2onKXpSnmUEhUKMZkDrcKZZ2lxBkp7MllKFk+nVUhaUewd0Ydkn5ESnXIrlmn6H5Zh+LQsllYybHXeSIJKKzUNOmOpyNL/dqBVQX0enwIUhLExynpq3GUSo6mOL1UW2MrH5ZIe+1wu4dPYGL4qqM/R0/wWs6a30T3kMmky4NfH8QepVDB4lLY1g+RJH0uHJKtEs2dIWfHlAnR7uNSEUym5hXyALQEwkk5VtrMZKhFVg+7uraS8u0c/Y8JsCQAbyeLuKPGAXi+8Wq3nsSUA/OZx67h8QzKuWT/j1FbDYOnfWN7iq4pbdNxhabDAbBo89/hW+SZLNzYM3Qd8iQ+Fxs8YKh0AAJQA9XMts5uYAGTmQxAEQRCEqiIvH4IgCIIgVBV5+RAEQRAEoaoYalR+1uSSTqchHo/DfffdJ86ngiAIgjBFKBQK8Mgjj8DQ0BDEYrEx95WZD0EQBEEQqoq8fAiCIAiCUFXk5UMQBEEQhKoiLx+CIAiCIFQVefkQBEEQBKGqnHYOpx8m3xSYs58gCIIgCKcvH35vn0gS7WmXanvw4EFoa2ub7GYIgiAIgnASdHd3Q2tr65j7nHYvH57nweHDh0EpBe3t7dDd3f2x+cJnI+l0Gtra2qR/joP0z9hI/4yN9M/YSP8cn7O5b5RSMDw8DC0tLWRtoY/itJNdTNOE1tZWSKfTAAAQi8XOugs4HqR/xkb6Z2ykf8ZG+mdspH+Oz9naN/F4/IT2k4BTQRAEQRCqirx8CIIgCIJQVU7blw+/3w8PPfSQrO9yHKR/xkb6Z2ykf8ZG+mdspH+Oj/TNiXHaBZwKgiAIgnBmc9rOfAiCIAiCcGYiLx+CIAiCIFQVefkQBEEQBKGqyMuHIAiCIAhVRV4+BEEQBEGoKqfty8eqVatgxowZEAgEYPHixbB+/frJblLVWblyJSxcuBCi0Sg0NjbCTTfdBDt37iT75PN5WLZsGdTV1UEkEoFbbrkF+vr6JqnFk8sjjzwChmHA3XffXfnd2d4/hw4dgj/5kz+Buro6CAaDcOGFF8LGjRsr9UopePDBB6G5uRmCwSAsWbIEdu/ePYktrh6u68IDDzwAHR0dEAwG4ZxzzoG//du/JYtinU398/rrr8P1118PLS0tYBgGPP/886T+RPpicHAQbrvtNojFYpBIJOCOO+6AkZGRKn6KU8dY/VMqleDee++FCy+8EMLhMLS0tMDtt98Ohw8fJsc4k/tn3KjTkGeeeUY5jqN+8IMfqPfff1/92Z/9mUokEqqvr2+ym1ZVrrnmGvXkk0+qrVu3qi1btqjPfe5zqr29XY2MjFT2ufPOO1VbW5tavXq12rhxo7r88svVpz71qUls9eSwfv16NWPGDHXRRRepu+66q/L7s7l/BgcH1fTp09WXvvQl9dZbb6m9e/eql19+We3Zs6eyzyOPPKLi8bh6/vnn1TvvvKNuuOEG1dHRoXK53CS2vDo8/PDDqq6uTr3wwguqq6tLPfvssyoSiahvf/vblX3Opv75xS9+ob75zW+qn/3sZwoA1HPPPUfqT6Qvrr32WnXxxRerdevWqTfeeEPNmjVL3XrrrVX+JKeGsfonlUqpJUuWqB//+Mdqx44dau3atWrRokVq/vz55Bhncv+Ml9Py5WPRokVq2bJllbLruqqlpUWtXLlyEls1+fT39ysAUK+99ppS6ncD3ufzqWeffbayz/bt2xUAqLVr105WM6vO8PCwmj17tnrllVfU7/3e71VePs72/rn33nvVlVdeedx6z/NUU1OT+sd//MfK71KplPL7/eo//uM/qtHESeXzn/+8+spXvkJ+d/PNN6vbbrtNKXV29w//cj2Rvti2bZsCALVhw4bKPr/85S+VYRjq0KFDVWt7NfiolzPO+vXrFQCo/fv3K6XOrv45EU472aVYLMKmTZtgyZIlld+ZpglLliyBtWvXTmLLJp+hoSEAAKitrQUAgE2bNkGpVCJ9NWfOHGhvbz+r+mrZsmXw+c9/nvQDgPTPf/7nf8KCBQvgj/7oj6CxsREuvfRS+P73v1+p7+rqgt7eXtI/8XgcFi9efFb0z6c+9SlYvXo17Nq1CwAA3nnnHXjzzTfhuuuuAwDpH8yJ9MXatWshkUjAggULKvssWbIETNOEt956q+ptnmyGhobAMAxIJBIAIP3DOe1WtR0YGADXdSGZTJLfJ5NJ2LFjxyS1avLxPA/uvvtuuOKKK2DevHkAANDb2wuO41QG94ckk0no7e2dhFZWn2eeeQbefvtt2LBhw6i6s71/9u7dC48//jisWLECvvGNb8CGDRvgL//yL8FxHFi6dGmlDz7qXjsb+ue+++6DdDoNc+bMAcuywHVdePjhh+G2224DADjr+wdzIn3R29sLjY2NpN62baitrT3r+iufz8O9994Lt956a2VlW+kfymn38iF8NMuWLYOtW7fCm2++OdlNOW3o7u6Gu+66C1555RUIBAKT3ZzTDs/zYMGCBfD3f//3AABw6aWXwtatW+F73/seLF26dJJbN/n85Cc/gR/96Efw9NNPwwUXXABbtmyBu+++G1paWqR/hJOmVCrBH//xH4NSCh5//PHJbs5py2knu9TX14NlWaMyEvr6+qCpqWmSWjW5LF++HF544QV49dVXobW1tfL7pqYmKBaLkEqlyP5nS19t2rQJ+vv74bLLLgPbtsG2bXjttdfgO9/5Dti2Dclk8qzun+bmZjj//PPJ7+bOnQsHDhwAAKj0wdl6r/3VX/0V3HffffDFL34RLrzwQvjTP/1TuOeee2DlypUAIP2DOZG+aGpqgv7+flJfLpdhcHDwrOmvD1889u/fD6+88kpl1gNA+odz2r18OI4D8+fPh9WrV1d+53kerF69Gjo7OyexZdVHKQXLly+H5557DtasWQMdHR2kfv78+eDz+Uhf7dy5Ew4cOHBW9NXVV18N7733HmzZsqXys2DBArjtttsq22dz/1xxxRWjUrN37doF06dPBwCAjo4OaGpqIv2TTqfhrbfeOiv6J5vNgmnSR6BlWeB5HgBI/2BOpC86OzshlUrBpk2bKvusWbMGPM+DxYsXV73N1ebDF4/du3fDr3/9a6irqyP1Z3v/jGKyI14/imeeeUb5/X711FNPqW3btqmvfvWrKpFIqN7e3sluWlX58z//cxWPx9VvfvMb1dPTU/nJZrOVfe68807V3t6u1qxZozZu3Kg6OztVZ2fnJLZ6csHZLkqd3f2zfv16Zdu2evjhh9Xu3bvVj370IxUKhdS///u/V/Z55JFHVCKRUD//+c/Vu+++q2688cYzNpWUs3TpUjVt2rRKqu3PfvYzVV9fr77+9a9X9jmb+md4eFht3rxZbd68WQGA+qd/+ie1efPmSrbGifTFtddeqy699FL11ltvqTfffFPNnj37jEklHat/isWiuuGGG1Rra6vasmULeV4XCoXKMc7k/hkvp+XLh1JK/fM//7Nqb29XjuOoRYsWqXXr1k12k6oOAHzkz5NPPlnZJ5fLqb/4i79QNTU1KhQKqT/8wz9UPT09k9foSYa/fJzt/fNf//Vfat68ecrv96s5c+aof/3XfyX1nuepBx54QCWTSeX3+9XVV1+tdu7cOUmtrS7pdFrdddddqr29XQUCATVz5kz1zW9+k3xZnE398+qrr37k82bp0qVKqRPri6NHj6pbb71VRSIRFYvF1Je//GU1PDw8CZ9m4hmrf7q6uo77vH711VcrxziT+2e8GEohOz9BEARBEIRTzGkX8yEIgiAIwpmNvHwIgiAIglBV5OVDEARBEISqIi8fgiAIgiBUFXn5EARBEAShqsjLhyAIgiAIVUVePgRBEARBqCry8iEIgiAIQlWRlw9BEARBEKqKvHwIgiAIglBV5OVDEARBEISq8v8DZUufM4OjZpYAAAAASUVORK5CYII=\n"
          },
          "metadata": {}
        }
      ],
      "source": [
        "# Test the trained model with sample\n",
        "dataiter_test = iter(testloader)\n",
        "img_test, labels_test = next(dataiter_test)\n",
        "\n",
        "imshow(torchvision.utils.make_grid(img_test))\n",
        "print('GroundTruth: ', ' '.join('%5s' % classes[labels_test[j]] for j in range(4)))\n",
        "\n",
        "img_test = img_test.to(device)\n",
        "labels_test = labels_test.to(device)\n",
        "\n",
        "# Prediction\n",
        "outputs_test, aux_outputs = model(img_test)\n",
        "_, predicted = torch.max(outputs_test.data, 1)\n",
        "print('Predicted: ', ' '.join('%5s' % classes[predicted[j]] for j in range(4)))"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": 24,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "DNrXRT1NrJft",
        "outputId": "2bfcbe19-0fce-4eaf-ed37-ea00f8ed308a"
      },
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "\u001b[1;30;43m스트리밍 출력 내용이 길어서 마지막 5000줄이 삭제되었습니다.\u001b[0m\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "torch.Size([4, 3, 32, 32])\n",
            "torch.Size([4, 10])\n",
            "Accuracy of the network on the 10,000 test images: 10 %\n"
          ]
        }
      ],
      "source": [
        "''# Test the trained model with overall test dataset\n",
        "\n",
        "correct = 0\n",
        "total = 0\n",
        "for data in testloader:\n",
        "    # Load the data\n",
        "    inputs_test, labels_test = data\n",
        "    inputs_test = inputs_test.to(device)\n",
        "    labels_test = labels_test.to(device)\n",
        "\n",
        "    # Estimate the output using the trained network\n",
        "    outputs_test, aux_outputs = model(img_test)\n",
        "    _, predicted = torch.max(outputs_test.data, 1)\n",
        "    \n",
        "    # Calculate the accuracy\n",
        "    total += labels_test.size(0)\n",
        "    correct += (predicted == labels_test).sum()\n",
        "\n",
        "# Final accuracy\n",
        "print('Accuracy of the network on the 10,000 test images: %d %%' % (100 * correct / total))\n",
        "\n",
        "\n",
        "## [SimpleNet / Training 5 epochs] Accuracy of the network on the 10,000 test images: 9 %\n",
        "## [VGG11 / Training 5 epochs] Accuracy of the network on the 10,000 test images: 11 %"
      ]
    }
  ],
  "metadata": {
    "colab": {
      "provenance": [],
      "gpuType": "T4",
      "include_colab_link": true
    },
    "gpuClass": "standard",
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    },
    "language_info": {
      "name": "python"
    },
    "accelerator": "GPU"
  },
  "nbformat": 4,
  "nbformat_minor": 0
}