dlnd_language_translation.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true,
    "deletable": true,
    "editable": true
   },
   "source": [
    "# Language Translation\n",
    "In this project, you’re going to take a peek into the realm of neural network machine translation.  You’ll be training a sequence to sequence model on a dataset of English and French sentences that can translate new sentences from English to French.\n",
    "## Get the Data\n",
    "Since translating the whole language of English to French will take lots of time to train, we have provided you with a small portion of the English corpus."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "import helper\n",
    "import problem_unittests as tests\n",
    "\n",
    "source_path = 'data/small_vocab_en'\n",
    "target_path = 'data/small_vocab_fr'\n",
    "source_text = helper.load_data(source_path)\n",
    "target_text = helper.load_data(target_path)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "## Explore the Data\n",
    "Play around with view_sentence_range to view different parts of the data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Dataset Stats\n",
      "Roughly the number of unique words: 227\n",
      "Number of sentences: 137861\n",
      "Average number of words in a sentence: 13.225277634719028\n",
      "\n",
      "English sentences 0 to 10:\n",
      "new jersey is sometimes quiet during autumn , and it is snowy in april .\n",
      "the united states is usually chilly during july , and it is usually freezing in november .\n",
      "california is usually quiet during march , and it is usually hot in june .\n",
      "the united states is sometimes mild during june , and it is cold in september .\n",
      "your least liked fruit is the grape , but my least liked is the apple .\n",
      "his favorite fruit is the orange , but my favorite is the grape .\n",
      "paris is relaxing during december , but it is usually chilly in july .\n",
      "new jersey is busy during spring , and it is never hot in march .\n",
      "our least liked fruit is the lemon , but my least liked is the grape .\n",
      "the united states is sometimes busy during january , and it is sometimes warm in november .\n",
      "\n",
      "French sentences 0 to 10:\n",
      "new jersey est parfois calme pendant l' automne , et il est neigeux en avril .\n",
      "les états-unis est généralement froid en juillet , et il gèle habituellement en novembre .\n",
      "california est généralement calme en mars , et il est généralement chaud en juin .\n",
      "les états-unis est parfois légère en juin , et il fait froid en septembre .\n",
      "votre moins aimé fruit est le raisin , mais mon moins aimé est la pomme .\n",
      "son fruit préféré est l'orange , mais mon préféré est le raisin .\n",
      "paris est relaxant en décembre , mais il est généralement froid en juillet .\n",
      "new jersey est occupé au printemps , et il est jamais chaude en mars .\n",
      "notre fruit est moins aimé le citron , mais mon moins aimé est le raisin .\n",
      "les états-unis est parfois occupé en janvier , et il est parfois chaud en novembre .\n"
     ]
    }
   ],
   "source": [
    "view_sentence_range = (0, 10)\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "import numpy as np\n",
    "\n",
    "print('Dataset Stats')\n",
    "print('Roughly the number of unique words: {}'.format(len({word: None for word in source_text.split()})))\n",
    "\n",
    "sentences = source_text.split('\\n')\n",
    "word_counts = [len(sentence.split()) for sentence in sentences]\n",
    "print('Number of sentences: {}'.format(len(sentences)))\n",
    "print('Average number of words in a sentence: {}'.format(np.average(word_counts)))\n",
    "\n",
    "print()\n",
    "print('English sentences {} to {}:'.format(*view_sentence_range))\n",
    "print('\\n'.join(source_text.split('\\n')[view_sentence_range[0]:view_sentence_range[1]]))\n",
    "print()\n",
    "print('French sentences {} to {}:'.format(*view_sentence_range))\n",
    "print('\\n'.join(target_text.split('\\n')[view_sentence_range[0]:view_sentence_range[1]]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "## Implement Preprocessing Function\n",
    "### Text to Word Ids\n",
    "As you did with other RNNs, you must turn the text into a number so the computer can understand it. In the function `text_to_ids()`, you'll turn `source_text` and `target_text` from words to ids.  However, you need to add the `<EOS>` word id at the end of each sentence from `target_text`.  This will help the neural network predict when the sentence should end.\n",
    "\n",
    "You can get the `<EOS>` word id by doing:\n",
    "```python\n",
    "target_vocab_to_int['<EOS>']\n",
    "```\n",
    "You can get other word ids using `source_vocab_to_int` and `target_vocab_to_int`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def text_to_ids(source_text, target_text, source_vocab_to_int, target_vocab_to_int):\n",
    "    \"\"\"\n",
    "    Convert source and target text to proper word ids\n",
    "    :param source_text: String that contains all the source text.\n",
    "    :param target_text: String that contains all the target text.\n",
    "    :param source_vocab_to_int: Dictionary to go from the source words to an id\n",
    "    :param target_vocab_to_int: Dictionary to go from the target words to an id\n",
    "    :return: A tuple of lists (source_id_text, target_id_text)\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    source_sentences = [sentence for sentence in source_text.split('\\n')]\n",
    "    target_sentences = [sentence + ' <EOS>' for sentence in target_text.split('\\n')]\n",
    "    \n",
    "    source_id_text = [[source_vocab_to_int[word] for word in sentence.split()] for sentence in source_sentences]\n",
    "    target_id_text = [[target_vocab_to_int[word] for word in sentence.split()] for sentence in target_sentences]\n",
    "    \n",
    "    return source_id_text, target_id_text\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_text_to_ids(text_to_ids)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Preprocess all the data and save it\n",
    "Running the code cell below will preprocess all the data and save it to file."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "helper.preprocess_and_save_data(source_path, target_path, text_to_ids)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "# Check Point\n",
    "This is your first checkpoint. If you ever decide to come back to this notebook or have to restart the notebook, you can start from here. The preprocessed data has been saved to disk."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "import numpy as np\n",
    "import helper\n",
    "\n",
    "(source_int_text, target_int_text), (source_vocab_to_int, target_vocab_to_int), _ = helper.load_preprocess()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Check the Version of TensorFlow and Access to GPU\n",
    "This will check to make sure you have the correct version of TensorFlow and access to a GPU"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "TensorFlow Version: 1.0.0\n",
      "Default GPU Device: /gpu:0\n"
     ]
    }
   ],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "from distutils.version import LooseVersion\n",
    "import warnings\n",
    "import tensorflow as tf\n",
    "\n",
    "# Check TensorFlow Version\n",
    "assert LooseVersion(tf.__version__) in [LooseVersion('1.0.0'), LooseVersion('1.0.1')], 'This project requires TensorFlow version 1.0  You are using {}'.format(tf.__version__)\n",
    "print('TensorFlow Version: {}'.format(tf.__version__))\n",
    "\n",
    "# Check for a GPU\n",
    "if not tf.test.gpu_device_name():\n",
    "    warnings.warn('No GPU found. Please use a GPU to train your neural network.')\n",
    "else:\n",
    "    print('Default GPU Device: {}'.format(tf.test.gpu_device_name()))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "## Build the Neural Network\n",
    "You'll build the components necessary to build a Sequence-to-Sequence model by implementing the following functions below:\n",
    "- `model_inputs`\n",
    "- `process_decoding_input`\n",
    "- `encoding_layer`\n",
    "- `decoding_layer_train`\n",
    "- `decoding_layer_infer`\n",
    "- `decoding_layer`\n",
    "- `seq2seq_model`\n",
    "\n",
    "### Input\n",
    "Implement the `model_inputs()` function to create TF Placeholders for the Neural Network. It should create the following placeholders:\n",
    "\n",
    "- Input text placeholder named \"input\" using the TF Placeholder name parameter with rank 2.\n",
    "- Targets placeholder with rank 2.\n",
    "- Learning rate placeholder with rank 0.\n",
    "- Keep probability placeholder named \"keep_prob\" using the TF Placeholder name parameter with rank 0.\n",
    "\n",
    "Return the placeholders in the following the tuple (Input, Targets, Learing Rate, Keep Probability)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def model_inputs():\n",
    "    \"\"\"\n",
    "    Create TF Placeholders for input, targets, and learning rate.\n",
    "    :return: Tuple (input, targets, learning rate, keep probability)\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    input_ = tf.placeholder(tf.int32, [None, None], 'input')\n",
    "    target_ = tf.placeholder(tf.int32, [None, None], 'target')\n",
    "    lr_ = tf.placeholder(tf.float32, None, 'lr')\n",
    "    keep_prob_ = tf.placeholder(tf.float32, None, 'keep_prob')\n",
    "    return input_, target_, lr_, keep_prob_\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_model_inputs(model_inputs)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Process Decoding Input\n",
    "Implement `process_decoding_input` using TensorFlow to remove the last word id from each batch in `target_data` and concat the GO ID to the beginning of each batch."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def process_decoding_input(target_data, target_vocab_to_int, batch_size):\n",
    "    \"\"\"\n",
    "    Preprocess target data for dencoding\n",
    "    :param target_data: Target Placehoder\n",
    "    :param target_vocab_to_int: Dictionary to go from the target words to an id\n",
    "    :param batch_size: Batch Size\n",
    "    :return: Preprocessed target data\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    a = tf.strided_slice(target_data, [0, 0], [batch_size, -1], [1, 1])\n",
    "    b = tf.fill([batch_size, 1], target_vocab_to_int['<GO>'])\n",
    "    c = tf.concat([b, a], 1)\n",
    "    \n",
    "    return c\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_process_decoding_input(process_decoding_input)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Encoding\n",
    "Implement `encoding_layer()` to create a Encoder RNN layer using [`tf.nn.dynamic_rnn()`](https://www.tensorflow.org/api_docs/python/tf/nn/dynamic_rnn)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def encoding_layer(rnn_inputs, rnn_size, num_layers, keep_prob):\n",
    "    \"\"\"\n",
    "    Create encoding layer\n",
    "    :param rnn_inputs: Inputs for the RNN\n",
    "    :param rnn_size: RNN Size\n",
    "    :param num_layers: Number of layers\n",
    "    :param keep_prob: Dropout keep probability\n",
    "    :return: RNN state\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    lstm = tf.contrib.rnn.BasicLSTMCell(rnn_size)\n",
    "    dropout = tf.contrib.rnn.DropoutWrapper(lstm, keep_prob)\n",
    "    cell = tf.contrib.rnn.MultiRNNCell([dropout] * num_layers)\n",
    "\n",
    "    _, final_state = tf.nn.dynamic_rnn(cell, rnn_inputs, dtype=tf.float32)\n",
    "    return final_state\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_encoding_layer(encoding_layer)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Decoding - Training\n",
    "Create training logits using [`tf.contrib.seq2seq.simple_decoder_fn_train()`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/simple_decoder_fn_train) and [`tf.contrib.seq2seq.dynamic_rnn_decoder()`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/dynamic_rnn_decoder).  Apply the `output_fn` to the [`tf.contrib.seq2seq.dynamic_rnn_decoder()`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/dynamic_rnn_decoder) outputs."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def decoding_layer_train(encoder_state, dec_cell, dec_embed_input, sequence_length, decoding_scope,\n",
    "                         output_fn, keep_prob):\n",
    "    \"\"\"\n",
    "    Create a decoding layer for training\n",
    "    :param encoder_state: Encoder State\n",
    "    :param dec_cell: Decoder RNN Cell\n",
    "    :param dec_embed_input: Decoder embedded input\n",
    "    :param sequence_length: Sequence Length\n",
    "    :param decoding_scope: TenorFlow Variable Scope for decoding\n",
    "    :param output_fn: Function to apply the output layer\n",
    "    :param keep_prob: Dropout keep probability\n",
    "    :return: Train Logits\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    dec_fn_train = tf.contrib.seq2seq.simple_decoder_fn_train(encoder_state)\n",
    "    outputs_train, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(dec_cell, \n",
    "                                                                 dec_fn_train, \n",
    "                                                                 dec_embed_input, \n",
    "                                                                 sequence_length, \n",
    "                                                                 scope=decoding_scope)\n",
    "    logits_train = output_fn(outputs_train)\n",
    "    logits = tf.nn.dropout(logits_train, keep_prob)\n",
    "    return logits\n",
    "\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_decoding_layer_train(decoding_layer_train)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Decoding - Inference\n",
    "Create inference logits using [`tf.contrib.seq2seq.simple_decoder_fn_inference()`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/simple_decoder_fn_inference) and [`tf.contrib.seq2seq.dynamic_rnn_decoder()`](https://www.tensorflow.org/api_docs/python/tf/contrib/seq2seq/dynamic_rnn_decoder). "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, start_of_sequence_id, end_of_sequence_id,\n",
    "                         maximum_length, vocab_size, decoding_scope, output_fn, keep_prob):\n",
    "    \"\"\"\n",
    "    Create a decoding layer for inference\n",
    "    :param encoder_state: Encoder state\n",
    "    :param dec_cell: Decoder RNN Cell\n",
    "    :param dec_embeddings: Decoder embeddings\n",
    "    :param start_of_sequence_id: GO ID\n",
    "    :param end_of_sequence_id: EOS Id\n",
    "    :param maximum_length: The maximum allowed time steps to decode\n",
    "    :param vocab_size: Size of vocabulary\n",
    "    :param decoding_scope: TensorFlow Variable Scope for decoding\n",
    "    :param output_fn: Function to apply the output layer\n",
    "    :param keep_prob: Dropout keep probability\n",
    "    :return: Inference Logits\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    dec_fn_infer = tf.contrib.seq2seq.simple_decoder_fn_inference(output_fn, \n",
    "                                                                  encoder_state, \n",
    "                                                                  dec_embeddings, \n",
    "                                                                  start_of_sequence_id, \n",
    "                                                                  end_of_sequence_id, \n",
    "                                                                  maximum_length, \n",
    "                                                                  vocab_size)\n",
    "    dropouted = tf.contrib.rnn.DropoutWrapper(dec_cell, keep_prob)\n",
    "    logits_infer, _, _ = tf.contrib.seq2seq.dynamic_rnn_decoder(dropouted, dec_fn_infer, \n",
    "                                                                sequence_length=maximum_length, \n",
    "                                                                scope=decoding_scope)\n",
    "    \n",
    "    return logits_infer\n",
    "\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_decoding_layer_infer(decoding_layer_infer)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Build the Decoding Layer\n",
    "Implement `decoding_layer()` to create a Decoder RNN layer.\n",
    "\n",
    "- Create RNN cell for decoding using `rnn_size` and `num_layers`.\n",
    "- Create the output fuction using [`lambda`](https://docs.python.org/3/tutorial/controlflow.html#lambda-expressions) to transform it's input, logits, to class logits.\n",
    "- Use the your `decoding_layer_train(encoder_state, dec_cell, dec_embed_input, sequence_length, decoding_scope, output_fn, keep_prob)` function to get the training logits.\n",
    "- Use your `decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, start_of_sequence_id, end_of_sequence_id, maximum_length, vocab_size, decoding_scope, output_fn, keep_prob)` function to get the inference logits.\n",
    "\n",
    "Note: You'll need to use [tf.variable_scope](https://www.tensorflow.org/api_docs/python/tf/variable_scope) to share variables between training and inference."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def decoding_layer(dec_embed_input, dec_embeddings, encoder_state, vocab_size, sequence_length, rnn_size,\n",
    "                   num_layers, target_vocab_to_int, keep_prob):\n",
    "    \"\"\"\n",
    "    Create decoding layer\n",
    "    :param dec_embed_input: Decoder embedded input\n",
    "    :param dec_embeddings: Decoder embeddings\n",
    "    :param encoder_state: The encoded state\n",
    "    :param vocab_size: Size of vocabulary\n",
    "    :param sequence_length: Sequence Length\n",
    "    :param rnn_size: RNN Size\n",
    "    :param num_layers: Number of layers\n",
    "    :param target_vocab_to_int: Dictionary to go from the target words to an id\n",
    "    :param keep_prob: Dropout keep probability\n",
    "    :return: Tuple of (Training Logits, Inference Logits)\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    lstm = tf.contrib.rnn.BasicLSTMCell(rnn_size)\n",
    "    dropout = tf.contrib.rnn.DropoutWrapper(lstm, keep_prob)\n",
    "    dec_cell = tf.contrib.rnn.MultiRNNCell([dropout] * num_layers)\n",
    "    \n",
    "    max_target_sentence_length = max([len(sentence) for sentence in source_int_text])\n",
    "    \n",
    "    with tf.variable_scope('decoding_layer') as decoding_scope:\n",
    "        output_fn = lambda x: tf.contrib.layers.fully_connected(x, vocab_size, None, scope=decoding_scope)\n",
    "    \n",
    "    with tf.variable_scope('decoding_layer') as decoding_scope:\n",
    "        logits_train = decoding_layer_train(encoder_state, dec_cell, dec_embed_input, \n",
    "                                            sequence_length, decoding_scope, output_fn, keep_prob)\n",
    "    \n",
    "    with tf.variable_scope('decoding_layer', reuse=True) as decoding_scope:\n",
    "        logits_infer = decoding_layer_infer(encoder_state, dec_cell, dec_embeddings, \n",
    "                                            target_vocab_to_int['<GO>'], target_vocab_to_int['<EOS>'], \n",
    "                                            max_target_sentence_length, \n",
    "                                            vocab_size, decoding_scope, output_fn, keep_prob)\n",
    "    \n",
    "    return logits_train, logits_infer\n",
    "\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_decoding_layer(decoding_layer)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Build the Neural Network\n",
    "Apply the functions you implemented above to:\n",
    "\n",
    "- Apply embedding to the input data for the encoder.\n",
    "- Encode the input using your `encoding_layer(rnn_inputs, rnn_size, num_layers, keep_prob)`.\n",
    "- Process target data using your `process_decoding_input(target_data, target_vocab_to_int, batch_size)` function.\n",
    "- Apply embedding to the target data for the decoder.\n",
    "- Decode the encoded input using your `decoding_layer(dec_embed_input, dec_embeddings, encoder_state, vocab_size, sequence_length, rnn_size, num_layers, target_vocab_to_int, keep_prob)`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def seq2seq_model(input_data, target_data, keep_prob, batch_size, sequence_length, source_vocab_size, target_vocab_size,\n",
    "                  enc_embedding_size, dec_embedding_size, rnn_size, num_layers, target_vocab_to_int):\n",
    "    \"\"\"\n",
    "    Build the Sequence-to-Sequence part of the neural network\n",
    "    :param input_data: Input placeholder\n",
    "    :param target_data: Target placeholder\n",
    "    :param keep_prob: Dropout keep probability placeholder\n",
    "    :param batch_size: Batch Size\n",
    "    :param sequence_length: Sequence Length\n",
    "    :param source_vocab_size: Source vocabulary size\n",
    "    :param target_vocab_size: Target vocabulary size\n",
    "    :param enc_embedding_size: Decoder embedding size\n",
    "    :param dec_embedding_size: Encoder embedding size\n",
    "    :param rnn_size: RNN Size\n",
    "    :param num_layers: Number of layers\n",
    "    :param target_vocab_to_int: Dictionary to go from the target words to an id\n",
    "    :return: Tuple of (Training Logits, Inference Logits)\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    enc_embed_input = tf.contrib.layers.embed_sequence(input_data, source_vocab_size, enc_embedding_size)\n",
    "    enc_state = encoding_layer(enc_embed_input, rnn_size, num_layers, keep_prob)\n",
    "    \n",
    "    dec_input = process_decoding_input(target_data, target_vocab_to_int, batch_size)\n",
    "    dec_embeddings = tf.Variable(tf.truncated_normal([target_vocab_size, dec_embedding_size], stddev=0.01))\n",
    "    dec_embed_input = tf.nn.embedding_lookup(dec_embeddings, dec_input)\n",
    "    logits_train, logits_infer = decoding_layer(dec_embed_input, dec_embeddings, \n",
    "                                                enc_state, target_vocab_size, \n",
    "                                                sequence_length, rnn_size, num_layers, \n",
    "                                                target_vocab_to_int, keep_prob)\n",
    "    \n",
    "    return logits_train, logits_infer\n",
    "\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_seq2seq_model(seq2seq_model)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "## Neural Network Training\n",
    "### Hyperparameters\n",
    "Tune the following parameters:\n",
    "\n",
    "- Set `epochs` to the number of epochs.\n",
    "- Set `batch_size` to the batch size.\n",
    "- Set `rnn_size` to the size of the RNNs.\n",
    "- Set `num_layers` to the number of layers.\n",
    "- Set `encoding_embedding_size` to the size of the embedding for the encoder.\n",
    "- Set `decoding_embedding_size` to the size of the embedding for the decoder.\n",
    "- Set `learning_rate` to the learning rate.\n",
    "- Set `keep_probability` to the Dropout keep probability"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": true,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "# Number of Epochs\n",
    "epochs = 15\n",
    "# Batch Size\n",
    "batch_size = 256\n",
    "# RNN Size\n",
    "rnn_size = 350\n",
    "# Number of Layers\n",
    "num_layers = 3\n",
    "# Embedding Size\n",
    "encoding_embedding_size = 150\n",
    "decoding_embedding_size = 150\n",
    "# Learning Rate\n",
    "learning_rate = 0.001\n",
    "# Dropout Keep Probability\n",
    "keep_probability = 0.75"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Build the Graph\n",
    "Build the graph using the neural network you implemented."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "save_path = 'checkpoints/dev'\n",
    "(source_int_text, target_int_text), (source_vocab_to_int, target_vocab_to_int), _ = helper.load_preprocess()\n",
    "max_source_sentence_length = max([len(sentence) for sentence in source_int_text])\n",
    "\n",
    "train_graph = tf.Graph()\n",
    "with train_graph.as_default():\n",
    "    input_data, targets, lr, keep_prob = model_inputs()\n",
    "    sequence_length = tf.placeholder_with_default(max_source_sentence_length, None, name='sequence_length')\n",
    "    input_shape = tf.shape(input_data)\n",
    "    \n",
    "    train_logits, inference_logits = seq2seq_model(\n",
    "        tf.reverse(input_data, [-1]), targets, keep_prob, batch_size, sequence_length, len(source_vocab_to_int), len(target_vocab_to_int),\n",
    "        encoding_embedding_size, decoding_embedding_size, rnn_size, num_layers, target_vocab_to_int)\n",
    "\n",
    "    tf.identity(inference_logits, 'logits')\n",
    "    with tf.name_scope(\"optimization\"):\n",
    "        # Loss function\n",
    "        cost = tf.contrib.seq2seq.sequence_loss(\n",
    "            train_logits,\n",
    "            targets,\n",
    "            tf.ones([input_shape[0], sequence_length]))\n",
    "\n",
    "        # Optimizer\n",
    "        optimizer = tf.train.AdamOptimizer(lr)\n",
    "\n",
    "        # Gradient Clipping\n",
    "        gradients = optimizer.compute_gradients(cost)\n",
    "        capped_gradients = [(tf.clip_by_value(grad, -1., 1.), var) for grad, var in gradients if grad is not None]\n",
    "        train_op = optimizer.apply_gradients(capped_gradients)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Train\n",
    "Train the neural network on the preprocessed data. If you have a hard time getting a good loss, check the forms to see if anyone is having the same problem."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch   0 Batch    0/538 - Train Accuracy:  0.263, Validation Accuracy:  0.341, Loss:  5.881\n",
      "Epoch   0 Batch    1/538 - Train Accuracy:  0.239, Validation Accuracy:  0.325, Loss:  5.857\n",
      "Epoch   0 Batch    2/538 - Train Accuracy:  0.252, Validation Accuracy:  0.316, Loss:  5.718\n",
      "Epoch   0 Batch    3/538 - Train Accuracy:  0.229, Validation Accuracy:  0.316, Loss:  5.074\n",
      "Epoch   0 Batch    4/538 - Train Accuracy:  0.239, Validation Accuracy:  0.317, Loss:  5.186\n",
      "Epoch   0 Batch    5/538 - Train Accuracy:  0.296, Validation Accuracy:  0.351, Loss:  4.536\n",
      "Epoch   0 Batch    6/538 - Train Accuracy:  0.303, Validation Accuracy:  0.346, Loss:  4.373\n",
      "Epoch   0 Batch    7/538 - Train Accuracy:  0.277, Validation Accuracy:  0.344, Loss:  4.433\n",
      "Epoch   0 Batch    8/538 - Train Accuracy:  0.278, Validation Accuracy:  0.346, Loss:  4.332\n",
      "Epoch   0 Batch    9/538 - Train Accuracy:  0.279, Validation Accuracy:  0.347, Loss:  4.177\n",
      "Epoch   0 Batch   10/538 - Train Accuracy:  0.274, Validation Accuracy:  0.358, Loss:  4.148\n",
      "Epoch   0 Batch   11/538 - Train Accuracy:  0.290, Validation Accuracy:  0.364, Loss:  4.113\n",
      "Epoch   0 Batch   12/538 - Train Accuracy:  0.295, Validation Accuracy:  0.376, Loss:  4.137\n",
      "Epoch   0 Batch   13/538 - Train Accuracy:  0.349, Validation Accuracy:  0.375, Loss:  3.900\n",
      "Epoch   0 Batch   14/538 - Train Accuracy:  0.305, Validation Accuracy:  0.372, Loss:  4.002\n",
      "Epoch   0 Batch   15/538 - Train Accuracy:  0.347, Validation Accuracy:  0.375, Loss:  3.903\n",
      "Epoch   0 Batch   16/538 - Train Accuracy:  0.338, Validation Accuracy:  0.379, Loss:  3.851\n",
      "Epoch   0 Batch   17/538 - Train Accuracy:  0.327, Validation Accuracy:  0.385, Loss:  3.876\n",
      "Epoch   0 Batch   18/538 - Train Accuracy:  0.316, Validation Accuracy:  0.386, Loss:  3.842\n",
      "Epoch   0 Batch   19/538 - Train Accuracy:  0.314, Validation Accuracy:  0.387, Loss:  3.806\n",
      "Epoch   0 Batch   20/538 - Train Accuracy:  0.352, Validation Accuracy:  0.395, Loss:  3.718\n",
      "Epoch   0 Batch   21/538 - Train Accuracy:  0.295, Validation Accuracy:  0.407, Loss:  3.852\n",
      "Epoch   0 Batch   22/538 - Train Accuracy:  0.348, Validation Accuracy:  0.410, Loss:  3.719\n",
      "Epoch   0 Batch   23/538 - Train Accuracy:  0.367, Validation Accuracy:  0.421, Loss:  3.712\n",
      "Epoch   0 Batch   24/538 - Train Accuracy:  0.369, Validation Accuracy:  0.419, Loss:  3.655\n",
      "Epoch   0 Batch   25/538 - Train Accuracy:  0.357, Validation Accuracy:  0.415, Loss:  3.691\n",
      "Epoch   0 Batch   26/538 - Train Accuracy:  0.369, Validation Accuracy:  0.429, Loss:  3.672\n",
      "Epoch   0 Batch   27/538 - Train Accuracy:  0.378, Validation Accuracy:  0.434, Loss:  3.543\n",
      "Epoch   0 Batch   28/538 - Train Accuracy:  0.424, Validation Accuracy:  0.427, Loss:  3.392\n",
      "Epoch   0 Batch   29/538 - Train Accuracy:  0.388, Validation Accuracy:  0.431, Loss:  3.488\n",
      "Epoch   0 Batch   30/538 - Train Accuracy:  0.376, Validation Accuracy:  0.439, Loss:  3.537\n",
      "Epoch   0 Batch   31/538 - Train Accuracy:  0.400, Validation Accuracy:  0.436, Loss:  3.472\n",
      "Epoch   0 Batch   32/538 - Train Accuracy:  0.384, Validation Accuracy:  0.443, Loss:  3.437\n",
      "Epoch   0 Batch   33/538 - Train Accuracy:  0.415, Validation Accuracy:  0.453, Loss:  3.373\n",
      "Epoch   0 Batch   34/538 - Train Accuracy:  0.399, Validation Accuracy:  0.449, Loss:  3.422\n",
      "Epoch   0 Batch   35/538 - Train Accuracy:  0.367, Validation Accuracy:  0.441, Loss:  3.447\n",
      "Epoch   0 Batch   36/538 - Train Accuracy:  0.413, Validation Accuracy:  0.450, Loss:  3.361\n",
      "Epoch   0 Batch   37/538 - Train Accuracy:  0.391, Validation Accuracy:  0.448, Loss:  3.366\n",
      "Epoch   0 Batch   38/538 - Train Accuracy:  0.368, Validation Accuracy:  0.445, Loss:  3.396\n",
      "Epoch   0 Batch   39/538 - Train Accuracy:  0.401, Validation Accuracy:  0.464, Loss:  3.363\n",
      "Epoch   0 Batch   40/538 - Train Accuracy:  0.451, Validation Accuracy:  0.462, Loss:  3.169\n",
      "Epoch   0 Batch   41/538 - Train Accuracy:  0.388, Validation Accuracy:  0.449, Loss:  3.341\n",
      "Epoch   0 Batch   42/538 - Train Accuracy:  0.428, Validation Accuracy:  0.477, Loss:  3.324\n",
      "Epoch   0 Batch   43/538 - Train Accuracy:  0.405, Validation Accuracy:  0.460, Loss:  3.353\n",
      "Epoch   0 Batch   44/538 - Train Accuracy:  0.386, Validation Accuracy:  0.452, Loss:  3.285\n",
      "Epoch   0 Batch   45/538 - Train Accuracy:  0.451, Validation Accuracy:  0.478, Loss:  3.155\n",
      "Epoch   0 Batch   46/538 - Train Accuracy:  0.413, Validation Accuracy:  0.472, Loss:  3.258\n",
      "Epoch   0 Batch   47/538 - Train Accuracy:  0.424, Validation Accuracy:  0.455, Loss:  3.163\n",
      "Epoch   0 Batch   48/538 - Train Accuracy:  0.461, Validation Accuracy:  0.482, Loss:  3.124\n",
      "Epoch   0 Batch   49/538 - Train Accuracy:  0.413, Validation Accuracy:  0.486, Loss:  3.257\n",
      "Epoch   0 Batch   50/538 - Train Accuracy:  0.409, Validation Accuracy:  0.470, Loss:  3.204\n",
      "Epoch   0 Batch   51/538 - Train Accuracy:  0.367, Validation Accuracy:  0.479, Loss:  3.326\n",
      "Epoch   0 Batch   52/538 - Train Accuracy:  0.420, Validation Accuracy:  0.466, Loss:  3.180\n",
      "Epoch   0 Batch   53/538 - Train Accuracy:  0.457, Validation Accuracy:  0.478, Loss:  3.094\n",
      "Epoch   0 Batch   54/538 - Train Accuracy:  0.450, Validation Accuracy:  0.487, Loss:  3.106\n",
      "Epoch   0 Batch   55/538 - Train Accuracy:  0.389, Validation Accuracy:  0.465, Loss:  3.187\n",
      "Epoch   0 Batch   56/538 - Train Accuracy:  0.438, Validation Accuracy:  0.480, Loss:  3.070\n",
      "Epoch   0 Batch   57/538 - Train Accuracy:  0.414, Validation Accuracy:  0.491, Loss:  3.160\n",
      "Epoch   0 Batch   58/538 - Train Accuracy:  0.385, Validation Accuracy:  0.474, Loss:  3.141\n",
      "Epoch   0 Batch   59/538 - Train Accuracy:  0.431, Validation Accuracy:  0.495, Loss:  3.114\n",
      "Epoch   0 Batch   60/538 - Train Accuracy:  0.446, Validation Accuracy:  0.495, Loss:  3.056\n",
      "Epoch   0 Batch   61/538 - Train Accuracy:  0.436, Validation Accuracy:  0.493, Loss:  3.061\n",
      "Epoch   0 Batch   62/538 - Train Accuracy:  0.454, Validation Accuracy:  0.502, Loss:  2.970\n",
      "Epoch   0 Batch   63/538 - Train Accuracy:  0.478, Validation Accuracy:  0.492, Loss:  2.961\n",
      "Epoch   0 Batch   64/538 - Train Accuracy:  0.460, Validation Accuracy:  0.499, Loss:  2.944\n",
      "Epoch   0 Batch   65/538 - Train Accuracy:  0.425, Validation Accuracy:  0.495, Loss:  3.057\n",
      "Epoch   0 Batch   66/538 - Train Accuracy:  0.462, Validation Accuracy:  0.490, Loss:  2.914\n",
      "Epoch   0 Batch   67/538 - Train Accuracy:  0.414, Validation Accuracy:  0.472, Loss:  3.040\n",
      "Epoch   0 Batch   68/538 - Train Accuracy:  0.466, Validation Accuracy:  0.496, Loss:  2.922\n",
      "Epoch   0 Batch   69/538 - Train Accuracy:  0.438, Validation Accuracy:  0.497, Loss:  3.002\n",
      "Epoch   0 Batch   70/538 - Train Accuracy:  0.444, Validation Accuracy:  0.488, Loss:  2.859\n",
      "Epoch   0 Batch   71/538 - Train Accuracy:  0.449, Validation Accuracy:  0.496, Loss:  2.934\n",
      "Epoch   0 Batch   72/538 - Train Accuracy:  0.464, Validation Accuracy:  0.488, Loss:  2.768\n",
      "Epoch   0 Batch   73/538 - Train Accuracy:  0.414, Validation Accuracy:  0.481, Loss:  2.902\n",
      "Epoch   0 Batch   74/538 - Train Accuracy:  0.472, Validation Accuracy:  0.501, Loss:  2.826\n",
      "Epoch   0 Batch   75/538 - Train Accuracy:  0.471, Validation Accuracy:  0.493, Loss:  2.851\n",
      "Epoch   0 Batch   76/538 - Train Accuracy:  0.433, Validation Accuracy:  0.488, Loss:  2.895\n",
      "Epoch   0 Batch   77/538 - Train Accuracy:  0.438, Validation Accuracy:  0.504, Loss:  2.894\n",
      "Epoch   0 Batch   78/538 - Train Accuracy:  0.468, Validation Accuracy:  0.502, Loss:  2.822\n",
      "Epoch   0 Batch   79/538 - Train Accuracy:  0.467, Validation Accuracy:  0.502, Loss:  2.770\n",
      "Epoch   0 Batch   80/538 - Train Accuracy:  0.456, Validation Accuracy:  0.505, Loss:  2.865\n",
      "Epoch   0 Batch   81/538 - Train Accuracy:  0.422, Validation Accuracy:  0.487, Loss:  2.898\n",
      "Epoch   0 Batch   82/538 - Train Accuracy:  0.442, Validation Accuracy:  0.504, Loss:  2.794\n",
      "Epoch   0 Batch   83/538 - Train Accuracy:  0.456, Validation Accuracy:  0.519, Loss:  2.800\n",
      "Epoch   0 Batch   84/538 - Train Accuracy:  0.453, Validation Accuracy:  0.493, Loss:  2.783\n",
      "Epoch   0 Batch   85/538 - Train Accuracy:  0.473, Validation Accuracy:  0.498, Loss:  2.662\n",
      "Epoch   0 Batch   86/538 - Train Accuracy:  0.446, Validation Accuracy:  0.496, Loss:  2.764\n",
      "Epoch   0 Batch   87/538 - Train Accuracy:  0.448, Validation Accuracy:  0.503, Loss:  2.775\n",
      "Epoch   0 Batch   88/538 - Train Accuracy:  0.450, Validation Accuracy:  0.496, Loss:  2.714\n",
      "Epoch   0 Batch   89/538 - Train Accuracy:  0.464, Validation Accuracy:  0.507, Loss:  2.728\n",
      "Epoch   0 Batch   90/538 - Train Accuracy:  0.485, Validation Accuracy:  0.515, Loss:  2.711\n",
      "Epoch   0 Batch   91/538 - Train Accuracy:  0.430, Validation Accuracy:  0.492, Loss:  2.732\n",
      "Epoch   0 Batch   92/538 - Train Accuracy:  0.468, Validation Accuracy:  0.516, Loss:  2.760\n",
      "Epoch   0 Batch   93/538 - Train Accuracy:  0.443, Validation Accuracy:  0.511, Loss:  2.788\n",
      "Epoch   0 Batch   94/538 - Train Accuracy:  0.435, Validation Accuracy:  0.495, Loss:  2.731\n",
      "Epoch   0 Batch   95/538 - Train Accuracy:  0.502, Validation Accuracy:  0.509, Loss:  2.635\n",
      "Epoch   0 Batch   96/538 - Train Accuracy:  0.499, Validation Accuracy:  0.507, Loss:  2.611\n",
      "Epoch   0 Batch   97/538 - Train Accuracy:  0.439, Validation Accuracy:  0.504, Loss:  2.700\n",
      "Epoch   0 Batch   98/538 - Train Accuracy:  0.484, Validation Accuracy:  0.506, Loss:  2.567\n",
      "Epoch   0 Batch   99/538 - Train Accuracy:  0.471, Validation Accuracy:  0.517, Loss:  2.696\n",
      "Epoch   0 Batch  100/538 - Train Accuracy:  0.464, Validation Accuracy:  0.511, Loss:  2.622\n",
      "Epoch   0 Batch  101/538 - Train Accuracy:  0.459, Validation Accuracy:  0.508, Loss:  2.620\n",
      "Epoch   0 Batch  102/538 - Train Accuracy:  0.474, Validation Accuracy:  0.523, Loss:  2.669\n",
      "Epoch   0 Batch  103/538 - Train Accuracy:  0.470, Validation Accuracy:  0.506, Loss:  2.630\n",
      "Epoch   0 Batch  104/538 - Train Accuracy:  0.478, Validation Accuracy:  0.514, Loss:  2.601\n",
      "Epoch   0 Batch  105/538 - Train Accuracy:  0.491, Validation Accuracy:  0.519, Loss:  2.541\n",
      "Epoch   0 Batch  106/538 - Train Accuracy:  0.461, Validation Accuracy:  0.517, Loss:  2.656\n",
      "Epoch   0 Batch  107/538 - Train Accuracy:  0.444, Validation Accuracy:  0.508, Loss:  2.682\n",
      "Epoch   0 Batch  108/538 - Train Accuracy:  0.463, Validation Accuracy:  0.505, Loss:  2.634\n",
      "Epoch   0 Batch  109/538 - Train Accuracy:  0.478, Validation Accuracy:  0.520, Loss:  2.616\n",
      "Epoch   0 Batch  110/538 - Train Accuracy:  0.468, Validation Accuracy:  0.521, Loss:  2.631\n",
      "Epoch   0 Batch  111/538 - Train Accuracy:  0.483, Validation Accuracy:  0.512, Loss:  2.504\n",
      "Epoch   0 Batch  112/538 - Train Accuracy:  0.456, Validation Accuracy:  0.525, Loss:  2.584\n",
      "Epoch   0 Batch  113/538 - Train Accuracy:  0.466, Validation Accuracy:  0.519, Loss:  2.638\n",
      "Epoch   0 Batch  114/538 - Train Accuracy:  0.512, Validation Accuracy:  0.514, Loss:  2.509\n",
      "Epoch   0 Batch  115/538 - Train Accuracy:  0.452, Validation Accuracy:  0.503, Loss:  2.602\n",
      "Epoch   0 Batch  116/538 - Train Accuracy:  0.481, Validation Accuracy:  0.511, Loss:  2.596\n",
      "Epoch   0 Batch  117/538 - Train Accuracy:  0.470, Validation Accuracy:  0.499, Loss:  2.534\n",
      "Epoch   0 Batch  118/538 - Train Accuracy:  0.499, Validation Accuracy:  0.519, Loss:  2.632\n",
      "Epoch   0 Batch  119/538 - Train Accuracy:  0.475, Validation Accuracy:  0.508, Loss:  2.530\n",
      "Epoch   0 Batch  120/538 - Train Accuracy:  0.477, Validation Accuracy:  0.506, Loss:  2.513\n",
      "Epoch   0 Batch  121/538 - Train Accuracy:  0.476, Validation Accuracy:  0.514, Loss:  2.497\n",
      "Epoch   0 Batch  122/538 - Train Accuracy:  0.471, Validation Accuracy:  0.507, Loss:  2.505\n",
      "Epoch   0 Batch  123/538 - Train Accuracy:  0.510, Validation Accuracy:  0.521, Loss:  2.485\n",
      "Epoch   0 Batch  124/538 - Train Accuracy:  0.475, Validation Accuracy:  0.498, Loss:  2.454\n",
      "Epoch   0 Batch  125/538 - Train Accuracy:  0.485, Validation Accuracy:  0.509, Loss:  2.502\n",
      "Epoch   0 Batch  126/538 - Train Accuracy:  0.502, Validation Accuracy:  0.516, Loss:  2.473\n",
      "Epoch   0 Batch  127/538 - Train Accuracy:  0.454, Validation Accuracy:  0.520, Loss:  2.544\n",
      "Epoch   0 Batch  128/538 - Train Accuracy:  0.486, Validation Accuracy:  0.512, Loss:  2.437\n",
      "Epoch   0 Batch  129/538 - Train Accuracy:  0.471, Validation Accuracy:  0.502, Loss:  2.456\n",
      "Epoch   0 Batch  130/538 - Train Accuracy:  0.478, Validation Accuracy:  0.510, Loss:  2.449\n",
      "Epoch   0 Batch  131/538 - Train Accuracy:  0.455, Validation Accuracy:  0.519, Loss:  2.529\n",
      "Epoch   0 Batch  132/538 - Train Accuracy:  0.499, Validation Accuracy:  0.512, Loss:  2.473\n",
      "Epoch   0 Batch  133/538 - Train Accuracy:  0.484, Validation Accuracy:  0.501, Loss:  2.348\n",
      "Epoch   0 Batch  134/538 - Train Accuracy:  0.440, Validation Accuracy:  0.506, Loss:  2.554\n",
      "Epoch   0 Batch  135/538 - Train Accuracy:  0.495, Validation Accuracy:  0.523, Loss:  2.403\n",
      "Epoch   0 Batch  136/538 - Train Accuracy:  0.477, Validation Accuracy:  0.511, Loss:  2.456\n",
      "Epoch   0 Batch  137/538 - Train Accuracy:  0.472, Validation Accuracy:  0.507, Loss:  2.438\n",
      "Epoch   0 Batch  138/538 - Train Accuracy:  0.466, Validation Accuracy:  0.502, Loss:  2.453\n",
      "Epoch   0 Batch  139/538 - Train Accuracy:  0.451, Validation Accuracy:  0.509, Loss:  2.547\n",
      "Epoch   0 Batch  140/538 - Train Accuracy:  0.442, Validation Accuracy:  0.503, Loss:  2.520\n",
      "Epoch   0 Batch  141/538 - Train Accuracy:  0.465, Validation Accuracy:  0.508, Loss:  2.521\n",
      "Epoch   0 Batch  142/538 - Train Accuracy:  0.497, Validation Accuracy:  0.501, Loss:  2.360\n",
      "Epoch   0 Batch  143/538 - Train Accuracy:  0.449, Validation Accuracy:  0.507, Loss:  2.461\n",
      "Epoch   0 Batch  144/538 - Train Accuracy:  0.458, Validation Accuracy:  0.500, Loss:  2.462\n",
      "Epoch   0 Batch  145/538 - Train Accuracy:  0.477, Validation Accuracy:  0.510, Loss:  2.405\n",
      "Epoch   0 Batch  146/538 - Train Accuracy:  0.492, Validation Accuracy:  0.518, Loss:  2.303\n",
      "Epoch   0 Batch  147/538 - Train Accuracy:  0.501, Validation Accuracy:  0.517, Loss:  2.353\n",
      "Epoch   0 Batch  148/538 - Train Accuracy:  0.459, Validation Accuracy:  0.515, Loss:  2.481\n",
      "Epoch   0 Batch  149/538 - Train Accuracy:  0.490, Validation Accuracy:  0.526, Loss:  2.387\n",
      "Epoch   0 Batch  150/538 - Train Accuracy:  0.490, Validation Accuracy:  0.526, Loss:  2.430\n",
      "Epoch   0 Batch  151/538 - Train Accuracy:  0.474, Validation Accuracy:  0.519, Loss:  2.379\n",
      "Epoch   0 Batch  152/538 - Train Accuracy:  0.474, Validation Accuracy:  0.507, Loss:  2.363\n",
      "Epoch   0 Batch  153/538 - Train Accuracy:  0.477, Validation Accuracy:  0.510, Loss:  2.446\n",
      "Epoch   0 Batch  154/538 - Train Accuracy:  0.458, Validation Accuracy:  0.483, Loss:  2.495\n",
      "Epoch   0 Batch  155/538 - Train Accuracy:  0.483, Validation Accuracy:  0.492, Loss:  2.609\n",
      "Epoch   0 Batch  156/538 - Train Accuracy:  0.447, Validation Accuracy:  0.487, Loss:  2.533\n",
      "Epoch   0 Batch  157/538 - Train Accuracy:  0.439, Validation Accuracy:  0.466, Loss:  2.380\n",
      "Epoch   0 Batch  158/538 - Train Accuracy:  0.465, Validation Accuracy:  0.508, Loss:  2.550\n",
      "Epoch   0 Batch  159/538 - Train Accuracy:  0.461, Validation Accuracy:  0.507, Loss:  2.445\n",
      "Epoch   0 Batch  160/538 - Train Accuracy:  0.466, Validation Accuracy:  0.507, Loss:  2.367\n",
      "Epoch   0 Batch  161/538 - Train Accuracy:  0.439, Validation Accuracy:  0.499, Loss:  2.442\n",
      "Epoch   0 Batch  162/538 - Train Accuracy:  0.513, Validation Accuracy:  0.528, Loss:  2.303\n",
      "Epoch   0 Batch  163/538 - Train Accuracy:  0.488, Validation Accuracy:  0.517, Loss:  2.383\n",
      "Epoch   0 Batch  164/538 - Train Accuracy:  0.443, Validation Accuracy:  0.485, Loss:  2.432\n",
      "Epoch   0 Batch  165/538 - Train Accuracy:  0.463, Validation Accuracy:  0.485, Loss:  2.314\n",
      "Epoch   0 Batch  166/538 - Train Accuracy:  0.493, Validation Accuracy:  0.518, Loss:  2.374\n",
      "Epoch   0 Batch  167/538 - Train Accuracy:  0.508, Validation Accuracy:  0.513, Loss:  2.280\n",
      "Epoch   0 Batch  168/538 - Train Accuracy:  0.467, Validation Accuracy:  0.508, Loss:  2.418\n",
      "Epoch   0 Batch  169/538 - Train Accuracy:  0.462, Validation Accuracy:  0.498, Loss:  2.343\n",
      "Epoch   0 Batch  170/538 - Train Accuracy:  0.491, Validation Accuracy:  0.517, Loss:  2.354\n",
      "Epoch   0 Batch  171/538 - Train Accuracy:  0.459, Validation Accuracy:  0.520, Loss:  2.376\n",
      "Epoch   0 Batch  172/538 - Train Accuracy:  0.479, Validation Accuracy:  0.520, Loss:  2.343\n",
      "Epoch   0 Batch  173/538 - Train Accuracy:  0.480, Validation Accuracy:  0.510, Loss:  2.292\n",
      "Epoch   0 Batch  174/538 - Train Accuracy:  0.444, Validation Accuracy:  0.510, Loss:  2.408\n",
      "Epoch   0 Batch  175/538 - Train Accuracy:  0.440, Validation Accuracy:  0.519, Loss:  2.360\n",
      "Epoch   0 Batch  176/538 - Train Accuracy:  0.456, Validation Accuracy:  0.515, Loss:  2.327\n",
      "Epoch   0 Batch  177/538 - Train Accuracy:  0.487, Validation Accuracy:  0.517, Loss:  2.315\n",
      "Epoch   0 Batch  178/538 - Train Accuracy:  0.503, Validation Accuracy:  0.508, Loss:  2.192\n",
      "Epoch   0 Batch  179/538 - Train Accuracy:  0.478, Validation Accuracy:  0.510, Loss:  2.295\n",
      "Epoch   0 Batch  180/538 - Train Accuracy:  0.510, Validation Accuracy:  0.517, Loss:  2.261\n",
      "Epoch   0 Batch  181/538 - Train Accuracy:  0.454, Validation Accuracy:  0.521, Loss:  2.303\n",
      "Epoch   0 Batch  182/538 - Train Accuracy:  0.425, Validation Accuracy:  0.499, Loss:  2.303\n",
      "Epoch   0 Batch  183/538 - Train Accuracy:  0.472, Validation Accuracy:  0.497, Loss:  2.233\n",
      "Epoch   0 Batch  184/538 - Train Accuracy:  0.476, Validation Accuracy:  0.518, Loss:  2.252\n",
      "Epoch   0 Batch  185/538 - Train Accuracy:  0.479, Validation Accuracy:  0.524, Loss:  2.255\n",
      "Epoch   0 Batch  186/538 - Train Accuracy:  0.484, Validation Accuracy:  0.520, Loss:  2.266\n",
      "Epoch   0 Batch  187/538 - Train Accuracy:  0.515, Validation Accuracy:  0.520, Loss:  2.181\n",
      "Epoch   0 Batch  188/538 - Train Accuracy:  0.476, Validation Accuracy:  0.525, Loss:  2.269\n",
      "Epoch   0 Batch  189/538 - Train Accuracy:  0.471, Validation Accuracy:  0.524, Loss:  2.284\n",
      "Epoch   0 Batch  190/538 - Train Accuracy:  0.489, Validation Accuracy:  0.517, Loss:  2.249\n",
      "Epoch   0 Batch  191/538 - Train Accuracy:  0.496, Validation Accuracy:  0.523, Loss:  2.155\n",
      "Epoch   0 Batch  192/538 - Train Accuracy:  0.487, Validation Accuracy:  0.526, Loss:  2.180\n",
      "Epoch   0 Batch  193/538 - Train Accuracy:  0.509, Validation Accuracy:  0.531, Loss:  2.161\n",
      "Epoch   0 Batch  194/538 - Train Accuracy:  0.469, Validation Accuracy:  0.529, Loss:  2.250\n",
      "Epoch   0 Batch  195/538 - Train Accuracy:  0.501, Validation Accuracy:  0.527, Loss:  2.248\n",
      "Epoch   0 Batch  196/538 - Train Accuracy:  0.486, Validation Accuracy:  0.531, Loss:  2.162\n",
      "Epoch   0 Batch  197/538 - Train Accuracy:  0.501, Validation Accuracy:  0.522, Loss:  2.185\n",
      "Epoch   0 Batch  198/538 - Train Accuracy:  0.524, Validation Accuracy:  0.536, Loss:  2.166\n",
      "Epoch   0 Batch  199/538 - Train Accuracy:  0.469, Validation Accuracy:  0.525, Loss:  2.236\n",
      "Epoch   0 Batch  200/538 - Train Accuracy:  0.483, Validation Accuracy:  0.513, Loss:  2.197\n",
      "Epoch   0 Batch  201/538 - Train Accuracy:  0.503, Validation Accuracy:  0.507, Loss:  2.241\n",
      "Epoch   0 Batch  202/538 - Train Accuracy:  0.453, Validation Accuracy:  0.508, Loss:  2.238\n",
      "Epoch   0 Batch  203/538 - Train Accuracy:  0.476, Validation Accuracy:  0.509, Loss:  2.241\n",
      "Epoch   0 Batch  204/538 - Train Accuracy:  0.464, Validation Accuracy:  0.515, Loss:  2.193\n",
      "Epoch   0 Batch  205/538 - Train Accuracy:  0.506, Validation Accuracy:  0.513, Loss:  2.150\n",
      "Epoch   0 Batch  206/538 - Train Accuracy:  0.458, Validation Accuracy:  0.504, Loss:  2.201\n",
      "Epoch   0 Batch  207/538 - Train Accuracy:  0.502, Validation Accuracy:  0.511, Loss:  2.146\n",
      "Epoch   0 Batch  208/538 - Train Accuracy:  0.468, Validation Accuracy:  0.508, Loss:  2.194\n",
      "Epoch   0 Batch  209/538 - Train Accuracy:  0.469, Validation Accuracy:  0.518, Loss:  2.242\n",
      "Epoch   0 Batch  210/538 - Train Accuracy:  0.495, Validation Accuracy:  0.523, Loss:  2.133\n",
      "Epoch   0 Batch  211/538 - Train Accuracy:  0.478, Validation Accuracy:  0.531, Loss:  2.214\n",
      "Epoch   0 Batch  212/538 - Train Accuracy:  0.501, Validation Accuracy:  0.520, Loss:  2.161\n",
      "Epoch   0 Batch  213/538 - Train Accuracy:  0.483, Validation Accuracy:  0.525, Loss:  2.169\n",
      "Epoch   0 Batch  214/538 - Train Accuracy:  0.505, Validation Accuracy:  0.551, Loss:  2.185\n",
      "Epoch   0 Batch  215/538 - Train Accuracy:  0.508, Validation Accuracy:  0.535, Loss:  2.202\n",
      "Epoch   0 Batch  216/538 - Train Accuracy:  0.458, Validation Accuracy:  0.543, Loss:  2.172\n",
      "Epoch   0 Batch  217/538 - Train Accuracy:  0.526, Validation Accuracy:  0.537, Loss:  2.108\n",
      "Epoch   0 Batch  218/538 - Train Accuracy:  0.444, Validation Accuracy:  0.514, Loss:  2.098\n",
      "Epoch   0 Batch  219/538 - Train Accuracy:  0.471, Validation Accuracy:  0.515, Loss:  2.188\n",
      "Epoch   0 Batch  220/538 - Train Accuracy:  0.486, Validation Accuracy:  0.527, Loss:  2.067\n",
      "Epoch   0 Batch  221/538 - Train Accuracy:  0.516, Validation Accuracy:  0.517, Loss:  2.149\n",
      "Epoch   0 Batch  222/538 - Train Accuracy:  0.490, Validation Accuracy:  0.517, Loss:  2.117\n",
      "Epoch   0 Batch  223/538 - Train Accuracy:  0.484, Validation Accuracy:  0.525, Loss:  2.154\n",
      "Epoch   0 Batch  224/538 - Train Accuracy:  0.462, Validation Accuracy:  0.519, Loss:  2.154\n",
      "Epoch   0 Batch  225/538 - Train Accuracy:  0.511, Validation Accuracy:  0.506, Loss:  2.096\n",
      "Epoch   0 Batch  226/538 - Train Accuracy:  0.496, Validation Accuracy:  0.501, Loss:  2.070\n",
      "Epoch   0 Batch  227/538 - Train Accuracy:  0.510, Validation Accuracy:  0.505, Loss:  2.080\n",
      "Epoch   0 Batch  228/538 - Train Accuracy:  0.490, Validation Accuracy:  0.508, Loss:  2.090\n",
      "Epoch   0 Batch  229/538 - Train Accuracy:  0.481, Validation Accuracy:  0.516, Loss:  2.083\n",
      "Epoch   0 Batch  230/538 - Train Accuracy:  0.493, Validation Accuracy:  0.517, Loss:  2.146\n",
      "Epoch   0 Batch  231/538 - Train Accuracy:  0.490, Validation Accuracy:  0.523, Loss:  2.062\n",
      "Epoch   0 Batch  232/538 - Train Accuracy:  0.474, Validation Accuracy:  0.519, Loss:  2.107\n",
      "Epoch   0 Batch  233/538 - Train Accuracy:  0.514, Validation Accuracy:  0.520, Loss:  2.077\n",
      "Epoch   0 Batch  234/538 - Train Accuracy:  0.464, Validation Accuracy:  0.519, Loss:  2.087\n",
      "Epoch   0 Batch  235/538 - Train Accuracy:  0.489, Validation Accuracy:  0.529, Loss:  2.045\n",
      "Epoch   0 Batch  236/538 - Train Accuracy:  0.475, Validation Accuracy:  0.532, Loss:  2.089\n",
      "Epoch   0 Batch  237/538 - Train Accuracy:  0.494, Validation Accuracy:  0.526, Loss:  2.116\n",
      "Epoch   0 Batch  238/538 - Train Accuracy:  0.510, Validation Accuracy:  0.522, Loss:  2.028\n",
      "Epoch   0 Batch  239/538 - Train Accuracy:  0.485, Validation Accuracy:  0.527, Loss:  2.085\n",
      "Epoch   0 Batch  240/538 - Train Accuracy:  0.486, Validation Accuracy:  0.517, Loss:  2.108\n",
      "Epoch   0 Batch  241/538 - Train Accuracy:  0.484, Validation Accuracy:  0.520, Loss:  2.124\n",
      "Epoch   0 Batch  242/538 - Train Accuracy:  0.489, Validation Accuracy:  0.525, Loss:  2.098\n",
      "Epoch   0 Batch  243/538 - Train Accuracy:  0.464, Validation Accuracy:  0.534, Loss:  2.154\n",
      "Epoch   0 Batch  244/538 - Train Accuracy:  0.516, Validation Accuracy:  0.537, Loss:  2.056\n",
      "Epoch   0 Batch  245/538 - Train Accuracy:  0.500, Validation Accuracy:  0.535, Loss:  2.074\n",
      "Epoch   0 Batch  246/538 - Train Accuracy:  0.537, Validation Accuracy:  0.527, Loss:  2.013\n",
      "Epoch   0 Batch  247/538 - Train Accuracy:  0.476, Validation Accuracy:  0.525, Loss:  2.093\n",
      "Epoch   0 Batch  248/538 - Train Accuracy:  0.500, Validation Accuracy:  0.522, Loss:  2.053\n",
      "Epoch   0 Batch  249/538 - Train Accuracy:  0.477, Validation Accuracy:  0.510, Loss:  1.998\n",
      "Epoch   0 Batch  250/538 - Train Accuracy:  0.473, Validation Accuracy:  0.527, Loss:  2.067\n",
      "Epoch   0 Batch  251/538 - Train Accuracy:  0.475, Validation Accuracy:  0.532, Loss:  2.108\n",
      "Epoch   0 Batch  252/538 - Train Accuracy:  0.499, Validation Accuracy:  0.535, Loss:  2.056\n",
      "Epoch   0 Batch  253/538 - Train Accuracy:  0.511, Validation Accuracy:  0.520, Loss:  2.023\n",
      "Epoch   0 Batch  254/538 - Train Accuracy:  0.486, Validation Accuracy:  0.528, Loss:  2.039\n",
      "Epoch   0 Batch  255/538 - Train Accuracy:  0.491, Validation Accuracy:  0.527, Loss:  2.062\n",
      "Epoch   0 Batch  256/538 - Train Accuracy:  0.509, Validation Accuracy:  0.528, Loss:  2.075\n",
      "Epoch   0 Batch  257/538 - Train Accuracy:  0.513, Validation Accuracy:  0.523, Loss:  2.035\n",
      "Epoch   0 Batch  258/538 - Train Accuracy:  0.514, Validation Accuracy:  0.520, Loss:  2.068\n",
      "Epoch   0 Batch  259/538 - Train Accuracy:  0.517, Validation Accuracy:  0.524, Loss:  2.017\n",
      "Epoch   0 Batch  260/538 - Train Accuracy:  0.495, Validation Accuracy:  0.522, Loss:  2.076\n",
      "Epoch   0 Batch  261/538 - Train Accuracy:  0.469, Validation Accuracy:  0.509, Loss:  2.104\n",
      "Epoch   0 Batch  262/538 - Train Accuracy:  0.488, Validation Accuracy:  0.523, Loss:  2.118\n",
      "Epoch   0 Batch  263/538 - Train Accuracy:  0.497, Validation Accuracy:  0.519, Loss:  2.070\n",
      "Epoch   0 Batch  264/538 - Train Accuracy:  0.485, Validation Accuracy:  0.522, Loss:  2.036\n",
      "Epoch   0 Batch  265/538 - Train Accuracy:  0.471, Validation Accuracy:  0.522, Loss:  2.053\n",
      "Epoch   0 Batch  266/538 - Train Accuracy:  0.529, Validation Accuracy:  0.531, Loss:  2.020\n",
      "Epoch   0 Batch  267/538 - Train Accuracy:  0.467, Validation Accuracy:  0.525, Loss:  2.009\n",
      "Epoch   0 Batch  268/538 - Train Accuracy:  0.514, Validation Accuracy:  0.526, Loss:  1.951\n",
      "Epoch   0 Batch  269/538 - Train Accuracy:  0.483, Validation Accuracy:  0.523, Loss:  2.079\n",
      "Epoch   0 Batch  270/538 - Train Accuracy:  0.487, Validation Accuracy:  0.528, Loss:  2.042\n",
      "Epoch   0 Batch  271/538 - Train Accuracy:  0.467, Validation Accuracy:  0.525, Loss:  2.027\n",
      "Epoch   0 Batch  272/538 - Train Accuracy:  0.488, Validation Accuracy:  0.526, Loss:  2.058\n",
      "Epoch   0 Batch  273/538 - Train Accuracy:  0.477, Validation Accuracy:  0.518, Loss:  2.071\n",
      "Epoch   0 Batch  274/538 - Train Accuracy:  0.450, Validation Accuracy:  0.522, Loss:  2.036\n",
      "Epoch   0 Batch  275/538 - Train Accuracy:  0.487, Validation Accuracy:  0.517, Loss:  2.027\n",
      "Epoch   0 Batch  276/538 - Train Accuracy:  0.499, Validation Accuracy:  0.517, Loss:  2.013\n",
      "Epoch   0 Batch  277/538 - Train Accuracy:  0.478, Validation Accuracy:  0.517, Loss:  2.004\n",
      "Epoch   0 Batch  278/538 - Train Accuracy:  0.493, Validation Accuracy:  0.518, Loss:  2.009\n",
      "Epoch   0 Batch  279/538 - Train Accuracy:  0.505, Validation Accuracy:  0.525, Loss:  2.036\n",
      "Epoch   0 Batch  280/538 - Train Accuracy:  0.522, Validation Accuracy:  0.530, Loss:  1.972\n",
      "Epoch   0 Batch  281/538 - Train Accuracy:  0.501, Validation Accuracy:  0.523, Loss:  2.005\n",
      "Epoch   0 Batch  282/538 - Train Accuracy:  0.525, Validation Accuracy:  0.539, Loss:  1.995\n",
      "Epoch   0 Batch  283/538 - Train Accuracy:  0.512, Validation Accuracy:  0.547, Loss:  2.004\n",
      "Epoch   0 Batch  284/538 - Train Accuracy:  0.512, Validation Accuracy:  0.525, Loss:  2.026\n",
      "Epoch   0 Batch  285/538 - Train Accuracy:  0.507, Validation Accuracy:  0.523, Loss:  1.938\n",
      "Epoch   0 Batch  286/538 - Train Accuracy:  0.482, Validation Accuracy:  0.516, Loss:  1.918\n",
      "Epoch   0 Batch  287/538 - Train Accuracy:  0.528, Validation Accuracy:  0.526, Loss:  1.965\n",
      "Epoch   0 Batch  288/538 - Train Accuracy:  0.496, Validation Accuracy:  0.536, Loss:  2.026\n",
      "Epoch   0 Batch  289/538 - Train Accuracy:  0.559, Validation Accuracy:  0.550, Loss:  1.922\n",
      "Epoch   0 Batch  290/538 - Train Accuracy:  0.503, Validation Accuracy:  0.530, Loss:  1.994\n",
      "Epoch   0 Batch  291/538 - Train Accuracy:  0.512, Validation Accuracy:  0.526, Loss:  2.003\n",
      "Epoch   0 Batch  292/538 - Train Accuracy:  0.516, Validation Accuracy:  0.528, Loss:  1.977\n",
      "Epoch   0 Batch  293/538 - Train Accuracy:  0.510, Validation Accuracy:  0.523, Loss:  1.953\n",
      "Epoch   0 Batch  294/538 - Train Accuracy:  0.469, Validation Accuracy:  0.518, Loss:  1.992\n",
      "Epoch   0 Batch  295/538 - Train Accuracy:  0.528, Validation Accuracy:  0.536, Loss:  1.887\n",
      "Epoch   0 Batch  296/538 - Train Accuracy:  0.522, Validation Accuracy:  0.542, Loss:  1.989\n",
      "Epoch   0 Batch  297/538 - Train Accuracy:  0.474, Validation Accuracy:  0.536, Loss:  2.000\n",
      "Epoch   0 Batch  298/538 - Train Accuracy:  0.534, Validation Accuracy:  0.557, Loss:  1.980\n",
      "Epoch   0 Batch  299/538 - Train Accuracy:  0.523, Validation Accuracy:  0.550, Loss:  1.929\n",
      "Epoch   0 Batch  300/538 - Train Accuracy:  0.532, Validation Accuracy:  0.530, Loss:  1.973\n",
      "Epoch   0 Batch  301/538 - Train Accuracy:  0.509, Validation Accuracy:  0.522, Loss:  1.951\n",
      "Epoch   0 Batch  302/538 - Train Accuracy:  0.524, Validation Accuracy:  0.526, Loss:  1.926\n",
      "Epoch   0 Batch  303/538 - Train Accuracy:  0.549, Validation Accuracy:  0.524, Loss:  1.902\n",
      "Epoch   0 Batch  304/538 - Train Accuracy:  0.506, Validation Accuracy:  0.524, Loss:  1.959\n",
      "Epoch   0 Batch  305/538 - Train Accuracy:  0.511, Validation Accuracy:  0.525, Loss:  1.897\n",
      "Epoch   0 Batch  306/538 - Train Accuracy:  0.518, Validation Accuracy:  0.530, Loss:  1.979\n",
      "Epoch   0 Batch  307/538 - Train Accuracy:  0.509, Validation Accuracy:  0.539, Loss:  1.948\n",
      "Epoch   0 Batch  308/538 - Train Accuracy:  0.535, Validation Accuracy:  0.534, Loss:  1.970\n",
      "Epoch   0 Batch  309/538 - Train Accuracy:  0.487, Validation Accuracy:  0.526, Loss:  1.996\n",
      "Epoch   0 Batch  310/538 - Train Accuracy:  0.507, Validation Accuracy:  0.538, Loss:  1.941\n",
      "Epoch   0 Batch  311/538 - Train Accuracy:  0.522, Validation Accuracy:  0.532, Loss:  1.919\n",
      "Epoch   0 Batch  312/538 - Train Accuracy:  0.579, Validation Accuracy:  0.540, Loss:  1.889\n",
      "Epoch   0 Batch  313/538 - Train Accuracy:  0.491, Validation Accuracy:  0.543, Loss:  1.944\n",
      "Epoch   0 Batch  314/538 - Train Accuracy:  0.525, Validation Accuracy:  0.542, Loss:  1.952\n",
      "Epoch   0 Batch  315/538 - Train Accuracy:  0.519, Validation Accuracy:  0.545, Loss:  1.941\n",
      "Epoch   0 Batch  316/538 - Train Accuracy:  0.517, Validation Accuracy:  0.547, Loss:  1.913\n",
      "Epoch   0 Batch  317/538 - Train Accuracy:  0.490, Validation Accuracy:  0.552, Loss:  2.017\n",
      "Epoch   0 Batch  318/538 - Train Accuracy:  0.507, Validation Accuracy:  0.551, Loss:  1.959\n",
      "Epoch   0 Batch  319/538 - Train Accuracy:  0.555, Validation Accuracy:  0.553, Loss:  1.959\n",
      "Epoch   0 Batch  320/538 - Train Accuracy:  0.557, Validation Accuracy:  0.544, Loss:  1.978\n",
      "Epoch   0 Batch  321/538 - Train Accuracy:  0.522, Validation Accuracy:  0.533, Loss:  1.919\n",
      "Epoch   0 Batch  322/538 - Train Accuracy:  0.554, Validation Accuracy:  0.525, Loss:  1.925\n",
      "Epoch   0 Batch  323/538 - Train Accuracy:  0.532, Validation Accuracy:  0.522, Loss:  1.908\n",
      "Epoch   0 Batch  324/538 - Train Accuracy:  0.479, Validation Accuracy:  0.520, Loss:  1.962\n",
      "Epoch   0 Batch  325/538 - Train Accuracy:  0.503, Validation Accuracy:  0.528, Loss:  1.927\n",
      "Epoch   0 Batch  326/538 - Train Accuracy:  0.503, Validation Accuracy:  0.528, Loss:  1.931\n",
      "Epoch   0 Batch  327/538 - Train Accuracy:  0.510, Validation Accuracy:  0.532, Loss:  1.944\n",
      "Epoch   0 Batch  328/538 - Train Accuracy:  0.539, Validation Accuracy:  0.541, Loss:  1.900\n",
      "Epoch   0 Batch  329/538 - Train Accuracy:  0.555, Validation Accuracy:  0.545, Loss:  1.853\n",
      "Epoch   0 Batch  330/538 - Train Accuracy:  0.536, Validation Accuracy:  0.537, Loss:  1.975\n",
      "Epoch   0 Batch  331/538 - Train Accuracy:  0.528, Validation Accuracy:  0.545, Loss:  1.922\n",
      "Epoch   0 Batch  332/538 - Train Accuracy:  0.497, Validation Accuracy:  0.547, Loss:  1.942\n",
      "Epoch   0 Batch  333/538 - Train Accuracy:  0.536, Validation Accuracy:  0.540, Loss:  1.913\n",
      "Epoch   0 Batch  334/538 - Train Accuracy:  0.561, Validation Accuracy:  0.537, Loss:  1.844\n",
      "Epoch   0 Batch  335/538 - Train Accuracy:  0.526, Validation Accuracy:  0.537, Loss:  1.926\n",
      "Epoch   0 Batch  336/538 - Train Accuracy:  0.533, Validation Accuracy:  0.537, Loss:  1.901\n",
      "Epoch   0 Batch  337/538 - Train Accuracy:  0.537, Validation Accuracy:  0.535, Loss:  1.911\n",
      "Epoch   0 Batch  338/538 - Train Accuracy:  0.515, Validation Accuracy:  0.531, Loss:  1.900\n",
      "Epoch   0 Batch  339/538 - Train Accuracy:  0.527, Validation Accuracy:  0.526, Loss:  1.886\n",
      "Epoch   0 Batch  340/538 - Train Accuracy:  0.497, Validation Accuracy:  0.535, Loss:  1.960\n",
      "Epoch   0 Batch  341/538 - Train Accuracy:  0.520, Validation Accuracy:  0.547, Loss:  1.911\n",
      "Epoch   0 Batch  342/538 - Train Accuracy:  0.540, Validation Accuracy:  0.548, Loss:  1.904\n",
      "Epoch   0 Batch  343/538 - Train Accuracy:  0.543, Validation Accuracy:  0.546, Loss:  1.910\n",
      "Epoch   0 Batch  344/538 - Train Accuracy:  0.523, Validation Accuracy:  0.553, Loss:  1.943\n",
      "Epoch   0 Batch  345/538 - Train Accuracy:  0.537, Validation Accuracy:  0.548, Loss:  1.907\n",
      "Epoch   0 Batch  346/538 - Train Accuracy:  0.539, Validation Accuracy:  0.552, Loss:  1.863\n",
      "Epoch   0 Batch  347/538 - Train Accuracy:  0.496, Validation Accuracy:  0.546, Loss:  1.893\n",
      "Epoch   0 Batch  348/538 - Train Accuracy:  0.522, Validation Accuracy:  0.515, Loss:  1.903\n",
      "Epoch   0 Batch  349/538 - Train Accuracy:  0.501, Validation Accuracy:  0.541, Loss:  1.928\n",
      "Epoch   0 Batch  350/538 - Train Accuracy:  0.544, Validation Accuracy:  0.542, Loss:  1.913\n",
      "Epoch   0 Batch  351/538 - Train Accuracy:  0.513, Validation Accuracy:  0.536, Loss:  1.962\n",
      "Epoch   0 Batch  352/538 - Train Accuracy:  0.531, Validation Accuracy:  0.525, Loss:  1.923\n",
      "Epoch   0 Batch  353/538 - Train Accuracy:  0.494, Validation Accuracy:  0.520, Loss:  1.939\n",
      "Epoch   0 Batch  354/538 - Train Accuracy:  0.505, Validation Accuracy:  0.516, Loss:  1.845\n",
      "Epoch   0 Batch  355/538 - Train Accuracy:  0.481, Validation Accuracy:  0.521, Loss:  1.975\n",
      "Epoch   0 Batch  356/538 - Train Accuracy:  0.523, Validation Accuracy:  0.524, Loss:  1.879\n",
      "Epoch   0 Batch  357/538 - Train Accuracy:  0.553, Validation Accuracy:  0.521, Loss:  1.937\n",
      "Epoch   0 Batch  358/538 - Train Accuracy:  0.489, Validation Accuracy:  0.526, Loss:  1.946\n",
      "Epoch   0 Batch  359/538 - Train Accuracy:  0.540, Validation Accuracy:  0.530, Loss:  1.908\n",
      "Epoch   0 Batch  360/538 - Train Accuracy:  0.513, Validation Accuracy:  0.529, Loss:  1.907\n",
      "Epoch   0 Batch  361/538 - Train Accuracy:  0.551, Validation Accuracy:  0.541, Loss:  1.849\n",
      "Epoch   0 Batch  362/538 - Train Accuracy:  0.531, Validation Accuracy:  0.546, Loss:  1.817\n",
      "Epoch   0 Batch  363/538 - Train Accuracy:  0.578, Validation Accuracy:  0.556, Loss:  1.869\n",
      "Epoch   0 Batch  364/538 - Train Accuracy:  0.508, Validation Accuracy:  0.557, Loss:  1.919\n",
      "Epoch   0 Batch  365/538 - Train Accuracy:  0.562, Validation Accuracy:  0.558, Loss:  1.885\n",
      "Epoch   0 Batch  366/538 - Train Accuracy:  0.533, Validation Accuracy:  0.555, Loss:  1.914\n",
      "Epoch   0 Batch  367/538 - Train Accuracy:  0.510, Validation Accuracy:  0.540, Loss:  1.906\n",
      "Epoch   0 Batch  368/538 - Train Accuracy:  0.576, Validation Accuracy:  0.535, Loss:  1.806\n",
      "Epoch   0 Batch  369/538 - Train Accuracy:  0.506, Validation Accuracy:  0.525, Loss:  1.863\n",
      "Epoch   0 Batch  370/538 - Train Accuracy:  0.462, Validation Accuracy:  0.520, Loss:  1.888\n",
      "Epoch   0 Batch  371/538 - Train Accuracy:  0.515, Validation Accuracy:  0.521, Loss:  1.869\n",
      "Epoch   0 Batch  372/538 - Train Accuracy:  0.496, Validation Accuracy:  0.531, Loss:  1.942\n",
      "Epoch   0 Batch  373/538 - Train Accuracy:  0.522, Validation Accuracy:  0.552, Loss:  1.892\n",
      "Epoch   0 Batch  374/538 - Train Accuracy:  0.520, Validation Accuracy:  0.556, Loss:  1.940\n",
      "Epoch   0 Batch  375/538 - Train Accuracy:  0.534, Validation Accuracy:  0.542, Loss:  1.798\n",
      "Epoch   0 Batch  376/538 - Train Accuracy:  0.519, Validation Accuracy:  0.536, Loss:  1.896\n",
      "Epoch   0 Batch  377/538 - Train Accuracy:  0.507, Validation Accuracy:  0.536, Loss:  1.865\n",
      "Epoch   0 Batch  378/538 - Train Accuracy:  0.551, Validation Accuracy:  0.534, Loss:  1.853\n",
      "Epoch   0 Batch  379/538 - Train Accuracy:  0.547, Validation Accuracy:  0.529, Loss:  1.845\n",
      "Epoch   0 Batch  380/538 - Train Accuracy:  0.527, Validation Accuracy:  0.530, Loss:  1.876\n",
      "Epoch   0 Batch  381/538 - Train Accuracy:  0.540, Validation Accuracy:  0.537, Loss:  1.901\n",
      "Epoch   0 Batch  382/538 - Train Accuracy:  0.509, Validation Accuracy:  0.523, Loss:  1.900\n",
      "Epoch   0 Batch  383/538 - Train Accuracy:  0.523, Validation Accuracy:  0.520, Loss:  1.869\n",
      "Epoch   0 Batch  384/538 - Train Accuracy:  0.541, Validation Accuracy:  0.534, Loss:  1.815\n",
      "Epoch   0 Batch  385/538 - Train Accuracy:  0.554, Validation Accuracy:  0.528, Loss:  1.872\n",
      "Epoch   0 Batch  386/538 - Train Accuracy:  0.512, Validation Accuracy:  0.532, Loss:  1.901\n",
      "Epoch   0 Batch  387/538 - Train Accuracy:  0.510, Validation Accuracy:  0.530, Loss:  1.855\n",
      "Epoch   0 Batch  388/538 - Train Accuracy:  0.536, Validation Accuracy:  0.542, Loss:  1.861\n",
      "Epoch   0 Batch  389/538 - Train Accuracy:  0.517, Validation Accuracy:  0.542, Loss:  1.915\n",
      "Epoch   0 Batch  390/538 - Train Accuracy:  0.535, Validation Accuracy:  0.540, Loss:  1.838\n",
      "Epoch   0 Batch  391/538 - Train Accuracy:  0.553, Validation Accuracy:  0.542, Loss:  1.883\n",
      "Epoch   0 Batch  392/538 - Train Accuracy:  0.530, Validation Accuracy:  0.542, Loss:  1.834\n",
      "Epoch   0 Batch  393/538 - Train Accuracy:  0.539, Validation Accuracy:  0.534, Loss:  1.831\n",
      "Epoch   0 Batch  394/538 - Train Accuracy:  0.464, Validation Accuracy:  0.518, Loss:  1.897\n",
      "Epoch   0 Batch  395/538 - Train Accuracy:  0.511, Validation Accuracy:  0.521, Loss:  1.927\n",
      "Epoch   0 Batch  396/538 - Train Accuracy:  0.525, Validation Accuracy:  0.533, Loss:  1.902\n",
      "Epoch   0 Batch  397/538 - Train Accuracy:  0.524, Validation Accuracy:  0.527, Loss:  1.916\n",
      "Epoch   0 Batch  398/538 - Train Accuracy:  0.516, Validation Accuracy:  0.549, Loss:  1.883\n",
      "Epoch   0 Batch  399/538 - Train Accuracy:  0.521, Validation Accuracy:  0.552, Loss:  1.969\n",
      "Epoch   0 Batch  400/538 - Train Accuracy:  0.531, Validation Accuracy:  0.533, Loss:  1.883\n",
      "Epoch   0 Batch  401/538 - Train Accuracy:  0.518, Validation Accuracy:  0.544, Loss:  1.941\n",
      "Epoch   0 Batch  402/538 - Train Accuracy:  0.548, Validation Accuracy:  0.544, Loss:  1.878\n",
      "Epoch   0 Batch  403/538 - Train Accuracy:  0.546, Validation Accuracy:  0.549, Loss:  1.872\n",
      "Epoch   0 Batch  404/538 - Train Accuracy:  0.574, Validation Accuracy:  0.573, Loss:  1.826\n",
      "Epoch   0 Batch  405/538 - Train Accuracy:  0.554, Validation Accuracy:  0.574, Loss:  1.858\n",
      "Epoch   0 Batch  406/538 - Train Accuracy:  0.555, Validation Accuracy:  0.549, Loss:  1.836\n",
      "Epoch   0 Batch  407/538 - Train Accuracy:  0.543, Validation Accuracy:  0.548, Loss:  1.837\n",
      "Epoch   0 Batch  408/538 - Train Accuracy:  0.488, Validation Accuracy:  0.547, Loss:  1.917\n",
      "Epoch   0 Batch  409/538 - Train Accuracy:  0.533, Validation Accuracy:  0.549, Loss:  1.859\n",
      "Epoch   0 Batch  410/538 - Train Accuracy:  0.532, Validation Accuracy:  0.549, Loss:  1.910\n",
      "Epoch   0 Batch  411/538 - Train Accuracy:  0.558, Validation Accuracy:  0.562, Loss:  1.823\n",
      "Epoch   0 Batch  412/538 - Train Accuracy:  0.566, Validation Accuracy:  0.566, Loss:  1.790\n",
      "Epoch   0 Batch  413/538 - Train Accuracy:  0.541, Validation Accuracy:  0.566, Loss:  1.829\n",
      "Epoch   0 Batch  414/538 - Train Accuracy:  0.526, Validation Accuracy:  0.555, Loss:  1.868\n",
      "Epoch   0 Batch  415/538 - Train Accuracy:  0.524, Validation Accuracy:  0.537, Loss:  1.845\n",
      "Epoch   0 Batch  416/538 - Train Accuracy:  0.557, Validation Accuracy:  0.539, Loss:  1.791\n",
      "Epoch   0 Batch  417/538 - Train Accuracy:  0.519, Validation Accuracy:  0.537, Loss:  1.888\n",
      "Epoch   0 Batch  418/538 - Train Accuracy:  0.515, Validation Accuracy:  0.542, Loss:  1.870\n",
      "Epoch   0 Batch  419/538 - Train Accuracy:  0.552, Validation Accuracy:  0.543, Loss:  1.821\n",
      "Epoch   0 Batch  420/538 - Train Accuracy:  0.545, Validation Accuracy:  0.539, Loss:  1.817\n",
      "Epoch   0 Batch  421/538 - Train Accuracy:  0.560, Validation Accuracy:  0.547, Loss:  1.757\n",
      "Epoch   0 Batch  422/538 - Train Accuracy:  0.535, Validation Accuracy:  0.541, Loss:  1.857\n",
      "Epoch   0 Batch  423/538 - Train Accuracy:  0.535, Validation Accuracy:  0.542, Loss:  1.879\n",
      "Epoch   0 Batch  424/538 - Train Accuracy:  0.527, Validation Accuracy:  0.546, Loss:  1.832\n",
      "Epoch   0 Batch  425/538 - Train Accuracy:  0.542, Validation Accuracy:  0.555, Loss:  1.800\n",
      "Epoch   0 Batch  426/538 - Train Accuracy:  0.547, Validation Accuracy:  0.562, Loss:  1.862\n",
      "Epoch   0 Batch  427/538 - Train Accuracy:  0.540, Validation Accuracy:  0.569, Loss:  1.870\n",
      "Epoch   0 Batch  428/538 - Train Accuracy:  0.565, Validation Accuracy:  0.567, Loss:  1.819\n",
      "Epoch   0 Batch  429/538 - Train Accuracy:  0.572, Validation Accuracy:  0.561, Loss:  1.846\n",
      "Epoch   0 Batch  430/538 - Train Accuracy:  0.515, Validation Accuracy:  0.540, Loss:  1.875\n",
      "Epoch   0 Batch  431/538 - Train Accuracy:  0.531, Validation Accuracy:  0.542, Loss:  1.762\n",
      "Epoch   0 Batch  432/538 - Train Accuracy:  0.557, Validation Accuracy:  0.544, Loss:  1.790\n",
      "Epoch   0 Batch  433/538 - Train Accuracy:  0.517, Validation Accuracy:  0.532, Loss:  1.901\n",
      "Epoch   0 Batch  434/538 - Train Accuracy:  0.510, Validation Accuracy:  0.527, Loss:  1.850\n",
      "Epoch   0 Batch  435/538 - Train Accuracy:  0.512, Validation Accuracy:  0.537, Loss:  1.863\n",
      "Epoch   0 Batch  436/538 - Train Accuracy:  0.510, Validation Accuracy:  0.542, Loss:  1.834\n",
      "Epoch   0 Batch  437/538 - Train Accuracy:  0.501, Validation Accuracy:  0.546, Loss:  1.844\n",
      "Epoch   0 Batch  438/538 - Train Accuracy:  0.528, Validation Accuracy:  0.539, Loss:  1.840\n",
      "Epoch   0 Batch  439/538 - Train Accuracy:  0.557, Validation Accuracy:  0.545, Loss:  1.802\n",
      "Epoch   0 Batch  440/538 - Train Accuracy:  0.550, Validation Accuracy:  0.567, Loss:  1.867\n",
      "Epoch   0 Batch  441/538 - Train Accuracy:  0.533, Validation Accuracy:  0.576, Loss:  1.877\n",
      "Epoch   0 Batch  442/538 - Train Accuracy:  0.581, Validation Accuracy:  0.580, Loss:  1.795\n",
      "Epoch   0 Batch  443/538 - Train Accuracy:  0.570, Validation Accuracy:  0.578, Loss:  1.835\n",
      "Epoch   0 Batch  444/538 - Train Accuracy:  0.608, Validation Accuracy:  0.563, Loss:  1.768\n",
      "Epoch   0 Batch  445/538 - Train Accuracy:  0.543, Validation Accuracy:  0.551, Loss:  1.834\n",
      "Epoch   0 Batch  446/538 - Train Accuracy:  0.567, Validation Accuracy:  0.550, Loss:  1.793\n",
      "Epoch   0 Batch  447/538 - Train Accuracy:  0.507, Validation Accuracy:  0.549, Loss:  1.853\n",
      "Epoch   0 Batch  448/538 - Train Accuracy:  0.550, Validation Accuracy:  0.555, Loss:  1.765\n",
      "Epoch   0 Batch  449/538 - Train Accuracy:  0.534, Validation Accuracy:  0.558, Loss:  1.871\n",
      "Epoch   0 Batch  450/538 - Train Accuracy:  0.579, Validation Accuracy:  0.565, Loss:  1.855\n",
      "Epoch   0 Batch  451/538 - Train Accuracy:  0.559, Validation Accuracy:  0.565, Loss:  1.816\n",
      "Epoch   0 Batch  452/538 - Train Accuracy:  0.543, Validation Accuracy:  0.562, Loss:  1.851\n",
      "Epoch   0 Batch  453/538 - Train Accuracy:  0.548, Validation Accuracy:  0.562, Loss:  1.842\n",
      "Epoch   0 Batch  454/538 - Train Accuracy:  0.554, Validation Accuracy:  0.561, Loss:  1.816\n",
      "Epoch   0 Batch  455/538 - Train Accuracy:  0.600, Validation Accuracy:  0.562, Loss:  1.784\n",
      "Epoch   0 Batch  456/538 - Train Accuracy:  0.592, Validation Accuracy:  0.539, Loss:  1.729\n",
      "Epoch   0 Batch  457/538 - Train Accuracy:  0.538, Validation Accuracy:  0.543, Loss:  1.830\n",
      "Epoch   0 Batch  458/538 - Train Accuracy:  0.545, Validation Accuracy:  0.558, Loss:  1.839\n",
      "Epoch   0 Batch  459/538 - Train Accuracy:  0.569, Validation Accuracy:  0.562, Loss:  1.813\n",
      "Epoch   0 Batch  460/538 - Train Accuracy:  0.555, Validation Accuracy:  0.562, Loss:  1.766\n",
      "Epoch   0 Batch  461/538 - Train Accuracy:  0.520, Validation Accuracy:  0.556, Loss:  1.846\n",
      "Epoch   0 Batch  462/538 - Train Accuracy:  0.572, Validation Accuracy:  0.552, Loss:  1.768\n",
      "Epoch   0 Batch  463/538 - Train Accuracy:  0.516, Validation Accuracy:  0.547, Loss:  1.795\n",
      "Epoch   0 Batch  464/538 - Train Accuracy:  0.523, Validation Accuracy:  0.550, Loss:  1.835\n",
      "Epoch   0 Batch  465/538 - Train Accuracy:  0.492, Validation Accuracy:  0.552, Loss:  1.840\n",
      "Epoch   0 Batch  466/538 - Train Accuracy:  0.521, Validation Accuracy:  0.548, Loss:  1.846\n",
      "Epoch   0 Batch  467/538 - Train Accuracy:  0.533, Validation Accuracy:  0.567, Loss:  1.745\n",
      "Epoch   0 Batch  468/538 - Train Accuracy:  0.556, Validation Accuracy:  0.561, Loss:  1.783\n",
      "Epoch   0 Batch  469/538 - Train Accuracy:  0.550, Validation Accuracy:  0.550, Loss:  1.825\n",
      "Epoch   0 Batch  470/538 - Train Accuracy:  0.557, Validation Accuracy:  0.557, Loss:  1.824\n",
      "Epoch   0 Batch  471/538 - Train Accuracy:  0.547, Validation Accuracy:  0.558, Loss:  1.754\n",
      "Epoch   0 Batch  472/538 - Train Accuracy:  0.570, Validation Accuracy:  0.561, Loss:  1.782\n",
      "Epoch   0 Batch  473/538 - Train Accuracy:  0.546, Validation Accuracy:  0.556, Loss:  1.795\n",
      "Epoch   0 Batch  474/538 - Train Accuracy:  0.568, Validation Accuracy:  0.550, Loss:  1.758\n",
      "Epoch   0 Batch  475/538 - Train Accuracy:  0.563, Validation Accuracy:  0.552, Loss:  1.817\n",
      "Epoch   0 Batch  476/538 - Train Accuracy:  0.539, Validation Accuracy:  0.559, Loss:  1.791\n",
      "Epoch   0 Batch  477/538 - Train Accuracy:  0.564, Validation Accuracy:  0.562, Loss:  1.791\n",
      "Epoch   0 Batch  478/538 - Train Accuracy:  0.585, Validation Accuracy:  0.573, Loss:  1.766\n",
      "Epoch   0 Batch  479/538 - Train Accuracy:  0.583, Validation Accuracy:  0.576, Loss:  1.768\n",
      "Epoch   0 Batch  480/538 - Train Accuracy:  0.583, Validation Accuracy:  0.573, Loss:  1.766\n",
      "Epoch   0 Batch  481/538 - Train Accuracy:  0.585, Validation Accuracy:  0.568, Loss:  1.757\n",
      "Epoch   0 Batch  482/538 - Train Accuracy:  0.581, Validation Accuracy:  0.568, Loss:  1.721\n",
      "Epoch   0 Batch  483/538 - Train Accuracy:  0.533, Validation Accuracy:  0.574, Loss:  1.837\n",
      "Epoch   0 Batch  484/538 - Train Accuracy:  0.591, Validation Accuracy:  0.577, Loss:  1.769\n",
      "Epoch   0 Batch  485/538 - Train Accuracy:  0.556, Validation Accuracy:  0.559, Loss:  1.786\n",
      "Epoch   0 Batch  486/538 - Train Accuracy:  0.552, Validation Accuracy:  0.558, Loss:  1.755\n",
      "Epoch   0 Batch  487/538 - Train Accuracy:  0.571, Validation Accuracy:  0.557, Loss:  1.761\n",
      "Epoch   0 Batch  488/538 - Train Accuracy:  0.562, Validation Accuracy:  0.563, Loss:  1.771\n",
      "Epoch   0 Batch  489/538 - Train Accuracy:  0.578, Validation Accuracy:  0.579, Loss:  1.835\n",
      "Epoch   0 Batch  490/538 - Train Accuracy:  0.563, Validation Accuracy:  0.583, Loss:  1.788\n",
      "Epoch   0 Batch  491/538 - Train Accuracy:  0.542, Validation Accuracy:  0.585, Loss:  1.837\n",
      "Epoch   0 Batch  492/538 - Train Accuracy:  0.579, Validation Accuracy:  0.582, Loss:  1.762\n",
      "Epoch   0 Batch  493/538 - Train Accuracy:  0.557, Validation Accuracy:  0.576, Loss:  1.788\n",
      "Epoch   0 Batch  494/538 - Train Accuracy:  0.570, Validation Accuracy:  0.578, Loss:  1.844\n",
      "Epoch   0 Batch  495/538 - Train Accuracy:  0.562, Validation Accuracy:  0.585, Loss:  1.836\n",
      "Epoch   0 Batch  496/538 - Train Accuracy:  0.553, Validation Accuracy:  0.575, Loss:  1.855\n",
      "Epoch   0 Batch  497/538 - Train Accuracy:  0.579, Validation Accuracy:  0.569, Loss:  1.784\n",
      "Epoch   0 Batch  498/538 - Train Accuracy:  0.532, Validation Accuracy:  0.570, Loss:  1.834\n",
      "Epoch   0 Batch  499/538 - Train Accuracy:  0.592, Validation Accuracy:  0.574, Loss:  1.750\n",
      "Epoch   0 Batch  500/538 - Train Accuracy:  0.587, Validation Accuracy:  0.570, Loss:  1.766\n",
      "Epoch   0 Batch  501/538 - Train Accuracy:  0.556, Validation Accuracy:  0.566, Loss:  1.765\n",
      "Epoch   0 Batch  502/538 - Train Accuracy:  0.517, Validation Accuracy:  0.571, Loss:  1.753\n",
      "Epoch   0 Batch  503/538 - Train Accuracy:  0.588, Validation Accuracy:  0.571, Loss:  1.791\n",
      "Epoch   0 Batch  504/538 - Train Accuracy:  0.582, Validation Accuracy:  0.565, Loss:  1.771\n",
      "Epoch   0 Batch  505/538 - Train Accuracy:  0.563, Validation Accuracy:  0.581, Loss:  1.769\n",
      "Epoch   0 Batch  506/538 - Train Accuracy:  0.580, Validation Accuracy:  0.575, Loss:  1.762\n",
      "Epoch   0 Batch  507/538 - Train Accuracy:  0.553, Validation Accuracy:  0.563, Loss:  1.757\n",
      "Epoch   0 Batch  508/538 - Train Accuracy:  0.563, Validation Accuracy:  0.554, Loss:  1.744\n",
      "Epoch   0 Batch  509/538 - Train Accuracy:  0.531, Validation Accuracy:  0.559, Loss:  1.814\n",
      "Epoch   0 Batch  510/538 - Train Accuracy:  0.563, Validation Accuracy:  0.570, Loss:  1.732\n",
      "Epoch   0 Batch  511/538 - Train Accuracy:  0.574, Validation Accuracy:  0.568, Loss:  1.786\n",
      "Epoch   0 Batch  512/538 - Train Accuracy:  0.577, Validation Accuracy:  0.567, Loss:  1.774\n",
      "Epoch   0 Batch  513/538 - Train Accuracy:  0.558, Validation Accuracy:  0.569, Loss:  1.838\n",
      "Epoch   0 Batch  514/538 - Train Accuracy:  0.564, Validation Accuracy:  0.568, Loss:  1.809\n",
      "Epoch   0 Batch  515/538 - Train Accuracy:  0.579, Validation Accuracy:  0.579, Loss:  1.796\n",
      "Epoch   0 Batch  516/538 - Train Accuracy:  0.551, Validation Accuracy:  0.585, Loss:  1.823\n",
      "Epoch   0 Batch  517/538 - Train Accuracy:  0.586, Validation Accuracy:  0.589, Loss:  1.743\n",
      "Epoch   0 Batch  518/538 - Train Accuracy:  0.549, Validation Accuracy:  0.582, Loss:  1.832\n",
      "Epoch   0 Batch  519/538 - Train Accuracy:  0.589, Validation Accuracy:  0.567, Loss:  1.737\n",
      "Epoch   0 Batch  520/538 - Train Accuracy:  0.557, Validation Accuracy:  0.569, Loss:  1.807\n",
      "Epoch   0 Batch  521/538 - Train Accuracy:  0.570, Validation Accuracy:  0.570, Loss:  1.795\n",
      "Epoch   0 Batch  522/538 - Train Accuracy:  0.550, Validation Accuracy:  0.570, Loss:  1.756\n",
      "Epoch   0 Batch  523/538 - Train Accuracy:  0.541, Validation Accuracy:  0.571, Loss:  1.777\n",
      "Epoch   0 Batch  524/538 - Train Accuracy:  0.512, Validation Accuracy:  0.571, Loss:  1.843\n",
      "Epoch   0 Batch  525/538 - Train Accuracy:  0.607, Validation Accuracy:  0.583, Loss:  1.746\n",
      "Epoch   0 Batch  526/538 - Train Accuracy:  0.565, Validation Accuracy:  0.585, Loss:  1.736\n",
      "Epoch   0 Batch  527/538 - Train Accuracy:  0.588, Validation Accuracy:  0.585, Loss:  1.757\n",
      "Epoch   0 Batch  528/538 - Train Accuracy:  0.562, Validation Accuracy:  0.597, Loss:  1.820\n",
      "Epoch   0 Batch  529/538 - Train Accuracy:  0.577, Validation Accuracy:  0.597, Loss:  1.776\n",
      "Epoch   0 Batch  530/538 - Train Accuracy:  0.559, Validation Accuracy:  0.589, Loss:  1.767\n",
      "Epoch   0 Batch  531/538 - Train Accuracy:  0.577, Validation Accuracy:  0.593, Loss:  1.778\n",
      "Epoch   0 Batch  532/538 - Train Accuracy:  0.538, Validation Accuracy:  0.584, Loss:  1.753\n",
      "Epoch   0 Batch  533/538 - Train Accuracy:  0.530, Validation Accuracy:  0.555, Loss:  1.868\n",
      "Epoch   0 Batch  534/538 - Train Accuracy:  0.565, Validation Accuracy:  0.547, Loss:  1.754\n",
      "Epoch   0 Batch  535/538 - Train Accuracy:  0.580, Validation Accuracy:  0.582, Loss:  1.813\n",
      "Epoch   0 Batch  536/538 - Train Accuracy:  0.574, Validation Accuracy:  0.566, Loss:  1.815\n",
      "Epoch   1 Batch    0/538 - Train Accuracy:  0.496, Validation Accuracy:  0.546, Loss:  1.905\n",
      "Epoch   1 Batch    1/538 - Train Accuracy:  0.491, Validation Accuracy:  0.514, Loss:  1.991\n",
      "Epoch   1 Batch    2/538 - Train Accuracy:  0.466, Validation Accuracy:  0.519, Loss:  2.146\n",
      "Epoch   1 Batch    3/538 - Train Accuracy:  0.518, Validation Accuracy:  0.571, Loss:  2.443\n",
      "Epoch   1 Batch    4/538 - Train Accuracy:  0.472, Validation Accuracy:  0.502, Loss:  1.979\n",
      "Epoch   1 Batch    5/538 - Train Accuracy:  0.518, Validation Accuracy:  0.564, Loss:  2.094\n",
      "Epoch   1 Batch    6/538 - Train Accuracy:  0.534, Validation Accuracy:  0.548, Loss:  1.912\n",
      "Epoch   1 Batch    7/538 - Train Accuracy:  0.510, Validation Accuracy:  0.547, Loss:  1.984\n",
      "Epoch   1 Batch    8/538 - Train Accuracy:  0.514, Validation Accuracy:  0.552, Loss:  1.959\n",
      "Epoch   1 Batch    9/538 - Train Accuracy:  0.496, Validation Accuracy:  0.523, Loss:  1.934\n",
      "Epoch   1 Batch   10/538 - Train Accuracy:  0.466, Validation Accuracy:  0.531, Loss:  1.937\n",
      "Epoch   1 Batch   11/538 - Train Accuracy:  0.490, Validation Accuracy:  0.545, Loss:  1.899\n",
      "Epoch   1 Batch   12/538 - Train Accuracy:  0.506, Validation Accuracy:  0.533, Loss:  1.942\n",
      "Epoch   1 Batch   13/538 - Train Accuracy:  0.534, Validation Accuracy:  0.539, Loss:  1.822\n",
      "Epoch   1 Batch   14/538 - Train Accuracy:  0.523, Validation Accuracy:  0.556, Loss:  1.880\n",
      "Epoch   1 Batch   15/538 - Train Accuracy:  0.554, Validation Accuracy:  0.568, Loss:  1.811\n",
      "Epoch   1 Batch   16/538 - Train Accuracy:  0.559, Validation Accuracy:  0.559, Loss:  1.804\n",
      "Epoch   1 Batch   17/538 - Train Accuracy:  0.551, Validation Accuracy:  0.558, Loss:  1.875\n",
      "Epoch   1 Batch   18/538 - Train Accuracy:  0.539, Validation Accuracy:  0.560, Loss:  1.872\n",
      "Epoch   1 Batch   19/538 - Train Accuracy:  0.530, Validation Accuracy:  0.561, Loss:  1.856\n",
      "Epoch   1 Batch   20/538 - Train Accuracy:  0.556, Validation Accuracy:  0.565, Loss:  1.837\n",
      "Epoch   1 Batch   21/538 - Train Accuracy:  0.511, Validation Accuracy:  0.573, Loss:  1.860\n",
      "Epoch   1 Batch   22/538 - Train Accuracy:  0.547, Validation Accuracy:  0.570, Loss:  1.843\n",
      "Epoch   1 Batch   23/538 - Train Accuracy:  0.555, Validation Accuracy:  0.563, Loss:  1.918\n",
      "Epoch   1 Batch   24/538 - Train Accuracy:  0.553, Validation Accuracy:  0.575, Loss:  1.824\n",
      "Epoch   1 Batch   25/538 - Train Accuracy:  0.562, Validation Accuracy:  0.579, Loss:  1.858\n",
      "Epoch   1 Batch   26/538 - Train Accuracy:  0.558, Validation Accuracy:  0.580, Loss:  1.856\n",
      "Epoch   1 Batch   27/538 - Train Accuracy:  0.564, Validation Accuracy:  0.580, Loss:  1.801\n",
      "Epoch   1 Batch   28/538 - Train Accuracy:  0.577, Validation Accuracy:  0.571, Loss:  1.798\n",
      "Epoch   1 Batch   29/538 - Train Accuracy:  0.581, Validation Accuracy:  0.576, Loss:  1.787\n",
      "Epoch   1 Batch   30/538 - Train Accuracy:  0.574, Validation Accuracy:  0.576, Loss:  1.855\n",
      "Epoch   1 Batch   31/538 - Train Accuracy:  0.556, Validation Accuracy:  0.583, Loss:  1.774\n",
      "Epoch   1 Batch   32/538 - Train Accuracy:  0.559, Validation Accuracy:  0.581, Loss:  1.773\n",
      "Epoch   1 Batch   33/538 - Train Accuracy:  0.581, Validation Accuracy:  0.580, Loss:  1.771\n",
      "Epoch   1 Batch   34/538 - Train Accuracy:  0.562, Validation Accuracy:  0.585, Loss:  1.844\n",
      "Epoch   1 Batch   35/538 - Train Accuracy:  0.575, Validation Accuracy:  0.595, Loss:  1.773\n",
      "Epoch   1 Batch   36/538 - Train Accuracy:  0.582, Validation Accuracy:  0.588, Loss:  1.788\n",
      "Epoch   1 Batch   37/538 - Train Accuracy:  0.586, Validation Accuracy:  0.598, Loss:  1.747\n",
      "Epoch   1 Batch   38/538 - Train Accuracy:  0.561, Validation Accuracy:  0.597, Loss:  1.833\n",
      "Epoch   1 Batch   39/538 - Train Accuracy:  0.576, Validation Accuracy:  0.597, Loss:  1.768\n",
      "Epoch   1 Batch   40/538 - Train Accuracy:  0.626, Validation Accuracy:  0.596, Loss:  1.713\n",
      "Epoch   1 Batch   41/538 - Train Accuracy:  0.572, Validation Accuracy:  0.596, Loss:  1.815\n",
      "Epoch   1 Batch   42/538 - Train Accuracy:  0.581, Validation Accuracy:  0.594, Loss:  1.845\n",
      "Epoch   1 Batch   43/538 - Train Accuracy:  0.591, Validation Accuracy:  0.589, Loss:  1.799\n",
      "Epoch   1 Batch   44/538 - Train Accuracy:  0.575, Validation Accuracy:  0.589, Loss:  1.798\n",
      "Epoch   1 Batch   45/538 - Train Accuracy:  0.579, Validation Accuracy:  0.586, Loss:  1.718\n",
      "Epoch   1 Batch   46/538 - Train Accuracy:  0.568, Validation Accuracy:  0.588, Loss:  1.751\n",
      "Epoch   1 Batch   47/538 - Train Accuracy:  0.570, Validation Accuracy:  0.592, Loss:  1.702\n",
      "Epoch   1 Batch   48/538 - Train Accuracy:  0.604, Validation Accuracy:  0.588, Loss:  1.716\n",
      "Epoch   1 Batch   49/538 - Train Accuracy:  0.556, Validation Accuracy:  0.588, Loss:  1.785\n",
      "Epoch   1 Batch   50/538 - Train Accuracy:  0.588, Validation Accuracy:  0.595, Loss:  1.780\n",
      "Epoch   1 Batch   51/538 - Train Accuracy:  0.524, Validation Accuracy:  0.589, Loss:  1.822\n",
      "Epoch   1 Batch   52/538 - Train Accuracy:  0.571, Validation Accuracy:  0.598, Loss:  1.771\n",
      "Epoch   1 Batch   53/538 - Train Accuracy:  0.604, Validation Accuracy:  0.597, Loss:  1.690\n",
      "Epoch   1 Batch   54/538 - Train Accuracy:  0.596, Validation Accuracy:  0.597, Loss:  1.781\n",
      "Epoch   1 Batch   55/538 - Train Accuracy:  0.575, Validation Accuracy:  0.592, Loss:  1.736\n",
      "Epoch   1 Batch   56/538 - Train Accuracy:  0.571, Validation Accuracy:  0.587, Loss:  1.736\n",
      "Epoch   1 Batch   57/538 - Train Accuracy:  0.540, Validation Accuracy:  0.584, Loss:  1.776\n",
      "Epoch   1 Batch   58/538 - Train Accuracy:  0.562, Validation Accuracy:  0.590, Loss:  1.776\n",
      "Epoch   1 Batch   59/538 - Train Accuracy:  0.568, Validation Accuracy:  0.595, Loss:  1.811\n",
      "Epoch   1 Batch   60/538 - Train Accuracy:  0.606, Validation Accuracy:  0.596, Loss:  1.750\n",
      "Epoch   1 Batch   61/538 - Train Accuracy:  0.568, Validation Accuracy:  0.590, Loss:  1.738\n",
      "Epoch   1 Batch   62/538 - Train Accuracy:  0.604, Validation Accuracy:  0.584, Loss:  1.735\n",
      "Epoch   1 Batch   63/538 - Train Accuracy:  0.593, Validation Accuracy:  0.582, Loss:  1.673\n",
      "Epoch   1 Batch   64/538 - Train Accuracy:  0.611, Validation Accuracy:  0.588, Loss:  1.711\n",
      "Epoch   1 Batch   65/538 - Train Accuracy:  0.572, Validation Accuracy:  0.583, Loss:  1.759\n",
      "Epoch   1 Batch   66/538 - Train Accuracy:  0.588, Validation Accuracy:  0.581, Loss:  1.653\n",
      "Epoch   1 Batch   67/538 - Train Accuracy:  0.589, Validation Accuracy:  0.567, Loss:  1.756\n",
      "Epoch   1 Batch   68/538 - Train Accuracy:  0.592, Validation Accuracy:  0.562, Loss:  1.705\n",
      "Epoch   1 Batch   69/538 - Train Accuracy:  0.567, Validation Accuracy:  0.558, Loss:  1.771\n",
      "Epoch   1 Batch   70/538 - Train Accuracy:  0.597, Validation Accuracy:  0.567, Loss:  1.746\n",
      "Epoch   1 Batch   71/538 - Train Accuracy:  0.547, Validation Accuracy:  0.569, Loss:  1.778\n",
      "Epoch   1 Batch   72/538 - Train Accuracy:  0.586, Validation Accuracy:  0.576, Loss:  1.766\n",
      "Epoch   1 Batch   73/538 - Train Accuracy:  0.553, Validation Accuracy:  0.580, Loss:  1.784\n",
      "Epoch   1 Batch   74/538 - Train Accuracy:  0.612, Validation Accuracy:  0.593, Loss:  1.739\n",
      "Epoch   1 Batch   75/538 - Train Accuracy:  0.608, Validation Accuracy:  0.593, Loss:  1.685\n",
      "Epoch   1 Batch   76/538 - Train Accuracy:  0.589, Validation Accuracy:  0.598, Loss:  1.716\n",
      "Epoch   1 Batch   77/538 - Train Accuracy:  0.571, Validation Accuracy:  0.597, Loss:  1.738\n",
      "Epoch   1 Batch   78/538 - Train Accuracy:  0.620, Validation Accuracy:  0.600, Loss:  1.719\n",
      "Epoch   1 Batch   79/538 - Train Accuracy:  0.594, Validation Accuracy:  0.599, Loss:  1.697\n",
      "Epoch   1 Batch   80/538 - Train Accuracy:  0.586, Validation Accuracy:  0.599, Loss:  1.754\n",
      "Epoch   1 Batch   81/538 - Train Accuracy:  0.585, Validation Accuracy:  0.599, Loss:  1.787\n",
      "Epoch   1 Batch   82/538 - Train Accuracy:  0.575, Validation Accuracy:  0.593, Loss:  1.738\n",
      "Epoch   1 Batch   83/538 - Train Accuracy:  0.576, Validation Accuracy:  0.588, Loss:  1.767\n",
      "Epoch   1 Batch   84/538 - Train Accuracy:  0.564, Validation Accuracy:  0.586, Loss:  1.720\n",
      "Epoch   1 Batch   85/538 - Train Accuracy:  0.607, Validation Accuracy:  0.582, Loss:  1.723\n",
      "Epoch   1 Batch   86/538 - Train Accuracy:  0.593, Validation Accuracy:  0.585, Loss:  1.731\n",
      "Epoch   1 Batch   87/538 - Train Accuracy:  0.574, Validation Accuracy:  0.586, Loss:  1.753\n",
      "Epoch   1 Batch   88/538 - Train Accuracy:  0.583, Validation Accuracy:  0.585, Loss:  1.743\n",
      "Epoch   1 Batch   89/538 - Train Accuracy:  0.594, Validation Accuracy:  0.593, Loss:  1.742\n",
      "Epoch   1 Batch   90/538 - Train Accuracy:  0.600, Validation Accuracy:  0.600, Loss:  1.746\n",
      "Epoch   1 Batch   91/538 - Train Accuracy:  0.579, Validation Accuracy:  0.597, Loss:  1.713\n",
      "Epoch   1 Batch   92/538 - Train Accuracy:  0.579, Validation Accuracy:  0.594, Loss:  1.717\n",
      "Epoch   1 Batch   93/538 - Train Accuracy:  0.584, Validation Accuracy:  0.583, Loss:  1.771\n",
      "Epoch   1 Batch   94/538 - Train Accuracy:  0.601, Validation Accuracy:  0.581, Loss:  1.687\n",
      "Epoch   1 Batch   95/538 - Train Accuracy:  0.626, Validation Accuracy:  0.582, Loss:  1.706\n",
      "Epoch   1 Batch   96/538 - Train Accuracy:  0.607, Validation Accuracy:  0.584, Loss:  1.708\n",
      "Epoch   1 Batch   97/538 - Train Accuracy:  0.573, Validation Accuracy:  0.594, Loss:  1.722\n",
      "Epoch   1 Batch   98/538 - Train Accuracy:  0.602, Validation Accuracy:  0.592, Loss:  1.737\n",
      "Epoch   1 Batch   99/538 - Train Accuracy:  0.566, Validation Accuracy:  0.594, Loss:  1.725\n",
      "Epoch   1 Batch  100/538 - Train Accuracy:  0.596, Validation Accuracy:  0.595, Loss:  1.750\n",
      "Epoch   1 Batch  101/538 - Train Accuracy:  0.554, Validation Accuracy:  0.594, Loss:  1.743\n",
      "Epoch   1 Batch  102/538 - Train Accuracy:  0.585, Validation Accuracy:  0.598, Loss:  1.754\n",
      "Epoch   1 Batch  103/538 - Train Accuracy:  0.566, Validation Accuracy:  0.598, Loss:  1.736\n",
      "Epoch   1 Batch  104/538 - Train Accuracy:  0.621, Validation Accuracy:  0.600, Loss:  1.725\n",
      "Epoch   1 Batch  105/538 - Train Accuracy:  0.588, Validation Accuracy:  0.605, Loss:  1.694\n",
      "Epoch   1 Batch  106/538 - Train Accuracy:  0.584, Validation Accuracy:  0.610, Loss:  1.670\n",
      "Epoch   1 Batch  107/538 - Train Accuracy:  0.576, Validation Accuracy:  0.612, Loss:  1.711\n",
      "Epoch   1 Batch  108/538 - Train Accuracy:  0.610, Validation Accuracy:  0.607, Loss:  1.756\n",
      "Epoch   1 Batch  109/538 - Train Accuracy:  0.622, Validation Accuracy:  0.602, Loss:  1.729\n",
      "Epoch   1 Batch  110/538 - Train Accuracy:  0.589, Validation Accuracy:  0.600, Loss:  1.751\n",
      "Epoch   1 Batch  111/538 - Train Accuracy:  0.615, Validation Accuracy:  0.602, Loss:  1.694\n",
      "Epoch   1 Batch  112/538 - Train Accuracy:  0.588, Validation Accuracy:  0.605, Loss:  1.747\n",
      "Epoch   1 Batch  113/538 - Train Accuracy:  0.589, Validation Accuracy:  0.599, Loss:  1.731\n",
      "Epoch   1 Batch  114/538 - Train Accuracy:  0.619, Validation Accuracy:  0.599, Loss:  1.709\n",
      "Epoch   1 Batch  115/538 - Train Accuracy:  0.591, Validation Accuracy:  0.601, Loss:  1.694\n",
      "Epoch   1 Batch  116/538 - Train Accuracy:  0.604, Validation Accuracy:  0.603, Loss:  1.704\n",
      "Epoch   1 Batch  117/538 - Train Accuracy:  0.614, Validation Accuracy:  0.603, Loss:  1.705\n",
      "Epoch   1 Batch  118/538 - Train Accuracy:  0.609, Validation Accuracy:  0.609, Loss:  1.709\n",
      "Epoch   1 Batch  119/538 - Train Accuracy:  0.620, Validation Accuracy:  0.608, Loss:  1.686\n",
      "Epoch   1 Batch  120/538 - Train Accuracy:  0.605, Validation Accuracy:  0.608, Loss:  1.731\n",
      "Epoch   1 Batch  121/538 - Train Accuracy:  0.616, Validation Accuracy:  0.601, Loss:  1.649\n",
      "Epoch   1 Batch  122/538 - Train Accuracy:  0.604, Validation Accuracy:  0.605, Loss:  1.685\n",
      "Epoch   1 Batch  123/538 - Train Accuracy:  0.623, Validation Accuracy:  0.605, Loss:  1.703\n",
      "Epoch   1 Batch  124/538 - Train Accuracy:  0.606, Validation Accuracy:  0.600, Loss:  1.681\n",
      "Epoch   1 Batch  125/538 - Train Accuracy:  0.609, Validation Accuracy:  0.598, Loss:  1.731\n",
      "Epoch   1 Batch  126/538 - Train Accuracy:  0.610, Validation Accuracy:  0.594, Loss:  1.695\n",
      "Epoch   1 Batch  127/538 - Train Accuracy:  0.568, Validation Accuracy:  0.595, Loss:  1.758\n",
      "Epoch   1 Batch  128/538 - Train Accuracy:  0.600, Validation Accuracy:  0.602, Loss:  1.719\n",
      "Epoch   1 Batch  129/538 - Train Accuracy:  0.603, Validation Accuracy:  0.597, Loss:  1.645\n",
      "Epoch   1 Batch  130/538 - Train Accuracy:  0.615, Validation Accuracy:  0.604, Loss:  1.661\n",
      "Epoch   1 Batch  131/538 - Train Accuracy:  0.609, Validation Accuracy:  0.607, Loss:  1.710\n",
      "Epoch   1 Batch  132/538 - Train Accuracy:  0.609, Validation Accuracy:  0.613, Loss:  1.688\n",
      "Epoch   1 Batch  133/538 - Train Accuracy:  0.618, Validation Accuracy:  0.611, Loss:  1.695\n",
      "Epoch   1 Batch  134/538 - Train Accuracy:  0.582, Validation Accuracy:  0.614, Loss:  1.787\n",
      "Epoch   1 Batch  135/538 - Train Accuracy:  0.619, Validation Accuracy:  0.612, Loss:  1.743\n",
      "Epoch   1 Batch  136/538 - Train Accuracy:  0.603, Validation Accuracy:  0.611, Loss:  1.709\n",
      "Epoch   1 Batch  137/538 - Train Accuracy:  0.583, Validation Accuracy:  0.608, Loss:  1.732\n",
      "Epoch   1 Batch  138/538 - Train Accuracy:  0.611, Validation Accuracy:  0.597, Loss:  1.709\n",
      "Epoch   1 Batch  139/538 - Train Accuracy:  0.569, Validation Accuracy:  0.585, Loss:  1.745\n",
      "Epoch   1 Batch  140/538 - Train Accuracy:  0.554, Validation Accuracy:  0.584, Loss:  1.713\n",
      "Epoch   1 Batch  141/538 - Train Accuracy:  0.586, Validation Accuracy:  0.580, Loss:  1.739\n",
      "Epoch   1 Batch  142/538 - Train Accuracy:  0.613, Validation Accuracy:  0.574, Loss:  1.737\n",
      "Epoch   1 Batch  143/538 - Train Accuracy:  0.570, Validation Accuracy:  0.577, Loss:  1.716\n",
      "Epoch   1 Batch  144/538 - Train Accuracy:  0.599, Validation Accuracy:  0.587, Loss:  1.703\n",
      "Epoch   1 Batch  145/538 - Train Accuracy:  0.600, Validation Accuracy:  0.590, Loss:  1.728\n",
      "Epoch   1 Batch  146/538 - Train Accuracy:  0.612, Validation Accuracy:  0.589, Loss:  1.674\n",
      "Epoch   1 Batch  147/538 - Train Accuracy:  0.620, Validation Accuracy:  0.593, Loss:  1.685\n",
      "Epoch   1 Batch  148/538 - Train Accuracy:  0.582, Validation Accuracy:  0.597, Loss:  1.746\n",
      "Epoch   1 Batch  149/538 - Train Accuracy:  0.591, Validation Accuracy:  0.604, Loss:  1.648\n",
      "Epoch   1 Batch  150/538 - Train Accuracy:  0.617, Validation Accuracy:  0.615, Loss:  1.745\n",
      "Epoch   1 Batch  151/538 - Train Accuracy:  0.589, Validation Accuracy:  0.620, Loss:  1.719\n",
      "Epoch   1 Batch  152/538 - Train Accuracy:  0.618, Validation Accuracy:  0.621, Loss:  1.725\n",
      "Epoch   1 Batch  153/538 - Train Accuracy:  0.592, Validation Accuracy:  0.612, Loss:  1.755\n",
      "Epoch   1 Batch  154/538 - Train Accuracy:  0.607, Validation Accuracy:  0.609, Loss:  1.682\n",
      "Epoch   1 Batch  155/538 - Train Accuracy:  0.648, Validation Accuracy:  0.612, Loss:  1.673\n",
      "Epoch   1 Batch  156/538 - Train Accuracy:  0.620, Validation Accuracy:  0.610, Loss:  1.691\n",
      "Epoch   1 Batch  157/538 - Train Accuracy:  0.604, Validation Accuracy:  0.604, Loss:  1.667\n",
      "Epoch   1 Batch  158/538 - Train Accuracy:  0.618, Validation Accuracy:  0.601, Loss:  1.737\n",
      "Epoch   1 Batch  159/538 - Train Accuracy:  0.611, Validation Accuracy:  0.602, Loss:  1.733\n",
      "Epoch   1 Batch  160/538 - Train Accuracy:  0.591, Validation Accuracy:  0.606, Loss:  1.669\n",
      "Epoch   1 Batch  161/538 - Train Accuracy:  0.583, Validation Accuracy:  0.606, Loss:  1.747\n",
      "Epoch   1 Batch  162/538 - Train Accuracy:  0.624, Validation Accuracy:  0.610, Loss:  1.715\n",
      "Epoch   1 Batch  163/538 - Train Accuracy:  0.616, Validation Accuracy:  0.607, Loss:  1.689\n",
      "Epoch   1 Batch  164/538 - Train Accuracy:  0.616, Validation Accuracy:  0.618, Loss:  1.690\n",
      "Epoch   1 Batch  165/538 - Train Accuracy:  0.614, Validation Accuracy:  0.619, Loss:  1.662\n",
      "Epoch   1 Batch  166/538 - Train Accuracy:  0.627, Validation Accuracy:  0.618, Loss:  1.679\n",
      "Epoch   1 Batch  167/538 - Train Accuracy:  0.617, Validation Accuracy:  0.622, Loss:  1.642\n",
      "Epoch   1 Batch  168/538 - Train Accuracy:  0.589, Validation Accuracy:  0.615, Loss:  1.729\n",
      "Epoch   1 Batch  169/538 - Train Accuracy:  0.600, Validation Accuracy:  0.620, Loss:  1.704\n",
      "Epoch   1 Batch  170/538 - Train Accuracy:  0.633, Validation Accuracy:  0.626, Loss:  1.710\n",
      "Epoch   1 Batch  171/538 - Train Accuracy:  0.611, Validation Accuracy:  0.624, Loss:  1.699\n",
      "Epoch   1 Batch  172/538 - Train Accuracy:  0.612, Validation Accuracy:  0.616, Loss:  1.674\n",
      "Epoch   1 Batch  173/538 - Train Accuracy:  0.603, Validation Accuracy:  0.609, Loss:  1.689\n",
      "Epoch   1 Batch  174/538 - Train Accuracy:  0.590, Validation Accuracy:  0.610, Loss:  1.687\n",
      "Epoch   1 Batch  175/538 - Train Accuracy:  0.575, Validation Accuracy:  0.607, Loss:  1.667\n",
      "Epoch   1 Batch  176/538 - Train Accuracy:  0.588, Validation Accuracy:  0.607, Loss:  1.721\n",
      "Epoch   1 Batch  177/538 - Train Accuracy:  0.606, Validation Accuracy:  0.607, Loss:  1.652\n",
      "Epoch   1 Batch  178/538 - Train Accuracy:  0.626, Validation Accuracy:  0.610, Loss:  1.683\n",
      "Epoch   1 Batch  179/538 - Train Accuracy:  0.604, Validation Accuracy:  0.616, Loss:  1.680\n",
      "Epoch   1 Batch  180/538 - Train Accuracy:  0.642, Validation Accuracy:  0.619, Loss:  1.693\n",
      "Epoch   1 Batch  181/538 - Train Accuracy:  0.585, Validation Accuracy:  0.620, Loss:  1.708\n",
      "Epoch   1 Batch  182/538 - Train Accuracy:  0.596, Validation Accuracy:  0.625, Loss:  1.679\n",
      "Epoch   1 Batch  183/538 - Train Accuracy:  0.634, Validation Accuracy:  0.621, Loss:  1.706\n",
      "Epoch   1 Batch  184/538 - Train Accuracy:  0.610, Validation Accuracy:  0.623, Loss:  1.684\n",
      "Epoch   1 Batch  185/538 - Train Accuracy:  0.609, Validation Accuracy:  0.627, Loss:  1.666\n",
      "Epoch   1 Batch  186/538 - Train Accuracy:  0.618, Validation Accuracy:  0.625, Loss:  1.717\n",
      "Epoch   1 Batch  187/538 - Train Accuracy:  0.632, Validation Accuracy:  0.624, Loss:  1.627\n",
      "Epoch   1 Batch  188/538 - Train Accuracy:  0.603, Validation Accuracy:  0.628, Loss:  1.654\n",
      "Epoch   1 Batch  189/538 - Train Accuracy:  0.616, Validation Accuracy:  0.630, Loss:  1.642\n",
      "Epoch   1 Batch  190/538 - Train Accuracy:  0.604, Validation Accuracy:  0.628, Loss:  1.751\n",
      "Epoch   1 Batch  191/538 - Train Accuracy:  0.630, Validation Accuracy:  0.628, Loss:  1.671\n",
      "Epoch   1 Batch  192/538 - Train Accuracy:  0.597, Validation Accuracy:  0.619, Loss:  1.680\n",
      "Epoch   1 Batch  193/538 - Train Accuracy:  0.631, Validation Accuracy:  0.610, Loss:  1.638\n",
      "Epoch   1 Batch  194/538 - Train Accuracy:  0.606, Validation Accuracy:  0.614, Loss:  1.720\n",
      "Epoch   1 Batch  195/538 - Train Accuracy:  0.602, Validation Accuracy:  0.618, Loss:  1.647\n",
      "Epoch   1 Batch  196/538 - Train Accuracy:  0.597, Validation Accuracy:  0.624, Loss:  1.672\n",
      "Epoch   1 Batch  197/538 - Train Accuracy:  0.627, Validation Accuracy:  0.625, Loss:  1.636\n",
      "Epoch   1 Batch  198/538 - Train Accuracy:  0.626, Validation Accuracy:  0.624, Loss:  1.655\n",
      "Epoch   1 Batch  199/538 - Train Accuracy:  0.604, Validation Accuracy:  0.626, Loss:  1.719\n",
      "Epoch   1 Batch  200/538 - Train Accuracy:  0.623, Validation Accuracy:  0.623, Loss:  1.661\n",
      "Epoch   1 Batch  201/538 - Train Accuracy:  0.623, Validation Accuracy:  0.627, Loss:  1.653\n",
      "Epoch   1 Batch  202/538 - Train Accuracy:  0.613, Validation Accuracy:  0.624, Loss:  1.749\n",
      "Epoch   1 Batch  203/538 - Train Accuracy:  0.592, Validation Accuracy:  0.622, Loss:  1.751\n",
      "Epoch   1 Batch  204/538 - Train Accuracy:  0.592, Validation Accuracy:  0.624, Loss:  1.694\n",
      "Epoch   1 Batch  205/538 - Train Accuracy:  0.627, Validation Accuracy:  0.631, Loss:  1.661\n",
      "Epoch   1 Batch  206/538 - Train Accuracy:  0.604, Validation Accuracy:  0.632, Loss:  1.726\n",
      "Epoch   1 Batch  207/538 - Train Accuracy:  0.627, Validation Accuracy:  0.637, Loss:  1.667\n",
      "Epoch   1 Batch  208/538 - Train Accuracy:  0.599, Validation Accuracy:  0.631, Loss:  1.680\n",
      "Epoch   1 Batch  209/538 - Train Accuracy:  0.591, Validation Accuracy:  0.631, Loss:  1.709\n",
      "Epoch   1 Batch  210/538 - Train Accuracy:  0.596, Validation Accuracy:  0.626, Loss:  1.654\n",
      "Epoch   1 Batch  211/538 - Train Accuracy:  0.576, Validation Accuracy:  0.627, Loss:  1.699\n",
      "Epoch   1 Batch  212/538 - Train Accuracy:  0.617, Validation Accuracy:  0.621, Loss:  1.664\n",
      "Epoch   1 Batch  213/538 - Train Accuracy:  0.608, Validation Accuracy:  0.616, Loss:  1.645\n",
      "Epoch   1 Batch  214/538 - Train Accuracy:  0.600, Validation Accuracy:  0.619, Loss:  1.651\n",
      "Epoch   1 Batch  215/538 - Train Accuracy:  0.605, Validation Accuracy:  0.622, Loss:  1.676\n",
      "Epoch   1 Batch  216/538 - Train Accuracy:  0.581, Validation Accuracy:  0.627, Loss:  1.722\n",
      "Epoch   1 Batch  217/538 - Train Accuracy:  0.659, Validation Accuracy:  0.635, Loss:  1.696\n",
      "Epoch   1 Batch  218/538 - Train Accuracy:  0.602, Validation Accuracy:  0.637, Loss:  1.664\n",
      "Epoch   1 Batch  219/538 - Train Accuracy:  0.606, Validation Accuracy:  0.638, Loss:  1.661\n",
      "Epoch   1 Batch  220/538 - Train Accuracy:  0.600, Validation Accuracy:  0.638, Loss:  1.665\n",
      "Epoch   1 Batch  221/538 - Train Accuracy:  0.627, Validation Accuracy:  0.635, Loss:  1.692\n",
      "Epoch   1 Batch  222/538 - Train Accuracy:  0.623, Validation Accuracy:  0.635, Loss:  1.644\n",
      "Epoch   1 Batch  223/538 - Train Accuracy:  0.605, Validation Accuracy:  0.628, Loss:  1.663\n",
      "Epoch   1 Batch  224/538 - Train Accuracy:  0.569, Validation Accuracy:  0.621, Loss:  1.733\n",
      "Epoch   1 Batch  225/538 - Train Accuracy:  0.629, Validation Accuracy:  0.618, Loss:  1.680\n",
      "Epoch   1 Batch  226/538 - Train Accuracy:  0.636, Validation Accuracy:  0.621, Loss:  1.632\n",
      "Epoch   1 Batch  227/538 - Train Accuracy:  0.635, Validation Accuracy:  0.633, Loss:  1.610\n",
      "Epoch   1 Batch  228/538 - Train Accuracy:  0.605, Validation Accuracy:  0.633, Loss:  1.656\n",
      "Epoch   1 Batch  229/538 - Train Accuracy:  0.628, Validation Accuracy:  0.634, Loss:  1.618\n",
      "Epoch   1 Batch  230/538 - Train Accuracy:  0.611, Validation Accuracy:  0.631, Loss:  1.702\n",
      "Epoch   1 Batch  231/538 - Train Accuracy:  0.618, Validation Accuracy:  0.634, Loss:  1.667\n",
      "Epoch   1 Batch  232/538 - Train Accuracy:  0.621, Validation Accuracy:  0.635, Loss:  1.646\n",
      "Epoch   1 Batch  233/538 - Train Accuracy:  0.644, Validation Accuracy:  0.628, Loss:  1.713\n",
      "Epoch   1 Batch  234/538 - Train Accuracy:  0.575, Validation Accuracy:  0.626, Loss:  1.658\n",
      "Epoch   1 Batch  235/538 - Train Accuracy:  0.618, Validation Accuracy:  0.621, Loss:  1.585\n",
      "Epoch   1 Batch  236/538 - Train Accuracy:  0.598, Validation Accuracy:  0.627, Loss:  1.659\n",
      "Epoch   1 Batch  237/538 - Train Accuracy:  0.627, Validation Accuracy:  0.633, Loss:  1.652\n",
      "Epoch   1 Batch  238/538 - Train Accuracy:  0.649, Validation Accuracy:  0.636, Loss:  1.670\n",
      "Epoch   1 Batch  239/538 - Train Accuracy:  0.617, Validation Accuracy:  0.637, Loss:  1.672\n",
      "Epoch   1 Batch  240/538 - Train Accuracy:  0.636, Validation Accuracy:  0.639, Loss:  1.634\n",
      "Epoch   1 Batch  241/538 - Train Accuracy:  0.616, Validation Accuracy:  0.642, Loss:  1.699\n",
      "Epoch   1 Batch  242/538 - Train Accuracy:  0.645, Validation Accuracy:  0.638, Loss:  1.647\n",
      "Epoch   1 Batch  243/538 - Train Accuracy:  0.590, Validation Accuracy:  0.635, Loss:  1.759\n",
      "Epoch   1 Batch  244/538 - Train Accuracy:  0.630, Validation Accuracy:  0.638, Loss:  1.680\n",
      "Epoch   1 Batch  245/538 - Train Accuracy:  0.618, Validation Accuracy:  0.640, Loss:  1.667\n",
      "Epoch   1 Batch  246/538 - Train Accuracy:  0.645, Validation Accuracy:  0.640, Loss:  1.598\n",
      "Epoch   1 Batch  247/538 - Train Accuracy:  0.611, Validation Accuracy:  0.633, Loss:  1.708\n",
      "Epoch   1 Batch  248/538 - Train Accuracy:  0.617, Validation Accuracy:  0.631, Loss:  1.680\n",
      "Epoch   1 Batch  249/538 - Train Accuracy:  0.619, Validation Accuracy:  0.637, Loss:  1.677\n",
      "Epoch   1 Batch  250/538 - Train Accuracy:  0.611, Validation Accuracy:  0.638, Loss:  1.630\n",
      "Epoch   1 Batch  251/538 - Train Accuracy:  0.626, Validation Accuracy:  0.640, Loss:  1.729\n",
      "Epoch   1 Batch  252/538 - Train Accuracy:  0.624, Validation Accuracy:  0.638, Loss:  1.674\n",
      "Epoch   1 Batch  253/538 - Train Accuracy:  0.630, Validation Accuracy:  0.641, Loss:  1.708\n",
      "Epoch   1 Batch  254/538 - Train Accuracy:  0.633, Validation Accuracy:  0.640, Loss:  1.668\n",
      "Epoch   1 Batch  255/538 - Train Accuracy:  0.629, Validation Accuracy:  0.638, Loss:  1.655\n",
      "Epoch   1 Batch  256/538 - Train Accuracy:  0.615, Validation Accuracy:  0.635, Loss:  1.632\n",
      "Epoch   1 Batch  257/538 - Train Accuracy:  0.640, Validation Accuracy:  0.634, Loss:  1.618\n",
      "Epoch   1 Batch  258/538 - Train Accuracy:  0.648, Validation Accuracy:  0.635, Loss:  1.723\n",
      "Epoch   1 Batch  259/538 - Train Accuracy:  0.643, Validation Accuracy:  0.629, Loss:  1.669\n",
      "Epoch   1 Batch  260/538 - Train Accuracy:  0.617, Validation Accuracy:  0.625, Loss:  1.669\n",
      "Epoch   1 Batch  261/538 - Train Accuracy:  0.620, Validation Accuracy:  0.621, Loss:  1.641\n",
      "Epoch   1 Batch  262/538 - Train Accuracy:  0.613, Validation Accuracy:  0.628, Loss:  1.680\n",
      "Epoch   1 Batch  263/538 - Train Accuracy:  0.625, Validation Accuracy:  0.632, Loss:  1.670\n",
      "Epoch   1 Batch  264/538 - Train Accuracy:  0.607, Validation Accuracy:  0.635, Loss:  1.696\n",
      "Epoch   1 Batch  265/538 - Train Accuracy:  0.576, Validation Accuracy:  0.623, Loss:  1.701\n",
      "Epoch   1 Batch  266/538 - Train Accuracy:  0.638, Validation Accuracy:  0.632, Loss:  1.616\n",
      "Epoch   1 Batch  267/538 - Train Accuracy:  0.599, Validation Accuracy:  0.632, Loss:  1.698\n",
      "Epoch   1 Batch  268/538 - Train Accuracy:  0.641, Validation Accuracy:  0.633, Loss:  1.609\n",
      "Epoch   1 Batch  269/538 - Train Accuracy:  0.616, Validation Accuracy:  0.638, Loss:  1.650\n",
      "Epoch   1 Batch  270/538 - Train Accuracy:  0.621, Validation Accuracy:  0.640, Loss:  1.642\n",
      "Epoch   1 Batch  271/538 - Train Accuracy:  0.624, Validation Accuracy:  0.640, Loss:  1.662\n",
      "Epoch   1 Batch  272/538 - Train Accuracy:  0.594, Validation Accuracy:  0.639, Loss:  1.730\n",
      "Epoch   1 Batch  273/538 - Train Accuracy:  0.623, Validation Accuracy:  0.638, Loss:  1.688\n",
      "Epoch   1 Batch  274/538 - Train Accuracy:  0.588, Validation Accuracy:  0.640, Loss:  1.702\n",
      "Epoch   1 Batch  275/538 - Train Accuracy:  0.625, Validation Accuracy:  0.638, Loss:  1.717\n",
      "Epoch   1 Batch  276/538 - Train Accuracy:  0.638, Validation Accuracy:  0.638, Loss:  1.717\n",
      "Epoch   1 Batch  277/538 - Train Accuracy:  0.622, Validation Accuracy:  0.644, Loss:  1.673\n",
      "Epoch   1 Batch  278/538 - Train Accuracy:  0.623, Validation Accuracy:  0.641, Loss:  1.689\n",
      "Epoch   1 Batch  279/538 - Train Accuracy:  0.635, Validation Accuracy:  0.634, Loss:  1.658\n",
      "Epoch   1 Batch  280/538 - Train Accuracy:  0.674, Validation Accuracy:  0.636, Loss:  1.661\n",
      "Epoch   1 Batch  281/538 - Train Accuracy:  0.625, Validation Accuracy:  0.640, Loss:  1.722\n",
      "Epoch   1 Batch  282/538 - Train Accuracy:  0.639, Validation Accuracy:  0.637, Loss:  1.673\n",
      "Epoch   1 Batch  283/538 - Train Accuracy:  0.637, Validation Accuracy:  0.641, Loss:  1.658\n",
      "Epoch   1 Batch  284/538 - Train Accuracy:  0.640, Validation Accuracy:  0.634, Loss:  1.657\n",
      "Epoch   1 Batch  285/538 - Train Accuracy:  0.630, Validation Accuracy:  0.637, Loss:  1.688\n",
      "Epoch   1 Batch  286/538 - Train Accuracy:  0.605, Validation Accuracy:  0.637, Loss:  1.675\n",
      "Epoch   1 Batch  287/538 - Train Accuracy:  0.657, Validation Accuracy:  0.639, Loss:  1.652\n",
      "Epoch   1 Batch  288/538 - Train Accuracy:  0.595, Validation Accuracy:  0.641, Loss:  1.707\n",
      "Epoch   1 Batch  289/538 - Train Accuracy:  0.677, Validation Accuracy:  0.644, Loss:  1.577\n",
      "Epoch   1 Batch  290/538 - Train Accuracy:  0.608, Validation Accuracy:  0.634, Loss:  1.658\n",
      "Epoch   1 Batch  291/538 - Train Accuracy:  0.624, Validation Accuracy:  0.632, Loss:  1.660\n",
      "Epoch   1 Batch  292/538 - Train Accuracy:  0.641, Validation Accuracy:  0.633, Loss:  1.649\n",
      "Epoch   1 Batch  293/538 - Train Accuracy:  0.614, Validation Accuracy:  0.634, Loss:  1.635\n",
      "Epoch   1 Batch  294/538 - Train Accuracy:  0.604, Validation Accuracy:  0.631, Loss:  1.686\n",
      "Epoch   1 Batch  295/538 - Train Accuracy:  0.648, Validation Accuracy:  0.631, Loss:  1.623\n",
      "Epoch   1 Batch  296/538 - Train Accuracy:  0.619, Validation Accuracy:  0.617, Loss:  1.669\n",
      "Epoch   1 Batch  297/538 - Train Accuracy:  0.610, Validation Accuracy:  0.622, Loss:  1.701\n",
      "Epoch   1 Batch  298/538 - Train Accuracy:  0.611, Validation Accuracy:  0.633, Loss:  1.699\n",
      "Epoch   1 Batch  299/538 - Train Accuracy:  0.633, Validation Accuracy:  0.638, Loss:  1.677\n",
      "Epoch   1 Batch  300/538 - Train Accuracy:  0.653, Validation Accuracy:  0.636, Loss:  1.616\n",
      "Epoch   1 Batch  301/538 - Train Accuracy:  0.620, Validation Accuracy:  0.636, Loss:  1.669\n",
      "Epoch   1 Batch  302/538 - Train Accuracy:  0.648, Validation Accuracy:  0.623, Loss:  1.625\n",
      "Epoch   1 Batch  303/538 - Train Accuracy:  0.670, Validation Accuracy:  0.627, Loss:  1.680\n",
      "Epoch   1 Batch  304/538 - Train Accuracy:  0.622, Validation Accuracy:  0.622, Loss:  1.678\n",
      "Epoch   1 Batch  305/538 - Train Accuracy:  0.623, Validation Accuracy:  0.627, Loss:  1.656\n",
      "Epoch   1 Batch  306/538 - Train Accuracy:  0.640, Validation Accuracy:  0.639, Loss:  1.673\n",
      "Epoch   1 Batch  307/538 - Train Accuracy:  0.631, Validation Accuracy:  0.644, Loss:  1.627\n",
      "Epoch   1 Batch  308/538 - Train Accuracy:  0.640, Validation Accuracy:  0.637, Loss:  1.600\n",
      "Epoch   1 Batch  309/538 - Train Accuracy:  0.607, Validation Accuracy:  0.636, Loss:  1.613\n",
      "Epoch   1 Batch  310/538 - Train Accuracy:  0.632, Validation Accuracy:  0.636, Loss:  1.663\n",
      "Epoch   1 Batch  311/538 - Train Accuracy:  0.626, Validation Accuracy:  0.635, Loss:  1.643\n",
      "Epoch   1 Batch  312/538 - Train Accuracy:  0.680, Validation Accuracy:  0.640, Loss:  1.616\n",
      "Epoch   1 Batch  313/538 - Train Accuracy:  0.611, Validation Accuracy:  0.638, Loss:  1.695\n",
      "Epoch   1 Batch  314/538 - Train Accuracy:  0.635, Validation Accuracy:  0.642, Loss:  1.655\n",
      "Epoch   1 Batch  315/538 - Train Accuracy:  0.620, Validation Accuracy:  0.645, Loss:  1.656\n",
      "Epoch   1 Batch  316/538 - Train Accuracy:  0.638, Validation Accuracy:  0.644, Loss:  1.691\n",
      "Epoch   1 Batch  317/538 - Train Accuracy:  0.640, Validation Accuracy:  0.645, Loss:  1.664\n",
      "Epoch   1 Batch  318/538 - Train Accuracy:  0.614, Validation Accuracy:  0.646, Loss:  1.699\n",
      "Epoch   1 Batch  319/538 - Train Accuracy:  0.643, Validation Accuracy:  0.647, Loss:  1.627\n",
      "Epoch   1 Batch  320/538 - Train Accuracy:  0.641, Validation Accuracy:  0.642, Loss:  1.637\n",
      "Epoch   1 Batch  321/538 - Train Accuracy:  0.631, Validation Accuracy:  0.638, Loss:  1.651\n",
      "Epoch   1 Batch  322/538 - Train Accuracy:  0.634, Validation Accuracy:  0.637, Loss:  1.659\n",
      "Epoch   1 Batch  323/538 - Train Accuracy:  0.633, Validation Accuracy:  0.639, Loss:  1.683\n",
      "Epoch   1 Batch  324/538 - Train Accuracy:  0.588, Validation Accuracy:  0.639, Loss:  1.683\n",
      "Epoch   1 Batch  325/538 - Train Accuracy:  0.630, Validation Accuracy:  0.643, Loss:  1.630\n",
      "Epoch   1 Batch  326/538 - Train Accuracy:  0.607, Validation Accuracy:  0.643, Loss:  1.668\n",
      "Epoch   1 Batch  327/538 - Train Accuracy:  0.628, Validation Accuracy:  0.640, Loss:  1.596\n",
      "Epoch   1 Batch  328/538 - Train Accuracy:  0.650, Validation Accuracy:  0.644, Loss:  1.643\n",
      "Epoch   1 Batch  329/538 - Train Accuracy:  0.661, Validation Accuracy:  0.640, Loss:  1.587\n",
      "Epoch   1 Batch  330/538 - Train Accuracy:  0.635, Validation Accuracy:  0.639, Loss:  1.613\n",
      "Epoch   1 Batch  331/538 - Train Accuracy:  0.618, Validation Accuracy:  0.640, Loss:  1.667\n",
      "Epoch   1 Batch  332/538 - Train Accuracy:  0.621, Validation Accuracy:  0.643, Loss:  1.664\n",
      "Epoch   1 Batch  333/538 - Train Accuracy:  0.632, Validation Accuracy:  0.646, Loss:  1.633\n",
      "Epoch   1 Batch  334/538 - Train Accuracy:  0.657, Validation Accuracy:  0.643, Loss:  1.553\n",
      "Epoch   1 Batch  335/538 - Train Accuracy:  0.637, Validation Accuracy:  0.647, Loss:  1.647\n",
      "Epoch   1 Batch  336/538 - Train Accuracy:  0.650, Validation Accuracy:  0.649, Loss:  1.631\n",
      "Epoch   1 Batch  337/538 - Train Accuracy:  0.654, Validation Accuracy:  0.648, Loss:  1.639\n",
      "Epoch   1 Batch  338/538 - Train Accuracy:  0.609, Validation Accuracy:  0.648, Loss:  1.610\n",
      "Epoch   1 Batch  339/538 - Train Accuracy:  0.641, Validation Accuracy:  0.646, Loss:  1.620\n",
      "Epoch   1 Batch  340/538 - Train Accuracy:  0.616, Validation Accuracy:  0.651, Loss:  1.674\n",
      "Epoch   1 Batch  341/538 - Train Accuracy:  0.618, Validation Accuracy:  0.650, Loss:  1.615\n",
      "Epoch   1 Batch  342/538 - Train Accuracy:  0.648, Validation Accuracy:  0.651, Loss:  1.581\n",
      "Epoch   1 Batch  343/538 - Train Accuracy:  0.651, Validation Accuracy:  0.650, Loss:  1.631\n",
      "Epoch   1 Batch  344/538 - Train Accuracy:  0.629, Validation Accuracy:  0.652, Loss:  1.692\n",
      "Epoch   1 Batch  345/538 - Train Accuracy:  0.650, Validation Accuracy:  0.653, Loss:  1.657\n",
      "Epoch   1 Batch  346/538 - Train Accuracy:  0.623, Validation Accuracy:  0.652, Loss:  1.648\n",
      "Epoch   1 Batch  347/538 - Train Accuracy:  0.627, Validation Accuracy:  0.656, Loss:  1.660\n",
      "Epoch   1 Batch  348/538 - Train Accuracy:  0.624, Validation Accuracy:  0.653, Loss:  1.628\n",
      "Epoch   1 Batch  349/538 - Train Accuracy:  0.608, Validation Accuracy:  0.651, Loss:  1.662\n",
      "Epoch   1 Batch  350/538 - Train Accuracy:  0.634, Validation Accuracy:  0.647, Loss:  1.719\n",
      "Epoch   1 Batch  351/538 - Train Accuracy:  0.623, Validation Accuracy:  0.640, Loss:  1.720\n",
      "Epoch   1 Batch  352/538 - Train Accuracy:  0.661, Validation Accuracy:  0.636, Loss:  1.645\n",
      "Epoch   1 Batch  353/538 - Train Accuracy:  0.636, Validation Accuracy:  0.638, Loss:  1.680\n",
      "Epoch   1 Batch  354/538 - Train Accuracy:  0.619, Validation Accuracy:  0.644, Loss:  1.619\n",
      "Epoch   1 Batch  355/538 - Train Accuracy:  0.618, Validation Accuracy:  0.649, Loss:  1.593\n",
      "Epoch   1 Batch  356/538 - Train Accuracy:  0.630, Validation Accuracy:  0.653, Loss:  1.646\n",
      "Epoch   1 Batch  357/538 - Train Accuracy:  0.638, Validation Accuracy:  0.651, Loss:  1.654\n",
      "Epoch   1 Batch  358/538 - Train Accuracy:  0.628, Validation Accuracy:  0.651, Loss:  1.681\n",
      "Epoch   1 Batch  359/538 - Train Accuracy:  0.650, Validation Accuracy:  0.651, Loss:  1.610\n",
      "Epoch   1 Batch  360/538 - Train Accuracy:  0.644, Validation Accuracy:  0.645, Loss:  1.623\n",
      "Epoch   1 Batch  361/538 - Train Accuracy:  0.643, Validation Accuracy:  0.648, Loss:  1.659\n",
      "Epoch   1 Batch  362/538 - Train Accuracy:  0.640, Validation Accuracy:  0.647, Loss:  1.579\n",
      "Epoch   1 Batch  363/538 - Train Accuracy:  0.638, Validation Accuracy:  0.650, Loss:  1.583\n",
      "Epoch   1 Batch  364/538 - Train Accuracy:  0.606, Validation Accuracy:  0.649, Loss:  1.636\n",
      "Epoch   1 Batch  365/538 - Train Accuracy:  0.643, Validation Accuracy:  0.645, Loss:  1.654\n",
      "Epoch   1 Batch  366/538 - Train Accuracy:  0.644, Validation Accuracy:  0.652, Loss:  1.690\n",
      "Epoch   1 Batch  367/538 - Train Accuracy:  0.656, Validation Accuracy:  0.655, Loss:  1.609\n",
      "Epoch   1 Batch  368/538 - Train Accuracy:  0.694, Validation Accuracy:  0.659, Loss:  1.535\n",
      "Epoch   1 Batch  369/538 - Train Accuracy:  0.643, Validation Accuracy:  0.664, Loss:  1.603\n",
      "Epoch   1 Batch  370/538 - Train Accuracy:  0.633, Validation Accuracy:  0.661, Loss:  1.620\n",
      "Epoch   1 Batch  371/538 - Train Accuracy:  0.644, Validation Accuracy:  0.659, Loss:  1.594\n",
      "Epoch   1 Batch  372/538 - Train Accuracy:  0.645, Validation Accuracy:  0.656, Loss:  1.614\n",
      "Epoch   1 Batch  373/538 - Train Accuracy:  0.647, Validation Accuracy:  0.650, Loss:  1.620\n",
      "Epoch   1 Batch  374/538 - Train Accuracy:  0.630, Validation Accuracy:  0.646, Loss:  1.605\n",
      "Epoch   1 Batch  375/538 - Train Accuracy:  0.653, Validation Accuracy:  0.651, Loss:  1.597\n",
      "Epoch   1 Batch  376/538 - Train Accuracy:  0.640, Validation Accuracy:  0.654, Loss:  1.656\n",
      "Epoch   1 Batch  377/538 - Train Accuracy:  0.645, Validation Accuracy:  0.657, Loss:  1.606\n",
      "Epoch   1 Batch  378/538 - Train Accuracy:  0.649, Validation Accuracy:  0.661, Loss:  1.603\n",
      "Epoch   1 Batch  379/538 - Train Accuracy:  0.666, Validation Accuracy:  0.647, Loss:  1.615\n",
      "Epoch   1 Batch  380/538 - Train Accuracy:  0.626, Validation Accuracy:  0.647, Loss:  1.591\n",
      "Epoch   1 Batch  381/538 - Train Accuracy:  0.636, Validation Accuracy:  0.647, Loss:  1.597\n",
      "Epoch   1 Batch  382/538 - Train Accuracy:  0.654, Validation Accuracy:  0.644, Loss:  1.626\n",
      "Epoch   1 Batch  383/538 - Train Accuracy:  0.641, Validation Accuracy:  0.643, Loss:  1.592\n",
      "Epoch   1 Batch  384/538 - Train Accuracy:  0.665, Validation Accuracy:  0.638, Loss:  1.613\n",
      "Epoch   1 Batch  385/538 - Train Accuracy:  0.659, Validation Accuracy:  0.638, Loss:  1.593\n",
      "Epoch   1 Batch  386/538 - Train Accuracy:  0.632, Validation Accuracy:  0.635, Loss:  1.658\n",
      "Epoch   1 Batch  387/538 - Train Accuracy:  0.640, Validation Accuracy:  0.637, Loss:  1.657\n",
      "Epoch   1 Batch  388/538 - Train Accuracy:  0.647, Validation Accuracy:  0.649, Loss:  1.613\n",
      "Epoch   1 Batch  389/538 - Train Accuracy:  0.649, Validation Accuracy:  0.648, Loss:  1.667\n",
      "Epoch   1 Batch  390/538 - Train Accuracy:  0.673, Validation Accuracy:  0.647, Loss:  1.585\n",
      "Epoch   1 Batch  391/538 - Train Accuracy:  0.648, Validation Accuracy:  0.657, Loss:  1.643\n",
      "Epoch   1 Batch  392/538 - Train Accuracy:  0.647, Validation Accuracy:  0.659, Loss:  1.641\n",
      "Epoch   1 Batch  393/538 - Train Accuracy:  0.655, Validation Accuracy:  0.654, Loss:  1.557\n",
      "Epoch   1 Batch  394/538 - Train Accuracy:  0.596, Validation Accuracy:  0.651, Loss:  1.664\n",
      "Epoch   1 Batch  395/538 - Train Accuracy:  0.635, Validation Accuracy:  0.657, Loss:  1.629\n",
      "Epoch   1 Batch  396/538 - Train Accuracy:  0.643, Validation Accuracy:  0.654, Loss:  1.613\n",
      "Epoch   1 Batch  397/538 - Train Accuracy:  0.627, Validation Accuracy:  0.651, Loss:  1.682\n",
      "Epoch   1 Batch  398/538 - Train Accuracy:  0.645, Validation Accuracy:  0.653, Loss:  1.590\n",
      "Epoch   1 Batch  399/538 - Train Accuracy:  0.628, Validation Accuracy:  0.647, Loss:  1.653\n",
      "Epoch   1 Batch  400/538 - Train Accuracy:  0.635, Validation Accuracy:  0.651, Loss:  1.597\n",
      "Epoch   1 Batch  401/538 - Train Accuracy:  0.644, Validation Accuracy:  0.650, Loss:  1.591\n",
      "Epoch   1 Batch  402/538 - Train Accuracy:  0.655, Validation Accuracy:  0.649, Loss:  1.627\n",
      "Epoch   1 Batch  403/538 - Train Accuracy:  0.626, Validation Accuracy:  0.648, Loss:  1.631\n",
      "Epoch   1 Batch  404/538 - Train Accuracy:  0.664, Validation Accuracy:  0.649, Loss:  1.619\n",
      "Epoch   1 Batch  405/538 - Train Accuracy:  0.651, Validation Accuracy:  0.652, Loss:  1.608\n",
      "Epoch   1 Batch  406/538 - Train Accuracy:  0.660, Validation Accuracy:  0.651, Loss:  1.586\n",
      "Epoch   1 Batch  407/538 - Train Accuracy:  0.649, Validation Accuracy:  0.654, Loss:  1.621\n",
      "Epoch   1 Batch  408/538 - Train Accuracy:  0.625, Validation Accuracy:  0.658, Loss:  1.655\n",
      "Epoch   1 Batch  409/538 - Train Accuracy:  0.621, Validation Accuracy:  0.655, Loss:  1.581\n",
      "Epoch   1 Batch  410/538 - Train Accuracy:  0.657, Validation Accuracy:  0.648, Loss:  1.596\n",
      "Epoch   1 Batch  411/538 - Train Accuracy:  0.649, Validation Accuracy:  0.647, Loss:  1.591\n",
      "Epoch   1 Batch  412/538 - Train Accuracy:  0.658, Validation Accuracy:  0.649, Loss:  1.589\n",
      "Epoch   1 Batch  413/538 - Train Accuracy:  0.643, Validation Accuracy:  0.649, Loss:  1.564\n",
      "Epoch   1 Batch  414/538 - Train Accuracy:  0.641, Validation Accuracy:  0.661, Loss:  1.640\n",
      "Epoch   1 Batch  415/538 - Train Accuracy:  0.627, Validation Accuracy:  0.660, Loss:  1.665\n",
      "Epoch   1 Batch  416/538 - Train Accuracy:  0.697, Validation Accuracy:  0.662, Loss:  1.574\n",
      "Epoch   1 Batch  417/538 - Train Accuracy:  0.657, Validation Accuracy:  0.660, Loss:  1.626\n",
      "Epoch   1 Batch  418/538 - Train Accuracy:  0.625, Validation Accuracy:  0.658, Loss:  1.615\n",
      "Epoch   1 Batch  419/538 - Train Accuracy:  0.655, Validation Accuracy:  0.656, Loss:  1.611\n",
      "Epoch   1 Batch  420/538 - Train Accuracy:  0.647, Validation Accuracy:  0.655, Loss:  1.619\n",
      "Epoch   1 Batch  421/538 - Train Accuracy:  0.651, Validation Accuracy:  0.659, Loss:  1.577\n",
      "Epoch   1 Batch  422/538 - Train Accuracy:  0.640, Validation Accuracy:  0.657, Loss:  1.665\n",
      "Epoch   1 Batch  423/538 - Train Accuracy:  0.642, Validation Accuracy:  0.654, Loss:  1.604\n",
      "Epoch   1 Batch  424/538 - Train Accuracy:  0.644, Validation Accuracy:  0.654, Loss:  1.621\n",
      "Epoch   1 Batch  425/538 - Train Accuracy:  0.646, Validation Accuracy:  0.660, Loss:  1.640\n",
      "Epoch   1 Batch  426/538 - Train Accuracy:  0.679, Validation Accuracy:  0.661, Loss:  1.644\n",
      "Epoch   1 Batch  427/538 - Train Accuracy:  0.651, Validation Accuracy:  0.659, Loss:  1.602\n",
      "Epoch   1 Batch  428/538 - Train Accuracy:  0.674, Validation Accuracy:  0.665, Loss:  1.610\n",
      "Epoch   1 Batch  429/538 - Train Accuracy:  0.664, Validation Accuracy:  0.662, Loss:  1.627\n",
      "Epoch   1 Batch  430/538 - Train Accuracy:  0.652, Validation Accuracy:  0.662, Loss:  1.590\n",
      "Epoch   1 Batch  431/538 - Train Accuracy:  0.643, Validation Accuracy:  0.665, Loss:  1.593\n",
      "Epoch   1 Batch  432/538 - Train Accuracy:  0.692, Validation Accuracy:  0.663, Loss:  1.570\n",
      "Epoch   1 Batch  433/538 - Train Accuracy:  0.638, Validation Accuracy:  0.661, Loss:  1.639\n",
      "Epoch   1 Batch  434/538 - Train Accuracy:  0.644, Validation Accuracy:  0.659, Loss:  1.602\n",
      "Epoch   1 Batch  435/538 - Train Accuracy:  0.631, Validation Accuracy:  0.661, Loss:  1.651\n",
      "Epoch   1 Batch  436/538 - Train Accuracy:  0.639, Validation Accuracy:  0.660, Loss:  1.645\n",
      "Epoch   1 Batch  437/538 - Train Accuracy:  0.636, Validation Accuracy:  0.657, Loss:  1.572\n",
      "Epoch   1 Batch  438/538 - Train Accuracy:  0.664, Validation Accuracy:  0.661, Loss:  1.569\n",
      "Epoch   1 Batch  439/538 - Train Accuracy:  0.661, Validation Accuracy:  0.663, Loss:  1.593\n",
      "Epoch   1 Batch  440/538 - Train Accuracy:  0.643, Validation Accuracy:  0.664, Loss:  1.661\n",
      "Epoch   1 Batch  441/538 - Train Accuracy:  0.633, Validation Accuracy:  0.671, Loss:  1.565\n",
      "Epoch   1 Batch  442/538 - Train Accuracy:  0.683, Validation Accuracy:  0.679, Loss:  1.586\n",
      "Epoch   1 Batch  443/538 - Train Accuracy:  0.666, Validation Accuracy:  0.679, Loss:  1.585\n",
      "Epoch   1 Batch  444/538 - Train Accuracy:  0.700, Validation Accuracy:  0.678, Loss:  1.580\n",
      "Epoch   1 Batch  445/538 - Train Accuracy:  0.671, Validation Accuracy:  0.679, Loss:  1.588\n",
      "Epoch   1 Batch  446/538 - Train Accuracy:  0.674, Validation Accuracy:  0.676, Loss:  1.600\n",
      "Epoch   1 Batch  447/538 - Train Accuracy:  0.647, Validation Accuracy:  0.674, Loss:  1.567\n",
      "Epoch   1 Batch  448/538 - Train Accuracy:  0.677, Validation Accuracy:  0.670, Loss:  1.544\n",
      "Epoch   1 Batch  449/538 - Train Accuracy:  0.666, Validation Accuracy:  0.672, Loss:  1.611\n",
      "Epoch   1 Batch  450/538 - Train Accuracy:  0.689, Validation Accuracy:  0.668, Loss:  1.630\n",
      "Epoch   1 Batch  451/538 - Train Accuracy:  0.646, Validation Accuracy:  0.662, Loss:  1.602\n",
      "Epoch   1 Batch  452/538 - Train Accuracy:  0.663, Validation Accuracy:  0.663, Loss:  1.595\n",
      "Epoch   1 Batch  453/538 - Train Accuracy:  0.636, Validation Accuracy:  0.665, Loss:  1.627\n",
      "Epoch   1 Batch  454/538 - Train Accuracy:  0.669, Validation Accuracy:  0.660, Loss:  1.599\n",
      "Epoch   1 Batch  455/538 - Train Accuracy:  0.681, Validation Accuracy:  0.663, Loss:  1.534\n",
      "Epoch   1 Batch  456/538 - Train Accuracy:  0.703, Validation Accuracy:  0.659, Loss:  1.570\n",
      "Epoch   1 Batch  457/538 - Train Accuracy:  0.648, Validation Accuracy:  0.662, Loss:  1.610\n",
      "Epoch   1 Batch  458/538 - Train Accuracy:  0.648, Validation Accuracy:  0.663, Loss:  1.569\n",
      "Epoch   1 Batch  459/538 - Train Accuracy:  0.681, Validation Accuracy:  0.670, Loss:  1.565\n",
      "Epoch   1 Batch  460/538 - Train Accuracy:  0.644, Validation Accuracy:  0.676, Loss:  1.634\n",
      "Epoch   1 Batch  461/538 - Train Accuracy:  0.624, Validation Accuracy:  0.676, Loss:  1.583\n",
      "Epoch   1 Batch  462/538 - Train Accuracy:  0.667, Validation Accuracy:  0.676, Loss:  1.587\n",
      "Epoch   1 Batch  463/538 - Train Accuracy:  0.642, Validation Accuracy:  0.679, Loss:  1.612\n",
      "Epoch   1 Batch  464/538 - Train Accuracy:  0.654, Validation Accuracy:  0.675, Loss:  1.625\n",
      "Epoch   1 Batch  465/538 - Train Accuracy:  0.631, Validation Accuracy:  0.676, Loss:  1.561\n",
      "Epoch   1 Batch  466/538 - Train Accuracy:  0.644, Validation Accuracy:  0.664, Loss:  1.575\n",
      "Epoch   1 Batch  467/538 - Train Accuracy:  0.653, Validation Accuracy:  0.671, Loss:  1.547\n",
      "Epoch   1 Batch  468/538 - Train Accuracy:  0.687, Validation Accuracy:  0.678, Loss:  1.656\n",
      "Epoch   1 Batch  469/538 - Train Accuracy:  0.665, Validation Accuracy:  0.674, Loss:  1.584\n",
      "Epoch   1 Batch  470/538 - Train Accuracy:  0.673, Validation Accuracy:  0.682, Loss:  1.563\n",
      "Epoch   1 Batch  471/538 - Train Accuracy:  0.657, Validation Accuracy:  0.676, Loss:  1.583\n",
      "Epoch   1 Batch  472/538 - Train Accuracy:  0.675, Validation Accuracy:  0.674, Loss:  1.554\n",
      "Epoch   1 Batch  473/538 - Train Accuracy:  0.633, Validation Accuracy:  0.675, Loss:  1.596\n",
      "Epoch   1 Batch  474/538 - Train Accuracy:  0.678, Validation Accuracy:  0.673, Loss:  1.582\n",
      "Epoch   1 Batch  475/538 - Train Accuracy:  0.664, Validation Accuracy:  0.669, Loss:  1.592\n",
      "Epoch   1 Batch  476/538 - Train Accuracy:  0.642, Validation Accuracy:  0.675, Loss:  1.577\n",
      "Epoch   1 Batch  477/538 - Train Accuracy:  0.681, Validation Accuracy:  0.673, Loss:  1.583\n",
      "Epoch   1 Batch  478/538 - Train Accuracy:  0.682, Validation Accuracy:  0.681, Loss:  1.553\n",
      "Epoch   1 Batch  479/538 - Train Accuracy:  0.674, Validation Accuracy:  0.687, Loss:  1.555\n",
      "Epoch   1 Batch  480/538 - Train Accuracy:  0.683, Validation Accuracy:  0.682, Loss:  1.582\n",
      "Epoch   1 Batch  481/538 - Train Accuracy:  0.680, Validation Accuracy:  0.681, Loss:  1.584\n",
      "Epoch   1 Batch  482/538 - Train Accuracy:  0.681, Validation Accuracy:  0.679, Loss:  1.491\n",
      "Epoch   1 Batch  483/538 - Train Accuracy:  0.641, Validation Accuracy:  0.673, Loss:  1.598\n",
      "Epoch   1 Batch  484/538 - Train Accuracy:  0.686, Validation Accuracy:  0.661, Loss:  1.601\n",
      "Epoch   1 Batch  485/538 - Train Accuracy:  0.658, Validation Accuracy:  0.664, Loss:  1.561\n",
      "Epoch   1 Batch  486/538 - Train Accuracy:  0.662, Validation Accuracy:  0.662, Loss:  1.536\n",
      "Epoch   1 Batch  487/538 - Train Accuracy:  0.678, Validation Accuracy:  0.663, Loss:  1.571\n",
      "Epoch   1 Batch  488/538 - Train Accuracy:  0.704, Validation Accuracy:  0.668, Loss:  1.577\n",
      "Epoch   1 Batch  489/538 - Train Accuracy:  0.660, Validation Accuracy:  0.672, Loss:  1.625\n",
      "Epoch   1 Batch  490/538 - Train Accuracy:  0.656, Validation Accuracy:  0.678, Loss:  1.612\n",
      "Epoch   1 Batch  491/538 - Train Accuracy:  0.671, Validation Accuracy:  0.678, Loss:  1.581\n",
      "Epoch   1 Batch  492/538 - Train Accuracy:  0.683, Validation Accuracy:  0.679, Loss:  1.587\n",
      "Epoch   1 Batch  493/538 - Train Accuracy:  0.644, Validation Accuracy:  0.684, Loss:  1.592\n",
      "Epoch   1 Batch  494/538 - Train Accuracy:  0.679, Validation Accuracy:  0.684, Loss:  1.599\n",
      "Epoch   1 Batch  495/538 - Train Accuracy:  0.680, Validation Accuracy:  0.684, Loss:  1.591\n",
      "Epoch   1 Batch  496/538 - Train Accuracy:  0.686, Validation Accuracy:  0.683, Loss:  1.572\n",
      "Epoch   1 Batch  497/538 - Train Accuracy:  0.696, Validation Accuracy:  0.685, Loss:  1.560\n",
      "Epoch   1 Batch  498/538 - Train Accuracy:  0.642, Validation Accuracy:  0.683, Loss:  1.547\n",
      "Epoch   1 Batch  499/538 - Train Accuracy:  0.708, Validation Accuracy:  0.684, Loss:  1.552\n",
      "Epoch   1 Batch  500/538 - Train Accuracy:  0.694, Validation Accuracy:  0.686, Loss:  1.498\n",
      "Epoch   1 Batch  501/538 - Train Accuracy:  0.680, Validation Accuracy:  0.686, Loss:  1.543\n",
      "Epoch   1 Batch  502/538 - Train Accuracy:  0.654, Validation Accuracy:  0.684, Loss:  1.579\n",
      "Epoch   1 Batch  503/538 - Train Accuracy:  0.702, Validation Accuracy:  0.686, Loss:  1.567\n",
      "Epoch   1 Batch  504/538 - Train Accuracy:  0.657, Validation Accuracy:  0.681, Loss:  1.563\n",
      "Epoch   1 Batch  505/538 - Train Accuracy:  0.682, Validation Accuracy:  0.685, Loss:  1.554\n",
      "Epoch   1 Batch  506/538 - Train Accuracy:  0.687, Validation Accuracy:  0.682, Loss:  1.547\n",
      "Epoch   1 Batch  507/538 - Train Accuracy:  0.645, Validation Accuracy:  0.685, Loss:  1.640\n",
      "Epoch   1 Batch  508/538 - Train Accuracy:  0.672, Validation Accuracy:  0.684, Loss:  1.498\n",
      "Epoch   1 Batch  509/538 - Train Accuracy:  0.669, Validation Accuracy:  0.682, Loss:  1.573\n",
      "Epoch   1 Batch  510/538 - Train Accuracy:  0.681, Validation Accuracy:  0.677, Loss:  1.544\n",
      "Epoch   1 Batch  511/538 - Train Accuracy:  0.696, Validation Accuracy:  0.673, Loss:  1.585\n",
      "Epoch   1 Batch  512/538 - Train Accuracy:  0.699, Validation Accuracy:  0.673, Loss:  1.547\n",
      "Epoch   1 Batch  513/538 - Train Accuracy:  0.648, Validation Accuracy:  0.679, Loss:  1.586\n",
      "Epoch   1 Batch  514/538 - Train Accuracy:  0.672, Validation Accuracy:  0.675, Loss:  1.628\n",
      "Epoch   1 Batch  515/538 - Train Accuracy:  0.679, Validation Accuracy:  0.677, Loss:  1.579\n",
      "Epoch   1 Batch  516/538 - Train Accuracy:  0.631, Validation Accuracy:  0.678, Loss:  1.532\n",
      "Epoch   1 Batch  517/538 - Train Accuracy:  0.659, Validation Accuracy:  0.672, Loss:  1.570\n",
      "Epoch   1 Batch  518/538 - Train Accuracy:  0.636, Validation Accuracy:  0.660, Loss:  1.547\n",
      "Epoch   1 Batch  519/538 - Train Accuracy:  0.685, Validation Accuracy:  0.670, Loss:  1.580\n",
      "Epoch   1 Batch  520/538 - Train Accuracy:  0.671, Validation Accuracy:  0.690, Loss:  1.586\n",
      "Epoch   1 Batch  521/538 - Train Accuracy:  0.684, Validation Accuracy:  0.689, Loss:  1.548\n",
      "Epoch   1 Batch  522/538 - Train Accuracy:  0.662, Validation Accuracy:  0.684, Loss:  1.560\n",
      "Epoch   1 Batch  523/538 - Train Accuracy:  0.679, Validation Accuracy:  0.683, Loss:  1.540\n",
      "Epoch   1 Batch  524/538 - Train Accuracy:  0.649, Validation Accuracy:  0.681, Loss:  1.554\n",
      "Epoch   1 Batch  525/538 - Train Accuracy:  0.695, Validation Accuracy:  0.683, Loss:  1.554\n",
      "Epoch   1 Batch  526/538 - Train Accuracy:  0.680, Validation Accuracy:  0.682, Loss:  1.484\n",
      "Epoch   1 Batch  527/538 - Train Accuracy:  0.706, Validation Accuracy:  0.686, Loss:  1.596\n",
      "Epoch   1 Batch  528/538 - Train Accuracy:  0.675, Validation Accuracy:  0.689, Loss:  1.633\n",
      "Epoch   1 Batch  529/538 - Train Accuracy:  0.672, Validation Accuracy:  0.693, Loss:  1.554\n",
      "Epoch   1 Batch  530/538 - Train Accuracy:  0.673, Validation Accuracy:  0.689, Loss:  1.561\n",
      "Epoch   1 Batch  531/538 - Train Accuracy:  0.690, Validation Accuracy:  0.692, Loss:  1.542\n",
      "Epoch   1 Batch  532/538 - Train Accuracy:  0.657, Validation Accuracy:  0.690, Loss:  1.522\n",
      "Epoch   1 Batch  533/538 - Train Accuracy:  0.687, Validation Accuracy:  0.681, Loss:  1.582\n",
      "Epoch   1 Batch  534/538 - Train Accuracy:  0.669, Validation Accuracy:  0.681, Loss:  1.565\n",
      "Epoch   1 Batch  535/538 - Train Accuracy:  0.695, Validation Accuracy:  0.679, Loss:  1.566\n",
      "Epoch   1 Batch  536/538 - Train Accuracy:  0.693, Validation Accuracy:  0.679, Loss:  1.570\n",
      "Epoch   2 Batch    0/538 - Train Accuracy:  0.639, Validation Accuracy:  0.684, Loss:  1.548\n",
      "Epoch   2 Batch    1/538 - Train Accuracy:  0.668, Validation Accuracy:  0.677, Loss:  1.564\n",
      "Epoch   2 Batch    2/538 - Train Accuracy:  0.652, Validation Accuracy:  0.676, Loss:  1.567\n",
      "Epoch   2 Batch    3/538 - Train Accuracy:  0.654, Validation Accuracy:  0.682, Loss:  1.547\n",
      "Epoch   2 Batch    4/538 - Train Accuracy:  0.699, Validation Accuracy:  0.678, Loss:  1.596\n",
      "Epoch   2 Batch    5/538 - Train Accuracy:  0.646, Validation Accuracy:  0.678, Loss:  1.556\n",
      "Epoch   2 Batch    6/538 - Train Accuracy:  0.688, Validation Accuracy:  0.676, Loss:  1.548\n",
      "Epoch   2 Batch    7/538 - Train Accuracy:  0.695, Validation Accuracy:  0.683, Loss:  1.578\n",
      "Epoch   2 Batch    8/538 - Train Accuracy:  0.691, Validation Accuracy:  0.682, Loss:  1.541\n",
      "Epoch   2 Batch    9/538 - Train Accuracy:  0.681, Validation Accuracy:  0.677, Loss:  1.581\n",
      "Epoch   2 Batch   10/538 - Train Accuracy:  0.656, Validation Accuracy:  0.677, Loss:  1.586\n",
      "Epoch   2 Batch   11/538 - Train Accuracy:  0.691, Validation Accuracy:  0.684, Loss:  1.586\n",
      "Epoch   2 Batch   12/538 - Train Accuracy:  0.662, Validation Accuracy:  0.678, Loss:  1.558\n",
      "Epoch   2 Batch   13/538 - Train Accuracy:  0.719, Validation Accuracy:  0.680, Loss:  1.513\n",
      "Epoch   2 Batch   14/538 - Train Accuracy:  0.666, Validation Accuracy:  0.674, Loss:  1.581\n",
      "Epoch   2 Batch   15/538 - Train Accuracy:  0.681, Validation Accuracy:  0.661, Loss:  1.509\n",
      "Epoch   2 Batch   16/538 - Train Accuracy:  0.659, Validation Accuracy:  0.662, Loss:  1.553\n",
      "Epoch   2 Batch   17/538 - Train Accuracy:  0.662, Validation Accuracy:  0.683, Loss:  1.548\n",
      "Epoch   2 Batch   18/538 - Train Accuracy:  0.674, Validation Accuracy:  0.685, Loss:  1.586\n",
      "Epoch   2 Batch   19/538 - Train Accuracy:  0.662, Validation Accuracy:  0.697, Loss:  1.556\n",
      "Epoch   2 Batch   20/538 - Train Accuracy:  0.668, Validation Accuracy:  0.694, Loss:  1.550\n",
      "Epoch   2 Batch   21/538 - Train Accuracy:  0.679, Validation Accuracy:  0.694, Loss:  1.606\n",
      "Epoch   2 Batch   22/538 - Train Accuracy:  0.683, Validation Accuracy:  0.696, Loss:  1.543\n",
      "Epoch   2 Batch   23/538 - Train Accuracy:  0.697, Validation Accuracy:  0.696, Loss:  1.594\n",
      "Epoch   2 Batch   24/538 - Train Accuracy:  0.674, Validation Accuracy:  0.698, Loss:  1.587\n",
      "Epoch   2 Batch   25/538 - Train Accuracy:  0.672, Validation Accuracy:  0.701, Loss:  1.509\n",
      "Epoch   2 Batch   26/538 - Train Accuracy:  0.662, Validation Accuracy:  0.691, Loss:  1.585\n",
      "Epoch   2 Batch   27/538 - Train Accuracy:  0.691, Validation Accuracy:  0.695, Loss:  1.529\n",
      "Epoch   2 Batch   28/538 - Train Accuracy:  0.710, Validation Accuracy:  0.693, Loss:  1.511\n",
      "Epoch   2 Batch   29/538 - Train Accuracy:  0.694, Validation Accuracy:  0.692, Loss:  1.540\n",
      "Epoch   2 Batch   30/538 - Train Accuracy:  0.682, Validation Accuracy:  0.692, Loss:  1.607\n",
      "Epoch   2 Batch   31/538 - Train Accuracy:  0.676, Validation Accuracy:  0.694, Loss:  1.577\n",
      "Epoch   2 Batch   32/538 - Train Accuracy:  0.664, Validation Accuracy:  0.689, Loss:  1.534\n",
      "Epoch   2 Batch   33/538 - Train Accuracy:  0.685, Validation Accuracy:  0.687, Loss:  1.544\n",
      "Epoch   2 Batch   34/538 - Train Accuracy:  0.711, Validation Accuracy:  0.691, Loss:  1.539\n",
      "Epoch   2 Batch   35/538 - Train Accuracy:  0.688, Validation Accuracy:  0.692, Loss:  1.551\n",
      "Epoch   2 Batch   36/538 - Train Accuracy:  0.689, Validation Accuracy:  0.690, Loss:  1.532\n",
      "Epoch   2 Batch   37/538 - Train Accuracy:  0.696, Validation Accuracy:  0.693, Loss:  1.502\n",
      "Epoch   2 Batch   38/538 - Train Accuracy:  0.675, Validation Accuracy:  0.692, Loss:  1.547\n",
      "Epoch   2 Batch   39/538 - Train Accuracy:  0.709, Validation Accuracy:  0.690, Loss:  1.524\n",
      "Epoch   2 Batch   40/538 - Train Accuracy:  0.731, Validation Accuracy:  0.694, Loss:  1.494\n",
      "Epoch   2 Batch   41/538 - Train Accuracy:  0.685, Validation Accuracy:  0.695, Loss:  1.564\n",
      "Epoch   2 Batch   42/538 - Train Accuracy:  0.691, Validation Accuracy:  0.689, Loss:  1.544\n",
      "Epoch   2 Batch   43/538 - Train Accuracy:  0.710, Validation Accuracy:  0.698, Loss:  1.534\n",
      "Epoch   2 Batch   44/538 - Train Accuracy:  0.678, Validation Accuracy:  0.695, Loss:  1.544\n",
      "Epoch   2 Batch   45/538 - Train Accuracy:  0.696, Validation Accuracy:  0.700, Loss:  1.534\n",
      "Epoch   2 Batch   46/538 - Train Accuracy:  0.708, Validation Accuracy:  0.702, Loss:  1.550\n",
      "Epoch   2 Batch   47/538 - Train Accuracy:  0.688, Validation Accuracy:  0.701, Loss:  1.565\n",
      "Epoch   2 Batch   48/538 - Train Accuracy:  0.725, Validation Accuracy:  0.697, Loss:  1.505\n",
      "Epoch   2 Batch   49/538 - Train Accuracy:  0.675, Validation Accuracy:  0.697, Loss:  1.599\n",
      "Epoch   2 Batch   50/538 - Train Accuracy:  0.690, Validation Accuracy:  0.698, Loss:  1.549\n",
      "Epoch   2 Batch   51/538 - Train Accuracy:  0.655, Validation Accuracy:  0.700, Loss:  1.585\n",
      "Epoch   2 Batch   52/538 - Train Accuracy:  0.692, Validation Accuracy:  0.697, Loss:  1.516\n",
      "Epoch   2 Batch   53/538 - Train Accuracy:  0.702, Validation Accuracy:  0.688, Loss:  1.575\n",
      "Epoch   2 Batch   54/538 - Train Accuracy:  0.709, Validation Accuracy:  0.691, Loss:  1.536\n",
      "Epoch   2 Batch   55/538 - Train Accuracy:  0.672, Validation Accuracy:  0.694, Loss:  1.572\n",
      "Epoch   2 Batch   56/538 - Train Accuracy:  0.676, Validation Accuracy:  0.691, Loss:  1.554\n",
      "Epoch   2 Batch   57/538 - Train Accuracy:  0.643, Validation Accuracy:  0.692, Loss:  1.602\n",
      "Epoch   2 Batch   58/538 - Train Accuracy:  0.656, Validation Accuracy:  0.695, Loss:  1.525\n",
      "Epoch   2 Batch   59/538 - Train Accuracy:  0.704, Validation Accuracy:  0.694, Loss:  1.584\n",
      "Epoch   2 Batch   60/538 - Train Accuracy:  0.693, Validation Accuracy:  0.698, Loss:  1.552\n",
      "Epoch   2 Batch   61/538 - Train Accuracy:  0.682, Validation Accuracy:  0.701, Loss:  1.533\n",
      "Epoch   2 Batch   62/538 - Train Accuracy:  0.694, Validation Accuracy:  0.700, Loss:  1.507\n",
      "Epoch   2 Batch   63/538 - Train Accuracy:  0.710, Validation Accuracy:  0.699, Loss:  1.450\n",
      "Epoch   2 Batch   64/538 - Train Accuracy:  0.709, Validation Accuracy:  0.698, Loss:  1.533\n",
      "Epoch   2 Batch   65/538 - Train Accuracy:  0.682, Validation Accuracy:  0.696, Loss:  1.512\n",
      "Epoch   2 Batch   66/538 - Train Accuracy:  0.692, Validation Accuracy:  0.696, Loss:  1.477\n",
      "Epoch   2 Batch   67/538 - Train Accuracy:  0.688, Validation Accuracy:  0.700, Loss:  1.517\n",
      "Epoch   2 Batch   68/538 - Train Accuracy:  0.711, Validation Accuracy:  0.703, Loss:  1.480\n",
      "Epoch   2 Batch   69/538 - Train Accuracy:  0.702, Validation Accuracy:  0.700, Loss:  1.541\n",
      "Epoch   2 Batch   70/538 - Train Accuracy:  0.693, Validation Accuracy:  0.697, Loss:  1.537\n",
      "Epoch   2 Batch   71/538 - Train Accuracy:  0.666, Validation Accuracy:  0.700, Loss:  1.601\n",
      "Epoch   2 Batch   72/538 - Train Accuracy:  0.732, Validation Accuracy:  0.706, Loss:  1.567\n",
      "Epoch   2 Batch   73/538 - Train Accuracy:  0.673, Validation Accuracy:  0.698, Loss:  1.532\n",
      "Epoch   2 Batch   74/538 - Train Accuracy:  0.707, Validation Accuracy:  0.699, Loss:  1.509\n",
      "Epoch   2 Batch   75/538 - Train Accuracy:  0.711, Validation Accuracy:  0.703, Loss:  1.522\n",
      "Epoch   2 Batch   76/538 - Train Accuracy:  0.692, Validation Accuracy:  0.705, Loss:  1.527\n",
      "Epoch   2 Batch   77/538 - Train Accuracy:  0.678, Validation Accuracy:  0.708, Loss:  1.541\n",
      "Epoch   2 Batch   78/538 - Train Accuracy:  0.709, Validation Accuracy:  0.710, Loss:  1.562\n",
      "Epoch   2 Batch   79/538 - Train Accuracy:  0.694, Validation Accuracy:  0.714, Loss:  1.537\n",
      "Epoch   2 Batch   80/538 - Train Accuracy:  0.683, Validation Accuracy:  0.710, Loss:  1.526\n",
      "Epoch   2 Batch   81/538 - Train Accuracy:  0.697, Validation Accuracy:  0.711, Loss:  1.543\n",
      "Epoch   2 Batch   82/538 - Train Accuracy:  0.690, Validation Accuracy:  0.715, Loss:  1.533\n",
      "Epoch   2 Batch   83/538 - Train Accuracy:  0.705, Validation Accuracy:  0.716, Loss:  1.553\n",
      "Epoch   2 Batch   84/538 - Train Accuracy:  0.694, Validation Accuracy:  0.716, Loss:  1.530\n",
      "Epoch   2 Batch   85/538 - Train Accuracy:  0.689, Validation Accuracy:  0.714, Loss:  1.522\n",
      "Epoch   2 Batch   86/538 - Train Accuracy:  0.701, Validation Accuracy:  0.719, Loss:  1.498\n",
      "Epoch   2 Batch   87/538 - Train Accuracy:  0.684, Validation Accuracy:  0.709, Loss:  1.561\n",
      "Epoch   2 Batch   88/538 - Train Accuracy:  0.711, Validation Accuracy:  0.707, Loss:  1.519\n",
      "Epoch   2 Batch   89/538 - Train Accuracy:  0.706, Validation Accuracy:  0.703, Loss:  1.565\n",
      "Epoch   2 Batch   90/538 - Train Accuracy:  0.698, Validation Accuracy:  0.699, Loss:  1.526\n",
      "Epoch   2 Batch   91/538 - Train Accuracy:  0.708, Validation Accuracy:  0.703, Loss:  1.538\n",
      "Epoch   2 Batch   92/538 - Train Accuracy:  0.662, Validation Accuracy:  0.700, Loss:  1.548\n",
      "Epoch   2 Batch   93/538 - Train Accuracy:  0.686, Validation Accuracy:  0.701, Loss:  1.594\n",
      "Epoch   2 Batch   94/538 - Train Accuracy:  0.723, Validation Accuracy:  0.708, Loss:  1.537\n",
      "Epoch   2 Batch   95/538 - Train Accuracy:  0.737, Validation Accuracy:  0.707, Loss:  1.467\n",
      "Epoch   2 Batch   96/538 - Train Accuracy:  0.726, Validation Accuracy:  0.714, Loss:  1.509\n",
      "Epoch   2 Batch   97/538 - Train Accuracy:  0.686, Validation Accuracy:  0.717, Loss:  1.544\n",
      "Epoch   2 Batch   98/538 - Train Accuracy:  0.716, Validation Accuracy:  0.717, Loss:  1.502\n",
      "Epoch   2 Batch   99/538 - Train Accuracy:  0.681, Validation Accuracy:  0.718, Loss:  1.505\n",
      "Epoch   2 Batch  100/538 - Train Accuracy:  0.698, Validation Accuracy:  0.714, Loss:  1.502\n",
      "Epoch   2 Batch  101/538 - Train Accuracy:  0.672, Validation Accuracy:  0.702, Loss:  1.595\n",
      "Epoch   2 Batch  102/538 - Train Accuracy:  0.685, Validation Accuracy:  0.700, Loss:  1.490\n",
      "Epoch   2 Batch  103/538 - Train Accuracy:  0.679, Validation Accuracy:  0.695, Loss:  1.471\n",
      "Epoch   2 Batch  104/538 - Train Accuracy:  0.690, Validation Accuracy:  0.701, Loss:  1.499\n",
      "Epoch   2 Batch  105/538 - Train Accuracy:  0.674, Validation Accuracy:  0.701, Loss:  1.530\n",
      "Epoch   2 Batch  106/538 - Train Accuracy:  0.697, Validation Accuracy:  0.703, Loss:  1.547\n",
      "Epoch   2 Batch  107/538 - Train Accuracy:  0.676, Validation Accuracy:  0.701, Loss:  1.528\n",
      "Epoch   2 Batch  108/538 - Train Accuracy:  0.720, Validation Accuracy:  0.703, Loss:  1.507\n",
      "Epoch   2 Batch  109/538 - Train Accuracy:  0.712, Validation Accuracy:  0.707, Loss:  1.491\n",
      "Epoch   2 Batch  110/538 - Train Accuracy:  0.700, Validation Accuracy:  0.711, Loss:  1.521\n",
      "Epoch   2 Batch  111/538 - Train Accuracy:  0.718, Validation Accuracy:  0.710, Loss:  1.479\n",
      "Epoch   2 Batch  112/538 - Train Accuracy:  0.699, Validation Accuracy:  0.708, Loss:  1.548\n",
      "Epoch   2 Batch  113/538 - Train Accuracy:  0.697, Validation Accuracy:  0.711, Loss:  1.509\n",
      "Epoch   2 Batch  114/538 - Train Accuracy:  0.728, Validation Accuracy:  0.716, Loss:  1.517\n",
      "Epoch   2 Batch  115/538 - Train Accuracy:  0.706, Validation Accuracy:  0.716, Loss:  1.571\n",
      "Epoch   2 Batch  116/538 - Train Accuracy:  0.724, Validation Accuracy:  0.715, Loss:  1.488\n",
      "Epoch   2 Batch  117/538 - Train Accuracy:  0.724, Validation Accuracy:  0.708, Loss:  1.523\n",
      "Epoch   2 Batch  118/538 - Train Accuracy:  0.720, Validation Accuracy:  0.709, Loss:  1.522\n",
      "Epoch   2 Batch  119/538 - Train Accuracy:  0.729, Validation Accuracy:  0.706, Loss:  1.472\n",
      "Epoch   2 Batch  120/538 - Train Accuracy:  0.694, Validation Accuracy:  0.708, Loss:  1.497\n",
      "Epoch   2 Batch  121/538 - Train Accuracy:  0.696, Validation Accuracy:  0.706, Loss:  1.507\n",
      "Epoch   2 Batch  122/538 - Train Accuracy:  0.670, Validation Accuracy:  0.705, Loss:  1.507\n",
      "Epoch   2 Batch  123/538 - Train Accuracy:  0.714, Validation Accuracy:  0.702, Loss:  1.488\n",
      "Epoch   2 Batch  124/538 - Train Accuracy:  0.716, Validation Accuracy:  0.710, Loss:  1.499\n",
      "Epoch   2 Batch  125/538 - Train Accuracy:  0.715, Validation Accuracy:  0.714, Loss:  1.539\n",
      "Epoch   2 Batch  126/538 - Train Accuracy:  0.722, Validation Accuracy:  0.713, Loss:  1.488\n",
      "Epoch   2 Batch  127/538 - Train Accuracy:  0.678, Validation Accuracy:  0.708, Loss:  1.513\n",
      "Epoch   2 Batch  128/538 - Train Accuracy:  0.723, Validation Accuracy:  0.704, Loss:  1.524\n",
      "Epoch   2 Batch  129/538 - Train Accuracy:  0.701, Validation Accuracy:  0.711, Loss:  1.487\n",
      "Epoch   2 Batch  130/538 - Train Accuracy:  0.692, Validation Accuracy:  0.709, Loss:  1.499\n",
      "Epoch   2 Batch  131/538 - Train Accuracy:  0.713, Validation Accuracy:  0.705, Loss:  1.529\n",
      "Epoch   2 Batch  132/538 - Train Accuracy:  0.677, Validation Accuracy:  0.700, Loss:  1.542\n",
      "Epoch   2 Batch  133/538 - Train Accuracy:  0.710, Validation Accuracy:  0.702, Loss:  1.454\n",
      "Epoch   2 Batch  134/538 - Train Accuracy:  0.670, Validation Accuracy:  0.704, Loss:  1.533\n",
      "Epoch   2 Batch  135/538 - Train Accuracy:  0.699, Validation Accuracy:  0.700, Loss:  1.524\n",
      "Epoch   2 Batch  136/538 - Train Accuracy:  0.687, Validation Accuracy:  0.705, Loss:  1.465\n",
      "Epoch   2 Batch  137/538 - Train Accuracy:  0.699, Validation Accuracy:  0.707, Loss:  1.524\n",
      "Epoch   2 Batch  138/538 - Train Accuracy:  0.698, Validation Accuracy:  0.699, Loss:  1.515\n",
      "Epoch   2 Batch  139/538 - Train Accuracy:  0.704, Validation Accuracy:  0.712, Loss:  1.548\n",
      "Epoch   2 Batch  140/538 - Train Accuracy:  0.684, Validation Accuracy:  0.718, Loss:  1.491\n",
      "Epoch   2 Batch  141/538 - Train Accuracy:  0.704, Validation Accuracy:  0.710, Loss:  1.509\n",
      "Epoch   2 Batch  142/538 - Train Accuracy:  0.734, Validation Accuracy:  0.708, Loss:  1.480\n",
      "Epoch   2 Batch  143/538 - Train Accuracy:  0.694, Validation Accuracy:  0.706, Loss:  1.479\n",
      "Epoch   2 Batch  144/538 - Train Accuracy:  0.707, Validation Accuracy:  0.709, Loss:  1.547\n",
      "Epoch   2 Batch  145/538 - Train Accuracy:  0.701, Validation Accuracy:  0.708, Loss:  1.506\n",
      "Epoch   2 Batch  146/538 - Train Accuracy:  0.711, Validation Accuracy:  0.705, Loss:  1.463\n",
      "Epoch   2 Batch  147/538 - Train Accuracy:  0.729, Validation Accuracy:  0.707, Loss:  1.476\n",
      "Epoch   2 Batch  148/538 - Train Accuracy:  0.689, Validation Accuracy:  0.709, Loss:  1.567\n",
      "Epoch   2 Batch  149/538 - Train Accuracy:  0.707, Validation Accuracy:  0.706, Loss:  1.463\n",
      "Epoch   2 Batch  150/538 - Train Accuracy:  0.700, Validation Accuracy:  0.706, Loss:  1.477\n",
      "Epoch   2 Batch  151/538 - Train Accuracy:  0.687, Validation Accuracy:  0.698, Loss:  1.532\n",
      "Epoch   2 Batch  152/538 - Train Accuracy:  0.701, Validation Accuracy:  0.693, Loss:  1.510\n",
      "Epoch   2 Batch  153/538 - Train Accuracy:  0.683, Validation Accuracy:  0.694, Loss:  1.517\n",
      "Epoch   2 Batch  154/538 - Train Accuracy:  0.703, Validation Accuracy:  0.708, Loss:  1.489\n",
      "Epoch   2 Batch  155/538 - Train Accuracy:  0.738, Validation Accuracy:  0.721, Loss:  1.503\n",
      "Epoch   2 Batch  156/538 - Train Accuracy:  0.694, Validation Accuracy:  0.725, Loss:  1.450\n",
      "Epoch   2 Batch  157/538 - Train Accuracy:  0.707, Validation Accuracy:  0.727, Loss:  1.530\n",
      "Epoch   2 Batch  158/538 - Train Accuracy:  0.717, Validation Accuracy:  0.725, Loss:  1.504\n",
      "Epoch   2 Batch  159/538 - Train Accuracy:  0.718, Validation Accuracy:  0.726, Loss:  1.526\n",
      "Epoch   2 Batch  160/538 - Train Accuracy:  0.703, Validation Accuracy:  0.731, Loss:  1.455\n",
      "Epoch   2 Batch  161/538 - Train Accuracy:  0.714, Validation Accuracy:  0.727, Loss:  1.504\n",
      "Epoch   2 Batch  162/538 - Train Accuracy:  0.730, Validation Accuracy:  0.724, Loss:  1.483\n",
      "Epoch   2 Batch  163/538 - Train Accuracy:  0.703, Validation Accuracy:  0.716, Loss:  1.468\n",
      "Epoch   2 Batch  164/538 - Train Accuracy:  0.709, Validation Accuracy:  0.711, Loss:  1.507\n",
      "Epoch   2 Batch  165/538 - Train Accuracy:  0.717, Validation Accuracy:  0.707, Loss:  1.468\n",
      "Epoch   2 Batch  166/538 - Train Accuracy:  0.735, Validation Accuracy:  0.707, Loss:  1.472\n",
      "Epoch   2 Batch  167/538 - Train Accuracy:  0.712, Validation Accuracy:  0.704, Loss:  1.491\n",
      "Epoch   2 Batch  168/538 - Train Accuracy:  0.668, Validation Accuracy:  0.706, Loss:  1.533\n",
      "Epoch   2 Batch  169/538 - Train Accuracy:  0.711, Validation Accuracy:  0.702, Loss:  1.507\n",
      "Epoch   2 Batch  170/538 - Train Accuracy:  0.716, Validation Accuracy:  0.712, Loss:  1.509\n",
      "Epoch   2 Batch  171/538 - Train Accuracy:  0.723, Validation Accuracy:  0.719, Loss:  1.541\n",
      "Epoch   2 Batch  172/538 - Train Accuracy:  0.705, Validation Accuracy:  0.717, Loss:  1.483\n",
      "Epoch   2 Batch  173/538 - Train Accuracy:  0.694, Validation Accuracy:  0.715, Loss:  1.508\n",
      "Epoch   2 Batch  174/538 - Train Accuracy:  0.681, Validation Accuracy:  0.716, Loss:  1.537\n",
      "Epoch   2 Batch  175/538 - Train Accuracy:  0.680, Validation Accuracy:  0.714, Loss:  1.532\n",
      "Epoch   2 Batch  176/538 - Train Accuracy:  0.701, Validation Accuracy:  0.720, Loss:  1.514\n",
      "Epoch   2 Batch  177/538 - Train Accuracy:  0.714, Validation Accuracy:  0.703, Loss:  1.443\n",
      "Epoch   2 Batch  178/538 - Train Accuracy:  0.709, Validation Accuracy:  0.701, Loss:  1.524\n",
      "Epoch   2 Batch  179/538 - Train Accuracy:  0.709, Validation Accuracy:  0.708, Loss:  1.473\n",
      "Epoch   2 Batch  180/538 - Train Accuracy:  0.737, Validation Accuracy:  0.712, Loss:  1.466\n",
      "Epoch   2 Batch  181/538 - Train Accuracy:  0.707, Validation Accuracy:  0.712, Loss:  1.561\n",
      "Epoch   2 Batch  182/538 - Train Accuracy:  0.683, Validation Accuracy:  0.712, Loss:  1.473\n",
      "Epoch   2 Batch  183/538 - Train Accuracy:  0.739, Validation Accuracy:  0.714, Loss:  1.462\n",
      "Epoch   2 Batch  184/538 - Train Accuracy:  0.705, Validation Accuracy:  0.718, Loss:  1.468\n",
      "Epoch   2 Batch  185/538 - Train Accuracy:  0.706, Validation Accuracy:  0.721, Loss:  1.469\n",
      "Epoch   2 Batch  186/538 - Train Accuracy:  0.726, Validation Accuracy:  0.721, Loss:  1.469\n",
      "Epoch   2 Batch  187/538 - Train Accuracy:  0.706, Validation Accuracy:  0.714, Loss:  1.494\n",
      "Epoch   2 Batch  188/538 - Train Accuracy:  0.716, Validation Accuracy:  0.714, Loss:  1.463\n",
      "Epoch   2 Batch  189/538 - Train Accuracy:  0.714, Validation Accuracy:  0.718, Loss:  1.483\n",
      "Epoch   2 Batch  190/538 - Train Accuracy:  0.699, Validation Accuracy:  0.716, Loss:  1.487\n",
      "Epoch   2 Batch  191/538 - Train Accuracy:  0.713, Validation Accuracy:  0.721, Loss:  1.519\n",
      "Epoch   2 Batch  192/538 - Train Accuracy:  0.699, Validation Accuracy:  0.731, Loss:  1.501\n",
      "Epoch   2 Batch  193/538 - Train Accuracy:  0.724, Validation Accuracy:  0.730, Loss:  1.467\n",
      "Epoch   2 Batch  194/538 - Train Accuracy:  0.693, Validation Accuracy:  0.730, Loss:  1.497\n",
      "Epoch   2 Batch  195/538 - Train Accuracy:  0.718, Validation Accuracy:  0.726, Loss:  1.487\n",
      "Epoch   2 Batch  196/538 - Train Accuracy:  0.714, Validation Accuracy:  0.724, Loss:  1.461\n",
      "Epoch   2 Batch  197/538 - Train Accuracy:  0.683, Validation Accuracy:  0.721, Loss:  1.507\n",
      "Epoch   2 Batch  198/538 - Train Accuracy:  0.727, Validation Accuracy:  0.716, Loss:  1.497\n",
      "Epoch   2 Batch  199/538 - Train Accuracy:  0.717, Validation Accuracy:  0.724, Loss:  1.479\n",
      "Epoch   2 Batch  200/538 - Train Accuracy:  0.727, Validation Accuracy:  0.729, Loss:  1.474\n",
      "Epoch   2 Batch  201/538 - Train Accuracy:  0.737, Validation Accuracy:  0.732, Loss:  1.473\n",
      "Epoch   2 Batch  202/538 - Train Accuracy:  0.760, Validation Accuracy:  0.729, Loss:  1.468\n",
      "Epoch   2 Batch  203/538 - Train Accuracy:  0.695, Validation Accuracy:  0.729, Loss:  1.461\n",
      "Epoch   2 Batch  204/538 - Train Accuracy:  0.697, Validation Accuracy:  0.729, Loss:  1.507\n",
      "Epoch   2 Batch  205/538 - Train Accuracy:  0.735, Validation Accuracy:  0.726, Loss:  1.413\n",
      "Epoch   2 Batch  206/538 - Train Accuracy:  0.683, Validation Accuracy:  0.730, Loss:  1.470\n",
      "Epoch   2 Batch  207/538 - Train Accuracy:  0.706, Validation Accuracy:  0.735, Loss:  1.502\n",
      "Epoch   2 Batch  208/538 - Train Accuracy:  0.667, Validation Accuracy:  0.719, Loss:  1.499\n",
      "Epoch   2 Batch  209/538 - Train Accuracy:  0.691, Validation Accuracy:  0.714, Loss:  1.519\n",
      "Epoch   2 Batch  210/538 - Train Accuracy:  0.682, Validation Accuracy:  0.718, Loss:  1.470\n",
      "Epoch   2 Batch  211/538 - Train Accuracy:  0.678, Validation Accuracy:  0.719, Loss:  1.455\n",
      "Epoch   2 Batch  212/538 - Train Accuracy:  0.708, Validation Accuracy:  0.722, Loss:  1.529\n",
      "Epoch   2 Batch  213/538 - Train Accuracy:  0.691, Validation Accuracy:  0.733, Loss:  1.442\n",
      "Epoch   2 Batch  214/538 - Train Accuracy:  0.721, Validation Accuracy:  0.738, Loss:  1.425\n",
      "Epoch   2 Batch  215/538 - Train Accuracy:  0.721, Validation Accuracy:  0.748, Loss:  1.446\n",
      "Epoch   2 Batch  216/538 - Train Accuracy:  0.688, Validation Accuracy:  0.747, Loss:  1.544\n",
      "Epoch   2 Batch  217/538 - Train Accuracy:  0.745, Validation Accuracy:  0.742, Loss:  1.471\n",
      "Epoch   2 Batch  218/538 - Train Accuracy:  0.688, Validation Accuracy:  0.734, Loss:  1.484\n",
      "Epoch   2 Batch  219/538 - Train Accuracy:  0.682, Validation Accuracy:  0.724, Loss:  1.490\n",
      "Epoch   2 Batch  220/538 - Train Accuracy:  0.688, Validation Accuracy:  0.714, Loss:  1.430\n",
      "Epoch   2 Batch  221/538 - Train Accuracy:  0.699, Validation Accuracy:  0.704, Loss:  1.484\n",
      "Epoch   2 Batch  222/538 - Train Accuracy:  0.691, Validation Accuracy:  0.695, Loss:  1.478\n",
      "Epoch   2 Batch  223/538 - Train Accuracy:  0.686, Validation Accuracy:  0.702, Loss:  1.542\n",
      "Epoch   2 Batch  224/538 - Train Accuracy:  0.690, Validation Accuracy:  0.700, Loss:  1.523\n",
      "Epoch   2 Batch  225/538 - Train Accuracy:  0.708, Validation Accuracy:  0.717, Loss:  1.438\n",
      "Epoch   2 Batch  226/538 - Train Accuracy:  0.708, Validation Accuracy:  0.722, Loss:  1.487\n",
      "Epoch   2 Batch  227/538 - Train Accuracy:  0.729, Validation Accuracy:  0.726, Loss:  1.481\n",
      "Epoch   2 Batch  228/538 - Train Accuracy:  0.694, Validation Accuracy:  0.729, Loss:  1.468\n",
      "Epoch   2 Batch  229/538 - Train Accuracy:  0.727, Validation Accuracy:  0.720, Loss:  1.465\n",
      "Epoch   2 Batch  230/538 - Train Accuracy:  0.693, Validation Accuracy:  0.722, Loss:  1.478\n",
      "Epoch   2 Batch  231/538 - Train Accuracy:  0.705, Validation Accuracy:  0.722, Loss:  1.479\n",
      "Epoch   2 Batch  232/538 - Train Accuracy:  0.699, Validation Accuracy:  0.722, Loss:  1.486\n",
      "Epoch   2 Batch  233/538 - Train Accuracy:  0.732, Validation Accuracy:  0.731, Loss:  1.455\n",
      "Epoch   2 Batch  234/538 - Train Accuracy:  0.684, Validation Accuracy:  0.731, Loss:  1.529\n",
      "Epoch   2 Batch  235/538 - Train Accuracy:  0.724, Validation Accuracy:  0.744, Loss:  1.453\n",
      "Epoch   2 Batch  236/538 - Train Accuracy:  0.713, Validation Accuracy:  0.751, Loss:  1.516\n",
      "Epoch   2 Batch  237/538 - Train Accuracy:  0.721, Validation Accuracy:  0.750, Loss:  1.443\n",
      "Epoch   2 Batch  238/538 - Train Accuracy:  0.749, Validation Accuracy:  0.746, Loss:  1.427\n",
      "Epoch   2 Batch  239/538 - Train Accuracy:  0.742, Validation Accuracy:  0.741, Loss:  1.493\n",
      "Epoch   2 Batch  240/538 - Train Accuracy:  0.716, Validation Accuracy:  0.739, Loss:  1.492\n",
      "Epoch   2 Batch  241/538 - Train Accuracy:  0.712, Validation Accuracy:  0.745, Loss:  1.484\n",
      "Epoch   2 Batch  242/538 - Train Accuracy:  0.734, Validation Accuracy:  0.741, Loss:  1.532\n",
      "Epoch   2 Batch  243/538 - Train Accuracy:  0.702, Validation Accuracy:  0.738, Loss:  1.468\n",
      "Epoch   2 Batch  244/538 - Train Accuracy:  0.716, Validation Accuracy:  0.740, Loss:  1.453\n",
      "Epoch   2 Batch  245/538 - Train Accuracy:  0.705, Validation Accuracy:  0.740, Loss:  1.494\n",
      "Epoch   2 Batch  246/538 - Train Accuracy:  0.741, Validation Accuracy:  0.735, Loss:  1.449\n",
      "Epoch   2 Batch  247/538 - Train Accuracy:  0.717, Validation Accuracy:  0.736, Loss:  1.488\n",
      "Epoch   2 Batch  248/538 - Train Accuracy:  0.724, Validation Accuracy:  0.741, Loss:  1.477\n",
      "Epoch   2 Batch  249/538 - Train Accuracy:  0.720, Validation Accuracy:  0.732, Loss:  1.448\n",
      "Epoch   2 Batch  250/538 - Train Accuracy:  0.720, Validation Accuracy:  0.737, Loss:  1.509\n",
      "Epoch   2 Batch  251/538 - Train Accuracy:  0.705, Validation Accuracy:  0.725, Loss:  1.482\n",
      "Epoch   2 Batch  252/538 - Train Accuracy:  0.723, Validation Accuracy:  0.721, Loss:  1.426\n",
      "Epoch   2 Batch  253/538 - Train Accuracy:  0.707, Validation Accuracy:  0.724, Loss:  1.401\n",
      "Epoch   2 Batch  254/538 - Train Accuracy:  0.729, Validation Accuracy:  0.729, Loss:  1.457\n",
      "Epoch   2 Batch  255/538 - Train Accuracy:  0.734, Validation Accuracy:  0.727, Loss:  1.423\n",
      "Epoch   2 Batch  256/538 - Train Accuracy:  0.706, Validation Accuracy:  0.736, Loss:  1.526\n",
      "Epoch   2 Batch  257/538 - Train Accuracy:  0.746, Validation Accuracy:  0.742, Loss:  1.486\n",
      "Epoch   2 Batch  258/538 - Train Accuracy:  0.746, Validation Accuracy:  0.744, Loss:  1.453\n",
      "Epoch   2 Batch  259/538 - Train Accuracy:  0.747, Validation Accuracy:  0.753, Loss:  1.404\n",
      "Epoch   2 Batch  260/538 - Train Accuracy:  0.712, Validation Accuracy:  0.745, Loss:  1.432\n",
      "Epoch   2 Batch  261/538 - Train Accuracy:  0.708, Validation Accuracy:  0.746, Loss:  1.501\n",
      "Epoch   2 Batch  262/538 - Train Accuracy:  0.725, Validation Accuracy:  0.745, Loss:  1.486\n",
      "Epoch   2 Batch  263/538 - Train Accuracy:  0.737, Validation Accuracy:  0.746, Loss:  1.455\n",
      "Epoch   2 Batch  264/538 - Train Accuracy:  0.723, Validation Accuracy:  0.746, Loss:  1.481\n",
      "Epoch   2 Batch  265/538 - Train Accuracy:  0.700, Validation Accuracy:  0.738, Loss:  1.481\n",
      "Epoch   2 Batch  266/538 - Train Accuracy:  0.735, Validation Accuracy:  0.740, Loss:  1.472\n",
      "Epoch   2 Batch  267/538 - Train Accuracy:  0.718, Validation Accuracy:  0.738, Loss:  1.439\n",
      "Epoch   2 Batch  268/538 - Train Accuracy:  0.736, Validation Accuracy:  0.734, Loss:  1.443\n",
      "Epoch   2 Batch  269/538 - Train Accuracy:  0.721, Validation Accuracy:  0.740, Loss:  1.507\n",
      "Epoch   2 Batch  270/538 - Train Accuracy:  0.705, Validation Accuracy:  0.736, Loss:  1.446\n",
      "Epoch   2 Batch  271/538 - Train Accuracy:  0.722, Validation Accuracy:  0.740, Loss:  1.439\n",
      "Epoch   2 Batch  272/538 - Train Accuracy:  0.704, Validation Accuracy:  0.744, Loss:  1.546\n",
      "Epoch   2 Batch  273/538 - Train Accuracy:  0.748, Validation Accuracy:  0.751, Loss:  1.498\n",
      "Epoch   2 Batch  274/538 - Train Accuracy:  0.688, Validation Accuracy:  0.749, Loss:  1.480\n",
      "Epoch   2 Batch  275/538 - Train Accuracy:  0.744, Validation Accuracy:  0.749, Loss:  1.462\n",
      "Epoch   2 Batch  276/538 - Train Accuracy:  0.732, Validation Accuracy:  0.745, Loss:  1.467\n",
      "Epoch   2 Batch  277/538 - Train Accuracy:  0.725, Validation Accuracy:  0.740, Loss:  1.433\n",
      "Epoch   2 Batch  278/538 - Train Accuracy:  0.744, Validation Accuracy:  0.743, Loss:  1.508\n",
      "Epoch   2 Batch  279/538 - Train Accuracy:  0.727, Validation Accuracy:  0.732, Loss:  1.460\n",
      "Epoch   2 Batch  280/538 - Train Accuracy:  0.771, Validation Accuracy:  0.723, Loss:  1.460\n",
      "Epoch   2 Batch  281/538 - Train Accuracy:  0.732, Validation Accuracy:  0.720, Loss:  1.505\n",
      "Epoch   2 Batch  282/538 - Train Accuracy:  0.735, Validation Accuracy:  0.728, Loss:  1.458\n",
      "Epoch   2 Batch  283/538 - Train Accuracy:  0.719, Validation Accuracy:  0.725, Loss:  1.445\n",
      "Epoch   2 Batch  284/538 - Train Accuracy:  0.726, Validation Accuracy:  0.731, Loss:  1.477\n",
      "Epoch   2 Batch  285/538 - Train Accuracy:  0.743, Validation Accuracy:  0.729, Loss:  1.413\n",
      "Epoch   2 Batch  286/538 - Train Accuracy:  0.718, Validation Accuracy:  0.740, Loss:  1.466\n",
      "Epoch   2 Batch  287/538 - Train Accuracy:  0.753, Validation Accuracy:  0.744, Loss:  1.407\n",
      "Epoch   2 Batch  288/538 - Train Accuracy:  0.724, Validation Accuracy:  0.747, Loss:  1.487\n",
      "Epoch   2 Batch  289/538 - Train Accuracy:  0.767, Validation Accuracy:  0.754, Loss:  1.432\n",
      "Epoch   2 Batch  290/538 - Train Accuracy:  0.728, Validation Accuracy:  0.756, Loss:  1.470\n",
      "Epoch   2 Batch  291/538 - Train Accuracy:  0.747, Validation Accuracy:  0.762, Loss:  1.432\n",
      "Epoch   2 Batch  292/538 - Train Accuracy:  0.744, Validation Accuracy:  0.768, Loss:  1.477\n",
      "Epoch   2 Batch  293/538 - Train Accuracy:  0.744, Validation Accuracy:  0.766, Loss:  1.433\n",
      "Epoch   2 Batch  294/538 - Train Accuracy:  0.715, Validation Accuracy:  0.764, Loss:  1.456\n",
      "Epoch   2 Batch  295/538 - Train Accuracy:  0.752, Validation Accuracy:  0.757, Loss:  1.451\n",
      "Epoch   2 Batch  296/538 - Train Accuracy:  0.722, Validation Accuracy:  0.757, Loss:  1.422\n",
      "Epoch   2 Batch  297/538 - Train Accuracy:  0.720, Validation Accuracy:  0.753, Loss:  1.481\n",
      "Epoch   2 Batch  298/538 - Train Accuracy:  0.740, Validation Accuracy:  0.752, Loss:  1.480\n",
      "Epoch   2 Batch  299/538 - Train Accuracy:  0.741, Validation Accuracy:  0.758, Loss:  1.439\n",
      "Epoch   2 Batch  300/538 - Train Accuracy:  0.714, Validation Accuracy:  0.746, Loss:  1.467\n",
      "Epoch   2 Batch  301/538 - Train Accuracy:  0.720, Validation Accuracy:  0.750, Loss:  1.421\n",
      "Epoch   2 Batch  302/538 - Train Accuracy:  0.763, Validation Accuracy:  0.759, Loss:  1.435\n",
      "Epoch   2 Batch  303/538 - Train Accuracy:  0.765, Validation Accuracy:  0.767, Loss:  1.444\n",
      "Epoch   2 Batch  304/538 - Train Accuracy:  0.739, Validation Accuracy:  0.768, Loss:  1.470\n",
      "Epoch   2 Batch  305/538 - Train Accuracy:  0.749, Validation Accuracy:  0.757, Loss:  1.426\n",
      "Epoch   2 Batch  306/538 - Train Accuracy:  0.730, Validation Accuracy:  0.752, Loss:  1.447\n",
      "Epoch   2 Batch  307/538 - Train Accuracy:  0.746, Validation Accuracy:  0.752, Loss:  1.407\n",
      "Epoch   2 Batch  308/538 - Train Accuracy:  0.743, Validation Accuracy:  0.759, Loss:  1.468\n",
      "Epoch   2 Batch  309/538 - Train Accuracy:  0.709, Validation Accuracy:  0.761, Loss:  1.439\n",
      "Epoch   2 Batch  310/538 - Train Accuracy:  0.745, Validation Accuracy:  0.756, Loss:  1.434\n",
      "Epoch   2 Batch  311/538 - Train Accuracy:  0.735, Validation Accuracy:  0.756, Loss:  1.431\n",
      "Epoch   2 Batch  312/538 - Train Accuracy:  0.773, Validation Accuracy:  0.759, Loss:  1.420\n",
      "Epoch   2 Batch  313/538 - Train Accuracy:  0.727, Validation Accuracy:  0.760, Loss:  1.483\n",
      "Epoch   2 Batch  314/538 - Train Accuracy:  0.734, Validation Accuracy:  0.762, Loss:  1.484\n",
      "Epoch   2 Batch  315/538 - Train Accuracy:  0.742, Validation Accuracy:  0.760, Loss:  1.451\n",
      "Epoch   2 Batch  316/538 - Train Accuracy:  0.748, Validation Accuracy:  0.758, Loss:  1.468\n",
      "Epoch   2 Batch  317/538 - Train Accuracy:  0.745, Validation Accuracy:  0.764, Loss:  1.443\n",
      "Epoch   2 Batch  318/538 - Train Accuracy:  0.731, Validation Accuracy:  0.755, Loss:  1.460\n",
      "Epoch   2 Batch  319/538 - Train Accuracy:  0.747, Validation Accuracy:  0.752, Loss:  1.474\n",
      "Epoch   2 Batch  320/538 - Train Accuracy:  0.757, Validation Accuracy:  0.749, Loss:  1.438\n",
      "Epoch   2 Batch  321/538 - Train Accuracy:  0.740, Validation Accuracy:  0.748, Loss:  1.455\n",
      "Epoch   2 Batch  322/538 - Train Accuracy:  0.749, Validation Accuracy:  0.744, Loss:  1.458\n",
      "Epoch   2 Batch  323/538 - Train Accuracy:  0.737, Validation Accuracy:  0.752, Loss:  1.469\n",
      "Epoch   2 Batch  324/538 - Train Accuracy:  0.723, Validation Accuracy:  0.757, Loss:  1.446\n",
      "Epoch   2 Batch  325/538 - Train Accuracy:  0.749, Validation Accuracy:  0.755, Loss:  1.453\n",
      "Epoch   2 Batch  326/538 - Train Accuracy:  0.735, Validation Accuracy:  0.749, Loss:  1.434\n",
      "Epoch   2 Batch  327/538 - Train Accuracy:  0.730, Validation Accuracy:  0.752, Loss:  1.499\n",
      "Epoch   2 Batch  328/538 - Train Accuracy:  0.759, Validation Accuracy:  0.751, Loss:  1.462\n",
      "Epoch   2 Batch  329/538 - Train Accuracy:  0.757, Validation Accuracy:  0.751, Loss:  1.395\n",
      "Epoch   2 Batch  330/538 - Train Accuracy:  0.740, Validation Accuracy:  0.756, Loss:  1.407\n",
      "Epoch   2 Batch  331/538 - Train Accuracy:  0.743, Validation Accuracy:  0.746, Loss:  1.470\n",
      "Epoch   2 Batch  332/538 - Train Accuracy:  0.739, Validation Accuracy:  0.749, Loss:  1.452\n",
      "Epoch   2 Batch  333/538 - Train Accuracy:  0.748, Validation Accuracy:  0.751, Loss:  1.365\n",
      "Epoch   2 Batch  334/538 - Train Accuracy:  0.751, Validation Accuracy:  0.744, Loss:  1.436\n",
      "Epoch   2 Batch  335/538 - Train Accuracy:  0.753, Validation Accuracy:  0.749, Loss:  1.459\n",
      "Epoch   2 Batch  336/538 - Train Accuracy:  0.736, Validation Accuracy:  0.736, Loss:  1.401\n",
      "Epoch   2 Batch  337/538 - Train Accuracy:  0.769, Validation Accuracy:  0.743, Loss:  1.444\n",
      "Epoch   2 Batch  338/538 - Train Accuracy:  0.722, Validation Accuracy:  0.747, Loss:  1.423\n",
      "Epoch   2 Batch  339/538 - Train Accuracy:  0.739, Validation Accuracy:  0.760, Loss:  1.456\n",
      "Epoch   2 Batch  340/538 - Train Accuracy:  0.741, Validation Accuracy:  0.756, Loss:  1.523\n",
      "Epoch   2 Batch  341/538 - Train Accuracy:  0.757, Validation Accuracy:  0.752, Loss:  1.452\n",
      "Epoch   2 Batch  342/538 - Train Accuracy:  0.748, Validation Accuracy:  0.749, Loss:  1.404\n",
      "Epoch   2 Batch  343/538 - Train Accuracy:  0.762, Validation Accuracy:  0.741, Loss:  1.437\n",
      "Epoch   2 Batch  344/538 - Train Accuracy:  0.719, Validation Accuracy:  0.749, Loss:  1.411\n",
      "Epoch   2 Batch  345/538 - Train Accuracy:  0.754, Validation Accuracy:  0.744, Loss:  1.401\n",
      "Epoch   2 Batch  346/538 - Train Accuracy:  0.728, Validation Accuracy:  0.745, Loss:  1.459\n",
      "Epoch   2 Batch  347/538 - Train Accuracy:  0.739, Validation Accuracy:  0.748, Loss:  1.477\n",
      "Epoch   2 Batch  348/538 - Train Accuracy:  0.719, Validation Accuracy:  0.751, Loss:  1.394\n",
      "Epoch   2 Batch  349/538 - Train Accuracy:  0.728, Validation Accuracy:  0.740, Loss:  1.417\n",
      "Epoch   2 Batch  350/538 - Train Accuracy:  0.751, Validation Accuracy:  0.747, Loss:  1.465\n",
      "Epoch   2 Batch  351/538 - Train Accuracy:  0.733, Validation Accuracy:  0.749, Loss:  1.440\n",
      "Epoch   2 Batch  352/538 - Train Accuracy:  0.751, Validation Accuracy:  0.766, Loss:  1.430\n",
      "Epoch   2 Batch  353/538 - Train Accuracy:  0.752, Validation Accuracy:  0.766, Loss:  1.431\n",
      "Epoch   2 Batch  354/538 - Train Accuracy:  0.713, Validation Accuracy:  0.763, Loss:  1.505\n",
      "Epoch   2 Batch  355/538 - Train Accuracy:  0.759, Validation Accuracy:  0.758, Loss:  1.443\n",
      "Epoch   2 Batch  356/538 - Train Accuracy:  0.750, Validation Accuracy:  0.754, Loss:  1.424\n",
      "Epoch   2 Batch  357/538 - Train Accuracy:  0.749, Validation Accuracy:  0.749, Loss:  1.456\n",
      "Epoch   2 Batch  358/538 - Train Accuracy:  0.743, Validation Accuracy:  0.741, Loss:  1.417\n",
      "Epoch   2 Batch  359/538 - Train Accuracy:  0.743, Validation Accuracy:  0.753, Loss:  1.467\n",
      "Epoch   2 Batch  360/538 - Train Accuracy:  0.728, Validation Accuracy:  0.760, Loss:  1.464\n",
      "Epoch   2 Batch  361/538 - Train Accuracy:  0.760, Validation Accuracy:  0.768, Loss:  1.395\n",
      "Epoch   2 Batch  362/538 - Train Accuracy:  0.755, Validation Accuracy:  0.766, Loss:  1.429\n",
      "Epoch   2 Batch  363/538 - Train Accuracy:  0.752, Validation Accuracy:  0.772, Loss:  1.424\n",
      "Epoch   2 Batch  364/538 - Train Accuracy:  0.722, Validation Accuracy:  0.750, Loss:  1.402\n",
      "Epoch   2 Batch  365/538 - Train Accuracy:  0.735, Validation Accuracy:  0.736, Loss:  1.435\n",
      "Epoch   2 Batch  366/538 - Train Accuracy:  0.747, Validation Accuracy:  0.742, Loss:  1.462\n",
      "Epoch   2 Batch  367/538 - Train Accuracy:  0.737, Validation Accuracy:  0.747, Loss:  1.450\n",
      "Epoch   2 Batch  368/538 - Train Accuracy:  0.768, Validation Accuracy:  0.757, Loss:  1.403\n",
      "Epoch   2 Batch  369/538 - Train Accuracy:  0.751, Validation Accuracy:  0.765, Loss:  1.466\n",
      "Epoch   2 Batch  370/538 - Train Accuracy:  0.740, Validation Accuracy:  0.760, Loss:  1.435\n",
      "Epoch   2 Batch  371/538 - Train Accuracy:  0.756, Validation Accuracy:  0.762, Loss:  1.408\n",
      "Epoch   2 Batch  372/538 - Train Accuracy:  0.765, Validation Accuracy:  0.751, Loss:  1.412\n",
      "Epoch   2 Batch  373/538 - Train Accuracy:  0.747, Validation Accuracy:  0.760, Loss:  1.477\n",
      "Epoch   2 Batch  374/538 - Train Accuracy:  0.744, Validation Accuracy:  0.760, Loss:  1.458\n",
      "Epoch   2 Batch  375/538 - Train Accuracy:  0.759, Validation Accuracy:  0.754, Loss:  1.437\n",
      "Epoch   2 Batch  376/538 - Train Accuracy:  0.753, Validation Accuracy:  0.762, Loss:  1.427\n",
      "Epoch   2 Batch  377/538 - Train Accuracy:  0.729, Validation Accuracy:  0.755, Loss:  1.452\n",
      "Epoch   2 Batch  378/538 - Train Accuracy:  0.752, Validation Accuracy:  0.751, Loss:  1.446\n",
      "Epoch   2 Batch  379/538 - Train Accuracy:  0.781, Validation Accuracy:  0.752, Loss:  1.393\n",
      "Epoch   2 Batch  380/538 - Train Accuracy:  0.738, Validation Accuracy:  0.751, Loss:  1.452\n",
      "Epoch   2 Batch  381/538 - Train Accuracy:  0.758, Validation Accuracy:  0.749, Loss:  1.465\n",
      "Epoch   2 Batch  382/538 - Train Accuracy:  0.743, Validation Accuracy:  0.741, Loss:  1.438\n",
      "Epoch   2 Batch  383/538 - Train Accuracy:  0.741, Validation Accuracy:  0.741, Loss:  1.416\n",
      "Epoch   2 Batch  384/538 - Train Accuracy:  0.767, Validation Accuracy:  0.741, Loss:  1.415\n",
      "Epoch   2 Batch  385/538 - Train Accuracy:  0.761, Validation Accuracy:  0.751, Loss:  1.450\n",
      "Epoch   2 Batch  386/538 - Train Accuracy:  0.746, Validation Accuracy:  0.754, Loss:  1.445\n",
      "Epoch   2 Batch  387/538 - Train Accuracy:  0.747, Validation Accuracy:  0.740, Loss:  1.407\n",
      "Epoch   2 Batch  388/538 - Train Accuracy:  0.743, Validation Accuracy:  0.743, Loss:  1.430\n",
      "Epoch   2 Batch  389/538 - Train Accuracy:  0.744, Validation Accuracy:  0.748, Loss:  1.458\n",
      "Epoch   2 Batch  390/538 - Train Accuracy:  0.769, Validation Accuracy:  0.758, Loss:  1.384\n",
      "Epoch   2 Batch  391/538 - Train Accuracy:  0.750, Validation Accuracy:  0.765, Loss:  1.461\n",
      "Epoch   2 Batch  392/538 - Train Accuracy:  0.740, Validation Accuracy:  0.764, Loss:  1.446\n",
      "Epoch   2 Batch  393/538 - Train Accuracy:  0.763, Validation Accuracy:  0.768, Loss:  1.427\n",
      "Epoch   2 Batch  394/538 - Train Accuracy:  0.709, Validation Accuracy:  0.774, Loss:  1.448\n",
      "Epoch   2 Batch  395/538 - Train Accuracy:  0.737, Validation Accuracy:  0.762, Loss:  1.449\n",
      "Epoch   2 Batch  396/538 - Train Accuracy:  0.718, Validation Accuracy:  0.763, Loss:  1.440\n",
      "Epoch   2 Batch  397/538 - Train Accuracy:  0.757, Validation Accuracy:  0.767, Loss:  1.450\n",
      "Epoch   2 Batch  398/538 - Train Accuracy:  0.730, Validation Accuracy:  0.763, Loss:  1.372\n",
      "Epoch   2 Batch  399/538 - Train Accuracy:  0.731, Validation Accuracy:  0.763, Loss:  1.416\n",
      "Epoch   2 Batch  400/538 - Train Accuracy:  0.766, Validation Accuracy:  0.770, Loss:  1.443\n",
      "Epoch   2 Batch  401/538 - Train Accuracy:  0.747, Validation Accuracy:  0.768, Loss:  1.452\n",
      "Epoch   2 Batch  402/538 - Train Accuracy:  0.769, Validation Accuracy:  0.775, Loss:  1.391\n",
      "Epoch   2 Batch  403/538 - Train Accuracy:  0.740, Validation Accuracy:  0.775, Loss:  1.436\n",
      "Epoch   2 Batch  404/538 - Train Accuracy:  0.760, Validation Accuracy:  0.766, Loss:  1.427\n",
      "Epoch   2 Batch  405/538 - Train Accuracy:  0.755, Validation Accuracy:  0.761, Loss:  1.484\n",
      "Epoch   2 Batch  406/538 - Train Accuracy:  0.771, Validation Accuracy:  0.766, Loss:  1.434\n",
      "Epoch   2 Batch  407/538 - Train Accuracy:  0.774, Validation Accuracy:  0.775, Loss:  1.413\n",
      "Epoch   2 Batch  408/538 - Train Accuracy:  0.738, Validation Accuracy:  0.757, Loss:  1.405\n",
      "Epoch   2 Batch  409/538 - Train Accuracy:  0.745, Validation Accuracy:  0.739, Loss:  1.435\n",
      "Epoch   2 Batch  410/538 - Train Accuracy:  0.754, Validation Accuracy:  0.745, Loss:  1.417\n",
      "Epoch   2 Batch  411/538 - Train Accuracy:  0.761, Validation Accuracy:  0.747, Loss:  1.381\n",
      "Epoch   2 Batch  412/538 - Train Accuracy:  0.763, Validation Accuracy:  0.748, Loss:  1.399\n",
      "Epoch   2 Batch  413/538 - Train Accuracy:  0.758, Validation Accuracy:  0.754, Loss:  1.410\n",
      "Epoch   2 Batch  414/538 - Train Accuracy:  0.741, Validation Accuracy:  0.749, Loss:  1.402\n",
      "Epoch   2 Batch  415/538 - Train Accuracy:  0.739, Validation Accuracy:  0.761, Loss:  1.414\n",
      "Epoch   2 Batch  416/538 - Train Accuracy:  0.773, Validation Accuracy:  0.754, Loss:  1.439\n",
      "Epoch   2 Batch  417/538 - Train Accuracy:  0.778, Validation Accuracy:  0.756, Loss:  1.441\n",
      "Epoch   2 Batch  418/538 - Train Accuracy:  0.752, Validation Accuracy:  0.759, Loss:  1.471\n",
      "Epoch   2 Batch  419/538 - Train Accuracy:  0.759, Validation Accuracy:  0.757, Loss:  1.421\n",
      "Epoch   2 Batch  420/538 - Train Accuracy:  0.777, Validation Accuracy:  0.759, Loss:  1.453\n",
      "Epoch   2 Batch  421/538 - Train Accuracy:  0.757, Validation Accuracy:  0.763, Loss:  1.440\n",
      "Epoch   2 Batch  422/538 - Train Accuracy:  0.788, Validation Accuracy:  0.761, Loss:  1.400\n",
      "Epoch   2 Batch  423/538 - Train Accuracy:  0.765, Validation Accuracy:  0.766, Loss:  1.398\n",
      "Epoch   2 Batch  424/538 - Train Accuracy:  0.768, Validation Accuracy:  0.769, Loss:  1.422\n",
      "Epoch   2 Batch  425/538 - Train Accuracy:  0.744, Validation Accuracy:  0.760, Loss:  1.487\n",
      "Epoch   2 Batch  426/538 - Train Accuracy:  0.768, Validation Accuracy:  0.762, Loss:  1.398\n",
      "Epoch   2 Batch  427/538 - Train Accuracy:  0.757, Validation Accuracy:  0.761, Loss:  1.472\n",
      "Epoch   2 Batch  428/538 - Train Accuracy:  0.776, Validation Accuracy:  0.763, Loss:  1.364\n",
      "Epoch   2 Batch  429/538 - Train Accuracy:  0.768, Validation Accuracy:  0.755, Loss:  1.395\n",
      "Epoch   2 Batch  430/538 - Train Accuracy:  0.756, Validation Accuracy:  0.756, Loss:  1.417\n",
      "Epoch   2 Batch  431/538 - Train Accuracy:  0.755, Validation Accuracy:  0.756, Loss:  1.400\n",
      "Epoch   2 Batch  432/538 - Train Accuracy:  0.800, Validation Accuracy:  0.755, Loss:  1.437\n",
      "Epoch   2 Batch  433/538 - Train Accuracy:  0.767, Validation Accuracy:  0.758, Loss:  1.476\n",
      "Epoch   2 Batch  434/538 - Train Accuracy:  0.775, Validation Accuracy:  0.764, Loss:  1.420\n",
      "Epoch   2 Batch  435/538 - Train Accuracy:  0.755, Validation Accuracy:  0.768, Loss:  1.425\n",
      "Epoch   2 Batch  436/538 - Train Accuracy:  0.762, Validation Accuracy:  0.770, Loss:  1.405\n",
      "Epoch   2 Batch  437/538 - Train Accuracy:  0.754, Validation Accuracy:  0.774, Loss:  1.424\n",
      "Epoch   2 Batch  438/538 - Train Accuracy:  0.780, Validation Accuracy:  0.766, Loss:  1.365\n",
      "Epoch   2 Batch  439/538 - Train Accuracy:  0.783, Validation Accuracy:  0.770, Loss:  1.387\n",
      "Epoch   2 Batch  440/538 - Train Accuracy:  0.768, Validation Accuracy:  0.782, Loss:  1.469\n",
      "Epoch   2 Batch  441/538 - Train Accuracy:  0.741, Validation Accuracy:  0.778, Loss:  1.424\n",
      "Epoch   2 Batch  442/538 - Train Accuracy:  0.798, Validation Accuracy:  0.774, Loss:  1.346\n",
      "Epoch   2 Batch  443/538 - Train Accuracy:  0.774, Validation Accuracy:  0.777, Loss:  1.449\n",
      "Epoch   2 Batch  444/538 - Train Accuracy:  0.811, Validation Accuracy:  0.772, Loss:  1.419\n",
      "Epoch   2 Batch  445/538 - Train Accuracy:  0.794, Validation Accuracy:  0.767, Loss:  1.391\n",
      "Epoch   2 Batch  446/538 - Train Accuracy:  0.796, Validation Accuracy:  0.763, Loss:  1.418\n",
      "Epoch   2 Batch  447/538 - Train Accuracy:  0.760, Validation Accuracy:  0.752, Loss:  1.423\n",
      "Epoch   2 Batch  448/538 - Train Accuracy:  0.783, Validation Accuracy:  0.756, Loss:  1.439\n",
      "Epoch   2 Batch  449/538 - Train Accuracy:  0.782, Validation Accuracy:  0.769, Loss:  1.438\n",
      "Epoch   2 Batch  450/538 - Train Accuracy:  0.767, Validation Accuracy:  0.765, Loss:  1.432\n",
      "Epoch   2 Batch  451/538 - Train Accuracy:  0.762, Validation Accuracy:  0.760, Loss:  1.371\n",
      "Epoch   2 Batch  452/538 - Train Accuracy:  0.772, Validation Accuracy:  0.764, Loss:  1.403\n",
      "Epoch   2 Batch  453/538 - Train Accuracy:  0.782, Validation Accuracy:  0.768, Loss:  1.460\n",
      "Epoch   2 Batch  454/538 - Train Accuracy:  0.780, Validation Accuracy:  0.763, Loss:  1.428\n",
      "Epoch   2 Batch  455/538 - Train Accuracy:  0.785, Validation Accuracy:  0.763, Loss:  1.404\n",
      "Epoch   2 Batch  456/538 - Train Accuracy:  0.809, Validation Accuracy:  0.753, Loss:  1.368\n",
      "Epoch   2 Batch  457/538 - Train Accuracy:  0.742, Validation Accuracy:  0.761, Loss:  1.431\n",
      "Epoch   2 Batch  458/538 - Train Accuracy:  0.760, Validation Accuracy:  0.763, Loss:  1.394\n",
      "Epoch   2 Batch  459/538 - Train Accuracy:  0.797, Validation Accuracy:  0.774, Loss:  1.438\n",
      "Epoch   2 Batch  460/538 - Train Accuracy:  0.753, Validation Accuracy:  0.766, Loss:  1.373\n",
      "Epoch   2 Batch  461/538 - Train Accuracy:  0.774, Validation Accuracy:  0.762, Loss:  1.471\n",
      "Epoch   2 Batch  462/538 - Train Accuracy:  0.760, Validation Accuracy:  0.761, Loss:  1.378\n",
      "Epoch   2 Batch  463/538 - Train Accuracy:  0.754, Validation Accuracy:  0.767, Loss:  1.467\n",
      "Epoch   2 Batch  464/538 - Train Accuracy:  0.752, Validation Accuracy:  0.773, Loss:  1.401\n",
      "Epoch   2 Batch  465/538 - Train Accuracy:  0.766, Validation Accuracy:  0.769, Loss:  1.412\n",
      "Epoch   2 Batch  466/538 - Train Accuracy:  0.767, Validation Accuracy:  0.773, Loss:  1.446\n",
      "Epoch   2 Batch  467/538 - Train Accuracy:  0.784, Validation Accuracy:  0.776, Loss:  1.415\n",
      "Epoch   2 Batch  468/538 - Train Accuracy:  0.821, Validation Accuracy:  0.785, Loss:  1.384\n",
      "Epoch   2 Batch  469/538 - Train Accuracy:  0.809, Validation Accuracy:  0.776, Loss:  1.340\n",
      "Epoch   2 Batch  470/538 - Train Accuracy:  0.782, Validation Accuracy:  0.776, Loss:  1.390\n",
      "Epoch   2 Batch  471/538 - Train Accuracy:  0.760, Validation Accuracy:  0.770, Loss:  1.404\n",
      "Epoch   2 Batch  472/538 - Train Accuracy:  0.809, Validation Accuracy:  0.767, Loss:  1.375\n",
      "Epoch   2 Batch  473/538 - Train Accuracy:  0.764, Validation Accuracy:  0.771, Loss:  1.402\n",
      "Epoch   2 Batch  474/538 - Train Accuracy:  0.797, Validation Accuracy:  0.776, Loss:  1.378\n",
      "Epoch   2 Batch  475/538 - Train Accuracy:  0.791, Validation Accuracy:  0.769, Loss:  1.452\n",
      "Epoch   2 Batch  476/538 - Train Accuracy:  0.765, Validation Accuracy:  0.771, Loss:  1.404\n",
      "Epoch   2 Batch  477/538 - Train Accuracy:  0.768, Validation Accuracy:  0.760, Loss:  1.398\n",
      "Epoch   2 Batch  478/538 - Train Accuracy:  0.802, Validation Accuracy:  0.755, Loss:  1.389\n",
      "Epoch   2 Batch  479/538 - Train Accuracy:  0.764, Validation Accuracy:  0.748, Loss:  1.397\n",
      "Epoch   2 Batch  480/538 - Train Accuracy:  0.796, Validation Accuracy:  0.755, Loss:  1.360\n",
      "Epoch   2 Batch  481/538 - Train Accuracy:  0.802, Validation Accuracy:  0.758, Loss:  1.420\n",
      "Epoch   2 Batch  482/538 - Train Accuracy:  0.789, Validation Accuracy:  0.767, Loss:  1.304\n",
      "Epoch   2 Batch  483/538 - Train Accuracy:  0.759, Validation Accuracy:  0.768, Loss:  1.375\n",
      "Epoch   2 Batch  484/538 - Train Accuracy:  0.795, Validation Accuracy:  0.765, Loss:  1.453\n",
      "Epoch   2 Batch  485/538 - Train Accuracy:  0.782, Validation Accuracy:  0.772, Loss:  1.382\n",
      "Epoch   2 Batch  486/538 - Train Accuracy:  0.781, Validation Accuracy:  0.775, Loss:  1.402\n",
      "Epoch   2 Batch  487/538 - Train Accuracy:  0.780, Validation Accuracy:  0.786, Loss:  1.396\n",
      "Epoch   2 Batch  488/538 - Train Accuracy:  0.793, Validation Accuracy:  0.779, Loss:  1.376\n",
      "Epoch   2 Batch  489/538 - Train Accuracy:  0.784, Validation Accuracy:  0.776, Loss:  1.386\n",
      "Epoch   2 Batch  490/538 - Train Accuracy:  0.782, Validation Accuracy:  0.786, Loss:  1.393\n",
      "Epoch   2 Batch  491/538 - Train Accuracy:  0.770, Validation Accuracy:  0.790, Loss:  1.439\n",
      "Epoch   2 Batch  492/538 - Train Accuracy:  0.787, Validation Accuracy:  0.794, Loss:  1.380\n",
      "Epoch   2 Batch  493/538 - Train Accuracy:  0.774, Validation Accuracy:  0.794, Loss:  1.407\n",
      "Epoch   2 Batch  494/538 - Train Accuracy:  0.794, Validation Accuracy:  0.788, Loss:  1.387\n",
      "Epoch   2 Batch  495/538 - Train Accuracy:  0.789, Validation Accuracy:  0.788, Loss:  1.418\n",
      "Epoch   2 Batch  496/538 - Train Accuracy:  0.770, Validation Accuracy:  0.778, Loss:  1.417\n",
      "Epoch   2 Batch  497/538 - Train Accuracy:  0.792, Validation Accuracy:  0.773, Loss:  1.401\n",
      "Epoch   2 Batch  498/538 - Train Accuracy:  0.758, Validation Accuracy:  0.782, Loss:  1.370\n",
      "Epoch   2 Batch  499/538 - Train Accuracy:  0.813, Validation Accuracy:  0.786, Loss:  1.377\n",
      "Epoch   2 Batch  500/538 - Train Accuracy:  0.797, Validation Accuracy:  0.792, Loss:  1.372\n",
      "Epoch   2 Batch  501/538 - Train Accuracy:  0.799, Validation Accuracy:  0.791, Loss:  1.367\n",
      "Epoch   2 Batch  502/538 - Train Accuracy:  0.784, Validation Accuracy:  0.792, Loss:  1.367\n",
      "Epoch   2 Batch  503/538 - Train Accuracy:  0.804, Validation Accuracy:  0.790, Loss:  1.425\n",
      "Epoch   2 Batch  504/538 - Train Accuracy:  0.791, Validation Accuracy:  0.778, Loss:  1.408\n",
      "Epoch   2 Batch  505/538 - Train Accuracy:  0.789, Validation Accuracy:  0.792, Loss:  1.364\n",
      "Epoch   2 Batch  506/538 - Train Accuracy:  0.801, Validation Accuracy:  0.802, Loss:  1.382\n",
      "Epoch   2 Batch  507/538 - Train Accuracy:  0.757, Validation Accuracy:  0.790, Loss:  1.355\n",
      "Epoch   2 Batch  508/538 - Train Accuracy:  0.784, Validation Accuracy:  0.796, Loss:  1.384\n",
      "Epoch   2 Batch  509/538 - Train Accuracy:  0.781, Validation Accuracy:  0.795, Loss:  1.414\n",
      "Epoch   2 Batch  510/538 - Train Accuracy:  0.779, Validation Accuracy:  0.791, Loss:  1.377\n",
      "Epoch   2 Batch  511/538 - Train Accuracy:  0.799, Validation Accuracy:  0.783, Loss:  1.345\n",
      "Epoch   2 Batch  512/538 - Train Accuracy:  0.811, Validation Accuracy:  0.795, Loss:  1.358\n",
      "Epoch   2 Batch  513/538 - Train Accuracy:  0.781, Validation Accuracy:  0.791, Loss:  1.426\n",
      "Epoch   2 Batch  514/538 - Train Accuracy:  0.788, Validation Accuracy:  0.783, Loss:  1.423\n",
      "Epoch   2 Batch  515/538 - Train Accuracy:  0.792, Validation Accuracy:  0.781, Loss:  1.446\n",
      "Epoch   2 Batch  516/538 - Train Accuracy:  0.747, Validation Accuracy:  0.786, Loss:  1.412\n",
      "Epoch   2 Batch  517/538 - Train Accuracy:  0.785, Validation Accuracy:  0.779, Loss:  1.386\n",
      "Epoch   2 Batch  518/538 - Train Accuracy:  0.782, Validation Accuracy:  0.782, Loss:  1.444\n",
      "Epoch   2 Batch  519/538 - Train Accuracy:  0.803, Validation Accuracy:  0.781, Loss:  1.389\n",
      "Epoch   2 Batch  520/538 - Train Accuracy:  0.796, Validation Accuracy:  0.786, Loss:  1.381\n",
      "Epoch   2 Batch  521/538 - Train Accuracy:  0.783, Validation Accuracy:  0.781, Loss:  1.394\n",
      "Epoch   2 Batch  522/538 - Train Accuracy:  0.765, Validation Accuracy:  0.786, Loss:  1.361\n",
      "Epoch   2 Batch  523/538 - Train Accuracy:  0.781, Validation Accuracy:  0.791, Loss:  1.353\n",
      "Epoch   2 Batch  524/538 - Train Accuracy:  0.793, Validation Accuracy:  0.797, Loss:  1.453\n",
      "Epoch   2 Batch  525/538 - Train Accuracy:  0.813, Validation Accuracy:  0.792, Loss:  1.364\n",
      "Epoch   2 Batch  526/538 - Train Accuracy:  0.772, Validation Accuracy:  0.778, Loss:  1.408\n",
      "Epoch   2 Batch  527/538 - Train Accuracy:  0.789, Validation Accuracy:  0.787, Loss:  1.383\n",
      "Epoch   2 Batch  528/538 - Train Accuracy:  0.774, Validation Accuracy:  0.802, Loss:  1.405\n",
      "Epoch   2 Batch  529/538 - Train Accuracy:  0.787, Validation Accuracy:  0.785, Loss:  1.361\n",
      "Epoch   2 Batch  530/538 - Train Accuracy:  0.781, Validation Accuracy:  0.769, Loss:  1.382\n",
      "Epoch   2 Batch  531/538 - Train Accuracy:  0.793, Validation Accuracy:  0.778, Loss:  1.401\n",
      "Epoch   2 Batch  532/538 - Train Accuracy:  0.785, Validation Accuracy:  0.766, Loss:  1.352\n",
      "Epoch   2 Batch  533/538 - Train Accuracy:  0.793, Validation Accuracy:  0.767, Loss:  1.397\n",
      "Epoch   2 Batch  534/538 - Train Accuracy:  0.781, Validation Accuracy:  0.773, Loss:  1.372\n",
      "Epoch   2 Batch  535/538 - Train Accuracy:  0.802, Validation Accuracy:  0.788, Loss:  1.389\n",
      "Epoch   2 Batch  536/538 - Train Accuracy:  0.813, Validation Accuracy:  0.782, Loss:  1.352\n",
      "Epoch   3 Batch    0/538 - Train Accuracy:  0.806, Validation Accuracy:  0.788, Loss:  1.347\n",
      "Epoch   3 Batch    1/538 - Train Accuracy:  0.797, Validation Accuracy:  0.778, Loss:  1.334\n",
      "Epoch   3 Batch    2/538 - Train Accuracy:  0.769, Validation Accuracy:  0.776, Loss:  1.382\n",
      "Epoch   3 Batch    3/538 - Train Accuracy:  0.796, Validation Accuracy:  0.804, Loss:  1.364\n",
      "Epoch   3 Batch    4/538 - Train Accuracy:  0.816, Validation Accuracy:  0.799, Loss:  1.388\n",
      "Epoch   3 Batch    5/538 - Train Accuracy:  0.787, Validation Accuracy:  0.788, Loss:  1.385\n",
      "Epoch   3 Batch    6/538 - Train Accuracy:  0.816, Validation Accuracy:  0.794, Loss:  1.391\n",
      "Epoch   3 Batch    7/538 - Train Accuracy:  0.793, Validation Accuracy:  0.790, Loss:  1.440\n",
      "Epoch   3 Batch    8/538 - Train Accuracy:  0.807, Validation Accuracy:  0.785, Loss:  1.414\n",
      "Epoch   3 Batch    9/538 - Train Accuracy:  0.789, Validation Accuracy:  0.792, Loss:  1.340\n",
      "Epoch   3 Batch   10/538 - Train Accuracy:  0.783, Validation Accuracy:  0.781, Loss:  1.413\n",
      "Epoch   3 Batch   11/538 - Train Accuracy:  0.812, Validation Accuracy:  0.777, Loss:  1.339\n",
      "Epoch   3 Batch   12/538 - Train Accuracy:  0.769, Validation Accuracy:  0.781, Loss:  1.367\n",
      "Epoch   3 Batch   13/538 - Train Accuracy:  0.811, Validation Accuracy:  0.779, Loss:  1.370\n",
      "Epoch   3 Batch   14/538 - Train Accuracy:  0.779, Validation Accuracy:  0.781, Loss:  1.406\n",
      "Epoch   3 Batch   15/538 - Train Accuracy:  0.807, Validation Accuracy:  0.777, Loss:  1.386\n",
      "Epoch   3 Batch   16/538 - Train Accuracy:  0.790, Validation Accuracy:  0.794, Loss:  1.374\n",
      "Epoch   3 Batch   17/538 - Train Accuracy:  0.779, Validation Accuracy:  0.792, Loss:  1.373\n",
      "Epoch   3 Batch   18/538 - Train Accuracy:  0.775, Validation Accuracy:  0.803, Loss:  1.428\n",
      "Epoch   3 Batch   19/538 - Train Accuracy:  0.796, Validation Accuracy:  0.816, Loss:  1.444\n",
      "Epoch   3 Batch   20/538 - Train Accuracy:  0.786, Validation Accuracy:  0.810, Loss:  1.435\n",
      "Epoch   3 Batch   21/538 - Train Accuracy:  0.809, Validation Accuracy:  0.815, Loss:  1.415\n",
      "Epoch   3 Batch   22/538 - Train Accuracy:  0.812, Validation Accuracy:  0.820, Loss:  1.372\n",
      "Epoch   3 Batch   23/538 - Train Accuracy:  0.794, Validation Accuracy:  0.807, Loss:  1.403\n",
      "Epoch   3 Batch   24/538 - Train Accuracy:  0.800, Validation Accuracy:  0.816, Loss:  1.391\n",
      "Epoch   3 Batch   25/538 - Train Accuracy:  0.810, Validation Accuracy:  0.821, Loss:  1.395\n",
      "Epoch   3 Batch   26/538 - Train Accuracy:  0.775, Validation Accuracy:  0.801, Loss:  1.350\n",
      "Epoch   3 Batch   27/538 - Train Accuracy:  0.822, Validation Accuracy:  0.796, Loss:  1.357\n",
      "Epoch   3 Batch   28/538 - Train Accuracy:  0.798, Validation Accuracy:  0.799, Loss:  1.349\n",
      "Epoch   3 Batch   29/538 - Train Accuracy:  0.815, Validation Accuracy:  0.794, Loss:  1.362\n",
      "Epoch   3 Batch   30/538 - Train Accuracy:  0.779, Validation Accuracy:  0.803, Loss:  1.356\n",
      "Epoch   3 Batch   31/538 - Train Accuracy:  0.799, Validation Accuracy:  0.803, Loss:  1.338\n",
      "Epoch   3 Batch   32/538 - Train Accuracy:  0.778, Validation Accuracy:  0.807, Loss:  1.327\n",
      "Epoch   3 Batch   33/538 - Train Accuracy:  0.789, Validation Accuracy:  0.809, Loss:  1.335\n",
      "Epoch   3 Batch   34/538 - Train Accuracy:  0.830, Validation Accuracy:  0.802, Loss:  1.389\n",
      "Epoch   3 Batch   35/538 - Train Accuracy:  0.809, Validation Accuracy:  0.807, Loss:  1.378\n",
      "Epoch   3 Batch   36/538 - Train Accuracy:  0.788, Validation Accuracy:  0.810, Loss:  1.361\n",
      "Epoch   3 Batch   37/538 - Train Accuracy:  0.806, Validation Accuracy:  0.818, Loss:  1.331\n",
      "Epoch   3 Batch   38/538 - Train Accuracy:  0.793, Validation Accuracy:  0.815, Loss:  1.402\n",
      "Epoch   3 Batch   39/538 - Train Accuracy:  0.810, Validation Accuracy:  0.811, Loss:  1.375\n",
      "Epoch   3 Batch   40/538 - Train Accuracy:  0.803, Validation Accuracy:  0.792, Loss:  1.312\n",
      "Epoch   3 Batch   41/538 - Train Accuracy:  0.793, Validation Accuracy:  0.797, Loss:  1.383\n",
      "Epoch   3 Batch   42/538 - Train Accuracy:  0.807, Validation Accuracy:  0.800, Loss:  1.396\n",
      "Epoch   3 Batch   43/538 - Train Accuracy:  0.802, Validation Accuracy:  0.821, Loss:  1.411\n",
      "Epoch   3 Batch   44/538 - Train Accuracy:  0.788, Validation Accuracy:  0.814, Loss:  1.393\n",
      "Epoch   3 Batch   45/538 - Train Accuracy:  0.823, Validation Accuracy:  0.826, Loss:  1.331\n",
      "Epoch   3 Batch   46/538 - Train Accuracy:  0.819, Validation Accuracy:  0.820, Loss:  1.377\n",
      "Epoch   3 Batch   47/538 - Train Accuracy:  0.810, Validation Accuracy:  0.813, Loss:  1.417\n",
      "Epoch   3 Batch   48/538 - Train Accuracy:  0.806, Validation Accuracy:  0.804, Loss:  1.353\n",
      "Epoch   3 Batch   49/538 - Train Accuracy:  0.781, Validation Accuracy:  0.802, Loss:  1.402\n",
      "Epoch   3 Batch   50/538 - Train Accuracy:  0.798, Validation Accuracy:  0.821, Loss:  1.347\n",
      "Epoch   3 Batch   51/538 - Train Accuracy:  0.787, Validation Accuracy:  0.812, Loss:  1.401\n",
      "Epoch   3 Batch   52/538 - Train Accuracy:  0.800, Validation Accuracy:  0.807, Loss:  1.397\n",
      "Epoch   3 Batch   53/538 - Train Accuracy:  0.810, Validation Accuracy:  0.809, Loss:  1.361\n",
      "Epoch   3 Batch   54/538 - Train Accuracy:  0.796, Validation Accuracy:  0.791, Loss:  1.321\n",
      "Epoch   3 Batch   55/538 - Train Accuracy:  0.797, Validation Accuracy:  0.790, Loss:  1.400\n",
      "Epoch   3 Batch   56/538 - Train Accuracy:  0.795, Validation Accuracy:  0.799, Loss:  1.323\n",
      "Epoch   3 Batch   57/538 - Train Accuracy:  0.760, Validation Accuracy:  0.803, Loss:  1.410\n",
      "Epoch   3 Batch   58/538 - Train Accuracy:  0.795, Validation Accuracy:  0.810, Loss:  1.395\n",
      "Epoch   3 Batch   59/538 - Train Accuracy:  0.788, Validation Accuracy:  0.798, Loss:  1.400\n",
      "Epoch   3 Batch   60/538 - Train Accuracy:  0.804, Validation Accuracy:  0.801, Loss:  1.356\n",
      "Epoch   3 Batch   61/538 - Train Accuracy:  0.785, Validation Accuracy:  0.797, Loss:  1.370\n",
      "Epoch   3 Batch   62/538 - Train Accuracy:  0.803, Validation Accuracy:  0.804, Loss:  1.385\n",
      "Epoch   3 Batch   63/538 - Train Accuracy:  0.837, Validation Accuracy:  0.801, Loss:  1.350\n",
      "Epoch   3 Batch   64/538 - Train Accuracy:  0.823, Validation Accuracy:  0.816, Loss:  1.319\n",
      "Epoch   3 Batch   65/538 - Train Accuracy:  0.805, Validation Accuracy:  0.795, Loss:  1.356\n",
      "Epoch   3 Batch   66/538 - Train Accuracy:  0.814, Validation Accuracy:  0.809, Loss:  1.351\n",
      "Epoch   3 Batch   67/538 - Train Accuracy:  0.814, Validation Accuracy:  0.793, Loss:  1.358\n",
      "Epoch   3 Batch   68/538 - Train Accuracy:  0.799, Validation Accuracy:  0.790, Loss:  1.336\n",
      "Epoch   3 Batch   69/538 - Train Accuracy:  0.811, Validation Accuracy:  0.801, Loss:  1.360\n",
      "Epoch   3 Batch   70/538 - Train Accuracy:  0.798, Validation Accuracy:  0.808, Loss:  1.352\n",
      "Epoch   3 Batch   71/538 - Train Accuracy:  0.808, Validation Accuracy:  0.810, Loss:  1.333\n",
      "Epoch   3 Batch   72/538 - Train Accuracy:  0.821, Validation Accuracy:  0.810, Loss:  1.348\n",
      "Epoch   3 Batch   73/538 - Train Accuracy:  0.805, Validation Accuracy:  0.809, Loss:  1.351\n",
      "Epoch   3 Batch   74/538 - Train Accuracy:  0.814, Validation Accuracy:  0.812, Loss:  1.388\n",
      "Epoch   3 Batch   75/538 - Train Accuracy:  0.814, Validation Accuracy:  0.806, Loss:  1.369\n",
      "Epoch   3 Batch   76/538 - Train Accuracy:  0.825, Validation Accuracy:  0.822, Loss:  1.379\n",
      "Epoch   3 Batch   77/538 - Train Accuracy:  0.825, Validation Accuracy:  0.829, Loss:  1.383\n",
      "Epoch   3 Batch   78/538 - Train Accuracy:  0.820, Validation Accuracy:  0.824, Loss:  1.299\n",
      "Epoch   3 Batch   79/538 - Train Accuracy:  0.814, Validation Accuracy:  0.816, Loss:  1.332\n",
      "Epoch   3 Batch   80/538 - Train Accuracy:  0.818, Validation Accuracy:  0.805, Loss:  1.367\n",
      "Epoch   3 Batch   81/538 - Train Accuracy:  0.812, Validation Accuracy:  0.812, Loss:  1.380\n",
      "Epoch   3 Batch   82/538 - Train Accuracy:  0.801, Validation Accuracy:  0.814, Loss:  1.365\n",
      "Epoch   3 Batch   83/538 - Train Accuracy:  0.802, Validation Accuracy:  0.828, Loss:  1.390\n",
      "Epoch   3 Batch   84/538 - Train Accuracy:  0.812, Validation Accuracy:  0.821, Loss:  1.430\n",
      "Epoch   3 Batch   85/538 - Train Accuracy:  0.816, Validation Accuracy:  0.816, Loss:  1.366\n",
      "Epoch   3 Batch   86/538 - Train Accuracy:  0.819, Validation Accuracy:  0.814, Loss:  1.397\n",
      "Epoch   3 Batch   87/538 - Train Accuracy:  0.807, Validation Accuracy:  0.816, Loss:  1.367\n",
      "Epoch   3 Batch   88/538 - Train Accuracy:  0.828, Validation Accuracy:  0.816, Loss:  1.384\n",
      "Epoch   3 Batch   89/538 - Train Accuracy:  0.812, Validation Accuracy:  0.824, Loss:  1.344\n",
      "Epoch   3 Batch   90/538 - Train Accuracy:  0.826, Validation Accuracy:  0.826, Loss:  1.386\n",
      "Epoch   3 Batch   91/538 - Train Accuracy:  0.833, Validation Accuracy:  0.823, Loss:  1.376\n",
      "Epoch   3 Batch   92/538 - Train Accuracy:  0.793, Validation Accuracy:  0.822, Loss:  1.343\n",
      "Epoch   3 Batch   93/538 - Train Accuracy:  0.803, Validation Accuracy:  0.807, Loss:  1.355\n",
      "Epoch   3 Batch   94/538 - Train Accuracy:  0.824, Validation Accuracy:  0.811, Loss:  1.377\n",
      "Epoch   3 Batch   95/538 - Train Accuracy:  0.813, Validation Accuracy:  0.812, Loss:  1.369\n",
      "Epoch   3 Batch   96/538 - Train Accuracy:  0.846, Validation Accuracy:  0.822, Loss:  1.329\n",
      "Epoch   3 Batch   97/538 - Train Accuracy:  0.794, Validation Accuracy:  0.822, Loss:  1.370\n",
      "Epoch   3 Batch   98/538 - Train Accuracy:  0.839, Validation Accuracy:  0.809, Loss:  1.398\n",
      "Epoch   3 Batch   99/538 - Train Accuracy:  0.813, Validation Accuracy:  0.815, Loss:  1.339\n",
      "Epoch   3 Batch  100/538 - Train Accuracy:  0.817, Validation Accuracy:  0.816, Loss:  1.330\n",
      "Epoch   3 Batch  101/538 - Train Accuracy:  0.784, Validation Accuracy:  0.821, Loss:  1.367\n",
      "Epoch   3 Batch  102/538 - Train Accuracy:  0.829, Validation Accuracy:  0.826, Loss:  1.335\n",
      "Epoch   3 Batch  103/538 - Train Accuracy:  0.836, Validation Accuracy:  0.827, Loss:  1.312\n",
      "Epoch   3 Batch  104/538 - Train Accuracy:  0.826, Validation Accuracy:  0.821, Loss:  1.324\n",
      "Epoch   3 Batch  105/538 - Train Accuracy:  0.806, Validation Accuracy:  0.821, Loss:  1.354\n",
      "Epoch   3 Batch  106/538 - Train Accuracy:  0.817, Validation Accuracy:  0.821, Loss:  1.332\n",
      "Epoch   3 Batch  107/538 - Train Accuracy:  0.801, Validation Accuracy:  0.808, Loss:  1.340\n",
      "Epoch   3 Batch  108/538 - Train Accuracy:  0.806, Validation Accuracy:  0.800, Loss:  1.380\n",
      "Epoch   3 Batch  109/538 - Train Accuracy:  0.833, Validation Accuracy:  0.813, Loss:  1.312\n",
      "Epoch   3 Batch  110/538 - Train Accuracy:  0.806, Validation Accuracy:  0.820, Loss:  1.331\n",
      "Epoch   3 Batch  111/538 - Train Accuracy:  0.846, Validation Accuracy:  0.827, Loss:  1.385\n",
      "Epoch   3 Batch  112/538 - Train Accuracy:  0.825, Validation Accuracy:  0.823, Loss:  1.366\n",
      "Epoch   3 Batch  113/538 - Train Accuracy:  0.810, Validation Accuracy:  0.819, Loss:  1.332\n",
      "Epoch   3 Batch  114/538 - Train Accuracy:  0.825, Validation Accuracy:  0.819, Loss:  1.328\n",
      "Epoch   3 Batch  115/538 - Train Accuracy:  0.836, Validation Accuracy:  0.827, Loss:  1.381\n",
      "Epoch   3 Batch  116/538 - Train Accuracy:  0.812, Validation Accuracy:  0.829, Loss:  1.419\n",
      "Epoch   3 Batch  117/538 - Train Accuracy:  0.835, Validation Accuracy:  0.832, Loss:  1.319\n",
      "Epoch   3 Batch  118/538 - Train Accuracy:  0.822, Validation Accuracy:  0.835, Loss:  1.330\n",
      "Epoch   3 Batch  119/538 - Train Accuracy:  0.851, Validation Accuracy:  0.826, Loss:  1.277\n",
      "Epoch   3 Batch  120/538 - Train Accuracy:  0.831, Validation Accuracy:  0.816, Loss:  1.334\n",
      "Epoch   3 Batch  121/538 - Train Accuracy:  0.816, Validation Accuracy:  0.817, Loss:  1.293\n",
      "Epoch   3 Batch  122/538 - Train Accuracy:  0.834, Validation Accuracy:  0.830, Loss:  1.327\n",
      "Epoch   3 Batch  123/538 - Train Accuracy:  0.838, Validation Accuracy:  0.821, Loss:  1.305\n",
      "Epoch   3 Batch  124/538 - Train Accuracy:  0.830, Validation Accuracy:  0.828, Loss:  1.342\n",
      "Epoch   3 Batch  125/538 - Train Accuracy:  0.828, Validation Accuracy:  0.827, Loss:  1.342\n",
      "Epoch   3 Batch  126/538 - Train Accuracy:  0.835, Validation Accuracy:  0.821, Loss:  1.328\n",
      "Epoch   3 Batch  127/538 - Train Accuracy:  0.815, Validation Accuracy:  0.818, Loss:  1.329\n",
      "Epoch   3 Batch  128/538 - Train Accuracy:  0.837, Validation Accuracy:  0.826, Loss:  1.337\n",
      "Epoch   3 Batch  129/538 - Train Accuracy:  0.840, Validation Accuracy:  0.823, Loss:  1.311\n",
      "Epoch   3 Batch  130/538 - Train Accuracy:  0.815, Validation Accuracy:  0.828, Loss:  1.332\n",
      "Epoch   3 Batch  131/538 - Train Accuracy:  0.834, Validation Accuracy:  0.820, Loss:  1.373\n",
      "Epoch   3 Batch  132/538 - Train Accuracy:  0.798, Validation Accuracy:  0.816, Loss:  1.316\n",
      "Epoch   3 Batch  133/538 - Train Accuracy:  0.821, Validation Accuracy:  0.824, Loss:  1.362\n",
      "Epoch   3 Batch  134/538 - Train Accuracy:  0.811, Validation Accuracy:  0.815, Loss:  1.385\n",
      "Epoch   3 Batch  135/538 - Train Accuracy:  0.802, Validation Accuracy:  0.809, Loss:  1.379\n",
      "Epoch   3 Batch  136/538 - Train Accuracy:  0.815, Validation Accuracy:  0.808, Loss:  1.264\n",
      "Epoch   3 Batch  137/538 - Train Accuracy:  0.801, Validation Accuracy:  0.810, Loss:  1.363\n",
      "Epoch   3 Batch  138/538 - Train Accuracy:  0.823, Validation Accuracy:  0.815, Loss:  1.302\n",
      "Epoch   3 Batch  139/538 - Train Accuracy:  0.813, Validation Accuracy:  0.822, Loss:  1.379\n",
      "Epoch   3 Batch  140/538 - Train Accuracy:  0.794, Validation Accuracy:  0.827, Loss:  1.367\n",
      "Epoch   3 Batch  141/538 - Train Accuracy:  0.832, Validation Accuracy:  0.821, Loss:  1.309\n",
      "Epoch   3 Batch  142/538 - Train Accuracy:  0.842, Validation Accuracy:  0.830, Loss:  1.354\n",
      "Epoch   3 Batch  143/538 - Train Accuracy:  0.835, Validation Accuracy:  0.830, Loss:  1.394\n",
      "Epoch   3 Batch  144/538 - Train Accuracy:  0.845, Validation Accuracy:  0.834, Loss:  1.390\n",
      "Epoch   3 Batch  145/538 - Train Accuracy:  0.788, Validation Accuracy:  0.801, Loss:  1.371\n",
      "Epoch   3 Batch  146/538 - Train Accuracy:  0.800, Validation Accuracy:  0.793, Loss:  1.344\n",
      "Epoch   3 Batch  147/538 - Train Accuracy:  0.826, Validation Accuracy:  0.805, Loss:  1.291\n",
      "Epoch   3 Batch  148/538 - Train Accuracy:  0.804, Validation Accuracy:  0.818, Loss:  1.344\n",
      "Epoch   3 Batch  149/538 - Train Accuracy:  0.843, Validation Accuracy:  0.807, Loss:  1.328\n",
      "Epoch   3 Batch  150/538 - Train Accuracy:  0.823, Validation Accuracy:  0.816, Loss:  1.329\n",
      "Epoch   3 Batch  151/538 - Train Accuracy:  0.803, Validation Accuracy:  0.798, Loss:  1.346\n",
      "Epoch   3 Batch  152/538 - Train Accuracy:  0.798, Validation Accuracy:  0.800, Loss:  1.327\n",
      "Epoch   3 Batch  153/538 - Train Accuracy:  0.809, Validation Accuracy:  0.806, Loss:  1.359\n",
      "Epoch   3 Batch  154/538 - Train Accuracy:  0.846, Validation Accuracy:  0.834, Loss:  1.346\n",
      "Epoch   3 Batch  155/538 - Train Accuracy:  0.829, Validation Accuracy:  0.828, Loss:  1.312\n",
      "Epoch   3 Batch  156/538 - Train Accuracy:  0.832, Validation Accuracy:  0.823, Loss:  1.338\n",
      "Epoch   3 Batch  157/538 - Train Accuracy:  0.823, Validation Accuracy:  0.831, Loss:  1.318\n",
      "Epoch   3 Batch  158/538 - Train Accuracy:  0.838, Validation Accuracy:  0.825, Loss:  1.327\n",
      "Epoch   3 Batch  159/538 - Train Accuracy:  0.809, Validation Accuracy:  0.814, Loss:  1.352\n",
      "Epoch   3 Batch  160/538 - Train Accuracy:  0.809, Validation Accuracy:  0.822, Loss:  1.320\n",
      "Epoch   3 Batch  161/538 - Train Accuracy:  0.818, Validation Accuracy:  0.820, Loss:  1.313\n",
      "Epoch   3 Batch  162/538 - Train Accuracy:  0.833, Validation Accuracy:  0.815, Loss:  1.349\n",
      "Epoch   3 Batch  163/538 - Train Accuracy:  0.834, Validation Accuracy:  0.810, Loss:  1.326\n",
      "Epoch   3 Batch  164/538 - Train Accuracy:  0.816, Validation Accuracy:  0.815, Loss:  1.267\n",
      "Epoch   3 Batch  165/538 - Train Accuracy:  0.821, Validation Accuracy:  0.807, Loss:  1.292\n",
      "Epoch   3 Batch  166/538 - Train Accuracy:  0.849, Validation Accuracy:  0.810, Loss:  1.311\n",
      "Epoch   3 Batch  167/538 - Train Accuracy:  0.820, Validation Accuracy:  0.807, Loss:  1.304\n",
      "Epoch   3 Batch  168/538 - Train Accuracy:  0.796, Validation Accuracy:  0.811, Loss:  1.360\n",
      "Epoch   3 Batch  169/538 - Train Accuracy:  0.834, Validation Accuracy:  0.822, Loss:  1.352\n",
      "Epoch   3 Batch  170/538 - Train Accuracy:  0.816, Validation Accuracy:  0.821, Loss:  1.317\n",
      "Epoch   3 Batch  171/538 - Train Accuracy:  0.835, Validation Accuracy:  0.821, Loss:  1.393\n",
      "Epoch   3 Batch  172/538 - Train Accuracy:  0.815, Validation Accuracy:  0.814, Loss:  1.333\n",
      "Epoch   3 Batch  173/538 - Train Accuracy:  0.830, Validation Accuracy:  0.817, Loss:  1.324\n",
      "Epoch   3 Batch  174/538 - Train Accuracy:  0.827, Validation Accuracy:  0.836, Loss:  1.335\n",
      "Epoch   3 Batch  175/538 - Train Accuracy:  0.846, Validation Accuracy:  0.836, Loss:  1.345\n",
      "Epoch   3 Batch  176/538 - Train Accuracy:  0.809, Validation Accuracy:  0.828, Loss:  1.345\n",
      "Epoch   3 Batch  177/538 - Train Accuracy:  0.837, Validation Accuracy:  0.823, Loss:  1.324\n",
      "Epoch   3 Batch  178/538 - Train Accuracy:  0.809, Validation Accuracy:  0.824, Loss:  1.308\n",
      "Epoch   3 Batch  179/538 - Train Accuracy:  0.810, Validation Accuracy:  0.829, Loss:  1.342\n",
      "Epoch   3 Batch  180/538 - Train Accuracy:  0.861, Validation Accuracy:  0.836, Loss:  1.333\n",
      "Epoch   3 Batch  181/538 - Train Accuracy:  0.824, Validation Accuracy:  0.836, Loss:  1.383\n",
      "Epoch   3 Batch  182/538 - Train Accuracy:  0.839, Validation Accuracy:  0.834, Loss:  1.299\n",
      "Epoch   3 Batch  183/538 - Train Accuracy:  0.861, Validation Accuracy:  0.838, Loss:  1.319\n",
      "Epoch   3 Batch  184/538 - Train Accuracy:  0.848, Validation Accuracy:  0.837, Loss:  1.313\n",
      "Epoch   3 Batch  185/538 - Train Accuracy:  0.856, Validation Accuracy:  0.841, Loss:  1.370\n",
      "Epoch   3 Batch  186/538 - Train Accuracy:  0.835, Validation Accuracy:  0.840, Loss:  1.340\n",
      "Epoch   3 Batch  187/538 - Train Accuracy:  0.850, Validation Accuracy:  0.828, Loss:  1.286\n",
      "Epoch   3 Batch  188/538 - Train Accuracy:  0.830, Validation Accuracy:  0.828, Loss:  1.293\n",
      "Epoch   3 Batch  189/538 - Train Accuracy:  0.819, Validation Accuracy:  0.833, Loss:  1.348\n",
      "Epoch   3 Batch  190/538 - Train Accuracy:  0.815, Validation Accuracy:  0.831, Loss:  1.325\n",
      "Epoch   3 Batch  191/538 - Train Accuracy:  0.835, Validation Accuracy:  0.827, Loss:  1.328\n",
      "Epoch   3 Batch  192/538 - Train Accuracy:  0.844, Validation Accuracy:  0.837, Loss:  1.341\n",
      "Epoch   3 Batch  193/538 - Train Accuracy:  0.834, Validation Accuracy:  0.835, Loss:  1.344\n",
      "Epoch   3 Batch  194/538 - Train Accuracy:  0.821, Validation Accuracy:  0.842, Loss:  1.377\n",
      "Epoch   3 Batch  195/538 - Train Accuracy:  0.830, Validation Accuracy:  0.832, Loss:  1.341\n",
      "Epoch   3 Batch  196/538 - Train Accuracy:  0.821, Validation Accuracy:  0.836, Loss:  1.317\n",
      "Epoch   3 Batch  197/538 - Train Accuracy:  0.834, Validation Accuracy:  0.836, Loss:  1.298\n",
      "Epoch   3 Batch  198/538 - Train Accuracy:  0.857, Validation Accuracy:  0.844, Loss:  1.317\n",
      "Epoch   3 Batch  199/538 - Train Accuracy:  0.827, Validation Accuracy:  0.839, Loss:  1.302\n",
      "Epoch   3 Batch  200/538 - Train Accuracy:  0.852, Validation Accuracy:  0.838, Loss:  1.336\n",
      "Epoch   3 Batch  201/538 - Train Accuracy:  0.831, Validation Accuracy:  0.835, Loss:  1.384\n",
      "Epoch   3 Batch  202/538 - Train Accuracy:  0.871, Validation Accuracy:  0.832, Loss:  1.303\n",
      "Epoch   3 Batch  203/538 - Train Accuracy:  0.810, Validation Accuracy:  0.836, Loss:  1.321\n",
      "Epoch   3 Batch  204/538 - Train Accuracy:  0.829, Validation Accuracy:  0.844, Loss:  1.355\n",
      "Epoch   3 Batch  205/538 - Train Accuracy:  0.851, Validation Accuracy:  0.844, Loss:  1.299\n",
      "Epoch   3 Batch  206/538 - Train Accuracy:  0.829, Validation Accuracy:  0.844, Loss:  1.281\n",
      "Epoch   3 Batch  207/538 - Train Accuracy:  0.835, Validation Accuracy:  0.843, Loss:  1.240\n",
      "Epoch   3 Batch  208/538 - Train Accuracy:  0.819, Validation Accuracy:  0.842, Loss:  1.347\n",
      "Epoch   3 Batch  209/538 - Train Accuracy:  0.848, Validation Accuracy:  0.845, Loss:  1.308\n",
      "Epoch   3 Batch  210/538 - Train Accuracy:  0.825, Validation Accuracy:  0.838, Loss:  1.259\n",
      "Epoch   3 Batch  211/538 - Train Accuracy:  0.817, Validation Accuracy:  0.837, Loss:  1.322\n",
      "Epoch   3 Batch  212/538 - Train Accuracy:  0.839, Validation Accuracy:  0.830, Loss:  1.327\n",
      "Epoch   3 Batch  213/538 - Train Accuracy:  0.836, Validation Accuracy:  0.829, Loss:  1.318\n",
      "Epoch   3 Batch  214/538 - Train Accuracy:  0.821, Validation Accuracy:  0.836, Loss:  1.312\n",
      "Epoch   3 Batch  215/538 - Train Accuracy:  0.843, Validation Accuracy:  0.836, Loss:  1.296\n",
      "Epoch   3 Batch  216/538 - Train Accuracy:  0.857, Validation Accuracy:  0.829, Loss:  1.362\n",
      "Epoch   3 Batch  217/538 - Train Accuracy:  0.859, Validation Accuracy:  0.833, Loss:  1.314\n",
      "Epoch   3 Batch  218/538 - Train Accuracy:  0.829, Validation Accuracy:  0.833, Loss:  1.333\n",
      "Epoch   3 Batch  219/538 - Train Accuracy:  0.812, Validation Accuracy:  0.828, Loss:  1.347\n",
      "Epoch   3 Batch  220/538 - Train Accuracy:  0.841, Validation Accuracy:  0.824, Loss:  1.322\n",
      "Epoch   3 Batch  221/538 - Train Accuracy:  0.831, Validation Accuracy:  0.828, Loss:  1.325\n",
      "Epoch   3 Batch  222/538 - Train Accuracy:  0.822, Validation Accuracy:  0.833, Loss:  1.297\n",
      "Epoch   3 Batch  223/538 - Train Accuracy:  0.840, Validation Accuracy:  0.830, Loss:  1.316\n",
      "Epoch   3 Batch  224/538 - Train Accuracy:  0.828, Validation Accuracy:  0.837, Loss:  1.326\n",
      "Epoch   3 Batch  225/538 - Train Accuracy:  0.835, Validation Accuracy:  0.822, Loss:  1.312\n",
      "Epoch   3 Batch  226/538 - Train Accuracy:  0.845, Validation Accuracy:  0.834, Loss:  1.330\n",
      "Epoch   3 Batch  227/538 - Train Accuracy:  0.847, Validation Accuracy:  0.834, Loss:  1.273\n",
      "Epoch   3 Batch  228/538 - Train Accuracy:  0.831, Validation Accuracy:  0.843, Loss:  1.306\n",
      "Epoch   3 Batch  229/538 - Train Accuracy:  0.846, Validation Accuracy:  0.842, Loss:  1.324\n",
      "Epoch   3 Batch  230/538 - Train Accuracy:  0.814, Validation Accuracy:  0.827, Loss:  1.367\n",
      "Epoch   3 Batch  231/538 - Train Accuracy:  0.824, Validation Accuracy:  0.844, Loss:  1.363\n",
      "Epoch   3 Batch  232/538 - Train Accuracy:  0.816, Validation Accuracy:  0.840, Loss:  1.305\n",
      "Epoch   3 Batch  233/538 - Train Accuracy:  0.873, Validation Accuracy:  0.849, Loss:  1.302\n",
      "Epoch   3 Batch  234/538 - Train Accuracy:  0.841, Validation Accuracy:  0.850, Loss:  1.328\n",
      "Epoch   3 Batch  235/538 - Train Accuracy:  0.875, Validation Accuracy:  0.849, Loss:  1.290\n",
      "Epoch   3 Batch  236/538 - Train Accuracy:  0.815, Validation Accuracy:  0.845, Loss:  1.260\n",
      "Epoch   3 Batch  237/538 - Train Accuracy:  0.869, Validation Accuracy:  0.848, Loss:  1.304\n",
      "Epoch   3 Batch  238/538 - Train Accuracy:  0.878, Validation Accuracy:  0.846, Loss:  1.297\n",
      "Epoch   3 Batch  239/538 - Train Accuracy:  0.843, Validation Accuracy:  0.839, Loss:  1.304\n",
      "Epoch   3 Batch  240/538 - Train Accuracy:  0.844, Validation Accuracy:  0.843, Loss:  1.327\n",
      "Epoch   3 Batch  241/538 - Train Accuracy:  0.840, Validation Accuracy:  0.848, Loss:  1.322\n",
      "Epoch   3 Batch  242/538 - Train Accuracy:  0.847, Validation Accuracy:  0.840, Loss:  1.307\n",
      "Epoch   3 Batch  243/538 - Train Accuracy:  0.836, Validation Accuracy:  0.848, Loss:  1.277\n",
      "Epoch   3 Batch  244/538 - Train Accuracy:  0.847, Validation Accuracy:  0.849, Loss:  1.342\n",
      "Epoch   3 Batch  245/538 - Train Accuracy:  0.840, Validation Accuracy:  0.848, Loss:  1.311\n",
      "Epoch   3 Batch  246/538 - Train Accuracy:  0.845, Validation Accuracy:  0.852, Loss:  1.296\n",
      "Epoch   3 Batch  247/538 - Train Accuracy:  0.851, Validation Accuracy:  0.853, Loss:  1.339\n",
      "Epoch   3 Batch  248/538 - Train Accuracy:  0.876, Validation Accuracy:  0.847, Loss:  1.287\n",
      "Epoch   3 Batch  249/538 - Train Accuracy:  0.839, Validation Accuracy:  0.843, Loss:  1.307\n",
      "Epoch   3 Batch  250/538 - Train Accuracy:  0.863, Validation Accuracy:  0.845, Loss:  1.319\n",
      "Epoch   3 Batch  251/538 - Train Accuracy:  0.850, Validation Accuracy:  0.843, Loss:  1.315\n",
      "Epoch   3 Batch  252/538 - Train Accuracy:  0.852, Validation Accuracy:  0.840, Loss:  1.259\n",
      "Epoch   3 Batch  253/538 - Train Accuracy:  0.822, Validation Accuracy:  0.837, Loss:  1.321\n",
      "Epoch   3 Batch  254/538 - Train Accuracy:  0.828, Validation Accuracy:  0.839, Loss:  1.345\n",
      "Epoch   3 Batch  255/538 - Train Accuracy:  0.855, Validation Accuracy:  0.844, Loss:  1.300\n",
      "Epoch   3 Batch  256/538 - Train Accuracy:  0.841, Validation Accuracy:  0.852, Loss:  1.264\n",
      "Epoch   3 Batch  257/538 - Train Accuracy:  0.865, Validation Accuracy:  0.852, Loss:  1.259\n",
      "Epoch   3 Batch  258/538 - Train Accuracy:  0.855, Validation Accuracy:  0.858, Loss:  1.312\n",
      "Epoch   3 Batch  259/538 - Train Accuracy:  0.890, Validation Accuracy:  0.866, Loss:  1.277\n",
      "Epoch   3 Batch  260/538 - Train Accuracy:  0.829, Validation Accuracy:  0.864, Loss:  1.299\n",
      "Epoch   3 Batch  261/538 - Train Accuracy:  0.849, Validation Accuracy:  0.865, Loss:  1.279\n",
      "Epoch   3 Batch  262/538 - Train Accuracy:  0.881, Validation Accuracy:  0.861, Loss:  1.268\n",
      "Epoch   3 Batch  263/538 - Train Accuracy:  0.855, Validation Accuracy:  0.862, Loss:  1.335\n",
      "Epoch   3 Batch  264/538 - Train Accuracy:  0.844, Validation Accuracy:  0.859, Loss:  1.328\n",
      "Epoch   3 Batch  265/538 - Train Accuracy:  0.846, Validation Accuracy:  0.854, Loss:  1.325\n",
      "Epoch   3 Batch  266/538 - Train Accuracy:  0.845, Validation Accuracy:  0.855, Loss:  1.320\n",
      "Epoch   3 Batch  267/538 - Train Accuracy:  0.848, Validation Accuracy:  0.861, Loss:  1.291\n",
      "Epoch   3 Batch  268/538 - Train Accuracy:  0.867, Validation Accuracy:  0.860, Loss:  1.248\n",
      "Epoch   3 Batch  269/538 - Train Accuracy:  0.855, Validation Accuracy:  0.853, Loss:  1.310\n",
      "Epoch   3 Batch  270/538 - Train Accuracy:  0.842, Validation Accuracy:  0.852, Loss:  1.292\n",
      "Epoch   3 Batch  271/538 - Train Accuracy:  0.855, Validation Accuracy:  0.845, Loss:  1.298\n",
      "Epoch   3 Batch  272/538 - Train Accuracy:  0.837, Validation Accuracy:  0.848, Loss:  1.297\n",
      "Epoch   3 Batch  273/538 - Train Accuracy:  0.864, Validation Accuracy:  0.856, Loss:  1.268\n",
      "Epoch   3 Batch  274/538 - Train Accuracy:  0.840, Validation Accuracy:  0.848, Loss:  1.365\n",
      "Epoch   3 Batch  275/538 - Train Accuracy:  0.844, Validation Accuracy:  0.856, Loss:  1.300\n",
      "Epoch   3 Batch  276/538 - Train Accuracy:  0.859, Validation Accuracy:  0.855, Loss:  1.317\n",
      "Epoch   3 Batch  277/538 - Train Accuracy:  0.846, Validation Accuracy:  0.854, Loss:  1.266\n",
      "Epoch   3 Batch  278/538 - Train Accuracy:  0.851, Validation Accuracy:  0.863, Loss:  1.309\n",
      "Epoch   3 Batch  279/538 - Train Accuracy:  0.846, Validation Accuracy:  0.873, Loss:  1.283\n",
      "Epoch   3 Batch  280/538 - Train Accuracy:  0.860, Validation Accuracy:  0.863, Loss:  1.270\n",
      "Epoch   3 Batch  281/538 - Train Accuracy:  0.874, Validation Accuracy:  0.876, Loss:  1.310\n",
      "Epoch   3 Batch  282/538 - Train Accuracy:  0.859, Validation Accuracy:  0.876, Loss:  1.325\n",
      "Epoch   3 Batch  283/538 - Train Accuracy:  0.855, Validation Accuracy:  0.866, Loss:  1.296\n",
      "Epoch   3 Batch  284/538 - Train Accuracy:  0.851, Validation Accuracy:  0.863, Loss:  1.289\n",
      "Epoch   3 Batch  285/538 - Train Accuracy:  0.864, Validation Accuracy:  0.865, Loss:  1.238\n",
      "Epoch   3 Batch  286/538 - Train Accuracy:  0.850, Validation Accuracy:  0.864, Loss:  1.350\n",
      "Epoch   3 Batch  287/538 - Train Accuracy:  0.872, Validation Accuracy:  0.864, Loss:  1.278\n",
      "Epoch   3 Batch  288/538 - Train Accuracy:  0.854, Validation Accuracy:  0.858, Loss:  1.304\n",
      "Epoch   3 Batch  289/538 - Train Accuracy:  0.881, Validation Accuracy:  0.869, Loss:  1.309\n",
      "Epoch   3 Batch  290/538 - Train Accuracy:  0.871, Validation Accuracy:  0.874, Loss:  1.309\n",
      "Epoch   3 Batch  291/538 - Train Accuracy:  0.866, Validation Accuracy:  0.867, Loss:  1.278\n",
      "Epoch   3 Batch  292/538 - Train Accuracy:  0.867, Validation Accuracy:  0.865, Loss:  1.280\n",
      "Epoch   3 Batch  293/538 - Train Accuracy:  0.860, Validation Accuracy:  0.863, Loss:  1.299\n",
      "Epoch   3 Batch  294/538 - Train Accuracy:  0.836, Validation Accuracy:  0.861, Loss:  1.287\n",
      "Epoch   3 Batch  295/538 - Train Accuracy:  0.895, Validation Accuracy:  0.868, Loss:  1.270\n",
      "Epoch   3 Batch  296/538 - Train Accuracy:  0.865, Validation Accuracy:  0.857, Loss:  1.303\n",
      "Epoch   3 Batch  297/538 - Train Accuracy:  0.882, Validation Accuracy:  0.860, Loss:  1.356\n",
      "Epoch   3 Batch  298/538 - Train Accuracy:  0.857, Validation Accuracy:  0.864, Loss:  1.316\n",
      "Epoch   3 Batch  299/538 - Train Accuracy:  0.841, Validation Accuracy:  0.865, Loss:  1.268\n",
      "Epoch   3 Batch  300/538 - Train Accuracy:  0.839, Validation Accuracy:  0.855, Loss:  1.313\n",
      "Epoch   3 Batch  301/538 - Train Accuracy:  0.844, Validation Accuracy:  0.854, Loss:  1.343\n",
      "Epoch   3 Batch  302/538 - Train Accuracy:  0.868, Validation Accuracy:  0.847, Loss:  1.277\n",
      "Epoch   3 Batch  303/538 - Train Accuracy:  0.878, Validation Accuracy:  0.852, Loss:  1.313\n",
      "Epoch   3 Batch  304/538 - Train Accuracy:  0.835, Validation Accuracy:  0.863, Loss:  1.309\n",
      "Epoch   3 Batch  305/538 - Train Accuracy:  0.867, Validation Accuracy:  0.868, Loss:  1.243\n",
      "Epoch   3 Batch  306/538 - Train Accuracy:  0.848, Validation Accuracy:  0.867, Loss:  1.325\n",
      "Epoch   3 Batch  307/538 - Train Accuracy:  0.881, Validation Accuracy:  0.876, Loss:  1.304\n",
      "Epoch   3 Batch  308/538 - Train Accuracy:  0.881, Validation Accuracy:  0.874, Loss:  1.279\n",
      "Epoch   3 Batch  309/538 - Train Accuracy:  0.882, Validation Accuracy:  0.871, Loss:  1.298\n",
      "Epoch   3 Batch  310/538 - Train Accuracy:  0.880, Validation Accuracy:  0.864, Loss:  1.321\n",
      "Epoch   3 Batch  311/538 - Train Accuracy:  0.861, Validation Accuracy:  0.866, Loss:  1.354\n",
      "Epoch   3 Batch  312/538 - Train Accuracy:  0.862, Validation Accuracy:  0.863, Loss:  1.294\n",
      "Epoch   3 Batch  313/538 - Train Accuracy:  0.854, Validation Accuracy:  0.866, Loss:  1.278\n",
      "Epoch   3 Batch  314/538 - Train Accuracy:  0.859, Validation Accuracy:  0.873, Loss:  1.271\n",
      "Epoch   3 Batch  315/538 - Train Accuracy:  0.868, Validation Accuracy:  0.873, Loss:  1.288\n",
      "Epoch   3 Batch  316/538 - Train Accuracy:  0.868, Validation Accuracy:  0.863, Loss:  1.265\n",
      "Epoch   3 Batch  317/538 - Train Accuracy:  0.875, Validation Accuracy:  0.860, Loss:  1.249\n",
      "Epoch   3 Batch  318/538 - Train Accuracy:  0.833, Validation Accuracy:  0.872, Loss:  1.262\n",
      "Epoch   3 Batch  319/538 - Train Accuracy:  0.850, Validation Accuracy:  0.855, Loss:  1.316\n",
      "Epoch   3 Batch  320/538 - Train Accuracy:  0.853, Validation Accuracy:  0.852, Loss:  1.316\n",
      "Epoch   3 Batch  321/538 - Train Accuracy:  0.882, Validation Accuracy:  0.860, Loss:  1.281\n",
      "Epoch   3 Batch  322/538 - Train Accuracy:  0.869, Validation Accuracy:  0.870, Loss:  1.311\n",
      "Epoch   3 Batch  323/538 - Train Accuracy:  0.858, Validation Accuracy:  0.865, Loss:  1.292\n",
      "Epoch   3 Batch  324/538 - Train Accuracy:  0.875, Validation Accuracy:  0.856, Loss:  1.257\n",
      "Epoch   3 Batch  325/538 - Train Accuracy:  0.875, Validation Accuracy:  0.859, Loss:  1.261\n",
      "Epoch   3 Batch  326/538 - Train Accuracy:  0.878, Validation Accuracy:  0.865, Loss:  1.282\n",
      "Epoch   3 Batch  327/538 - Train Accuracy:  0.866, Validation Accuracy:  0.863, Loss:  1.342\n",
      "Epoch   3 Batch  328/538 - Train Accuracy:  0.868, Validation Accuracy:  0.862, Loss:  1.315\n",
      "Epoch   3 Batch  329/538 - Train Accuracy:  0.872, Validation Accuracy:  0.859, Loss:  1.280\n",
      "Epoch   3 Batch  330/538 - Train Accuracy:  0.875, Validation Accuracy:  0.861, Loss:  1.255\n",
      "Epoch   3 Batch  331/538 - Train Accuracy:  0.862, Validation Accuracy:  0.866, Loss:  1.280\n",
      "Epoch   3 Batch  332/538 - Train Accuracy:  0.852, Validation Accuracy:  0.861, Loss:  1.248\n",
      "Epoch   3 Batch  333/538 - Train Accuracy:  0.856, Validation Accuracy:  0.862, Loss:  1.272\n",
      "Epoch   3 Batch  334/538 - Train Accuracy:  0.879, Validation Accuracy:  0.860, Loss:  1.284\n",
      "Epoch   3 Batch  335/538 - Train Accuracy:  0.869, Validation Accuracy:  0.849, Loss:  1.298\n",
      "Epoch   3 Batch  336/538 - Train Accuracy:  0.859, Validation Accuracy:  0.854, Loss:  1.283\n",
      "Epoch   3 Batch  337/538 - Train Accuracy:  0.879, Validation Accuracy:  0.848, Loss:  1.318\n",
      "Epoch   3 Batch  338/538 - Train Accuracy:  0.843, Validation Accuracy:  0.856, Loss:  1.262\n",
      "Epoch   3 Batch  339/538 - Train Accuracy:  0.851, Validation Accuracy:  0.858, Loss:  1.317\n",
      "Epoch   3 Batch  340/538 - Train Accuracy:  0.864, Validation Accuracy:  0.861, Loss:  1.333\n",
      "Epoch   3 Batch  341/538 - Train Accuracy:  0.876, Validation Accuracy:  0.868, Loss:  1.315\n",
      "Epoch   3 Batch  342/538 - Train Accuracy:  0.871, Validation Accuracy:  0.858, Loss:  1.308\n",
      "Epoch   3 Batch  343/538 - Train Accuracy:  0.866, Validation Accuracy:  0.856, Loss:  1.296\n",
      "Epoch   3 Batch  344/538 - Train Accuracy:  0.888, Validation Accuracy:  0.864, Loss:  1.302\n",
      "Epoch   3 Batch  345/538 - Train Accuracy:  0.859, Validation Accuracy:  0.868, Loss:  1.309\n",
      "Epoch   3 Batch  346/538 - Train Accuracy:  0.852, Validation Accuracy:  0.862, Loss:  1.278\n",
      "Epoch   3 Batch  347/538 - Train Accuracy:  0.868, Validation Accuracy:  0.868, Loss:  1.303\n",
      "Epoch   3 Batch  348/538 - Train Accuracy:  0.859, Validation Accuracy:  0.862, Loss:  1.316\n",
      "Epoch   3 Batch  349/538 - Train Accuracy:  0.871, Validation Accuracy:  0.865, Loss:  1.264\n",
      "Epoch   3 Batch  350/538 - Train Accuracy:  0.867, Validation Accuracy:  0.865, Loss:  1.285\n",
      "Epoch   3 Batch  351/538 - Train Accuracy:  0.873, Validation Accuracy:  0.860, Loss:  1.321\n",
      "Epoch   3 Batch  352/538 - Train Accuracy:  0.837, Validation Accuracy:  0.866, Loss:  1.304\n",
      "Epoch   3 Batch  353/538 - Train Accuracy:  0.854, Validation Accuracy:  0.864, Loss:  1.285\n",
      "Epoch   3 Batch  354/538 - Train Accuracy:  0.837, Validation Accuracy:  0.871, Loss:  1.270\n",
      "Epoch   3 Batch  355/538 - Train Accuracy:  0.872, Validation Accuracy:  0.868, Loss:  1.274\n",
      "Epoch   3 Batch  356/538 - Train Accuracy:  0.869, Validation Accuracy:  0.860, Loss:  1.246\n",
      "Epoch   3 Batch  357/538 - Train Accuracy:  0.860, Validation Accuracy:  0.867, Loss:  1.258\n",
      "Epoch   3 Batch  358/538 - Train Accuracy:  0.888, Validation Accuracy:  0.868, Loss:  1.307\n",
      "Epoch   3 Batch  359/538 - Train Accuracy:  0.886, Validation Accuracy:  0.878, Loss:  1.300\n",
      "Epoch   3 Batch  360/538 - Train Accuracy:  0.850, Validation Accuracy:  0.882, Loss:  1.324\n",
      "Epoch   3 Batch  361/538 - Train Accuracy:  0.897, Validation Accuracy:  0.879, Loss:  1.313\n",
      "Epoch   3 Batch  362/538 - Train Accuracy:  0.874, Validation Accuracy:  0.881, Loss:  1.278\n",
      "Epoch   3 Batch  363/538 - Train Accuracy:  0.873, Validation Accuracy:  0.880, Loss:  1.239\n",
      "Epoch   3 Batch  364/538 - Train Accuracy:  0.860, Validation Accuracy:  0.886, Loss:  1.308\n",
      "Epoch   3 Batch  365/538 - Train Accuracy:  0.868, Validation Accuracy:  0.880, Loss:  1.299\n",
      "Epoch   3 Batch  366/538 - Train Accuracy:  0.888, Validation Accuracy:  0.884, Loss:  1.260\n",
      "Epoch   3 Batch  367/538 - Train Accuracy:  0.882, Validation Accuracy:  0.888, Loss:  1.258\n",
      "Epoch   3 Batch  368/538 - Train Accuracy:  0.865, Validation Accuracy:  0.885, Loss:  1.279\n",
      "Epoch   3 Batch  369/538 - Train Accuracy:  0.883, Validation Accuracy:  0.878, Loss:  1.302\n",
      "Epoch   3 Batch  370/538 - Train Accuracy:  0.860, Validation Accuracy:  0.877, Loss:  1.247\n",
      "Epoch   3 Batch  371/538 - Train Accuracy:  0.885, Validation Accuracy:  0.869, Loss:  1.248\n",
      "Epoch   3 Batch  372/538 - Train Accuracy:  0.887, Validation Accuracy:  0.869, Loss:  1.292\n",
      "Epoch   3 Batch  373/538 - Train Accuracy:  0.860, Validation Accuracy:  0.873, Loss:  1.269\n",
      "Epoch   3 Batch  374/538 - Train Accuracy:  0.869, Validation Accuracy:  0.864, Loss:  1.306\n",
      "Epoch   3 Batch  375/538 - Train Accuracy:  0.864, Validation Accuracy:  0.871, Loss:  1.290\n",
      "Epoch   3 Batch  376/538 - Train Accuracy:  0.869, Validation Accuracy:  0.882, Loss:  1.257\n",
      "Epoch   3 Batch  377/538 - Train Accuracy:  0.877, Validation Accuracy:  0.885, Loss:  1.335\n",
      "Epoch   3 Batch  378/538 - Train Accuracy:  0.876, Validation Accuracy:  0.886, Loss:  1.271\n",
      "Epoch   3 Batch  379/538 - Train Accuracy:  0.883, Validation Accuracy:  0.873, Loss:  1.260\n",
      "Epoch   3 Batch  380/538 - Train Accuracy:  0.867, Validation Accuracy:  0.871, Loss:  1.262\n",
      "Epoch   3 Batch  381/538 - Train Accuracy:  0.887, Validation Accuracy:  0.867, Loss:  1.259\n",
      "Epoch   3 Batch  382/538 - Train Accuracy:  0.859, Validation Accuracy:  0.866, Loss:  1.302\n",
      "Epoch   3 Batch  383/538 - Train Accuracy:  0.863, Validation Accuracy:  0.860, Loss:  1.287\n",
      "Epoch   3 Batch  384/538 - Train Accuracy:  0.876, Validation Accuracy:  0.857, Loss:  1.301\n",
      "Epoch   3 Batch  385/538 - Train Accuracy:  0.876, Validation Accuracy:  0.860, Loss:  1.303\n",
      "Epoch   3 Batch  386/538 - Train Accuracy:  0.868, Validation Accuracy:  0.863, Loss:  1.245\n",
      "Epoch   3 Batch  387/538 - Train Accuracy:  0.871, Validation Accuracy:  0.874, Loss:  1.242\n",
      "Epoch   3 Batch  388/538 - Train Accuracy:  0.849, Validation Accuracy:  0.870, Loss:  1.365\n",
      "Epoch   3 Batch  389/538 - Train Accuracy:  0.845, Validation Accuracy:  0.867, Loss:  1.321\n",
      "Epoch   3 Batch  390/538 - Train Accuracy:  0.880, Validation Accuracy:  0.860, Loss:  1.241\n",
      "Epoch   3 Batch  391/538 - Train Accuracy:  0.876, Validation Accuracy:  0.873, Loss:  1.257\n",
      "Epoch   3 Batch  392/538 - Train Accuracy:  0.867, Validation Accuracy:  0.868, Loss:  1.273\n",
      "Epoch   3 Batch  393/538 - Train Accuracy:  0.885, Validation Accuracy:  0.877, Loss:  1.265\n",
      "Epoch   3 Batch  394/538 - Train Accuracy:  0.846, Validation Accuracy:  0.874, Loss:  1.301\n",
      "Epoch   3 Batch  395/538 - Train Accuracy:  0.875, Validation Accuracy:  0.869, Loss:  1.262\n",
      "Epoch   3 Batch  396/538 - Train Accuracy:  0.860, Validation Accuracy:  0.867, Loss:  1.256\n",
      "Epoch   3 Batch  397/538 - Train Accuracy:  0.864, Validation Accuracy:  0.869, Loss:  1.273\n",
      "Epoch   3 Batch  398/538 - Train Accuracy:  0.857, Validation Accuracy:  0.877, Loss:  1.281\n",
      "Epoch   3 Batch  399/538 - Train Accuracy:  0.872, Validation Accuracy:  0.870, Loss:  1.268\n",
      "Epoch   3 Batch  400/538 - Train Accuracy:  0.863, Validation Accuracy:  0.878, Loss:  1.257\n",
      "Epoch   3 Batch  401/538 - Train Accuracy:  0.888, Validation Accuracy:  0.868, Loss:  1.260\n",
      "Epoch   3 Batch  402/538 - Train Accuracy:  0.842, Validation Accuracy:  0.872, Loss:  1.254\n",
      "Epoch   3 Batch  403/538 - Train Accuracy:  0.884, Validation Accuracy:  0.868, Loss:  1.297\n",
      "Epoch   3 Batch  404/538 - Train Accuracy:  0.884, Validation Accuracy:  0.867, Loss:  1.325\n",
      "Epoch   3 Batch  405/538 - Train Accuracy:  0.888, Validation Accuracy:  0.876, Loss:  1.347\n",
      "Epoch   3 Batch  406/538 - Train Accuracy:  0.893, Validation Accuracy:  0.877, Loss:  1.287\n",
      "Epoch   3 Batch  407/538 - Train Accuracy:  0.889, Validation Accuracy:  0.872, Loss:  1.342\n",
      "Epoch   3 Batch  408/538 - Train Accuracy:  0.881, Validation Accuracy:  0.877, Loss:  1.291\n",
      "Epoch   3 Batch  409/538 - Train Accuracy:  0.861, Validation Accuracy:  0.869, Loss:  1.287\n",
      "Epoch   3 Batch  410/538 - Train Accuracy:  0.888, Validation Accuracy:  0.871, Loss:  1.309\n",
      "Epoch   3 Batch  411/538 - Train Accuracy:  0.904, Validation Accuracy:  0.876, Loss:  1.257\n",
      "Epoch   3 Batch  412/538 - Train Accuracy:  0.878, Validation Accuracy:  0.868, Loss:  1.230\n",
      "Epoch   3 Batch  413/538 - Train Accuracy:  0.878, Validation Accuracy:  0.877, Loss:  1.280\n",
      "Epoch   3 Batch  414/538 - Train Accuracy:  0.850, Validation Accuracy:  0.886, Loss:  1.254\n",
      "Epoch   3 Batch  415/538 - Train Accuracy:  0.857, Validation Accuracy:  0.889, Loss:  1.247\n",
      "Epoch   3 Batch  416/538 - Train Accuracy:  0.882, Validation Accuracy:  0.888, Loss:  1.208\n",
      "Epoch   3 Batch  417/538 - Train Accuracy:  0.882, Validation Accuracy:  0.885, Loss:  1.308\n",
      "Epoch   3 Batch  418/538 - Train Accuracy:  0.897, Validation Accuracy:  0.897, Loss:  1.246\n",
      "Epoch   3 Batch  419/538 - Train Accuracy:  0.890, Validation Accuracy:  0.891, Loss:  1.246\n",
      "Epoch   3 Batch  420/538 - Train Accuracy:  0.905, Validation Accuracy:  0.885, Loss:  1.245\n",
      "Epoch   3 Batch  421/538 - Train Accuracy:  0.887, Validation Accuracy:  0.877, Loss:  1.222\n",
      "Epoch   3 Batch  422/538 - Train Accuracy:  0.888, Validation Accuracy:  0.886, Loss:  1.275\n",
      "Epoch   3 Batch  423/538 - Train Accuracy:  0.891, Validation Accuracy:  0.890, Loss:  1.250\n",
      "Epoch   3 Batch  424/538 - Train Accuracy:  0.896, Validation Accuracy:  0.890, Loss:  1.308\n",
      "Epoch   3 Batch  425/538 - Train Accuracy:  0.877, Validation Accuracy:  0.893, Loss:  1.347\n",
      "Epoch   3 Batch  426/538 - Train Accuracy:  0.878, Validation Accuracy:  0.896, Loss:  1.284\n",
      "Epoch   3 Batch  427/538 - Train Accuracy:  0.865, Validation Accuracy:  0.894, Loss:  1.316\n",
      "Epoch   3 Batch  428/538 - Train Accuracy:  0.897, Validation Accuracy:  0.888, Loss:  1.246\n",
      "Epoch   3 Batch  429/538 - Train Accuracy:  0.872, Validation Accuracy:  0.889, Loss:  1.234\n",
      "Epoch   3 Batch  430/538 - Train Accuracy:  0.874, Validation Accuracy:  0.887, Loss:  1.269\n",
      "Epoch   3 Batch  431/538 - Train Accuracy:  0.883, Validation Accuracy:  0.879, Loss:  1.269\n",
      "Epoch   3 Batch  432/538 - Train Accuracy:  0.865, Validation Accuracy:  0.872, Loss:  1.282\n",
      "Epoch   3 Batch  433/538 - Train Accuracy:  0.876, Validation Accuracy:  0.880, Loss:  1.237\n",
      "Epoch   3 Batch  434/538 - Train Accuracy:  0.879, Validation Accuracy:  0.884, Loss:  1.218\n",
      "Epoch   3 Batch  435/538 - Train Accuracy:  0.899, Validation Accuracy:  0.884, Loss:  1.279\n",
      "Epoch   3 Batch  436/538 - Train Accuracy:  0.874, Validation Accuracy:  0.890, Loss:  1.310\n",
      "Epoch   3 Batch  437/538 - Train Accuracy:  0.890, Validation Accuracy:  0.887, Loss:  1.273\n",
      "Epoch   3 Batch  438/538 - Train Accuracy:  0.890, Validation Accuracy:  0.890, Loss:  1.246\n",
      "Epoch   3 Batch  439/538 - Train Accuracy:  0.913, Validation Accuracy:  0.884, Loss:  1.295\n",
      "Epoch   3 Batch  440/538 - Train Accuracy:  0.869, Validation Accuracy:  0.892, Loss:  1.270\n",
      "Epoch   3 Batch  441/538 - Train Accuracy:  0.861, Validation Accuracy:  0.901, Loss:  1.262\n",
      "Epoch   3 Batch  442/538 - Train Accuracy:  0.897, Validation Accuracy:  0.907, Loss:  1.252\n",
      "Epoch   3 Batch  443/538 - Train Accuracy:  0.899, Validation Accuracy:  0.899, Loss:  1.271\n",
      "Epoch   3 Batch  444/538 - Train Accuracy:  0.904, Validation Accuracy:  0.899, Loss:  1.275\n",
      "Epoch   3 Batch  445/538 - Train Accuracy:  0.920, Validation Accuracy:  0.893, Loss:  1.286\n",
      "Epoch   3 Batch  446/538 - Train Accuracy:  0.890, Validation Accuracy:  0.897, Loss:  1.267\n",
      "Epoch   3 Batch  447/538 - Train Accuracy:  0.879, Validation Accuracy:  0.891, Loss:  1.266\n",
      "Epoch   3 Batch  448/538 - Train Accuracy:  0.875, Validation Accuracy:  0.888, Loss:  1.248\n",
      "Epoch   3 Batch  449/538 - Train Accuracy:  0.888, Validation Accuracy:  0.889, Loss:  1.264\n",
      "Epoch   3 Batch  450/538 - Train Accuracy:  0.873, Validation Accuracy:  0.877, Loss:  1.256\n",
      "Epoch   3 Batch  451/538 - Train Accuracy:  0.869, Validation Accuracy:  0.879, Loss:  1.265\n",
      "Epoch   3 Batch  452/538 - Train Accuracy:  0.888, Validation Accuracy:  0.886, Loss:  1.282\n",
      "Epoch   3 Batch  453/538 - Train Accuracy:  0.879, Validation Accuracy:  0.885, Loss:  1.282\n",
      "Epoch   3 Batch  454/538 - Train Accuracy:  0.882, Validation Accuracy:  0.890, Loss:  1.243\n",
      "Epoch   3 Batch  455/538 - Train Accuracy:  0.885, Validation Accuracy:  0.894, Loss:  1.290\n",
      "Epoch   3 Batch  456/538 - Train Accuracy:  0.914, Validation Accuracy:  0.897, Loss:  1.230\n",
      "Epoch   3 Batch  457/538 - Train Accuracy:  0.874, Validation Accuracy:  0.899, Loss:  1.262\n",
      "Epoch   3 Batch  458/538 - Train Accuracy:  0.895, Validation Accuracy:  0.895, Loss:  1.268\n",
      "Epoch   3 Batch  459/538 - Train Accuracy:  0.907, Validation Accuracy:  0.886, Loss:  1.268\n",
      "Epoch   3 Batch  460/538 - Train Accuracy:  0.872, Validation Accuracy:  0.888, Loss:  1.263\n",
      "Epoch   3 Batch  461/538 - Train Accuracy:  0.900, Validation Accuracy:  0.886, Loss:  1.260\n",
      "Epoch   3 Batch  462/538 - Train Accuracy:  0.871, Validation Accuracy:  0.889, Loss:  1.283\n",
      "Epoch   3 Batch  463/538 - Train Accuracy:  0.895, Validation Accuracy:  0.898, Loss:  1.266\n",
      "Epoch   3 Batch  464/538 - Train Accuracy:  0.908, Validation Accuracy:  0.899, Loss:  1.310\n",
      "Epoch   3 Batch  465/538 - Train Accuracy:  0.896, Validation Accuracy:  0.891, Loss:  1.293\n",
      "Epoch   3 Batch  466/538 - Train Accuracy:  0.875, Validation Accuracy:  0.886, Loss:  1.271\n",
      "Epoch   3 Batch  467/538 - Train Accuracy:  0.900, Validation Accuracy:  0.895, Loss:  1.258\n",
      "Epoch   3 Batch  468/538 - Train Accuracy:  0.910, Validation Accuracy:  0.897, Loss:  1.245\n",
      "Epoch   3 Batch  469/538 - Train Accuracy:  0.907, Validation Accuracy:  0.891, Loss:  1.324\n",
      "Epoch   3 Batch  470/538 - Train Accuracy:  0.879, Validation Accuracy:  0.881, Loss:  1.273\n",
      "Epoch   3 Batch  471/538 - Train Accuracy:  0.887, Validation Accuracy:  0.882, Loss:  1.274\n",
      "Epoch   3 Batch  472/538 - Train Accuracy:  0.927, Validation Accuracy:  0.881, Loss:  1.255\n",
      "Epoch   3 Batch  473/538 - Train Accuracy:  0.856, Validation Accuracy:  0.884, Loss:  1.265\n",
      "Epoch   3 Batch  474/538 - Train Accuracy:  0.902, Validation Accuracy:  0.881, Loss:  1.258\n",
      "Epoch   3 Batch  475/538 - Train Accuracy:  0.906, Validation Accuracy:  0.883, Loss:  1.261\n",
      "Epoch   3 Batch  476/538 - Train Accuracy:  0.899, Validation Accuracy:  0.877, Loss:  1.323\n",
      "Epoch   3 Batch  477/538 - Train Accuracy:  0.891, Validation Accuracy:  0.878, Loss:  1.237\n",
      "Epoch   3 Batch  478/538 - Train Accuracy:  0.911, Validation Accuracy:  0.894, Loss:  1.250\n",
      "Epoch   3 Batch  479/538 - Train Accuracy:  0.892, Validation Accuracy:  0.891, Loss:  1.207\n",
      "Epoch   3 Batch  480/538 - Train Accuracy:  0.902, Validation Accuracy:  0.889, Loss:  1.273\n",
      "Epoch   3 Batch  481/538 - Train Accuracy:  0.924, Validation Accuracy:  0.883, Loss:  1.218\n",
      "Epoch   3 Batch  482/538 - Train Accuracy:  0.898, Validation Accuracy:  0.890, Loss:  1.241\n",
      "Epoch   3 Batch  483/538 - Train Accuracy:  0.877, Validation Accuracy:  0.884, Loss:  1.247\n",
      "Epoch   3 Batch  484/538 - Train Accuracy:  0.902, Validation Accuracy:  0.880, Loss:  1.270\n",
      "Epoch   3 Batch  485/538 - Train Accuracy:  0.910, Validation Accuracy:  0.879, Loss:  1.246\n",
      "Epoch   3 Batch  486/538 - Train Accuracy:  0.904, Validation Accuracy:  0.874, Loss:  1.296\n",
      "Epoch   3 Batch  487/538 - Train Accuracy:  0.899, Validation Accuracy:  0.879, Loss:  1.283\n",
      "Epoch   3 Batch  488/538 - Train Accuracy:  0.908, Validation Accuracy:  0.879, Loss:  1.223\n",
      "Epoch   3 Batch  489/538 - Train Accuracy:  0.871, Validation Accuracy:  0.883, Loss:  1.279\n",
      "Epoch   3 Batch  490/538 - Train Accuracy:  0.884, Validation Accuracy:  0.878, Loss:  1.263\n",
      "Epoch   3 Batch  491/538 - Train Accuracy:  0.859, Validation Accuracy:  0.881, Loss:  1.280\n",
      "Epoch   3 Batch  492/538 - Train Accuracy:  0.903, Validation Accuracy:  0.888, Loss:  1.227\n",
      "Epoch   3 Batch  493/538 - Train Accuracy:  0.889, Validation Accuracy:  0.889, Loss:  1.271\n",
      "Epoch   3 Batch  494/538 - Train Accuracy:  0.911, Validation Accuracy:  0.891, Loss:  1.252\n",
      "Epoch   3 Batch  495/538 - Train Accuracy:  0.909, Validation Accuracy:  0.888, Loss:  1.286\n",
      "Epoch   3 Batch  496/538 - Train Accuracy:  0.897, Validation Accuracy:  0.888, Loss:  1.201\n",
      "Epoch   3 Batch  497/538 - Train Accuracy:  0.911, Validation Accuracy:  0.889, Loss:  1.209\n",
      "Epoch   3 Batch  498/538 - Train Accuracy:  0.887, Validation Accuracy:  0.891, Loss:  1.262\n",
      "Epoch   3 Batch  499/538 - Train Accuracy:  0.896, Validation Accuracy:  0.894, Loss:  1.202\n",
      "Epoch   3 Batch  500/538 - Train Accuracy:  0.907, Validation Accuracy:  0.898, Loss:  1.201\n",
      "Epoch   3 Batch  501/538 - Train Accuracy:  0.909, Validation Accuracy:  0.900, Loss:  1.217\n",
      "Epoch   3 Batch  502/538 - Train Accuracy:  0.888, Validation Accuracy:  0.892, Loss:  1.261\n",
      "Epoch   3 Batch  503/538 - Train Accuracy:  0.927, Validation Accuracy:  0.895, Loss:  1.244\n",
      "Epoch   3 Batch  504/538 - Train Accuracy:  0.933, Validation Accuracy:  0.894, Loss:  1.225\n",
      "Epoch   3 Batch  505/538 - Train Accuracy:  0.921, Validation Accuracy:  0.894, Loss:  1.260\n",
      "Epoch   3 Batch  506/538 - Train Accuracy:  0.904, Validation Accuracy:  0.908, Loss:  1.229\n",
      "Epoch   3 Batch  507/538 - Train Accuracy:  0.877, Validation Accuracy:  0.905, Loss:  1.253\n",
      "Epoch   3 Batch  508/538 - Train Accuracy:  0.883, Validation Accuracy:  0.903, Loss:  1.259\n",
      "Epoch   3 Batch  509/538 - Train Accuracy:  0.905, Validation Accuracy:  0.898, Loss:  1.231\n",
      "Epoch   3 Batch  510/538 - Train Accuracy:  0.898, Validation Accuracy:  0.893, Loss:  1.182\n",
      "Epoch   3 Batch  511/538 - Train Accuracy:  0.891, Validation Accuracy:  0.890, Loss:  1.249\n",
      "Epoch   3 Batch  512/538 - Train Accuracy:  0.916, Validation Accuracy:  0.896, Loss:  1.292\n",
      "Epoch   3 Batch  513/538 - Train Accuracy:  0.879, Validation Accuracy:  0.902, Loss:  1.299\n",
      "Epoch   3 Batch  514/538 - Train Accuracy:  0.881, Validation Accuracy:  0.898, Loss:  1.227\n",
      "Epoch   3 Batch  515/538 - Train Accuracy:  0.888, Validation Accuracy:  0.909, Loss:  1.300\n",
      "Epoch   3 Batch  516/538 - Train Accuracy:  0.868, Validation Accuracy:  0.904, Loss:  1.264\n",
      "Epoch   3 Batch  517/538 - Train Accuracy:  0.914, Validation Accuracy:  0.899, Loss:  1.281\n",
      "Epoch   3 Batch  518/538 - Train Accuracy:  0.879, Validation Accuracy:  0.900, Loss:  1.266\n",
      "Epoch   3 Batch  519/538 - Train Accuracy:  0.905, Validation Accuracy:  0.897, Loss:  1.283\n",
      "Epoch   3 Batch  520/538 - Train Accuracy:  0.902, Validation Accuracy:  0.895, Loss:  1.255\n",
      "Epoch   3 Batch  521/538 - Train Accuracy:  0.881, Validation Accuracy:  0.893, Loss:  1.295\n",
      "Epoch   3 Batch  522/538 - Train Accuracy:  0.894, Validation Accuracy:  0.899, Loss:  1.228\n",
      "Epoch   3 Batch  523/538 - Train Accuracy:  0.899, Validation Accuracy:  0.889, Loss:  1.270\n",
      "Epoch   3 Batch  524/538 - Train Accuracy:  0.886, Validation Accuracy:  0.889, Loss:  1.286\n",
      "Epoch   3 Batch  525/538 - Train Accuracy:  0.896, Validation Accuracy:  0.895, Loss:  1.206\n",
      "Epoch   3 Batch  526/538 - Train Accuracy:  0.897, Validation Accuracy:  0.900, Loss:  1.222\n",
      "Epoch   3 Batch  527/538 - Train Accuracy:  0.901, Validation Accuracy:  0.896, Loss:  1.285\n",
      "Epoch   3 Batch  528/538 - Train Accuracy:  0.890, Validation Accuracy:  0.898, Loss:  1.268\n",
      "Epoch   3 Batch  529/538 - Train Accuracy:  0.873, Validation Accuracy:  0.899, Loss:  1.291\n",
      "Epoch   3 Batch  530/538 - Train Accuracy:  0.874, Validation Accuracy:  0.899, Loss:  1.318\n",
      "Epoch   3 Batch  531/538 - Train Accuracy:  0.918, Validation Accuracy:  0.896, Loss:  1.263\n",
      "Epoch   3 Batch  532/538 - Train Accuracy:  0.913, Validation Accuracy:  0.908, Loss:  1.246\n",
      "Epoch   3 Batch  533/538 - Train Accuracy:  0.912, Validation Accuracy:  0.904, Loss:  1.258\n",
      "Epoch   3 Batch  534/538 - Train Accuracy:  0.895, Validation Accuracy:  0.900, Loss:  1.220\n",
      "Epoch   3 Batch  535/538 - Train Accuracy:  0.885, Validation Accuracy:  0.897, Loss:  1.253\n",
      "Epoch   3 Batch  536/538 - Train Accuracy:  0.897, Validation Accuracy:  0.891, Loss:  1.277\n",
      "Epoch   4 Batch    0/538 - Train Accuracy:  0.918, Validation Accuracy:  0.880, Loss:  1.266\n",
      "Epoch   4 Batch    1/538 - Train Accuracy:  0.925, Validation Accuracy:  0.876, Loss:  1.223\n",
      "Epoch   4 Batch    2/538 - Train Accuracy:  0.910, Validation Accuracy:  0.888, Loss:  1.275\n",
      "Epoch   4 Batch    3/538 - Train Accuracy:  0.916, Validation Accuracy:  0.888, Loss:  1.202\n",
      "Epoch   4 Batch    4/538 - Train Accuracy:  0.891, Validation Accuracy:  0.895, Loss:  1.226\n",
      "Epoch   4 Batch    5/538 - Train Accuracy:  0.919, Validation Accuracy:  0.899, Loss:  1.252\n",
      "Epoch   4 Batch    6/538 - Train Accuracy:  0.923, Validation Accuracy:  0.892, Loss:  1.289\n",
      "Epoch   4 Batch    7/538 - Train Accuracy:  0.921, Validation Accuracy:  0.888, Loss:  1.246\n",
      "Epoch   4 Batch    8/538 - Train Accuracy:  0.901, Validation Accuracy:  0.897, Loss:  1.281\n",
      "Epoch   4 Batch    9/538 - Train Accuracy:  0.884, Validation Accuracy:  0.909, Loss:  1.244\n",
      "Epoch   4 Batch   10/538 - Train Accuracy:  0.898, Validation Accuracy:  0.901, Loss:  1.247\n",
      "Epoch   4 Batch   11/538 - Train Accuracy:  0.910, Validation Accuracy:  0.904, Loss:  1.225\n",
      "Epoch   4 Batch   12/538 - Train Accuracy:  0.917, Validation Accuracy:  0.902, Loss:  1.273\n",
      "Epoch   4 Batch   13/538 - Train Accuracy:  0.923, Validation Accuracy:  0.889, Loss:  1.202\n",
      "Epoch   4 Batch   14/538 - Train Accuracy:  0.909, Validation Accuracy:  0.883, Loss:  1.222\n",
      "Epoch   4 Batch   15/538 - Train Accuracy:  0.917, Validation Accuracy:  0.887, Loss:  1.228\n",
      "Epoch   4 Batch   16/538 - Train Accuracy:  0.890, Validation Accuracy:  0.888, Loss:  1.227\n",
      "Epoch   4 Batch   17/538 - Train Accuracy:  0.907, Validation Accuracy:  0.891, Loss:  1.226\n",
      "Epoch   4 Batch   18/538 - Train Accuracy:  0.921, Validation Accuracy:  0.892, Loss:  1.177\n",
      "Epoch   4 Batch   19/538 - Train Accuracy:  0.906, Validation Accuracy:  0.899, Loss:  1.296\n",
      "Epoch   4 Batch   20/538 - Train Accuracy:  0.913, Validation Accuracy:  0.890, Loss:  1.221\n",
      "Epoch   4 Batch   21/538 - Train Accuracy:  0.943, Validation Accuracy:  0.898, Loss:  1.272\n",
      "Epoch   4 Batch   22/538 - Train Accuracy:  0.895, Validation Accuracy:  0.893, Loss:  1.276\n",
      "Epoch   4 Batch   23/538 - Train Accuracy:  0.883, Validation Accuracy:  0.894, Loss:  1.277\n",
      "Epoch   4 Batch   24/538 - Train Accuracy:  0.911, Validation Accuracy:  0.909, Loss:  1.248\n",
      "Epoch   4 Batch   25/538 - Train Accuracy:  0.904, Validation Accuracy:  0.904, Loss:  1.285\n",
      "Epoch   4 Batch   26/538 - Train Accuracy:  0.889, Validation Accuracy:  0.896, Loss:  1.224\n",
      "Epoch   4 Batch   27/538 - Train Accuracy:  0.904, Validation Accuracy:  0.901, Loss:  1.288\n",
      "Epoch   4 Batch   28/538 - Train Accuracy:  0.896, Validation Accuracy:  0.906, Loss:  1.266\n",
      "Epoch   4 Batch   29/538 - Train Accuracy:  0.909, Validation Accuracy:  0.907, Loss:  1.297\n",
      "Epoch   4 Batch   30/538 - Train Accuracy:  0.899, Validation Accuracy:  0.903, Loss:  1.220\n",
      "Epoch   4 Batch   31/538 - Train Accuracy:  0.918, Validation Accuracy:  0.903, Loss:  1.215\n",
      "Epoch   4 Batch   32/538 - Train Accuracy:  0.904, Validation Accuracy:  0.903, Loss:  1.243\n",
      "Epoch   4 Batch   33/538 - Train Accuracy:  0.910, Validation Accuracy:  0.900, Loss:  1.244\n",
      "Epoch   4 Batch   34/538 - Train Accuracy:  0.898, Validation Accuracy:  0.906, Loss:  1.248\n",
      "Epoch   4 Batch   35/538 - Train Accuracy:  0.905, Validation Accuracy:  0.906, Loss:  1.221\n",
      "Epoch   4 Batch   36/538 - Train Accuracy:  0.903, Validation Accuracy:  0.904, Loss:  1.298\n",
      "Epoch   4 Batch   37/538 - Train Accuracy:  0.898, Validation Accuracy:  0.904, Loss:  1.288\n",
      "Epoch   4 Batch   38/538 - Train Accuracy:  0.890, Validation Accuracy:  0.909, Loss:  1.208\n",
      "Epoch   4 Batch   39/538 - Train Accuracy:  0.919, Validation Accuracy:  0.906, Loss:  1.194\n",
      "Epoch   4 Batch   40/538 - Train Accuracy:  0.919, Validation Accuracy:  0.907, Loss:  1.227\n",
      "Epoch   4 Batch   41/538 - Train Accuracy:  0.906, Validation Accuracy:  0.907, Loss:  1.236\n",
      "Epoch   4 Batch   42/538 - Train Accuracy:  0.903, Validation Accuracy:  0.906, Loss:  1.240\n",
      "Epoch   4 Batch   43/538 - Train Accuracy:  0.895, Validation Accuracy:  0.899, Loss:  1.266\n",
      "Epoch   4 Batch   44/538 - Train Accuracy:  0.883, Validation Accuracy:  0.899, Loss:  1.296\n",
      "Epoch   4 Batch   45/538 - Train Accuracy:  0.910, Validation Accuracy:  0.905, Loss:  1.232\n",
      "Epoch   4 Batch   46/538 - Train Accuracy:  0.922, Validation Accuracy:  0.901, Loss:  1.212\n",
      "Epoch   4 Batch   47/538 - Train Accuracy:  0.899, Validation Accuracy:  0.899, Loss:  1.223\n",
      "Epoch   4 Batch   48/538 - Train Accuracy:  0.903, Validation Accuracy:  0.907, Loss:  1.259\n",
      "Epoch   4 Batch   49/538 - Train Accuracy:  0.907, Validation Accuracy:  0.906, Loss:  1.224\n",
      "Epoch   4 Batch   50/538 - Train Accuracy:  0.913, Validation Accuracy:  0.905, Loss:  1.231\n",
      "Epoch   4 Batch   51/538 - Train Accuracy:  0.913, Validation Accuracy:  0.907, Loss:  1.232\n",
      "Epoch   4 Batch   52/538 - Train Accuracy:  0.885, Validation Accuracy:  0.907, Loss:  1.243\n",
      "Epoch   4 Batch   53/538 - Train Accuracy:  0.888, Validation Accuracy:  0.905, Loss:  1.220\n",
      "Epoch   4 Batch   54/538 - Train Accuracy:  0.906, Validation Accuracy:  0.903, Loss:  1.203\n",
      "Epoch   4 Batch   55/538 - Train Accuracy:  0.910, Validation Accuracy:  0.900, Loss:  1.253\n",
      "Epoch   4 Batch   56/538 - Train Accuracy:  0.899, Validation Accuracy:  0.902, Loss:  1.234\n",
      "Epoch   4 Batch   57/538 - Train Accuracy:  0.892, Validation Accuracy:  0.899, Loss:  1.261\n",
      "Epoch   4 Batch   58/538 - Train Accuracy:  0.901, Validation Accuracy:  0.901, Loss:  1.274\n",
      "Epoch   4 Batch   59/538 - Train Accuracy:  0.906, Validation Accuracy:  0.901, Loss:  1.254\n",
      "Epoch   4 Batch   60/538 - Train Accuracy:  0.925, Validation Accuracy:  0.904, Loss:  1.259\n",
      "Epoch   4 Batch   61/538 - Train Accuracy:  0.900, Validation Accuracy:  0.900, Loss:  1.245\n",
      "Epoch   4 Batch   62/538 - Train Accuracy:  0.919, Validation Accuracy:  0.902, Loss:  1.187\n",
      "Epoch   4 Batch   63/538 - Train Accuracy:  0.925, Validation Accuracy:  0.896, Loss:  1.232\n",
      "Epoch   4 Batch   64/538 - Train Accuracy:  0.905, Validation Accuracy:  0.898, Loss:  1.233\n",
      "Epoch   4 Batch   65/538 - Train Accuracy:  0.891, Validation Accuracy:  0.899, Loss:  1.242\n",
      "Epoch   4 Batch   66/538 - Train Accuracy:  0.922, Validation Accuracy:  0.900, Loss:  1.173\n",
      "Epoch   4 Batch   67/538 - Train Accuracy:  0.909, Validation Accuracy:  0.900, Loss:  1.242\n",
      "Epoch   4 Batch   68/538 - Train Accuracy:  0.893, Validation Accuracy:  0.898, Loss:  1.225\n",
      "Epoch   4 Batch   69/538 - Train Accuracy:  0.907, Validation Accuracy:  0.902, Loss:  1.197\n",
      "Epoch   4 Batch   70/538 - Train Accuracy:  0.906, Validation Accuracy:  0.899, Loss:  1.272\n",
      "Epoch   4 Batch   71/538 - Train Accuracy:  0.900, Validation Accuracy:  0.900, Loss:  1.229\n",
      "Epoch   4 Batch   72/538 - Train Accuracy:  0.927, Validation Accuracy:  0.900, Loss:  1.254\n",
      "Epoch   4 Batch   73/538 - Train Accuracy:  0.889, Validation Accuracy:  0.906, Loss:  1.217\n",
      "Epoch   4 Batch   74/538 - Train Accuracy:  0.912, Validation Accuracy:  0.904, Loss:  1.245\n",
      "Epoch   4 Batch   75/538 - Train Accuracy:  0.916, Validation Accuracy:  0.910, Loss:  1.241\n",
      "Epoch   4 Batch   76/538 - Train Accuracy:  0.914, Validation Accuracy:  0.906, Loss:  1.233\n",
      "Epoch   4 Batch   77/538 - Train Accuracy:  0.939, Validation Accuracy:  0.909, Loss:  1.243\n",
      "Epoch   4 Batch   78/538 - Train Accuracy:  0.909, Validation Accuracy:  0.912, Loss:  1.264\n",
      "Epoch   4 Batch   79/538 - Train Accuracy:  0.910, Validation Accuracy:  0.909, Loss:  1.219\n",
      "Epoch   4 Batch   80/538 - Train Accuracy:  0.922, Validation Accuracy:  0.899, Loss:  1.209\n",
      "Epoch   4 Batch   81/538 - Train Accuracy:  0.911, Validation Accuracy:  0.896, Loss:  1.209\n",
      "Epoch   4 Batch   82/538 - Train Accuracy:  0.898, Validation Accuracy:  0.900, Loss:  1.234\n",
      "Epoch   4 Batch   83/538 - Train Accuracy:  0.901, Validation Accuracy:  0.902, Loss:  1.244\n",
      "Epoch   4 Batch   84/538 - Train Accuracy:  0.903, Validation Accuracy:  0.898, Loss:  1.221\n",
      "Epoch   4 Batch   85/538 - Train Accuracy:  0.922, Validation Accuracy:  0.903, Loss:  1.186\n",
      "Epoch   4 Batch   86/538 - Train Accuracy:  0.918, Validation Accuracy:  0.898, Loss:  1.217\n",
      "Epoch   4 Batch   87/538 - Train Accuracy:  0.911, Validation Accuracy:  0.898, Loss:  1.262\n",
      "Epoch   4 Batch   88/538 - Train Accuracy:  0.921, Validation Accuracy:  0.903, Loss:  1.208\n",
      "Epoch   4 Batch   89/538 - Train Accuracy:  0.906, Validation Accuracy:  0.901, Loss:  1.249\n",
      "Epoch   4 Batch   90/538 - Train Accuracy:  0.919, Validation Accuracy:  0.901, Loss:  1.218\n",
      "Epoch   4 Batch   91/538 - Train Accuracy:  0.919, Validation Accuracy:  0.901, Loss:  1.236\n",
      "Epoch   4 Batch   92/538 - Train Accuracy:  0.918, Validation Accuracy:  0.901, Loss:  1.280\n",
      "Epoch   4 Batch   93/538 - Train Accuracy:  0.898, Validation Accuracy:  0.898, Loss:  1.227\n",
      "Epoch   4 Batch   94/538 - Train Accuracy:  0.912, Validation Accuracy:  0.898, Loss:  1.235\n",
      "Epoch   4 Batch   95/538 - Train Accuracy:  0.898, Validation Accuracy:  0.903, Loss:  1.185\n",
      "Epoch   4 Batch   96/538 - Train Accuracy:  0.940, Validation Accuracy:  0.904, Loss:  1.156\n",
      "Epoch   4 Batch   97/538 - Train Accuracy:  0.910, Validation Accuracy:  0.905, Loss:  1.207\n",
      "Epoch   4 Batch   98/538 - Train Accuracy:  0.924, Validation Accuracy:  0.907, Loss:  1.237\n",
      "Epoch   4 Batch   99/538 - Train Accuracy:  0.896, Validation Accuracy:  0.907, Loss:  1.227\n",
      "Epoch   4 Batch  100/538 - Train Accuracy:  0.924, Validation Accuracy:  0.903, Loss:  1.197\n",
      "Epoch   4 Batch  101/538 - Train Accuracy:  0.904, Validation Accuracy:  0.900, Loss:  1.189\n",
      "Epoch   4 Batch  102/538 - Train Accuracy:  0.901, Validation Accuracy:  0.901, Loss:  1.218\n",
      "Epoch   4 Batch  103/538 - Train Accuracy:  0.912, Validation Accuracy:  0.900, Loss:  1.259\n",
      "Epoch   4 Batch  104/538 - Train Accuracy:  0.901, Validation Accuracy:  0.899, Loss:  1.219\n",
      "Epoch   4 Batch  105/538 - Train Accuracy:  0.904, Validation Accuracy:  0.903, Loss:  1.228\n",
      "Epoch   4 Batch  106/538 - Train Accuracy:  0.901, Validation Accuracy:  0.901, Loss:  1.200\n",
      "Epoch   4 Batch  107/538 - Train Accuracy:  0.898, Validation Accuracy:  0.903, Loss:  1.226\n",
      "Epoch   4 Batch  108/538 - Train Accuracy:  0.919, Validation Accuracy:  0.903, Loss:  1.248\n",
      "Epoch   4 Batch  109/538 - Train Accuracy:  0.922, Validation Accuracy:  0.897, Loss:  1.184\n",
      "Epoch   4 Batch  110/538 - Train Accuracy:  0.901, Validation Accuracy:  0.897, Loss:  1.241\n",
      "Epoch   4 Batch  111/538 - Train Accuracy:  0.916, Validation Accuracy:  0.901, Loss:  1.266\n",
      "Epoch   4 Batch  112/538 - Train Accuracy:  0.913, Validation Accuracy:  0.904, Loss:  1.256\n",
      "Epoch   4 Batch  113/538 - Train Accuracy:  0.913, Validation Accuracy:  0.903, Loss:  1.225\n",
      "Epoch   4 Batch  114/538 - Train Accuracy:  0.912, Validation Accuracy:  0.898, Loss:  1.216\n",
      "Epoch   4 Batch  115/538 - Train Accuracy:  0.909, Validation Accuracy:  0.898, Loss:  1.204\n",
      "Epoch   4 Batch  116/538 - Train Accuracy:  0.914, Validation Accuracy:  0.900, Loss:  1.233\n",
      "Epoch   4 Batch  117/538 - Train Accuracy:  0.912, Validation Accuracy:  0.899, Loss:  1.237\n",
      "Epoch   4 Batch  118/538 - Train Accuracy:  0.925, Validation Accuracy:  0.898, Loss:  1.246\n",
      "Epoch   4 Batch  119/538 - Train Accuracy:  0.929, Validation Accuracy:  0.893, Loss:  1.271\n",
      "Epoch   4 Batch  120/538 - Train Accuracy:  0.924, Validation Accuracy:  0.894, Loss:  1.229\n",
      "Epoch   4 Batch  121/538 - Train Accuracy:  0.918, Validation Accuracy:  0.897, Loss:  1.191\n",
      "Epoch   4 Batch  122/538 - Train Accuracy:  0.919, Validation Accuracy:  0.901, Loss:  1.229\n",
      "Epoch   4 Batch  123/538 - Train Accuracy:  0.921, Validation Accuracy:  0.904, Loss:  1.191\n",
      "Epoch   4 Batch  124/538 - Train Accuracy:  0.935, Validation Accuracy:  0.907, Loss:  1.177\n",
      "Epoch   4 Batch  125/538 - Train Accuracy:  0.911, Validation Accuracy:  0.907, Loss:  1.215\n",
      "Epoch   4 Batch  126/538 - Train Accuracy:  0.908, Validation Accuracy:  0.907, Loss:  1.259\n",
      "Epoch   4 Batch  127/538 - Train Accuracy:  0.919, Validation Accuracy:  0.902, Loss:  1.269\n",
      "Epoch   4 Batch  128/538 - Train Accuracy:  0.912, Validation Accuracy:  0.902, Loss:  1.203\n",
      "Epoch   4 Batch  129/538 - Train Accuracy:  0.921, Validation Accuracy:  0.896, Loss:  1.218\n",
      "Epoch   4 Batch  130/538 - Train Accuracy:  0.919, Validation Accuracy:  0.898, Loss:  1.221\n",
      "Epoch   4 Batch  131/538 - Train Accuracy:  0.928, Validation Accuracy:  0.897, Loss:  1.234\n",
      "Epoch   4 Batch  132/538 - Train Accuracy:  0.874, Validation Accuracy:  0.904, Loss:  1.220\n",
      "Epoch   4 Batch  133/538 - Train Accuracy:  0.918, Validation Accuracy:  0.905, Loss:  1.249\n",
      "Epoch   4 Batch  134/538 - Train Accuracy:  0.887, Validation Accuracy:  0.900, Loss:  1.205\n",
      "Epoch   4 Batch  135/538 - Train Accuracy:  0.919, Validation Accuracy:  0.902, Loss:  1.240\n",
      "Epoch   4 Batch  136/538 - Train Accuracy:  0.909, Validation Accuracy:  0.902, Loss:  1.225\n",
      "Epoch   4 Batch  137/538 - Train Accuracy:  0.882, Validation Accuracy:  0.902, Loss:  1.301\n",
      "Epoch   4 Batch  138/538 - Train Accuracy:  0.910, Validation Accuracy:  0.915, Loss:  1.260\n",
      "Epoch   4 Batch  139/538 - Train Accuracy:  0.910, Validation Accuracy:  0.913, Loss:  1.201\n",
      "Epoch   4 Batch  140/538 - Train Accuracy:  0.899, Validation Accuracy:  0.915, Loss:  1.226\n",
      "Epoch   4 Batch  141/538 - Train Accuracy:  0.935, Validation Accuracy:  0.907, Loss:  1.242\n",
      "Epoch   4 Batch  142/538 - Train Accuracy:  0.912, Validation Accuracy:  0.907, Loss:  1.250\n",
      "Epoch   4 Batch  143/538 - Train Accuracy:  0.916, Validation Accuracy:  0.902, Loss:  1.228\n",
      "Epoch   4 Batch  144/538 - Train Accuracy:  0.916, Validation Accuracy:  0.904, Loss:  1.198\n",
      "Epoch   4 Batch  145/538 - Train Accuracy:  0.904, Validation Accuracy:  0.901, Loss:  1.249\n",
      "Epoch   4 Batch  146/538 - Train Accuracy:  0.925, Validation Accuracy:  0.906, Loss:  1.217\n",
      "Epoch   4 Batch  147/538 - Train Accuracy:  0.910, Validation Accuracy:  0.907, Loss:  1.207\n",
      "Epoch   4 Batch  148/538 - Train Accuracy:  0.879, Validation Accuracy:  0.916, Loss:  1.191\n",
      "Epoch   4 Batch  149/538 - Train Accuracy:  0.925, Validation Accuracy:  0.907, Loss:  1.174\n",
      "Epoch   4 Batch  150/538 - Train Accuracy:  0.932, Validation Accuracy:  0.899, Loss:  1.216\n",
      "Epoch   4 Batch  151/538 - Train Accuracy:  0.920, Validation Accuracy:  0.906, Loss:  1.219\n",
      "Epoch   4 Batch  152/538 - Train Accuracy:  0.921, Validation Accuracy:  0.908, Loss:  1.181\n",
      "Epoch   4 Batch  153/538 - Train Accuracy:  0.909, Validation Accuracy:  0.911, Loss:  1.263\n",
      "Epoch   4 Batch  154/538 - Train Accuracy:  0.923, Validation Accuracy:  0.912, Loss:  1.266\n",
      "Epoch   4 Batch  155/538 - Train Accuracy:  0.920, Validation Accuracy:  0.907, Loss:  1.201\n",
      "Epoch   4 Batch  156/538 - Train Accuracy:  0.928, Validation Accuracy:  0.904, Loss:  1.256\n",
      "Epoch   4 Batch  157/538 - Train Accuracy:  0.919, Validation Accuracy:  0.907, Loss:  1.241\n",
      "Epoch   4 Batch  158/538 - Train Accuracy:  0.913, Validation Accuracy:  0.908, Loss:  1.193\n",
      "Epoch   4 Batch  159/538 - Train Accuracy:  0.911, Validation Accuracy:  0.907, Loss:  1.268\n",
      "Epoch   4 Batch  160/538 - Train Accuracy:  0.902, Validation Accuracy:  0.908, Loss:  1.217\n",
      "Epoch   4 Batch  161/538 - Train Accuracy:  0.911, Validation Accuracy:  0.906, Loss:  1.217\n",
      "Epoch   4 Batch  162/538 - Train Accuracy:  0.903, Validation Accuracy:  0.902, Loss:  1.225\n",
      "Epoch   4 Batch  163/538 - Train Accuracy:  0.907, Validation Accuracy:  0.901, Loss:  1.257\n",
      "Epoch   4 Batch  164/538 - Train Accuracy:  0.900, Validation Accuracy:  0.909, Loss:  1.245\n",
      "Epoch   4 Batch  165/538 - Train Accuracy:  0.917, Validation Accuracy:  0.903, Loss:  1.191\n",
      "Epoch   4 Batch  166/538 - Train Accuracy:  0.936, Validation Accuracy:  0.900, Loss:  1.212\n",
      "Epoch   4 Batch  167/538 - Train Accuracy:  0.911, Validation Accuracy:  0.906, Loss:  1.280\n",
      "Epoch   4 Batch  168/538 - Train Accuracy:  0.884, Validation Accuracy:  0.904, Loss:  1.158\n",
      "Epoch   4 Batch  169/538 - Train Accuracy:  0.921, Validation Accuracy:  0.903, Loss:  1.183\n",
      "Epoch   4 Batch  170/538 - Train Accuracy:  0.900, Validation Accuracy:  0.895, Loss:  1.210\n",
      "Epoch   4 Batch  171/538 - Train Accuracy:  0.912, Validation Accuracy:  0.895, Loss:  1.235\n",
      "Epoch   4 Batch  172/538 - Train Accuracy:  0.915, Validation Accuracy:  0.901, Loss:  1.230\n",
      "Epoch   4 Batch  173/538 - Train Accuracy:  0.914, Validation Accuracy:  0.905, Loss:  1.273\n",
      "Epoch   4 Batch  174/538 - Train Accuracy:  0.913, Validation Accuracy:  0.904, Loss:  1.201\n",
      "Epoch   4 Batch  175/538 - Train Accuracy:  0.907, Validation Accuracy:  0.911, Loss:  1.178\n",
      "Epoch   4 Batch  176/538 - Train Accuracy:  0.897, Validation Accuracy:  0.918, Loss:  1.227\n",
      "Epoch   4 Batch  177/538 - Train Accuracy:  0.916, Validation Accuracy:  0.910, Loss:  1.246\n",
      "Epoch   4 Batch  178/538 - Train Accuracy:  0.875, Validation Accuracy:  0.897, Loss:  1.205\n",
      "Epoch   4 Batch  179/538 - Train Accuracy:  0.906, Validation Accuracy:  0.900, Loss:  1.181\n",
      "Epoch   4 Batch  180/538 - Train Accuracy:  0.923, Validation Accuracy:  0.895, Loss:  1.237\n",
      "Epoch   4 Batch  181/538 - Train Accuracy:  0.911, Validation Accuracy:  0.897, Loss:  1.225\n",
      "Epoch   4 Batch  182/538 - Train Accuracy:  0.925, Validation Accuracy:  0.901, Loss:  1.246\n",
      "Epoch   4 Batch  183/538 - Train Accuracy:  0.942, Validation Accuracy:  0.902, Loss:  1.248\n",
      "Epoch   4 Batch  184/538 - Train Accuracy:  0.919, Validation Accuracy:  0.902, Loss:  1.209\n",
      "Epoch   4 Batch  185/538 - Train Accuracy:  0.941, Validation Accuracy:  0.901, Loss:  1.179\n",
      "Epoch   4 Batch  186/538 - Train Accuracy:  0.921, Validation Accuracy:  0.898, Loss:  1.196\n",
      "Epoch   4 Batch  187/538 - Train Accuracy:  0.933, Validation Accuracy:  0.899, Loss:  1.214\n",
      "Epoch   4 Batch  188/538 - Train Accuracy:  0.920, Validation Accuracy:  0.906, Loss:  1.233\n",
      "Epoch   4 Batch  189/538 - Train Accuracy:  0.922, Validation Accuracy:  0.909, Loss:  1.259\n",
      "Epoch   4 Batch  190/538 - Train Accuracy:  0.907, Validation Accuracy:  0.907, Loss:  1.240\n",
      "Epoch   4 Batch  191/538 - Train Accuracy:  0.916, Validation Accuracy:  0.903, Loss:  1.216\n",
      "Epoch   4 Batch  192/538 - Train Accuracy:  0.928, Validation Accuracy:  0.900, Loss:  1.248\n",
      "Epoch   4 Batch  193/538 - Train Accuracy:  0.914, Validation Accuracy:  0.899, Loss:  1.205\n",
      "Epoch   4 Batch  194/538 - Train Accuracy:  0.905, Validation Accuracy:  0.892, Loss:  1.191\n",
      "Epoch   4 Batch  195/538 - Train Accuracy:  0.926, Validation Accuracy:  0.891, Loss:  1.179\n",
      "Epoch   4 Batch  196/538 - Train Accuracy:  0.897, Validation Accuracy:  0.903, Loss:  1.287\n",
      "Epoch   4 Batch  197/538 - Train Accuracy:  0.923, Validation Accuracy:  0.902, Loss:  1.206\n",
      "Epoch   4 Batch  198/538 - Train Accuracy:  0.924, Validation Accuracy:  0.907, Loss:  1.192\n",
      "Epoch   4 Batch  199/538 - Train Accuracy:  0.903, Validation Accuracy:  0.903, Loss:  1.170\n",
      "Epoch   4 Batch  200/538 - Train Accuracy:  0.913, Validation Accuracy:  0.900, Loss:  1.208\n",
      "Epoch   4 Batch  201/538 - Train Accuracy:  0.908, Validation Accuracy:  0.902, Loss:  1.257\n",
      "Epoch   4 Batch  202/538 - Train Accuracy:  0.934, Validation Accuracy:  0.905, Loss:  1.224\n",
      "Epoch   4 Batch  203/538 - Train Accuracy:  0.905, Validation Accuracy:  0.907, Loss:  1.202\n",
      "Epoch   4 Batch  204/538 - Train Accuracy:  0.907, Validation Accuracy:  0.907, Loss:  1.160\n",
      "Epoch   4 Batch  205/538 - Train Accuracy:  0.915, Validation Accuracy:  0.912, Loss:  1.220\n",
      "Epoch   4 Batch  206/538 - Train Accuracy:  0.907, Validation Accuracy:  0.911, Loss:  1.230\n",
      "Epoch   4 Batch  207/538 - Train Accuracy:  0.920, Validation Accuracy:  0.911, Loss:  1.212\n",
      "Epoch   4 Batch  208/538 - Train Accuracy:  0.905, Validation Accuracy:  0.907, Loss:  1.309\n",
      "Epoch   4 Batch  209/538 - Train Accuracy:  0.935, Validation Accuracy:  0.911, Loss:  1.210\n",
      "Epoch   4 Batch  210/538 - Train Accuracy:  0.887, Validation Accuracy:  0.906, Loss:  1.243\n",
      "Epoch   4 Batch  211/538 - Train Accuracy:  0.906, Validation Accuracy:  0.910, Loss:  1.248\n",
      "Epoch   4 Batch  212/538 - Train Accuracy:  0.908, Validation Accuracy:  0.907, Loss:  1.245\n",
      "Epoch   4 Batch  213/538 - Train Accuracy:  0.906, Validation Accuracy:  0.909, Loss:  1.235\n",
      "Epoch   4 Batch  214/538 - Train Accuracy:  0.917, Validation Accuracy:  0.916, Loss:  1.192\n",
      "Epoch   4 Batch  215/538 - Train Accuracy:  0.935, Validation Accuracy:  0.917, Loss:  1.182\n",
      "Epoch   4 Batch  216/538 - Train Accuracy:  0.929, Validation Accuracy:  0.909, Loss:  1.170\n",
      "Epoch   4 Batch  217/538 - Train Accuracy:  0.930, Validation Accuracy:  0.906, Loss:  1.201\n",
      "Epoch   4 Batch  218/538 - Train Accuracy:  0.912, Validation Accuracy:  0.906, Loss:  1.229\n",
      "Epoch   4 Batch  219/538 - Train Accuracy:  0.889, Validation Accuracy:  0.912, Loss:  1.230\n",
      "Epoch   4 Batch  220/538 - Train Accuracy:  0.912, Validation Accuracy:  0.917, Loss:  1.205\n",
      "Epoch   4 Batch  221/538 - Train Accuracy:  0.924, Validation Accuracy:  0.910, Loss:  1.198\n",
      "Epoch   4 Batch  222/538 - Train Accuracy:  0.900, Validation Accuracy:  0.901, Loss:  1.187\n",
      "Epoch   4 Batch  223/538 - Train Accuracy:  0.914, Validation Accuracy:  0.896, Loss:  1.167\n",
      "Epoch   4 Batch  224/538 - Train Accuracy:  0.921, Validation Accuracy:  0.893, Loss:  1.238\n",
      "Epoch   4 Batch  225/538 - Train Accuracy:  0.914, Validation Accuracy:  0.893, Loss:  1.162\n",
      "Epoch   4 Batch  226/538 - Train Accuracy:  0.916, Validation Accuracy:  0.888, Loss:  1.143\n",
      "Epoch   4 Batch  227/538 - Train Accuracy:  0.923, Validation Accuracy:  0.895, Loss:  1.212\n",
      "Epoch   4 Batch  228/538 - Train Accuracy:  0.903, Validation Accuracy:  0.897, Loss:  1.236\n",
      "Epoch   4 Batch  229/538 - Train Accuracy:  0.923, Validation Accuracy:  0.898, Loss:  1.224\n",
      "Epoch   4 Batch  230/538 - Train Accuracy:  0.899, Validation Accuracy:  0.903, Loss:  1.229\n",
      "Epoch   4 Batch  231/538 - Train Accuracy:  0.892, Validation Accuracy:  0.908, Loss:  1.243\n",
      "Epoch   4 Batch  232/538 - Train Accuracy:  0.905, Validation Accuracy:  0.901, Loss:  1.209\n",
      "Epoch   4 Batch  233/538 - Train Accuracy:  0.923, Validation Accuracy:  0.905, Loss:  1.210\n",
      "Epoch   4 Batch  234/538 - Train Accuracy:  0.913, Validation Accuracy:  0.899, Loss:  1.207\n",
      "Epoch   4 Batch  235/538 - Train Accuracy:  0.928, Validation Accuracy:  0.905, Loss:  1.219\n",
      "Epoch   4 Batch  236/538 - Train Accuracy:  0.903, Validation Accuracy:  0.903, Loss:  1.188\n",
      "Epoch   4 Batch  237/538 - Train Accuracy:  0.915, Validation Accuracy:  0.896, Loss:  1.214\n",
      "Epoch   4 Batch  238/538 - Train Accuracy:  0.927, Validation Accuracy:  0.904, Loss:  1.179\n",
      "Epoch   4 Batch  239/538 - Train Accuracy:  0.902, Validation Accuracy:  0.909, Loss:  1.211\n",
      "Epoch   4 Batch  240/538 - Train Accuracy:  0.920, Validation Accuracy:  0.909, Loss:  1.221\n",
      "Epoch   4 Batch  241/538 - Train Accuracy:  0.912, Validation Accuracy:  0.911, Loss:  1.164\n",
      "Epoch   4 Batch  242/538 - Train Accuracy:  0.927, Validation Accuracy:  0.909, Loss:  1.276\n",
      "Epoch   4 Batch  243/538 - Train Accuracy:  0.925, Validation Accuracy:  0.906, Loss:  1.246\n",
      "Epoch   4 Batch  244/538 - Train Accuracy:  0.922, Validation Accuracy:  0.908, Loss:  1.194\n",
      "Epoch   4 Batch  245/538 - Train Accuracy:  0.905, Validation Accuracy:  0.905, Loss:  1.190\n",
      "Epoch   4 Batch  246/538 - Train Accuracy:  0.933, Validation Accuracy:  0.902, Loss:  1.175\n",
      "Epoch   4 Batch  247/538 - Train Accuracy:  0.910, Validation Accuracy:  0.898, Loss:  1.185\n",
      "Epoch   4 Batch  248/538 - Train Accuracy:  0.924, Validation Accuracy:  0.899, Loss:  1.189\n",
      "Epoch   4 Batch  249/538 - Train Accuracy:  0.909, Validation Accuracy:  0.901, Loss:  1.220\n",
      "Epoch   4 Batch  250/538 - Train Accuracy:  0.916, Validation Accuracy:  0.900, Loss:  1.250\n",
      "Epoch   4 Batch  251/538 - Train Accuracy:  0.915, Validation Accuracy:  0.905, Loss:  1.237\n",
      "Epoch   4 Batch  252/538 - Train Accuracy:  0.906, Validation Accuracy:  0.914, Loss:  1.214\n",
      "Epoch   4 Batch  253/538 - Train Accuracy:  0.898, Validation Accuracy:  0.912, Loss:  1.200\n",
      "Epoch   4 Batch  254/538 - Train Accuracy:  0.892, Validation Accuracy:  0.904, Loss:  1.242\n",
      "Epoch   4 Batch  255/538 - Train Accuracy:  0.935, Validation Accuracy:  0.901, Loss:  1.222\n",
      "Epoch   4 Batch  256/538 - Train Accuracy:  0.901, Validation Accuracy:  0.898, Loss:  1.230\n",
      "Epoch   4 Batch  257/538 - Train Accuracy:  0.898, Validation Accuracy:  0.902, Loss:  1.235\n",
      "Epoch   4 Batch  258/538 - Train Accuracy:  0.914, Validation Accuracy:  0.904, Loss:  1.184\n",
      "Epoch   4 Batch  259/538 - Train Accuracy:  0.941, Validation Accuracy:  0.910, Loss:  1.172\n",
      "Epoch   4 Batch  260/538 - Train Accuracy:  0.882, Validation Accuracy:  0.908, Loss:  1.221\n",
      "Epoch   4 Batch  261/538 - Train Accuracy:  0.918, Validation Accuracy:  0.904, Loss:  1.170\n",
      "Epoch   4 Batch  262/538 - Train Accuracy:  0.923, Validation Accuracy:  0.906, Loss:  1.191\n",
      "Epoch   4 Batch  263/538 - Train Accuracy:  0.892, Validation Accuracy:  0.911, Loss:  1.195\n",
      "Epoch   4 Batch  264/538 - Train Accuracy:  0.906, Validation Accuracy:  0.909, Loss:  1.162\n",
      "Epoch   4 Batch  265/538 - Train Accuracy:  0.905, Validation Accuracy:  0.903, Loss:  1.194\n",
      "Epoch   4 Batch  266/538 - Train Accuracy:  0.908, Validation Accuracy:  0.903, Loss:  1.198\n",
      "Epoch   4 Batch  267/538 - Train Accuracy:  0.911, Validation Accuracy:  0.901, Loss:  1.206\n",
      "Epoch   4 Batch  268/538 - Train Accuracy:  0.937, Validation Accuracy:  0.896, Loss:  1.196\n",
      "Epoch   4 Batch  269/538 - Train Accuracy:  0.906, Validation Accuracy:  0.893, Loss:  1.230\n",
      "Epoch   4 Batch  270/538 - Train Accuracy:  0.909, Validation Accuracy:  0.904, Loss:  1.232\n",
      "Epoch   4 Batch  271/538 - Train Accuracy:  0.910, Validation Accuracy:  0.904, Loss:  1.207\n",
      "Epoch   4 Batch  272/538 - Train Accuracy:  0.909, Validation Accuracy:  0.904, Loss:  1.226\n",
      "Epoch   4 Batch  273/538 - Train Accuracy:  0.930, Validation Accuracy:  0.901, Loss:  1.196\n",
      "Epoch   4 Batch  274/538 - Train Accuracy:  0.898, Validation Accuracy:  0.899, Loss:  1.262\n",
      "Epoch   4 Batch  275/538 - Train Accuracy:  0.917, Validation Accuracy:  0.899, Loss:  1.208\n",
      "Epoch   4 Batch  276/538 - Train Accuracy:  0.906, Validation Accuracy:  0.897, Loss:  1.190\n",
      "Epoch   4 Batch  277/538 - Train Accuracy:  0.917, Validation Accuracy:  0.902, Loss:  1.189\n",
      "Epoch   4 Batch  278/538 - Train Accuracy:  0.918, Validation Accuracy:  0.908, Loss:  1.191\n",
      "Epoch   4 Batch  279/538 - Train Accuracy:  0.913, Validation Accuracy:  0.901, Loss:  1.212\n",
      "Epoch   4 Batch  280/538 - Train Accuracy:  0.940, Validation Accuracy:  0.901, Loss:  1.183\n",
      "Epoch   4 Batch  281/538 - Train Accuracy:  0.902, Validation Accuracy:  0.902, Loss:  1.204\n",
      "Epoch   4 Batch  282/538 - Train Accuracy:  0.924, Validation Accuracy:  0.899, Loss:  1.286\n",
      "Epoch   4 Batch  283/538 - Train Accuracy:  0.913, Validation Accuracy:  0.901, Loss:  1.248\n",
      "Epoch   4 Batch  284/538 - Train Accuracy:  0.913, Validation Accuracy:  0.901, Loss:  1.220\n",
      "Epoch   4 Batch  285/538 - Train Accuracy:  0.927, Validation Accuracy:  0.902, Loss:  1.183\n",
      "Epoch   4 Batch  286/538 - Train Accuracy:  0.904, Validation Accuracy:  0.909, Loss:  1.222\n",
      "Epoch   4 Batch  287/538 - Train Accuracy:  0.932, Validation Accuracy:  0.917, Loss:  1.186\n",
      "Epoch   4 Batch  288/538 - Train Accuracy:  0.929, Validation Accuracy:  0.916, Loss:  1.203\n",
      "Epoch   4 Batch  289/538 - Train Accuracy:  0.919, Validation Accuracy:  0.906, Loss:  1.171\n",
      "Epoch   4 Batch  290/538 - Train Accuracy:  0.934, Validation Accuracy:  0.907, Loss:  1.222\n",
      "Epoch   4 Batch  291/538 - Train Accuracy:  0.915, Validation Accuracy:  0.906, Loss:  1.211\n",
      "Epoch   4 Batch  292/538 - Train Accuracy:  0.928, Validation Accuracy:  0.913, Loss:  1.234\n",
      "Epoch   4 Batch  293/538 - Train Accuracy:  0.916, Validation Accuracy:  0.917, Loss:  1.219\n",
      "Epoch   4 Batch  294/538 - Train Accuracy:  0.901, Validation Accuracy:  0.917, Loss:  1.202\n",
      "Epoch   4 Batch  295/538 - Train Accuracy:  0.937, Validation Accuracy:  0.914, Loss:  1.186\n",
      "Epoch   4 Batch  296/538 - Train Accuracy:  0.902, Validation Accuracy:  0.920, Loss:  1.181\n",
      "Epoch   4 Batch  297/538 - Train Accuracy:  0.939, Validation Accuracy:  0.912, Loss:  1.214\n",
      "Epoch   4 Batch  298/538 - Train Accuracy:  0.910, Validation Accuracy:  0.915, Loss:  1.205\n",
      "Epoch   4 Batch  299/538 - Train Accuracy:  0.903, Validation Accuracy:  0.917, Loss:  1.229\n",
      "Epoch   4 Batch  300/538 - Train Accuracy:  0.911, Validation Accuracy:  0.919, Loss:  1.193\n",
      "Epoch   4 Batch  301/538 - Train Accuracy:  0.905, Validation Accuracy:  0.922, Loss:  1.178\n",
      "Epoch   4 Batch  302/538 - Train Accuracy:  0.942, Validation Accuracy:  0.917, Loss:  1.208\n",
      "Epoch   4 Batch  303/538 - Train Accuracy:  0.930, Validation Accuracy:  0.913, Loss:  1.216\n",
      "Epoch   4 Batch  304/538 - Train Accuracy:  0.915, Validation Accuracy:  0.912, Loss:  1.253\n",
      "Epoch   4 Batch  305/538 - Train Accuracy:  0.925, Validation Accuracy:  0.911, Loss:  1.230\n",
      "Epoch   4 Batch  306/538 - Train Accuracy:  0.916, Validation Accuracy:  0.905, Loss:  1.266\n",
      "Epoch   4 Batch  307/538 - Train Accuracy:  0.923, Validation Accuracy:  0.909, Loss:  1.249\n",
      "Epoch   4 Batch  308/538 - Train Accuracy:  0.935, Validation Accuracy:  0.916, Loss:  1.232\n",
      "Epoch   4 Batch  309/538 - Train Accuracy:  0.929, Validation Accuracy:  0.916, Loss:  1.198\n",
      "Epoch   4 Batch  310/538 - Train Accuracy:  0.945, Validation Accuracy:  0.915, Loss:  1.163\n",
      "Epoch   4 Batch  311/538 - Train Accuracy:  0.907, Validation Accuracy:  0.913, Loss:  1.192\n",
      "Epoch   4 Batch  312/538 - Train Accuracy:  0.932, Validation Accuracy:  0.907, Loss:  1.169\n",
      "Epoch   4 Batch  313/538 - Train Accuracy:  0.909, Validation Accuracy:  0.908, Loss:  1.200\n",
      "Epoch   4 Batch  314/538 - Train Accuracy:  0.911, Validation Accuracy:  0.910, Loss:  1.219\n",
      "Epoch   4 Batch  315/538 - Train Accuracy:  0.913, Validation Accuracy:  0.917, Loss:  1.211\n",
      "Epoch   4 Batch  316/538 - Train Accuracy:  0.908, Validation Accuracy:  0.916, Loss:  1.159\n",
      "Epoch   4 Batch  317/538 - Train Accuracy:  0.926, Validation Accuracy:  0.913, Loss:  1.210\n",
      "Epoch   4 Batch  318/538 - Train Accuracy:  0.924, Validation Accuracy:  0.914, Loss:  1.219\n",
      "Epoch   4 Batch  319/538 - Train Accuracy:  0.905, Validation Accuracy:  0.908, Loss:  1.188\n",
      "Epoch   4 Batch  320/538 - Train Accuracy:  0.912, Validation Accuracy:  0.912, Loss:  1.235\n",
      "Epoch   4 Batch  321/538 - Train Accuracy:  0.913, Validation Accuracy:  0.911, Loss:  1.239\n",
      "Epoch   4 Batch  322/538 - Train Accuracy:  0.921, Validation Accuracy:  0.913, Loss:  1.264\n",
      "Epoch   4 Batch  323/538 - Train Accuracy:  0.938, Validation Accuracy:  0.918, Loss:  1.214\n",
      "Epoch   4 Batch  324/538 - Train Accuracy:  0.926, Validation Accuracy:  0.915, Loss:  1.209\n",
      "Epoch   4 Batch  325/538 - Train Accuracy:  0.938, Validation Accuracy:  0.912, Loss:  1.184\n",
      "Epoch   4 Batch  326/538 - Train Accuracy:  0.923, Validation Accuracy:  0.914, Loss:  1.188\n",
      "Epoch   4 Batch  327/538 - Train Accuracy:  0.919, Validation Accuracy:  0.913, Loss:  1.233\n",
      "Epoch   4 Batch  328/538 - Train Accuracy:  0.938, Validation Accuracy:  0.914, Loss:  1.185\n",
      "Epoch   4 Batch  329/538 - Train Accuracy:  0.920, Validation Accuracy:  0.916, Loss:  1.216\n",
      "Epoch   4 Batch  330/538 - Train Accuracy:  0.918, Validation Accuracy:  0.919, Loss:  1.208\n",
      "Epoch   4 Batch  331/538 - Train Accuracy:  0.928, Validation Accuracy:  0.912, Loss:  1.207\n",
      "Epoch   4 Batch  332/538 - Train Accuracy:  0.928, Validation Accuracy:  0.909, Loss:  1.263\n",
      "Epoch   4 Batch  333/538 - Train Accuracy:  0.934, Validation Accuracy:  0.912, Loss:  1.238\n",
      "Epoch   4 Batch  334/538 - Train Accuracy:  0.931, Validation Accuracy:  0.901, Loss:  1.191\n",
      "Epoch   4 Batch  335/538 - Train Accuracy:  0.919, Validation Accuracy:  0.906, Loss:  1.237\n",
      "Epoch   4 Batch  336/538 - Train Accuracy:  0.926, Validation Accuracy:  0.904, Loss:  1.139\n",
      "Epoch   4 Batch  337/538 - Train Accuracy:  0.928, Validation Accuracy:  0.916, Loss:  1.194\n",
      "Epoch   4 Batch  338/538 - Train Accuracy:  0.910, Validation Accuracy:  0.917, Loss:  1.149\n",
      "Epoch   4 Batch  339/538 - Train Accuracy:  0.903, Validation Accuracy:  0.911, Loss:  1.170\n",
      "Epoch   4 Batch  340/538 - Train Accuracy:  0.915, Validation Accuracy:  0.918, Loss:  1.167\n",
      "Epoch   4 Batch  341/538 - Train Accuracy:  0.907, Validation Accuracy:  0.923, Loss:  1.180\n",
      "Epoch   4 Batch  342/538 - Train Accuracy:  0.910, Validation Accuracy:  0.925, Loss:  1.193\n",
      "Epoch   4 Batch  343/538 - Train Accuracy:  0.922, Validation Accuracy:  0.922, Loss:  1.208\n",
      "Epoch   4 Batch  344/538 - Train Accuracy:  0.938, Validation Accuracy:  0.921, Loss:  1.218\n",
      "Epoch   4 Batch  345/538 - Train Accuracy:  0.930, Validation Accuracy:  0.919, Loss:  1.155\n",
      "Epoch   4 Batch  346/538 - Train Accuracy:  0.911, Validation Accuracy:  0.921, Loss:  1.170\n",
      "Epoch   4 Batch  347/538 - Train Accuracy:  0.932, Validation Accuracy:  0.920, Loss:  1.182\n",
      "Epoch   4 Batch  348/538 - Train Accuracy:  0.922, Validation Accuracy:  0.921, Loss:  1.138\n",
      "Epoch   4 Batch  349/538 - Train Accuracy:  0.930, Validation Accuracy:  0.918, Loss:  1.180\n",
      "Epoch   4 Batch  350/538 - Train Accuracy:  0.931, Validation Accuracy:  0.911, Loss:  1.221\n",
      "Epoch   4 Batch  351/538 - Train Accuracy:  0.926, Validation Accuracy:  0.912, Loss:  1.219\n",
      "Epoch   4 Batch  352/538 - Train Accuracy:  0.890, Validation Accuracy:  0.914, Loss:  1.219\n",
      "Epoch   4 Batch  353/538 - Train Accuracy:  0.902, Validation Accuracy:  0.912, Loss:  1.168\n",
      "Epoch   4 Batch  354/538 - Train Accuracy:  0.919, Validation Accuracy:  0.916, Loss:  1.150\n",
      "Epoch   4 Batch  355/538 - Train Accuracy:  0.940, Validation Accuracy:  0.920, Loss:  1.211\n",
      "Epoch   4 Batch  356/538 - Train Accuracy:  0.925, Validation Accuracy:  0.924, Loss:  1.228\n",
      "Epoch   4 Batch  357/538 - Train Accuracy:  0.940, Validation Accuracy:  0.924, Loss:  1.221\n",
      "Epoch   4 Batch  358/538 - Train Accuracy:  0.932, Validation Accuracy:  0.918, Loss:  1.184\n",
      "Epoch   4 Batch  359/538 - Train Accuracy:  0.923, Validation Accuracy:  0.922, Loss:  1.238\n",
      "Epoch   4 Batch  360/538 - Train Accuracy:  0.925, Validation Accuracy:  0.926, Loss:  1.205\n",
      "Epoch   4 Batch  361/538 - Train Accuracy:  0.925, Validation Accuracy:  0.925, Loss:  1.192\n",
      "Epoch   4 Batch  362/538 - Train Accuracy:  0.945, Validation Accuracy:  0.917, Loss:  1.228\n",
      "Epoch   4 Batch  363/538 - Train Accuracy:  0.903, Validation Accuracy:  0.916, Loss:  1.172\n",
      "Epoch   4 Batch  364/538 - Train Accuracy:  0.921, Validation Accuracy:  0.914, Loss:  1.211\n",
      "Epoch   4 Batch  365/538 - Train Accuracy:  0.913, Validation Accuracy:  0.911, Loss:  1.182\n",
      "Epoch   4 Batch  366/538 - Train Accuracy:  0.937, Validation Accuracy:  0.917, Loss:  1.238\n",
      "Epoch   4 Batch  367/538 - Train Accuracy:  0.929, Validation Accuracy:  0.920, Loss:  1.180\n",
      "Epoch   4 Batch  368/538 - Train Accuracy:  0.931, Validation Accuracy:  0.919, Loss:  1.209\n",
      "Epoch   4 Batch  369/538 - Train Accuracy:  0.927, Validation Accuracy:  0.923, Loss:  1.179\n",
      "Epoch   4 Batch  370/538 - Train Accuracy:  0.922, Validation Accuracy:  0.921, Loss:  1.226\n",
      "Epoch   4 Batch  371/538 - Train Accuracy:  0.922, Validation Accuracy:  0.912, Loss:  1.242\n",
      "Epoch   4 Batch  372/538 - Train Accuracy:  0.947, Validation Accuracy:  0.911, Loss:  1.174\n",
      "Epoch   4 Batch  373/538 - Train Accuracy:  0.924, Validation Accuracy:  0.906, Loss:  1.258\n",
      "Epoch   4 Batch  374/538 - Train Accuracy:  0.925, Validation Accuracy:  0.911, Loss:  1.205\n",
      "Epoch   4 Batch  375/538 - Train Accuracy:  0.923, Validation Accuracy:  0.918, Loss:  1.220\n",
      "Epoch   4 Batch  376/538 - Train Accuracy:  0.929, Validation Accuracy:  0.918, Loss:  1.193\n",
      "Epoch   4 Batch  377/538 - Train Accuracy:  0.922, Validation Accuracy:  0.919, Loss:  1.226\n",
      "Epoch   4 Batch  378/538 - Train Accuracy:  0.911, Validation Accuracy:  0.915, Loss:  1.228\n",
      "Epoch   4 Batch  379/538 - Train Accuracy:  0.935, Validation Accuracy:  0.919, Loss:  1.226\n",
      "Epoch   4 Batch  380/538 - Train Accuracy:  0.926, Validation Accuracy:  0.917, Loss:  1.249\n",
      "Epoch   4 Batch  381/538 - Train Accuracy:  0.936, Validation Accuracy:  0.921, Loss:  1.150\n",
      "Epoch   4 Batch  382/538 - Train Accuracy:  0.904, Validation Accuracy:  0.918, Loss:  1.211\n",
      "Epoch   4 Batch  383/538 - Train Accuracy:  0.911, Validation Accuracy:  0.917, Loss:  1.171\n",
      "Epoch   4 Batch  384/538 - Train Accuracy:  0.905, Validation Accuracy:  0.919, Loss:  1.173\n",
      "Epoch   4 Batch  385/538 - Train Accuracy:  0.929, Validation Accuracy:  0.922, Loss:  1.236\n",
      "Epoch   4 Batch  386/538 - Train Accuracy:  0.922, Validation Accuracy:  0.924, Loss:  1.161\n",
      "Epoch   4 Batch  387/538 - Train Accuracy:  0.924, Validation Accuracy:  0.931, Loss:  1.210\n",
      "Epoch   4 Batch  388/538 - Train Accuracy:  0.934, Validation Accuracy:  0.933, Loss:  1.199\n",
      "Epoch   4 Batch  389/538 - Train Accuracy:  0.913, Validation Accuracy:  0.930, Loss:  1.209\n",
      "Epoch   4 Batch  390/538 - Train Accuracy:  0.933, Validation Accuracy:  0.922, Loss:  1.185\n",
      "Epoch   4 Batch  391/538 - Train Accuracy:  0.925, Validation Accuracy:  0.920, Loss:  1.222\n",
      "Epoch   4 Batch  392/538 - Train Accuracy:  0.917, Validation Accuracy:  0.923, Loss:  1.203\n",
      "Epoch   4 Batch  393/538 - Train Accuracy:  0.940, Validation Accuracy:  0.919, Loss:  1.186\n",
      "Epoch   4 Batch  394/538 - Train Accuracy:  0.900, Validation Accuracy:  0.922, Loss:  1.188\n",
      "Epoch   4 Batch  395/538 - Train Accuracy:  0.919, Validation Accuracy:  0.923, Loss:  1.219\n",
      "Epoch   4 Batch  396/538 - Train Accuracy:  0.930, Validation Accuracy:  0.923, Loss:  1.182\n",
      "Epoch   4 Batch  397/538 - Train Accuracy:  0.931, Validation Accuracy:  0.921, Loss:  1.207\n",
      "Epoch   4 Batch  398/538 - Train Accuracy:  0.930, Validation Accuracy:  0.919, Loss:  1.231\n",
      "Epoch   4 Batch  399/538 - Train Accuracy:  0.920, Validation Accuracy:  0.921, Loss:  1.287\n",
      "Epoch   4 Batch  400/538 - Train Accuracy:  0.924, Validation Accuracy:  0.927, Loss:  1.190\n",
      "Epoch   4 Batch  401/538 - Train Accuracy:  0.939, Validation Accuracy:  0.919, Loss:  1.182\n",
      "Epoch   4 Batch  402/538 - Train Accuracy:  0.918, Validation Accuracy:  0.918, Loss:  1.199\n",
      "Epoch   4 Batch  403/538 - Train Accuracy:  0.923, Validation Accuracy:  0.916, Loss:  1.185\n",
      "Epoch   4 Batch  404/538 - Train Accuracy:  0.908, Validation Accuracy:  0.917, Loss:  1.206\n",
      "Epoch   4 Batch  405/538 - Train Accuracy:  0.930, Validation Accuracy:  0.913, Loss:  1.121\n",
      "Epoch   4 Batch  406/538 - Train Accuracy:  0.929, Validation Accuracy:  0.917, Loss:  1.218\n",
      "Epoch   4 Batch  407/538 - Train Accuracy:  0.926, Validation Accuracy:  0.912, Loss:  1.250\n",
      "Epoch   4 Batch  408/538 - Train Accuracy:  0.911, Validation Accuracy:  0.909, Loss:  1.210\n",
      "Epoch   4 Batch  409/538 - Train Accuracy:  0.916, Validation Accuracy:  0.905, Loss:  1.240\n",
      "Epoch   4 Batch  410/538 - Train Accuracy:  0.921, Validation Accuracy:  0.913, Loss:  1.172\n",
      "Epoch   4 Batch  411/538 - Train Accuracy:  0.944, Validation Accuracy:  0.918, Loss:  1.200\n",
      "Epoch   4 Batch  412/538 - Train Accuracy:  0.933, Validation Accuracy:  0.915, Loss:  1.204\n",
      "Epoch   4 Batch  413/538 - Train Accuracy:  0.934, Validation Accuracy:  0.913, Loss:  1.147\n",
      "Epoch   4 Batch  414/538 - Train Accuracy:  0.894, Validation Accuracy:  0.907, Loss:  1.207\n",
      "Epoch   4 Batch  415/538 - Train Accuracy:  0.914, Validation Accuracy:  0.910, Loss:  1.207\n",
      "Epoch   4 Batch  416/538 - Train Accuracy:  0.930, Validation Accuracy:  0.917, Loss:  1.223\n",
      "Epoch   4 Batch  417/538 - Train Accuracy:  0.925, Validation Accuracy:  0.922, Loss:  1.226\n",
      "Epoch   4 Batch  418/538 - Train Accuracy:  0.919, Validation Accuracy:  0.922, Loss:  1.186\n",
      "Epoch   4 Batch  419/538 - Train Accuracy:  0.928, Validation Accuracy:  0.924, Loss:  1.201\n",
      "Epoch   4 Batch  420/538 - Train Accuracy:  0.946, Validation Accuracy:  0.926, Loss:  1.234\n",
      "Epoch   4 Batch  421/538 - Train Accuracy:  0.940, Validation Accuracy:  0.921, Loss:  1.166\n",
      "Epoch   4 Batch  422/538 - Train Accuracy:  0.921, Validation Accuracy:  0.919, Loss:  1.204\n",
      "Epoch   4 Batch  423/538 - Train Accuracy:  0.930, Validation Accuracy:  0.926, Loss:  1.195\n",
      "Epoch   4 Batch  424/538 - Train Accuracy:  0.919, Validation Accuracy:  0.923, Loss:  1.278\n",
      "Epoch   4 Batch  425/538 - Train Accuracy:  0.915, Validation Accuracy:  0.926, Loss:  1.205\n",
      "Epoch   4 Batch  426/538 - Train Accuracy:  0.930, Validation Accuracy:  0.932, Loss:  1.241\n",
      "Epoch   4 Batch  427/538 - Train Accuracy:  0.919, Validation Accuracy:  0.928, Loss:  1.201\n",
      "Epoch   4 Batch  428/538 - Train Accuracy:  0.936, Validation Accuracy:  0.919, Loss:  1.185\n",
      "Epoch   4 Batch  429/538 - Train Accuracy:  0.934, Validation Accuracy:  0.918, Loss:  1.220\n",
      "Epoch   4 Batch  430/538 - Train Accuracy:  0.904, Validation Accuracy:  0.920, Loss:  1.256\n",
      "Epoch   4 Batch  431/538 - Train Accuracy:  0.916, Validation Accuracy:  0.916, Loss:  1.146\n",
      "Epoch   4 Batch  432/538 - Train Accuracy:  0.923, Validation Accuracy:  0.924, Loss:  1.211\n",
      "Epoch   4 Batch  433/538 - Train Accuracy:  0.913, Validation Accuracy:  0.922, Loss:  1.245\n",
      "Epoch   4 Batch  434/538 - Train Accuracy:  0.913, Validation Accuracy:  0.923, Loss:  1.168\n",
      "Epoch   4 Batch  435/538 - Train Accuracy:  0.919, Validation Accuracy:  0.928, Loss:  1.234\n",
      "Epoch   4 Batch  436/538 - Train Accuracy:  0.905, Validation Accuracy:  0.923, Loss:  1.224\n",
      "Epoch   4 Batch  437/538 - Train Accuracy:  0.921, Validation Accuracy:  0.926, Loss:  1.233\n",
      "Epoch   4 Batch  438/538 - Train Accuracy:  0.931, Validation Accuracy:  0.921, Loss:  1.177\n",
      "Epoch   4 Batch  439/538 - Train Accuracy:  0.935, Validation Accuracy:  0.920, Loss:  1.203\n",
      "Epoch   4 Batch  440/538 - Train Accuracy:  0.913, Validation Accuracy:  0.920, Loss:  1.203\n",
      "Epoch   4 Batch  441/538 - Train Accuracy:  0.910, Validation Accuracy:  0.919, Loss:  1.214\n",
      "Epoch   4 Batch  442/538 - Train Accuracy:  0.941, Validation Accuracy:  0.923, Loss:  1.207\n",
      "Epoch   4 Batch  443/538 - Train Accuracy:  0.937, Validation Accuracy:  0.918, Loss:  1.159\n",
      "Epoch   4 Batch  444/538 - Train Accuracy:  0.930, Validation Accuracy:  0.923, Loss:  1.183\n",
      "Epoch   4 Batch  445/538 - Train Accuracy:  0.942, Validation Accuracy:  0.917, Loss:  1.206\n",
      "Epoch   4 Batch  446/538 - Train Accuracy:  0.943, Validation Accuracy:  0.920, Loss:  1.175\n",
      "Epoch   4 Batch  447/538 - Train Accuracy:  0.913, Validation Accuracy:  0.921, Loss:  1.183\n",
      "Epoch   4 Batch  448/538 - Train Accuracy:  0.935, Validation Accuracy:  0.920, Loss:  1.231\n",
      "Epoch   4 Batch  449/538 - Train Accuracy:  0.933, Validation Accuracy:  0.919, Loss:  1.205\n",
      "Epoch   4 Batch  450/538 - Train Accuracy:  0.910, Validation Accuracy:  0.924, Loss:  1.225\n",
      "Epoch   4 Batch  451/538 - Train Accuracy:  0.918, Validation Accuracy:  0.927, Loss:  1.205\n",
      "Epoch   4 Batch  452/538 - Train Accuracy:  0.925, Validation Accuracy:  0.929, Loss:  1.181\n",
      "Epoch   4 Batch  453/538 - Train Accuracy:  0.937, Validation Accuracy:  0.927, Loss:  1.177\n",
      "Epoch   4 Batch  454/538 - Train Accuracy:  0.922, Validation Accuracy:  0.923, Loss:  1.188\n",
      "Epoch   4 Batch  455/538 - Train Accuracy:  0.930, Validation Accuracy:  0.914, Loss:  1.210\n",
      "Epoch   4 Batch  456/538 - Train Accuracy:  0.930, Validation Accuracy:  0.912, Loss:  1.230\n",
      "Epoch   4 Batch  457/538 - Train Accuracy:  0.928, Validation Accuracy:  0.912, Loss:  1.227\n",
      "Epoch   4 Batch  458/538 - Train Accuracy:  0.940, Validation Accuracy:  0.912, Loss:  1.190\n",
      "Epoch   4 Batch  459/538 - Train Accuracy:  0.930, Validation Accuracy:  0.925, Loss:  1.168\n",
      "Epoch   4 Batch  460/538 - Train Accuracy:  0.926, Validation Accuracy:  0.925, Loss:  1.195\n",
      "Epoch   4 Batch  461/538 - Train Accuracy:  0.939, Validation Accuracy:  0.920, Loss:  1.225\n",
      "Epoch   4 Batch  462/538 - Train Accuracy:  0.929, Validation Accuracy:  0.918, Loss:  1.190\n",
      "Epoch   4 Batch  463/538 - Train Accuracy:  0.901, Validation Accuracy:  0.914, Loss:  1.215\n",
      "Epoch   4 Batch  464/538 - Train Accuracy:  0.941, Validation Accuracy:  0.917, Loss:  1.245\n",
      "Epoch   4 Batch  465/538 - Train Accuracy:  0.933, Validation Accuracy:  0.920, Loss:  1.204\n",
      "Epoch   4 Batch  466/538 - Train Accuracy:  0.924, Validation Accuracy:  0.919, Loss:  1.141\n",
      "Epoch   4 Batch  467/538 - Train Accuracy:  0.936, Validation Accuracy:  0.919, Loss:  1.254\n",
      "Epoch   4 Batch  468/538 - Train Accuracy:  0.931, Validation Accuracy:  0.914, Loss:  1.183\n",
      "Epoch   4 Batch  469/538 - Train Accuracy:  0.928, Validation Accuracy:  0.908, Loss:  1.192\n",
      "Epoch   4 Batch  470/538 - Train Accuracy:  0.925, Validation Accuracy:  0.914, Loss:  1.214\n",
      "Epoch   4 Batch  471/538 - Train Accuracy:  0.938, Validation Accuracy:  0.924, Loss:  1.156\n",
      "Epoch   4 Batch  472/538 - Train Accuracy:  0.965, Validation Accuracy:  0.924, Loss:  1.183\n",
      "Epoch   4 Batch  473/538 - Train Accuracy:  0.910, Validation Accuracy:  0.926, Loss:  1.188\n",
      "Epoch   4 Batch  474/538 - Train Accuracy:  0.935, Validation Accuracy:  0.923, Loss:  1.176\n",
      "Epoch   4 Batch  475/538 - Train Accuracy:  0.930, Validation Accuracy:  0.923, Loss:  1.178\n",
      "Epoch   4 Batch  476/538 - Train Accuracy:  0.926, Validation Accuracy:  0.920, Loss:  1.134\n",
      "Epoch   4 Batch  477/538 - Train Accuracy:  0.913, Validation Accuracy:  0.915, Loss:  1.188\n",
      "Epoch   4 Batch  478/538 - Train Accuracy:  0.942, Validation Accuracy:  0.919, Loss:  1.155\n",
      "Epoch   4 Batch  479/538 - Train Accuracy:  0.924, Validation Accuracy:  0.920, Loss:  1.192\n",
      "Epoch   4 Batch  480/538 - Train Accuracy:  0.939, Validation Accuracy:  0.930, Loss:  1.224\n",
      "Epoch   4 Batch  481/538 - Train Accuracy:  0.928, Validation Accuracy:  0.936, Loss:  1.222\n",
      "Epoch   4 Batch  482/538 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  1.174\n",
      "Epoch   4 Batch  483/538 - Train Accuracy:  0.906, Validation Accuracy:  0.939, Loss:  1.232\n",
      "Epoch   4 Batch  484/538 - Train Accuracy:  0.939, Validation Accuracy:  0.942, Loss:  1.215\n",
      "Epoch   4 Batch  485/538 - Train Accuracy:  0.921, Validation Accuracy:  0.932, Loss:  1.151\n",
      "Epoch   4 Batch  486/538 - Train Accuracy:  0.943, Validation Accuracy:  0.928, Loss:  1.189\n",
      "Epoch   4 Batch  487/538 - Train Accuracy:  0.930, Validation Accuracy:  0.924, Loss:  1.246\n",
      "Epoch   4 Batch  488/538 - Train Accuracy:  0.949, Validation Accuracy:  0.930, Loss:  1.182\n",
      "Epoch   4 Batch  489/538 - Train Accuracy:  0.907, Validation Accuracy:  0.932, Loss:  1.217\n",
      "Epoch   4 Batch  490/538 - Train Accuracy:  0.919, Validation Accuracy:  0.932, Loss:  1.129\n",
      "Epoch   4 Batch  491/538 - Train Accuracy:  0.896, Validation Accuracy:  0.930, Loss:  1.210\n",
      "Epoch   4 Batch  492/538 - Train Accuracy:  0.943, Validation Accuracy:  0.929, Loss:  1.189\n",
      "Epoch   4 Batch  493/538 - Train Accuracy:  0.922, Validation Accuracy:  0.927, Loss:  1.206\n",
      "Epoch   4 Batch  494/538 - Train Accuracy:  0.919, Validation Accuracy:  0.928, Loss:  1.198\n",
      "Epoch   4 Batch  495/538 - Train Accuracy:  0.927, Validation Accuracy:  0.928, Loss:  1.199\n",
      "Epoch   4 Batch  496/538 - Train Accuracy:  0.925, Validation Accuracy:  0.927, Loss:  1.201\n",
      "Epoch   4 Batch  497/538 - Train Accuracy:  0.943, Validation Accuracy:  0.924, Loss:  1.186\n",
      "Epoch   4 Batch  498/538 - Train Accuracy:  0.929, Validation Accuracy:  0.916, Loss:  1.226\n",
      "Epoch   4 Batch  499/538 - Train Accuracy:  0.921, Validation Accuracy:  0.920, Loss:  1.182\n",
      "Epoch   4 Batch  500/538 - Train Accuracy:  0.941, Validation Accuracy:  0.915, Loss:  1.149\n",
      "Epoch   4 Batch  501/538 - Train Accuracy:  0.934, Validation Accuracy:  0.920, Loss:  1.185\n",
      "Epoch   4 Batch  502/538 - Train Accuracy:  0.916, Validation Accuracy:  0.923, Loss:  1.183\n",
      "Epoch   4 Batch  503/538 - Train Accuracy:  0.945, Validation Accuracy:  0.918, Loss:  1.204\n",
      "Epoch   4 Batch  504/538 - Train Accuracy:  0.940, Validation Accuracy:  0.914, Loss:  1.192\n",
      "Epoch   4 Batch  505/538 - Train Accuracy:  0.939, Validation Accuracy:  0.918, Loss:  1.142\n",
      "Epoch   4 Batch  506/538 - Train Accuracy:  0.928, Validation Accuracy:  0.922, Loss:  1.166\n",
      "Epoch   4 Batch  507/538 - Train Accuracy:  0.917, Validation Accuracy:  0.926, Loss:  1.220\n",
      "Epoch   4 Batch  508/538 - Train Accuracy:  0.930, Validation Accuracy:  0.928, Loss:  1.216\n",
      "Epoch   4 Batch  509/538 - Train Accuracy:  0.929, Validation Accuracy:  0.930, Loss:  1.179\n",
      "Epoch   4 Batch  510/538 - Train Accuracy:  0.940, Validation Accuracy:  0.937, Loss:  1.196\n",
      "Epoch   4 Batch  511/538 - Train Accuracy:  0.923, Validation Accuracy:  0.935, Loss:  1.175\n",
      "Epoch   4 Batch  512/538 - Train Accuracy:  0.942, Validation Accuracy:  0.934, Loss:  1.170\n",
      "Epoch   4 Batch  513/538 - Train Accuracy:  0.916, Validation Accuracy:  0.938, Loss:  1.212\n",
      "Epoch   4 Batch  514/538 - Train Accuracy:  0.946, Validation Accuracy:  0.929, Loss:  1.205\n",
      "Epoch   4 Batch  515/538 - Train Accuracy:  0.930, Validation Accuracy:  0.930, Loss:  1.279\n",
      "Epoch   4 Batch  516/538 - Train Accuracy:  0.905, Validation Accuracy:  0.933, Loss:  1.207\n",
      "Epoch   4 Batch  517/538 - Train Accuracy:  0.942, Validation Accuracy:  0.934, Loss:  1.162\n",
      "Epoch   4 Batch  518/538 - Train Accuracy:  0.914, Validation Accuracy:  0.931, Loss:  1.170\n",
      "Epoch   4 Batch  519/538 - Train Accuracy:  0.932, Validation Accuracy:  0.933, Loss:  1.195\n",
      "Epoch   4 Batch  520/538 - Train Accuracy:  0.936, Validation Accuracy:  0.930, Loss:  1.186\n",
      "Epoch   4 Batch  521/538 - Train Accuracy:  0.932, Validation Accuracy:  0.932, Loss:  1.229\n",
      "Epoch   4 Batch  522/538 - Train Accuracy:  0.931, Validation Accuracy:  0.934, Loss:  1.205\n",
      "Epoch   4 Batch  523/538 - Train Accuracy:  0.936, Validation Accuracy:  0.927, Loss:  1.209\n",
      "Epoch   4 Batch  524/538 - Train Accuracy:  0.926, Validation Accuracy:  0.926, Loss:  1.164\n",
      "Epoch   4 Batch  525/538 - Train Accuracy:  0.946, Validation Accuracy:  0.928, Loss:  1.212\n",
      "Epoch   4 Batch  526/538 - Train Accuracy:  0.934, Validation Accuracy:  0.931, Loss:  1.203\n",
      "Epoch   4 Batch  527/538 - Train Accuracy:  0.951, Validation Accuracy:  0.937, Loss:  1.260\n",
      "Epoch   4 Batch  528/538 - Train Accuracy:  0.924, Validation Accuracy:  0.928, Loss:  1.198\n",
      "Epoch   4 Batch  529/538 - Train Accuracy:  0.904, Validation Accuracy:  0.933, Loss:  1.180\n",
      "Epoch   4 Batch  530/538 - Train Accuracy:  0.928, Validation Accuracy:  0.931, Loss:  1.188\n",
      "Epoch   4 Batch  531/538 - Train Accuracy:  0.932, Validation Accuracy:  0.934, Loss:  1.200\n",
      "Epoch   4 Batch  532/538 - Train Accuracy:  0.940, Validation Accuracy:  0.929, Loss:  1.223\n",
      "Epoch   4 Batch  533/538 - Train Accuracy:  0.933, Validation Accuracy:  0.929, Loss:  1.205\n",
      "Epoch   4 Batch  534/538 - Train Accuracy:  0.943, Validation Accuracy:  0.933, Loss:  1.194\n",
      "Epoch   4 Batch  535/538 - Train Accuracy:  0.931, Validation Accuracy:  0.931, Loss:  1.202\n",
      "Epoch   4 Batch  536/538 - Train Accuracy:  0.944, Validation Accuracy:  0.934, Loss:  1.195\n",
      "Epoch   5 Batch    0/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  1.209\n",
      "Epoch   5 Batch    1/538 - Train Accuracy:  0.949, Validation Accuracy:  0.945, Loss:  1.205\n",
      "Epoch   5 Batch    2/538 - Train Accuracy:  0.939, Validation Accuracy:  0.937, Loss:  1.173\n",
      "Epoch   5 Batch    3/538 - Train Accuracy:  0.938, Validation Accuracy:  0.937, Loss:  1.147\n",
      "Epoch   5 Batch    4/538 - Train Accuracy:  0.916, Validation Accuracy:  0.938, Loss:  1.160\n",
      "Epoch   5 Batch    5/538 - Train Accuracy:  0.939, Validation Accuracy:  0.939, Loss:  1.191\n",
      "Epoch   5 Batch    6/538 - Train Accuracy:  0.939, Validation Accuracy:  0.918, Loss:  1.155\n",
      "Epoch   5 Batch    7/538 - Train Accuracy:  0.946, Validation Accuracy:  0.924, Loss:  1.205\n",
      "Epoch   5 Batch    8/538 - Train Accuracy:  0.929, Validation Accuracy:  0.920, Loss:  1.197\n",
      "Epoch   5 Batch    9/538 - Train Accuracy:  0.919, Validation Accuracy:  0.921, Loss:  1.205\n",
      "Epoch   5 Batch   10/538 - Train Accuracy:  0.929, Validation Accuracy:  0.922, Loss:  1.249\n",
      "Epoch   5 Batch   11/538 - Train Accuracy:  0.938, Validation Accuracy:  0.922, Loss:  1.223\n",
      "Epoch   5 Batch   12/538 - Train Accuracy:  0.929, Validation Accuracy:  0.923, Loss:  1.140\n",
      "Epoch   5 Batch   13/538 - Train Accuracy:  0.939, Validation Accuracy:  0.930, Loss:  1.210\n",
      "Epoch   5 Batch   14/538 - Train Accuracy:  0.934, Validation Accuracy:  0.927, Loss:  1.185\n",
      "Epoch   5 Batch   15/538 - Train Accuracy:  0.946, Validation Accuracy:  0.930, Loss:  1.191\n",
      "Epoch   5 Batch   16/538 - Train Accuracy:  0.929, Validation Accuracy:  0.935, Loss:  1.229\n",
      "Epoch   5 Batch   17/538 - Train Accuracy:  0.937, Validation Accuracy:  0.934, Loss:  1.194\n",
      "Epoch   5 Batch   18/538 - Train Accuracy:  0.950, Validation Accuracy:  0.934, Loss:  1.220\n",
      "Epoch   5 Batch   19/538 - Train Accuracy:  0.926, Validation Accuracy:  0.936, Loss:  1.192\n",
      "Epoch   5 Batch   20/538 - Train Accuracy:  0.943, Validation Accuracy:  0.937, Loss:  1.148\n",
      "Epoch   5 Batch   21/538 - Train Accuracy:  0.958, Validation Accuracy:  0.937, Loss:  1.195\n",
      "Epoch   5 Batch   22/538 - Train Accuracy:  0.931, Validation Accuracy:  0.939, Loss:  1.216\n",
      "Epoch   5 Batch   23/538 - Train Accuracy:  0.927, Validation Accuracy:  0.937, Loss:  1.196\n",
      "Epoch   5 Batch   24/538 - Train Accuracy:  0.936, Validation Accuracy:  0.933, Loss:  1.203\n",
      "Epoch   5 Batch   25/538 - Train Accuracy:  0.921, Validation Accuracy:  0.930, Loss:  1.168\n",
      "Epoch   5 Batch   26/538 - Train Accuracy:  0.907, Validation Accuracy:  0.932, Loss:  1.185\n",
      "Epoch   5 Batch   27/538 - Train Accuracy:  0.939, Validation Accuracy:  0.933, Loss:  1.137\n",
      "Epoch   5 Batch   28/538 - Train Accuracy:  0.922, Validation Accuracy:  0.931, Loss:  1.185\n",
      "Epoch   5 Batch   29/538 - Train Accuracy:  0.926, Validation Accuracy:  0.931, Loss:  1.202\n",
      "Epoch   5 Batch   30/538 - Train Accuracy:  0.930, Validation Accuracy:  0.927, Loss:  1.173\n",
      "Epoch   5 Batch   31/538 - Train Accuracy:  0.933, Validation Accuracy:  0.930, Loss:  1.164\n",
      "Epoch   5 Batch   32/538 - Train Accuracy:  0.936, Validation Accuracy:  0.922, Loss:  1.205\n",
      "Epoch   5 Batch   33/538 - Train Accuracy:  0.932, Validation Accuracy:  0.913, Loss:  1.180\n",
      "Epoch   5 Batch   34/538 - Train Accuracy:  0.909, Validation Accuracy:  0.916, Loss:  1.184\n",
      "Epoch   5 Batch   35/538 - Train Accuracy:  0.934, Validation Accuracy:  0.925, Loss:  1.188\n",
      "Epoch   5 Batch   36/538 - Train Accuracy:  0.931, Validation Accuracy:  0.932, Loss:  1.165\n",
      "Epoch   5 Batch   37/538 - Train Accuracy:  0.934, Validation Accuracy:  0.931, Loss:  1.178\n",
      "Epoch   5 Batch   38/538 - Train Accuracy:  0.918, Validation Accuracy:  0.928, Loss:  1.165\n",
      "Epoch   5 Batch   39/538 - Train Accuracy:  0.934, Validation Accuracy:  0.930, Loss:  1.224\n",
      "Epoch   5 Batch   40/538 - Train Accuracy:  0.940, Validation Accuracy:  0.933, Loss:  1.182\n",
      "Epoch   5 Batch   41/538 - Train Accuracy:  0.942, Validation Accuracy:  0.931, Loss:  1.181\n",
      "Epoch   5 Batch   42/538 - Train Accuracy:  0.923, Validation Accuracy:  0.931, Loss:  1.162\n",
      "Epoch   5 Batch   43/538 - Train Accuracy:  0.909, Validation Accuracy:  0.928, Loss:  1.187\n",
      "Epoch   5 Batch   44/538 - Train Accuracy:  0.908, Validation Accuracy:  0.933, Loss:  1.156\n",
      "Epoch   5 Batch   45/538 - Train Accuracy:  0.934, Validation Accuracy:  0.933, Loss:  1.223\n",
      "Epoch   5 Batch   46/538 - Train Accuracy:  0.952, Validation Accuracy:  0.933, Loss:  1.220\n",
      "Epoch   5 Batch   47/538 - Train Accuracy:  0.935, Validation Accuracy:  0.932, Loss:  1.173\n",
      "Epoch   5 Batch   48/538 - Train Accuracy:  0.937, Validation Accuracy:  0.927, Loss:  1.237\n",
      "Epoch   5 Batch   49/538 - Train Accuracy:  0.932, Validation Accuracy:  0.926, Loss:  1.192\n",
      "Epoch   5 Batch   50/538 - Train Accuracy:  0.929, Validation Accuracy:  0.918, Loss:  1.154\n",
      "Epoch   5 Batch   51/538 - Train Accuracy:  0.933, Validation Accuracy:  0.920, Loss:  1.170\n",
      "Epoch   5 Batch   52/538 - Train Accuracy:  0.927, Validation Accuracy:  0.920, Loss:  1.194\n",
      "Epoch   5 Batch   53/538 - Train Accuracy:  0.926, Validation Accuracy:  0.922, Loss:  1.165\n",
      "Epoch   5 Batch   54/538 - Train Accuracy:  0.938, Validation Accuracy:  0.919, Loss:  1.170\n",
      "Epoch   5 Batch   55/538 - Train Accuracy:  0.928, Validation Accuracy:  0.929, Loss:  1.178\n",
      "Epoch   5 Batch   56/538 - Train Accuracy:  0.934, Validation Accuracy:  0.936, Loss:  1.186\n",
      "Epoch   5 Batch   57/538 - Train Accuracy:  0.932, Validation Accuracy:  0.935, Loss:  1.199\n",
      "Epoch   5 Batch   58/538 - Train Accuracy:  0.917, Validation Accuracy:  0.926, Loss:  1.197\n",
      "Epoch   5 Batch   59/538 - Train Accuracy:  0.927, Validation Accuracy:  0.930, Loss:  1.212\n",
      "Epoch   5 Batch   60/538 - Train Accuracy:  0.945, Validation Accuracy:  0.931, Loss:  1.194\n",
      "Epoch   5 Batch   61/538 - Train Accuracy:  0.930, Validation Accuracy:  0.927, Loss:  1.189\n",
      "Epoch   5 Batch   62/538 - Train Accuracy:  0.930, Validation Accuracy:  0.930, Loss:  1.160\n",
      "Epoch   5 Batch   63/538 - Train Accuracy:  0.950, Validation Accuracy:  0.941, Loss:  1.155\n",
      "Epoch   5 Batch   64/538 - Train Accuracy:  0.923, Validation Accuracy:  0.941, Loss:  1.173\n",
      "Epoch   5 Batch   65/538 - Train Accuracy:  0.924, Validation Accuracy:  0.942, Loss:  1.217\n",
      "Epoch   5 Batch   66/538 - Train Accuracy:  0.953, Validation Accuracy:  0.938, Loss:  1.137\n",
      "Epoch   5 Batch   67/538 - Train Accuracy:  0.934, Validation Accuracy:  0.932, Loss:  1.181\n",
      "Epoch   5 Batch   68/538 - Train Accuracy:  0.913, Validation Accuracy:  0.920, Loss:  1.212\n",
      "Epoch   5 Batch   69/538 - Train Accuracy:  0.940, Validation Accuracy:  0.923, Loss:  1.200\n",
      "Epoch   5 Batch   70/538 - Train Accuracy:  0.936, Validation Accuracy:  0.929, Loss:  1.187\n",
      "Epoch   5 Batch   71/538 - Train Accuracy:  0.922, Validation Accuracy:  0.935, Loss:  1.207\n",
      "Epoch   5 Batch   72/538 - Train Accuracy:  0.948, Validation Accuracy:  0.925, Loss:  1.228\n",
      "Epoch   5 Batch   73/538 - Train Accuracy:  0.928, Validation Accuracy:  0.926, Loss:  1.202\n",
      "Epoch   5 Batch   74/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  1.185\n",
      "Epoch   5 Batch   75/538 - Train Accuracy:  0.929, Validation Accuracy:  0.939, Loss:  1.249\n",
      "Epoch   5 Batch   76/538 - Train Accuracy:  0.924, Validation Accuracy:  0.940, Loss:  1.173\n",
      "Epoch   5 Batch   77/538 - Train Accuracy:  0.946, Validation Accuracy:  0.942, Loss:  1.138\n",
      "Epoch   5 Batch   78/538 - Train Accuracy:  0.913, Validation Accuracy:  0.943, Loss:  1.212\n",
      "Epoch   5 Batch   79/538 - Train Accuracy:  0.933, Validation Accuracy:  0.941, Loss:  1.185\n",
      "Epoch   5 Batch   80/538 - Train Accuracy:  0.946, Validation Accuracy:  0.947, Loss:  1.196\n",
      "Epoch   5 Batch   81/538 - Train Accuracy:  0.925, Validation Accuracy:  0.944, Loss:  1.234\n",
      "Epoch   5 Batch   82/538 - Train Accuracy:  0.916, Validation Accuracy:  0.943, Loss:  1.176\n",
      "Epoch   5 Batch   83/538 - Train Accuracy:  0.914, Validation Accuracy:  0.941, Loss:  1.208\n",
      "Epoch   5 Batch   84/538 - Train Accuracy:  0.921, Validation Accuracy:  0.937, Loss:  1.172\n",
      "Epoch   5 Batch   85/538 - Train Accuracy:  0.949, Validation Accuracy:  0.928, Loss:  1.225\n",
      "Epoch   5 Batch   86/538 - Train Accuracy:  0.930, Validation Accuracy:  0.917, Loss:  1.232\n",
      "Epoch   5 Batch   87/538 - Train Accuracy:  0.904, Validation Accuracy:  0.919, Loss:  1.138\n",
      "Epoch   5 Batch   88/538 - Train Accuracy:  0.917, Validation Accuracy:  0.916, Loss:  1.234\n",
      "Epoch   5 Batch   89/538 - Train Accuracy:  0.923, Validation Accuracy:  0.918, Loss:  1.184\n",
      "Epoch   5 Batch   90/538 - Train Accuracy:  0.934, Validation Accuracy:  0.919, Loss:  1.196\n",
      "Epoch   5 Batch   91/538 - Train Accuracy:  0.931, Validation Accuracy:  0.927, Loss:  1.193\n",
      "Epoch   5 Batch   92/538 - Train Accuracy:  0.934, Validation Accuracy:  0.929, Loss:  1.184\n",
      "Epoch   5 Batch   93/538 - Train Accuracy:  0.925, Validation Accuracy:  0.928, Loss:  1.183\n",
      "Epoch   5 Batch   94/538 - Train Accuracy:  0.923, Validation Accuracy:  0.925, Loss:  1.185\n",
      "Epoch   5 Batch   95/538 - Train Accuracy:  0.923, Validation Accuracy:  0.923, Loss:  1.194\n",
      "Epoch   5 Batch   96/538 - Train Accuracy:  0.950, Validation Accuracy:  0.922, Loss:  1.174\n",
      "Epoch   5 Batch   97/538 - Train Accuracy:  0.937, Validation Accuracy:  0.919, Loss:  1.195\n",
      "Epoch   5 Batch   98/538 - Train Accuracy:  0.930, Validation Accuracy:  0.916, Loss:  1.220\n",
      "Epoch   5 Batch   99/538 - Train Accuracy:  0.923, Validation Accuracy:  0.924, Loss:  1.202\n",
      "Epoch   5 Batch  100/538 - Train Accuracy:  0.951, Validation Accuracy:  0.928, Loss:  1.191\n",
      "Epoch   5 Batch  101/538 - Train Accuracy:  0.929, Validation Accuracy:  0.925, Loss:  1.237\n",
      "Epoch   5 Batch  102/538 - Train Accuracy:  0.942, Validation Accuracy:  0.926, Loss:  1.201\n",
      "Epoch   5 Batch  103/538 - Train Accuracy:  0.948, Validation Accuracy:  0.922, Loss:  1.223\n",
      "Epoch   5 Batch  104/538 - Train Accuracy:  0.936, Validation Accuracy:  0.929, Loss:  1.209\n",
      "Epoch   5 Batch  105/538 - Train Accuracy:  0.940, Validation Accuracy:  0.926, Loss:  1.186\n",
      "Epoch   5 Batch  106/538 - Train Accuracy:  0.922, Validation Accuracy:  0.928, Loss:  1.193\n",
      "Epoch   5 Batch  107/538 - Train Accuracy:  0.916, Validation Accuracy:  0.929, Loss:  1.219\n",
      "Epoch   5 Batch  108/538 - Train Accuracy:  0.940, Validation Accuracy:  0.924, Loss:  1.191\n",
      "Epoch   5 Batch  109/538 - Train Accuracy:  0.944, Validation Accuracy:  0.930, Loss:  1.222\n",
      "Epoch   5 Batch  110/538 - Train Accuracy:  0.938, Validation Accuracy:  0.925, Loss:  1.159\n",
      "Epoch   5 Batch  111/538 - Train Accuracy:  0.939, Validation Accuracy:  0.932, Loss:  1.244\n",
      "Epoch   5 Batch  112/538 - Train Accuracy:  0.934, Validation Accuracy:  0.936, Loss:  1.184\n",
      "Epoch   5 Batch  113/538 - Train Accuracy:  0.910, Validation Accuracy:  0.934, Loss:  1.232\n",
      "Epoch   5 Batch  114/538 - Train Accuracy:  0.943, Validation Accuracy:  0.931, Loss:  1.169\n",
      "Epoch   5 Batch  115/538 - Train Accuracy:  0.942, Validation Accuracy:  0.930, Loss:  1.178\n",
      "Epoch   5 Batch  116/538 - Train Accuracy:  0.929, Validation Accuracy:  0.929, Loss:  1.190\n",
      "Epoch   5 Batch  117/538 - Train Accuracy:  0.930, Validation Accuracy:  0.931, Loss:  1.194\n",
      "Epoch   5 Batch  118/538 - Train Accuracy:  0.936, Validation Accuracy:  0.932, Loss:  1.203\n",
      "Epoch   5 Batch  119/538 - Train Accuracy:  0.959, Validation Accuracy:  0.934, Loss:  1.166\n",
      "Epoch   5 Batch  120/538 - Train Accuracy:  0.944, Validation Accuracy:  0.931, Loss:  1.182\n",
      "Epoch   5 Batch  121/538 - Train Accuracy:  0.947, Validation Accuracy:  0.927, Loss:  1.191\n",
      "Epoch   5 Batch  122/538 - Train Accuracy:  0.938, Validation Accuracy:  0.929, Loss:  1.187\n",
      "Epoch   5 Batch  123/538 - Train Accuracy:  0.935, Validation Accuracy:  0.924, Loss:  1.143\n",
      "Epoch   5 Batch  124/538 - Train Accuracy:  0.939, Validation Accuracy:  0.926, Loss:  1.159\n",
      "Epoch   5 Batch  125/538 - Train Accuracy:  0.951, Validation Accuracy:  0.928, Loss:  1.244\n",
      "Epoch   5 Batch  126/538 - Train Accuracy:  0.926, Validation Accuracy:  0.927, Loss:  1.228\n",
      "Epoch   5 Batch  127/538 - Train Accuracy:  0.914, Validation Accuracy:  0.928, Loss:  1.246\n",
      "Epoch   5 Batch  128/538 - Train Accuracy:  0.938, Validation Accuracy:  0.928, Loss:  1.176\n",
      "Epoch   5 Batch  129/538 - Train Accuracy:  0.940, Validation Accuracy:  0.929, Loss:  1.160\n",
      "Epoch   5 Batch  130/538 - Train Accuracy:  0.932, Validation Accuracy:  0.923, Loss:  1.190\n",
      "Epoch   5 Batch  131/538 - Train Accuracy:  0.955, Validation Accuracy:  0.926, Loss:  1.215\n",
      "Epoch   5 Batch  132/538 - Train Accuracy:  0.912, Validation Accuracy:  0.934, Loss:  1.140\n",
      "Epoch   5 Batch  133/538 - Train Accuracy:  0.933, Validation Accuracy:  0.939, Loss:  1.208\n",
      "Epoch   5 Batch  134/538 - Train Accuracy:  0.925, Validation Accuracy:  0.932, Loss:  1.187\n",
      "Epoch   5 Batch  135/538 - Train Accuracy:  0.935, Validation Accuracy:  0.931, Loss:  1.166\n",
      "Epoch   5 Batch  136/538 - Train Accuracy:  0.934, Validation Accuracy:  0.930, Loss:  1.231\n",
      "Epoch   5 Batch  137/538 - Train Accuracy:  0.926, Validation Accuracy:  0.928, Loss:  1.223\n",
      "Epoch   5 Batch  138/538 - Train Accuracy:  0.930, Validation Accuracy:  0.933, Loss:  1.198\n",
      "Epoch   5 Batch  139/538 - Train Accuracy:  0.932, Validation Accuracy:  0.921, Loss:  1.195\n",
      "Epoch   5 Batch  140/538 - Train Accuracy:  0.920, Validation Accuracy:  0.921, Loss:  1.212\n",
      "Epoch   5 Batch  141/538 - Train Accuracy:  0.945, Validation Accuracy:  0.919, Loss:  1.205\n",
      "Epoch   5 Batch  142/538 - Train Accuracy:  0.939, Validation Accuracy:  0.925, Loss:  1.184\n",
      "Epoch   5 Batch  143/538 - Train Accuracy:  0.943, Validation Accuracy:  0.934, Loss:  1.189\n",
      "Epoch   5 Batch  144/538 - Train Accuracy:  0.938, Validation Accuracy:  0.936, Loss:  1.127\n",
      "Epoch   5 Batch  145/538 - Train Accuracy:  0.928, Validation Accuracy:  0.941, Loss:  1.226\n",
      "Epoch   5 Batch  146/538 - Train Accuracy:  0.943, Validation Accuracy:  0.945, Loss:  1.160\n",
      "Epoch   5 Batch  147/538 - Train Accuracy:  0.936, Validation Accuracy:  0.943, Loss:  1.235\n",
      "Epoch   5 Batch  148/538 - Train Accuracy:  0.906, Validation Accuracy:  0.943, Loss:  1.176\n",
      "Epoch   5 Batch  149/538 - Train Accuracy:  0.937, Validation Accuracy:  0.940, Loss:  1.183\n",
      "Epoch   5 Batch  150/538 - Train Accuracy:  0.945, Validation Accuracy:  0.939, Loss:  1.179\n",
      "Epoch   5 Batch  151/538 - Train Accuracy:  0.939, Validation Accuracy:  0.935, Loss:  1.139\n",
      "Epoch   5 Batch  152/538 - Train Accuracy:  0.954, Validation Accuracy:  0.933, Loss:  1.177\n",
      "Epoch   5 Batch  153/538 - Train Accuracy:  0.920, Validation Accuracy:  0.932, Loss:  1.151\n",
      "Epoch   5 Batch  154/538 - Train Accuracy:  0.934, Validation Accuracy:  0.931, Loss:  1.166\n",
      "Epoch   5 Batch  155/538 - Train Accuracy:  0.926, Validation Accuracy:  0.926, Loss:  1.206\n",
      "Epoch   5 Batch  156/538 - Train Accuracy:  0.945, Validation Accuracy:  0.926, Loss:  1.201\n",
      "Epoch   5 Batch  157/538 - Train Accuracy:  0.945, Validation Accuracy:  0.928, Loss:  1.203\n",
      "Epoch   5 Batch  158/538 - Train Accuracy:  0.937, Validation Accuracy:  0.928, Loss:  1.211\n",
      "Epoch   5 Batch  159/538 - Train Accuracy:  0.941, Validation Accuracy:  0.929, Loss:  1.181\n",
      "Epoch   5 Batch  160/538 - Train Accuracy:  0.914, Validation Accuracy:  0.923, Loss:  1.183\n",
      "Epoch   5 Batch  161/538 - Train Accuracy:  0.934, Validation Accuracy:  0.916, Loss:  1.164\n",
      "Epoch   5 Batch  162/538 - Train Accuracy:  0.936, Validation Accuracy:  0.933, Loss:  1.186\n",
      "Epoch   5 Batch  163/538 - Train Accuracy:  0.943, Validation Accuracy:  0.930, Loss:  1.219\n",
      "Epoch   5 Batch  164/538 - Train Accuracy:  0.929, Validation Accuracy:  0.932, Loss:  1.154\n",
      "Epoch   5 Batch  165/538 - Train Accuracy:  0.920, Validation Accuracy:  0.925, Loss:  1.169\n",
      "Epoch   5 Batch  166/538 - Train Accuracy:  0.955, Validation Accuracy:  0.923, Loss:  1.191\n",
      "Epoch   5 Batch  167/538 - Train Accuracy:  0.939, Validation Accuracy:  0.921, Loss:  1.202\n",
      "Epoch   5 Batch  168/538 - Train Accuracy:  0.912, Validation Accuracy:  0.928, Loss:  1.198\n",
      "Epoch   5 Batch  169/538 - Train Accuracy:  0.942, Validation Accuracy:  0.925, Loss:  1.196\n",
      "Epoch   5 Batch  170/538 - Train Accuracy:  0.931, Validation Accuracy:  0.922, Loss:  1.173\n",
      "Epoch   5 Batch  171/538 - Train Accuracy:  0.915, Validation Accuracy:  0.928, Loss:  1.178\n",
      "Epoch   5 Batch  172/538 - Train Accuracy:  0.934, Validation Accuracy:  0.924, Loss:  1.182\n",
      "Epoch   5 Batch  173/538 - Train Accuracy:  0.940, Validation Accuracy:  0.920, Loss:  1.156\n",
      "Epoch   5 Batch  174/538 - Train Accuracy:  0.942, Validation Accuracy:  0.922, Loss:  1.199\n",
      "Epoch   5 Batch  175/538 - Train Accuracy:  0.951, Validation Accuracy:  0.922, Loss:  1.167\n",
      "Epoch   5 Batch  176/538 - Train Accuracy:  0.906, Validation Accuracy:  0.925, Loss:  1.210\n",
      "Epoch   5 Batch  177/538 - Train Accuracy:  0.938, Validation Accuracy:  0.925, Loss:  1.192\n",
      "Epoch   5 Batch  178/538 - Train Accuracy:  0.923, Validation Accuracy:  0.932, Loss:  1.167\n",
      "Epoch   5 Batch  179/538 - Train Accuracy:  0.928, Validation Accuracy:  0.935, Loss:  1.157\n",
      "Epoch   5 Batch  180/538 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  1.138\n",
      "Epoch   5 Batch  181/538 - Train Accuracy:  0.929, Validation Accuracy:  0.937, Loss:  1.171\n",
      "Epoch   5 Batch  182/538 - Train Accuracy:  0.954, Validation Accuracy:  0.936, Loss:  1.176\n",
      "Epoch   5 Batch  183/538 - Train Accuracy:  0.962, Validation Accuracy:  0.942, Loss:  1.119\n",
      "Epoch   5 Batch  184/538 - Train Accuracy:  0.948, Validation Accuracy:  0.945, Loss:  1.171\n",
      "Epoch   5 Batch  185/538 - Train Accuracy:  0.949, Validation Accuracy:  0.939, Loss:  1.170\n",
      "Epoch   5 Batch  186/538 - Train Accuracy:  0.941, Validation Accuracy:  0.938, Loss:  1.159\n",
      "Epoch   5 Batch  187/538 - Train Accuracy:  0.945, Validation Accuracy:  0.937, Loss:  1.150\n",
      "Epoch   5 Batch  188/538 - Train Accuracy:  0.937, Validation Accuracy:  0.944, Loss:  1.189\n",
      "Epoch   5 Batch  189/538 - Train Accuracy:  0.940, Validation Accuracy:  0.942, Loss:  1.178\n",
      "Epoch   5 Batch  190/538 - Train Accuracy:  0.924, Validation Accuracy:  0.944, Loss:  1.223\n",
      "Epoch   5 Batch  191/538 - Train Accuracy:  0.951, Validation Accuracy:  0.948, Loss:  1.188\n",
      "Epoch   5 Batch  192/538 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  1.184\n",
      "Epoch   5 Batch  193/538 - Train Accuracy:  0.948, Validation Accuracy:  0.948, Loss:  1.226\n",
      "Epoch   5 Batch  194/538 - Train Accuracy:  0.928, Validation Accuracy:  0.945, Loss:  1.214\n",
      "Epoch   5 Batch  195/538 - Train Accuracy:  0.946, Validation Accuracy:  0.946, Loss:  1.220\n",
      "Epoch   5 Batch  196/538 - Train Accuracy:  0.928, Validation Accuracy:  0.943, Loss:  1.190\n",
      "Epoch   5 Batch  197/538 - Train Accuracy:  0.946, Validation Accuracy:  0.938, Loss:  1.207\n",
      "Epoch   5 Batch  198/538 - Train Accuracy:  0.945, Validation Accuracy:  0.936, Loss:  1.159\n",
      "Epoch   5 Batch  199/538 - Train Accuracy:  0.938, Validation Accuracy:  0.931, Loss:  1.147\n",
      "Epoch   5 Batch  200/538 - Train Accuracy:  0.929, Validation Accuracy:  0.929, Loss:  1.182\n",
      "Epoch   5 Batch  201/538 - Train Accuracy:  0.933, Validation Accuracy:  0.939, Loss:  1.193\n",
      "Epoch   5 Batch  202/538 - Train Accuracy:  0.944, Validation Accuracy:  0.937, Loss:  1.163\n",
      "Epoch   5 Batch  203/538 - Train Accuracy:  0.925, Validation Accuracy:  0.935, Loss:  1.221\n",
      "Epoch   5 Batch  204/538 - Train Accuracy:  0.929, Validation Accuracy:  0.932, Loss:  1.202\n",
      "Epoch   5 Batch  205/538 - Train Accuracy:  0.932, Validation Accuracy:  0.933, Loss:  1.196\n",
      "Epoch   5 Batch  206/538 - Train Accuracy:  0.926, Validation Accuracy:  0.942, Loss:  1.182\n",
      "Epoch   5 Batch  207/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  1.200\n",
      "Epoch   5 Batch  208/538 - Train Accuracy:  0.923, Validation Accuracy:  0.940, Loss:  1.216\n",
      "Epoch   5 Batch  209/538 - Train Accuracy:  0.952, Validation Accuracy:  0.940, Loss:  1.158\n",
      "Epoch   5 Batch  210/538 - Train Accuracy:  0.925, Validation Accuracy:  0.942, Loss:  1.201\n",
      "Epoch   5 Batch  211/538 - Train Accuracy:  0.932, Validation Accuracy:  0.941, Loss:  1.169\n",
      "Epoch   5 Batch  212/538 - Train Accuracy:  0.937, Validation Accuracy:  0.947, Loss:  1.207\n",
      "Epoch   5 Batch  213/538 - Train Accuracy:  0.943, Validation Accuracy:  0.944, Loss:  1.177\n",
      "Epoch   5 Batch  214/538 - Train Accuracy:  0.942, Validation Accuracy:  0.947, Loss:  1.181\n",
      "Epoch   5 Batch  215/538 - Train Accuracy:  0.954, Validation Accuracy:  0.945, Loss:  1.168\n",
      "Epoch   5 Batch  216/538 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  1.160\n",
      "Epoch   5 Batch  217/538 - Train Accuracy:  0.941, Validation Accuracy:  0.944, Loss:  1.184\n",
      "Epoch   5 Batch  218/538 - Train Accuracy:  0.938, Validation Accuracy:  0.935, Loss:  1.234\n",
      "Epoch   5 Batch  219/538 - Train Accuracy:  0.920, Validation Accuracy:  0.931, Loss:  1.197\n",
      "Epoch   5 Batch  220/538 - Train Accuracy:  0.921, Validation Accuracy:  0.929, Loss:  1.175\n",
      "Epoch   5 Batch  221/538 - Train Accuracy:  0.946, Validation Accuracy:  0.929, Loss:  1.183\n",
      "Epoch   5 Batch  222/538 - Train Accuracy:  0.926, Validation Accuracy:  0.930, Loss:  1.178\n",
      "Epoch   5 Batch  223/538 - Train Accuracy:  0.926, Validation Accuracy:  0.938, Loss:  1.219\n",
      "Epoch   5 Batch  224/538 - Train Accuracy:  0.931, Validation Accuracy:  0.935, Loss:  1.182\n",
      "Epoch   5 Batch  225/538 - Train Accuracy:  0.952, Validation Accuracy:  0.933, Loss:  1.188\n",
      "Epoch   5 Batch  226/538 - Train Accuracy:  0.937, Validation Accuracy:  0.926, Loss:  1.179\n",
      "Epoch   5 Batch  227/538 - Train Accuracy:  0.941, Validation Accuracy:  0.916, Loss:  1.175\n",
      "Epoch   5 Batch  228/538 - Train Accuracy:  0.922, Validation Accuracy:  0.922, Loss:  1.169\n",
      "Epoch   5 Batch  229/538 - Train Accuracy:  0.936, Validation Accuracy:  0.933, Loss:  1.140\n",
      "Epoch   5 Batch  230/538 - Train Accuracy:  0.922, Validation Accuracy:  0.939, Loss:  1.177\n",
      "Epoch   5 Batch  231/538 - Train Accuracy:  0.938, Validation Accuracy:  0.940, Loss:  1.181\n",
      "Epoch   5 Batch  232/538 - Train Accuracy:  0.926, Validation Accuracy:  0.938, Loss:  1.156\n",
      "Epoch   5 Batch  233/538 - Train Accuracy:  0.951, Validation Accuracy:  0.939, Loss:  1.159\n",
      "Epoch   5 Batch  234/538 - Train Accuracy:  0.956, Validation Accuracy:  0.938, Loss:  1.154\n",
      "Epoch   5 Batch  235/538 - Train Accuracy:  0.960, Validation Accuracy:  0.937, Loss:  1.173\n",
      "Epoch   5 Batch  236/538 - Train Accuracy:  0.934, Validation Accuracy:  0.932, Loss:  1.175\n",
      "Epoch   5 Batch  237/538 - Train Accuracy:  0.933, Validation Accuracy:  0.930, Loss:  1.192\n",
      "Epoch   5 Batch  238/538 - Train Accuracy:  0.953, Validation Accuracy:  0.932, Loss:  1.145\n",
      "Epoch   5 Batch  239/538 - Train Accuracy:  0.936, Validation Accuracy:  0.938, Loss:  1.203\n",
      "Epoch   5 Batch  240/538 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  1.194\n",
      "Epoch   5 Batch  241/538 - Train Accuracy:  0.926, Validation Accuracy:  0.939, Loss:  1.160\n",
      "Epoch   5 Batch  242/538 - Train Accuracy:  0.947, Validation Accuracy:  0.937, Loss:  1.213\n",
      "Epoch   5 Batch  243/538 - Train Accuracy:  0.951, Validation Accuracy:  0.937, Loss:  1.195\n",
      "Epoch   5 Batch  244/538 - Train Accuracy:  0.928, Validation Accuracy:  0.936, Loss:  1.122\n",
      "Epoch   5 Batch  245/538 - Train Accuracy:  0.933, Validation Accuracy:  0.927, Loss:  1.186\n",
      "Epoch   5 Batch  246/538 - Train Accuracy:  0.940, Validation Accuracy:  0.928, Loss:  1.135\n",
      "Epoch   5 Batch  247/538 - Train Accuracy:  0.936, Validation Accuracy:  0.928, Loss:  1.171\n",
      "Epoch   5 Batch  248/538 - Train Accuracy:  0.942, Validation Accuracy:  0.931, Loss:  1.207\n",
      "Epoch   5 Batch  249/538 - Train Accuracy:  0.938, Validation Accuracy:  0.931, Loss:  1.163\n",
      "Epoch   5 Batch  250/538 - Train Accuracy:  0.939, Validation Accuracy:  0.931, Loss:  1.171\n",
      "Epoch   5 Batch  251/538 - Train Accuracy:  0.941, Validation Accuracy:  0.935, Loss:  1.161\n",
      "Epoch   5 Batch  252/538 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  1.220\n",
      "Epoch   5 Batch  253/538 - Train Accuracy:  0.905, Validation Accuracy:  0.943, Loss:  1.161\n",
      "Epoch   5 Batch  254/538 - Train Accuracy:  0.922, Validation Accuracy:  0.941, Loss:  1.185\n",
      "Epoch   5 Batch  255/538 - Train Accuracy:  0.955, Validation Accuracy:  0.941, Loss:  1.174\n",
      "Epoch   5 Batch  256/538 - Train Accuracy:  0.926, Validation Accuracy:  0.935, Loss:  1.173\n",
      "Epoch   5 Batch  257/538 - Train Accuracy:  0.944, Validation Accuracy:  0.923, Loss:  1.174\n",
      "Epoch   5 Batch  258/538 - Train Accuracy:  0.935, Validation Accuracy:  0.929, Loss:  1.253\n",
      "Epoch   5 Batch  259/538 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  1.196\n",
      "Epoch   5 Batch  260/538 - Train Accuracy:  0.915, Validation Accuracy:  0.940, Loss:  1.218\n",
      "Epoch   5 Batch  261/538 - Train Accuracy:  0.938, Validation Accuracy:  0.939, Loss:  1.204\n",
      "Epoch   5 Batch  262/538 - Train Accuracy:  0.957, Validation Accuracy:  0.936, Loss:  1.171\n",
      "Epoch   5 Batch  263/538 - Train Accuracy:  0.921, Validation Accuracy:  0.935, Loss:  1.164\n",
      "Epoch   5 Batch  264/538 - Train Accuracy:  0.927, Validation Accuracy:  0.933, Loss:  1.169\n",
      "Epoch   5 Batch  265/538 - Train Accuracy:  0.922, Validation Accuracy:  0.923, Loss:  1.237\n",
      "Epoch   5 Batch  266/538 - Train Accuracy:  0.936, Validation Accuracy:  0.931, Loss:  1.175\n",
      "Epoch   5 Batch  267/538 - Train Accuracy:  0.931, Validation Accuracy:  0.932, Loss:  1.163\n",
      "Epoch   5 Batch  268/538 - Train Accuracy:  0.962, Validation Accuracy:  0.936, Loss:  1.153\n",
      "Epoch   5 Batch  269/538 - Train Accuracy:  0.952, Validation Accuracy:  0.935, Loss:  1.144\n",
      "Epoch   5 Batch  270/538 - Train Accuracy:  0.940, Validation Accuracy:  0.939, Loss:  1.142\n",
      "Epoch   5 Batch  271/538 - Train Accuracy:  0.929, Validation Accuracy:  0.937, Loss:  1.195\n",
      "Epoch   5 Batch  272/538 - Train Accuracy:  0.933, Validation Accuracy:  0.940, Loss:  1.139\n",
      "Epoch   5 Batch  273/538 - Train Accuracy:  0.934, Validation Accuracy:  0.942, Loss:  1.241\n",
      "Epoch   5 Batch  274/538 - Train Accuracy:  0.916, Validation Accuracy:  0.945, Loss:  1.194\n",
      "Epoch   5 Batch  275/538 - Train Accuracy:  0.952, Validation Accuracy:  0.943, Loss:  1.193\n",
      "Epoch   5 Batch  276/538 - Train Accuracy:  0.927, Validation Accuracy:  0.942, Loss:  1.182\n",
      "Epoch   5 Batch  277/538 - Train Accuracy:  0.950, Validation Accuracy:  0.938, Loss:  1.194\n",
      "Epoch   5 Batch  278/538 - Train Accuracy:  0.935, Validation Accuracy:  0.941, Loss:  1.151\n",
      "Epoch   5 Batch  279/538 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  1.192\n",
      "Epoch   5 Batch  280/538 - Train Accuracy:  0.958, Validation Accuracy:  0.946, Loss:  1.189\n",
      "Epoch   5 Batch  281/538 - Train Accuracy:  0.937, Validation Accuracy:  0.945, Loss:  1.182\n",
      "Epoch   5 Batch  282/538 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  1.163\n",
      "Epoch   5 Batch  283/538 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  1.191\n",
      "Epoch   5 Batch  284/538 - Train Accuracy:  0.928, Validation Accuracy:  0.951, Loss:  1.108\n",
      "Epoch   5 Batch  285/538 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  1.230\n",
      "Epoch   5 Batch  286/538 - Train Accuracy:  0.935, Validation Accuracy:  0.945, Loss:  1.228\n",
      "Epoch   5 Batch  287/538 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  1.156\n",
      "Epoch   5 Batch  288/538 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  1.185\n",
      "Epoch   5 Batch  289/538 - Train Accuracy:  0.944, Validation Accuracy:  0.945, Loss:  1.193\n",
      "Epoch   5 Batch  290/538 - Train Accuracy:  0.958, Validation Accuracy:  0.942, Loss:  1.197\n",
      "Epoch   5 Batch  291/538 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  1.203\n",
      "Epoch   5 Batch  292/538 - Train Accuracy:  0.958, Validation Accuracy:  0.940, Loss:  1.162\n",
      "Epoch   5 Batch  293/538 - Train Accuracy:  0.942, Validation Accuracy:  0.939, Loss:  1.119\n",
      "Epoch   5 Batch  294/538 - Train Accuracy:  0.927, Validation Accuracy:  0.931, Loss:  1.179\n",
      "Epoch   5 Batch  295/538 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  1.192\n",
      "Epoch   5 Batch  296/538 - Train Accuracy:  0.921, Validation Accuracy:  0.943, Loss:  1.190\n",
      "Epoch   5 Batch  297/538 - Train Accuracy:  0.951, Validation Accuracy:  0.951, Loss:  1.169\n",
      "Epoch   5 Batch  298/538 - Train Accuracy:  0.936, Validation Accuracy:  0.948, Loss:  1.167\n",
      "Epoch   5 Batch  299/538 - Train Accuracy:  0.926, Validation Accuracy:  0.945, Loss:  1.188\n",
      "Epoch   5 Batch  300/538 - Train Accuracy:  0.938, Validation Accuracy:  0.949, Loss:  1.201\n",
      "Epoch   5 Batch  301/538 - Train Accuracy:  0.929, Validation Accuracy:  0.948, Loss:  1.200\n",
      "Epoch   5 Batch  302/538 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  1.189\n",
      "Epoch   5 Batch  303/538 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  1.198\n",
      "Epoch   5 Batch  304/538 - Train Accuracy:  0.942, Validation Accuracy:  0.944, Loss:  1.168\n",
      "Epoch   5 Batch  305/538 - Train Accuracy:  0.958, Validation Accuracy:  0.943, Loss:  1.148\n",
      "Epoch   5 Batch  306/538 - Train Accuracy:  0.935, Validation Accuracy:  0.943, Loss:  1.192\n",
      "Epoch   5 Batch  307/538 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  1.160\n",
      "Epoch   5 Batch  308/538 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  1.137\n",
      "Epoch   5 Batch  309/538 - Train Accuracy:  0.955, Validation Accuracy:  0.952, Loss:  1.225\n",
      "Epoch   5 Batch  310/538 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  1.157\n",
      "Epoch   5 Batch  311/538 - Train Accuracy:  0.920, Validation Accuracy:  0.947, Loss:  1.185\n",
      "Epoch   5 Batch  312/538 - Train Accuracy:  0.944, Validation Accuracy:  0.946, Loss:  1.164\n",
      "Epoch   5 Batch  313/538 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  1.190\n",
      "Epoch   5 Batch  314/538 - Train Accuracy:  0.949, Validation Accuracy:  0.942, Loss:  1.150\n",
      "Epoch   5 Batch  315/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  1.210\n",
      "Epoch   5 Batch  316/538 - Train Accuracy:  0.929, Validation Accuracy:  0.944, Loss:  1.174\n",
      "Epoch   5 Batch  317/538 - Train Accuracy:  0.942, Validation Accuracy:  0.942, Loss:  1.134\n",
      "Epoch   5 Batch  318/538 - Train Accuracy:  0.940, Validation Accuracy:  0.941, Loss:  1.182\n",
      "Epoch   5 Batch  319/538 - Train Accuracy:  0.943, Validation Accuracy:  0.939, Loss:  1.221\n",
      "Epoch   5 Batch  320/538 - Train Accuracy:  0.941, Validation Accuracy:  0.940, Loss:  1.152\n",
      "Epoch   5 Batch  321/538 - Train Accuracy:  0.928, Validation Accuracy:  0.934, Loss:  1.164\n",
      "Epoch   5 Batch  322/538 - Train Accuracy:  0.943, Validation Accuracy:  0.938, Loss:  1.205\n",
      "Epoch   5 Batch  323/538 - Train Accuracy:  0.953, Validation Accuracy:  0.936, Loss:  1.155\n",
      "Epoch   5 Batch  324/538 - Train Accuracy:  0.943, Validation Accuracy:  0.944, Loss:  1.176\n",
      "Epoch   5 Batch  325/538 - Train Accuracy:  0.944, Validation Accuracy:  0.947, Loss:  1.171\n",
      "Epoch   5 Batch  326/538 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  1.133\n",
      "Epoch   5 Batch  327/538 - Train Accuracy:  0.939, Validation Accuracy:  0.950, Loss:  1.219\n",
      "Epoch   5 Batch  328/538 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  1.171\n",
      "Epoch   5 Batch  329/538 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  1.160\n",
      "Epoch   5 Batch  330/538 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  1.184\n",
      "Epoch   5 Batch  331/538 - Train Accuracy:  0.936, Validation Accuracy:  0.944, Loss:  1.163\n",
      "Epoch   5 Batch  332/538 - Train Accuracy:  0.941, Validation Accuracy:  0.945, Loss:  1.161\n",
      "Epoch   5 Batch  333/538 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  1.170\n",
      "Epoch   5 Batch  334/538 - Train Accuracy:  0.947, Validation Accuracy:  0.950, Loss:  1.198\n",
      "Epoch   5 Batch  335/538 - Train Accuracy:  0.934, Validation Accuracy:  0.951, Loss:  1.199\n",
      "Epoch   5 Batch  336/538 - Train Accuracy:  0.936, Validation Accuracy:  0.948, Loss:  1.201\n",
      "Epoch   5 Batch  337/538 - Train Accuracy:  0.937, Validation Accuracy:  0.952, Loss:  1.220\n",
      "Epoch   5 Batch  338/538 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  1.170\n",
      "Epoch   5 Batch  339/538 - Train Accuracy:  0.929, Validation Accuracy:  0.946, Loss:  1.160\n",
      "Epoch   5 Batch  340/538 - Train Accuracy:  0.924, Validation Accuracy:  0.940, Loss:  1.159\n",
      "Epoch   5 Batch  341/538 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  1.100\n",
      "Epoch   5 Batch  342/538 - Train Accuracy:  0.925, Validation Accuracy:  0.938, Loss:  1.206\n",
      "Epoch   5 Batch  343/538 - Train Accuracy:  0.945, Validation Accuracy:  0.939, Loss:  1.159\n",
      "Epoch   5 Batch  344/538 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  1.214\n",
      "Epoch   5 Batch  345/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  1.161\n",
      "Epoch   5 Batch  346/538 - Train Accuracy:  0.933, Validation Accuracy:  0.944, Loss:  1.225\n",
      "Epoch   5 Batch  347/538 - Train Accuracy:  0.945, Validation Accuracy:  0.949, Loss:  1.195\n",
      "Epoch   5 Batch  348/538 - Train Accuracy:  0.945, Validation Accuracy:  0.944, Loss:  1.143\n",
      "Epoch   5 Batch  349/538 - Train Accuracy:  0.952, Validation Accuracy:  0.946, Loss:  1.187\n",
      "Epoch   5 Batch  350/538 - Train Accuracy:  0.952, Validation Accuracy:  0.946, Loss:  1.120\n",
      "Epoch   5 Batch  351/538 - Train Accuracy:  0.939, Validation Accuracy:  0.951, Loss:  1.178\n",
      "Epoch   5 Batch  352/538 - Train Accuracy:  0.925, Validation Accuracy:  0.950, Loss:  1.186\n",
      "Epoch   5 Batch  353/538 - Train Accuracy:  0.928, Validation Accuracy:  0.944, Loss:  1.146\n",
      "Epoch   5 Batch  354/538 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  1.162\n",
      "Epoch   5 Batch  355/538 - Train Accuracy:  0.954, Validation Accuracy:  0.938, Loss:  1.162\n",
      "Epoch   5 Batch  356/538 - Train Accuracy:  0.946, Validation Accuracy:  0.936, Loss:  1.139\n",
      "Epoch   5 Batch  357/538 - Train Accuracy:  0.952, Validation Accuracy:  0.935, Loss:  1.226\n",
      "Epoch   5 Batch  358/538 - Train Accuracy:  0.952, Validation Accuracy:  0.941, Loss:  1.220\n",
      "Epoch   5 Batch  359/538 - Train Accuracy:  0.928, Validation Accuracy:  0.944, Loss:  1.181\n",
      "Epoch   5 Batch  360/538 - Train Accuracy:  0.940, Validation Accuracy:  0.943, Loss:  1.208\n",
      "Epoch   5 Batch  361/538 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  1.175\n",
      "Epoch   5 Batch  362/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  1.189\n",
      "Epoch   5 Batch  363/538 - Train Accuracy:  0.944, Validation Accuracy:  0.945, Loss:  1.183\n",
      "Epoch   5 Batch  364/538 - Train Accuracy:  0.928, Validation Accuracy:  0.953, Loss:  1.168\n",
      "Epoch   5 Batch  365/538 - Train Accuracy:  0.939, Validation Accuracy:  0.945, Loss:  1.188\n",
      "Epoch   5 Batch  366/538 - Train Accuracy:  0.936, Validation Accuracy:  0.940, Loss:  1.172\n",
      "Epoch   5 Batch  367/538 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  1.216\n",
      "Epoch   5 Batch  368/538 - Train Accuracy:  0.952, Validation Accuracy:  0.942, Loss:  1.144\n",
      "Epoch   5 Batch  369/538 - Train Accuracy:  0.952, Validation Accuracy:  0.938, Loss:  1.154\n",
      "Epoch   5 Batch  370/538 - Train Accuracy:  0.946, Validation Accuracy:  0.943, Loss:  1.219\n",
      "Epoch   5 Batch  371/538 - Train Accuracy:  0.946, Validation Accuracy:  0.941, Loss:  1.187\n",
      "Epoch   5 Batch  372/538 - Train Accuracy:  0.940, Validation Accuracy:  0.939, Loss:  1.242\n",
      "Epoch   5 Batch  373/538 - Train Accuracy:  0.937, Validation Accuracy:  0.938, Loss:  1.162\n",
      "Epoch   5 Batch  374/538 - Train Accuracy:  0.950, Validation Accuracy:  0.934, Loss:  1.138\n",
      "Epoch   5 Batch  375/538 - Train Accuracy:  0.948, Validation Accuracy:  0.938, Loss:  1.159\n",
      "Epoch   5 Batch  376/538 - Train Accuracy:  0.937, Validation Accuracy:  0.940, Loss:  1.165\n",
      "Epoch   5 Batch  377/538 - Train Accuracy:  0.948, Validation Accuracy:  0.940, Loss:  1.135\n",
      "Epoch   5 Batch  378/538 - Train Accuracy:  0.934, Validation Accuracy:  0.942, Loss:  1.166\n",
      "Epoch   5 Batch  379/538 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  1.189\n",
      "Epoch   5 Batch  380/538 - Train Accuracy:  0.946, Validation Accuracy:  0.941, Loss:  1.131\n",
      "Epoch   5 Batch  381/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  1.186\n",
      "Epoch   5 Batch  382/538 - Train Accuracy:  0.931, Validation Accuracy:  0.942, Loss:  1.159\n",
      "Epoch   5 Batch  383/538 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  1.131\n",
      "Epoch   5 Batch  384/538 - Train Accuracy:  0.930, Validation Accuracy:  0.946, Loss:  1.186\n",
      "Epoch   5 Batch  385/538 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  1.183\n",
      "Epoch   5 Batch  386/538 - Train Accuracy:  0.939, Validation Accuracy:  0.946, Loss:  1.155\n",
      "Epoch   5 Batch  387/538 - Train Accuracy:  0.937, Validation Accuracy:  0.948, Loss:  1.127\n",
      "Epoch   5 Batch  388/538 - Train Accuracy:  0.942, Validation Accuracy:  0.953, Loss:  1.160\n",
      "Epoch   5 Batch  389/538 - Train Accuracy:  0.942, Validation Accuracy:  0.951, Loss:  1.208\n",
      "Epoch   5 Batch  390/538 - Train Accuracy:  0.951, Validation Accuracy:  0.950, Loss:  1.165\n",
      "Epoch   5 Batch  391/538 - Train Accuracy:  0.938, Validation Accuracy:  0.946, Loss:  1.175\n",
      "Epoch   5 Batch  392/538 - Train Accuracy:  0.950, Validation Accuracy:  0.947, Loss:  1.198\n",
      "Epoch   5 Batch  393/538 - Train Accuracy:  0.953, Validation Accuracy:  0.941, Loss:  1.136\n",
      "Epoch   5 Batch  394/538 - Train Accuracy:  0.928, Validation Accuracy:  0.946, Loss:  1.163\n",
      "Epoch   5 Batch  395/538 - Train Accuracy:  0.939, Validation Accuracy:  0.951, Loss:  1.164\n",
      "Epoch   5 Batch  396/538 - Train Accuracy:  0.947, Validation Accuracy:  0.952, Loss:  1.152\n",
      "Epoch   5 Batch  397/538 - Train Accuracy:  0.943, Validation Accuracy:  0.951, Loss:  1.222\n",
      "Epoch   5 Batch  398/538 - Train Accuracy:  0.946, Validation Accuracy:  0.955, Loss:  1.179\n",
      "Epoch   5 Batch  399/538 - Train Accuracy:  0.933, Validation Accuracy:  0.958, Loss:  1.151\n",
      "Epoch   5 Batch  400/538 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  1.189\n",
      "Epoch   5 Batch  401/538 - Train Accuracy:  0.951, Validation Accuracy:  0.962, Loss:  1.186\n",
      "Epoch   5 Batch  402/538 - Train Accuracy:  0.947, Validation Accuracy:  0.953, Loss:  1.197\n",
      "Epoch   5 Batch  403/538 - Train Accuracy:  0.933, Validation Accuracy:  0.945, Loss:  1.213\n",
      "Epoch   5 Batch  404/538 - Train Accuracy:  0.936, Validation Accuracy:  0.937, Loss:  1.194\n",
      "Epoch   5 Batch  405/538 - Train Accuracy:  0.943, Validation Accuracy:  0.936, Loss:  1.210\n",
      "Epoch   5 Batch  406/538 - Train Accuracy:  0.946, Validation Accuracy:  0.942, Loss:  1.188\n",
      "Epoch   5 Batch  407/538 - Train Accuracy:  0.957, Validation Accuracy:  0.938, Loss:  1.158\n",
      "Epoch   5 Batch  408/538 - Train Accuracy:  0.931, Validation Accuracy:  0.936, Loss:  1.203\n",
      "Epoch   5 Batch  409/538 - Train Accuracy:  0.942, Validation Accuracy:  0.937, Loss:  1.129\n",
      "Epoch   5 Batch  410/538 - Train Accuracy:  0.954, Validation Accuracy:  0.946, Loss:  1.182\n",
      "Epoch   5 Batch  411/538 - Train Accuracy:  0.964, Validation Accuracy:  0.950, Loss:  1.218\n",
      "Epoch   5 Batch  412/538 - Train Accuracy:  0.959, Validation Accuracy:  0.946, Loss:  1.163\n",
      "Epoch   5 Batch  413/538 - Train Accuracy:  0.947, Validation Accuracy:  0.946, Loss:  1.163\n",
      "Epoch   5 Batch  414/538 - Train Accuracy:  0.911, Validation Accuracy:  0.950, Loss:  1.199\n",
      "Epoch   5 Batch  415/538 - Train Accuracy:  0.931, Validation Accuracy:  0.942, Loss:  1.179\n",
      "Epoch   5 Batch  416/538 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  1.177\n",
      "Epoch   5 Batch  417/538 - Train Accuracy:  0.949, Validation Accuracy:  0.943, Loss:  1.206\n",
      "Epoch   5 Batch  418/538 - Train Accuracy:  0.939, Validation Accuracy:  0.940, Loss:  1.169\n",
      "Epoch   5 Batch  419/538 - Train Accuracy:  0.947, Validation Accuracy:  0.940, Loss:  1.201\n",
      "Epoch   5 Batch  420/538 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  1.143\n",
      "Epoch   5 Batch  421/538 - Train Accuracy:  0.965, Validation Accuracy:  0.945, Loss:  1.158\n",
      "Epoch   5 Batch  422/538 - Train Accuracy:  0.931, Validation Accuracy:  0.947, Loss:  1.209\n",
      "Epoch   5 Batch  423/538 - Train Accuracy:  0.963, Validation Accuracy:  0.946, Loss:  1.160\n",
      "Epoch   5 Batch  424/538 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  1.221\n",
      "Epoch   5 Batch  425/538 - Train Accuracy:  0.939, Validation Accuracy:  0.948, Loss:  1.231\n",
      "Epoch   5 Batch  426/538 - Train Accuracy:  0.947, Validation Accuracy:  0.953, Loss:  1.167\n",
      "Epoch   5 Batch  427/538 - Train Accuracy:  0.935, Validation Accuracy:  0.957, Loss:  1.199\n",
      "Epoch   5 Batch  428/538 - Train Accuracy:  0.949, Validation Accuracy:  0.948, Loss:  1.167\n",
      "Epoch   5 Batch  429/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  1.183\n",
      "Epoch   5 Batch  430/538 - Train Accuracy:  0.938, Validation Accuracy:  0.955, Loss:  1.177\n",
      "Epoch   5 Batch  431/538 - Train Accuracy:  0.937, Validation Accuracy:  0.957, Loss:  1.185\n",
      "Epoch   5 Batch  432/538 - Train Accuracy:  0.945, Validation Accuracy:  0.956, Loss:  1.177\n",
      "Epoch   5 Batch  433/538 - Train Accuracy:  0.931, Validation Accuracy:  0.959, Loss:  1.189\n",
      "Epoch   5 Batch  434/538 - Train Accuracy:  0.943, Validation Accuracy:  0.956, Loss:  1.178\n",
      "Epoch   5 Batch  435/538 - Train Accuracy:  0.935, Validation Accuracy:  0.955, Loss:  1.120\n",
      "Epoch   5 Batch  436/538 - Train Accuracy:  0.936, Validation Accuracy:  0.955, Loss:  1.236\n",
      "Epoch   5 Batch  437/538 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  1.147\n",
      "Epoch   5 Batch  438/538 - Train Accuracy:  0.955, Validation Accuracy:  0.944, Loss:  1.167\n",
      "Epoch   5 Batch  439/538 - Train Accuracy:  0.949, Validation Accuracy:  0.940, Loss:  1.217\n",
      "Epoch   5 Batch  440/538 - Train Accuracy:  0.942, Validation Accuracy:  0.942, Loss:  1.137\n",
      "Epoch   5 Batch  441/538 - Train Accuracy:  0.930, Validation Accuracy:  0.940, Loss:  1.177\n",
      "Epoch   5 Batch  442/538 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  1.161\n",
      "Epoch   5 Batch  443/538 - Train Accuracy:  0.952, Validation Accuracy:  0.949, Loss:  1.192\n",
      "Epoch   5 Batch  444/538 - Train Accuracy:  0.947, Validation Accuracy:  0.942, Loss:  1.153\n",
      "Epoch   5 Batch  445/538 - Train Accuracy:  0.961, Validation Accuracy:  0.940, Loss:  1.152\n",
      "Epoch   5 Batch  446/538 - Train Accuracy:  0.953, Validation Accuracy:  0.938, Loss:  1.202\n",
      "Epoch   5 Batch  447/538 - Train Accuracy:  0.926, Validation Accuracy:  0.939, Loss:  1.167\n",
      "Epoch   5 Batch  448/538 - Train Accuracy:  0.940, Validation Accuracy:  0.936, Loss:  1.166\n",
      "Epoch   5 Batch  449/538 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  1.139\n",
      "Epoch   5 Batch  450/538 - Train Accuracy:  0.938, Validation Accuracy:  0.947, Loss:  1.203\n",
      "Epoch   5 Batch  451/538 - Train Accuracy:  0.936, Validation Accuracy:  0.946, Loss:  1.129\n",
      "Epoch   5 Batch  452/538 - Train Accuracy:  0.933, Validation Accuracy:  0.945, Loss:  1.146\n",
      "Epoch   5 Batch  453/538 - Train Accuracy:  0.949, Validation Accuracy:  0.945, Loss:  1.205\n",
      "Epoch   5 Batch  454/538 - Train Accuracy:  0.938, Validation Accuracy:  0.938, Loss:  1.158\n",
      "Epoch   5 Batch  455/538 - Train Accuracy:  0.955, Validation Accuracy:  0.941, Loss:  1.160\n",
      "Epoch   5 Batch  456/538 - Train Accuracy:  0.939, Validation Accuracy:  0.941, Loss:  1.216\n",
      "Epoch   5 Batch  457/538 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  1.186\n",
      "Epoch   5 Batch  458/538 - Train Accuracy:  0.956, Validation Accuracy:  0.939, Loss:  1.125\n",
      "Epoch   5 Batch  459/538 - Train Accuracy:  0.949, Validation Accuracy:  0.943, Loss:  1.175\n",
      "Epoch   5 Batch  460/538 - Train Accuracy:  0.932, Validation Accuracy:  0.947, Loss:  1.187\n",
      "Epoch   5 Batch  461/538 - Train Accuracy:  0.955, Validation Accuracy:  0.949, Loss:  1.192\n",
      "Epoch   5 Batch  462/538 - Train Accuracy:  0.937, Validation Accuracy:  0.950, Loss:  1.144\n",
      "Epoch   5 Batch  463/538 - Train Accuracy:  0.915, Validation Accuracy:  0.955, Loss:  1.188\n",
      "Epoch   5 Batch  464/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  1.189\n",
      "Epoch   5 Batch  465/538 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  1.197\n",
      "Epoch   5 Batch  466/538 - Train Accuracy:  0.946, Validation Accuracy:  0.958, Loss:  1.126\n",
      "Epoch   5 Batch  467/538 - Train Accuracy:  0.948, Validation Accuracy:  0.950, Loss:  1.231\n",
      "Epoch   5 Batch  468/538 - Train Accuracy:  0.938, Validation Accuracy:  0.944, Loss:  1.194\n",
      "Epoch   5 Batch  469/538 - Train Accuracy:  0.941, Validation Accuracy:  0.939, Loss:  1.159\n",
      "Epoch   5 Batch  470/538 - Train Accuracy:  0.944, Validation Accuracy:  0.936, Loss:  1.140\n",
      "Epoch   5 Batch  471/538 - Train Accuracy:  0.949, Validation Accuracy:  0.936, Loss:  1.217\n",
      "Epoch   5 Batch  472/538 - Train Accuracy:  0.986, Validation Accuracy:  0.933, Loss:  1.180\n",
      "Epoch   5 Batch  473/538 - Train Accuracy:  0.923, Validation Accuracy:  0.936, Loss:  1.167\n",
      "Epoch   5 Batch  474/538 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  1.131\n",
      "Epoch   5 Batch  475/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  1.185\n",
      "Epoch   5 Batch  476/538 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  1.169\n",
      "Epoch   5 Batch  477/538 - Train Accuracy:  0.933, Validation Accuracy:  0.957, Loss:  1.189\n",
      "Epoch   5 Batch  478/538 - Train Accuracy:  0.959, Validation Accuracy:  0.949, Loss:  1.170\n",
      "Epoch   5 Batch  479/538 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  1.193\n",
      "Epoch   5 Batch  480/538 - Train Accuracy:  0.959, Validation Accuracy:  0.948, Loss:  1.147\n",
      "Epoch   5 Batch  481/538 - Train Accuracy:  0.943, Validation Accuracy:  0.950, Loss:  1.195\n",
      "Epoch   5 Batch  482/538 - Train Accuracy:  0.931, Validation Accuracy:  0.951, Loss:  1.209\n",
      "Epoch   5 Batch  483/538 - Train Accuracy:  0.921, Validation Accuracy:  0.956, Loss:  1.189\n",
      "Epoch   5 Batch  484/538 - Train Accuracy:  0.942, Validation Accuracy:  0.959, Loss:  1.148\n",
      "Epoch   5 Batch  485/538 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  1.229\n",
      "Epoch   5 Batch  486/538 - Train Accuracy:  0.960, Validation Accuracy:  0.957, Loss:  1.151\n",
      "Epoch   5 Batch  487/538 - Train Accuracy:  0.943, Validation Accuracy:  0.954, Loss:  1.177\n",
      "Epoch   5 Batch  488/538 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  1.143\n",
      "Epoch   5 Batch  489/538 - Train Accuracy:  0.941, Validation Accuracy:  0.951, Loss:  1.187\n",
      "Epoch   5 Batch  490/538 - Train Accuracy:  0.943, Validation Accuracy:  0.956, Loss:  1.164\n",
      "Epoch   5 Batch  491/538 - Train Accuracy:  0.912, Validation Accuracy:  0.960, Loss:  1.111\n",
      "Epoch   5 Batch  492/538 - Train Accuracy:  0.960, Validation Accuracy:  0.965, Loss:  1.200\n",
      "Epoch   5 Batch  493/538 - Train Accuracy:  0.937, Validation Accuracy:  0.965, Loss:  1.216\n",
      "Epoch   5 Batch  494/538 - Train Accuracy:  0.937, Validation Accuracy:  0.962, Loss:  1.167\n",
      "Epoch   5 Batch  495/538 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  1.239\n",
      "Epoch   5 Batch  496/538 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  1.157\n",
      "Epoch   5 Batch  497/538 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  1.151\n",
      "Epoch   5 Batch  498/538 - Train Accuracy:  0.944, Validation Accuracy:  0.957, Loss:  1.147\n",
      "Epoch   5 Batch  499/538 - Train Accuracy:  0.948, Validation Accuracy:  0.956, Loss:  1.175\n",
      "Epoch   5 Batch  500/538 - Train Accuracy:  0.952, Validation Accuracy:  0.952, Loss:  1.132\n",
      "Epoch   5 Batch  501/538 - Train Accuracy:  0.953, Validation Accuracy:  0.951, Loss:  1.178\n",
      "Epoch   5 Batch  502/538 - Train Accuracy:  0.944, Validation Accuracy:  0.948, Loss:  1.097\n",
      "Epoch   5 Batch  503/538 - Train Accuracy:  0.960, Validation Accuracy:  0.942, Loss:  1.259\n",
      "Epoch   5 Batch  504/538 - Train Accuracy:  0.952, Validation Accuracy:  0.947, Loss:  1.169\n",
      "Epoch   5 Batch  505/538 - Train Accuracy:  0.961, Validation Accuracy:  0.950, Loss:  1.179\n",
      "Epoch   5 Batch  506/538 - Train Accuracy:  0.949, Validation Accuracy:  0.952, Loss:  1.237\n",
      "Epoch   5 Batch  507/538 - Train Accuracy:  0.934, Validation Accuracy:  0.955, Loss:  1.201\n",
      "Epoch   5 Batch  508/538 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  1.188\n",
      "Epoch   5 Batch  509/538 - Train Accuracy:  0.947, Validation Accuracy:  0.959, Loss:  1.178\n",
      "Epoch   5 Batch  510/538 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  1.143\n",
      "Epoch   5 Batch  511/538 - Train Accuracy:  0.944, Validation Accuracy:  0.956, Loss:  1.242\n",
      "Epoch   5 Batch  512/538 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  1.184\n",
      "Epoch   5 Batch  513/538 - Train Accuracy:  0.929, Validation Accuracy:  0.947, Loss:  1.160\n",
      "Epoch   5 Batch  514/538 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  1.211\n",
      "Epoch   5 Batch  515/538 - Train Accuracy:  0.945, Validation Accuracy:  0.952, Loss:  1.216\n",
      "Epoch   5 Batch  516/538 - Train Accuracy:  0.950, Validation Accuracy:  0.945, Loss:  1.193\n",
      "Epoch   5 Batch  517/538 - Train Accuracy:  0.946, Validation Accuracy:  0.938, Loss:  1.187\n",
      "Epoch   5 Batch  518/538 - Train Accuracy:  0.935, Validation Accuracy:  0.939, Loss:  1.136\n",
      "Epoch   5 Batch  519/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  1.172\n",
      "Epoch   5 Batch  520/538 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  1.239\n",
      "Epoch   5 Batch  521/538 - Train Accuracy:  0.944, Validation Accuracy:  0.943, Loss:  1.200\n",
      "Epoch   5 Batch  522/538 - Train Accuracy:  0.946, Validation Accuracy:  0.939, Loss:  1.187\n",
      "Epoch   5 Batch  523/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  1.220\n",
      "Epoch   5 Batch  524/538 - Train Accuracy:  0.939, Validation Accuracy:  0.946, Loss:  1.156\n",
      "Epoch   5 Batch  525/538 - Train Accuracy:  0.951, Validation Accuracy:  0.947, Loss:  1.161\n",
      "Epoch   5 Batch  526/538 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  1.133\n",
      "Epoch   5 Batch  527/538 - Train Accuracy:  0.961, Validation Accuracy:  0.950, Loss:  1.189\n",
      "Epoch   5 Batch  528/538 - Train Accuracy:  0.946, Validation Accuracy:  0.950, Loss:  1.161\n",
      "Epoch   5 Batch  529/538 - Train Accuracy:  0.932, Validation Accuracy:  0.943, Loss:  1.163\n",
      "Epoch   5 Batch  530/538 - Train Accuracy:  0.930, Validation Accuracy:  0.942, Loss:  1.170\n",
      "Epoch   5 Batch  531/538 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  1.199\n",
      "Epoch   5 Batch  532/538 - Train Accuracy:  0.933, Validation Accuracy:  0.934, Loss:  1.187\n",
      "Epoch   5 Batch  533/538 - Train Accuracy:  0.950, Validation Accuracy:  0.933, Loss:  1.205\n",
      "Epoch   5 Batch  534/538 - Train Accuracy:  0.955, Validation Accuracy:  0.940, Loss:  1.150\n",
      "Epoch   5 Batch  535/538 - Train Accuracy:  0.942, Validation Accuracy:  0.944, Loss:  1.174\n",
      "Epoch   5 Batch  536/538 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  1.180\n",
      "Epoch   6 Batch    0/538 - Train Accuracy:  0.962, Validation Accuracy:  0.944, Loss:  1.164\n",
      "Epoch   6 Batch    1/538 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  1.170\n",
      "Epoch   6 Batch    2/538 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  1.161\n",
      "Epoch   6 Batch    3/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  1.226\n",
      "Epoch   6 Batch    4/538 - Train Accuracy:  0.938, Validation Accuracy:  0.949, Loss:  1.201\n",
      "Epoch   6 Batch    5/538 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  1.173\n",
      "Epoch   6 Batch    6/538 - Train Accuracy:  0.951, Validation Accuracy:  0.944, Loss:  1.216\n",
      "Epoch   6 Batch    7/538 - Train Accuracy:  0.965, Validation Accuracy:  0.947, Loss:  1.184\n",
      "Epoch   6 Batch    8/538 - Train Accuracy:  0.945, Validation Accuracy:  0.949, Loss:  1.207\n",
      "Epoch   6 Batch    9/538 - Train Accuracy:  0.938, Validation Accuracy:  0.949, Loss:  1.205\n",
      "Epoch   6 Batch   10/538 - Train Accuracy:  0.947, Validation Accuracy:  0.949, Loss:  1.178\n",
      "Epoch   6 Batch   11/538 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  1.171\n",
      "Epoch   6 Batch   12/538 - Train Accuracy:  0.957, Validation Accuracy:  0.944, Loss:  1.190\n",
      "Epoch   6 Batch   13/538 - Train Accuracy:  0.956, Validation Accuracy:  0.947, Loss:  1.163\n",
      "Epoch   6 Batch   14/538 - Train Accuracy:  0.936, Validation Accuracy:  0.948, Loss:  1.175\n",
      "Epoch   6 Batch   15/538 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  1.182\n",
      "Epoch   6 Batch   16/538 - Train Accuracy:  0.943, Validation Accuracy:  0.951, Loss:  1.208\n",
      "Epoch   6 Batch   17/538 - Train Accuracy:  0.956, Validation Accuracy:  0.953, Loss:  1.180\n",
      "Epoch   6 Batch   18/538 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  1.167\n",
      "Epoch   6 Batch   19/538 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  1.241\n",
      "Epoch   6 Batch   20/538 - Train Accuracy:  0.953, Validation Accuracy:  0.953, Loss:  1.148\n",
      "Epoch   6 Batch   21/538 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  1.163\n",
      "Epoch   6 Batch   22/538 - Train Accuracy:  0.940, Validation Accuracy:  0.948, Loss:  1.161\n",
      "Epoch   6 Batch   23/538 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  1.189\n",
      "Epoch   6 Batch   24/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  1.163\n",
      "Epoch   6 Batch   25/538 - Train Accuracy:  0.938, Validation Accuracy:  0.941, Loss:  1.161\n",
      "Epoch   6 Batch   26/538 - Train Accuracy:  0.930, Validation Accuracy:  0.941, Loss:  1.226\n",
      "Epoch   6 Batch   27/538 - Train Accuracy:  0.958, Validation Accuracy:  0.941, Loss:  1.155\n",
      "Epoch   6 Batch   28/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  1.153\n",
      "Epoch   6 Batch   29/538 - Train Accuracy:  0.953, Validation Accuracy:  0.939, Loss:  1.175\n",
      "Epoch   6 Batch   30/538 - Train Accuracy:  0.943, Validation Accuracy:  0.941, Loss:  1.141\n",
      "Epoch   6 Batch   31/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  1.208\n",
      "Epoch   6 Batch   32/538 - Train Accuracy:  0.949, Validation Accuracy:  0.948, Loss:  1.181\n",
      "Epoch   6 Batch   33/538 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  1.221\n",
      "Epoch   6 Batch   34/538 - Train Accuracy:  0.941, Validation Accuracy:  0.946, Loss:  1.154\n",
      "Epoch   6 Batch   35/538 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  1.173\n",
      "Epoch   6 Batch   36/538 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  1.157\n",
      "Epoch   6 Batch   37/538 - Train Accuracy:  0.939, Validation Accuracy:  0.944, Loss:  1.155\n",
      "Epoch   6 Batch   38/538 - Train Accuracy:  0.953, Validation Accuracy:  0.946, Loss:  1.157\n",
      "Epoch   6 Batch   39/538 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  1.184\n",
      "Epoch   6 Batch   40/538 - Train Accuracy:  0.953, Validation Accuracy:  0.938, Loss:  1.200\n",
      "Epoch   6 Batch   41/538 - Train Accuracy:  0.950, Validation Accuracy:  0.937, Loss:  1.140\n",
      "Epoch   6 Batch   42/538 - Train Accuracy:  0.948, Validation Accuracy:  0.935, Loss:  1.136\n",
      "Epoch   6 Batch   43/538 - Train Accuracy:  0.914, Validation Accuracy:  0.931, Loss:  1.237\n",
      "Epoch   6 Batch   44/538 - Train Accuracy:  0.931, Validation Accuracy:  0.941, Loss:  1.218\n",
      "Epoch   6 Batch   45/538 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  1.134\n",
      "Epoch   6 Batch   46/538 - Train Accuracy:  0.955, Validation Accuracy:  0.944, Loss:  1.211\n",
      "Epoch   6 Batch   47/538 - Train Accuracy:  0.949, Validation Accuracy:  0.946, Loss:  1.143\n",
      "Epoch   6 Batch   48/538 - Train Accuracy:  0.947, Validation Accuracy:  0.948, Loss:  1.126\n",
      "Epoch   6 Batch   49/538 - Train Accuracy:  0.957, Validation Accuracy:  0.946, Loss:  1.219\n",
      "Epoch   6 Batch   50/538 - Train Accuracy:  0.949, Validation Accuracy:  0.948, Loss:  1.190\n",
      "Epoch   6 Batch   51/538 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  1.163\n",
      "Epoch   6 Batch   52/538 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  1.194\n",
      "Epoch   6 Batch   53/538 - Train Accuracy:  0.922, Validation Accuracy:  0.946, Loss:  1.197\n",
      "Epoch   6 Batch   54/538 - Train Accuracy:  0.953, Validation Accuracy:  0.945, Loss:  1.169\n",
      "Epoch   6 Batch   55/538 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  1.181\n",
      "Epoch   6 Batch   56/538 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  1.211\n",
      "Epoch   6 Batch   57/538 - Train Accuracy:  0.937, Validation Accuracy:  0.947, Loss:  1.182\n",
      "Epoch   6 Batch   58/538 - Train Accuracy:  0.939, Validation Accuracy:  0.953, Loss:  1.220\n",
      "Epoch   6 Batch   59/538 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  1.194\n",
      "Epoch   6 Batch   60/538 - Train Accuracy:  0.947, Validation Accuracy:  0.951, Loss:  1.179\n",
      "Epoch   6 Batch   61/538 - Train Accuracy:  0.947, Validation Accuracy:  0.951, Loss:  1.217\n",
      "Epoch   6 Batch   62/538 - Train Accuracy:  0.940, Validation Accuracy:  0.957, Loss:  1.184\n",
      "Epoch   6 Batch   63/538 - Train Accuracy:  0.950, Validation Accuracy:  0.950, Loss:  1.150\n",
      "Epoch   6 Batch   64/538 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  1.148\n",
      "Epoch   6 Batch   65/538 - Train Accuracy:  0.939, Validation Accuracy:  0.956, Loss:  1.184\n",
      "Epoch   6 Batch   66/538 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  1.179\n",
      "Epoch   6 Batch   67/538 - Train Accuracy:  0.948, Validation Accuracy:  0.954, Loss:  1.206\n",
      "Epoch   6 Batch   68/538 - Train Accuracy:  0.929, Validation Accuracy:  0.945, Loss:  1.158\n",
      "Epoch   6 Batch   69/538 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  1.158\n",
      "Epoch   6 Batch   70/538 - Train Accuracy:  0.942, Validation Accuracy:  0.947, Loss:  1.189\n",
      "Epoch   6 Batch   71/538 - Train Accuracy:  0.949, Validation Accuracy:  0.944, Loss:  1.176\n",
      "Epoch   6 Batch   72/538 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  1.186\n",
      "Epoch   6 Batch   73/538 - Train Accuracy:  0.939, Validation Accuracy:  0.944, Loss:  1.174\n",
      "Epoch   6 Batch   74/538 - Train Accuracy:  0.947, Validation Accuracy:  0.946, Loss:  1.160\n",
      "Epoch   6 Batch   75/538 - Train Accuracy:  0.934, Validation Accuracy:  0.946, Loss:  1.125\n",
      "Epoch   6 Batch   76/538 - Train Accuracy:  0.952, Validation Accuracy:  0.944, Loss:  1.175\n",
      "Epoch   6 Batch   77/538 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  1.157\n",
      "Epoch   6 Batch   78/538 - Train Accuracy:  0.937, Validation Accuracy:  0.955, Loss:  1.257\n",
      "Epoch   6 Batch   79/538 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  1.180\n",
      "Epoch   6 Batch   80/538 - Train Accuracy:  0.951, Validation Accuracy:  0.952, Loss:  1.168\n",
      "Epoch   6 Batch   81/538 - Train Accuracy:  0.936, Validation Accuracy:  0.952, Loss:  1.149\n",
      "Epoch   6 Batch   82/538 - Train Accuracy:  0.945, Validation Accuracy:  0.945, Loss:  1.177\n",
      "Epoch   6 Batch   83/538 - Train Accuracy:  0.939, Validation Accuracy:  0.943, Loss:  1.154\n",
      "Epoch   6 Batch   84/538 - Train Accuracy:  0.945, Validation Accuracy:  0.941, Loss:  1.199\n",
      "Epoch   6 Batch   85/538 - Train Accuracy:  0.959, Validation Accuracy:  0.940, Loss:  1.144\n",
      "Epoch   6 Batch   86/538 - Train Accuracy:  0.944, Validation Accuracy:  0.939, Loss:  1.174\n",
      "Epoch   6 Batch   87/538 - Train Accuracy:  0.943, Validation Accuracy:  0.946, Loss:  1.196\n",
      "Epoch   6 Batch   88/538 - Train Accuracy:  0.950, Validation Accuracy:  0.948, Loss:  1.160\n",
      "Epoch   6 Batch   89/538 - Train Accuracy:  0.950, Validation Accuracy:  0.940, Loss:  1.198\n",
      "Epoch   6 Batch   90/538 - Train Accuracy:  0.954, Validation Accuracy:  0.938, Loss:  1.156\n",
      "Epoch   6 Batch   91/538 - Train Accuracy:  0.947, Validation Accuracy:  0.940, Loss:  1.184\n",
      "Epoch   6 Batch   92/538 - Train Accuracy:  0.939, Validation Accuracy:  0.943, Loss:  1.161\n",
      "Epoch   6 Batch   93/538 - Train Accuracy:  0.949, Validation Accuracy:  0.939, Loss:  1.187\n",
      "Epoch   6 Batch   94/538 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  1.186\n",
      "Epoch   6 Batch   95/538 - Train Accuracy:  0.934, Validation Accuracy:  0.940, Loss:  1.158\n",
      "Epoch   6 Batch   96/538 - Train Accuracy:  0.967, Validation Accuracy:  0.933, Loss:  1.159\n",
      "Epoch   6 Batch   97/538 - Train Accuracy:  0.950, Validation Accuracy:  0.936, Loss:  1.191\n",
      "Epoch   6 Batch   98/538 - Train Accuracy:  0.948, Validation Accuracy:  0.936, Loss:  1.201\n",
      "Epoch   6 Batch   99/538 - Train Accuracy:  0.948, Validation Accuracy:  0.944, Loss:  1.183\n",
      "Epoch   6 Batch  100/538 - Train Accuracy:  0.948, Validation Accuracy:  0.939, Loss:  1.156\n",
      "Epoch   6 Batch  101/538 - Train Accuracy:  0.947, Validation Accuracy:  0.934, Loss:  1.243\n",
      "Epoch   6 Batch  102/538 - Train Accuracy:  0.933, Validation Accuracy:  0.935, Loss:  1.180\n",
      "Epoch   6 Batch  103/538 - Train Accuracy:  0.946, Validation Accuracy:  0.936, Loss:  1.233\n",
      "Epoch   6 Batch  104/538 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  1.180\n",
      "Epoch   6 Batch  105/538 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  1.170\n",
      "Epoch   6 Batch  106/538 - Train Accuracy:  0.928, Validation Accuracy:  0.944, Loss:  1.164\n",
      "Epoch   6 Batch  107/538 - Train Accuracy:  0.947, Validation Accuracy:  0.938, Loss:  1.203\n",
      "Epoch   6 Batch  108/538 - Train Accuracy:  0.955, Validation Accuracy:  0.942, Loss:  1.195\n",
      "Epoch   6 Batch  109/538 - Train Accuracy:  0.951, Validation Accuracy:  0.936, Loss:  1.208\n",
      "Epoch   6 Batch  110/538 - Train Accuracy:  0.955, Validation Accuracy:  0.936, Loss:  1.190\n",
      "Epoch   6 Batch  111/538 - Train Accuracy:  0.946, Validation Accuracy:  0.938, Loss:  1.185\n",
      "Epoch   6 Batch  112/538 - Train Accuracy:  0.946, Validation Accuracy:  0.942, Loss:  1.228\n",
      "Epoch   6 Batch  113/538 - Train Accuracy:  0.933, Validation Accuracy:  0.944, Loss:  1.190\n",
      "Epoch   6 Batch  114/538 - Train Accuracy:  0.956, Validation Accuracy:  0.943, Loss:  1.182\n",
      "Epoch   6 Batch  115/538 - Train Accuracy:  0.954, Validation Accuracy:  0.939, Loss:  1.173\n",
      "Epoch   6 Batch  116/538 - Train Accuracy:  0.943, Validation Accuracy:  0.940, Loss:  1.168\n",
      "Epoch   6 Batch  117/538 - Train Accuracy:  0.955, Validation Accuracy:  0.943, Loss:  1.181\n",
      "Epoch   6 Batch  118/538 - Train Accuracy:  0.952, Validation Accuracy:  0.940, Loss:  1.157\n",
      "Epoch   6 Batch  119/538 - Train Accuracy:  0.966, Validation Accuracy:  0.940, Loss:  1.136\n",
      "Epoch   6 Batch  120/538 - Train Accuracy:  0.963, Validation Accuracy:  0.940, Loss:  1.192\n",
      "Epoch   6 Batch  121/538 - Train Accuracy:  0.963, Validation Accuracy:  0.945, Loss:  1.178\n",
      "Epoch   6 Batch  122/538 - Train Accuracy:  0.941, Validation Accuracy:  0.946, Loss:  1.174\n",
      "Epoch   6 Batch  123/538 - Train Accuracy:  0.936, Validation Accuracy:  0.951, Loss:  1.166\n",
      "Epoch   6 Batch  124/538 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  1.165\n",
      "Epoch   6 Batch  125/538 - Train Accuracy:  0.958, Validation Accuracy:  0.960, Loss:  1.175\n",
      "Epoch   6 Batch  126/538 - Train Accuracy:  0.940, Validation Accuracy:  0.956, Loss:  1.174\n",
      "Epoch   6 Batch  127/538 - Train Accuracy:  0.944, Validation Accuracy:  0.958, Loss:  1.179\n",
      "Epoch   6 Batch  128/538 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  1.166\n",
      "Epoch   6 Batch  129/538 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  1.132\n",
      "Epoch   6 Batch  130/538 - Train Accuracy:  0.952, Validation Accuracy:  0.952, Loss:  1.198\n",
      "Epoch   6 Batch  131/538 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  1.190\n",
      "Epoch   6 Batch  132/538 - Train Accuracy:  0.931, Validation Accuracy:  0.953, Loss:  1.227\n",
      "Epoch   6 Batch  133/538 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  1.195\n",
      "Epoch   6 Batch  134/538 - Train Accuracy:  0.934, Validation Accuracy:  0.954, Loss:  1.221\n",
      "Epoch   6 Batch  135/538 - Train Accuracy:  0.947, Validation Accuracy:  0.953, Loss:  1.177\n",
      "Epoch   6 Batch  136/538 - Train Accuracy:  0.948, Validation Accuracy:  0.953, Loss:  1.116\n",
      "Epoch   6 Batch  137/538 - Train Accuracy:  0.944, Validation Accuracy:  0.950, Loss:  1.156\n",
      "Epoch   6 Batch  138/538 - Train Accuracy:  0.943, Validation Accuracy:  0.948, Loss:  1.159\n",
      "Epoch   6 Batch  139/538 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  1.214\n",
      "Epoch   6 Batch  140/538 - Train Accuracy:  0.931, Validation Accuracy:  0.942, Loss:  1.200\n",
      "Epoch   6 Batch  141/538 - Train Accuracy:  0.963, Validation Accuracy:  0.941, Loss:  1.157\n",
      "Epoch   6 Batch  142/538 - Train Accuracy:  0.953, Validation Accuracy:  0.938, Loss:  1.130\n",
      "Epoch   6 Batch  143/538 - Train Accuracy:  0.955, Validation Accuracy:  0.943, Loss:  1.178\n",
      "Epoch   6 Batch  144/538 - Train Accuracy:  0.948, Validation Accuracy:  0.942, Loss:  1.174\n",
      "Epoch   6 Batch  145/538 - Train Accuracy:  0.941, Validation Accuracy:  0.942, Loss:  1.134\n",
      "Epoch   6 Batch  146/538 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  1.162\n",
      "Epoch   6 Batch  147/538 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  1.137\n",
      "Epoch   6 Batch  148/538 - Train Accuracy:  0.935, Validation Accuracy:  0.951, Loss:  1.166\n",
      "Epoch   6 Batch  149/538 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  1.220\n",
      "Epoch   6 Batch  150/538 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  1.131\n",
      "Epoch   6 Batch  151/538 - Train Accuracy:  0.954, Validation Accuracy:  0.955, Loss:  1.191\n",
      "Epoch   6 Batch  152/538 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  1.185\n",
      "Epoch   6 Batch  153/538 - Train Accuracy:  0.935, Validation Accuracy:  0.953, Loss:  1.159\n",
      "Epoch   6 Batch  154/538 - Train Accuracy:  0.945, Validation Accuracy:  0.952, Loss:  1.132\n",
      "Epoch   6 Batch  155/538 - Train Accuracy:  0.948, Validation Accuracy:  0.952, Loss:  1.138\n",
      "Epoch   6 Batch  156/538 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  1.168\n",
      "Epoch   6 Batch  157/538 - Train Accuracy:  0.961, Validation Accuracy:  0.946, Loss:  1.148\n",
      "Epoch   6 Batch  158/538 - Train Accuracy:  0.950, Validation Accuracy:  0.943, Loss:  1.207\n",
      "Epoch   6 Batch  159/538 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  1.183\n",
      "Epoch   6 Batch  160/538 - Train Accuracy:  0.948, Validation Accuracy:  0.940, Loss:  1.186\n",
      "Epoch   6 Batch  161/538 - Train Accuracy:  0.954, Validation Accuracy:  0.943, Loss:  1.110\n",
      "Epoch   6 Batch  162/538 - Train Accuracy:  0.949, Validation Accuracy:  0.943, Loss:  1.222\n",
      "Epoch   6 Batch  163/538 - Train Accuracy:  0.948, Validation Accuracy:  0.941, Loss:  1.155\n",
      "Epoch   6 Batch  164/538 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  1.169\n",
      "Epoch   6 Batch  165/538 - Train Accuracy:  0.952, Validation Accuracy:  0.941, Loss:  1.155\n",
      "Epoch   6 Batch  166/538 - Train Accuracy:  0.965, Validation Accuracy:  0.939, Loss:  1.157\n",
      "Epoch   6 Batch  167/538 - Train Accuracy:  0.942, Validation Accuracy:  0.941, Loss:  1.158\n",
      "Epoch   6 Batch  168/538 - Train Accuracy:  0.923, Validation Accuracy:  0.938, Loss:  1.203\n",
      "Epoch   6 Batch  169/538 - Train Accuracy:  0.957, Validation Accuracy:  0.938, Loss:  1.136\n",
      "Epoch   6 Batch  170/538 - Train Accuracy:  0.942, Validation Accuracy:  0.931, Loss:  1.136\n",
      "Epoch   6 Batch  171/538 - Train Accuracy:  0.936, Validation Accuracy:  0.934, Loss:  1.162\n",
      "Epoch   6 Batch  172/538 - Train Accuracy:  0.945, Validation Accuracy:  0.941, Loss:  1.169\n",
      "Epoch   6 Batch  173/538 - Train Accuracy:  0.951, Validation Accuracy:  0.944, Loss:  1.125\n",
      "Epoch   6 Batch  174/538 - Train Accuracy:  0.945, Validation Accuracy:  0.943, Loss:  1.144\n",
      "Epoch   6 Batch  175/538 - Train Accuracy:  0.960, Validation Accuracy:  0.937, Loss:  1.148\n",
      "Epoch   6 Batch  176/538 - Train Accuracy:  0.948, Validation Accuracy:  0.933, Loss:  1.198\n",
      "Epoch   6 Batch  177/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  1.222\n",
      "Epoch   6 Batch  178/538 - Train Accuracy:  0.938, Validation Accuracy:  0.944, Loss:  1.117\n",
      "Epoch   6 Batch  179/538 - Train Accuracy:  0.940, Validation Accuracy:  0.943, Loss:  1.205\n",
      "Epoch   6 Batch  180/538 - Train Accuracy:  0.942, Validation Accuracy:  0.942, Loss:  1.128\n",
      "Epoch   6 Batch  181/538 - Train Accuracy:  0.951, Validation Accuracy:  0.942, Loss:  1.221\n",
      "Epoch   6 Batch  182/538 - Train Accuracy:  0.960, Validation Accuracy:  0.941, Loss:  1.166\n",
      "Epoch   6 Batch  183/538 - Train Accuracy:  0.967, Validation Accuracy:  0.938, Loss:  1.154\n",
      "Epoch   6 Batch  184/538 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  1.178\n",
      "Epoch   6 Batch  185/538 - Train Accuracy:  0.972, Validation Accuracy:  0.956, Loss:  1.135\n",
      "Epoch   6 Batch  186/538 - Train Accuracy:  0.948, Validation Accuracy:  0.954, Loss:  1.152\n",
      "Epoch   6 Batch  187/538 - Train Accuracy:  0.962, Validation Accuracy:  0.947, Loss:  1.210\n",
      "Epoch   6 Batch  188/538 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  1.201\n",
      "Epoch   6 Batch  189/538 - Train Accuracy:  0.954, Validation Accuracy:  0.952, Loss:  1.157\n",
      "Epoch   6 Batch  190/538 - Train Accuracy:  0.936, Validation Accuracy:  0.949, Loss:  1.183\n",
      "Epoch   6 Batch  191/538 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  1.168\n",
      "Epoch   6 Batch  192/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  1.190\n",
      "Epoch   6 Batch  193/538 - Train Accuracy:  0.955, Validation Accuracy:  0.955, Loss:  1.152\n",
      "Epoch   6 Batch  194/538 - Train Accuracy:  0.929, Validation Accuracy:  0.963, Loss:  1.217\n",
      "Epoch   6 Batch  195/538 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  1.172\n",
      "Epoch   6 Batch  196/538 - Train Accuracy:  0.940, Validation Accuracy:  0.961, Loss:  1.180\n",
      "Epoch   6 Batch  197/538 - Train Accuracy:  0.945, Validation Accuracy:  0.961, Loss:  1.195\n",
      "Epoch   6 Batch  198/538 - Train Accuracy:  0.941, Validation Accuracy:  0.955, Loss:  1.176\n",
      "Epoch   6 Batch  199/538 - Train Accuracy:  0.941, Validation Accuracy:  0.948, Loss:  1.175\n",
      "Epoch   6 Batch  200/538 - Train Accuracy:  0.965, Validation Accuracy:  0.948, Loss:  1.180\n",
      "Epoch   6 Batch  201/538 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  1.208\n",
      "Epoch   6 Batch  202/538 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  1.183\n",
      "Epoch   6 Batch  203/538 - Train Accuracy:  0.955, Validation Accuracy:  0.958, Loss:  1.194\n",
      "Epoch   6 Batch  204/538 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  1.226\n",
      "Epoch   6 Batch  205/538 - Train Accuracy:  0.947, Validation Accuracy:  0.959, Loss:  1.139\n",
      "Epoch   6 Batch  206/538 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  1.163\n",
      "Epoch   6 Batch  207/538 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  1.163\n",
      "Epoch   6 Batch  208/538 - Train Accuracy:  0.940, Validation Accuracy:  0.958, Loss:  1.159\n",
      "Epoch   6 Batch  209/538 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  1.098\n",
      "Epoch   6 Batch  210/538 - Train Accuracy:  0.944, Validation Accuracy:  0.956, Loss:  1.213\n",
      "Epoch   6 Batch  211/538 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  1.196\n",
      "Epoch   6 Batch  212/538 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  1.176\n",
      "Epoch   6 Batch  213/538 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  1.185\n",
      "Epoch   6 Batch  214/538 - Train Accuracy:  0.960, Validation Accuracy:  0.961, Loss:  1.159\n",
      "Epoch   6 Batch  215/538 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  1.137\n",
      "Epoch   6 Batch  216/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.194\n",
      "Epoch   6 Batch  217/538 - Train Accuracy:  0.953, Validation Accuracy:  0.958, Loss:  1.151\n",
      "Epoch   6 Batch  218/538 - Train Accuracy:  0.956, Validation Accuracy:  0.953, Loss:  1.164\n",
      "Epoch   6 Batch  219/538 - Train Accuracy:  0.945, Validation Accuracy:  0.951, Loss:  1.131\n",
      "Epoch   6 Batch  220/538 - Train Accuracy:  0.942, Validation Accuracy:  0.950, Loss:  1.216\n",
      "Epoch   6 Batch  221/538 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  1.190\n",
      "Epoch   6 Batch  222/538 - Train Accuracy:  0.949, Validation Accuracy:  0.952, Loss:  1.194\n",
      "Epoch   6 Batch  223/538 - Train Accuracy:  0.938, Validation Accuracy:  0.949, Loss:  1.161\n",
      "Epoch   6 Batch  224/538 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  1.174\n",
      "Epoch   6 Batch  225/538 - Train Accuracy:  0.959, Validation Accuracy:  0.957, Loss:  1.176\n",
      "Epoch   6 Batch  226/538 - Train Accuracy:  0.945, Validation Accuracy:  0.956, Loss:  1.122\n",
      "Epoch   6 Batch  227/538 - Train Accuracy:  0.947, Validation Accuracy:  0.948, Loss:  1.196\n",
      "Epoch   6 Batch  228/538 - Train Accuracy:  0.943, Validation Accuracy:  0.945, Loss:  1.158\n",
      "Epoch   6 Batch  229/538 - Train Accuracy:  0.943, Validation Accuracy:  0.946, Loss:  1.160\n",
      "Epoch   6 Batch  230/538 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  1.158\n",
      "Epoch   6 Batch  231/538 - Train Accuracy:  0.949, Validation Accuracy:  0.939, Loss:  1.160\n",
      "Epoch   6 Batch  232/538 - Train Accuracy:  0.951, Validation Accuracy:  0.945, Loss:  1.197\n",
      "Epoch   6 Batch  233/538 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  1.166\n",
      "Epoch   6 Batch  234/538 - Train Accuracy:  0.958, Validation Accuracy:  0.954, Loss:  1.166\n",
      "Epoch   6 Batch  235/538 - Train Accuracy:  0.964, Validation Accuracy:  0.954, Loss:  1.165\n",
      "Epoch   6 Batch  236/538 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  1.133\n",
      "Epoch   6 Batch  237/538 - Train Accuracy:  0.955, Validation Accuracy:  0.951, Loss:  1.173\n",
      "Epoch   6 Batch  238/538 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  1.156\n",
      "Epoch   6 Batch  239/538 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  1.197\n",
      "Epoch   6 Batch  240/538 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  1.145\n",
      "Epoch   6 Batch  241/538 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  1.221\n",
      "Epoch   6 Batch  242/538 - Train Accuracy:  0.963, Validation Accuracy:  0.955, Loss:  1.169\n",
      "Epoch   6 Batch  243/538 - Train Accuracy:  0.956, Validation Accuracy:  0.953, Loss:  1.144\n",
      "Epoch   6 Batch  244/538 - Train Accuracy:  0.949, Validation Accuracy:  0.947, Loss:  1.135\n",
      "Epoch   6 Batch  245/538 - Train Accuracy:  0.954, Validation Accuracy:  0.942, Loss:  1.171\n",
      "Epoch   6 Batch  246/538 - Train Accuracy:  0.961, Validation Accuracy:  0.943, Loss:  1.180\n",
      "Epoch   6 Batch  247/538 - Train Accuracy:  0.945, Validation Accuracy:  0.940, Loss:  1.202\n",
      "Epoch   6 Batch  248/538 - Train Accuracy:  0.952, Validation Accuracy:  0.939, Loss:  1.149\n",
      "Epoch   6 Batch  249/538 - Train Accuracy:  0.950, Validation Accuracy:  0.938, Loss:  1.215\n",
      "Epoch   6 Batch  250/538 - Train Accuracy:  0.945, Validation Accuracy:  0.942, Loss:  1.145\n",
      "Epoch   6 Batch  251/538 - Train Accuracy:  0.952, Validation Accuracy:  0.941, Loss:  1.171\n",
      "Epoch   6 Batch  252/538 - Train Accuracy:  0.953, Validation Accuracy:  0.936, Loss:  1.142\n",
      "Epoch   6 Batch  253/538 - Train Accuracy:  0.942, Validation Accuracy:  0.938, Loss:  1.160\n",
      "Epoch   6 Batch  254/538 - Train Accuracy:  0.949, Validation Accuracy:  0.939, Loss:  1.131\n",
      "Epoch   6 Batch  255/538 - Train Accuracy:  0.955, Validation Accuracy:  0.943, Loss:  1.197\n",
      "Epoch   6 Batch  256/538 - Train Accuracy:  0.938, Validation Accuracy:  0.947, Loss:  1.187\n",
      "Epoch   6 Batch  257/538 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  1.174\n",
      "Epoch   6 Batch  258/538 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  1.153\n",
      "Epoch   6 Batch  259/538 - Train Accuracy:  0.966, Validation Accuracy:  0.941, Loss:  1.138\n",
      "Epoch   6 Batch  260/538 - Train Accuracy:  0.931, Validation Accuracy:  0.934, Loss:  1.119\n",
      "Epoch   6 Batch  261/538 - Train Accuracy:  0.951, Validation Accuracy:  0.934, Loss:  1.167\n",
      "Epoch   6 Batch  262/538 - Train Accuracy:  0.949, Validation Accuracy:  0.934, Loss:  1.157\n",
      "Epoch   6 Batch  263/538 - Train Accuracy:  0.944, Validation Accuracy:  0.939, Loss:  1.215\n",
      "Epoch   6 Batch  264/538 - Train Accuracy:  0.958, Validation Accuracy:  0.936, Loss:  1.129\n",
      "Epoch   6 Batch  265/538 - Train Accuracy:  0.941, Validation Accuracy:  0.941, Loss:  1.190\n",
      "Epoch   6 Batch  266/538 - Train Accuracy:  0.946, Validation Accuracy:  0.943, Loss:  1.166\n",
      "Epoch   6 Batch  267/538 - Train Accuracy:  0.941, Validation Accuracy:  0.949, Loss:  1.148\n",
      "Epoch   6 Batch  268/538 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  1.196\n",
      "Epoch   6 Batch  269/538 - Train Accuracy:  0.949, Validation Accuracy:  0.951, Loss:  1.184\n",
      "Epoch   6 Batch  270/538 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  1.132\n",
      "Epoch   6 Batch  271/538 - Train Accuracy:  0.951, Validation Accuracy:  0.956, Loss:  1.175\n",
      "Epoch   6 Batch  272/538 - Train Accuracy:  0.946, Validation Accuracy:  0.961, Loss:  1.167\n",
      "Epoch   6 Batch  273/538 - Train Accuracy:  0.942, Validation Accuracy:  0.964, Loss:  1.131\n",
      "Epoch   6 Batch  274/538 - Train Accuracy:  0.932, Validation Accuracy:  0.958, Loss:  1.170\n",
      "Epoch   6 Batch  275/538 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  1.158\n",
      "Epoch   6 Batch  276/538 - Train Accuracy:  0.937, Validation Accuracy:  0.959, Loss:  1.186\n",
      "Epoch   6 Batch  277/538 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  1.160\n",
      "Epoch   6 Batch  278/538 - Train Accuracy:  0.939, Validation Accuracy:  0.957, Loss:  1.134\n",
      "Epoch   6 Batch  279/538 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  1.177\n",
      "Epoch   6 Batch  280/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.162\n",
      "Epoch   6 Batch  281/538 - Train Accuracy:  0.946, Validation Accuracy:  0.957, Loss:  1.129\n",
      "Epoch   6 Batch  282/538 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  1.176\n",
      "Epoch   6 Batch  283/538 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  1.133\n",
      "Epoch   6 Batch  284/538 - Train Accuracy:  0.948, Validation Accuracy:  0.956, Loss:  1.179\n",
      "Epoch   6 Batch  285/538 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  1.215\n",
      "Epoch   6 Batch  286/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  1.196\n",
      "Epoch   6 Batch  287/538 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  1.146\n",
      "Epoch   6 Batch  288/538 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  1.119\n",
      "Epoch   6 Batch  289/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  1.169\n",
      "Epoch   6 Batch  290/538 - Train Accuracy:  0.968, Validation Accuracy:  0.949, Loss:  1.147\n",
      "Epoch   6 Batch  291/538 - Train Accuracy:  0.943, Validation Accuracy:  0.947, Loss:  1.145\n",
      "Epoch   6 Batch  292/538 - Train Accuracy:  0.977, Validation Accuracy:  0.947, Loss:  1.171\n",
      "Epoch   6 Batch  293/538 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  1.171\n",
      "Epoch   6 Batch  294/538 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  1.189\n",
      "Epoch   6 Batch  295/538 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  1.164\n",
      "Epoch   6 Batch  296/538 - Train Accuracy:  0.937, Validation Accuracy:  0.952, Loss:  1.176\n",
      "Epoch   6 Batch  297/538 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  1.225\n",
      "Epoch   6 Batch  298/538 - Train Accuracy:  0.951, Validation Accuracy:  0.950, Loss:  1.185\n",
      "Epoch   6 Batch  299/538 - Train Accuracy:  0.934, Validation Accuracy:  0.954, Loss:  1.117\n",
      "Epoch   6 Batch  300/538 - Train Accuracy:  0.954, Validation Accuracy:  0.952, Loss:  1.206\n",
      "Epoch   6 Batch  301/538 - Train Accuracy:  0.947, Validation Accuracy:  0.956, Loss:  1.209\n",
      "Epoch   6 Batch  302/538 - Train Accuracy:  0.973, Validation Accuracy:  0.960, Loss:  1.178\n",
      "Epoch   6 Batch  303/538 - Train Accuracy:  0.959, Validation Accuracy:  0.957, Loss:  1.181\n",
      "Epoch   6 Batch  304/538 - Train Accuracy:  0.950, Validation Accuracy:  0.948, Loss:  1.154\n",
      "Epoch   6 Batch  305/538 - Train Accuracy:  0.969, Validation Accuracy:  0.944, Loss:  1.159\n",
      "Epoch   6 Batch  306/538 - Train Accuracy:  0.950, Validation Accuracy:  0.944, Loss:  1.156\n",
      "Epoch   6 Batch  307/538 - Train Accuracy:  0.967, Validation Accuracy:  0.947, Loss:  1.161\n",
      "Epoch   6 Batch  308/538 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  1.140\n",
      "Epoch   6 Batch  309/538 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  1.146\n",
      "Epoch   6 Batch  310/538 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  1.157\n",
      "Epoch   6 Batch  311/538 - Train Accuracy:  0.933, Validation Accuracy:  0.957, Loss:  1.139\n",
      "Epoch   6 Batch  312/538 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  1.170\n",
      "Epoch   6 Batch  313/538 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  1.137\n",
      "Epoch   6 Batch  314/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.215\n",
      "Epoch   6 Batch  315/538 - Train Accuracy:  0.951, Validation Accuracy:  0.957, Loss:  1.166\n",
      "Epoch   6 Batch  316/538 - Train Accuracy:  0.946, Validation Accuracy:  0.960, Loss:  1.171\n",
      "Epoch   6 Batch  317/538 - Train Accuracy:  0.943, Validation Accuracy:  0.960, Loss:  1.160\n",
      "Epoch   6 Batch  318/538 - Train Accuracy:  0.954, Validation Accuracy:  0.965, Loss:  1.192\n",
      "Epoch   6 Batch  319/538 - Train Accuracy:  0.955, Validation Accuracy:  0.963, Loss:  1.126\n",
      "Epoch   6 Batch  320/538 - Train Accuracy:  0.937, Validation Accuracy:  0.961, Loss:  1.148\n",
      "Epoch   6 Batch  321/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.187\n",
      "Epoch   6 Batch  322/538 - Train Accuracy:  0.953, Validation Accuracy:  0.956, Loss:  1.231\n",
      "Epoch   6 Batch  323/538 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  1.148\n",
      "Epoch   6 Batch  324/538 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  1.180\n",
      "Epoch   6 Batch  325/538 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  1.187\n",
      "Epoch   6 Batch  326/538 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  1.151\n",
      "Epoch   6 Batch  327/538 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  1.187\n",
      "Epoch   6 Batch  328/538 - Train Accuracy:  0.975, Validation Accuracy:  0.949, Loss:  1.152\n",
      "Epoch   6 Batch  329/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  1.152\n",
      "Epoch   6 Batch  330/538 - Train Accuracy:  0.964, Validation Accuracy:  0.948, Loss:  1.100\n",
      "Epoch   6 Batch  331/538 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  1.160\n",
      "Epoch   6 Batch  332/538 - Train Accuracy:  0.960, Validation Accuracy:  0.950, Loss:  1.194\n",
      "Epoch   6 Batch  333/538 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  1.183\n",
      "Epoch   6 Batch  334/538 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  1.186\n",
      "Epoch   6 Batch  335/538 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  1.112\n",
      "Epoch   6 Batch  336/538 - Train Accuracy:  0.952, Validation Accuracy:  0.950, Loss:  1.174\n",
      "Epoch   6 Batch  337/538 - Train Accuracy:  0.948, Validation Accuracy:  0.946, Loss:  1.199\n",
      "Epoch   6 Batch  338/538 - Train Accuracy:  0.961, Validation Accuracy:  0.947, Loss:  1.125\n",
      "Epoch   6 Batch  339/538 - Train Accuracy:  0.947, Validation Accuracy:  0.951, Loss:  1.170\n",
      "Epoch   6 Batch  340/538 - Train Accuracy:  0.929, Validation Accuracy:  0.953, Loss:  1.196\n",
      "Epoch   6 Batch  341/538 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  1.146\n",
      "Epoch   6 Batch  342/538 - Train Accuracy:  0.946, Validation Accuracy:  0.956, Loss:  1.192\n",
      "Epoch   6 Batch  343/538 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  1.172\n",
      "Epoch   6 Batch  344/538 - Train Accuracy:  0.950, Validation Accuracy:  0.960, Loss:  1.144\n",
      "Epoch   6 Batch  345/538 - Train Accuracy:  0.957, Validation Accuracy:  0.956, Loss:  1.151\n",
      "Epoch   6 Batch  346/538 - Train Accuracy:  0.947, Validation Accuracy:  0.957, Loss:  1.162\n",
      "Epoch   6 Batch  347/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  1.154\n",
      "Epoch   6 Batch  348/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  1.151\n",
      "Epoch   6 Batch  349/538 - Train Accuracy:  0.965, Validation Accuracy:  0.958, Loss:  1.170\n",
      "Epoch   6 Batch  350/538 - Train Accuracy:  0.956, Validation Accuracy:  0.953, Loss:  1.201\n",
      "Epoch   6 Batch  351/538 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  1.192\n",
      "Epoch   6 Batch  352/538 - Train Accuracy:  0.940, Validation Accuracy:  0.963, Loss:  1.204\n",
      "Epoch   6 Batch  353/538 - Train Accuracy:  0.956, Validation Accuracy:  0.959, Loss:  1.145\n",
      "Epoch   6 Batch  354/538 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  1.169\n",
      "Epoch   6 Batch  355/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  1.201\n",
      "Epoch   6 Batch  356/538 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  1.143\n",
      "Epoch   6 Batch  357/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.116\n",
      "Epoch   6 Batch  358/538 - Train Accuracy:  0.965, Validation Accuracy:  0.954, Loss:  1.194\n",
      "Epoch   6 Batch  359/538 - Train Accuracy:  0.932, Validation Accuracy:  0.953, Loss:  1.184\n",
      "Epoch   6 Batch  360/538 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  1.198\n",
      "Epoch   6 Batch  361/538 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  1.164\n",
      "Epoch   6 Batch  362/538 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  1.180\n",
      "Epoch   6 Batch  363/538 - Train Accuracy:  0.962, Validation Accuracy:  0.964, Loss:  1.182\n",
      "Epoch   6 Batch  364/538 - Train Accuracy:  0.961, Validation Accuracy:  0.966, Loss:  1.170\n",
      "Epoch   6 Batch  365/538 - Train Accuracy:  0.944, Validation Accuracy:  0.963, Loss:  1.135\n",
      "Epoch   6 Batch  366/538 - Train Accuracy:  0.953, Validation Accuracy:  0.958, Loss:  1.159\n",
      "Epoch   6 Batch  367/538 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  1.219\n",
      "Epoch   6 Batch  368/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.186\n",
      "Epoch   6 Batch  369/538 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  1.182\n",
      "Epoch   6 Batch  370/538 - Train Accuracy:  0.951, Validation Accuracy:  0.960, Loss:  1.153\n",
      "Epoch   6 Batch  371/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  1.125\n",
      "Epoch   6 Batch  372/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  1.114\n",
      "Epoch   6 Batch  373/538 - Train Accuracy:  0.953, Validation Accuracy:  0.948, Loss:  1.214\n",
      "Epoch   6 Batch  374/538 - Train Accuracy:  0.963, Validation Accuracy:  0.946, Loss:  1.153\n",
      "Epoch   6 Batch  375/538 - Train Accuracy:  0.954, Validation Accuracy:  0.947, Loss:  1.200\n",
      "Epoch   6 Batch  376/538 - Train Accuracy:  0.943, Validation Accuracy:  0.946, Loss:  1.129\n",
      "Epoch   6 Batch  377/538 - Train Accuracy:  0.965, Validation Accuracy:  0.949, Loss:  1.212\n",
      "Epoch   6 Batch  378/538 - Train Accuracy:  0.953, Validation Accuracy:  0.949, Loss:  1.137\n",
      "Epoch   6 Batch  379/538 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  1.161\n",
      "Epoch   6 Batch  380/538 - Train Accuracy:  0.958, Validation Accuracy:  0.954, Loss:  1.155\n",
      "Epoch   6 Batch  381/538 - Train Accuracy:  0.971, Validation Accuracy:  0.954, Loss:  1.169\n",
      "Epoch   6 Batch  382/538 - Train Accuracy:  0.947, Validation Accuracy:  0.951, Loss:  1.200\n",
      "Epoch   6 Batch  383/538 - Train Accuracy:  0.958, Validation Accuracy:  0.949, Loss:  1.222\n",
      "Epoch   6 Batch  384/538 - Train Accuracy:  0.951, Validation Accuracy:  0.951, Loss:  1.154\n",
      "Epoch   6 Batch  385/538 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  1.210\n",
      "Epoch   6 Batch  386/538 - Train Accuracy:  0.967, Validation Accuracy:  0.952, Loss:  1.171\n",
      "Epoch   6 Batch  387/538 - Train Accuracy:  0.951, Validation Accuracy:  0.961, Loss:  1.176\n",
      "Epoch   6 Batch  388/538 - Train Accuracy:  0.951, Validation Accuracy:  0.956, Loss:  1.182\n",
      "Epoch   6 Batch  389/538 - Train Accuracy:  0.946, Validation Accuracy:  0.960, Loss:  1.205\n",
      "Epoch   6 Batch  390/538 - Train Accuracy:  0.959, Validation Accuracy:  0.955, Loss:  1.203\n",
      "Epoch   6 Batch  391/538 - Train Accuracy:  0.963, Validation Accuracy:  0.954, Loss:  1.128\n",
      "Epoch   6 Batch  392/538 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  1.191\n",
      "Epoch   6 Batch  393/538 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  1.152\n",
      "Epoch   6 Batch  394/538 - Train Accuracy:  0.942, Validation Accuracy:  0.954, Loss:  1.133\n",
      "Epoch   6 Batch  395/538 - Train Accuracy:  0.944, Validation Accuracy:  0.953, Loss:  1.178\n",
      "Epoch   6 Batch  396/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.213\n",
      "Epoch   6 Batch  397/538 - Train Accuracy:  0.950, Validation Accuracy:  0.964, Loss:  1.133\n",
      "Epoch   6 Batch  398/538 - Train Accuracy:  0.958, Validation Accuracy:  0.967, Loss:  1.180\n",
      "Epoch   6 Batch  399/538 - Train Accuracy:  0.939, Validation Accuracy:  0.965, Loss:  1.181\n",
      "Epoch   6 Batch  400/538 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  1.203\n",
      "Epoch   6 Batch  401/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.201\n",
      "Epoch   6 Batch  402/538 - Train Accuracy:  0.945, Validation Accuracy:  0.955, Loss:  1.171\n",
      "Epoch   6 Batch  403/538 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  1.188\n",
      "Epoch   6 Batch  404/538 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  1.133\n",
      "Epoch   6 Batch  405/538 - Train Accuracy:  0.954, Validation Accuracy:  0.964, Loss:  1.166\n",
      "Epoch   6 Batch  406/538 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  1.173\n",
      "Epoch   6 Batch  407/538 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  1.144\n",
      "Epoch   6 Batch  408/538 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  1.191\n",
      "Epoch   6 Batch  409/538 - Train Accuracy:  0.953, Validation Accuracy:  0.959, Loss:  1.169\n",
      "Epoch   6 Batch  410/538 - Train Accuracy:  0.956, Validation Accuracy:  0.960, Loss:  1.180\n",
      "Epoch   6 Batch  411/538 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  1.127\n",
      "Epoch   6 Batch  412/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.168\n",
      "Epoch   6 Batch  413/538 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  1.148\n",
      "Epoch   6 Batch  414/538 - Train Accuracy:  0.926, Validation Accuracy:  0.961, Loss:  1.163\n",
      "Epoch   6 Batch  415/538 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  1.172\n",
      "Epoch   6 Batch  416/538 - Train Accuracy:  0.950, Validation Accuracy:  0.966, Loss:  1.193\n",
      "Epoch   6 Batch  417/538 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  1.214\n",
      "Epoch   6 Batch  418/538 - Train Accuracy:  0.949, Validation Accuracy:  0.963, Loss:  1.147\n",
      "Epoch   6 Batch  419/538 - Train Accuracy:  0.953, Validation Accuracy:  0.961, Loss:  1.132\n",
      "Epoch   6 Batch  420/538 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  1.171\n",
      "Epoch   6 Batch  421/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.158\n",
      "Epoch   6 Batch  422/538 - Train Accuracy:  0.936, Validation Accuracy:  0.957, Loss:  1.146\n",
      "Epoch   6 Batch  423/538 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  1.173\n",
      "Epoch   6 Batch  424/538 - Train Accuracy:  0.953, Validation Accuracy:  0.953, Loss:  1.144\n",
      "Epoch   6 Batch  425/538 - Train Accuracy:  0.941, Validation Accuracy:  0.953, Loss:  1.207\n",
      "Epoch   6 Batch  426/538 - Train Accuracy:  0.950, Validation Accuracy:  0.951, Loss:  1.106\n",
      "Epoch   6 Batch  427/538 - Train Accuracy:  0.940, Validation Accuracy:  0.947, Loss:  1.193\n",
      "Epoch   6 Batch  428/538 - Train Accuracy:  0.955, Validation Accuracy:  0.946, Loss:  1.134\n",
      "Epoch   6 Batch  429/538 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  1.188\n",
      "Epoch   6 Batch  430/538 - Train Accuracy:  0.945, Validation Accuracy:  0.947, Loss:  1.154\n",
      "Epoch   6 Batch  431/538 - Train Accuracy:  0.945, Validation Accuracy:  0.944, Loss:  1.148\n",
      "Epoch   6 Batch  432/538 - Train Accuracy:  0.947, Validation Accuracy:  0.937, Loss:  1.139\n",
      "Epoch   6 Batch  433/538 - Train Accuracy:  0.947, Validation Accuracy:  0.937, Loss:  1.186\n",
      "Epoch   6 Batch  434/538 - Train Accuracy:  0.940, Validation Accuracy:  0.941, Loss:  1.188\n",
      "Epoch   6 Batch  435/538 - Train Accuracy:  0.938, Validation Accuracy:  0.940, Loss:  1.121\n",
      "Epoch   6 Batch  436/538 - Train Accuracy:  0.940, Validation Accuracy:  0.944, Loss:  1.143\n",
      "Epoch   6 Batch  437/538 - Train Accuracy:  0.965, Validation Accuracy:  0.948, Loss:  1.189\n",
      "Epoch   6 Batch  438/538 - Train Accuracy:  0.956, Validation Accuracy:  0.949, Loss:  1.180\n",
      "Epoch   6 Batch  439/538 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  1.143\n",
      "Epoch   6 Batch  440/538 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  1.124\n",
      "Epoch   6 Batch  441/538 - Train Accuracy:  0.931, Validation Accuracy:  0.965, Loss:  1.148\n",
      "Epoch   6 Batch  442/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.169\n",
      "Epoch   6 Batch  443/538 - Train Accuracy:  0.948, Validation Accuracy:  0.960, Loss:  1.144\n",
      "Epoch   6 Batch  444/538 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  1.176\n",
      "Epoch   6 Batch  445/538 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  1.154\n",
      "Epoch   6 Batch  446/538 - Train Accuracy:  0.964, Validation Accuracy:  0.950, Loss:  1.212\n",
      "Epoch   6 Batch  447/538 - Train Accuracy:  0.939, Validation Accuracy:  0.951, Loss:  1.165\n",
      "Epoch   6 Batch  448/538 - Train Accuracy:  0.944, Validation Accuracy:  0.953, Loss:  1.173\n",
      "Epoch   6 Batch  449/538 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  1.203\n",
      "Epoch   6 Batch  450/538 - Train Accuracy:  0.934, Validation Accuracy:  0.953, Loss:  1.154\n",
      "Epoch   6 Batch  451/538 - Train Accuracy:  0.945, Validation Accuracy:  0.956, Loss:  1.149\n",
      "Epoch   6 Batch  452/538 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  1.187\n",
      "Epoch   6 Batch  453/538 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  1.216\n",
      "Epoch   6 Batch  454/538 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  1.136\n",
      "Epoch   6 Batch  455/538 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  1.171\n",
      "Epoch   6 Batch  456/538 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  1.184\n",
      "Epoch   6 Batch  457/538 - Train Accuracy:  0.948, Validation Accuracy:  0.949, Loss:  1.214\n",
      "Epoch   6 Batch  458/538 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  1.196\n",
      "Epoch   6 Batch  459/538 - Train Accuracy:  0.950, Validation Accuracy:  0.959, Loss:  1.124\n",
      "Epoch   6 Batch  460/538 - Train Accuracy:  0.949, Validation Accuracy:  0.957, Loss:  1.149\n",
      "Epoch   6 Batch  461/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  1.158\n",
      "Epoch   6 Batch  462/538 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  1.195\n",
      "Epoch   6 Batch  463/538 - Train Accuracy:  0.929, Validation Accuracy:  0.955, Loss:  1.140\n",
      "Epoch   6 Batch  464/538 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  1.200\n",
      "Epoch   6 Batch  465/538 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  1.145\n",
      "Epoch   6 Batch  466/538 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  1.162\n",
      "Epoch   6 Batch  467/538 - Train Accuracy:  0.957, Validation Accuracy:  0.954, Loss:  1.154\n",
      "Epoch   6 Batch  468/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  1.132\n",
      "Epoch   6 Batch  469/538 - Train Accuracy:  0.949, Validation Accuracy:  0.952, Loss:  1.163\n",
      "Epoch   6 Batch  470/538 - Train Accuracy:  0.953, Validation Accuracy:  0.953, Loss:  1.184\n",
      "Epoch   6 Batch  471/538 - Train Accuracy:  0.962, Validation Accuracy:  0.945, Loss:  1.194\n",
      "Epoch   6 Batch  472/538 - Train Accuracy:  0.963, Validation Accuracy:  0.942, Loss:  1.186\n",
      "Epoch   6 Batch  473/538 - Train Accuracy:  0.941, Validation Accuracy:  0.952, Loss:  1.160\n",
      "Epoch   6 Batch  474/538 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  1.169\n",
      "Epoch   6 Batch  475/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.202\n",
      "Epoch   6 Batch  476/538 - Train Accuracy:  0.956, Validation Accuracy:  0.963, Loss:  1.222\n",
      "Epoch   6 Batch  477/538 - Train Accuracy:  0.955, Validation Accuracy:  0.959, Loss:  1.203\n",
      "Epoch   6 Batch  478/538 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  1.183\n",
      "Epoch   6 Batch  479/538 - Train Accuracy:  0.956, Validation Accuracy:  0.945, Loss:  1.184\n",
      "Epoch   6 Batch  480/538 - Train Accuracy:  0.960, Validation Accuracy:  0.949, Loss:  1.141\n",
      "Epoch   6 Batch  481/538 - Train Accuracy:  0.961, Validation Accuracy:  0.950, Loss:  1.220\n",
      "Epoch   6 Batch  482/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  1.213\n",
      "Epoch   6 Batch  483/538 - Train Accuracy:  0.924, Validation Accuracy:  0.943, Loss:  1.185\n",
      "Epoch   6 Batch  484/538 - Train Accuracy:  0.933, Validation Accuracy:  0.939, Loss:  1.210\n",
      "Epoch   6 Batch  485/538 - Train Accuracy:  0.951, Validation Accuracy:  0.941, Loss:  1.192\n",
      "Epoch   6 Batch  486/538 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  1.225\n",
      "Epoch   6 Batch  487/538 - Train Accuracy:  0.943, Validation Accuracy:  0.944, Loss:  1.215\n",
      "Epoch   6 Batch  488/538 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  1.246\n",
      "Epoch   6 Batch  489/538 - Train Accuracy:  0.948, Validation Accuracy:  0.945, Loss:  1.196\n",
      "Epoch   6 Batch  490/538 - Train Accuracy:  0.946, Validation Accuracy:  0.941, Loss:  1.174\n",
      "Epoch   6 Batch  491/538 - Train Accuracy:  0.922, Validation Accuracy:  0.940, Loss:  1.192\n",
      "Epoch   6 Batch  492/538 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  1.160\n",
      "Epoch   6 Batch  493/538 - Train Accuracy:  0.936, Validation Accuracy:  0.954, Loss:  1.211\n",
      "Epoch   6 Batch  494/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  1.197\n",
      "Epoch   6 Batch  495/538 - Train Accuracy:  0.945, Validation Accuracy:  0.959, Loss:  1.195\n",
      "Epoch   6 Batch  496/538 - Train Accuracy:  0.949, Validation Accuracy:  0.947, Loss:  1.153\n",
      "Epoch   6 Batch  497/538 - Train Accuracy:  0.956, Validation Accuracy:  0.948, Loss:  1.184\n",
      "Epoch   6 Batch  498/538 - Train Accuracy:  0.957, Validation Accuracy:  0.945, Loss:  1.182\n",
      "Epoch   6 Batch  499/538 - Train Accuracy:  0.943, Validation Accuracy:  0.937, Loss:  1.245\n",
      "Epoch   6 Batch  500/538 - Train Accuracy:  0.963, Validation Accuracy:  0.940, Loss:  1.164\n",
      "Epoch   6 Batch  501/538 - Train Accuracy:  0.960, Validation Accuracy:  0.934, Loss:  1.199\n",
      "Epoch   6 Batch  502/538 - Train Accuracy:  0.937, Validation Accuracy:  0.940, Loss:  1.146\n",
      "Epoch   6 Batch  503/538 - Train Accuracy:  0.964, Validation Accuracy:  0.932, Loss:  1.150\n",
      "Epoch   6 Batch  504/538 - Train Accuracy:  0.959, Validation Accuracy:  0.933, Loss:  1.180\n",
      "Epoch   6 Batch  505/538 - Train Accuracy:  0.949, Validation Accuracy:  0.941, Loss:  1.150\n",
      "Epoch   6 Batch  506/538 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  1.148\n",
      "Epoch   6 Batch  507/538 - Train Accuracy:  0.945, Validation Accuracy:  0.953, Loss:  1.231\n",
      "Epoch   6 Batch  508/538 - Train Accuracy:  0.945, Validation Accuracy:  0.952, Loss:  1.159\n",
      "Epoch   6 Batch  509/538 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  1.177\n",
      "Epoch   6 Batch  510/538 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  1.193\n",
      "Epoch   6 Batch  511/538 - Train Accuracy:  0.934, Validation Accuracy:  0.956, Loss:  1.230\n",
      "Epoch   6 Batch  512/538 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  1.169\n",
      "Epoch   6 Batch  513/538 - Train Accuracy:  0.936, Validation Accuracy:  0.956, Loss:  1.172\n",
      "Epoch   6 Batch  514/538 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  1.181\n",
      "Epoch   6 Batch  515/538 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  1.163\n",
      "Epoch   6 Batch  516/538 - Train Accuracy:  0.934, Validation Accuracy:  0.954, Loss:  1.176\n",
      "Epoch   6 Batch  517/538 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  1.200\n",
      "Epoch   6 Batch  518/538 - Train Accuracy:  0.946, Validation Accuracy:  0.945, Loss:  1.166\n",
      "Epoch   6 Batch  519/538 - Train Accuracy:  0.959, Validation Accuracy:  0.944, Loss:  1.160\n",
      "Epoch   6 Batch  520/538 - Train Accuracy:  0.967, Validation Accuracy:  0.945, Loss:  1.207\n",
      "Epoch   6 Batch  521/538 - Train Accuracy:  0.954, Validation Accuracy:  0.952, Loss:  1.191\n",
      "Epoch   6 Batch  522/538 - Train Accuracy:  0.943, Validation Accuracy:  0.954, Loss:  1.144\n",
      "Epoch   6 Batch  523/538 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  1.219\n",
      "Epoch   6 Batch  524/538 - Train Accuracy:  0.947, Validation Accuracy:  0.956, Loss:  1.140\n",
      "Epoch   6 Batch  525/538 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  1.173\n",
      "Epoch   6 Batch  526/538 - Train Accuracy:  0.941, Validation Accuracy:  0.958, Loss:  1.189\n",
      "Epoch   6 Batch  527/538 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  1.157\n",
      "Epoch   6 Batch  528/538 - Train Accuracy:  0.948, Validation Accuracy:  0.952, Loss:  1.171\n",
      "Epoch   6 Batch  529/538 - Train Accuracy:  0.947, Validation Accuracy:  0.954, Loss:  1.180\n",
      "Epoch   6 Batch  530/538 - Train Accuracy:  0.942, Validation Accuracy:  0.956, Loss:  1.109\n",
      "Epoch   6 Batch  531/538 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  1.212\n",
      "Epoch   6 Batch  532/538 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  1.143\n",
      "Epoch   6 Batch  533/538 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  1.206\n",
      "Epoch   6 Batch  534/538 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  1.163\n",
      "Epoch   6 Batch  535/538 - Train Accuracy:  0.954, Validation Accuracy:  0.962, Loss:  1.167\n",
      "Epoch   6 Batch  536/538 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  1.189\n",
      "Epoch   7 Batch    0/538 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  1.182\n",
      "Epoch   7 Batch    1/538 - Train Accuracy:  0.966, Validation Accuracy:  0.951, Loss:  1.130\n",
      "Epoch   7 Batch    2/538 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  1.178\n",
      "Epoch   7 Batch    3/538 - Train Accuracy:  0.961, Validation Accuracy:  0.951, Loss:  1.185\n",
      "Epoch   7 Batch    4/538 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  1.211\n",
      "Epoch   7 Batch    5/538 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  1.212\n",
      "Epoch   7 Batch    6/538 - Train Accuracy:  0.969, Validation Accuracy:  0.943, Loss:  1.141\n",
      "Epoch   7 Batch    7/538 - Train Accuracy:  0.964, Validation Accuracy:  0.939, Loss:  1.208\n",
      "Epoch   7 Batch    8/538 - Train Accuracy:  0.946, Validation Accuracy:  0.944, Loss:  1.122\n",
      "Epoch   7 Batch    9/538 - Train Accuracy:  0.952, Validation Accuracy:  0.945, Loss:  1.159\n",
      "Epoch   7 Batch   10/538 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  1.188\n",
      "Epoch   7 Batch   11/538 - Train Accuracy:  0.951, Validation Accuracy:  0.961, Loss:  1.178\n",
      "Epoch   7 Batch   12/538 - Train Accuracy:  0.971, Validation Accuracy:  0.960, Loss:  1.147\n",
      "Epoch   7 Batch   13/538 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  1.182\n",
      "Epoch   7 Batch   14/538 - Train Accuracy:  0.952, Validation Accuracy:  0.962, Loss:  1.168\n",
      "Epoch   7 Batch   15/538 - Train Accuracy:  0.951, Validation Accuracy:  0.966, Loss:  1.187\n",
      "Epoch   7 Batch   16/538 - Train Accuracy:  0.960, Validation Accuracy:  0.966, Loss:  1.185\n",
      "Epoch   7 Batch   17/538 - Train Accuracy:  0.956, Validation Accuracy:  0.965, Loss:  1.216\n",
      "Epoch   7 Batch   18/538 - Train Accuracy:  0.960, Validation Accuracy:  0.966, Loss:  1.213\n",
      "Epoch   7 Batch   19/538 - Train Accuracy:  0.960, Validation Accuracy:  0.964, Loss:  1.134\n",
      "Epoch   7 Batch   20/538 - Train Accuracy:  0.955, Validation Accuracy:  0.968, Loss:  1.176\n",
      "Epoch   7 Batch   21/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch   7 Batch   22/538 - Train Accuracy:  0.957, Validation Accuracy:  0.969, Loss:  1.158\n",
      "Epoch   7 Batch   23/538 - Train Accuracy:  0.956, Validation Accuracy:  0.970, Loss:  1.181\n",
      "Epoch   7 Batch   24/538 - Train Accuracy:  0.956, Validation Accuracy:  0.965, Loss:  1.188\n",
      "Epoch   7 Batch   25/538 - Train Accuracy:  0.949, Validation Accuracy:  0.964, Loss:  1.206\n",
      "Epoch   7 Batch   26/538 - Train Accuracy:  0.941, Validation Accuracy:  0.956, Loss:  1.155\n",
      "Epoch   7 Batch   27/538 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  1.189\n",
      "Epoch   7 Batch   28/538 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  1.169\n",
      "Epoch   7 Batch   29/538 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  1.169\n",
      "Epoch   7 Batch   30/538 - Train Accuracy:  0.951, Validation Accuracy:  0.954, Loss:  1.186\n",
      "Epoch   7 Batch   31/538 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  1.146\n",
      "Epoch   7 Batch   32/538 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  1.232\n",
      "Epoch   7 Batch   33/538 - Train Accuracy:  0.958, Validation Accuracy:  0.951, Loss:  1.156\n",
      "Epoch   7 Batch   34/538 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  1.214\n",
      "Epoch   7 Batch   35/538 - Train Accuracy:  0.957, Validation Accuracy:  0.947, Loss:  1.109\n",
      "Epoch   7 Batch   36/538 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  1.199\n",
      "Epoch   7 Batch   37/538 - Train Accuracy:  0.947, Validation Accuracy:  0.959, Loss:  1.197\n",
      "Epoch   7 Batch   38/538 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  1.142\n",
      "Epoch   7 Batch   39/538 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  1.163\n",
      "Epoch   7 Batch   40/538 - Train Accuracy:  0.962, Validation Accuracy:  0.953, Loss:  1.185\n",
      "Epoch   7 Batch   41/538 - Train Accuracy:  0.960, Validation Accuracy:  0.954, Loss:  1.143\n",
      "Epoch   7 Batch   42/538 - Train Accuracy:  0.966, Validation Accuracy:  0.948, Loss:  1.146\n",
      "Epoch   7 Batch   43/538 - Train Accuracy:  0.930, Validation Accuracy:  0.949, Loss:  1.152\n",
      "Epoch   7 Batch   44/538 - Train Accuracy:  0.942, Validation Accuracy:  0.953, Loss:  1.166\n",
      "Epoch   7 Batch   45/538 - Train Accuracy:  0.946, Validation Accuracy:  0.953, Loss:  1.210\n",
      "Epoch   7 Batch   46/538 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  1.161\n",
      "Epoch   7 Batch   47/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  1.185\n",
      "Epoch   7 Batch   48/538 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  1.134\n",
      "Epoch   7 Batch   49/538 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  1.201\n",
      "Epoch   7 Batch   50/538 - Train Accuracy:  0.953, Validation Accuracy:  0.959, Loss:  1.127\n",
      "Epoch   7 Batch   51/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.173\n",
      "Epoch   7 Batch   52/538 - Train Accuracy:  0.949, Validation Accuracy:  0.949, Loss:  1.176\n",
      "Epoch   7 Batch   53/538 - Train Accuracy:  0.926, Validation Accuracy:  0.944, Loss:  1.221\n",
      "Epoch   7 Batch   54/538 - Train Accuracy:  0.959, Validation Accuracy:  0.945, Loss:  1.162\n",
      "Epoch   7 Batch   55/538 - Train Accuracy:  0.939, Validation Accuracy:  0.947, Loss:  1.140\n",
      "Epoch   7 Batch   56/538 - Train Accuracy:  0.955, Validation Accuracy:  0.954, Loss:  1.178\n",
      "Epoch   7 Batch   57/538 - Train Accuracy:  0.941, Validation Accuracy:  0.954, Loss:  1.241\n",
      "Epoch   7 Batch   58/538 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  1.184\n",
      "Epoch   7 Batch   59/538 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  1.164\n",
      "Epoch   7 Batch   60/538 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  1.135\n",
      "Epoch   7 Batch   61/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  1.149\n",
      "Epoch   7 Batch   62/538 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  1.152\n",
      "Epoch   7 Batch   63/538 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  1.202\n",
      "Epoch   7 Batch   64/538 - Train Accuracy:  0.953, Validation Accuracy:  0.960, Loss:  1.188\n",
      "Epoch   7 Batch   65/538 - Train Accuracy:  0.946, Validation Accuracy:  0.958, Loss:  1.138\n",
      "Epoch   7 Batch   66/538 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  1.158\n",
      "Epoch   7 Batch   67/538 - Train Accuracy:  0.954, Validation Accuracy:  0.954, Loss:  1.180\n",
      "Epoch   7 Batch   68/538 - Train Accuracy:  0.942, Validation Accuracy:  0.952, Loss:  1.179\n",
      "Epoch   7 Batch   69/538 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  1.242\n",
      "Epoch   7 Batch   70/538 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  1.156\n",
      "Epoch   7 Batch   71/538 - Train Accuracy:  0.965, Validation Accuracy:  0.960, Loss:  1.141\n",
      "Epoch   7 Batch   72/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.196\n",
      "Epoch   7 Batch   73/538 - Train Accuracy:  0.947, Validation Accuracy:  0.962, Loss:  1.182\n",
      "Epoch   7 Batch   74/538 - Train Accuracy:  0.953, Validation Accuracy:  0.964, Loss:  1.159\n",
      "Epoch   7 Batch   75/538 - Train Accuracy:  0.961, Validation Accuracy:  0.964, Loss:  1.148\n",
      "Epoch   7 Batch   76/538 - Train Accuracy:  0.958, Validation Accuracy:  0.963, Loss:  1.173\n",
      "Epoch   7 Batch   77/538 - Train Accuracy:  0.956, Validation Accuracy:  0.967, Loss:  1.116\n",
      "Epoch   7 Batch   78/538 - Train Accuracy:  0.952, Validation Accuracy:  0.967, Loss:  1.154\n",
      "Epoch   7 Batch   79/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.194\n",
      "Epoch   7 Batch   80/538 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  1.120\n",
      "Epoch   7 Batch   81/538 - Train Accuracy:  0.955, Validation Accuracy:  0.966, Loss:  1.193\n",
      "Epoch   7 Batch   82/538 - Train Accuracy:  0.951, Validation Accuracy:  0.964, Loss:  1.231\n",
      "Epoch   7 Batch   83/538 - Train Accuracy:  0.931, Validation Accuracy:  0.966, Loss:  1.135\n",
      "Epoch   7 Batch   84/538 - Train Accuracy:  0.946, Validation Accuracy:  0.959, Loss:  1.111\n",
      "Epoch   7 Batch   85/538 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  1.145\n",
      "Epoch   7 Batch   86/538 - Train Accuracy:  0.966, Validation Accuracy:  0.953, Loss:  1.172\n",
      "Epoch   7 Batch   87/538 - Train Accuracy:  0.948, Validation Accuracy:  0.947, Loss:  1.132\n",
      "Epoch   7 Batch   88/538 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  1.151\n",
      "Epoch   7 Batch   89/538 - Train Accuracy:  0.950, Validation Accuracy:  0.946, Loss:  1.167\n",
      "Epoch   7 Batch   90/538 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  1.172\n",
      "Epoch   7 Batch   91/538 - Train Accuracy:  0.955, Validation Accuracy:  0.950, Loss:  1.177\n",
      "Epoch   7 Batch   92/538 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  1.191\n",
      "Epoch   7 Batch   93/538 - Train Accuracy:  0.956, Validation Accuracy:  0.955, Loss:  1.156\n",
      "Epoch   7 Batch   94/538 - Train Accuracy:  0.952, Validation Accuracy:  0.957, Loss:  1.173\n",
      "Epoch   7 Batch   95/538 - Train Accuracy:  0.944, Validation Accuracy:  0.957, Loss:  1.134\n",
      "Epoch   7 Batch   96/538 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  1.152\n",
      "Epoch   7 Batch   97/538 - Train Accuracy:  0.960, Validation Accuracy:  0.964, Loss:  1.191\n",
      "Epoch   7 Batch   98/538 - Train Accuracy:  0.960, Validation Accuracy:  0.961, Loss:  1.164\n",
      "Epoch   7 Batch   99/538 - Train Accuracy:  0.947, Validation Accuracy:  0.956, Loss:  1.170\n",
      "Epoch   7 Batch  100/538 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  1.177\n",
      "Epoch   7 Batch  101/538 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  1.159\n",
      "Epoch   7 Batch  102/538 - Train Accuracy:  0.943, Validation Accuracy:  0.958, Loss:  1.158\n",
      "Epoch   7 Batch  103/538 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  1.213\n",
      "Epoch   7 Batch  104/538 - Train Accuracy:  0.963, Validation Accuracy:  0.955, Loss:  1.109\n",
      "Epoch   7 Batch  105/538 - Train Accuracy:  0.953, Validation Accuracy:  0.956, Loss:  1.171\n",
      "Epoch   7 Batch  106/538 - Train Accuracy:  0.947, Validation Accuracy:  0.957, Loss:  1.170\n",
      "Epoch   7 Batch  107/538 - Train Accuracy:  0.951, Validation Accuracy:  0.959, Loss:  1.180\n",
      "Epoch   7 Batch  108/538 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  1.143\n",
      "Epoch   7 Batch  109/538 - Train Accuracy:  0.961, Validation Accuracy:  0.966, Loss:  1.146\n",
      "Epoch   7 Batch  110/538 - Train Accuracy:  0.959, Validation Accuracy:  0.966, Loss:  1.203\n",
      "Epoch   7 Batch  111/538 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  1.169\n",
      "Epoch   7 Batch  112/538 - Train Accuracy:  0.954, Validation Accuracy:  0.955, Loss:  1.157\n",
      "Epoch   7 Batch  113/538 - Train Accuracy:  0.937, Validation Accuracy:  0.958, Loss:  1.163\n",
      "Epoch   7 Batch  114/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.169\n",
      "Epoch   7 Batch  115/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.117\n",
      "Epoch   7 Batch  116/538 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  1.091\n",
      "Epoch   7 Batch  117/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.165\n",
      "Epoch   7 Batch  118/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.156\n",
      "Epoch   7 Batch  119/538 - Train Accuracy:  0.968, Validation Accuracy:  0.957, Loss:  1.206\n",
      "Epoch   7 Batch  120/538 - Train Accuracy:  0.951, Validation Accuracy:  0.953, Loss:  1.156\n",
      "Epoch   7 Batch  121/538 - Train Accuracy:  0.961, Validation Accuracy:  0.953, Loss:  1.126\n",
      "Epoch   7 Batch  122/538 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  1.169\n",
      "Epoch   7 Batch  123/538 - Train Accuracy:  0.942, Validation Accuracy:  0.958, Loss:  1.145\n",
      "Epoch   7 Batch  124/538 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  1.178\n",
      "Epoch   7 Batch  125/538 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  1.133\n",
      "Epoch   7 Batch  126/538 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  1.220\n",
      "Epoch   7 Batch  127/538 - Train Accuracy:  0.948, Validation Accuracy:  0.958, Loss:  1.183\n",
      "Epoch   7 Batch  128/538 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  1.144\n",
      "Epoch   7 Batch  129/538 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  1.133\n",
      "Epoch   7 Batch  130/538 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  1.125\n",
      "Epoch   7 Batch  131/538 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  1.176\n",
      "Epoch   7 Batch  132/538 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  1.184\n",
      "Epoch   7 Batch  133/538 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  1.153\n",
      "Epoch   7 Batch  134/538 - Train Accuracy:  0.946, Validation Accuracy:  0.956, Loss:  1.171\n",
      "Epoch   7 Batch  135/538 - Train Accuracy:  0.951, Validation Accuracy:  0.957, Loss:  1.196\n",
      "Epoch   7 Batch  136/538 - Train Accuracy:  0.957, Validation Accuracy:  0.954, Loss:  1.194\n",
      "Epoch   7 Batch  137/538 - Train Accuracy:  0.952, Validation Accuracy:  0.955, Loss:  1.159\n",
      "Epoch   7 Batch  138/538 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  1.141\n",
      "Epoch   7 Batch  139/538 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  1.161\n",
      "Epoch   7 Batch  140/538 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  1.127\n",
      "Epoch   7 Batch  141/538 - Train Accuracy:  0.965, Validation Accuracy:  0.955, Loss:  1.220\n",
      "Epoch   7 Batch  142/538 - Train Accuracy:  0.969, Validation Accuracy:  0.952, Loss:  1.133\n",
      "Epoch   7 Batch  143/538 - Train Accuracy:  0.960, Validation Accuracy:  0.952, Loss:  1.149\n",
      "Epoch   7 Batch  144/538 - Train Accuracy:  0.949, Validation Accuracy:  0.953, Loss:  1.141\n",
      "Epoch   7 Batch  145/538 - Train Accuracy:  0.958, Validation Accuracy:  0.952, Loss:  1.166\n",
      "Epoch   7 Batch  146/538 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  1.156\n",
      "Epoch   7 Batch  147/538 - Train Accuracy:  0.953, Validation Accuracy:  0.952, Loss:  1.165\n",
      "Epoch   7 Batch  148/538 - Train Accuracy:  0.941, Validation Accuracy:  0.957, Loss:  1.153\n",
      "Epoch   7 Batch  149/538 - Train Accuracy:  0.965, Validation Accuracy:  0.954, Loss:  1.129\n",
      "Epoch   7 Batch  150/538 - Train Accuracy:  0.960, Validation Accuracy:  0.951, Loss:  1.165\n",
      "Epoch   7 Batch  151/538 - Train Accuracy:  0.942, Validation Accuracy:  0.949, Loss:  1.155\n",
      "Epoch   7 Batch  152/538 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  1.184\n",
      "Epoch   7 Batch  153/538 - Train Accuracy:  0.952, Validation Accuracy:  0.958, Loss:  1.148\n",
      "Epoch   7 Batch  154/538 - Train Accuracy:  0.955, Validation Accuracy:  0.963, Loss:  1.186\n",
      "Epoch   7 Batch  155/538 - Train Accuracy:  0.956, Validation Accuracy:  0.963, Loss:  1.165\n",
      "Epoch   7 Batch  156/538 - Train Accuracy:  0.966, Validation Accuracy:  0.962, Loss:  1.175\n",
      "Epoch   7 Batch  157/538 - Train Accuracy:  0.969, Validation Accuracy:  0.959, Loss:  1.161\n",
      "Epoch   7 Batch  158/538 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  1.174\n",
      "Epoch   7 Batch  159/538 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  1.158\n",
      "Epoch   7 Batch  160/538 - Train Accuracy:  0.933, Validation Accuracy:  0.959, Loss:  1.158\n",
      "Epoch   7 Batch  161/538 - Train Accuracy:  0.951, Validation Accuracy:  0.955, Loss:  1.140\n",
      "Epoch   7 Batch  162/538 - Train Accuracy:  0.956, Validation Accuracy:  0.951, Loss:  1.120\n",
      "Epoch   7 Batch  163/538 - Train Accuracy:  0.945, Validation Accuracy:  0.950, Loss:  1.162\n",
      "Epoch   7 Batch  164/538 - Train Accuracy:  0.950, Validation Accuracy:  0.953, Loss:  1.130\n",
      "Epoch   7 Batch  165/538 - Train Accuracy:  0.961, Validation Accuracy:  0.954, Loss:  1.138\n",
      "Epoch   7 Batch  166/538 - Train Accuracy:  0.974, Validation Accuracy:  0.956, Loss:  1.152\n",
      "Epoch   7 Batch  167/538 - Train Accuracy:  0.952, Validation Accuracy:  0.954, Loss:  1.194\n",
      "Epoch   7 Batch  168/538 - Train Accuracy:  0.950, Validation Accuracy:  0.958, Loss:  1.229\n",
      "Epoch   7 Batch  169/538 - Train Accuracy:  0.968, Validation Accuracy:  0.957, Loss:  1.144\n",
      "Epoch   7 Batch  170/538 - Train Accuracy:  0.953, Validation Accuracy:  0.957, Loss:  1.149\n",
      "Epoch   7 Batch  171/538 - Train Accuracy:  0.940, Validation Accuracy:  0.956, Loss:  1.154\n",
      "Epoch   7 Batch  172/538 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  1.169\n",
      "Epoch   7 Batch  173/538 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  1.165\n",
      "Epoch   7 Batch  174/538 - Train Accuracy:  0.970, Validation Accuracy:  0.957, Loss:  1.124\n",
      "Epoch   7 Batch  175/538 - Train Accuracy:  0.956, Validation Accuracy:  0.948, Loss:  1.196\n",
      "Epoch   7 Batch  176/538 - Train Accuracy:  0.947, Validation Accuracy:  0.951, Loss:  1.188\n",
      "Epoch   7 Batch  177/538 - Train Accuracy:  0.970, Validation Accuracy:  0.952, Loss:  1.160\n",
      "Epoch   7 Batch  178/538 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  1.124\n",
      "Epoch   7 Batch  179/538 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  1.177\n",
      "Epoch   7 Batch  180/538 - Train Accuracy:  0.947, Validation Accuracy:  0.955, Loss:  1.184\n",
      "Epoch   7 Batch  181/538 - Train Accuracy:  0.948, Validation Accuracy:  0.959, Loss:  1.191\n",
      "Epoch   7 Batch  182/538 - Train Accuracy:  0.974, Validation Accuracy:  0.963, Loss:  1.155\n",
      "Epoch   7 Batch  183/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.149\n",
      "Epoch   7 Batch  184/538 - Train Accuracy:  0.950, Validation Accuracy:  0.964, Loss:  1.128\n",
      "Epoch   7 Batch  185/538 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  1.193\n",
      "Epoch   7 Batch  186/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.147\n",
      "Epoch   7 Batch  187/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.172\n",
      "Epoch   7 Batch  188/538 - Train Accuracy:  0.962, Validation Accuracy:  0.968, Loss:  1.146\n",
      "Epoch   7 Batch  189/538 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  1.113\n",
      "Epoch   7 Batch  190/538 - Train Accuracy:  0.941, Validation Accuracy:  0.961, Loss:  1.199\n",
      "Epoch   7 Batch  191/538 - Train Accuracy:  0.966, Validation Accuracy:  0.962, Loss:  1.166\n",
      "Epoch   7 Batch  192/538 - Train Accuracy:  0.956, Validation Accuracy:  0.961, Loss:  1.172\n",
      "Epoch   7 Batch  193/538 - Train Accuracy:  0.961, Validation Accuracy:  0.966, Loss:  1.147\n",
      "Epoch   7 Batch  194/538 - Train Accuracy:  0.944, Validation Accuracy:  0.968, Loss:  1.127\n",
      "Epoch   7 Batch  195/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.178\n",
      "Epoch   7 Batch  196/538 - Train Accuracy:  0.944, Validation Accuracy:  0.968, Loss:  1.196\n",
      "Epoch   7 Batch  197/538 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  1.149\n",
      "Epoch   7 Batch  198/538 - Train Accuracy:  0.959, Validation Accuracy:  0.961, Loss:  1.161\n",
      "Epoch   7 Batch  199/538 - Train Accuracy:  0.948, Validation Accuracy:  0.961, Loss:  1.103\n",
      "Epoch   7 Batch  200/538 - Train Accuracy:  0.968, Validation Accuracy:  0.965, Loss:  1.154\n",
      "Epoch   7 Batch  201/538 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch   7 Batch  202/538 - Train Accuracy:  0.949, Validation Accuracy:  0.965, Loss:  1.191\n",
      "Epoch   7 Batch  203/538 - Train Accuracy:  0.951, Validation Accuracy:  0.960, Loss:  1.156\n",
      "Epoch   7 Batch  204/538 - Train Accuracy:  0.957, Validation Accuracy:  0.964, Loss:  1.220\n",
      "Epoch   7 Batch  205/538 - Train Accuracy:  0.943, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch   7 Batch  206/538 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  1.134\n",
      "Epoch   7 Batch  207/538 - Train Accuracy:  0.961, Validation Accuracy:  0.952, Loss:  1.169\n",
      "Epoch   7 Batch  208/538 - Train Accuracy:  0.952, Validation Accuracy:  0.951, Loss:  1.223\n",
      "Epoch   7 Batch  209/538 - Train Accuracy:  0.971, Validation Accuracy:  0.950, Loss:  1.191\n",
      "Epoch   7 Batch  210/538 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  1.147\n",
      "Epoch   7 Batch  211/538 - Train Accuracy:  0.959, Validation Accuracy:  0.961, Loss:  1.136\n",
      "Epoch   7 Batch  212/538 - Train Accuracy:  0.956, Validation Accuracy:  0.961, Loss:  1.191\n",
      "Epoch   7 Batch  213/538 - Train Accuracy:  0.960, Validation Accuracy:  0.961, Loss:  1.188\n",
      "Epoch   7 Batch  214/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.132\n",
      "Epoch   7 Batch  215/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.131\n",
      "Epoch   7 Batch  216/538 - Train Accuracy:  0.957, Validation Accuracy:  0.965, Loss:  1.132\n",
      "Epoch   7 Batch  217/538 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  1.143\n",
      "Epoch   7 Batch  218/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.167\n",
      "Epoch   7 Batch  219/538 - Train Accuracy:  0.952, Validation Accuracy:  0.956, Loss:  1.168\n",
      "Epoch   7 Batch  220/538 - Train Accuracy:  0.953, Validation Accuracy:  0.955, Loss:  1.190\n",
      "Epoch   7 Batch  221/538 - Train Accuracy:  0.964, Validation Accuracy:  0.945, Loss:  1.176\n",
      "Epoch   7 Batch  222/538 - Train Accuracy:  0.965, Validation Accuracy:  0.948, Loss:  1.167\n",
      "Epoch   7 Batch  223/538 - Train Accuracy:  0.947, Validation Accuracy:  0.947, Loss:  1.132\n",
      "Epoch   7 Batch  224/538 - Train Accuracy:  0.949, Validation Accuracy:  0.945, Loss:  1.170\n",
      "Epoch   7 Batch  225/538 - Train Accuracy:  0.971, Validation Accuracy:  0.948, Loss:  1.153\n",
      "Epoch   7 Batch  226/538 - Train Accuracy:  0.951, Validation Accuracy:  0.950, Loss:  1.120\n",
      "Epoch   7 Batch  227/538 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  1.147\n",
      "Epoch   7 Batch  228/538 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  1.157\n",
      "Epoch   7 Batch  229/538 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  1.186\n",
      "Epoch   7 Batch  230/538 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  1.155\n",
      "Epoch   7 Batch  231/538 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  1.147\n",
      "Epoch   7 Batch  232/538 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  1.182\n",
      "Epoch   7 Batch  233/538 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  1.218\n",
      "Epoch   7 Batch  234/538 - Train Accuracy:  0.975, Validation Accuracy:  0.959, Loss:  1.171\n",
      "Epoch   7 Batch  235/538 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  1.132\n",
      "Epoch   7 Batch  236/538 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  1.196\n",
      "Epoch   7 Batch  237/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.120\n",
      "Epoch   7 Batch  238/538 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  1.146\n",
      "Epoch   7 Batch  239/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  1.158\n",
      "Epoch   7 Batch  240/538 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  1.171\n",
      "Epoch   7 Batch  241/538 - Train Accuracy:  0.950, Validation Accuracy:  0.955, Loss:  1.150\n",
      "Epoch   7 Batch  242/538 - Train Accuracy:  0.974, Validation Accuracy:  0.956, Loss:  1.163\n",
      "Epoch   7 Batch  243/538 - Train Accuracy:  0.958, Validation Accuracy:  0.954, Loss:  1.156\n",
      "Epoch   7 Batch  244/538 - Train Accuracy:  0.951, Validation Accuracy:  0.958, Loss:  1.137\n",
      "Epoch   7 Batch  245/538 - Train Accuracy:  0.954, Validation Accuracy:  0.964, Loss:  1.198\n",
      "Epoch   7 Batch  246/538 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  1.152\n",
      "Epoch   7 Batch  247/538 - Train Accuracy:  0.943, Validation Accuracy:  0.958, Loss:  1.108\n",
      "Epoch   7 Batch  248/538 - Train Accuracy:  0.944, Validation Accuracy:  0.955, Loss:  1.167\n",
      "Epoch   7 Batch  249/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.178\n",
      "Epoch   7 Batch  250/538 - Train Accuracy:  0.960, Validation Accuracy:  0.948, Loss:  1.188\n",
      "Epoch   7 Batch  251/538 - Train Accuracy:  0.952, Validation Accuracy:  0.950, Loss:  1.192\n",
      "Epoch   7 Batch  252/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.180\n",
      "Epoch   7 Batch  253/538 - Train Accuracy:  0.949, Validation Accuracy:  0.958, Loss:  1.166\n",
      "Epoch   7 Batch  254/538 - Train Accuracy:  0.953, Validation Accuracy:  0.955, Loss:  1.160\n",
      "Epoch   7 Batch  255/538 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  1.159\n",
      "Epoch   7 Batch  256/538 - Train Accuracy:  0.950, Validation Accuracy:  0.965, Loss:  1.154\n",
      "Epoch   7 Batch  257/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.167\n",
      "Epoch   7 Batch  258/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.148\n",
      "Epoch   7 Batch  259/538 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  1.140\n",
      "Epoch   7 Batch  260/538 - Train Accuracy:  0.944, Validation Accuracy:  0.956, Loss:  1.188\n",
      "Epoch   7 Batch  261/538 - Train Accuracy:  0.949, Validation Accuracy:  0.950, Loss:  1.217\n",
      "Epoch   7 Batch  262/538 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  1.134\n",
      "Epoch   7 Batch  263/538 - Train Accuracy:  0.938, Validation Accuracy:  0.953, Loss:  1.183\n",
      "Epoch   7 Batch  264/538 - Train Accuracy:  0.956, Validation Accuracy:  0.954, Loss:  1.173\n",
      "Epoch   7 Batch  265/538 - Train Accuracy:  0.947, Validation Accuracy:  0.959, Loss:  1.187\n",
      "Epoch   7 Batch  266/538 - Train Accuracy:  0.947, Validation Accuracy:  0.957, Loss:  1.146\n",
      "Epoch   7 Batch  267/538 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  1.137\n",
      "Epoch   7 Batch  268/538 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  1.129\n",
      "Epoch   7 Batch  269/538 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  1.163\n",
      "Epoch   7 Batch  270/538 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  1.153\n",
      "Epoch   7 Batch  271/538 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  1.161\n",
      "Epoch   7 Batch  272/538 - Train Accuracy:  0.954, Validation Accuracy:  0.956, Loss:  1.092\n",
      "Epoch   7 Batch  273/538 - Train Accuracy:  0.953, Validation Accuracy:  0.955, Loss:  1.217\n",
      "Epoch   7 Batch  274/538 - Train Accuracy:  0.940, Validation Accuracy:  0.956, Loss:  1.166\n",
      "Epoch   7 Batch  275/538 - Train Accuracy:  0.963, Validation Accuracy:  0.955, Loss:  1.157\n",
      "Epoch   7 Batch  276/538 - Train Accuracy:  0.949, Validation Accuracy:  0.961, Loss:  1.093\n",
      "Epoch   7 Batch  277/538 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  1.171\n",
      "Epoch   7 Batch  278/538 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  1.176\n",
      "Epoch   7 Batch  279/538 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  1.161\n",
      "Epoch   7 Batch  280/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.185\n",
      "Epoch   7 Batch  281/538 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  1.150\n",
      "Epoch   7 Batch  282/538 - Train Accuracy:  0.959, Validation Accuracy:  0.961, Loss:  1.173\n",
      "Epoch   7 Batch  283/538 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  1.119\n",
      "Epoch   7 Batch  284/538 - Train Accuracy:  0.953, Validation Accuracy:  0.965, Loss:  1.174\n",
      "Epoch   7 Batch  285/538 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  1.165\n",
      "Epoch   7 Batch  286/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.206\n",
      "Epoch   7 Batch  287/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.186\n",
      "Epoch   7 Batch  288/538 - Train Accuracy:  0.962, Validation Accuracy:  0.973, Loss:  1.201\n",
      "Epoch   7 Batch  289/538 - Train Accuracy:  0.963, Validation Accuracy:  0.972, Loss:  1.106\n",
      "Epoch   7 Batch  290/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.204\n",
      "Epoch   7 Batch  291/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.181\n",
      "Epoch   7 Batch  292/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.171\n",
      "Epoch   7 Batch  293/538 - Train Accuracy:  0.961, Validation Accuracy:  0.969, Loss:  1.169\n",
      "Epoch   7 Batch  294/538 - Train Accuracy:  0.950, Validation Accuracy:  0.966, Loss:  1.152\n",
      "Epoch   7 Batch  295/538 - Train Accuracy:  0.961, Validation Accuracy:  0.969, Loss:  1.194\n",
      "Epoch   7 Batch  296/538 - Train Accuracy:  0.957, Validation Accuracy:  0.971, Loss:  1.106\n",
      "Epoch   7 Batch  297/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.161\n",
      "Epoch   7 Batch  298/538 - Train Accuracy:  0.954, Validation Accuracy:  0.970, Loss:  1.162\n",
      "Epoch   7 Batch  299/538 - Train Accuracy:  0.957, Validation Accuracy:  0.974, Loss:  1.140\n",
      "Epoch   7 Batch  300/538 - Train Accuracy:  0.960, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch   7 Batch  301/538 - Train Accuracy:  0.959, Validation Accuracy:  0.969, Loss:  1.167\n",
      "Epoch   7 Batch  302/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.145\n",
      "Epoch   7 Batch  303/538 - Train Accuracy:  0.960, Validation Accuracy:  0.968, Loss:  1.184\n",
      "Epoch   7 Batch  304/538 - Train Accuracy:  0.958, Validation Accuracy:  0.968, Loss:  1.168\n",
      "Epoch   7 Batch  305/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.159\n",
      "Epoch   7 Batch  306/538 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  1.168\n",
      "Epoch   7 Batch  307/538 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  1.151\n",
      "Epoch   7 Batch  308/538 - Train Accuracy:  0.968, Validation Accuracy:  0.961, Loss:  1.155\n",
      "Epoch   7 Batch  309/538 - Train Accuracy:  0.968, Validation Accuracy:  0.962, Loss:  1.185\n",
      "Epoch   7 Batch  310/538 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  1.155\n",
      "Epoch   7 Batch  311/538 - Train Accuracy:  0.953, Validation Accuracy:  0.966, Loss:  1.147\n",
      "Epoch   7 Batch  312/538 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  1.157\n",
      "Epoch   7 Batch  313/538 - Train Accuracy:  0.959, Validation Accuracy:  0.964, Loss:  1.182\n",
      "Epoch   7 Batch  314/538 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  1.139\n",
      "Epoch   7 Batch  315/538 - Train Accuracy:  0.956, Validation Accuracy:  0.968, Loss:  1.133\n",
      "Epoch   7 Batch  316/538 - Train Accuracy:  0.957, Validation Accuracy:  0.972, Loss:  1.101\n",
      "Epoch   7 Batch  317/538 - Train Accuracy:  0.960, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch   7 Batch  318/538 - Train Accuracy:  0.959, Validation Accuracy:  0.969, Loss:  1.227\n",
      "Epoch   7 Batch  319/538 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  1.133\n",
      "Epoch   7 Batch  320/538 - Train Accuracy:  0.956, Validation Accuracy:  0.960, Loss:  1.142\n",
      "Epoch   7 Batch  321/538 - Train Accuracy:  0.958, Validation Accuracy:  0.960, Loss:  1.158\n",
      "Epoch   7 Batch  322/538 - Train Accuracy:  0.975, Validation Accuracy:  0.960, Loss:  1.175\n",
      "Epoch   7 Batch  323/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.128\n",
      "Epoch   7 Batch  324/538 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  1.148\n",
      "Epoch   7 Batch  325/538 - Train Accuracy:  0.960, Validation Accuracy:  0.964, Loss:  1.189\n",
      "Epoch   7 Batch  326/538 - Train Accuracy:  0.959, Validation Accuracy:  0.966, Loss:  1.171\n",
      "Epoch   7 Batch  327/538 - Train Accuracy:  0.955, Validation Accuracy:  0.966, Loss:  1.237\n",
      "Epoch   7 Batch  328/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.130\n",
      "Epoch   7 Batch  329/538 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  1.136\n",
      "Epoch   7 Batch  330/538 - Train Accuracy:  0.958, Validation Accuracy:  0.970, Loss:  1.149\n",
      "Epoch   7 Batch  331/538 - Train Accuracy:  0.953, Validation Accuracy:  0.971, Loss:  1.164\n",
      "Epoch   7 Batch  332/538 - Train Accuracy:  0.962, Validation Accuracy:  0.972, Loss:  1.106\n",
      "Epoch   7 Batch  333/538 - Train Accuracy:  0.963, Validation Accuracy:  0.971, Loss:  1.185\n",
      "Epoch   7 Batch  334/538 - Train Accuracy:  0.967, Validation Accuracy:  0.973, Loss:  1.185\n",
      "Epoch   7 Batch  335/538 - Train Accuracy:  0.962, Validation Accuracy:  0.976, Loss:  1.140\n",
      "Epoch   7 Batch  336/538 - Train Accuracy:  0.963, Validation Accuracy:  0.966, Loss:  1.149\n",
      "Epoch   7 Batch  337/538 - Train Accuracy:  0.967, Validation Accuracy:  0.968, Loss:  1.202\n",
      "Epoch   7 Batch  338/538 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  1.154\n",
      "Epoch   7 Batch  339/538 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  1.198\n",
      "Epoch   7 Batch  340/538 - Train Accuracy:  0.958, Validation Accuracy:  0.966, Loss:  1.225\n",
      "Epoch   7 Batch  341/538 - Train Accuracy:  0.960, Validation Accuracy:  0.964, Loss:  1.152\n",
      "Epoch   7 Batch  342/538 - Train Accuracy:  0.953, Validation Accuracy:  0.966, Loss:  1.139\n",
      "Epoch   7 Batch  343/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.208\n",
      "Epoch   7 Batch  344/538 - Train Accuracy:  0.950, Validation Accuracy:  0.969, Loss:  1.121\n",
      "Epoch   7 Batch  345/538 - Train Accuracy:  0.953, Validation Accuracy:  0.965, Loss:  1.181\n",
      "Epoch   7 Batch  346/538 - Train Accuracy:  0.953, Validation Accuracy:  0.960, Loss:  1.141\n",
      "Epoch   7 Batch  347/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.108\n",
      "Epoch   7 Batch  348/538 - Train Accuracy:  0.953, Validation Accuracy:  0.959, Loss:  1.221\n",
      "Epoch   7 Batch  349/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.145\n",
      "Epoch   7 Batch  350/538 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  1.186\n",
      "Epoch   7 Batch  351/538 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  1.152\n",
      "Epoch   7 Batch  352/538 - Train Accuracy:  0.947, Validation Accuracy:  0.964, Loss:  1.170\n",
      "Epoch   7 Batch  353/538 - Train Accuracy:  0.942, Validation Accuracy:  0.968, Loss:  1.205\n",
      "Epoch   7 Batch  354/538 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch   7 Batch  355/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.155\n",
      "Epoch   7 Batch  356/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.144\n",
      "Epoch   7 Batch  357/538 - Train Accuracy:  0.971, Validation Accuracy:  0.960, Loss:  1.174\n",
      "Epoch   7 Batch  358/538 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  1.160\n",
      "Epoch   7 Batch  359/538 - Train Accuracy:  0.951, Validation Accuracy:  0.964, Loss:  1.152\n",
      "Epoch   7 Batch  360/538 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  1.159\n",
      "Epoch   7 Batch  361/538 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  1.169\n",
      "Epoch   7 Batch  362/538 - Train Accuracy:  0.973, Validation Accuracy:  0.960, Loss:  1.197\n",
      "Epoch   7 Batch  363/538 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  1.183\n",
      "Epoch   7 Batch  364/538 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  1.186\n",
      "Epoch   7 Batch  365/538 - Train Accuracy:  0.952, Validation Accuracy:  0.960, Loss:  1.153\n",
      "Epoch   7 Batch  366/538 - Train Accuracy:  0.950, Validation Accuracy:  0.961, Loss:  1.199\n",
      "Epoch   7 Batch  367/538 - Train Accuracy:  0.955, Validation Accuracy:  0.963, Loss:  1.094\n",
      "Epoch   7 Batch  368/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.130\n",
      "Epoch   7 Batch  369/538 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  1.137\n",
      "Epoch   7 Batch  370/538 - Train Accuracy:  0.953, Validation Accuracy:  0.959, Loss:  1.174\n",
      "Epoch   7 Batch  371/538 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  1.152\n",
      "Epoch   7 Batch  372/538 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  1.182\n",
      "Epoch   7 Batch  373/538 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  1.117\n",
      "Epoch   7 Batch  374/538 - Train Accuracy:  0.971, Validation Accuracy:  0.958, Loss:  1.149\n",
      "Epoch   7 Batch  375/538 - Train Accuracy:  0.972, Validation Accuracy:  0.958, Loss:  1.235\n",
      "Epoch   7 Batch  376/538 - Train Accuracy:  0.948, Validation Accuracy:  0.956, Loss:  1.218\n",
      "Epoch   7 Batch  377/538 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  1.164\n",
      "Epoch   7 Batch  378/538 - Train Accuracy:  0.976, Validation Accuracy:  0.961, Loss:  1.159\n",
      "Epoch   7 Batch  379/538 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  1.154\n",
      "Epoch   7 Batch  380/538 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  1.182\n",
      "Epoch   7 Batch  381/538 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  1.155\n",
      "Epoch   7 Batch  382/538 - Train Accuracy:  0.944, Validation Accuracy:  0.960, Loss:  1.185\n",
      "Epoch   7 Batch  383/538 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  1.141\n",
      "Epoch   7 Batch  384/538 - Train Accuracy:  0.957, Validation Accuracy:  0.949, Loss:  1.164\n",
      "Epoch   7 Batch  385/538 - Train Accuracy:  0.969, Validation Accuracy:  0.948, Loss:  1.150\n",
      "Epoch   7 Batch  386/538 - Train Accuracy:  0.973, Validation Accuracy:  0.948, Loss:  1.190\n",
      "Epoch   7 Batch  387/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  1.169\n",
      "Epoch   7 Batch  388/538 - Train Accuracy:  0.963, Validation Accuracy:  0.947, Loss:  1.144\n",
      "Epoch   7 Batch  389/538 - Train Accuracy:  0.959, Validation Accuracy:  0.952, Loss:  1.157\n",
      "Epoch   7 Batch  390/538 - Train Accuracy:  0.971, Validation Accuracy:  0.951, Loss:  1.081\n",
      "Epoch   7 Batch  391/538 - Train Accuracy:  0.973, Validation Accuracy:  0.957, Loss:  1.177\n",
      "Epoch   7 Batch  392/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.153\n",
      "Epoch   7 Batch  393/538 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  1.145\n",
      "Epoch   7 Batch  394/538 - Train Accuracy:  0.944, Validation Accuracy:  0.959, Loss:  1.183\n",
      "Epoch   7 Batch  395/538 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  1.137\n",
      "Epoch   7 Batch  396/538 - Train Accuracy:  0.960, Validation Accuracy:  0.947, Loss:  1.145\n",
      "Epoch   7 Batch  397/538 - Train Accuracy:  0.964, Validation Accuracy:  0.960, Loss:  1.142\n",
      "Epoch   7 Batch  398/538 - Train Accuracy:  0.960, Validation Accuracy:  0.961, Loss:  1.178\n",
      "Epoch   7 Batch  399/538 - Train Accuracy:  0.950, Validation Accuracy:  0.958, Loss:  1.158\n",
      "Epoch   7 Batch  400/538 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  1.193\n",
      "Epoch   7 Batch  401/538 - Train Accuracy:  0.975, Validation Accuracy:  0.955, Loss:  1.134\n",
      "Epoch   7 Batch  402/538 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  1.165\n",
      "Epoch   7 Batch  403/538 - Train Accuracy:  0.973, Validation Accuracy:  0.957, Loss:  1.170\n",
      "Epoch   7 Batch  404/538 - Train Accuracy:  0.961, Validation Accuracy:  0.964, Loss:  1.153\n",
      "Epoch   7 Batch  405/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.156\n",
      "Epoch   7 Batch  406/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.158\n",
      "Epoch   7 Batch  407/538 - Train Accuracy:  0.948, Validation Accuracy:  0.957, Loss:  1.102\n",
      "Epoch   7 Batch  408/538 - Train Accuracy:  0.946, Validation Accuracy:  0.955, Loss:  1.198\n",
      "Epoch   7 Batch  409/538 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  1.161\n",
      "Epoch   7 Batch  410/538 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  1.197\n",
      "Epoch   7 Batch  411/538 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  1.097\n",
      "Epoch   7 Batch  412/538 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  1.162\n",
      "Epoch   7 Batch  413/538 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  1.146\n",
      "Epoch   7 Batch  414/538 - Train Accuracy:  0.936, Validation Accuracy:  0.963, Loss:  1.199\n",
      "Epoch   7 Batch  415/538 - Train Accuracy:  0.942, Validation Accuracy:  0.963, Loss:  1.113\n",
      "Epoch   7 Batch  416/538 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  1.161\n",
      "Epoch   7 Batch  417/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.137\n",
      "Epoch   7 Batch  418/538 - Train Accuracy:  0.960, Validation Accuracy:  0.966, Loss:  1.170\n",
      "Epoch   7 Batch  419/538 - Train Accuracy:  0.958, Validation Accuracy:  0.966, Loss:  1.157\n",
      "Epoch   7 Batch  420/538 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  1.110\n",
      "Epoch   7 Batch  421/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.122\n",
      "Epoch   7 Batch  422/538 - Train Accuracy:  0.947, Validation Accuracy:  0.965, Loss:  1.184\n",
      "Epoch   7 Batch  423/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.179\n",
      "Epoch   7 Batch  424/538 - Train Accuracy:  0.955, Validation Accuracy:  0.968, Loss:  1.193\n",
      "Epoch   7 Batch  425/538 - Train Accuracy:  0.955, Validation Accuracy:  0.971, Loss:  1.172\n",
      "Epoch   7 Batch  426/538 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  1.153\n",
      "Epoch   7 Batch  427/538 - Train Accuracy:  0.948, Validation Accuracy:  0.967, Loss:  1.152\n",
      "Epoch   7 Batch  428/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.115\n",
      "Epoch   7 Batch  429/538 - Train Accuracy:  0.976, Validation Accuracy:  0.957, Loss:  1.170\n",
      "Epoch   7 Batch  430/538 - Train Accuracy:  0.947, Validation Accuracy:  0.960, Loss:  1.142\n",
      "Epoch   7 Batch  431/538 - Train Accuracy:  0.958, Validation Accuracy:  0.958, Loss:  1.173\n",
      "Epoch   7 Batch  432/538 - Train Accuracy:  0.957, Validation Accuracy:  0.964, Loss:  1.143\n",
      "Epoch   7 Batch  433/538 - Train Accuracy:  0.951, Validation Accuracy:  0.960, Loss:  1.213\n",
      "Epoch   7 Batch  434/538 - Train Accuracy:  0.949, Validation Accuracy:  0.964, Loss:  1.146\n",
      "Epoch   7 Batch  435/538 - Train Accuracy:  0.956, Validation Accuracy:  0.966, Loss:  1.152\n",
      "Epoch   7 Batch  436/538 - Train Accuracy:  0.950, Validation Accuracy:  0.966, Loss:  1.131\n",
      "Epoch   7 Batch  437/538 - Train Accuracy:  0.968, Validation Accuracy:  0.962, Loss:  1.202\n",
      "Epoch   7 Batch  438/538 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  1.150\n",
      "Epoch   7 Batch  439/538 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  1.162\n",
      "Epoch   7 Batch  440/538 - Train Accuracy:  0.976, Validation Accuracy:  0.960, Loss:  1.113\n",
      "Epoch   7 Batch  441/538 - Train Accuracy:  0.949, Validation Accuracy:  0.953, Loss:  1.199\n",
      "Epoch   7 Batch  442/538 - Train Accuracy:  0.973, Validation Accuracy:  0.953, Loss:  1.147\n",
      "Epoch   7 Batch  443/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  1.157\n",
      "Epoch   7 Batch  444/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.205\n",
      "Epoch   7 Batch  445/538 - Train Accuracy:  0.977, Validation Accuracy:  0.959, Loss:  1.126\n",
      "Epoch   7 Batch  446/538 - Train Accuracy:  0.968, Validation Accuracy:  0.957, Loss:  1.134\n",
      "Epoch   7 Batch  447/538 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  1.107\n",
      "Epoch   7 Batch  448/538 - Train Accuracy:  0.965, Validation Accuracy:  0.952, Loss:  1.126\n",
      "Epoch   7 Batch  449/538 - Train Accuracy:  0.967, Validation Accuracy:  0.955, Loss:  1.184\n",
      "Epoch   7 Batch  450/538 - Train Accuracy:  0.947, Validation Accuracy:  0.957, Loss:  1.174\n",
      "Epoch   7 Batch  451/538 - Train Accuracy:  0.947, Validation Accuracy:  0.959, Loss:  1.202\n",
      "Epoch   7 Batch  452/538 - Train Accuracy:  0.962, Validation Accuracy:  0.958, Loss:  1.155\n",
      "Epoch   7 Batch  453/538 - Train Accuracy:  0.949, Validation Accuracy:  0.959, Loss:  1.183\n",
      "Epoch   7 Batch  454/538 - Train Accuracy:  0.971, Validation Accuracy:  0.959, Loss:  1.176\n",
      "Epoch   7 Batch  455/538 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  1.142\n",
      "Epoch   7 Batch  456/538 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  1.199\n",
      "Epoch   7 Batch  457/538 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  1.191\n",
      "Epoch   7 Batch  458/538 - Train Accuracy:  0.976, Validation Accuracy:  0.955, Loss:  1.107\n",
      "Epoch   7 Batch  459/538 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  1.122\n",
      "Epoch   7 Batch  460/538 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  1.153\n",
      "Epoch   7 Batch  461/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.158\n",
      "Epoch   7 Batch  462/538 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  1.146\n",
      "Epoch   7 Batch  463/538 - Train Accuracy:  0.953, Validation Accuracy:  0.960, Loss:  1.156\n",
      "Epoch   7 Batch  464/538 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  1.184\n",
      "Epoch   7 Batch  465/538 - Train Accuracy:  0.966, Validation Accuracy:  0.958, Loss:  1.168\n",
      "Epoch   7 Batch  466/538 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  1.189\n",
      "Epoch   7 Batch  467/538 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  1.194\n",
      "Epoch   7 Batch  468/538 - Train Accuracy:  0.959, Validation Accuracy:  0.954, Loss:  1.152\n",
      "Epoch   7 Batch  469/538 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  1.064\n",
      "Epoch   7 Batch  470/538 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  1.151\n",
      "Epoch   7 Batch  471/538 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  1.219\n",
      "Epoch   7 Batch  472/538 - Train Accuracy:  0.981, Validation Accuracy:  0.959, Loss:  1.204\n",
      "Epoch   7 Batch  473/538 - Train Accuracy:  0.956, Validation Accuracy:  0.959, Loss:  1.125\n",
      "Epoch   7 Batch  474/538 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  1.169\n",
      "Epoch   7 Batch  475/538 - Train Accuracy:  0.968, Validation Accuracy:  0.957, Loss:  1.144\n",
      "Epoch   7 Batch  476/538 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  1.131\n",
      "Epoch   7 Batch  477/538 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  1.204\n",
      "Epoch   7 Batch  478/538 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  1.203\n",
      "Epoch   7 Batch  479/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.155\n",
      "Epoch   7 Batch  480/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.145\n",
      "Epoch   7 Batch  481/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch   7 Batch  482/538 - Train Accuracy:  0.962, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch   7 Batch  483/538 - Train Accuracy:  0.942, Validation Accuracy:  0.968, Loss:  1.157\n",
      "Epoch   7 Batch  484/538 - Train Accuracy:  0.956, Validation Accuracy:  0.967, Loss:  1.201\n",
      "Epoch   7 Batch  485/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.198\n",
      "Epoch   7 Batch  486/538 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  1.132\n",
      "Epoch   7 Batch  487/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.152\n",
      "Epoch   7 Batch  488/538 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  1.158\n",
      "Epoch   7 Batch  489/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.140\n",
      "Epoch   7 Batch  490/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.150\n",
      "Epoch   7 Batch  491/538 - Train Accuracy:  0.946, Validation Accuracy:  0.969, Loss:  1.167\n",
      "Epoch   7 Batch  492/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.184\n",
      "Epoch   7 Batch  493/538 - Train Accuracy:  0.946, Validation Accuracy:  0.967, Loss:  1.135\n",
      "Epoch   7 Batch  494/538 - Train Accuracy:  0.951, Validation Accuracy:  0.969, Loss:  1.150\n",
      "Epoch   7 Batch  495/538 - Train Accuracy:  0.970, Validation Accuracy:  0.966, Loss:  1.198\n",
      "Epoch   7 Batch  496/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.144\n",
      "Epoch   7 Batch  497/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.162\n",
      "Epoch   7 Batch  498/538 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  1.192\n",
      "Epoch   7 Batch  499/538 - Train Accuracy:  0.955, Validation Accuracy:  0.953, Loss:  1.194\n",
      "Epoch   7 Batch  500/538 - Train Accuracy:  0.968, Validation Accuracy:  0.952, Loss:  1.183\n",
      "Epoch   7 Batch  501/538 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  1.164\n",
      "Epoch   7 Batch  502/538 - Train Accuracy:  0.952, Validation Accuracy:  0.953, Loss:  1.143\n",
      "Epoch   7 Batch  503/538 - Train Accuracy:  0.964, Validation Accuracy:  0.953, Loss:  1.123\n",
      "Epoch   7 Batch  504/538 - Train Accuracy:  0.972, Validation Accuracy:  0.953, Loss:  1.177\n",
      "Epoch   7 Batch  505/538 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  1.162\n",
      "Epoch   7 Batch  506/538 - Train Accuracy:  0.965, Validation Accuracy:  0.958, Loss:  1.166\n",
      "Epoch   7 Batch  507/538 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  1.172\n",
      "Epoch   7 Batch  508/538 - Train Accuracy:  0.962, Validation Accuracy:  0.958, Loss:  1.123\n",
      "Epoch   7 Batch  509/538 - Train Accuracy:  0.957, Validation Accuracy:  0.960, Loss:  1.198\n",
      "Epoch   7 Batch  510/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.123\n",
      "Epoch   7 Batch  511/538 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  1.164\n",
      "Epoch   7 Batch  512/538 - Train Accuracy:  0.970, Validation Accuracy:  0.957, Loss:  1.123\n",
      "Epoch   7 Batch  513/538 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  1.143\n",
      "Epoch   7 Batch  514/538 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  1.188\n",
      "Epoch   7 Batch  515/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.123\n",
      "Epoch   7 Batch  516/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.125\n",
      "Epoch   7 Batch  517/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.126\n",
      "Epoch   7 Batch  518/538 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  1.193\n",
      "Epoch   7 Batch  519/538 - Train Accuracy:  0.957, Validation Accuracy:  0.956, Loss:  1.116\n",
      "Epoch   7 Batch  520/538 - Train Accuracy:  0.970, Validation Accuracy:  0.955, Loss:  1.157\n",
      "Epoch   7 Batch  521/538 - Train Accuracy:  0.964, Validation Accuracy:  0.958, Loss:  1.182\n",
      "Epoch   7 Batch  522/538 - Train Accuracy:  0.966, Validation Accuracy:  0.958, Loss:  1.153\n",
      "Epoch   7 Batch  523/538 - Train Accuracy:  0.961, Validation Accuracy:  0.958, Loss:  1.200\n",
      "Epoch   7 Batch  524/538 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  1.150\n",
      "Epoch   7 Batch  525/538 - Train Accuracy:  0.966, Validation Accuracy:  0.953, Loss:  1.131\n",
      "Epoch   7 Batch  526/538 - Train Accuracy:  0.952, Validation Accuracy:  0.955, Loss:  1.102\n",
      "Epoch   7 Batch  527/538 - Train Accuracy:  0.975, Validation Accuracy:  0.953, Loss:  1.140\n",
      "Epoch   7 Batch  528/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  1.186\n",
      "Epoch   7 Batch  529/538 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  1.172\n",
      "Epoch   7 Batch  530/538 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  1.168\n",
      "Epoch   7 Batch  531/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.180\n",
      "Epoch   7 Batch  532/538 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  1.132\n",
      "Epoch   7 Batch  533/538 - Train Accuracy:  0.956, Validation Accuracy:  0.965, Loss:  1.204\n",
      "Epoch   7 Batch  534/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.137\n",
      "Epoch   7 Batch  535/538 - Train Accuracy:  0.966, Validation Accuracy:  0.968, Loss:  1.142\n",
      "Epoch   7 Batch  536/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.221\n",
      "Epoch   8 Batch    0/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch   8 Batch    1/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.135\n",
      "Epoch   8 Batch    2/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.155\n",
      "Epoch   8 Batch    3/538 - Train Accuracy:  0.970, Validation Accuracy:  0.959, Loss:  1.192\n",
      "Epoch   8 Batch    4/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.108\n",
      "Epoch   8 Batch    5/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.175\n",
      "Epoch   8 Batch    6/538 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  1.123\n",
      "Epoch   8 Batch    7/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.218\n",
      "Epoch   8 Batch    8/538 - Train Accuracy:  0.961, Validation Accuracy:  0.971, Loss:  1.208\n",
      "Epoch   8 Batch    9/538 - Train Accuracy:  0.954, Validation Accuracy:  0.963, Loss:  1.141\n",
      "Epoch   8 Batch   10/538 - Train Accuracy:  0.957, Validation Accuracy:  0.958, Loss:  1.155\n",
      "Epoch   8 Batch   11/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.141\n",
      "Epoch   8 Batch   12/538 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  1.210\n",
      "Epoch   8 Batch   13/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.183\n",
      "Epoch   8 Batch   14/538 - Train Accuracy:  0.957, Validation Accuracy:  0.957, Loss:  1.151\n",
      "Epoch   8 Batch   15/538 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  1.151\n",
      "Epoch   8 Batch   16/538 - Train Accuracy:  0.966, Validation Accuracy:  0.962, Loss:  1.139\n",
      "Epoch   8 Batch   17/538 - Train Accuracy:  0.968, Validation Accuracy:  0.961, Loss:  1.140\n",
      "Epoch   8 Batch   18/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.153\n",
      "Epoch   8 Batch   19/538 - Train Accuracy:  0.960, Validation Accuracy:  0.962, Loss:  1.183\n",
      "Epoch   8 Batch   20/538 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  1.164\n",
      "Epoch   8 Batch   21/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.202\n",
      "Epoch   8 Batch   22/538 - Train Accuracy:  0.943, Validation Accuracy:  0.953, Loss:  1.130\n",
      "Epoch   8 Batch   23/538 - Train Accuracy:  0.966, Validation Accuracy:  0.953, Loss:  1.169\n",
      "Epoch   8 Batch   24/538 - Train Accuracy:  0.971, Validation Accuracy:  0.952, Loss:  1.217\n",
      "Epoch   8 Batch   25/538 - Train Accuracy:  0.949, Validation Accuracy:  0.955, Loss:  1.174\n",
      "Epoch   8 Batch   26/538 - Train Accuracy:  0.966, Validation Accuracy:  0.950, Loss:  1.164\n",
      "Epoch   8 Batch   27/538 - Train Accuracy:  0.976, Validation Accuracy:  0.952, Loss:  1.151\n",
      "Epoch   8 Batch   28/538 - Train Accuracy:  0.958, Validation Accuracy:  0.950, Loss:  1.185\n",
      "Epoch   8 Batch   29/538 - Train Accuracy:  0.954, Validation Accuracy:  0.950, Loss:  1.139\n",
      "Epoch   8 Batch   30/538 - Train Accuracy:  0.961, Validation Accuracy:  0.948, Loss:  1.209\n",
      "Epoch   8 Batch   31/538 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  1.134\n",
      "Epoch   8 Batch   32/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.151\n",
      "Epoch   8 Batch   33/538 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  1.176\n",
      "Epoch   8 Batch   34/538 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  1.194\n",
      "Epoch   8 Batch   35/538 - Train Accuracy:  0.965, Validation Accuracy:  0.951, Loss:  1.147\n",
      "Epoch   8 Batch   36/538 - Train Accuracy:  0.965, Validation Accuracy:  0.950, Loss:  1.136\n",
      "Epoch   8 Batch   37/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.212\n",
      "Epoch   8 Batch   38/538 - Train Accuracy:  0.966, Validation Accuracy:  0.958, Loss:  1.132\n",
      "Epoch   8 Batch   39/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.142\n",
      "Epoch   8 Batch   40/538 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  1.138\n",
      "Epoch   8 Batch   41/538 - Train Accuracy:  0.966, Validation Accuracy:  0.958, Loss:  1.179\n",
      "Epoch   8 Batch   42/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.172\n",
      "Epoch   8 Batch   43/538 - Train Accuracy:  0.943, Validation Accuracy:  0.959, Loss:  1.194\n",
      "Epoch   8 Batch   44/538 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  1.147\n",
      "Epoch   8 Batch   45/538 - Train Accuracy:  0.951, Validation Accuracy:  0.961, Loss:  1.168\n",
      "Epoch   8 Batch   46/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.156\n",
      "Epoch   8 Batch   47/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.142\n",
      "Epoch   8 Batch   48/538 - Train Accuracy:  0.952, Validation Accuracy:  0.961, Loss:  1.165\n",
      "Epoch   8 Batch   49/538 - Train Accuracy:  0.967, Validation Accuracy:  0.957, Loss:  1.142\n",
      "Epoch   8 Batch   50/538 - Train Accuracy:  0.960, Validation Accuracy:  0.960, Loss:  1.161\n",
      "Epoch   8 Batch   51/538 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  1.143\n",
      "Epoch   8 Batch   52/538 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  1.173\n",
      "Epoch   8 Batch   53/538 - Train Accuracy:  0.945, Validation Accuracy:  0.960, Loss:  1.187\n",
      "Epoch   8 Batch   54/538 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  1.186\n",
      "Epoch   8 Batch   55/538 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  1.201\n",
      "Epoch   8 Batch   56/538 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  1.148\n",
      "Epoch   8 Batch   57/538 - Train Accuracy:  0.938, Validation Accuracy:  0.958, Loss:  1.181\n",
      "Epoch   8 Batch   58/538 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  1.144\n",
      "Epoch   8 Batch   59/538 - Train Accuracy:  0.956, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch   8 Batch   60/538 - Train Accuracy:  0.976, Validation Accuracy:  0.966, Loss:  1.173\n",
      "Epoch   8 Batch   61/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.191\n",
      "Epoch   8 Batch   62/538 - Train Accuracy:  0.960, Validation Accuracy:  0.968, Loss:  1.154\n",
      "Epoch   8 Batch   63/538 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  1.131\n",
      "Epoch   8 Batch   64/538 - Train Accuracy:  0.963, Validation Accuracy:  0.965, Loss:  1.155\n",
      "Epoch   8 Batch   65/538 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  1.118\n",
      "Epoch   8 Batch   66/538 - Train Accuracy:  0.971, Validation Accuracy:  0.959, Loss:  1.198\n",
      "Epoch   8 Batch   67/538 - Train Accuracy:  0.969, Validation Accuracy:  0.959, Loss:  1.211\n",
      "Epoch   8 Batch   68/538 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  1.185\n",
      "Epoch   8 Batch   69/538 - Train Accuracy:  0.971, Validation Accuracy:  0.957, Loss:  1.132\n",
      "Epoch   8 Batch   70/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.159\n",
      "Epoch   8 Batch   71/538 - Train Accuracy:  0.958, Validation Accuracy:  0.961, Loss:  1.123\n",
      "Epoch   8 Batch   72/538 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  1.202\n",
      "Epoch   8 Batch   73/538 - Train Accuracy:  0.950, Validation Accuracy:  0.958, Loss:  1.140\n",
      "Epoch   8 Batch   74/538 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  1.178\n",
      "Epoch   8 Batch   75/538 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  1.157\n",
      "Epoch   8 Batch   76/538 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  1.158\n",
      "Epoch   8 Batch   77/538 - Train Accuracy:  0.966, Validation Accuracy:  0.965, Loss:  1.163\n",
      "Epoch   8 Batch   78/538 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  1.122\n",
      "Epoch   8 Batch   79/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.168\n",
      "Epoch   8 Batch   80/538 - Train Accuracy:  0.962, Validation Accuracy:  0.965, Loss:  1.155\n",
      "Epoch   8 Batch   81/538 - Train Accuracy:  0.963, Validation Accuracy:  0.966, Loss:  1.204\n",
      "Epoch   8 Batch   82/538 - Train Accuracy:  0.955, Validation Accuracy:  0.971, Loss:  1.185\n",
      "Epoch   8 Batch   83/538 - Train Accuracy:  0.943, Validation Accuracy:  0.965, Loss:  1.159\n",
      "Epoch   8 Batch   84/538 - Train Accuracy:  0.951, Validation Accuracy:  0.965, Loss:  1.145\n",
      "Epoch   8 Batch   85/538 - Train Accuracy:  0.977, Validation Accuracy:  0.964, Loss:  1.149\n",
      "Epoch   8 Batch   86/538 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  1.145\n",
      "Epoch   8 Batch   87/538 - Train Accuracy:  0.957, Validation Accuracy:  0.952, Loss:  1.172\n",
      "Epoch   8 Batch   88/538 - Train Accuracy:  0.959, Validation Accuracy:  0.944, Loss:  1.182\n",
      "Epoch   8 Batch   89/538 - Train Accuracy:  0.953, Validation Accuracy:  0.944, Loss:  1.199\n",
      "Epoch   8 Batch   90/538 - Train Accuracy:  0.955, Validation Accuracy:  0.947, Loss:  1.157\n",
      "Epoch   8 Batch   91/538 - Train Accuracy:  0.956, Validation Accuracy:  0.950, Loss:  1.164\n",
      "Epoch   8 Batch   92/538 - Train Accuracy:  0.950, Validation Accuracy:  0.960, Loss:  1.141\n",
      "Epoch   8 Batch   93/538 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  1.156\n",
      "Epoch   8 Batch   94/538 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  1.184\n",
      "Epoch   8 Batch   95/538 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  1.145\n",
      "Epoch   8 Batch   96/538 - Train Accuracy:  0.971, Validation Accuracy:  0.960, Loss:  1.195\n",
      "Epoch   8 Batch   97/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.194\n",
      "Epoch   8 Batch   98/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.248\n",
      "Epoch   8 Batch   99/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.188\n",
      "Epoch   8 Batch  100/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.136\n",
      "Epoch   8 Batch  101/538 - Train Accuracy:  0.950, Validation Accuracy:  0.962, Loss:  1.189\n",
      "Epoch   8 Batch  102/538 - Train Accuracy:  0.954, Validation Accuracy:  0.959, Loss:  1.166\n",
      "Epoch   8 Batch  103/538 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  1.192\n",
      "Epoch   8 Batch  104/538 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  1.146\n",
      "Epoch   8 Batch  105/538 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  1.145\n",
      "Epoch   8 Batch  106/538 - Train Accuracy:  0.967, Validation Accuracy:  0.959, Loss:  1.137\n",
      "Epoch   8 Batch  107/538 - Train Accuracy:  0.956, Validation Accuracy:  0.961, Loss:  1.167\n",
      "Epoch   8 Batch  108/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.113\n",
      "Epoch   8 Batch  109/538 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  1.141\n",
      "Epoch   8 Batch  110/538 - Train Accuracy:  0.972, Validation Accuracy:  0.960, Loss:  1.120\n",
      "Epoch   8 Batch  111/538 - Train Accuracy:  0.969, Validation Accuracy:  0.959, Loss:  1.163\n",
      "Epoch   8 Batch  112/538 - Train Accuracy:  0.958, Validation Accuracy:  0.956, Loss:  1.165\n",
      "Epoch   8 Batch  113/538 - Train Accuracy:  0.943, Validation Accuracy:  0.956, Loss:  1.167\n",
      "Epoch   8 Batch  114/538 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  1.178\n",
      "Epoch   8 Batch  115/538 - Train Accuracy:  0.959, Validation Accuracy:  0.956, Loss:  1.177\n",
      "Epoch   8 Batch  116/538 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  1.148\n",
      "Epoch   8 Batch  117/538 - Train Accuracy:  0.965, Validation Accuracy:  0.958, Loss:  1.171\n",
      "Epoch   8 Batch  118/538 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  1.141\n",
      "Epoch   8 Batch  119/538 - Train Accuracy:  0.973, Validation Accuracy:  0.957, Loss:  1.202\n",
      "Epoch   8 Batch  120/538 - Train Accuracy:  0.974, Validation Accuracy:  0.956, Loss:  1.176\n",
      "Epoch   8 Batch  121/538 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  1.113\n",
      "Epoch   8 Batch  122/538 - Train Accuracy:  0.961, Validation Accuracy:  0.957, Loss:  1.149\n",
      "Epoch   8 Batch  123/538 - Train Accuracy:  0.957, Validation Accuracy:  0.959, Loss:  1.166\n",
      "Epoch   8 Batch  124/538 - Train Accuracy:  0.958, Validation Accuracy:  0.957, Loss:  1.144\n",
      "Epoch   8 Batch  125/538 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  1.151\n",
      "Epoch   8 Batch  126/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.188\n",
      "Epoch   8 Batch  127/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.144\n",
      "Epoch   8 Batch  128/538 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  1.187\n",
      "Epoch   8 Batch  129/538 - Train Accuracy:  0.977, Validation Accuracy:  0.962, Loss:  1.159\n",
      "Epoch   8 Batch  130/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.112\n",
      "Epoch   8 Batch  131/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.115\n",
      "Epoch   8 Batch  132/538 - Train Accuracy:  0.941, Validation Accuracy:  0.963, Loss:  1.108\n",
      "Epoch   8 Batch  133/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.144\n",
      "Epoch   8 Batch  134/538 - Train Accuracy:  0.962, Validation Accuracy:  0.964, Loss:  1.134\n",
      "Epoch   8 Batch  135/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.182\n",
      "Epoch   8 Batch  136/538 - Train Accuracy:  0.951, Validation Accuracy:  0.965, Loss:  1.123\n",
      "Epoch   8 Batch  137/538 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  1.169\n",
      "Epoch   8 Batch  138/538 - Train Accuracy:  0.957, Validation Accuracy:  0.955, Loss:  1.095\n",
      "Epoch   8 Batch  139/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.133\n",
      "Epoch   8 Batch  140/538 - Train Accuracy:  0.958, Validation Accuracy:  0.955, Loss:  1.125\n",
      "Epoch   8 Batch  141/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.151\n",
      "Epoch   8 Batch  142/538 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  1.171\n",
      "Epoch   8 Batch  143/538 - Train Accuracy:  0.960, Validation Accuracy:  0.957, Loss:  1.108\n",
      "Epoch   8 Batch  144/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.159\n",
      "Epoch   8 Batch  145/538 - Train Accuracy:  0.962, Validation Accuracy:  0.961, Loss:  1.090\n",
      "Epoch   8 Batch  146/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.146\n",
      "Epoch   8 Batch  147/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.146\n",
      "Epoch   8 Batch  148/538 - Train Accuracy:  0.946, Validation Accuracy:  0.960, Loss:  1.153\n",
      "Epoch   8 Batch  149/538 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  1.169\n",
      "Epoch   8 Batch  150/538 - Train Accuracy:  0.963, Validation Accuracy:  0.957, Loss:  1.130\n",
      "Epoch   8 Batch  151/538 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  1.160\n",
      "Epoch   8 Batch  152/538 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  1.179\n",
      "Epoch   8 Batch  153/538 - Train Accuracy:  0.948, Validation Accuracy:  0.959, Loss:  1.156\n",
      "Epoch   8 Batch  154/538 - Train Accuracy:  0.962, Validation Accuracy:  0.955, Loss:  1.166\n",
      "Epoch   8 Batch  155/538 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  1.142\n",
      "Epoch   8 Batch  156/538 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  1.179\n",
      "Epoch   8 Batch  157/538 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  1.209\n",
      "Epoch   8 Batch  158/538 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  1.175\n",
      "Epoch   8 Batch  159/538 - Train Accuracy:  0.973, Validation Accuracy:  0.954, Loss:  1.186\n",
      "Epoch   8 Batch  160/538 - Train Accuracy:  0.950, Validation Accuracy:  0.952, Loss:  1.181\n",
      "Epoch   8 Batch  161/538 - Train Accuracy:  0.958, Validation Accuracy:  0.947, Loss:  1.195\n",
      "Epoch   8 Batch  162/538 - Train Accuracy:  0.964, Validation Accuracy:  0.947, Loss:  1.186\n",
      "Epoch   8 Batch  163/538 - Train Accuracy:  0.948, Validation Accuracy:  0.955, Loss:  1.164\n",
      "Epoch   8 Batch  164/538 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  1.162\n",
      "Epoch   8 Batch  165/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.142\n",
      "Epoch   8 Batch  166/538 - Train Accuracy:  0.979, Validation Accuracy:  0.957, Loss:  1.137\n",
      "Epoch   8 Batch  167/538 - Train Accuracy:  0.959, Validation Accuracy:  0.958, Loss:  1.167\n",
      "Epoch   8 Batch  168/538 - Train Accuracy:  0.946, Validation Accuracy:  0.956, Loss:  1.157\n",
      "Epoch   8 Batch  169/538 - Train Accuracy:  0.977, Validation Accuracy:  0.960, Loss:  1.128\n",
      "Epoch   8 Batch  170/538 - Train Accuracy:  0.949, Validation Accuracy:  0.963, Loss:  1.171\n",
      "Epoch   8 Batch  171/538 - Train Accuracy:  0.947, Validation Accuracy:  0.961, Loss:  1.198\n",
      "Epoch   8 Batch  172/538 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  1.185\n",
      "Epoch   8 Batch  173/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.137\n",
      "Epoch   8 Batch  174/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.163\n",
      "Epoch   8 Batch  175/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.111\n",
      "Epoch   8 Batch  176/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.132\n",
      "Epoch   8 Batch  177/538 - Train Accuracy:  0.973, Validation Accuracy:  0.960, Loss:  1.186\n",
      "Epoch   8 Batch  178/538 - Train Accuracy:  0.965, Validation Accuracy:  0.957, Loss:  1.136\n",
      "Epoch   8 Batch  179/538 - Train Accuracy:  0.963, Validation Accuracy:  0.953, Loss:  1.142\n",
      "Epoch   8 Batch  180/538 - Train Accuracy:  0.959, Validation Accuracy:  0.951, Loss:  1.094\n",
      "Epoch   8 Batch  181/538 - Train Accuracy:  0.962, Validation Accuracy:  0.949, Loss:  1.136\n",
      "Epoch   8 Batch  182/538 - Train Accuracy:  0.978, Validation Accuracy:  0.949, Loss:  1.129\n",
      "Epoch   8 Batch  183/538 - Train Accuracy:  0.977, Validation Accuracy:  0.952, Loss:  1.154\n",
      "Epoch   8 Batch  184/538 - Train Accuracy:  0.962, Validation Accuracy:  0.951, Loss:  1.168\n",
      "Epoch   8 Batch  185/538 - Train Accuracy:  0.969, Validation Accuracy:  0.953, Loss:  1.140\n",
      "Epoch   8 Batch  186/538 - Train Accuracy:  0.953, Validation Accuracy:  0.953, Loss:  1.138\n",
      "Epoch   8 Batch  187/538 - Train Accuracy:  0.961, Validation Accuracy:  0.949, Loss:  1.106\n",
      "Epoch   8 Batch  188/538 - Train Accuracy:  0.966, Validation Accuracy:  0.951, Loss:  1.139\n",
      "Epoch   8 Batch  189/538 - Train Accuracy:  0.961, Validation Accuracy:  0.950, Loss:  1.177\n",
      "Epoch   8 Batch  190/538 - Train Accuracy:  0.945, Validation Accuracy:  0.954, Loss:  1.190\n",
      "Epoch   8 Batch  191/538 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  1.208\n",
      "Epoch   8 Batch  192/538 - Train Accuracy:  0.967, Validation Accuracy:  0.959, Loss:  1.134\n",
      "Epoch   8 Batch  193/538 - Train Accuracy:  0.962, Validation Accuracy:  0.958, Loss:  1.192\n",
      "Epoch   8 Batch  194/538 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  1.120\n",
      "Epoch   8 Batch  195/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.158\n",
      "Epoch   8 Batch  196/538 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  1.196\n",
      "Epoch   8 Batch  197/538 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  1.180\n",
      "Epoch   8 Batch  198/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.170\n",
      "Epoch   8 Batch  199/538 - Train Accuracy:  0.961, Validation Accuracy:  0.961, Loss:  1.184\n",
      "Epoch   8 Batch  200/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.177\n",
      "Epoch   8 Batch  201/538 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  1.181\n",
      "Epoch   8 Batch  202/538 - Train Accuracy:  0.976, Validation Accuracy:  0.953, Loss:  1.167\n",
      "Epoch   8 Batch  203/538 - Train Accuracy:  0.958, Validation Accuracy:  0.954, Loss:  1.174\n",
      "Epoch   8 Batch  204/538 - Train Accuracy:  0.959, Validation Accuracy:  0.950, Loss:  1.141\n",
      "Epoch   8 Batch  205/538 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  1.185\n",
      "Epoch   8 Batch  206/538 - Train Accuracy:  0.957, Validation Accuracy:  0.951, Loss:  1.138\n",
      "Epoch   8 Batch  207/538 - Train Accuracy:  0.970, Validation Accuracy:  0.956, Loss:  1.160\n",
      "Epoch   8 Batch  208/538 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  1.183\n",
      "Epoch   8 Batch  209/538 - Train Accuracy:  0.983, Validation Accuracy:  0.960, Loss:  1.140\n",
      "Epoch   8 Batch  210/538 - Train Accuracy:  0.953, Validation Accuracy:  0.961, Loss:  1.148\n",
      "Epoch   8 Batch  211/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.171\n",
      "Epoch   8 Batch  212/538 - Train Accuracy:  0.965, Validation Accuracy:  0.960, Loss:  1.132\n",
      "Epoch   8 Batch  213/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.158\n",
      "Epoch   8 Batch  214/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.148\n",
      "Epoch   8 Batch  215/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.184\n",
      "Epoch   8 Batch  216/538 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  1.190\n",
      "Epoch   8 Batch  217/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.207\n",
      "Epoch   8 Batch  218/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.179\n",
      "Epoch   8 Batch  219/538 - Train Accuracy:  0.968, Validation Accuracy:  0.961, Loss:  1.178\n",
      "Epoch   8 Batch  220/538 - Train Accuracy:  0.950, Validation Accuracy:  0.962, Loss:  1.150\n",
      "Epoch   8 Batch  221/538 - Train Accuracy:  0.967, Validation Accuracy:  0.952, Loss:  1.128\n",
      "Epoch   8 Batch  222/538 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  1.148\n",
      "Epoch   8 Batch  223/538 - Train Accuracy:  0.954, Validation Accuracy:  0.948, Loss:  1.156\n",
      "Epoch   8 Batch  224/538 - Train Accuracy:  0.955, Validation Accuracy:  0.948, Loss:  1.160\n",
      "Epoch   8 Batch  225/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  1.165\n",
      "Epoch   8 Batch  226/538 - Train Accuracy:  0.950, Validation Accuracy:  0.954, Loss:  1.168\n",
      "Epoch   8 Batch  227/538 - Train Accuracy:  0.952, Validation Accuracy:  0.956, Loss:  1.176\n",
      "Epoch   8 Batch  228/538 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  1.155\n",
      "Epoch   8 Batch  229/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.172\n",
      "Epoch   8 Batch  230/538 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  1.119\n",
      "Epoch   8 Batch  231/538 - Train Accuracy:  0.949, Validation Accuracy:  0.959, Loss:  1.147\n",
      "Epoch   8 Batch  232/538 - Train Accuracy:  0.964, Validation Accuracy:  0.960, Loss:  1.131\n",
      "Epoch   8 Batch  233/538 - Train Accuracy:  0.970, Validation Accuracy:  0.959, Loss:  1.149\n",
      "Epoch   8 Batch  234/538 - Train Accuracy:  0.965, Validation Accuracy:  0.960, Loss:  1.165\n",
      "Epoch   8 Batch  235/538 - Train Accuracy:  0.983, Validation Accuracy:  0.955, Loss:  1.207\n",
      "Epoch   8 Batch  236/538 - Train Accuracy:  0.956, Validation Accuracy:  0.959, Loss:  1.134\n",
      "Epoch   8 Batch  237/538 - Train Accuracy:  0.960, Validation Accuracy:  0.955, Loss:  1.122\n",
      "Epoch   8 Batch  238/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.158\n",
      "Epoch   8 Batch  239/538 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  1.135\n",
      "Epoch   8 Batch  240/538 - Train Accuracy:  0.970, Validation Accuracy:  0.966, Loss:  1.150\n",
      "Epoch   8 Batch  241/538 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  1.181\n",
      "Epoch   8 Batch  242/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.161\n",
      "Epoch   8 Batch  243/538 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  1.170\n",
      "Epoch   8 Batch  244/538 - Train Accuracy:  0.954, Validation Accuracy:  0.965, Loss:  1.121\n",
      "Epoch   8 Batch  245/538 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  1.128\n",
      "Epoch   8 Batch  246/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.139\n",
      "Epoch   8 Batch  247/538 - Train Accuracy:  0.956, Validation Accuracy:  0.971, Loss:  1.139\n",
      "Epoch   8 Batch  248/538 - Train Accuracy:  0.955, Validation Accuracy:  0.965, Loss:  1.191\n",
      "Epoch   8 Batch  249/538 - Train Accuracy:  0.971, Validation Accuracy:  0.958, Loss:  1.159\n",
      "Epoch   8 Batch  250/538 - Train Accuracy:  0.967, Validation Accuracy:  0.957, Loss:  1.186\n",
      "Epoch   8 Batch  251/538 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  1.170\n",
      "Epoch   8 Batch  252/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.153\n",
      "Epoch   8 Batch  253/538 - Train Accuracy:  0.954, Validation Accuracy:  0.962, Loss:  1.143\n",
      "Epoch   8 Batch  254/538 - Train Accuracy:  0.959, Validation Accuracy:  0.964, Loss:  1.211\n",
      "Epoch   8 Batch  255/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.156\n",
      "Epoch   8 Batch  256/538 - Train Accuracy:  0.954, Validation Accuracy:  0.969, Loss:  1.170\n",
      "Epoch   8 Batch  257/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.214\n",
      "Epoch   8 Batch  258/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.144\n",
      "Epoch   8 Batch  259/538 - Train Accuracy:  0.968, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch   8 Batch  260/538 - Train Accuracy:  0.946, Validation Accuracy:  0.969, Loss:  1.171\n",
      "Epoch   8 Batch  261/538 - Train Accuracy:  0.950, Validation Accuracy:  0.956, Loss:  1.201\n",
      "Epoch   8 Batch  262/538 - Train Accuracy:  0.972, Validation Accuracy:  0.954, Loss:  1.174\n",
      "Epoch   8 Batch  263/538 - Train Accuracy:  0.948, Validation Accuracy:  0.954, Loss:  1.214\n",
      "Epoch   8 Batch  264/538 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  1.143\n",
      "Epoch   8 Batch  265/538 - Train Accuracy:  0.952, Validation Accuracy:  0.959, Loss:  1.140\n",
      "Epoch   8 Batch  266/538 - Train Accuracy:  0.958, Validation Accuracy:  0.959, Loss:  1.122\n",
      "Epoch   8 Batch  267/538 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  1.132\n",
      "Epoch   8 Batch  268/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.094\n",
      "Epoch   8 Batch  269/538 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  1.167\n",
      "Epoch   8 Batch  270/538 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  1.144\n",
      "Epoch   8 Batch  271/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.129\n",
      "Epoch   8 Batch  272/538 - Train Accuracy:  0.950, Validation Accuracy:  0.966, Loss:  1.163\n",
      "Epoch   8 Batch  273/538 - Train Accuracy:  0.953, Validation Accuracy:  0.963, Loss:  1.137\n",
      "Epoch   8 Batch  274/538 - Train Accuracy:  0.953, Validation Accuracy:  0.960, Loss:  1.159\n",
      "Epoch   8 Batch  275/538 - Train Accuracy:  0.964, Validation Accuracy:  0.954, Loss:  1.129\n",
      "Epoch   8 Batch  276/538 - Train Accuracy:  0.954, Validation Accuracy:  0.957, Loss:  1.201\n",
      "Epoch   8 Batch  277/538 - Train Accuracy:  0.979, Validation Accuracy:  0.957, Loss:  1.210\n",
      "Epoch   8 Batch  278/538 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  1.138\n",
      "Epoch   8 Batch  279/538 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  1.167\n",
      "Epoch   8 Batch  280/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.146\n",
      "Epoch   8 Batch  281/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.170\n",
      "Epoch   8 Batch  282/538 - Train Accuracy:  0.965, Validation Accuracy:  0.970, Loss:  1.138\n",
      "Epoch   8 Batch  283/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch   8 Batch  284/538 - Train Accuracy:  0.951, Validation Accuracy:  0.971, Loss:  1.168\n",
      "Epoch   8 Batch  285/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.177\n",
      "Epoch   8 Batch  286/538 - Train Accuracy:  0.949, Validation Accuracy:  0.968, Loss:  1.155\n",
      "Epoch   8 Batch  287/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.181\n",
      "Epoch   8 Batch  288/538 - Train Accuracy:  0.967, Validation Accuracy:  0.974, Loss:  1.162\n",
      "Epoch   8 Batch  289/538 - Train Accuracy:  0.958, Validation Accuracy:  0.976, Loss:  1.139\n",
      "Epoch   8 Batch  290/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.155\n",
      "Epoch   8 Batch  291/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.132\n",
      "Epoch   8 Batch  292/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.161\n",
      "Epoch   8 Batch  293/538 - Train Accuracy:  0.959, Validation Accuracy:  0.966, Loss:  1.208\n",
      "Epoch   8 Batch  294/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.137\n",
      "Epoch   8 Batch  295/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.120\n",
      "Epoch   8 Batch  296/538 - Train Accuracy:  0.953, Validation Accuracy:  0.964, Loss:  1.198\n",
      "Epoch   8 Batch  297/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.179\n",
      "Epoch   8 Batch  298/538 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  1.120\n",
      "Epoch   8 Batch  299/538 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  1.146\n",
      "Epoch   8 Batch  300/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.192\n",
      "Epoch   8 Batch  301/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.186\n",
      "Epoch   8 Batch  302/538 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  1.113\n",
      "Epoch   8 Batch  303/538 - Train Accuracy:  0.968, Validation Accuracy:  0.962, Loss:  1.171\n",
      "Epoch   8 Batch  304/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.135\n",
      "Epoch   8 Batch  305/538 - Train Accuracy:  0.979, Validation Accuracy:  0.960, Loss:  1.161\n",
      "Epoch   8 Batch  306/538 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  1.129\n",
      "Epoch   8 Batch  307/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.128\n",
      "Epoch   8 Batch  308/538 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  1.120\n",
      "Epoch   8 Batch  309/538 - Train Accuracy:  0.981, Validation Accuracy:  0.960, Loss:  1.126\n",
      "Epoch   8 Batch  310/538 - Train Accuracy:  0.976, Validation Accuracy:  0.959, Loss:  1.169\n",
      "Epoch   8 Batch  311/538 - Train Accuracy:  0.961, Validation Accuracy:  0.956, Loss:  1.179\n",
      "Epoch   8 Batch  312/538 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  1.144\n",
      "Epoch   8 Batch  313/538 - Train Accuracy:  0.960, Validation Accuracy:  0.957, Loss:  1.142\n",
      "Epoch   8 Batch  314/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.120\n",
      "Epoch   8 Batch  315/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.198\n",
      "Epoch   8 Batch  316/538 - Train Accuracy:  0.957, Validation Accuracy:  0.962, Loss:  1.187\n",
      "Epoch   8 Batch  317/538 - Train Accuracy:  0.959, Validation Accuracy:  0.971, Loss:  1.128\n",
      "Epoch   8 Batch  318/538 - Train Accuracy:  0.961, Validation Accuracy:  0.970, Loss:  1.161\n",
      "Epoch   8 Batch  319/538 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  1.160\n",
      "Epoch   8 Batch  320/538 - Train Accuracy:  0.957, Validation Accuracy:  0.970, Loss:  1.183\n",
      "Epoch   8 Batch  321/538 - Train Accuracy:  0.956, Validation Accuracy:  0.965, Loss:  1.165\n",
      "Epoch   8 Batch  322/538 - Train Accuracy:  0.976, Validation Accuracy:  0.965, Loss:  1.163\n",
      "Epoch   8 Batch  323/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.118\n",
      "Epoch   8 Batch  324/538 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  1.174\n",
      "Epoch   8 Batch  325/538 - Train Accuracy:  0.964, Validation Accuracy:  0.952, Loss:  1.133\n",
      "Epoch   8 Batch  326/538 - Train Accuracy:  0.967, Validation Accuracy:  0.951, Loss:  1.187\n",
      "Epoch   8 Batch  327/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.142\n",
      "Epoch   8 Batch  328/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.142\n",
      "Epoch   8 Batch  329/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.120\n",
      "Epoch   8 Batch  330/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.146\n",
      "Epoch   8 Batch  331/538 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  1.160\n",
      "Epoch   8 Batch  332/538 - Train Accuracy:  0.957, Validation Accuracy:  0.965, Loss:  1.158\n",
      "Epoch   8 Batch  333/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.136\n",
      "Epoch   8 Batch  334/538 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  1.102\n",
      "Epoch   8 Batch  335/538 - Train Accuracy:  0.958, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch   8 Batch  336/538 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  1.141\n",
      "Epoch   8 Batch  337/538 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  1.141\n",
      "Epoch   8 Batch  338/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.153\n",
      "Epoch   8 Batch  339/538 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  1.164\n",
      "Epoch   8 Batch  340/538 - Train Accuracy:  0.960, Validation Accuracy:  0.967, Loss:  1.222\n",
      "Epoch   8 Batch  341/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.188\n",
      "Epoch   8 Batch  342/538 - Train Accuracy:  0.955, Validation Accuracy:  0.964, Loss:  1.171\n",
      "Epoch   8 Batch  343/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.155\n",
      "Epoch   8 Batch  344/538 - Train Accuracy:  0.956, Validation Accuracy:  0.967, Loss:  1.148\n",
      "Epoch   8 Batch  345/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.146\n",
      "Epoch   8 Batch  346/538 - Train Accuracy:  0.956, Validation Accuracy:  0.970, Loss:  1.109\n",
      "Epoch   8 Batch  347/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.195\n",
      "Epoch   8 Batch  348/538 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  1.139\n",
      "Epoch   8 Batch  349/538 - Train Accuracy:  0.981, Validation Accuracy:  0.965, Loss:  1.116\n",
      "Epoch   8 Batch  350/538 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  1.180\n",
      "Epoch   8 Batch  351/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.184\n",
      "Epoch   8 Batch  352/538 - Train Accuracy:  0.951, Validation Accuracy:  0.963, Loss:  1.155\n",
      "Epoch   8 Batch  353/538 - Train Accuracy:  0.965, Validation Accuracy:  0.966, Loss:  1.168\n",
      "Epoch   8 Batch  354/538 - Train Accuracy:  0.964, Validation Accuracy:  0.971, Loss:  1.169\n",
      "Epoch   8 Batch  355/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.228\n",
      "Epoch   8 Batch  356/538 - Train Accuracy:  0.981, Validation Accuracy:  0.964, Loss:  1.101\n",
      "Epoch   8 Batch  357/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.120\n",
      "Epoch   8 Batch  358/538 - Train Accuracy:  0.968, Validation Accuracy:  0.961, Loss:  1.113\n",
      "Epoch   8 Batch  359/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.167\n",
      "Epoch   8 Batch  360/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.196\n",
      "Epoch   8 Batch  361/538 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  1.184\n",
      "Epoch   8 Batch  362/538 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  1.167\n",
      "Epoch   8 Batch  363/538 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  1.141\n",
      "Epoch   8 Batch  364/538 - Train Accuracy:  0.958, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch   8 Batch  365/538 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  1.180\n",
      "Epoch   8 Batch  366/538 - Train Accuracy:  0.955, Validation Accuracy:  0.960, Loss:  1.146\n",
      "Epoch   8 Batch  367/538 - Train Accuracy:  0.980, Validation Accuracy:  0.959, Loss:  1.134\n",
      "Epoch   8 Batch  368/538 - Train Accuracy:  0.975, Validation Accuracy:  0.961, Loss:  1.169\n",
      "Epoch   8 Batch  369/538 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  1.123\n",
      "Epoch   8 Batch  370/538 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  1.198\n",
      "Epoch   8 Batch  371/538 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  1.149\n",
      "Epoch   8 Batch  372/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.173\n",
      "Epoch   8 Batch  373/538 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  1.177\n",
      "Epoch   8 Batch  374/538 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  1.154\n",
      "Epoch   8 Batch  375/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.095\n",
      "Epoch   8 Batch  376/538 - Train Accuracy:  0.960, Validation Accuracy:  0.956, Loss:  1.157\n",
      "Epoch   8 Batch  377/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.170\n",
      "Epoch   8 Batch  378/538 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  1.171\n",
      "Epoch   8 Batch  379/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.133\n",
      "Epoch   8 Batch  380/538 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  1.162\n",
      "Epoch   8 Batch  381/538 - Train Accuracy:  0.983, Validation Accuracy:  0.965, Loss:  1.162\n",
      "Epoch   8 Batch  382/538 - Train Accuracy:  0.947, Validation Accuracy:  0.963, Loss:  1.137\n",
      "Epoch   8 Batch  383/538 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  1.149\n",
      "Epoch   8 Batch  384/538 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  1.151\n",
      "Epoch   8 Batch  385/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.166\n",
      "Epoch   8 Batch  386/538 - Train Accuracy:  0.979, Validation Accuracy:  0.959, Loss:  1.169\n",
      "Epoch   8 Batch  387/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.124\n",
      "Epoch   8 Batch  388/538 - Train Accuracy:  0.962, Validation Accuracy:  0.954, Loss:  1.137\n",
      "Epoch   8 Batch  389/538 - Train Accuracy:  0.956, Validation Accuracy:  0.956, Loss:  1.160\n",
      "Epoch   8 Batch  390/538 - Train Accuracy:  0.964, Validation Accuracy:  0.956, Loss:  1.160\n",
      "Epoch   8 Batch  391/538 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  1.135\n",
      "Epoch   8 Batch  392/538 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  1.148\n",
      "Epoch   8 Batch  393/538 - Train Accuracy:  0.974, Validation Accuracy:  0.958, Loss:  1.168\n",
      "Epoch   8 Batch  394/538 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  1.098\n",
      "Epoch   8 Batch  395/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.206\n",
      "Epoch   8 Batch  396/538 - Train Accuracy:  0.974, Validation Accuracy:  0.963, Loss:  1.182\n",
      "Epoch   8 Batch  397/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.137\n",
      "Epoch   8 Batch  398/538 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  1.154\n",
      "Epoch   8 Batch  399/538 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  1.169\n",
      "Epoch   8 Batch  400/538 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  1.105\n",
      "Epoch   8 Batch  401/538 - Train Accuracy:  0.984, Validation Accuracy:  0.962, Loss:  1.134\n",
      "Epoch   8 Batch  402/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.147\n",
      "Epoch   8 Batch  403/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.101\n",
      "Epoch   8 Batch  404/538 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  1.128\n",
      "Epoch   8 Batch  405/538 - Train Accuracy:  0.977, Validation Accuracy:  0.962, Loss:  1.147\n",
      "Epoch   8 Batch  406/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.145\n",
      "Epoch   8 Batch  407/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.159\n",
      "Epoch   8 Batch  408/538 - Train Accuracy:  0.956, Validation Accuracy:  0.963, Loss:  1.146\n",
      "Epoch   8 Batch  409/538 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  1.182\n",
      "Epoch   8 Batch  410/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.186\n",
      "Epoch   8 Batch  411/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.219\n",
      "Epoch   8 Batch  412/538 - Train Accuracy:  0.977, Validation Accuracy:  0.955, Loss:  1.146\n",
      "Epoch   8 Batch  413/538 - Train Accuracy:  0.974, Validation Accuracy:  0.955, Loss:  1.080\n",
      "Epoch   8 Batch  414/538 - Train Accuracy:  0.942, Validation Accuracy:  0.962, Loss:  1.178\n",
      "Epoch   8 Batch  415/538 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  1.145\n",
      "Epoch   8 Batch  416/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.208\n",
      "Epoch   8 Batch  417/538 - Train Accuracy:  0.967, Validation Accuracy:  0.966, Loss:  1.169\n",
      "Epoch   8 Batch  418/538 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  1.152\n",
      "Epoch   8 Batch  419/538 - Train Accuracy:  0.968, Validation Accuracy:  0.964, Loss:  1.155\n",
      "Epoch   8 Batch  420/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch   8 Batch  421/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.158\n",
      "Epoch   8 Batch  422/538 - Train Accuracy:  0.976, Validation Accuracy:  0.960, Loss:  1.140\n",
      "Epoch   8 Batch  423/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.198\n",
      "Epoch   8 Batch  424/538 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  1.142\n",
      "Epoch   8 Batch  425/538 - Train Accuracy:  0.957, Validation Accuracy:  0.964, Loss:  1.164\n",
      "Epoch   8 Batch  426/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.151\n",
      "Epoch   8 Batch  427/538 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  1.115\n",
      "Epoch   8 Batch  428/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.167\n",
      "Epoch   8 Batch  429/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.183\n",
      "Epoch   8 Batch  430/538 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  1.170\n",
      "Epoch   8 Batch  431/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.161\n",
      "Epoch   8 Batch  432/538 - Train Accuracy:  0.958, Validation Accuracy:  0.953, Loss:  1.170\n",
      "Epoch   8 Batch  433/538 - Train Accuracy:  0.950, Validation Accuracy:  0.965, Loss:  1.161\n",
      "Epoch   8 Batch  434/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.109\n",
      "Epoch   8 Batch  435/538 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  1.166\n",
      "Epoch   8 Batch  436/538 - Train Accuracy:  0.949, Validation Accuracy:  0.957, Loss:  1.161\n",
      "Epoch   8 Batch  437/538 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  1.083\n",
      "Epoch   8 Batch  438/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.152\n",
      "Epoch   8 Batch  439/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.173\n",
      "Epoch   8 Batch  440/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.159\n",
      "Epoch   8 Batch  441/538 - Train Accuracy:  0.949, Validation Accuracy:  0.964, Loss:  1.159\n",
      "Epoch   8 Batch  442/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.192\n",
      "Epoch   8 Batch  443/538 - Train Accuracy:  0.959, Validation Accuracy:  0.964, Loss:  1.154\n",
      "Epoch   8 Batch  444/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.130\n",
      "Epoch   8 Batch  445/538 - Train Accuracy:  0.976, Validation Accuracy:  0.959, Loss:  1.181\n",
      "Epoch   8 Batch  446/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.174\n",
      "Epoch   8 Batch  447/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.151\n",
      "Epoch   8 Batch  448/538 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  1.162\n",
      "Epoch   8 Batch  449/538 - Train Accuracy:  0.975, Validation Accuracy:  0.961, Loss:  1.144\n",
      "Epoch   8 Batch  450/538 - Train Accuracy:  0.948, Validation Accuracy:  0.959, Loss:  1.192\n",
      "Epoch   8 Batch  451/538 - Train Accuracy:  0.958, Validation Accuracy:  0.960, Loss:  1.143\n",
      "Epoch   8 Batch  452/538 - Train Accuracy:  0.971, Validation Accuracy:  0.960, Loss:  1.130\n",
      "Epoch   8 Batch  453/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.200\n",
      "Epoch   8 Batch  454/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.141\n",
      "Epoch   8 Batch  455/538 - Train Accuracy:  0.968, Validation Accuracy:  0.969, Loss:  1.179\n",
      "Epoch   8 Batch  456/538 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  1.174\n",
      "Epoch   8 Batch  457/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.174\n",
      "Epoch   8 Batch  458/538 - Train Accuracy:  0.978, Validation Accuracy:  0.962, Loss:  1.150\n",
      "Epoch   8 Batch  459/538 - Train Accuracy:  0.967, Validation Accuracy:  0.966, Loss:  1.154\n",
      "Epoch   8 Batch  460/538 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch   8 Batch  461/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.178\n",
      "Epoch   8 Batch  462/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.141\n",
      "Epoch   8 Batch  463/538 - Train Accuracy:  0.943, Validation Accuracy:  0.972, Loss:  1.105\n",
      "Epoch   8 Batch  464/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.117\n",
      "Epoch   8 Batch  465/538 - Train Accuracy:  0.961, Validation Accuracy:  0.970, Loss:  1.140\n",
      "Epoch   8 Batch  466/538 - Train Accuracy:  0.959, Validation Accuracy:  0.969, Loss:  1.139\n",
      "Epoch   8 Batch  467/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.135\n",
      "Epoch   8 Batch  468/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.115\n",
      "Epoch   8 Batch  469/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.147\n",
      "Epoch   8 Batch  470/538 - Train Accuracy:  0.957, Validation Accuracy:  0.964, Loss:  1.169\n",
      "Epoch   8 Batch  471/538 - Train Accuracy:  0.984, Validation Accuracy:  0.962, Loss:  1.090\n",
      "Epoch   8 Batch  472/538 - Train Accuracy:  0.991, Validation Accuracy:  0.963, Loss:  1.218\n",
      "Epoch   8 Batch  473/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.201\n",
      "Epoch   8 Batch  474/538 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  1.117\n",
      "Epoch   8 Batch  475/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.195\n",
      "Epoch   8 Batch  476/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.171\n",
      "Epoch   8 Batch  477/538 - Train Accuracy:  0.975, Validation Accuracy:  0.963, Loss:  1.182\n",
      "Epoch   8 Batch  478/538 - Train Accuracy:  0.972, Validation Accuracy:  0.960, Loss:  1.111\n",
      "Epoch   8 Batch  479/538 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  1.140\n",
      "Epoch   8 Batch  480/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.148\n",
      "Epoch   8 Batch  481/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.132\n",
      "Epoch   8 Batch  482/538 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  1.128\n",
      "Epoch   8 Batch  483/538 - Train Accuracy:  0.953, Validation Accuracy:  0.969, Loss:  1.174\n",
      "Epoch   8 Batch  484/538 - Train Accuracy:  0.956, Validation Accuracy:  0.968, Loss:  1.176\n",
      "Epoch   8 Batch  485/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.160\n",
      "Epoch   8 Batch  486/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.140\n",
      "Epoch   8 Batch  487/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.159\n",
      "Epoch   8 Batch  488/538 - Train Accuracy:  0.969, Validation Accuracy:  0.972, Loss:  1.171\n",
      "Epoch   8 Batch  489/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.114\n",
      "Epoch   8 Batch  490/538 - Train Accuracy:  0.959, Validation Accuracy:  0.968, Loss:  1.109\n",
      "Epoch   8 Batch  491/538 - Train Accuracy:  0.946, Validation Accuracy:  0.964, Loss:  1.145\n",
      "Epoch   8 Batch  492/538 - Train Accuracy:  0.976, Validation Accuracy:  0.966, Loss:  1.148\n",
      "Epoch   8 Batch  493/538 - Train Accuracy:  0.963, Validation Accuracy:  0.965, Loss:  1.127\n",
      "Epoch   8 Batch  494/538 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  1.145\n",
      "Epoch   8 Batch  495/538 - Train Accuracy:  0.965, Validation Accuracy:  0.964, Loss:  1.166\n",
      "Epoch   8 Batch  496/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch   8 Batch  497/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.161\n",
      "Epoch   8 Batch  498/538 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  1.117\n",
      "Epoch   8 Batch  499/538 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  1.183\n",
      "Epoch   8 Batch  500/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.138\n",
      "Epoch   8 Batch  501/538 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  1.194\n",
      "Epoch   8 Batch  502/538 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  1.199\n",
      "Epoch   8 Batch  503/538 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  1.162\n",
      "Epoch   8 Batch  504/538 - Train Accuracy:  0.978, Validation Accuracy:  0.959, Loss:  1.123\n",
      "Epoch   8 Batch  505/538 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  1.138\n",
      "Epoch   8 Batch  506/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.163\n",
      "Epoch   8 Batch  507/538 - Train Accuracy:  0.955, Validation Accuracy:  0.961, Loss:  1.104\n",
      "Epoch   8 Batch  508/538 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  1.169\n",
      "Epoch   8 Batch  509/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.186\n",
      "Epoch   8 Batch  510/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.165\n",
      "Epoch   8 Batch  511/538 - Train Accuracy:  0.958, Validation Accuracy:  0.952, Loss:  1.141\n",
      "Epoch   8 Batch  512/538 - Train Accuracy:  0.975, Validation Accuracy:  0.949, Loss:  1.128\n",
      "Epoch   8 Batch  513/538 - Train Accuracy:  0.953, Validation Accuracy:  0.950, Loss:  1.129\n",
      "Epoch   8 Batch  514/538 - Train Accuracy:  0.970, Validation Accuracy:  0.953, Loss:  1.148\n",
      "Epoch   8 Batch  515/538 - Train Accuracy:  0.959, Validation Accuracy:  0.953, Loss:  1.167\n",
      "Epoch   8 Batch  516/538 - Train Accuracy:  0.969, Validation Accuracy:  0.955, Loss:  1.140\n",
      "Epoch   8 Batch  517/538 - Train Accuracy:  0.965, Validation Accuracy:  0.957, Loss:  1.186\n",
      "Epoch   8 Batch  518/538 - Train Accuracy:  0.976, Validation Accuracy:  0.956, Loss:  1.182\n",
      "Epoch   8 Batch  519/538 - Train Accuracy:  0.978, Validation Accuracy:  0.959, Loss:  1.153\n",
      "Epoch   8 Batch  520/538 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  1.131\n",
      "Epoch   8 Batch  521/538 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  1.165\n",
      "Epoch   8 Batch  522/538 - Train Accuracy:  0.972, Validation Accuracy:  0.960, Loss:  1.178\n",
      "Epoch   8 Batch  523/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.162\n",
      "Epoch   8 Batch  524/538 - Train Accuracy:  0.963, Validation Accuracy:  0.958, Loss:  1.122\n",
      "Epoch   8 Batch  525/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.152\n",
      "Epoch   8 Batch  526/538 - Train Accuracy:  0.957, Validation Accuracy:  0.961, Loss:  1.146\n",
      "Epoch   8 Batch  527/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.137\n",
      "Epoch   8 Batch  528/538 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  1.134\n",
      "Epoch   8 Batch  529/538 - Train Accuracy:  0.961, Validation Accuracy:  0.964, Loss:  1.166\n",
      "Epoch   8 Batch  530/538 - Train Accuracy:  0.960, Validation Accuracy:  0.964, Loss:  1.197\n",
      "Epoch   8 Batch  531/538 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  1.095\n",
      "Epoch   8 Batch  532/538 - Train Accuracy:  0.964, Validation Accuracy:  0.957, Loss:  1.134\n",
      "Epoch   8 Batch  533/538 - Train Accuracy:  0.956, Validation Accuracy:  0.957, Loss:  1.178\n",
      "Epoch   8 Batch  534/538 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  1.121\n",
      "Epoch   8 Batch  535/538 - Train Accuracy:  0.971, Validation Accuracy:  0.962, Loss:  1.141\n",
      "Epoch   8 Batch  536/538 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  1.160\n",
      "Epoch   9 Batch    0/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.155\n",
      "Epoch   9 Batch    1/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.184\n",
      "Epoch   9 Batch    2/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.163\n",
      "Epoch   9 Batch    3/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.173\n",
      "Epoch   9 Batch    4/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch   9 Batch    5/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.140\n",
      "Epoch   9 Batch    6/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.143\n",
      "Epoch   9 Batch    7/538 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  1.120\n",
      "Epoch   9 Batch    8/538 - Train Accuracy:  0.963, Validation Accuracy:  0.966, Loss:  1.128\n",
      "Epoch   9 Batch    9/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.121\n",
      "Epoch   9 Batch   10/538 - Train Accuracy:  0.950, Validation Accuracy:  0.965, Loss:  1.117\n",
      "Epoch   9 Batch   11/538 - Train Accuracy:  0.968, Validation Accuracy:  0.964, Loss:  1.145\n",
      "Epoch   9 Batch   12/538 - Train Accuracy:  0.965, Validation Accuracy:  0.956, Loss:  1.111\n",
      "Epoch   9 Batch   13/538 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  1.119\n",
      "Epoch   9 Batch   14/538 - Train Accuracy:  0.973, Validation Accuracy:  0.956, Loss:  1.170\n",
      "Epoch   9 Batch   15/538 - Train Accuracy:  0.959, Validation Accuracy:  0.961, Loss:  1.171\n",
      "Epoch   9 Batch   16/538 - Train Accuracy:  0.971, Validation Accuracy:  0.962, Loss:  1.121\n",
      "Epoch   9 Batch   17/538 - Train Accuracy:  0.974, Validation Accuracy:  0.958, Loss:  1.132\n",
      "Epoch   9 Batch   18/538 - Train Accuracy:  0.975, Validation Accuracy:  0.961, Loss:  1.172\n",
      "Epoch   9 Batch   19/538 - Train Accuracy:  0.977, Validation Accuracy:  0.957, Loss:  1.172\n",
      "Epoch   9 Batch   20/538 - Train Accuracy:  0.974, Validation Accuracy:  0.957, Loss:  1.170\n",
      "Epoch   9 Batch   21/538 - Train Accuracy:  0.987, Validation Accuracy:  0.953, Loss:  1.130\n",
      "Epoch   9 Batch   22/538 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  1.136\n",
      "Epoch   9 Batch   23/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.155\n",
      "Epoch   9 Batch   24/538 - Train Accuracy:  0.974, Validation Accuracy:  0.956, Loss:  1.163\n",
      "Epoch   9 Batch   25/538 - Train Accuracy:  0.953, Validation Accuracy:  0.956, Loss:  1.166\n",
      "Epoch   9 Batch   26/538 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  1.217\n",
      "Epoch   9 Batch   27/538 - Train Accuracy:  0.979, Validation Accuracy:  0.957, Loss:  1.137\n",
      "Epoch   9 Batch   28/538 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  1.184\n",
      "Epoch   9 Batch   29/538 - Train Accuracy:  0.975, Validation Accuracy:  0.959, Loss:  1.129\n",
      "Epoch   9 Batch   30/538 - Train Accuracy:  0.961, Validation Accuracy:  0.955, Loss:  1.190\n",
      "Epoch   9 Batch   31/538 - Train Accuracy:  0.983, Validation Accuracy:  0.954, Loss:  1.189\n",
      "Epoch   9 Batch   32/538 - Train Accuracy:  0.969, Validation Accuracy:  0.952, Loss:  1.155\n",
      "Epoch   9 Batch   33/538 - Train Accuracy:  0.964, Validation Accuracy:  0.951, Loss:  1.191\n",
      "Epoch   9 Batch   34/538 - Train Accuracy:  0.957, Validation Accuracy:  0.953, Loss:  1.147\n",
      "Epoch   9 Batch   35/538 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  1.159\n",
      "Epoch   9 Batch   36/538 - Train Accuracy:  0.969, Validation Accuracy:  0.954, Loss:  1.139\n",
      "Epoch   9 Batch   37/538 - Train Accuracy:  0.962, Validation Accuracy:  0.950, Loss:  1.136\n",
      "Epoch   9 Batch   38/538 - Train Accuracy:  0.973, Validation Accuracy:  0.952, Loss:  1.168\n",
      "Epoch   9 Batch   39/538 - Train Accuracy:  0.967, Validation Accuracy:  0.957, Loss:  1.127\n",
      "Epoch   9 Batch   40/538 - Train Accuracy:  0.975, Validation Accuracy:  0.960, Loss:  1.130\n",
      "Epoch   9 Batch   41/538 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  1.151\n",
      "Epoch   9 Batch   42/538 - Train Accuracy:  0.971, Validation Accuracy:  0.959, Loss:  1.193\n",
      "Epoch   9 Batch   43/538 - Train Accuracy:  0.951, Validation Accuracy:  0.958, Loss:  1.189\n",
      "Epoch   9 Batch   44/538 - Train Accuracy:  0.973, Validation Accuracy:  0.958, Loss:  1.185\n",
      "Epoch   9 Batch   45/538 - Train Accuracy:  0.966, Validation Accuracy:  0.961, Loss:  1.161\n",
      "Epoch   9 Batch   46/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.184\n",
      "Epoch   9 Batch   47/538 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  1.158\n",
      "Epoch   9 Batch   48/538 - Train Accuracy:  0.955, Validation Accuracy:  0.965, Loss:  1.147\n",
      "Epoch   9 Batch   49/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.142\n",
      "Epoch   9 Batch   50/538 - Train Accuracy:  0.966, Validation Accuracy:  0.958, Loss:  1.190\n",
      "Epoch   9 Batch   51/538 - Train Accuracy:  0.970, Validation Accuracy:  0.956, Loss:  1.150\n",
      "Epoch   9 Batch   52/538 - Train Accuracy:  0.969, Validation Accuracy:  0.954, Loss:  1.201\n",
      "Epoch   9 Batch   53/538 - Train Accuracy:  0.949, Validation Accuracy:  0.956, Loss:  1.122\n",
      "Epoch   9 Batch   54/538 - Train Accuracy:  0.963, Validation Accuracy:  0.952, Loss:  1.145\n",
      "Epoch   9 Batch   55/538 - Train Accuracy:  0.976, Validation Accuracy:  0.952, Loss:  1.154\n",
      "Epoch   9 Batch   56/538 - Train Accuracy:  0.981, Validation Accuracy:  0.957, Loss:  1.156\n",
      "Epoch   9 Batch   57/538 - Train Accuracy:  0.947, Validation Accuracy:  0.958, Loss:  1.210\n",
      "Epoch   9 Batch   58/538 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  1.090\n",
      "Epoch   9 Batch   59/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.124\n",
      "Epoch   9 Batch   60/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.146\n",
      "Epoch   9 Batch   61/538 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  1.207\n",
      "Epoch   9 Batch   62/538 - Train Accuracy:  0.959, Validation Accuracy:  0.957, Loss:  1.156\n",
      "Epoch   9 Batch   63/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.107\n",
      "Epoch   9 Batch   64/538 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  1.157\n",
      "Epoch   9 Batch   65/538 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  1.134\n",
      "Epoch   9 Batch   66/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.102\n",
      "Epoch   9 Batch   67/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.132\n",
      "Epoch   9 Batch   68/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.111\n",
      "Epoch   9 Batch   69/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.084\n",
      "Epoch   9 Batch   70/538 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  1.091\n",
      "Epoch   9 Batch   71/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.162\n",
      "Epoch   9 Batch   72/538 - Train Accuracy:  0.975, Validation Accuracy:  0.963, Loss:  1.175\n",
      "Epoch   9 Batch   73/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.130\n",
      "Epoch   9 Batch   74/538 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  1.143\n",
      "Epoch   9 Batch   75/538 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  1.150\n",
      "Epoch   9 Batch   76/538 - Train Accuracy:  0.968, Validation Accuracy:  0.961, Loss:  1.153\n",
      "Epoch   9 Batch   77/538 - Train Accuracy:  0.975, Validation Accuracy:  0.961, Loss:  1.162\n",
      "Epoch   9 Batch   78/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.147\n",
      "Epoch   9 Batch   79/538 - Train Accuracy:  0.965, Validation Accuracy:  0.962, Loss:  1.137\n",
      "Epoch   9 Batch   80/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.158\n",
      "Epoch   9 Batch   81/538 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  1.220\n",
      "Epoch   9 Batch   82/538 - Train Accuracy:  0.968, Validation Accuracy:  0.964, Loss:  1.190\n",
      "Epoch   9 Batch   83/538 - Train Accuracy:  0.965, Validation Accuracy:  0.970, Loss:  1.195\n",
      "Epoch   9 Batch   84/538 - Train Accuracy:  0.957, Validation Accuracy:  0.967, Loss:  1.151\n",
      "Epoch   9 Batch   85/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.125\n",
      "Epoch   9 Batch   86/538 - Train Accuracy:  0.974, Validation Accuracy:  0.967, Loss:  1.129\n",
      "Epoch   9 Batch   87/538 - Train Accuracy:  0.960, Validation Accuracy:  0.965, Loss:  1.176\n",
      "Epoch   9 Batch   88/538 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  1.175\n",
      "Epoch   9 Batch   89/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.123\n",
      "Epoch   9 Batch   90/538 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  1.167\n",
      "Epoch   9 Batch   91/538 - Train Accuracy:  0.956, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch   9 Batch   92/538 - Train Accuracy:  0.958, Validation Accuracy:  0.965, Loss:  1.107\n",
      "Epoch   9 Batch   93/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.202\n",
      "Epoch   9 Batch   94/538 - Train Accuracy:  0.968, Validation Accuracy:  0.964, Loss:  1.150\n",
      "Epoch   9 Batch   95/538 - Train Accuracy:  0.959, Validation Accuracy:  0.966, Loss:  1.164\n",
      "Epoch   9 Batch   96/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.123\n",
      "Epoch   9 Batch   97/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.159\n",
      "Epoch   9 Batch   98/538 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  1.150\n",
      "Epoch   9 Batch   99/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.171\n",
      "Epoch   9 Batch  100/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch   9 Batch  101/538 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch   9 Batch  102/538 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  1.150\n",
      "Epoch   9 Batch  103/538 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  1.205\n",
      "Epoch   9 Batch  104/538 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  1.169\n",
      "Epoch   9 Batch  105/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.175\n",
      "Epoch   9 Batch  106/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.148\n",
      "Epoch   9 Batch  107/538 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  1.128\n",
      "Epoch   9 Batch  108/538 - Train Accuracy:  0.978, Validation Accuracy:  0.962, Loss:  1.153\n",
      "Epoch   9 Batch  109/538 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  1.149\n",
      "Epoch   9 Batch  110/538 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  1.120\n",
      "Epoch   9 Batch  111/538 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  1.118\n",
      "Epoch   9 Batch  112/538 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  1.140\n",
      "Epoch   9 Batch  113/538 - Train Accuracy:  0.952, Validation Accuracy:  0.959, Loss:  1.183\n",
      "Epoch   9 Batch  114/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.101\n",
      "Epoch   9 Batch  115/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.159\n",
      "Epoch   9 Batch  116/538 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  1.147\n",
      "Epoch   9 Batch  117/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.182\n",
      "Epoch   9 Batch  118/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch   9 Batch  119/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.117\n",
      "Epoch   9 Batch  120/538 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  1.110\n",
      "Epoch   9 Batch  121/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.167\n",
      "Epoch   9 Batch  122/538 - Train Accuracy:  0.953, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch   9 Batch  123/538 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  1.159\n",
      "Epoch   9 Batch  124/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.181\n",
      "Epoch   9 Batch  125/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.195\n",
      "Epoch   9 Batch  126/538 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  1.179\n",
      "Epoch   9 Batch  127/538 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  1.226\n",
      "Epoch   9 Batch  128/538 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  1.123\n",
      "Epoch   9 Batch  129/538 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  1.117\n",
      "Epoch   9 Batch  130/538 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  1.125\n",
      "Epoch   9 Batch  131/538 - Train Accuracy:  0.973, Validation Accuracy:  0.958, Loss:  1.148\n",
      "Epoch   9 Batch  132/538 - Train Accuracy:  0.956, Validation Accuracy:  0.958, Loss:  1.152\n",
      "Epoch   9 Batch  133/538 - Train Accuracy:  0.967, Validation Accuracy:  0.958, Loss:  1.145\n",
      "Epoch   9 Batch  134/538 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  1.189\n",
      "Epoch   9 Batch  135/538 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  1.176\n",
      "Epoch   9 Batch  136/538 - Train Accuracy:  0.966, Validation Accuracy:  0.955, Loss:  1.158\n",
      "Epoch   9 Batch  137/538 - Train Accuracy:  0.954, Validation Accuracy:  0.953, Loss:  1.205\n",
      "Epoch   9 Batch  138/538 - Train Accuracy:  0.967, Validation Accuracy:  0.953, Loss:  1.163\n",
      "Epoch   9 Batch  139/538 - Train Accuracy:  0.966, Validation Accuracy:  0.954, Loss:  1.183\n",
      "Epoch   9 Batch  140/538 - Train Accuracy:  0.951, Validation Accuracy:  0.957, Loss:  1.149\n",
      "Epoch   9 Batch  141/538 - Train Accuracy:  0.977, Validation Accuracy:  0.958, Loss:  1.128\n",
      "Epoch   9 Batch  142/538 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  1.106\n",
      "Epoch   9 Batch  143/538 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  1.171\n",
      "Epoch   9 Batch  144/538 - Train Accuracy:  0.975, Validation Accuracy:  0.957, Loss:  1.182\n",
      "Epoch   9 Batch  145/538 - Train Accuracy:  0.963, Validation Accuracy:  0.956, Loss:  1.140\n",
      "Epoch   9 Batch  146/538 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  1.176\n",
      "Epoch   9 Batch  147/538 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  1.118\n",
      "Epoch   9 Batch  148/538 - Train Accuracy:  0.951, Validation Accuracy:  0.958, Loss:  1.150\n",
      "Epoch   9 Batch  149/538 - Train Accuracy:  0.969, Validation Accuracy:  0.956, Loss:  1.140\n",
      "Epoch   9 Batch  150/538 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  1.161\n",
      "Epoch   9 Batch  151/538 - Train Accuracy:  0.962, Validation Accuracy:  0.951, Loss:  1.155\n",
      "Epoch   9 Batch  152/538 - Train Accuracy:  0.976, Validation Accuracy:  0.950, Loss:  1.169\n",
      "Epoch   9 Batch  153/538 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  1.145\n",
      "Epoch   9 Batch  154/538 - Train Accuracy:  0.968, Validation Accuracy:  0.953, Loss:  1.114\n",
      "Epoch   9 Batch  155/538 - Train Accuracy:  0.968, Validation Accuracy:  0.951, Loss:  1.131\n",
      "Epoch   9 Batch  156/538 - Train Accuracy:  0.977, Validation Accuracy:  0.953, Loss:  1.127\n",
      "Epoch   9 Batch  157/538 - Train Accuracy:  0.977, Validation Accuracy:  0.955, Loss:  1.150\n",
      "Epoch   9 Batch  158/538 - Train Accuracy:  0.974, Validation Accuracy:  0.959, Loss:  1.173\n",
      "Epoch   9 Batch  159/538 - Train Accuracy:  0.968, Validation Accuracy:  0.955, Loss:  1.151\n",
      "Epoch   9 Batch  160/538 - Train Accuracy:  0.965, Validation Accuracy:  0.957, Loss:  1.165\n",
      "Epoch   9 Batch  161/538 - Train Accuracy:  0.967, Validation Accuracy:  0.959, Loss:  1.168\n",
      "Epoch   9 Batch  162/538 - Train Accuracy:  0.975, Validation Accuracy:  0.957, Loss:  1.186\n",
      "Epoch   9 Batch  163/538 - Train Accuracy:  0.966, Validation Accuracy:  0.961, Loss:  1.202\n",
      "Epoch   9 Batch  164/538 - Train Accuracy:  0.971, Validation Accuracy:  0.958, Loss:  1.183\n",
      "Epoch   9 Batch  165/538 - Train Accuracy:  0.978, Validation Accuracy:  0.956, Loss:  1.164\n",
      "Epoch   9 Batch  166/538 - Train Accuracy:  0.980, Validation Accuracy:  0.959, Loss:  1.179\n",
      "Epoch   9 Batch  167/538 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  1.138\n",
      "Epoch   9 Batch  168/538 - Train Accuracy:  0.949, Validation Accuracy:  0.959, Loss:  1.158\n",
      "Epoch   9 Batch  169/538 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  1.083\n",
      "Epoch   9 Batch  170/538 - Train Accuracy:  0.963, Validation Accuracy:  0.962, Loss:  1.119\n",
      "Epoch   9 Batch  171/538 - Train Accuracy:  0.960, Validation Accuracy:  0.957, Loss:  1.135\n",
      "Epoch   9 Batch  172/538 - Train Accuracy:  0.971, Validation Accuracy:  0.957, Loss:  1.148\n",
      "Epoch   9 Batch  173/538 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  1.166\n",
      "Epoch   9 Batch  174/538 - Train Accuracy:  0.976, Validation Accuracy:  0.956, Loss:  1.164\n",
      "Epoch   9 Batch  175/538 - Train Accuracy:  0.975, Validation Accuracy:  0.955, Loss:  1.142\n",
      "Epoch   9 Batch  176/538 - Train Accuracy:  0.963, Validation Accuracy:  0.955, Loss:  1.155\n",
      "Epoch   9 Batch  177/538 - Train Accuracy:  0.977, Validation Accuracy:  0.955, Loss:  1.128\n",
      "Epoch   9 Batch  178/538 - Train Accuracy:  0.964, Validation Accuracy:  0.956, Loss:  1.123\n",
      "Epoch   9 Batch  179/538 - Train Accuracy:  0.971, Validation Accuracy:  0.955, Loss:  1.111\n",
      "Epoch   9 Batch  180/538 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  1.160\n",
      "Epoch   9 Batch  181/538 - Train Accuracy:  0.971, Validation Accuracy:  0.959, Loss:  1.131\n",
      "Epoch   9 Batch  182/538 - Train Accuracy:  0.969, Validation Accuracy:  0.957, Loss:  1.171\n",
      "Epoch   9 Batch  183/538 - Train Accuracy:  0.986, Validation Accuracy:  0.959, Loss:  1.159\n",
      "Epoch   9 Batch  184/538 - Train Accuracy:  0.970, Validation Accuracy:  0.959, Loss:  1.147\n",
      "Epoch   9 Batch  185/538 - Train Accuracy:  0.979, Validation Accuracy:  0.961, Loss:  1.183\n",
      "Epoch   9 Batch  186/538 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  1.137\n",
      "Epoch   9 Batch  187/538 - Train Accuracy:  0.971, Validation Accuracy:  0.957, Loss:  1.171\n",
      "Epoch   9 Batch  188/538 - Train Accuracy:  0.976, Validation Accuracy:  0.958, Loss:  1.156\n",
      "Epoch   9 Batch  189/538 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  1.136\n",
      "Epoch   9 Batch  190/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.129\n",
      "Epoch   9 Batch  191/538 - Train Accuracy:  0.980, Validation Accuracy:  0.960, Loss:  1.149\n",
      "Epoch   9 Batch  192/538 - Train Accuracy:  0.975, Validation Accuracy:  0.957, Loss:  1.151\n",
      "Epoch   9 Batch  193/538 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  1.171\n",
      "Epoch   9 Batch  194/538 - Train Accuracy:  0.951, Validation Accuracy:  0.960, Loss:  1.180\n",
      "Epoch   9 Batch  195/538 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  1.171\n",
      "Epoch   9 Batch  196/538 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  1.126\n",
      "Epoch   9 Batch  197/538 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  1.125\n",
      "Epoch   9 Batch  198/538 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  1.139\n",
      "Epoch   9 Batch  199/538 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  1.152\n",
      "Epoch   9 Batch  200/538 - Train Accuracy:  0.972, Validation Accuracy:  0.958, Loss:  1.153\n",
      "Epoch   9 Batch  201/538 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  1.197\n",
      "Epoch   9 Batch  202/538 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  1.182\n",
      "Epoch   9 Batch  203/538 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  1.133\n",
      "Epoch   9 Batch  204/538 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  1.185\n",
      "Epoch   9 Batch  205/538 - Train Accuracy:  0.959, Validation Accuracy:  0.959, Loss:  1.178\n",
      "Epoch   9 Batch  206/538 - Train Accuracy:  0.968, Validation Accuracy:  0.960, Loss:  1.141\n",
      "Epoch   9 Batch  207/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.115\n",
      "Epoch   9 Batch  208/538 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  1.166\n",
      "Epoch   9 Batch  209/538 - Train Accuracy:  0.982, Validation Accuracy:  0.960, Loss:  1.134\n",
      "Epoch   9 Batch  210/538 - Train Accuracy:  0.967, Validation Accuracy:  0.960, Loss:  1.125\n",
      "Epoch   9 Batch  211/538 - Train Accuracy:  0.965, Validation Accuracy:  0.960, Loss:  1.162\n",
      "Epoch   9 Batch  212/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.153\n",
      "Epoch   9 Batch  213/538 - Train Accuracy:  0.977, Validation Accuracy:  0.964, Loss:  1.099\n",
      "Epoch   9 Batch  214/538 - Train Accuracy:  0.984, Validation Accuracy:  0.960, Loss:  1.142\n",
      "Epoch   9 Batch  215/538 - Train Accuracy:  0.984, Validation Accuracy:  0.960, Loss:  1.130\n",
      "Epoch   9 Batch  216/538 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  1.098\n",
      "Epoch   9 Batch  217/538 - Train Accuracy:  0.980, Validation Accuracy:  0.959, Loss:  1.194\n",
      "Epoch   9 Batch  218/538 - Train Accuracy:  0.974, Validation Accuracy:  0.958, Loss:  1.113\n",
      "Epoch   9 Batch  219/538 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  1.145\n",
      "Epoch   9 Batch  220/538 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  1.130\n",
      "Epoch   9 Batch  221/538 - Train Accuracy:  0.966, Validation Accuracy:  0.957, Loss:  1.169\n",
      "Epoch   9 Batch  222/538 - Train Accuracy:  0.969, Validation Accuracy:  0.955, Loss:  1.200\n",
      "Epoch   9 Batch  223/538 - Train Accuracy:  0.973, Validation Accuracy:  0.957, Loss:  1.129\n",
      "Epoch   9 Batch  224/538 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  1.129\n",
      "Epoch   9 Batch  225/538 - Train Accuracy:  0.968, Validation Accuracy:  0.956, Loss:  1.160\n",
      "Epoch   9 Batch  226/538 - Train Accuracy:  0.948, Validation Accuracy:  0.962, Loss:  1.153\n",
      "Epoch   9 Batch  227/538 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  1.145\n",
      "Epoch   9 Batch  228/538 - Train Accuracy:  0.968, Validation Accuracy:  0.969, Loss:  1.109\n",
      "Epoch   9 Batch  229/538 - Train Accuracy:  0.969, Validation Accuracy:  0.969, Loss:  1.122\n",
      "Epoch   9 Batch  230/538 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  1.133\n",
      "Epoch   9 Batch  231/538 - Train Accuracy:  0.966, Validation Accuracy:  0.972, Loss:  1.160\n",
      "Epoch   9 Batch  232/538 - Train Accuracy:  0.968, Validation Accuracy:  0.972, Loss:  1.112\n",
      "Epoch   9 Batch  233/538 - Train Accuracy:  0.978, Validation Accuracy:  0.973, Loss:  1.133\n",
      "Epoch   9 Batch  234/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.122\n",
      "Epoch   9 Batch  235/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.087\n",
      "Epoch   9 Batch  236/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.115\n",
      "Epoch   9 Batch  237/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.136\n",
      "Epoch   9 Batch  238/538 - Train Accuracy:  0.963, Validation Accuracy:  0.970, Loss:  1.204\n",
      "Epoch   9 Batch  239/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.172\n",
      "Epoch   9 Batch  240/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.097\n",
      "Epoch   9 Batch  241/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.144\n",
      "Epoch   9 Batch  242/538 - Train Accuracy:  0.982, Validation Accuracy:  0.964, Loss:  1.154\n",
      "Epoch   9 Batch  243/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.098\n",
      "Epoch   9 Batch  244/538 - Train Accuracy:  0.966, Validation Accuracy:  0.960, Loss:  1.181\n",
      "Epoch   9 Batch  245/538 - Train Accuracy:  0.963, Validation Accuracy:  0.959, Loss:  1.148\n",
      "Epoch   9 Batch  246/538 - Train Accuracy:  0.979, Validation Accuracy:  0.961, Loss:  1.114\n",
      "Epoch   9 Batch  247/538 - Train Accuracy:  0.954, Validation Accuracy:  0.961, Loss:  1.141\n",
      "Epoch   9 Batch  248/538 - Train Accuracy:  0.956, Validation Accuracy:  0.964, Loss:  1.127\n",
      "Epoch   9 Batch  249/538 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  1.120\n",
      "Epoch   9 Batch  250/538 - Train Accuracy:  0.972, Validation Accuracy:  0.952, Loss:  1.115\n",
      "Epoch   9 Batch  251/538 - Train Accuracy:  0.979, Validation Accuracy:  0.948, Loss:  1.153\n",
      "Epoch   9 Batch  252/538 - Train Accuracy:  0.975, Validation Accuracy:  0.947, Loss:  1.136\n",
      "Epoch   9 Batch  253/538 - Train Accuracy:  0.959, Validation Accuracy:  0.947, Loss:  1.121\n",
      "Epoch   9 Batch  254/538 - Train Accuracy:  0.964, Validation Accuracy:  0.949, Loss:  1.139\n",
      "Epoch   9 Batch  255/538 - Train Accuracy:  0.967, Validation Accuracy:  0.952, Loss:  1.158\n",
      "Epoch   9 Batch  256/538 - Train Accuracy:  0.954, Validation Accuracy:  0.958, Loss:  1.172\n",
      "Epoch   9 Batch  257/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.130\n",
      "Epoch   9 Batch  258/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.162\n",
      "Epoch   9 Batch  259/538 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  1.147\n",
      "Epoch   9 Batch  260/538 - Train Accuracy:  0.944, Validation Accuracy:  0.969, Loss:  1.151\n",
      "Epoch   9 Batch  261/538 - Train Accuracy:  0.958, Validation Accuracy:  0.967, Loss:  1.159\n",
      "Epoch   9 Batch  262/538 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  1.120\n",
      "Epoch   9 Batch  263/538 - Train Accuracy:  0.954, Validation Accuracy:  0.969, Loss:  1.165\n",
      "Epoch   9 Batch  264/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.115\n",
      "Epoch   9 Batch  265/538 - Train Accuracy:  0.956, Validation Accuracy:  0.974, Loss:  1.127\n",
      "Epoch   9 Batch  266/538 - Train Accuracy:  0.962, Validation Accuracy:  0.976, Loss:  1.121\n",
      "Epoch   9 Batch  267/538 - Train Accuracy:  0.955, Validation Accuracy:  0.969, Loss:  1.177\n",
      "Epoch   9 Batch  268/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.211\n",
      "Epoch   9 Batch  269/538 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  1.178\n",
      "Epoch   9 Batch  270/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.137\n",
      "Epoch   9 Batch  271/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.119\n",
      "Epoch   9 Batch  272/538 - Train Accuracy:  0.972, Validation Accuracy:  0.973, Loss:  1.179\n",
      "Epoch   9 Batch  273/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.083\n",
      "Epoch   9 Batch  274/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.143\n",
      "Epoch   9 Batch  275/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.179\n",
      "Epoch   9 Batch  276/538 - Train Accuracy:  0.965, Validation Accuracy:  0.961, Loss:  1.109\n",
      "Epoch   9 Batch  277/538 - Train Accuracy:  0.973, Validation Accuracy:  0.955, Loss:  1.170\n",
      "Epoch   9 Batch  278/538 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  1.096\n",
      "Epoch   9 Batch  279/538 - Train Accuracy:  0.960, Validation Accuracy:  0.965, Loss:  1.153\n",
      "Epoch   9 Batch  280/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.172\n",
      "Epoch   9 Batch  281/538 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  1.149\n",
      "Epoch   9 Batch  282/538 - Train Accuracy:  0.961, Validation Accuracy:  0.962, Loss:  1.092\n",
      "Epoch   9 Batch  283/538 - Train Accuracy:  0.981, Validation Accuracy:  0.963, Loss:  1.152\n",
      "Epoch   9 Batch  284/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.127\n",
      "Epoch   9 Batch  285/538 - Train Accuracy:  0.971, Validation Accuracy:  0.958, Loss:  1.128\n",
      "Epoch   9 Batch  286/538 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  1.157\n",
      "Epoch   9 Batch  287/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.120\n",
      "Epoch   9 Batch  288/538 - Train Accuracy:  0.965, Validation Accuracy:  0.966, Loss:  1.109\n",
      "Epoch   9 Batch  289/538 - Train Accuracy:  0.965, Validation Accuracy:  0.966, Loss:  1.160\n",
      "Epoch   9 Batch  290/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.165\n",
      "Epoch   9 Batch  291/538 - Train Accuracy:  0.978, Validation Accuracy:  0.960, Loss:  1.189\n",
      "Epoch   9 Batch  292/538 - Train Accuracy:  0.983, Validation Accuracy:  0.960, Loss:  1.162\n",
      "Epoch   9 Batch  293/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.166\n",
      "Epoch   9 Batch  294/538 - Train Accuracy:  0.969, Validation Accuracy:  0.958, Loss:  1.116\n",
      "Epoch   9 Batch  295/538 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  1.124\n",
      "Epoch   9 Batch  296/538 - Train Accuracy:  0.964, Validation Accuracy:  0.959, Loss:  1.165\n",
      "Epoch   9 Batch  297/538 - Train Accuracy:  0.983, Validation Accuracy:  0.959, Loss:  1.115\n",
      "Epoch   9 Batch  298/538 - Train Accuracy:  0.965, Validation Accuracy:  0.959, Loss:  1.186\n",
      "Epoch   9 Batch  299/538 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  1.166\n",
      "Epoch   9 Batch  300/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.126\n",
      "Epoch   9 Batch  301/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.196\n",
      "Epoch   9 Batch  302/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.159\n",
      "Epoch   9 Batch  303/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.162\n",
      "Epoch   9 Batch  304/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.063\n",
      "Epoch   9 Batch  305/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.141\n",
      "Epoch   9 Batch  306/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.151\n",
      "Epoch   9 Batch  307/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.155\n",
      "Epoch   9 Batch  308/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.130\n",
      "Epoch   9 Batch  309/538 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  1.163\n",
      "Epoch   9 Batch  310/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.161\n",
      "Epoch   9 Batch  311/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.148\n",
      "Epoch   9 Batch  312/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.120\n",
      "Epoch   9 Batch  313/538 - Train Accuracy:  0.962, Validation Accuracy:  0.969, Loss:  1.118\n",
      "Epoch   9 Batch  314/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.129\n",
      "Epoch   9 Batch  315/538 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  1.139\n",
      "Epoch   9 Batch  316/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.133\n",
      "Epoch   9 Batch  317/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.176\n",
      "Epoch   9 Batch  318/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.211\n",
      "Epoch   9 Batch  319/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.147\n",
      "Epoch   9 Batch  320/538 - Train Accuracy:  0.961, Validation Accuracy:  0.965, Loss:  1.148\n",
      "Epoch   9 Batch  321/538 - Train Accuracy:  0.958, Validation Accuracy:  0.965, Loss:  1.124\n",
      "Epoch   9 Batch  322/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.143\n",
      "Epoch   9 Batch  323/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.157\n",
      "Epoch   9 Batch  324/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.164\n",
      "Epoch   9 Batch  325/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.151\n",
      "Epoch   9 Batch  326/538 - Train Accuracy:  0.969, Validation Accuracy:  0.969, Loss:  1.160\n",
      "Epoch   9 Batch  327/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.150\n",
      "Epoch   9 Batch  328/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.170\n",
      "Epoch   9 Batch  329/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.128\n",
      "Epoch   9 Batch  330/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.167\n",
      "Epoch   9 Batch  331/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.184\n",
      "Epoch   9 Batch  332/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.246\n",
      "Epoch   9 Batch  333/538 - Train Accuracy:  0.964, Validation Accuracy:  0.966, Loss:  1.116\n",
      "Epoch   9 Batch  334/538 - Train Accuracy:  0.968, Validation Accuracy:  0.958, Loss:  1.096\n",
      "Epoch   9 Batch  335/538 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  1.167\n",
      "Epoch   9 Batch  336/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.123\n",
      "Epoch   9 Batch  337/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.193\n",
      "Epoch   9 Batch  338/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.135\n",
      "Epoch   9 Batch  339/538 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  1.201\n",
      "Epoch   9 Batch  340/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.153\n",
      "Epoch   9 Batch  341/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.200\n",
      "Epoch   9 Batch  342/538 - Train Accuracy:  0.961, Validation Accuracy:  0.971, Loss:  1.168\n",
      "Epoch   9 Batch  343/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch   9 Batch  344/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.199\n",
      "Epoch   9 Batch  345/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.185\n",
      "Epoch   9 Batch  346/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.128\n",
      "Epoch   9 Batch  347/538 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  1.165\n",
      "Epoch   9 Batch  348/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.177\n",
      "Epoch   9 Batch  349/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.159\n",
      "Epoch   9 Batch  350/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.122\n",
      "Epoch   9 Batch  351/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.129\n",
      "Epoch   9 Batch  352/538 - Train Accuracy:  0.959, Validation Accuracy:  0.968, Loss:  1.166\n",
      "Epoch   9 Batch  353/538 - Train Accuracy:  0.969, Validation Accuracy:  0.972, Loss:  1.119\n",
      "Epoch   9 Batch  354/538 - Train Accuracy:  0.980, Validation Accuracy:  0.962, Loss:  1.126\n",
      "Epoch   9 Batch  355/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.171\n",
      "Epoch   9 Batch  356/538 - Train Accuracy:  0.981, Validation Accuracy:  0.964, Loss:  1.171\n",
      "Epoch   9 Batch  357/538 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  1.116\n",
      "Epoch   9 Batch  358/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.170\n",
      "Epoch   9 Batch  359/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.128\n",
      "Epoch   9 Batch  360/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch   9 Batch  361/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.120\n",
      "Epoch   9 Batch  362/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.118\n",
      "Epoch   9 Batch  363/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.134\n",
      "Epoch   9 Batch  364/538 - Train Accuracy:  0.967, Validation Accuracy:  0.966, Loss:  1.179\n",
      "Epoch   9 Batch  365/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch   9 Batch  366/538 - Train Accuracy:  0.965, Validation Accuracy:  0.966, Loss:  1.136\n",
      "Epoch   9 Batch  367/538 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  1.147\n",
      "Epoch   9 Batch  368/538 - Train Accuracy:  0.986, Validation Accuracy:  0.964, Loss:  1.123\n",
      "Epoch   9 Batch  369/538 - Train Accuracy:  0.982, Validation Accuracy:  0.965, Loss:  1.113\n",
      "Epoch   9 Batch  370/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.121\n",
      "Epoch   9 Batch  371/538 - Train Accuracy:  0.978, Validation Accuracy:  0.962, Loss:  1.119\n",
      "Epoch   9 Batch  372/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.151\n",
      "Epoch   9 Batch  373/538 - Train Accuracy:  0.974, Validation Accuracy:  0.963, Loss:  1.174\n",
      "Epoch   9 Batch  374/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.109\n",
      "Epoch   9 Batch  375/538 - Train Accuracy:  0.969, Validation Accuracy:  0.961, Loss:  1.190\n",
      "Epoch   9 Batch  376/538 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  1.150\n",
      "Epoch   9 Batch  377/538 - Train Accuracy:  0.972, Validation Accuracy:  0.957, Loss:  1.120\n",
      "Epoch   9 Batch  378/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.118\n",
      "Epoch   9 Batch  379/538 - Train Accuracy:  0.975, Validation Accuracy:  0.955, Loss:  1.163\n",
      "Epoch   9 Batch  380/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.173\n",
      "Epoch   9 Batch  381/538 - Train Accuracy:  0.975, Validation Accuracy:  0.959, Loss:  1.147\n",
      "Epoch   9 Batch  382/538 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  1.138\n",
      "Epoch   9 Batch  383/538 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  1.115\n",
      "Epoch   9 Batch  384/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.143\n",
      "Epoch   9 Batch  385/538 - Train Accuracy:  0.970, Validation Accuracy:  0.955, Loss:  1.133\n",
      "Epoch   9 Batch  386/538 - Train Accuracy:  0.980, Validation Accuracy:  0.958, Loss:  1.179\n",
      "Epoch   9 Batch  387/538 - Train Accuracy:  0.963, Validation Accuracy:  0.955, Loss:  1.147\n",
      "Epoch   9 Batch  388/538 - Train Accuracy:  0.968, Validation Accuracy:  0.955, Loss:  1.148\n",
      "Epoch   9 Batch  389/538 - Train Accuracy:  0.960, Validation Accuracy:  0.953, Loss:  1.157\n",
      "Epoch   9 Batch  390/538 - Train Accuracy:  0.965, Validation Accuracy:  0.953, Loss:  1.149\n",
      "Epoch   9 Batch  391/538 - Train Accuracy:  0.971, Validation Accuracy:  0.957, Loss:  1.161\n",
      "Epoch   9 Batch  392/538 - Train Accuracy:  0.980, Validation Accuracy:  0.957, Loss:  1.141\n",
      "Epoch   9 Batch  393/538 - Train Accuracy:  0.974, Validation Accuracy:  0.959, Loss:  1.143\n",
      "Epoch   9 Batch  394/538 - Train Accuracy:  0.952, Validation Accuracy:  0.961, Loss:  1.145\n",
      "Epoch   9 Batch  395/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.168\n",
      "Epoch   9 Batch  396/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.141\n",
      "Epoch   9 Batch  397/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.161\n",
      "Epoch   9 Batch  398/538 - Train Accuracy:  0.972, Validation Accuracy:  0.975, Loss:  1.126\n",
      "Epoch   9 Batch  399/538 - Train Accuracy:  0.964, Validation Accuracy:  0.975, Loss:  1.184\n",
      "Epoch   9 Batch  400/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch   9 Batch  401/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.186\n",
      "Epoch   9 Batch  402/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.134\n",
      "Epoch   9 Batch  403/538 - Train Accuracy:  0.956, Validation Accuracy:  0.968, Loss:  1.167\n",
      "Epoch   9 Batch  404/538 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  1.172\n",
      "Epoch   9 Batch  405/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.181\n",
      "Epoch   9 Batch  406/538 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  1.117\n",
      "Epoch   9 Batch  407/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.192\n",
      "Epoch   9 Batch  408/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.166\n",
      "Epoch   9 Batch  409/538 - Train Accuracy:  0.962, Validation Accuracy:  0.968, Loss:  1.174\n",
      "Epoch   9 Batch  410/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.135\n",
      "Epoch   9 Batch  411/538 - Train Accuracy:  0.971, Validation Accuracy:  0.962, Loss:  1.160\n",
      "Epoch   9 Batch  412/538 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  1.084\n",
      "Epoch   9 Batch  413/538 - Train Accuracy:  0.977, Validation Accuracy:  0.960, Loss:  1.161\n",
      "Epoch   9 Batch  414/538 - Train Accuracy:  0.944, Validation Accuracy:  0.957, Loss:  1.203\n",
      "Epoch   9 Batch  415/538 - Train Accuracy:  0.960, Validation Accuracy:  0.958, Loss:  1.090\n",
      "Epoch   9 Batch  416/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.136\n",
      "Epoch   9 Batch  417/538 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  1.155\n",
      "Epoch   9 Batch  418/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.159\n",
      "Epoch   9 Batch  419/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.158\n",
      "Epoch   9 Batch  420/538 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch   9 Batch  421/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.147\n",
      "Epoch   9 Batch  422/538 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  1.141\n",
      "Epoch   9 Batch  423/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.125\n",
      "Epoch   9 Batch  424/538 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  1.155\n",
      "Epoch   9 Batch  425/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.140\n",
      "Epoch   9 Batch  426/538 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  1.119\n",
      "Epoch   9 Batch  427/538 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  1.104\n",
      "Epoch   9 Batch  428/538 - Train Accuracy:  0.965, Validation Accuracy:  0.964, Loss:  1.212\n",
      "Epoch   9 Batch  429/538 - Train Accuracy:  0.983, Validation Accuracy:  0.964, Loss:  1.140\n",
      "Epoch   9 Batch  430/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.106\n",
      "Epoch   9 Batch  431/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.102\n",
      "Epoch   9 Batch  432/538 - Train Accuracy:  0.965, Validation Accuracy:  0.964, Loss:  1.159\n",
      "Epoch   9 Batch  433/538 - Train Accuracy:  0.968, Validation Accuracy:  0.967, Loss:  1.215\n",
      "Epoch   9 Batch  434/538 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  1.104\n",
      "Epoch   9 Batch  435/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.144\n",
      "Epoch   9 Batch  436/538 - Train Accuracy:  0.958, Validation Accuracy:  0.966, Loss:  1.107\n",
      "Epoch   9 Batch  437/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch   9 Batch  438/538 - Train Accuracy:  0.961, Validation Accuracy:  0.972, Loss:  1.149\n",
      "Epoch   9 Batch  439/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.208\n",
      "Epoch   9 Batch  440/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.161\n",
      "Epoch   9 Batch  441/538 - Train Accuracy:  0.966, Validation Accuracy:  0.975, Loss:  1.145\n",
      "Epoch   9 Batch  442/538 - Train Accuracy:  0.974, Validation Accuracy:  0.973, Loss:  1.198\n",
      "Epoch   9 Batch  443/538 - Train Accuracy:  0.960, Validation Accuracy:  0.973, Loss:  1.122\n",
      "Epoch   9 Batch  444/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.152\n",
      "Epoch   9 Batch  445/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.210\n",
      "Epoch   9 Batch  446/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.124\n",
      "Epoch   9 Batch  447/538 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  1.156\n",
      "Epoch   9 Batch  448/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.219\n",
      "Epoch   9 Batch  449/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.161\n",
      "Epoch   9 Batch  450/538 - Train Accuracy:  0.954, Validation Accuracy:  0.965, Loss:  1.219\n",
      "Epoch   9 Batch  451/538 - Train Accuracy:  0.960, Validation Accuracy:  0.962, Loss:  1.161\n",
      "Epoch   9 Batch  452/538 - Train Accuracy:  0.967, Validation Accuracy:  0.954, Loss:  1.181\n",
      "Epoch   9 Batch  453/538 - Train Accuracy:  0.955, Validation Accuracy:  0.957, Loss:  1.185\n",
      "Epoch   9 Batch  454/538 - Train Accuracy:  0.974, Validation Accuracy:  0.960, Loss:  1.204\n",
      "Epoch   9 Batch  455/538 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  1.142\n",
      "Epoch   9 Batch  456/538 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  1.172\n",
      "Epoch   9 Batch  457/538 - Train Accuracy:  0.976, Validation Accuracy:  0.965, Loss:  1.101\n",
      "Epoch   9 Batch  458/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.136\n",
      "Epoch   9 Batch  459/538 - Train Accuracy:  0.985, Validation Accuracy:  0.966, Loss:  1.160\n",
      "Epoch   9 Batch  460/538 - Train Accuracy:  0.962, Validation Accuracy:  0.969, Loss:  1.222\n",
      "Epoch   9 Batch  461/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.145\n",
      "Epoch   9 Batch  462/538 - Train Accuracy:  0.960, Validation Accuracy:  0.969, Loss:  1.115\n",
      "Epoch   9 Batch  463/538 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  1.116\n",
      "Epoch   9 Batch  464/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.162\n",
      "Epoch   9 Batch  465/538 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  1.101\n",
      "Epoch   9 Batch  466/538 - Train Accuracy:  0.963, Validation Accuracy:  0.965, Loss:  1.213\n",
      "Epoch   9 Batch  467/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.176\n",
      "Epoch   9 Batch  468/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.154\n",
      "Epoch   9 Batch  469/538 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  1.159\n",
      "Epoch   9 Batch  470/538 - Train Accuracy:  0.960, Validation Accuracy:  0.965, Loss:  1.175\n",
      "Epoch   9 Batch  471/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.190\n",
      "Epoch   9 Batch  472/538 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  1.125\n",
      "Epoch   9 Batch  473/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.145\n",
      "Epoch   9 Batch  474/538 - Train Accuracy:  0.951, Validation Accuracy:  0.971, Loss:  1.144\n",
      "Epoch   9 Batch  475/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.138\n",
      "Epoch   9 Batch  476/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.161\n",
      "Epoch   9 Batch  477/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.151\n",
      "Epoch   9 Batch  478/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.097\n",
      "Epoch   9 Batch  479/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.152\n",
      "Epoch   9 Batch  480/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.153\n",
      "Epoch   9 Batch  481/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.181\n",
      "Epoch   9 Batch  482/538 - Train Accuracy:  0.964, Validation Accuracy:  0.968, Loss:  1.181\n",
      "Epoch   9 Batch  483/538 - Train Accuracy:  0.958, Validation Accuracy:  0.968, Loss:  1.173\n",
      "Epoch   9 Batch  484/538 - Train Accuracy:  0.952, Validation Accuracy:  0.966, Loss:  1.137\n",
      "Epoch   9 Batch  485/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.112\n",
      "Epoch   9 Batch  486/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.128\n",
      "Epoch   9 Batch  487/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.134\n",
      "Epoch   9 Batch  488/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.119\n",
      "Epoch   9 Batch  489/538 - Train Accuracy:  0.965, Validation Accuracy:  0.965, Loss:  1.163\n",
      "Epoch   9 Batch  490/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.059\n",
      "Epoch   9 Batch  491/538 - Train Accuracy:  0.960, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch   9 Batch  492/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch   9 Batch  493/538 - Train Accuracy:  0.954, Validation Accuracy:  0.965, Loss:  1.193\n",
      "Epoch   9 Batch  494/538 - Train Accuracy:  0.968, Validation Accuracy:  0.964, Loss:  1.128\n",
      "Epoch   9 Batch  495/538 - Train Accuracy:  0.959, Validation Accuracy:  0.971, Loss:  1.183\n",
      "Epoch   9 Batch  496/538 - Train Accuracy:  0.966, Validation Accuracy:  0.975, Loss:  1.188\n",
      "Epoch   9 Batch  497/538 - Train Accuracy:  0.979, Validation Accuracy:  0.977, Loss:  1.176\n",
      "Epoch   9 Batch  498/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.172\n",
      "Epoch   9 Batch  499/538 - Train Accuracy:  0.958, Validation Accuracy:  0.979, Loss:  1.175\n",
      "Epoch   9 Batch  500/538 - Train Accuracy:  0.980, Validation Accuracy:  0.974, Loss:  1.162\n",
      "Epoch   9 Batch  501/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.139\n",
      "Epoch   9 Batch  502/538 - Train Accuracy:  0.964, Validation Accuracy:  0.968, Loss:  1.111\n",
      "Epoch   9 Batch  503/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.148\n",
      "Epoch   9 Batch  504/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.116\n",
      "Epoch   9 Batch  505/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.122\n",
      "Epoch   9 Batch  506/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch   9 Batch  507/538 - Train Accuracy:  0.968, Validation Accuracy:  0.973, Loss:  1.129\n",
      "Epoch   9 Batch  508/538 - Train Accuracy:  0.971, Validation Accuracy:  0.977, Loss:  1.170\n",
      "Epoch   9 Batch  509/538 - Train Accuracy:  0.966, Validation Accuracy:  0.975, Loss:  1.194\n",
      "Epoch   9 Batch  510/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.164\n",
      "Epoch   9 Batch  511/538 - Train Accuracy:  0.968, Validation Accuracy:  0.971, Loss:  1.128\n",
      "Epoch   9 Batch  512/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.203\n",
      "Epoch   9 Batch  513/538 - Train Accuracy:  0.961, Validation Accuracy:  0.971, Loss:  1.135\n",
      "Epoch   9 Batch  514/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.135\n",
      "Epoch   9 Batch  515/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.142\n",
      "Epoch   9 Batch  516/538 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  1.131\n",
      "Epoch   9 Batch  517/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.196\n",
      "Epoch   9 Batch  518/538 - Train Accuracy:  0.972, Validation Accuracy:  0.961, Loss:  1.159\n",
      "Epoch   9 Batch  519/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.193\n",
      "Epoch   9 Batch  520/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.138\n",
      "Epoch   9 Batch  521/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.194\n",
      "Epoch   9 Batch  522/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.096\n",
      "Epoch   9 Batch  523/538 - Train Accuracy:  0.959, Validation Accuracy:  0.965, Loss:  1.172\n",
      "Epoch   9 Batch  524/538 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch   9 Batch  525/538 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  1.174\n",
      "Epoch   9 Batch  526/538 - Train Accuracy:  0.959, Validation Accuracy:  0.962, Loss:  1.186\n",
      "Epoch   9 Batch  527/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.158\n",
      "Epoch   9 Batch  528/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.184\n",
      "Epoch   9 Batch  529/538 - Train Accuracy:  0.957, Validation Accuracy:  0.969, Loss:  1.084\n",
      "Epoch   9 Batch  530/538 - Train Accuracy:  0.962, Validation Accuracy:  0.971, Loss:  1.188\n",
      "Epoch   9 Batch  531/538 - Train Accuracy:  0.968, Validation Accuracy:  0.972, Loss:  1.115\n",
      "Epoch   9 Batch  532/538 - Train Accuracy:  0.965, Validation Accuracy:  0.974, Loss:  1.159\n",
      "Epoch   9 Batch  533/538 - Train Accuracy:  0.967, Validation Accuracy:  0.975, Loss:  1.100\n",
      "Epoch   9 Batch  534/538 - Train Accuracy:  0.972, Validation Accuracy:  0.973, Loss:  1.152\n",
      "Epoch   9 Batch  535/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.217\n",
      "Epoch   9 Batch  536/538 - Train Accuracy:  0.975, Validation Accuracy:  0.976, Loss:  1.165\n",
      "Epoch  10 Batch    0/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.088\n",
      "Epoch  10 Batch    1/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.153\n",
      "Epoch  10 Batch    2/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.178\n",
      "Epoch  10 Batch    3/538 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  1.193\n",
      "Epoch  10 Batch    4/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.125\n",
      "Epoch  10 Batch    5/538 - Train Accuracy:  0.968, Validation Accuracy:  0.969, Loss:  1.095\n",
      "Epoch  10 Batch    6/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.122\n",
      "Epoch  10 Batch    7/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.152\n",
      "Epoch  10 Batch    8/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.107\n",
      "Epoch  10 Batch    9/538 - Train Accuracy:  0.965, Validation Accuracy:  0.972, Loss:  1.139\n",
      "Epoch  10 Batch   10/538 - Train Accuracy:  0.962, Validation Accuracy:  0.971, Loss:  1.159\n",
      "Epoch  10 Batch   11/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.109\n",
      "Epoch  10 Batch   12/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.168\n",
      "Epoch  10 Batch   13/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.151\n",
      "Epoch  10 Batch   14/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.156\n",
      "Epoch  10 Batch   15/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.096\n",
      "Epoch  10 Batch   16/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.158\n",
      "Epoch  10 Batch   17/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.119\n",
      "Epoch  10 Batch   18/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.174\n",
      "Epoch  10 Batch   19/538 - Train Accuracy:  0.979, Validation Accuracy:  0.962, Loss:  1.186\n",
      "Epoch  10 Batch   20/538 - Train Accuracy:  0.969, Validation Accuracy:  0.969, Loss:  1.163\n",
      "Epoch  10 Batch   21/538 - Train Accuracy:  0.988, Validation Accuracy:  0.972, Loss:  1.166\n",
      "Epoch  10 Batch   22/538 - Train Accuracy:  0.963, Validation Accuracy:  0.972, Loss:  1.150\n",
      "Epoch  10 Batch   23/538 - Train Accuracy:  0.968, Validation Accuracy:  0.969, Loss:  1.155\n",
      "Epoch  10 Batch   24/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.130\n",
      "Epoch  10 Batch   25/538 - Train Accuracy:  0.961, Validation Accuracy:  0.963, Loss:  1.092\n",
      "Epoch  10 Batch   26/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.153\n",
      "Epoch  10 Batch   27/538 - Train Accuracy:  0.980, Validation Accuracy:  0.962, Loss:  1.106\n",
      "Epoch  10 Batch   28/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.118\n",
      "Epoch  10 Batch   29/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.147\n",
      "Epoch  10 Batch   30/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.138\n",
      "Epoch  10 Batch   31/538 - Train Accuracy:  0.976, Validation Accuracy:  0.965, Loss:  1.133\n",
      "Epoch  10 Batch   32/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.212\n",
      "Epoch  10 Batch   33/538 - Train Accuracy:  0.961, Validation Accuracy:  0.966, Loss:  1.156\n",
      "Epoch  10 Batch   34/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.178\n",
      "Epoch  10 Batch   35/538 - Train Accuracy:  0.970, Validation Accuracy:  0.968, Loss:  1.179\n",
      "Epoch  10 Batch   36/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.152\n",
      "Epoch  10 Batch   37/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.099\n",
      "Epoch  10 Batch   38/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.124\n",
      "Epoch  10 Batch   39/538 - Train Accuracy:  0.987, Validation Accuracy:  0.965, Loss:  1.120\n",
      "Epoch  10 Batch   40/538 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  1.190\n",
      "Epoch  10 Batch   41/538 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  1.133\n",
      "Epoch  10 Batch   42/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.137\n",
      "Epoch  10 Batch   43/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.188\n",
      "Epoch  10 Batch   44/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.145\n",
      "Epoch  10 Batch   45/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.138\n",
      "Epoch  10 Batch   46/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.129\n",
      "Epoch  10 Batch   47/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.120\n",
      "Epoch  10 Batch   48/538 - Train Accuracy:  0.967, Validation Accuracy:  0.968, Loss:  1.125\n",
      "Epoch  10 Batch   49/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.151\n",
      "Epoch  10 Batch   50/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.128\n",
      "Epoch  10 Batch   51/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.176\n",
      "Epoch  10 Batch   52/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.132\n",
      "Epoch  10 Batch   53/538 - Train Accuracy:  0.955, Validation Accuracy:  0.964, Loss:  1.139\n",
      "Epoch  10 Batch   54/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.169\n",
      "Epoch  10 Batch   55/538 - Train Accuracy:  0.970, Validation Accuracy:  0.968, Loss:  1.178\n",
      "Epoch  10 Batch   56/538 - Train Accuracy:  0.973, Validation Accuracy:  0.972, Loss:  1.144\n",
      "Epoch  10 Batch   57/538 - Train Accuracy:  0.953, Validation Accuracy:  0.972, Loss:  1.153\n",
      "Epoch  10 Batch   58/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.118\n",
      "Epoch  10 Batch   59/538 - Train Accuracy:  0.976, Validation Accuracy:  0.975, Loss:  1.154\n",
      "Epoch  10 Batch   60/538 - Train Accuracy:  0.968, Validation Accuracy:  0.971, Loss:  1.129\n",
      "Epoch  10 Batch   61/538 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  1.139\n",
      "Epoch  10 Batch   62/538 - Train Accuracy:  0.964, Validation Accuracy:  0.974, Loss:  1.171\n",
      "Epoch  10 Batch   63/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.128\n",
      "Epoch  10 Batch   64/538 - Train Accuracy:  0.966, Validation Accuracy:  0.975, Loss:  1.159\n",
      "Epoch  10 Batch   65/538 - Train Accuracy:  0.971, Validation Accuracy:  0.975, Loss:  1.095\n",
      "Epoch  10 Batch   66/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.152\n",
      "Epoch  10 Batch   67/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.189\n",
      "Epoch  10 Batch   68/538 - Train Accuracy:  0.967, Validation Accuracy:  0.971, Loss:  1.204\n",
      "Epoch  10 Batch   69/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.163\n",
      "Epoch  10 Batch   70/538 - Train Accuracy:  0.965, Validation Accuracy:  0.973, Loss:  1.121\n",
      "Epoch  10 Batch   71/538 - Train Accuracy:  0.968, Validation Accuracy:  0.972, Loss:  1.191\n",
      "Epoch  10 Batch   72/538 - Train Accuracy:  0.976, Validation Accuracy:  0.966, Loss:  1.191\n",
      "Epoch  10 Batch   73/538 - Train Accuracy:  0.960, Validation Accuracy:  0.970, Loss:  1.138\n",
      "Epoch  10 Batch   74/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.166\n",
      "Epoch  10 Batch   75/538 - Train Accuracy:  0.966, Validation Accuracy:  0.968, Loss:  1.145\n",
      "Epoch  10 Batch   76/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.144\n",
      "Epoch  10 Batch   77/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.138\n",
      "Epoch  10 Batch   78/538 - Train Accuracy:  0.968, Validation Accuracy:  0.969, Loss:  1.207\n",
      "Epoch  10 Batch   79/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.108\n",
      "Epoch  10 Batch   80/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.167\n",
      "Epoch  10 Batch   81/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.147\n",
      "Epoch  10 Batch   82/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.141\n",
      "Epoch  10 Batch   83/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.163\n",
      "Epoch  10 Batch   84/538 - Train Accuracy:  0.957, Validation Accuracy:  0.964, Loss:  1.175\n",
      "Epoch  10 Batch   85/538 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  1.159\n",
      "Epoch  10 Batch   86/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.177\n",
      "Epoch  10 Batch   87/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.151\n",
      "Epoch  10 Batch   88/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.174\n",
      "Epoch  10 Batch   89/538 - Train Accuracy:  0.975, Validation Accuracy:  0.963, Loss:  1.118\n",
      "Epoch  10 Batch   90/538 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  1.119\n",
      "Epoch  10 Batch   91/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.112\n",
      "Epoch  10 Batch   92/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.148\n",
      "Epoch  10 Batch   93/538 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  1.134\n",
      "Epoch  10 Batch   94/538 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  1.158\n",
      "Epoch  10 Batch   95/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.160\n",
      "Epoch  10 Batch   96/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.085\n",
      "Epoch  10 Batch   97/538 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  1.165\n",
      "Epoch  10 Batch   98/538 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  1.165\n",
      "Epoch  10 Batch   99/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch  10 Batch  100/538 - Train Accuracy:  0.981, Validation Accuracy:  0.967, Loss:  1.170\n",
      "Epoch  10 Batch  101/538 - Train Accuracy:  0.964, Validation Accuracy:  0.966, Loss:  1.137\n",
      "Epoch  10 Batch  102/538 - Train Accuracy:  0.957, Validation Accuracy:  0.967, Loss:  1.168\n",
      "Epoch  10 Batch  103/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.113\n",
      "Epoch  10 Batch  104/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.119\n",
      "Epoch  10 Batch  105/538 - Train Accuracy:  0.967, Validation Accuracy:  0.968, Loss:  1.149\n",
      "Epoch  10 Batch  106/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.112\n",
      "Epoch  10 Batch  107/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.163\n",
      "Epoch  10 Batch  108/538 - Train Accuracy:  0.974, Validation Accuracy:  0.960, Loss:  1.146\n",
      "Epoch  10 Batch  109/538 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  1.200\n",
      "Epoch  10 Batch  110/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.148\n",
      "Epoch  10 Batch  111/538 - Train Accuracy:  0.970, Validation Accuracy:  0.962, Loss:  1.175\n",
      "Epoch  10 Batch  112/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.152\n",
      "Epoch  10 Batch  113/538 - Train Accuracy:  0.953, Validation Accuracy:  0.963, Loss:  1.142\n",
      "Epoch  10 Batch  114/538 - Train Accuracy:  0.975, Validation Accuracy:  0.958, Loss:  1.134\n",
      "Epoch  10 Batch  115/538 - Train Accuracy:  0.964, Validation Accuracy:  0.955, Loss:  1.143\n",
      "Epoch  10 Batch  116/538 - Train Accuracy:  0.957, Validation Accuracy:  0.962, Loss:  1.102\n",
      "Epoch  10 Batch  117/538 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  1.139\n",
      "Epoch  10 Batch  118/538 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  1.144\n",
      "Epoch  10 Batch  119/538 - Train Accuracy:  0.986, Validation Accuracy:  0.969, Loss:  1.164\n",
      "Epoch  10 Batch  120/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.203\n",
      "Epoch  10 Batch  121/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.163\n",
      "Epoch  10 Batch  122/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch  10 Batch  123/538 - Train Accuracy:  0.963, Validation Accuracy:  0.966, Loss:  1.159\n",
      "Epoch  10 Batch  124/538 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  1.109\n",
      "Epoch  10 Batch  125/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.099\n",
      "Epoch  10 Batch  126/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.107\n",
      "Epoch  10 Batch  127/538 - Train Accuracy:  0.964, Validation Accuracy:  0.969, Loss:  1.134\n",
      "Epoch  10 Batch  128/538 - Train Accuracy:  0.959, Validation Accuracy:  0.966, Loss:  1.122\n",
      "Epoch  10 Batch  129/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.121\n",
      "Epoch  10 Batch  130/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.159\n",
      "Epoch  10 Batch  131/538 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  1.174\n",
      "Epoch  10 Batch  132/538 - Train Accuracy:  0.962, Validation Accuracy:  0.964, Loss:  1.192\n",
      "Epoch  10 Batch  133/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.155\n",
      "Epoch  10 Batch  134/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch  10 Batch  135/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.199\n",
      "Epoch  10 Batch  136/538 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  1.087\n",
      "Epoch  10 Batch  137/538 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  1.143\n",
      "Epoch  10 Batch  138/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.095\n",
      "Epoch  10 Batch  139/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.168\n",
      "Epoch  10 Batch  140/538 - Train Accuracy:  0.965, Validation Accuracy:  0.971, Loss:  1.132\n",
      "Epoch  10 Batch  141/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.133\n",
      "Epoch  10 Batch  142/538 - Train Accuracy:  0.970, Validation Accuracy:  0.968, Loss:  1.127\n",
      "Epoch  10 Batch  143/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.180\n",
      "Epoch  10 Batch  144/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.141\n",
      "Epoch  10 Batch  145/538 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  1.185\n",
      "Epoch  10 Batch  146/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.171\n",
      "Epoch  10 Batch  147/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.144\n",
      "Epoch  10 Batch  148/538 - Train Accuracy:  0.962, Validation Accuracy:  0.962, Loss:  1.118\n",
      "Epoch  10 Batch  149/538 - Train Accuracy:  0.979, Validation Accuracy:  0.961, Loss:  1.125\n",
      "Epoch  10 Batch  150/538 - Train Accuracy:  0.976, Validation Accuracy:  0.958, Loss:  1.149\n",
      "Epoch  10 Batch  151/538 - Train Accuracy:  0.968, Validation Accuracy:  0.965, Loss:  1.160\n",
      "Epoch  10 Batch  152/538 - Train Accuracy:  0.975, Validation Accuracy:  0.960, Loss:  1.147\n",
      "Epoch  10 Batch  153/538 - Train Accuracy:  0.959, Validation Accuracy:  0.960, Loss:  1.147\n",
      "Epoch  10 Batch  154/538 - Train Accuracy:  0.975, Validation Accuracy:  0.957, Loss:  1.129\n",
      "Epoch  10 Batch  155/538 - Train Accuracy:  0.964, Validation Accuracy:  0.962, Loss:  1.184\n",
      "Epoch  10 Batch  156/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.190\n",
      "Epoch  10 Batch  157/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.146\n",
      "Epoch  10 Batch  158/538 - Train Accuracy:  0.986, Validation Accuracy:  0.966, Loss:  1.140\n",
      "Epoch  10 Batch  159/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.065\n",
      "Epoch  10 Batch  160/538 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  1.147\n",
      "Epoch  10 Batch  161/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.183\n",
      "Epoch  10 Batch  162/538 - Train Accuracy:  0.981, Validation Accuracy:  0.967, Loss:  1.148\n",
      "Epoch  10 Batch  163/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.163\n",
      "Epoch  10 Batch  164/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.192\n",
      "Epoch  10 Batch  165/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.176\n",
      "Epoch  10 Batch  166/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.131\n",
      "Epoch  10 Batch  167/538 - Train Accuracy:  0.967, Validation Accuracy:  0.966, Loss:  1.151\n",
      "Epoch  10 Batch  168/538 - Train Accuracy:  0.955, Validation Accuracy:  0.964, Loss:  1.143\n",
      "Epoch  10 Batch  169/538 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  1.104\n",
      "Epoch  10 Batch  170/538 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  1.118\n",
      "Epoch  10 Batch  171/538 - Train Accuracy:  0.962, Validation Accuracy:  0.971, Loss:  1.095\n",
      "Epoch  10 Batch  172/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.169\n",
      "Epoch  10 Batch  173/538 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch  10 Batch  174/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.145\n",
      "Epoch  10 Batch  175/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.146\n",
      "Epoch  10 Batch  176/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.150\n",
      "Epoch  10 Batch  177/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.119\n",
      "Epoch  10 Batch  178/538 - Train Accuracy:  0.963, Validation Accuracy:  0.972, Loss:  1.182\n",
      "Epoch  10 Batch  179/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.110\n",
      "Epoch  10 Batch  180/538 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  1.149\n",
      "Epoch  10 Batch  181/538 - Train Accuracy:  0.955, Validation Accuracy:  0.968, Loss:  1.167\n",
      "Epoch  10 Batch  182/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.183\n",
      "Epoch  10 Batch  183/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.158\n",
      "Epoch  10 Batch  184/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.168\n",
      "Epoch  10 Batch  185/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.119\n",
      "Epoch  10 Batch  186/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.179\n",
      "Epoch  10 Batch  187/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.132\n",
      "Epoch  10 Batch  188/538 - Train Accuracy:  0.970, Validation Accuracy:  0.966, Loss:  1.127\n",
      "Epoch  10 Batch  189/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.171\n",
      "Epoch  10 Batch  190/538 - Train Accuracy:  0.962, Validation Accuracy:  0.965, Loss:  1.128\n",
      "Epoch  10 Batch  191/538 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  1.155\n",
      "Epoch  10 Batch  192/538 - Train Accuracy:  0.972, Validation Accuracy:  0.960, Loss:  1.133\n",
      "Epoch  10 Batch  193/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.134\n",
      "Epoch  10 Batch  194/538 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  1.181\n",
      "Epoch  10 Batch  195/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.177\n",
      "Epoch  10 Batch  196/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.109\n",
      "Epoch  10 Batch  197/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.126\n",
      "Epoch  10 Batch  198/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.183\n",
      "Epoch  10 Batch  199/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.191\n",
      "Epoch  10 Batch  200/538 - Train Accuracy:  0.974, Validation Accuracy:  0.967, Loss:  1.194\n",
      "Epoch  10 Batch  201/538 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  1.153\n",
      "Epoch  10 Batch  202/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.185\n",
      "Epoch  10 Batch  203/538 - Train Accuracy:  0.968, Validation Accuracy:  0.972, Loss:  1.180\n",
      "Epoch  10 Batch  204/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.150\n",
      "Epoch  10 Batch  205/538 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  1.162\n",
      "Epoch  10 Batch  206/538 - Train Accuracy:  0.967, Validation Accuracy:  0.966, Loss:  1.182\n",
      "Epoch  10 Batch  207/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.122\n",
      "Epoch  10 Batch  208/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.128\n",
      "Epoch  10 Batch  209/538 - Train Accuracy:  0.984, Validation Accuracy:  0.965, Loss:  1.139\n",
      "Epoch  10 Batch  210/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.150\n",
      "Epoch  10 Batch  211/538 - Train Accuracy:  0.969, Validation Accuracy:  0.969, Loss:  1.139\n",
      "Epoch  10 Batch  212/538 - Train Accuracy:  0.961, Validation Accuracy:  0.969, Loss:  1.162\n",
      "Epoch  10 Batch  213/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.150\n",
      "Epoch  10 Batch  214/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.153\n",
      "Epoch  10 Batch  215/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.142\n",
      "Epoch  10 Batch  216/538 - Train Accuracy:  0.957, Validation Accuracy:  0.970, Loss:  1.142\n",
      "Epoch  10 Batch  217/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.161\n",
      "Epoch  10 Batch  218/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.184\n",
      "Epoch  10 Batch  219/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.138\n",
      "Epoch  10 Batch  220/538 - Train Accuracy:  0.964, Validation Accuracy:  0.966, Loss:  1.205\n",
      "Epoch  10 Batch  221/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.141\n",
      "Epoch  10 Batch  222/538 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  1.108\n",
      "Epoch  10 Batch  223/538 - Train Accuracy:  0.979, Validation Accuracy:  0.961, Loss:  1.174\n",
      "Epoch  10 Batch  224/538 - Train Accuracy:  0.970, Validation Accuracy:  0.961, Loss:  1.125\n",
      "Epoch  10 Batch  225/538 - Train Accuracy:  0.962, Validation Accuracy:  0.957, Loss:  1.133\n",
      "Epoch  10 Batch  226/538 - Train Accuracy:  0.967, Validation Accuracy:  0.961, Loss:  1.151\n",
      "Epoch  10 Batch  227/538 - Train Accuracy:  0.960, Validation Accuracy:  0.966, Loss:  1.133\n",
      "Epoch  10 Batch  228/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.132\n",
      "Epoch  10 Batch  229/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.064\n",
      "Epoch  10 Batch  230/538 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  1.123\n",
      "Epoch  10 Batch  231/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.194\n",
      "Epoch  10 Batch  232/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.112\n",
      "Epoch  10 Batch  233/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.181\n",
      "Epoch  10 Batch  234/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.189\n",
      "Epoch  10 Batch  235/538 - Train Accuracy:  0.985, Validation Accuracy:  0.966, Loss:  1.138\n",
      "Epoch  10 Batch  236/538 - Train Accuracy:  0.966, Validation Accuracy:  0.965, Loss:  1.144\n",
      "Epoch  10 Batch  237/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.148\n",
      "Epoch  10 Batch  238/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.113\n",
      "Epoch  10 Batch  239/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.133\n",
      "Epoch  10 Batch  240/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.107\n",
      "Epoch  10 Batch  241/538 - Train Accuracy:  0.960, Validation Accuracy:  0.976, Loss:  1.166\n",
      "Epoch  10 Batch  242/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.149\n",
      "Epoch  10 Batch  243/538 - Train Accuracy:  0.975, Validation Accuracy:  0.976, Loss:  1.149\n",
      "Epoch  10 Batch  244/538 - Train Accuracy:  0.968, Validation Accuracy:  0.976, Loss:  1.133\n",
      "Epoch  10 Batch  245/538 - Train Accuracy:  0.966, Validation Accuracy:  0.974, Loss:  1.149\n",
      "Epoch  10 Batch  246/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.132\n",
      "Epoch  10 Batch  247/538 - Train Accuracy:  0.960, Validation Accuracy:  0.975, Loss:  1.165\n",
      "Epoch  10 Batch  248/538 - Train Accuracy:  0.962, Validation Accuracy:  0.977, Loss:  1.126\n",
      "Epoch  10 Batch  249/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.131\n",
      "Epoch  10 Batch  250/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.184\n",
      "Epoch  10 Batch  251/538 - Train Accuracy:  0.984, Validation Accuracy:  0.961, Loss:  1.138\n",
      "Epoch  10 Batch  252/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.163\n",
      "Epoch  10 Batch  253/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.173\n",
      "Epoch  10 Batch  254/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.150\n",
      "Epoch  10 Batch  255/538 - Train Accuracy:  0.986, Validation Accuracy:  0.968, Loss:  1.147\n",
      "Epoch  10 Batch  256/538 - Train Accuracy:  0.961, Validation Accuracy:  0.970, Loss:  1.178\n",
      "Epoch  10 Batch  257/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.136\n",
      "Epoch  10 Batch  258/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.141\n",
      "Epoch  10 Batch  259/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.140\n",
      "Epoch  10 Batch  260/538 - Train Accuracy:  0.953, Validation Accuracy:  0.969, Loss:  1.131\n",
      "Epoch  10 Batch  261/538 - Train Accuracy:  0.965, Validation Accuracy:  0.967, Loss:  1.130\n",
      "Epoch  10 Batch  262/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.152\n",
      "Epoch  10 Batch  263/538 - Train Accuracy:  0.958, Validation Accuracy:  0.970, Loss:  1.161\n",
      "Epoch  10 Batch  264/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.138\n",
      "Epoch  10 Batch  265/538 - Train Accuracy:  0.962, Validation Accuracy:  0.972, Loss:  1.159\n",
      "Epoch  10 Batch  266/538 - Train Accuracy:  0.963, Validation Accuracy:  0.970, Loss:  1.166\n",
      "Epoch  10 Batch  267/538 - Train Accuracy:  0.967, Validation Accuracy:  0.971, Loss:  1.188\n",
      "Epoch  10 Batch  268/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.205\n",
      "Epoch  10 Batch  269/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch  10 Batch  270/538 - Train Accuracy:  0.974, Validation Accuracy:  0.975, Loss:  1.110\n",
      "Epoch  10 Batch  271/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.165\n",
      "Epoch  10 Batch  272/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.223\n",
      "Epoch  10 Batch  273/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.141\n",
      "Epoch  10 Batch  274/538 - Train Accuracy:  0.956, Validation Accuracy:  0.970, Loss:  1.141\n",
      "Epoch  10 Batch  275/538 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  1.112\n",
      "Epoch  10 Batch  276/538 - Train Accuracy:  0.970, Validation Accuracy:  0.973, Loss:  1.136\n",
      "Epoch  10 Batch  277/538 - Train Accuracy:  0.985, Validation Accuracy:  0.976, Loss:  1.175\n",
      "Epoch  10 Batch  278/538 - Train Accuracy:  0.972, Validation Accuracy:  0.977, Loss:  1.155\n",
      "Epoch  10 Batch  279/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.144\n",
      "Epoch  10 Batch  280/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.111\n",
      "Epoch  10 Batch  281/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.166\n",
      "Epoch  10 Batch  282/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.167\n",
      "Epoch  10 Batch  283/538 - Train Accuracy:  0.987, Validation Accuracy:  0.977, Loss:  1.149\n",
      "Epoch  10 Batch  284/538 - Train Accuracy:  0.967, Validation Accuracy:  0.978, Loss:  1.120\n",
      "Epoch  10 Batch  285/538 - Train Accuracy:  0.982, Validation Accuracy:  0.976, Loss:  1.164\n",
      "Epoch  10 Batch  286/538 - Train Accuracy:  0.968, Validation Accuracy:  0.976, Loss:  1.171\n",
      "Epoch  10 Batch  287/538 - Train Accuracy:  0.974, Validation Accuracy:  0.976, Loss:  1.174\n",
      "Epoch  10 Batch  288/538 - Train Accuracy:  0.972, Validation Accuracy:  0.977, Loss:  1.186\n",
      "Epoch  10 Batch  289/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.170\n",
      "Epoch  10 Batch  290/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.148\n",
      "Epoch  10 Batch  291/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.119\n",
      "Epoch  10 Batch  292/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.158\n",
      "Epoch  10 Batch  293/538 - Train Accuracy:  0.968, Validation Accuracy:  0.967, Loss:  1.156\n",
      "Epoch  10 Batch  294/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.165\n",
      "Epoch  10 Batch  295/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.106\n",
      "Epoch  10 Batch  296/538 - Train Accuracy:  0.959, Validation Accuracy:  0.968, Loss:  1.129\n",
      "Epoch  10 Batch  297/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.074\n",
      "Epoch  10 Batch  298/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.100\n",
      "Epoch  10 Batch  299/538 - Train Accuracy:  0.965, Validation Accuracy:  0.971, Loss:  1.151\n",
      "Epoch  10 Batch  300/538 - Train Accuracy:  0.974, Validation Accuracy:  0.974, Loss:  1.147\n",
      "Epoch  10 Batch  301/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.145\n",
      "Epoch  10 Batch  302/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.133\n",
      "Epoch  10 Batch  303/538 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  1.154\n",
      "Epoch  10 Batch  304/538 - Train Accuracy:  0.971, Validation Accuracy:  0.976, Loss:  1.174\n",
      "Epoch  10 Batch  305/538 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  1.137\n",
      "Epoch  10 Batch  306/538 - Train Accuracy:  0.976, Validation Accuracy:  0.975, Loss:  1.175\n",
      "Epoch  10 Batch  307/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  10 Batch  308/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.181\n",
      "Epoch  10 Batch  309/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.103\n",
      "Epoch  10 Batch  310/538 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  1.124\n",
      "Epoch  10 Batch  311/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.144\n",
      "Epoch  10 Batch  312/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.179\n",
      "Epoch  10 Batch  313/538 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  1.157\n",
      "Epoch  10 Batch  314/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.113\n",
      "Epoch  10 Batch  315/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.117\n",
      "Epoch  10 Batch  316/538 - Train Accuracy:  0.961, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch  10 Batch  317/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.159\n",
      "Epoch  10 Batch  318/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.144\n",
      "Epoch  10 Batch  319/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.158\n",
      "Epoch  10 Batch  320/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.107\n",
      "Epoch  10 Batch  321/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.134\n",
      "Epoch  10 Batch  322/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.139\n",
      "Epoch  10 Batch  323/538 - Train Accuracy:  0.973, Validation Accuracy:  0.966, Loss:  1.146\n",
      "Epoch  10 Batch  324/538 - Train Accuracy:  0.973, Validation Accuracy:  0.964, Loss:  1.136\n",
      "Epoch  10 Batch  325/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.153\n",
      "Epoch  10 Batch  326/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.143\n",
      "Epoch  10 Batch  327/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.149\n",
      "Epoch  10 Batch  328/538 - Train Accuracy:  0.981, Validation Accuracy:  0.965, Loss:  1.120\n",
      "Epoch  10 Batch  329/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.147\n",
      "Epoch  10 Batch  330/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.177\n",
      "Epoch  10 Batch  331/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.140\n",
      "Epoch  10 Batch  332/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.157\n",
      "Epoch  10 Batch  333/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.187\n",
      "Epoch  10 Batch  334/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.086\n",
      "Epoch  10 Batch  335/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.108\n",
      "Epoch  10 Batch  336/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.147\n",
      "Epoch  10 Batch  337/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.128\n",
      "Epoch  10 Batch  338/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.106\n",
      "Epoch  10 Batch  339/538 - Train Accuracy:  0.967, Validation Accuracy:  0.975, Loss:  1.114\n",
      "Epoch  10 Batch  340/538 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  1.102\n",
      "Epoch  10 Batch  341/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.142\n",
      "Epoch  10 Batch  342/538 - Train Accuracy:  0.963, Validation Accuracy:  0.973, Loss:  1.152\n",
      "Epoch  10 Batch  343/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.155\n",
      "Epoch  10 Batch  344/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.163\n",
      "Epoch  10 Batch  345/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.184\n",
      "Epoch  10 Batch  346/538 - Train Accuracy:  0.964, Validation Accuracy:  0.966, Loss:  1.165\n",
      "Epoch  10 Batch  347/538 - Train Accuracy:  0.973, Validation Accuracy:  0.966, Loss:  1.111\n",
      "Epoch  10 Batch  348/538 - Train Accuracy:  0.961, Validation Accuracy:  0.968, Loss:  1.138\n",
      "Epoch  10 Batch  349/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.114\n",
      "Epoch  10 Batch  350/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.141\n",
      "Epoch  10 Batch  351/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.171\n",
      "Epoch  10 Batch  352/538 - Train Accuracy:  0.953, Validation Accuracy:  0.967, Loss:  1.145\n",
      "Epoch  10 Batch  353/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.138\n",
      "Epoch  10 Batch  354/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.110\n",
      "Epoch  10 Batch  355/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.123\n",
      "Epoch  10 Batch  356/538 - Train Accuracy:  0.974, Validation Accuracy:  0.967, Loss:  1.142\n",
      "Epoch  10 Batch  357/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.102\n",
      "Epoch  10 Batch  358/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.156\n",
      "Epoch  10 Batch  359/538 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  1.180\n",
      "Epoch  10 Batch  360/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.163\n",
      "Epoch  10 Batch  361/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.176\n",
      "Epoch  10 Batch  362/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.142\n",
      "Epoch  10 Batch  363/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.140\n",
      "Epoch  10 Batch  364/538 - Train Accuracy:  0.961, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  10 Batch  365/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.157\n",
      "Epoch  10 Batch  366/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.099\n",
      "Epoch  10 Batch  367/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.054\n",
      "Epoch  10 Batch  368/538 - Train Accuracy:  0.988, Validation Accuracy:  0.967, Loss:  1.152\n",
      "Epoch  10 Batch  369/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.174\n",
      "Epoch  10 Batch  370/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.152\n",
      "Epoch  10 Batch  371/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.152\n",
      "Epoch  10 Batch  372/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.155\n",
      "Epoch  10 Batch  373/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.113\n",
      "Epoch  10 Batch  374/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.132\n",
      "Epoch  10 Batch  375/538 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  1.187\n",
      "Epoch  10 Batch  376/538 - Train Accuracy:  0.966, Validation Accuracy:  0.974, Loss:  1.138\n",
      "Epoch  10 Batch  377/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.152\n",
      "Epoch  10 Batch  378/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.123\n",
      "Epoch  10 Batch  379/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.155\n",
      "Epoch  10 Batch  380/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.143\n",
      "Epoch  10 Batch  381/538 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  1.133\n",
      "Epoch  10 Batch  382/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.138\n",
      "Epoch  10 Batch  383/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.193\n",
      "Epoch  10 Batch  384/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.162\n",
      "Epoch  10 Batch  385/538 - Train Accuracy:  0.972, Validation Accuracy:  0.972, Loss:  1.163\n",
      "Epoch  10 Batch  386/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.151\n",
      "Epoch  10 Batch  387/538 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  1.185\n",
      "Epoch  10 Batch  388/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.160\n",
      "Epoch  10 Batch  389/538 - Train Accuracy:  0.966, Validation Accuracy:  0.964, Loss:  1.114\n",
      "Epoch  10 Batch  390/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.153\n",
      "Epoch  10 Batch  391/538 - Train Accuracy:  0.972, Validation Accuracy:  0.955, Loss:  1.127\n",
      "Epoch  10 Batch  392/538 - Train Accuracy:  0.978, Validation Accuracy:  0.956, Loss:  1.127\n",
      "Epoch  10 Batch  393/538 - Train Accuracy:  0.977, Validation Accuracy:  0.957, Loss:  1.170\n",
      "Epoch  10 Batch  394/538 - Train Accuracy:  0.961, Validation Accuracy:  0.960, Loss:  1.094\n",
      "Epoch  10 Batch  395/538 - Train Accuracy:  0.971, Validation Accuracy:  0.960, Loss:  1.172\n",
      "Epoch  10 Batch  396/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.120\n",
      "Epoch  10 Batch  397/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.149\n",
      "Epoch  10 Batch  398/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.182\n",
      "Epoch  10 Batch  399/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.150\n",
      "Epoch  10 Batch  400/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.079\n",
      "Epoch  10 Batch  401/538 - Train Accuracy:  0.987, Validation Accuracy:  0.964, Loss:  1.148\n",
      "Epoch  10 Batch  402/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.135\n",
      "Epoch  10 Batch  403/538 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  1.111\n",
      "Epoch  10 Batch  404/538 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  1.138\n",
      "Epoch  10 Batch  405/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.171\n",
      "Epoch  10 Batch  406/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.148\n",
      "Epoch  10 Batch  407/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.132\n",
      "Epoch  10 Batch  408/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.122\n",
      "Epoch  10 Batch  409/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.185\n",
      "Epoch  10 Batch  410/538 - Train Accuracy:  0.987, Validation Accuracy:  0.965, Loss:  1.130\n",
      "Epoch  10 Batch  411/538 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  1.149\n",
      "Epoch  10 Batch  412/538 - Train Accuracy:  0.976, Validation Accuracy:  0.960, Loss:  1.095\n",
      "Epoch  10 Batch  413/538 - Train Accuracy:  0.980, Validation Accuracy:  0.960, Loss:  1.170\n",
      "Epoch  10 Batch  414/538 - Train Accuracy:  0.954, Validation Accuracy:  0.962, Loss:  1.137\n",
      "Epoch  10 Batch  415/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.148\n",
      "Epoch  10 Batch  416/538 - Train Accuracy:  0.981, Validation Accuracy:  0.965, Loss:  1.159\n",
      "Epoch  10 Batch  417/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.166\n",
      "Epoch  10 Batch  418/538 - Train Accuracy:  0.972, Validation Accuracy:  0.964, Loss:  1.186\n",
      "Epoch  10 Batch  419/538 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  1.117\n",
      "Epoch  10 Batch  420/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.168\n",
      "Epoch  10 Batch  421/538 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  1.097\n",
      "Epoch  10 Batch  422/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.091\n",
      "Epoch  10 Batch  423/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.104\n",
      "Epoch  10 Batch  424/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.147\n",
      "Epoch  10 Batch  425/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.150\n",
      "Epoch  10 Batch  426/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.192\n",
      "Epoch  10 Batch  427/538 - Train Accuracy:  0.972, Validation Accuracy:  0.973, Loss:  1.150\n",
      "Epoch  10 Batch  428/538 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  1.130\n",
      "Epoch  10 Batch  429/538 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  1.200\n",
      "Epoch  10 Batch  430/538 - Train Accuracy:  0.964, Validation Accuracy:  0.971, Loss:  1.131\n",
      "Epoch  10 Batch  431/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.123\n",
      "Epoch  10 Batch  432/538 - Train Accuracy:  0.961, Validation Accuracy:  0.971, Loss:  1.145\n",
      "Epoch  10 Batch  433/538 - Train Accuracy:  0.958, Validation Accuracy:  0.969, Loss:  1.123\n",
      "Epoch  10 Batch  434/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.149\n",
      "Epoch  10 Batch  435/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.158\n",
      "Epoch  10 Batch  436/538 - Train Accuracy:  0.955, Validation Accuracy:  0.971, Loss:  1.144\n",
      "Epoch  10 Batch  437/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.129\n",
      "Epoch  10 Batch  438/538 - Train Accuracy:  0.970, Validation Accuracy:  0.975, Loss:  1.159\n",
      "Epoch  10 Batch  439/538 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  1.113\n",
      "Epoch  10 Batch  440/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.150\n",
      "Epoch  10 Batch  441/538 - Train Accuracy:  0.959, Validation Accuracy:  0.976, Loss:  1.155\n",
      "Epoch  10 Batch  442/538 - Train Accuracy:  0.972, Validation Accuracy:  0.978, Loss:  1.156\n",
      "Epoch  10 Batch  443/538 - Train Accuracy:  0.961, Validation Accuracy:  0.978, Loss:  1.152\n",
      "Epoch  10 Batch  444/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  10 Batch  445/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.092\n",
      "Epoch  10 Batch  446/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.150\n",
      "Epoch  10 Batch  447/538 - Train Accuracy:  0.974, Validation Accuracy:  0.974, Loss:  1.078\n",
      "Epoch  10 Batch  448/538 - Train Accuracy:  0.967, Validation Accuracy:  0.973, Loss:  1.148\n",
      "Epoch  10 Batch  449/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.150\n",
      "Epoch  10 Batch  450/538 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  1.189\n",
      "Epoch  10 Batch  451/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch  10 Batch  452/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.188\n",
      "Epoch  10 Batch  453/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.200\n",
      "Epoch  10 Batch  454/538 - Train Accuracy:  0.977, Validation Accuracy:  0.978, Loss:  1.141\n",
      "Epoch  10 Batch  455/538 - Train Accuracy:  0.974, Validation Accuracy:  0.974, Loss:  1.144\n",
      "Epoch  10 Batch  456/538 - Train Accuracy:  0.969, Validation Accuracy:  0.973, Loss:  1.179\n",
      "Epoch  10 Batch  457/538 - Train Accuracy:  0.982, Validation Accuracy:  0.976, Loss:  1.110\n",
      "Epoch  10 Batch  458/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.153\n",
      "Epoch  10 Batch  459/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.171\n",
      "Epoch  10 Batch  460/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.171\n",
      "Epoch  10 Batch  461/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.119\n",
      "Epoch  10 Batch  462/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.116\n",
      "Epoch  10 Batch  463/538 - Train Accuracy:  0.961, Validation Accuracy:  0.974, Loss:  1.135\n",
      "Epoch  10 Batch  464/538 - Train Accuracy:  0.978, Validation Accuracy:  0.977, Loss:  1.157\n",
      "Epoch  10 Batch  465/538 - Train Accuracy:  0.977, Validation Accuracy:  0.979, Loss:  1.170\n",
      "Epoch  10 Batch  466/538 - Train Accuracy:  0.972, Validation Accuracy:  0.979, Loss:  1.193\n",
      "Epoch  10 Batch  467/538 - Train Accuracy:  0.970, Validation Accuracy:  0.977, Loss:  1.205\n",
      "Epoch  10 Batch  468/538 - Train Accuracy:  0.980, Validation Accuracy:  0.977, Loss:  1.177\n",
      "Epoch  10 Batch  469/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.155\n",
      "Epoch  10 Batch  470/538 - Train Accuracy:  0.969, Validation Accuracy:  0.963, Loss:  1.158\n",
      "Epoch  10 Batch  471/538 - Train Accuracy:  0.985, Validation Accuracy:  0.964, Loss:  1.167\n",
      "Epoch  10 Batch  472/538 - Train Accuracy:  0.990, Validation Accuracy:  0.969, Loss:  1.122\n",
      "Epoch  10 Batch  473/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.113\n",
      "Epoch  10 Batch  474/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.130\n",
      "Epoch  10 Batch  475/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.120\n",
      "Epoch  10 Batch  476/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.134\n",
      "Epoch  10 Batch  477/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.183\n",
      "Epoch  10 Batch  478/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch  10 Batch  479/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.146\n",
      "Epoch  10 Batch  480/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.116\n",
      "Epoch  10 Batch  481/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.100\n",
      "Epoch  10 Batch  482/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.143\n",
      "Epoch  10 Batch  483/538 - Train Accuracy:  0.961, Validation Accuracy:  0.970, Loss:  1.182\n",
      "Epoch  10 Batch  484/538 - Train Accuracy:  0.966, Validation Accuracy:  0.972, Loss:  1.160\n",
      "Epoch  10 Batch  485/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.167\n",
      "Epoch  10 Batch  486/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.177\n",
      "Epoch  10 Batch  487/538 - Train Accuracy:  0.986, Validation Accuracy:  0.972, Loss:  1.162\n",
      "Epoch  10 Batch  488/538 - Train Accuracy:  0.986, Validation Accuracy:  0.974, Loss:  1.148\n",
      "Epoch  10 Batch  489/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.172\n",
      "Epoch  10 Batch  490/538 - Train Accuracy:  0.964, Validation Accuracy:  0.977, Loss:  1.130\n",
      "Epoch  10 Batch  491/538 - Train Accuracy:  0.965, Validation Accuracy:  0.978, Loss:  1.147\n",
      "Epoch  10 Batch  492/538 - Train Accuracy:  0.983, Validation Accuracy:  0.978, Loss:  1.147\n",
      "Epoch  10 Batch  493/538 - Train Accuracy:  0.962, Validation Accuracy:  0.975, Loss:  1.138\n",
      "Epoch  10 Batch  494/538 - Train Accuracy:  0.963, Validation Accuracy:  0.970, Loss:  1.138\n",
      "Epoch  10 Batch  495/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.115\n",
      "Epoch  10 Batch  496/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.140\n",
      "Epoch  10 Batch  497/538 - Train Accuracy:  0.984, Validation Accuracy:  0.972, Loss:  1.165\n",
      "Epoch  10 Batch  498/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.157\n",
      "Epoch  10 Batch  499/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.151\n",
      "Epoch  10 Batch  500/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.143\n",
      "Epoch  10 Batch  501/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.106\n",
      "Epoch  10 Batch  502/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.156\n",
      "Epoch  10 Batch  503/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.167\n",
      "Epoch  10 Batch  504/538 - Train Accuracy:  0.988, Validation Accuracy:  0.972, Loss:  1.122\n",
      "Epoch  10 Batch  505/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.105\n",
      "Epoch  10 Batch  506/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.151\n",
      "Epoch  10 Batch  507/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.141\n",
      "Epoch  10 Batch  508/538 - Train Accuracy:  0.966, Validation Accuracy:  0.969, Loss:  1.141\n",
      "Epoch  10 Batch  509/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch  10 Batch  510/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.114\n",
      "Epoch  10 Batch  511/538 - Train Accuracy:  0.965, Validation Accuracy:  0.972, Loss:  1.172\n",
      "Epoch  10 Batch  512/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.111\n",
      "Epoch  10 Batch  513/538 - Train Accuracy:  0.962, Validation Accuracy:  0.972, Loss:  1.122\n",
      "Epoch  10 Batch  514/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.155\n",
      "Epoch  10 Batch  515/538 - Train Accuracy:  0.959, Validation Accuracy:  0.966, Loss:  1.189\n",
      "Epoch  10 Batch  516/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.187\n",
      "Epoch  10 Batch  517/538 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  1.139\n",
      "Epoch  10 Batch  518/538 - Train Accuracy:  0.974, Validation Accuracy:  0.959, Loss:  1.153\n",
      "Epoch  10 Batch  519/538 - Train Accuracy:  0.977, Validation Accuracy:  0.956, Loss:  1.141\n",
      "Epoch  10 Batch  520/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.137\n",
      "Epoch  10 Batch  521/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.162\n",
      "Epoch  10 Batch  522/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.115\n",
      "Epoch  10 Batch  523/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.124\n",
      "Epoch  10 Batch  524/538 - Train Accuracy:  0.967, Validation Accuracy:  0.972, Loss:  1.118\n",
      "Epoch  10 Batch  525/538 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  1.169\n",
      "Epoch  10 Batch  526/538 - Train Accuracy:  0.961, Validation Accuracy:  0.975, Loss:  1.196\n",
      "Epoch  10 Batch  527/538 - Train Accuracy:  0.984, Validation Accuracy:  0.976, Loss:  1.117\n",
      "Epoch  10 Batch  528/538 - Train Accuracy:  0.963, Validation Accuracy:  0.974, Loss:  1.101\n",
      "Epoch  10 Batch  529/538 - Train Accuracy:  0.958, Validation Accuracy:  0.974, Loss:  1.143\n",
      "Epoch  10 Batch  530/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.149\n",
      "Epoch  10 Batch  531/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.137\n",
      "Epoch  10 Batch  532/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.104\n",
      "Epoch  10 Batch  533/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.171\n",
      "Epoch  10 Batch  534/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.167\n",
      "Epoch  10 Batch  535/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.175\n",
      "Epoch  10 Batch  536/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.138\n",
      "Epoch  11 Batch    0/538 - Train Accuracy:  0.982, Validation Accuracy:  0.961, Loss:  1.150\n",
      "Epoch  11 Batch    1/538 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  1.118\n",
      "Epoch  11 Batch    2/538 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  1.198\n",
      "Epoch  11 Batch    3/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.195\n",
      "Epoch  11 Batch    4/538 - Train Accuracy:  0.984, Validation Accuracy:  0.963, Loss:  1.169\n",
      "Epoch  11 Batch    5/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.137\n",
      "Epoch  11 Batch    6/538 - Train Accuracy:  0.982, Validation Accuracy:  0.964, Loss:  1.128\n",
      "Epoch  11 Batch    7/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.149\n",
      "Epoch  11 Batch    8/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.110\n",
      "Epoch  11 Batch    9/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.154\n",
      "Epoch  11 Batch   10/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.155\n",
      "Epoch  11 Batch   11/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch  11 Batch   12/538 - Train Accuracy:  0.969, Validation Accuracy:  0.969, Loss:  1.166\n",
      "Epoch  11 Batch   13/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.080\n",
      "Epoch  11 Batch   14/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.102\n",
      "Epoch  11 Batch   15/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.131\n",
      "Epoch  11 Batch   16/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.133\n",
      "Epoch  11 Batch   17/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.146\n",
      "Epoch  11 Batch   18/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.137\n",
      "Epoch  11 Batch   19/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.180\n",
      "Epoch  11 Batch   20/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.168\n",
      "Epoch  11 Batch   21/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.163\n",
      "Epoch  11 Batch   22/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.133\n",
      "Epoch  11 Batch   23/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.122\n",
      "Epoch  11 Batch   24/538 - Train Accuracy:  0.977, Validation Accuracy:  0.960, Loss:  1.147\n",
      "Epoch  11 Batch   25/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.173\n",
      "Epoch  11 Batch   26/538 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  1.126\n",
      "Epoch  11 Batch   27/538 - Train Accuracy:  0.986, Validation Accuracy:  0.964, Loss:  1.096\n",
      "Epoch  11 Batch   28/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.152\n",
      "Epoch  11 Batch   29/538 - Train Accuracy:  0.963, Validation Accuracy:  0.964, Loss:  1.105\n",
      "Epoch  11 Batch   30/538 - Train Accuracy:  0.963, Validation Accuracy:  0.961, Loss:  1.167\n",
      "Epoch  11 Batch   31/538 - Train Accuracy:  0.984, Validation Accuracy:  0.961, Loss:  1.177\n",
      "Epoch  11 Batch   32/538 - Train Accuracy:  0.974, Validation Accuracy:  0.961, Loss:  1.190\n",
      "Epoch  11 Batch   33/538 - Train Accuracy:  0.961, Validation Accuracy:  0.959, Loss:  1.130\n",
      "Epoch  11 Batch   34/538 - Train Accuracy:  0.970, Validation Accuracy:  0.954, Loss:  1.164\n",
      "Epoch  11 Batch   35/538 - Train Accuracy:  0.978, Validation Accuracy:  0.951, Loss:  1.130\n",
      "Epoch  11 Batch   36/538 - Train Accuracy:  0.976, Validation Accuracy:  0.958, Loss:  1.163\n",
      "Epoch  11 Batch   37/538 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  1.156\n",
      "Epoch  11 Batch   38/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.151\n",
      "Epoch  11 Batch   39/538 - Train Accuracy:  0.986, Validation Accuracy:  0.964, Loss:  1.100\n",
      "Epoch  11 Batch   40/538 - Train Accuracy:  0.979, Validation Accuracy:  0.961, Loss:  1.153\n",
      "Epoch  11 Batch   41/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.136\n",
      "Epoch  11 Batch   42/538 - Train Accuracy:  0.968, Validation Accuracy:  0.967, Loss:  1.121\n",
      "Epoch  11 Batch   43/538 - Train Accuracy:  0.957, Validation Accuracy:  0.968, Loss:  1.142\n",
      "Epoch  11 Batch   44/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.129\n",
      "Epoch  11 Batch   45/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.121\n",
      "Epoch  11 Batch   46/538 - Train Accuracy:  0.970, Validation Accuracy:  0.966, Loss:  1.157\n",
      "Epoch  11 Batch   47/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.131\n",
      "Epoch  11 Batch   48/538 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  1.138\n",
      "Epoch  11 Batch   49/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.159\n",
      "Epoch  11 Batch   50/538 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  1.180\n",
      "Epoch  11 Batch   51/538 - Train Accuracy:  0.967, Validation Accuracy:  0.973, Loss:  1.179\n",
      "Epoch  11 Batch   52/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.052\n",
      "Epoch  11 Batch   53/538 - Train Accuracy:  0.958, Validation Accuracy:  0.970, Loss:  1.143\n",
      "Epoch  11 Batch   54/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.148\n",
      "Epoch  11 Batch   55/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.128\n",
      "Epoch  11 Batch   56/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.137\n",
      "Epoch  11 Batch   57/538 - Train Accuracy:  0.955, Validation Accuracy:  0.969, Loss:  1.158\n",
      "Epoch  11 Batch   58/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.170\n",
      "Epoch  11 Batch   59/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.176\n",
      "Epoch  11 Batch   60/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.125\n",
      "Epoch  11 Batch   61/538 - Train Accuracy:  0.971, Validation Accuracy:  0.975, Loss:  1.115\n",
      "Epoch  11 Batch   62/538 - Train Accuracy:  0.959, Validation Accuracy:  0.975, Loss:  1.146\n",
      "Epoch  11 Batch   63/538 - Train Accuracy:  0.965, Validation Accuracy:  0.975, Loss:  1.120\n",
      "Epoch  11 Batch   64/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.151\n",
      "Epoch  11 Batch   65/538 - Train Accuracy:  0.959, Validation Accuracy:  0.968, Loss:  1.207\n",
      "Epoch  11 Batch   66/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.141\n",
      "Epoch  11 Batch   67/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.184\n",
      "Epoch  11 Batch   68/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.157\n",
      "Epoch  11 Batch   69/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  11 Batch   70/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.102\n",
      "Epoch  11 Batch   71/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.161\n",
      "Epoch  11 Batch   72/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.132\n",
      "Epoch  11 Batch   73/538 - Train Accuracy:  0.966, Validation Accuracy:  0.970, Loss:  1.209\n",
      "Epoch  11 Batch   74/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.129\n",
      "Epoch  11 Batch   75/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.123\n",
      "Epoch  11 Batch   76/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.180\n",
      "Epoch  11 Batch   77/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.145\n",
      "Epoch  11 Batch   78/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.128\n",
      "Epoch  11 Batch   79/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.120\n",
      "Epoch  11 Batch   80/538 - Train Accuracy:  0.987, Validation Accuracy:  0.980, Loss:  1.149\n",
      "Epoch  11 Batch   81/538 - Train Accuracy:  0.973, Validation Accuracy:  0.978, Loss:  1.180\n",
      "Epoch  11 Batch   82/538 - Train Accuracy:  0.975, Validation Accuracy:  0.977, Loss:  1.136\n",
      "Epoch  11 Batch   83/538 - Train Accuracy:  0.961, Validation Accuracy:  0.977, Loss:  1.132\n",
      "Epoch  11 Batch   84/538 - Train Accuracy:  0.965, Validation Accuracy:  0.976, Loss:  1.153\n",
      "Epoch  11 Batch   85/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.082\n",
      "Epoch  11 Batch   86/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.126\n",
      "Epoch  11 Batch   87/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.130\n",
      "Epoch  11 Batch   88/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.158\n",
      "Epoch  11 Batch   89/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.110\n",
      "Epoch  11 Batch   90/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.117\n",
      "Epoch  11 Batch   91/538 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  1.104\n",
      "Epoch  11 Batch   92/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.155\n",
      "Epoch  11 Batch   93/538 - Train Accuracy:  0.981, Validation Accuracy:  0.964, Loss:  1.142\n",
      "Epoch  11 Batch   94/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.107\n",
      "Epoch  11 Batch   95/538 - Train Accuracy:  0.965, Validation Accuracy:  0.963, Loss:  1.138\n",
      "Epoch  11 Batch   96/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.172\n",
      "Epoch  11 Batch   97/538 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  1.167\n",
      "Epoch  11 Batch   98/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.145\n",
      "Epoch  11 Batch   99/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.127\n",
      "Epoch  11 Batch  100/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.177\n",
      "Epoch  11 Batch  101/538 - Train Accuracy:  0.965, Validation Accuracy:  0.964, Loss:  1.094\n",
      "Epoch  11 Batch  102/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.180\n",
      "Epoch  11 Batch  103/538 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  1.124\n",
      "Epoch  11 Batch  104/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.199\n",
      "Epoch  11 Batch  105/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.179\n",
      "Epoch  11 Batch  106/538 - Train Accuracy:  0.967, Validation Accuracy:  0.975, Loss:  1.155\n",
      "Epoch  11 Batch  107/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.135\n",
      "Epoch  11 Batch  108/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.159\n",
      "Epoch  11 Batch  109/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.139\n",
      "Epoch  11 Batch  110/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.183\n",
      "Epoch  11 Batch  111/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.177\n",
      "Epoch  11 Batch  112/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.174\n",
      "Epoch  11 Batch  113/538 - Train Accuracy:  0.958, Validation Accuracy:  0.965, Loss:  1.175\n",
      "Epoch  11 Batch  114/538 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  1.134\n",
      "Epoch  11 Batch  115/538 - Train Accuracy:  0.981, Validation Accuracy:  0.962, Loss:  1.110\n",
      "Epoch  11 Batch  116/538 - Train Accuracy:  0.969, Validation Accuracy:  0.962, Loss:  1.124\n",
      "Epoch  11 Batch  117/538 - Train Accuracy:  0.969, Validation Accuracy:  0.964, Loss:  1.167\n",
      "Epoch  11 Batch  118/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.152\n",
      "Epoch  11 Batch  119/538 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  1.151\n",
      "Epoch  11 Batch  120/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.170\n",
      "Epoch  11 Batch  121/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.163\n",
      "Epoch  11 Batch  122/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.104\n",
      "Epoch  11 Batch  123/538 - Train Accuracy:  0.956, Validation Accuracy:  0.969, Loss:  1.171\n",
      "Epoch  11 Batch  124/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.198\n",
      "Epoch  11 Batch  125/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.129\n",
      "Epoch  11 Batch  126/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.157\n",
      "Epoch  11 Batch  127/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.175\n",
      "Epoch  11 Batch  128/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.124\n",
      "Epoch  11 Batch  129/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.163\n",
      "Epoch  11 Batch  130/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.146\n",
      "Epoch  11 Batch  131/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.145\n",
      "Epoch  11 Batch  132/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.095\n",
      "Epoch  11 Batch  133/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.094\n",
      "Epoch  11 Batch  134/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.157\n",
      "Epoch  11 Batch  135/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.144\n",
      "Epoch  11 Batch  136/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.171\n",
      "Epoch  11 Batch  137/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.134\n",
      "Epoch  11 Batch  138/538 - Train Accuracy:  0.974, Validation Accuracy:  0.967, Loss:  1.130\n",
      "Epoch  11 Batch  139/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.171\n",
      "Epoch  11 Batch  140/538 - Train Accuracy:  0.956, Validation Accuracy:  0.968, Loss:  1.152\n",
      "Epoch  11 Batch  141/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.123\n",
      "Epoch  11 Batch  142/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.129\n",
      "Epoch  11 Batch  143/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.133\n",
      "Epoch  11 Batch  144/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.144\n",
      "Epoch  11 Batch  145/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.239\n",
      "Epoch  11 Batch  146/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.131\n",
      "Epoch  11 Batch  147/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.150\n",
      "Epoch  11 Batch  148/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.204\n",
      "Epoch  11 Batch  149/538 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  1.173\n",
      "Epoch  11 Batch  150/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.140\n",
      "Epoch  11 Batch  151/538 - Train Accuracy:  0.953, Validation Accuracy:  0.963, Loss:  1.155\n",
      "Epoch  11 Batch  152/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.137\n",
      "Epoch  11 Batch  153/538 - Train Accuracy:  0.961, Validation Accuracy:  0.971, Loss:  1.150\n",
      "Epoch  11 Batch  154/538 - Train Accuracy:  0.970, Validation Accuracy:  0.973, Loss:  1.129\n",
      "Epoch  11 Batch  155/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.122\n",
      "Epoch  11 Batch  156/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.156\n",
      "Epoch  11 Batch  157/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.184\n",
      "Epoch  11 Batch  158/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.103\n",
      "Epoch  11 Batch  159/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.157\n",
      "Epoch  11 Batch  160/538 - Train Accuracy:  0.972, Validation Accuracy:  0.972, Loss:  1.123\n",
      "Epoch  11 Batch  161/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.168\n",
      "Epoch  11 Batch  162/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.165\n",
      "Epoch  11 Batch  163/538 - Train Accuracy:  0.969, Validation Accuracy:  0.975, Loss:  1.190\n",
      "Epoch  11 Batch  164/538 - Train Accuracy:  0.974, Validation Accuracy:  0.978, Loss:  1.191\n",
      "Epoch  11 Batch  165/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.118\n",
      "Epoch  11 Batch  166/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.189\n",
      "Epoch  11 Batch  167/538 - Train Accuracy:  0.964, Validation Accuracy:  0.974, Loss:  1.181\n",
      "Epoch  11 Batch  168/538 - Train Accuracy:  0.959, Validation Accuracy:  0.970, Loss:  1.178\n",
      "Epoch  11 Batch  169/538 - Train Accuracy:  0.974, Validation Accuracy:  0.973, Loss:  1.136\n",
      "Epoch  11 Batch  170/538 - Train Accuracy:  0.964, Validation Accuracy:  0.970, Loss:  1.149\n",
      "Epoch  11 Batch  171/538 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch  11 Batch  172/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  11 Batch  173/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.152\n",
      "Epoch  11 Batch  174/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.190\n",
      "Epoch  11 Batch  175/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.100\n",
      "Epoch  11 Batch  176/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.173\n",
      "Epoch  11 Batch  177/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.133\n",
      "Epoch  11 Batch  178/538 - Train Accuracy:  0.974, Validation Accuracy:  0.973, Loss:  1.101\n",
      "Epoch  11 Batch  179/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.139\n",
      "Epoch  11 Batch  180/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.161\n",
      "Epoch  11 Batch  181/538 - Train Accuracy:  0.962, Validation Accuracy:  0.967, Loss:  1.158\n",
      "Epoch  11 Batch  182/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.136\n",
      "Epoch  11 Batch  183/538 - Train Accuracy:  0.986, Validation Accuracy:  0.968, Loss:  1.121\n",
      "Epoch  11 Batch  184/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.139\n",
      "Epoch  11 Batch  185/538 - Train Accuracy:  0.983, Validation Accuracy:  0.965, Loss:  1.133\n",
      "Epoch  11 Batch  186/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.096\n",
      "Epoch  11 Batch  187/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.119\n",
      "Epoch  11 Batch  188/538 - Train Accuracy:  0.973, Validation Accuracy:  0.966, Loss:  1.117\n",
      "Epoch  11 Batch  189/538 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  1.191\n",
      "Epoch  11 Batch  190/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.136\n",
      "Epoch  11 Batch  191/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.152\n",
      "Epoch  11 Batch  192/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  11 Batch  193/538 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  1.131\n",
      "Epoch  11 Batch  194/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.126\n",
      "Epoch  11 Batch  195/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.161\n",
      "Epoch  11 Batch  196/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.158\n",
      "Epoch  11 Batch  197/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.142\n",
      "Epoch  11 Batch  198/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.167\n",
      "Epoch  11 Batch  199/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.123\n",
      "Epoch  11 Batch  200/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.119\n",
      "Epoch  11 Batch  201/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.204\n",
      "Epoch  11 Batch  202/538 - Train Accuracy:  0.981, Validation Accuracy:  0.964, Loss:  1.199\n",
      "Epoch  11 Batch  203/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.172\n",
      "Epoch  11 Batch  204/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.179\n",
      "Epoch  11 Batch  205/538 - Train Accuracy:  0.967, Validation Accuracy:  0.966, Loss:  1.143\n",
      "Epoch  11 Batch  206/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.148\n",
      "Epoch  11 Batch  207/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.152\n",
      "Epoch  11 Batch  208/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.198\n",
      "Epoch  11 Batch  209/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.152\n",
      "Epoch  11 Batch  210/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.203\n",
      "Epoch  11 Batch  211/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.139\n",
      "Epoch  11 Batch  212/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.153\n",
      "Epoch  11 Batch  213/538 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  1.114\n",
      "Epoch  11 Batch  214/538 - Train Accuracy:  0.981, Validation Accuracy:  0.976, Loss:  1.114\n",
      "Epoch  11 Batch  215/538 - Train Accuracy:  0.980, Validation Accuracy:  0.976, Loss:  1.139\n",
      "Epoch  11 Batch  216/538 - Train Accuracy:  0.975, Validation Accuracy:  0.976, Loss:  1.229\n",
      "Epoch  11 Batch  217/538 - Train Accuracy:  0.980, Validation Accuracy:  0.974, Loss:  1.142\n",
      "Epoch  11 Batch  218/538 - Train Accuracy:  0.986, Validation Accuracy:  0.973, Loss:  1.107\n",
      "Epoch  11 Batch  219/538 - Train Accuracy:  0.972, Validation Accuracy:  0.973, Loss:  1.178\n",
      "Epoch  11 Batch  220/538 - Train Accuracy:  0.972, Validation Accuracy:  0.973, Loss:  1.156\n",
      "Epoch  11 Batch  221/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch  11 Batch  222/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.118\n",
      "Epoch  11 Batch  223/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.154\n",
      "Epoch  11 Batch  224/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.229\n",
      "Epoch  11 Batch  225/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.114\n",
      "Epoch  11 Batch  226/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.177\n",
      "Epoch  11 Batch  227/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.158\n",
      "Epoch  11 Batch  228/538 - Train Accuracy:  0.967, Validation Accuracy:  0.973, Loss:  1.108\n",
      "Epoch  11 Batch  229/538 - Train Accuracy:  0.971, Validation Accuracy:  0.976, Loss:  1.124\n",
      "Epoch  11 Batch  230/538 - Train Accuracy:  0.968, Validation Accuracy:  0.976, Loss:  1.127\n",
      "Epoch  11 Batch  231/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.112\n",
      "Epoch  11 Batch  232/538 - Train Accuracy:  0.965, Validation Accuracy:  0.976, Loss:  1.116\n",
      "Epoch  11 Batch  233/538 - Train Accuracy:  0.984, Validation Accuracy:  0.976, Loss:  1.134\n",
      "Epoch  11 Batch  234/538 - Train Accuracy:  0.970, Validation Accuracy:  0.976, Loss:  1.183\n",
      "Epoch  11 Batch  235/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.132\n",
      "Epoch  11 Batch  236/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.149\n",
      "Epoch  11 Batch  237/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.136\n",
      "Epoch  11 Batch  238/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.147\n",
      "Epoch  11 Batch  239/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.168\n",
      "Epoch  11 Batch  240/538 - Train Accuracy:  0.974, Validation Accuracy:  0.974, Loss:  1.098\n",
      "Epoch  11 Batch  241/538 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  1.178\n",
      "Epoch  11 Batch  242/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.197\n",
      "Epoch  11 Batch  243/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.191\n",
      "Epoch  11 Batch  244/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.151\n",
      "Epoch  11 Batch  245/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.163\n",
      "Epoch  11 Batch  246/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.104\n",
      "Epoch  11 Batch  247/538 - Train Accuracy:  0.950, Validation Accuracy:  0.974, Loss:  1.198\n",
      "Epoch  11 Batch  248/538 - Train Accuracy:  0.972, Validation Accuracy:  0.977, Loss:  1.163\n",
      "Epoch  11 Batch  249/538 - Train Accuracy:  0.972, Validation Accuracy:  0.977, Loss:  1.110\n",
      "Epoch  11 Batch  250/538 - Train Accuracy:  0.985, Validation Accuracy:  0.976, Loss:  1.154\n",
      "Epoch  11 Batch  251/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.105\n",
      "Epoch  11 Batch  252/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.127\n",
      "Epoch  11 Batch  253/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.124\n",
      "Epoch  11 Batch  254/538 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  1.153\n",
      "Epoch  11 Batch  255/538 - Train Accuracy:  0.967, Validation Accuracy:  0.962, Loss:  1.132\n",
      "Epoch  11 Batch  256/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.153\n",
      "Epoch  11 Batch  257/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.124\n",
      "Epoch  11 Batch  258/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.099\n",
      "Epoch  11 Batch  259/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.183\n",
      "Epoch  11 Batch  260/538 - Train Accuracy:  0.951, Validation Accuracy:  0.976, Loss:  1.099\n",
      "Epoch  11 Batch  261/538 - Train Accuracy:  0.963, Validation Accuracy:  0.976, Loss:  1.183\n",
      "Epoch  11 Batch  262/538 - Train Accuracy:  0.971, Validation Accuracy:  0.979, Loss:  1.158\n",
      "Epoch  11 Batch  263/538 - Train Accuracy:  0.968, Validation Accuracy:  0.976, Loss:  1.176\n",
      "Epoch  11 Batch  264/538 - Train Accuracy:  0.971, Validation Accuracy:  0.975, Loss:  1.154\n",
      "Epoch  11 Batch  265/538 - Train Accuracy:  0.964, Validation Accuracy:  0.971, Loss:  1.137\n",
      "Epoch  11 Batch  266/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.171\n",
      "Epoch  11 Batch  267/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.116\n",
      "Epoch  11 Batch  268/538 - Train Accuracy:  0.985, Validation Accuracy:  0.966, Loss:  1.129\n",
      "Epoch  11 Batch  269/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.171\n",
      "Epoch  11 Batch  270/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.109\n",
      "Epoch  11 Batch  271/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.111\n",
      "Epoch  11 Batch  272/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.153\n",
      "Epoch  11 Batch  273/538 - Train Accuracy:  0.965, Validation Accuracy:  0.974, Loss:  1.121\n",
      "Epoch  11 Batch  274/538 - Train Accuracy:  0.960, Validation Accuracy:  0.974, Loss:  1.179\n",
      "Epoch  11 Batch  275/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.164\n",
      "Epoch  11 Batch  276/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.149\n",
      "Epoch  11 Batch  277/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.177\n",
      "Epoch  11 Batch  278/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.205\n",
      "Epoch  11 Batch  279/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.160\n",
      "Epoch  11 Batch  280/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.150\n",
      "Epoch  11 Batch  281/538 - Train Accuracy:  0.967, Validation Accuracy:  0.973, Loss:  1.203\n",
      "Epoch  11 Batch  282/538 - Train Accuracy:  0.974, Validation Accuracy:  0.974, Loss:  1.164\n",
      "Epoch  11 Batch  283/538 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  1.163\n",
      "Epoch  11 Batch  284/538 - Train Accuracy:  0.962, Validation Accuracy:  0.972, Loss:  1.183\n",
      "Epoch  11 Batch  285/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.127\n",
      "Epoch  11 Batch  286/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.154\n",
      "Epoch  11 Batch  287/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.117\n",
      "Epoch  11 Batch  288/538 - Train Accuracy:  0.973, Validation Accuracy:  0.972, Loss:  1.126\n",
      "Epoch  11 Batch  289/538 - Train Accuracy:  0.963, Validation Accuracy:  0.972, Loss:  1.129\n",
      "Epoch  11 Batch  290/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.141\n",
      "Epoch  11 Batch  291/538 - Train Accuracy:  0.983, Validation Accuracy:  0.979, Loss:  1.105\n",
      "Epoch  11 Batch  292/538 - Train Accuracy:  0.990, Validation Accuracy:  0.978, Loss:  1.138\n",
      "Epoch  11 Batch  293/538 - Train Accuracy:  0.967, Validation Accuracy:  0.978, Loss:  1.121\n",
      "Epoch  11 Batch  294/538 - Train Accuracy:  0.981, Validation Accuracy:  0.978, Loss:  1.196\n",
      "Epoch  11 Batch  295/538 - Train Accuracy:  0.982, Validation Accuracy:  0.978, Loss:  1.108\n",
      "Epoch  11 Batch  296/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.137\n",
      "Epoch  11 Batch  297/538 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  1.168\n",
      "Epoch  11 Batch  298/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.159\n",
      "Epoch  11 Batch  299/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.103\n",
      "Epoch  11 Batch  300/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.083\n",
      "Epoch  11 Batch  301/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.163\n",
      "Epoch  11 Batch  302/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.119\n",
      "Epoch  11 Batch  303/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.142\n",
      "Epoch  11 Batch  304/538 - Train Accuracy:  0.972, Validation Accuracy:  0.972, Loss:  1.161\n",
      "Epoch  11 Batch  305/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.110\n",
      "Epoch  11 Batch  306/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.147\n",
      "Epoch  11 Batch  307/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.140\n",
      "Epoch  11 Batch  308/538 - Train Accuracy:  0.976, Validation Accuracy:  0.976, Loss:  1.150\n",
      "Epoch  11 Batch  309/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.146\n",
      "Epoch  11 Batch  310/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.156\n",
      "Epoch  11 Batch  311/538 - Train Accuracy:  0.978, Validation Accuracy:  0.973, Loss:  1.188\n",
      "Epoch  11 Batch  312/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.091\n",
      "Epoch  11 Batch  313/538 - Train Accuracy:  0.969, Validation Accuracy:  0.973, Loss:  1.215\n",
      "Epoch  11 Batch  314/538 - Train Accuracy:  0.987, Validation Accuracy:  0.973, Loss:  1.147\n",
      "Epoch  11 Batch  315/538 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch  11 Batch  316/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.121\n",
      "Epoch  11 Batch  317/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.179\n",
      "Epoch  11 Batch  318/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  11 Batch  319/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.117\n",
      "Epoch  11 Batch  320/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.140\n",
      "Epoch  11 Batch  321/538 - Train Accuracy:  0.971, Validation Accuracy:  0.965, Loss:  1.153\n",
      "Epoch  11 Batch  322/538 - Train Accuracy:  0.982, Validation Accuracy:  0.964, Loss:  1.208\n",
      "Epoch  11 Batch  323/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.124\n",
      "Epoch  11 Batch  324/538 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  1.166\n",
      "Epoch  11 Batch  325/538 - Train Accuracy:  0.985, Validation Accuracy:  0.965, Loss:  1.125\n",
      "Epoch  11 Batch  326/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.105\n",
      "Epoch  11 Batch  327/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.138\n",
      "Epoch  11 Batch  328/538 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  1.185\n",
      "Epoch  11 Batch  329/538 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  1.118\n",
      "Epoch  11 Batch  330/538 - Train Accuracy:  0.976, Validation Accuracy:  0.966, Loss:  1.124\n",
      "Epoch  11 Batch  331/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.168\n",
      "Epoch  11 Batch  332/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.156\n",
      "Epoch  11 Batch  333/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.174\n",
      "Epoch  11 Batch  334/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.167\n",
      "Epoch  11 Batch  335/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.140\n",
      "Epoch  11 Batch  336/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.166\n",
      "Epoch  11 Batch  337/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.104\n",
      "Epoch  11 Batch  338/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.117\n",
      "Epoch  11 Batch  339/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.150\n",
      "Epoch  11 Batch  340/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.111\n",
      "Epoch  11 Batch  341/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.125\n",
      "Epoch  11 Batch  342/538 - Train Accuracy:  0.962, Validation Accuracy:  0.965, Loss:  1.201\n",
      "Epoch  11 Batch  343/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.158\n",
      "Epoch  11 Batch  344/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.144\n",
      "Epoch  11 Batch  345/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.124\n",
      "Epoch  11 Batch  346/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.153\n",
      "Epoch  11 Batch  347/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.133\n",
      "Epoch  11 Batch  348/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.151\n",
      "Epoch  11 Batch  349/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.170\n",
      "Epoch  11 Batch  350/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.136\n",
      "Epoch  11 Batch  351/538 - Train Accuracy:  0.967, Validation Accuracy:  0.972, Loss:  1.125\n",
      "Epoch  11 Batch  352/538 - Train Accuracy:  0.966, Validation Accuracy:  0.974, Loss:  1.142\n",
      "Epoch  11 Batch  353/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.103\n",
      "Epoch  11 Batch  354/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.127\n",
      "Epoch  11 Batch  355/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.142\n",
      "Epoch  11 Batch  356/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.138\n",
      "Epoch  11 Batch  357/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.117\n",
      "Epoch  11 Batch  358/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.150\n",
      "Epoch  11 Batch  359/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.154\n",
      "Epoch  11 Batch  360/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.140\n",
      "Epoch  11 Batch  361/538 - Train Accuracy:  0.983, Validation Accuracy:  0.976, Loss:  1.176\n",
      "Epoch  11 Batch  362/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.135\n",
      "Epoch  11 Batch  363/538 - Train Accuracy:  0.969, Validation Accuracy:  0.974, Loss:  1.163\n",
      "Epoch  11 Batch  364/538 - Train Accuracy:  0.971, Validation Accuracy:  0.973, Loss:  1.145\n",
      "Epoch  11 Batch  365/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  11 Batch  366/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.097\n",
      "Epoch  11 Batch  367/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.131\n",
      "Epoch  11 Batch  368/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.134\n",
      "Epoch  11 Batch  369/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.134\n",
      "Epoch  11 Batch  370/538 - Train Accuracy:  0.973, Validation Accuracy:  0.962, Loss:  1.156\n",
      "Epoch  11 Batch  371/538 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  1.153\n",
      "Epoch  11 Batch  372/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.159\n",
      "Epoch  11 Batch  373/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.060\n",
      "Epoch  11 Batch  374/538 - Train Accuracy:  0.976, Validation Accuracy:  0.966, Loss:  1.137\n",
      "Epoch  11 Batch  375/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.112\n",
      "Epoch  11 Batch  376/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.137\n",
      "Epoch  11 Batch  377/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.174\n",
      "Epoch  11 Batch  378/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.097\n",
      "Epoch  11 Batch  379/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.143\n",
      "Epoch  11 Batch  380/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.113\n",
      "Epoch  11 Batch  381/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch  11 Batch  382/538 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  1.085\n",
      "Epoch  11 Batch  383/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.144\n",
      "Epoch  11 Batch  384/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.170\n",
      "Epoch  11 Batch  385/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.121\n",
      "Epoch  11 Batch  386/538 - Train Accuracy:  0.987, Validation Accuracy:  0.966, Loss:  1.178\n",
      "Epoch  11 Batch  387/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.116\n",
      "Epoch  11 Batch  388/538 - Train Accuracy:  0.967, Validation Accuracy:  0.968, Loss:  1.156\n",
      "Epoch  11 Batch  389/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.130\n",
      "Epoch  11 Batch  390/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.185\n",
      "Epoch  11 Batch  391/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.116\n",
      "Epoch  11 Batch  392/538 - Train Accuracy:  0.986, Validation Accuracy:  0.966, Loss:  1.108\n",
      "Epoch  11 Batch  393/538 - Train Accuracy:  0.982, Validation Accuracy:  0.961, Loss:  1.088\n",
      "Epoch  11 Batch  394/538 - Train Accuracy:  0.955, Validation Accuracy:  0.956, Loss:  1.111\n",
      "Epoch  11 Batch  395/538 - Train Accuracy:  0.977, Validation Accuracy:  0.958, Loss:  1.190\n",
      "Epoch  11 Batch  396/538 - Train Accuracy:  0.980, Validation Accuracy:  0.958, Loss:  1.186\n",
      "Epoch  11 Batch  397/538 - Train Accuracy:  0.973, Validation Accuracy:  0.966, Loss:  1.126\n",
      "Epoch  11 Batch  398/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.119\n",
      "Epoch  11 Batch  399/538 - Train Accuracy:  0.963, Validation Accuracy:  0.970, Loss:  1.147\n",
      "Epoch  11 Batch  400/538 - Train Accuracy:  0.980, Validation Accuracy:  0.977, Loss:  1.115\n",
      "Epoch  11 Batch  401/538 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  1.059\n",
      "Epoch  11 Batch  402/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.202\n",
      "Epoch  11 Batch  403/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.122\n",
      "Epoch  11 Batch  404/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.126\n",
      "Epoch  11 Batch  405/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.199\n",
      "Epoch  11 Batch  406/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.171\n",
      "Epoch  11 Batch  407/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.171\n",
      "Epoch  11 Batch  408/538 - Train Accuracy:  0.970, Validation Accuracy:  0.975, Loss:  1.103\n",
      "Epoch  11 Batch  409/538 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  1.130\n",
      "Epoch  11 Batch  410/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.147\n",
      "Epoch  11 Batch  411/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.169\n",
      "Epoch  11 Batch  412/538 - Train Accuracy:  0.987, Validation Accuracy:  0.962, Loss:  1.126\n",
      "Epoch  11 Batch  413/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.113\n",
      "Epoch  11 Batch  414/538 - Train Accuracy:  0.956, Validation Accuracy:  0.962, Loss:  1.172\n",
      "Epoch  11 Batch  415/538 - Train Accuracy:  0.968, Validation Accuracy:  0.965, Loss:  1.118\n",
      "Epoch  11 Batch  416/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.159\n",
      "Epoch  11 Batch  417/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.089\n",
      "Epoch  11 Batch  418/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.150\n",
      "Epoch  11 Batch  419/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.108\n",
      "Epoch  11 Batch  420/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.176\n",
      "Epoch  11 Batch  421/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.206\n",
      "Epoch  11 Batch  422/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.143\n",
      "Epoch  11 Batch  423/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.074\n",
      "Epoch  11 Batch  424/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.180\n",
      "Epoch  11 Batch  425/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.177\n",
      "Epoch  11 Batch  426/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.113\n",
      "Epoch  11 Batch  427/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.130\n",
      "Epoch  11 Batch  428/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.132\n",
      "Epoch  11 Batch  429/538 - Train Accuracy:  0.988, Validation Accuracy:  0.969, Loss:  1.151\n",
      "Epoch  11 Batch  430/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.181\n",
      "Epoch  11 Batch  431/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.135\n",
      "Epoch  11 Batch  432/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.145\n",
      "Epoch  11 Batch  433/538 - Train Accuracy:  0.967, Validation Accuracy:  0.972, Loss:  1.142\n",
      "Epoch  11 Batch  434/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.185\n",
      "Epoch  11 Batch  435/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.165\n",
      "Epoch  11 Batch  436/538 - Train Accuracy:  0.958, Validation Accuracy:  0.966, Loss:  1.177\n",
      "Epoch  11 Batch  437/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.146\n",
      "Epoch  11 Batch  438/538 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  1.133\n",
      "Epoch  11 Batch  439/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.143\n",
      "Epoch  11 Batch  440/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.155\n",
      "Epoch  11 Batch  441/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.131\n",
      "Epoch  11 Batch  442/538 - Train Accuracy:  0.976, Validation Accuracy:  0.976, Loss:  1.164\n",
      "Epoch  11 Batch  443/538 - Train Accuracy:  0.970, Validation Accuracy:  0.976, Loss:  1.137\n",
      "Epoch  11 Batch  444/538 - Train Accuracy:  0.973, Validation Accuracy:  0.976, Loss:  1.175\n",
      "Epoch  11 Batch  445/538 - Train Accuracy:  0.987, Validation Accuracy:  0.978, Loss:  1.107\n",
      "Epoch  11 Batch  446/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.143\n",
      "Epoch  11 Batch  447/538 - Train Accuracy:  0.969, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  11 Batch  448/538 - Train Accuracy:  0.961, Validation Accuracy:  0.972, Loss:  1.123\n",
      "Epoch  11 Batch  449/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.147\n",
      "Epoch  11 Batch  450/538 - Train Accuracy:  0.958, Validation Accuracy:  0.971, Loss:  1.127\n",
      "Epoch  11 Batch  451/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.166\n",
      "Epoch  11 Batch  452/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.140\n",
      "Epoch  11 Batch  453/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.172\n",
      "Epoch  11 Batch  454/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.119\n",
      "Epoch  11 Batch  455/538 - Train Accuracy:  0.974, Validation Accuracy:  0.975, Loss:  1.170\n",
      "Epoch  11 Batch  456/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.169\n",
      "Epoch  11 Batch  457/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.152\n",
      "Epoch  11 Batch  458/538 - Train Accuracy:  0.983, Validation Accuracy:  0.977, Loss:  1.090\n",
      "Epoch  11 Batch  459/538 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  1.118\n",
      "Epoch  11 Batch  460/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.110\n",
      "Epoch  11 Batch  461/538 - Train Accuracy:  0.975, Validation Accuracy:  0.978, Loss:  1.110\n",
      "Epoch  11 Batch  462/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.067\n",
      "Epoch  11 Batch  463/538 - Train Accuracy:  0.965, Validation Accuracy:  0.976, Loss:  1.150\n",
      "Epoch  11 Batch  464/538 - Train Accuracy:  0.985, Validation Accuracy:  0.977, Loss:  1.188\n",
      "Epoch  11 Batch  465/538 - Train Accuracy:  0.972, Validation Accuracy:  0.977, Loss:  1.141\n",
      "Epoch  11 Batch  466/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.164\n",
      "Epoch  11 Batch  467/538 - Train Accuracy:  0.976, Validation Accuracy:  0.976, Loss:  1.140\n",
      "Epoch  11 Batch  468/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.094\n",
      "Epoch  11 Batch  469/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.132\n",
      "Epoch  11 Batch  470/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.169\n",
      "Epoch  11 Batch  471/538 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  1.120\n",
      "Epoch  11 Batch  472/538 - Train Accuracy:  0.989, Validation Accuracy:  0.966, Loss:  1.104\n",
      "Epoch  11 Batch  473/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.205\n",
      "Epoch  11 Batch  474/538 - Train Accuracy:  0.962, Validation Accuracy:  0.963, Loss:  1.153\n",
      "Epoch  11 Batch  475/538 - Train Accuracy:  0.974, Validation Accuracy:  0.957, Loss:  1.152\n",
      "Epoch  11 Batch  476/538 - Train Accuracy:  0.979, Validation Accuracy:  0.959, Loss:  1.148\n",
      "Epoch  11 Batch  477/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.154\n",
      "Epoch  11 Batch  478/538 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  1.139\n",
      "Epoch  11 Batch  479/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.127\n",
      "Epoch  11 Batch  480/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.179\n",
      "Epoch  11 Batch  481/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.166\n",
      "Epoch  11 Batch  482/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.170\n",
      "Epoch  11 Batch  483/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.139\n",
      "Epoch  11 Batch  484/538 - Train Accuracy:  0.968, Validation Accuracy:  0.974, Loss:  1.178\n",
      "Epoch  11 Batch  485/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.153\n",
      "Epoch  11 Batch  486/538 - Train Accuracy:  0.983, Validation Accuracy:  0.976, Loss:  1.119\n",
      "Epoch  11 Batch  487/538 - Train Accuracy:  0.983, Validation Accuracy:  0.976, Loss:  1.153\n",
      "Epoch  11 Batch  488/538 - Train Accuracy:  0.983, Validation Accuracy:  0.976, Loss:  1.152\n",
      "Epoch  11 Batch  489/538 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  1.069\n",
      "Epoch  11 Batch  490/538 - Train Accuracy:  0.969, Validation Accuracy:  0.975, Loss:  1.110\n",
      "Epoch  11 Batch  491/538 - Train Accuracy:  0.968, Validation Accuracy:  0.978, Loss:  1.200\n",
      "Epoch  11 Batch  492/538 - Train Accuracy:  0.979, Validation Accuracy:  0.978, Loss:  1.162\n",
      "Epoch  11 Batch  493/538 - Train Accuracy:  0.967, Validation Accuracy:  0.979, Loss:  1.132\n",
      "Epoch  11 Batch  494/538 - Train Accuracy:  0.978, Validation Accuracy:  0.979, Loss:  1.148\n",
      "Epoch  11 Batch  495/538 - Train Accuracy:  0.981, Validation Accuracy:  0.977, Loss:  1.106\n",
      "Epoch  11 Batch  496/538 - Train Accuracy:  0.969, Validation Accuracy:  0.976, Loss:  1.129\n",
      "Epoch  11 Batch  497/538 - Train Accuracy:  0.983, Validation Accuracy:  0.979, Loss:  1.143\n",
      "Epoch  11 Batch  498/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.174\n",
      "Epoch  11 Batch  499/538 - Train Accuracy:  0.967, Validation Accuracy:  0.976, Loss:  1.096\n",
      "Epoch  11 Batch  500/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.118\n",
      "Epoch  11 Batch  501/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.121\n",
      "Epoch  11 Batch  502/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.119\n",
      "Epoch  11 Batch  503/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.124\n",
      "Epoch  11 Batch  504/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.155\n",
      "Epoch  11 Batch  505/538 - Train Accuracy:  0.985, Validation Accuracy:  0.976, Loss:  1.115\n",
      "Epoch  11 Batch  506/538 - Train Accuracy:  0.974, Validation Accuracy:  0.981, Loss:  1.124\n",
      "Epoch  11 Batch  507/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.151\n",
      "Epoch  11 Batch  508/538 - Train Accuracy:  0.974, Validation Accuracy:  0.977, Loss:  1.132\n",
      "Epoch  11 Batch  509/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.163\n",
      "Epoch  11 Batch  510/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.119\n",
      "Epoch  11 Batch  511/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.209\n",
      "Epoch  11 Batch  512/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.177\n",
      "Epoch  11 Batch  513/538 - Train Accuracy:  0.970, Validation Accuracy:  0.966, Loss:  1.152\n",
      "Epoch  11 Batch  514/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.187\n",
      "Epoch  11 Batch  515/538 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  1.195\n",
      "Epoch  11 Batch  516/538 - Train Accuracy:  0.981, Validation Accuracy:  0.964, Loss:  1.140\n",
      "Epoch  11 Batch  517/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.151\n",
      "Epoch  11 Batch  518/538 - Train Accuracy:  0.975, Validation Accuracy:  0.961, Loss:  1.212\n",
      "Epoch  11 Batch  519/538 - Train Accuracy:  0.970, Validation Accuracy:  0.960, Loss:  1.134\n",
      "Epoch  11 Batch  520/538 - Train Accuracy:  0.980, Validation Accuracy:  0.961, Loss:  1.134\n",
      "Epoch  11 Batch  521/538 - Train Accuracy:  0.987, Validation Accuracy:  0.965, Loss:  1.144\n",
      "Epoch  11 Batch  522/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.143\n",
      "Epoch  11 Batch  523/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.190\n",
      "Epoch  11 Batch  524/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.195\n",
      "Epoch  11 Batch  525/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.114\n",
      "Epoch  11 Batch  526/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.139\n",
      "Epoch  11 Batch  527/538 - Train Accuracy:  0.988, Validation Accuracy:  0.971, Loss:  1.098\n",
      "Epoch  11 Batch  528/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.161\n",
      "Epoch  11 Batch  529/538 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  1.172\n",
      "Epoch  11 Batch  530/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.131\n",
      "Epoch  11 Batch  531/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.128\n",
      "Epoch  11 Batch  532/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.100\n",
      "Epoch  11 Batch  533/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.129\n",
      "Epoch  11 Batch  534/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.180\n",
      "Epoch  11 Batch  535/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.164\n",
      "Epoch  11 Batch  536/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.170\n",
      "Epoch  12 Batch    0/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.137\n",
      "Epoch  12 Batch    1/538 - Train Accuracy:  0.982, Validation Accuracy:  0.962, Loss:  1.095\n",
      "Epoch  12 Batch    2/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.129\n",
      "Epoch  12 Batch    3/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.139\n",
      "Epoch  12 Batch    4/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.147\n",
      "Epoch  12 Batch    5/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.150\n",
      "Epoch  12 Batch    6/538 - Train Accuracy:  0.985, Validation Accuracy:  0.966, Loss:  1.134\n",
      "Epoch  12 Batch    7/538 - Train Accuracy:  0.985, Validation Accuracy:  0.965, Loss:  1.106\n",
      "Epoch  12 Batch    8/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.135\n",
      "Epoch  12 Batch    9/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.152\n",
      "Epoch  12 Batch   10/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.127\n",
      "Epoch  12 Batch   11/538 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  1.126\n",
      "Epoch  12 Batch   12/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.134\n",
      "Epoch  12 Batch   13/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.138\n",
      "Epoch  12 Batch   14/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.155\n",
      "Epoch  12 Batch   15/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.142\n",
      "Epoch  12 Batch   16/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.142\n",
      "Epoch  12 Batch   17/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.135\n",
      "Epoch  12 Batch   18/538 - Train Accuracy:  0.985, Validation Accuracy:  0.965, Loss:  1.156\n",
      "Epoch  12 Batch   19/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.118\n",
      "Epoch  12 Batch   20/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.118\n",
      "Epoch  12 Batch   21/538 - Train Accuracy:  0.992, Validation Accuracy:  0.971, Loss:  1.097\n",
      "Epoch  12 Batch   22/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.137\n",
      "Epoch  12 Batch   23/538 - Train Accuracy:  0.968, Validation Accuracy:  0.973, Loss:  1.115\n",
      "Epoch  12 Batch   24/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.197\n",
      "Epoch  12 Batch   25/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.127\n",
      "Epoch  12 Batch   26/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.114\n",
      "Epoch  12 Batch   27/538 - Train Accuracy:  0.990, Validation Accuracy:  0.974, Loss:  1.155\n",
      "Epoch  12 Batch   28/538 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  1.144\n",
      "Epoch  12 Batch   29/538 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  1.120\n",
      "Epoch  12 Batch   30/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.160\n",
      "Epoch  12 Batch   31/538 - Train Accuracy:  0.989, Validation Accuracy:  0.971, Loss:  1.171\n",
      "Epoch  12 Batch   32/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.132\n",
      "Epoch  12 Batch   33/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.148\n",
      "Epoch  12 Batch   34/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.179\n",
      "Epoch  12 Batch   35/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.133\n",
      "Epoch  12 Batch   36/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.138\n",
      "Epoch  12 Batch   37/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.114\n",
      "Epoch  12 Batch   38/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.151\n",
      "Epoch  12 Batch   39/538 - Train Accuracy:  0.972, Validation Accuracy:  0.972, Loss:  1.159\n",
      "Epoch  12 Batch   40/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.106\n",
      "Epoch  12 Batch   41/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.135\n",
      "Epoch  12 Batch   42/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.118\n",
      "Epoch  12 Batch   43/538 - Train Accuracy:  0.948, Validation Accuracy:  0.972, Loss:  1.136\n",
      "Epoch  12 Batch   44/538 - Train Accuracy:  0.987, Validation Accuracy:  0.972, Loss:  1.150\n",
      "Epoch  12 Batch   45/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.160\n",
      "Epoch  12 Batch   46/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.141\n",
      "Epoch  12 Batch   47/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.121\n",
      "Epoch  12 Batch   48/538 - Train Accuracy:  0.966, Validation Accuracy:  0.975, Loss:  1.118\n",
      "Epoch  12 Batch   49/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.123\n",
      "Epoch  12 Batch   50/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.155\n",
      "Epoch  12 Batch   51/538 - Train Accuracy:  0.976, Validation Accuracy:  0.976, Loss:  1.142\n",
      "Epoch  12 Batch   52/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.128\n",
      "Epoch  12 Batch   53/538 - Train Accuracy:  0.958, Validation Accuracy:  0.977, Loss:  1.156\n",
      "Epoch  12 Batch   54/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  12 Batch   55/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.120\n",
      "Epoch  12 Batch   56/538 - Train Accuracy:  0.972, Validation Accuracy:  0.975, Loss:  1.121\n",
      "Epoch  12 Batch   57/538 - Train Accuracy:  0.964, Validation Accuracy:  0.974, Loss:  1.129\n",
      "Epoch  12 Batch   58/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.117\n",
      "Epoch  12 Batch   59/538 - Train Accuracy:  0.973, Validation Accuracy:  0.978, Loss:  1.161\n",
      "Epoch  12 Batch   60/538 - Train Accuracy:  0.981, Validation Accuracy:  0.978, Loss:  1.130\n",
      "Epoch  12 Batch   61/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.105\n",
      "Epoch  12 Batch   62/538 - Train Accuracy:  0.963, Validation Accuracy:  0.970, Loss:  1.110\n",
      "Epoch  12 Batch   63/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.183\n",
      "Epoch  12 Batch   64/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.159\n",
      "Epoch  12 Batch   65/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.104\n",
      "Epoch  12 Batch   66/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.158\n",
      "Epoch  12 Batch   67/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.123\n",
      "Epoch  12 Batch   68/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch  12 Batch   69/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.138\n",
      "Epoch  12 Batch   70/538 - Train Accuracy:  0.973, Validation Accuracy:  0.975, Loss:  1.174\n",
      "Epoch  12 Batch   71/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.100\n",
      "Epoch  12 Batch   72/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.175\n",
      "Epoch  12 Batch   73/538 - Train Accuracy:  0.966, Validation Accuracy:  0.965, Loss:  1.083\n",
      "Epoch  12 Batch   74/538 - Train Accuracy:  0.983, Validation Accuracy:  0.965, Loss:  1.124\n",
      "Epoch  12 Batch   75/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.170\n",
      "Epoch  12 Batch   76/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.094\n",
      "Epoch  12 Batch   77/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.176\n",
      "Epoch  12 Batch   78/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.082\n",
      "Epoch  12 Batch   79/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.114\n",
      "Epoch  12 Batch   80/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.112\n",
      "Epoch  12 Batch   81/538 - Train Accuracy:  0.970, Validation Accuracy:  0.968, Loss:  1.142\n",
      "Epoch  12 Batch   82/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.144\n",
      "Epoch  12 Batch   83/538 - Train Accuracy:  0.965, Validation Accuracy:  0.977, Loss:  1.130\n",
      "Epoch  12 Batch   84/538 - Train Accuracy:  0.964, Validation Accuracy:  0.970, Loss:  1.163\n",
      "Epoch  12 Batch   85/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.142\n",
      "Epoch  12 Batch   86/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.138\n",
      "Epoch  12 Batch   87/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.163\n",
      "Epoch  12 Batch   88/538 - Train Accuracy:  0.984, Validation Accuracy:  0.966, Loss:  1.134\n",
      "Epoch  12 Batch   89/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.109\n",
      "Epoch  12 Batch   90/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.162\n",
      "Epoch  12 Batch   91/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.133\n",
      "Epoch  12 Batch   92/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.139\n",
      "Epoch  12 Batch   93/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.128\n",
      "Epoch  12 Batch   94/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.127\n",
      "Epoch  12 Batch   95/538 - Train Accuracy:  0.961, Validation Accuracy:  0.976, Loss:  1.115\n",
      "Epoch  12 Batch   96/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.098\n",
      "Epoch  12 Batch   97/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.109\n",
      "Epoch  12 Batch   98/538 - Train Accuracy:  0.972, Validation Accuracy:  0.977, Loss:  1.139\n",
      "Epoch  12 Batch   99/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.168\n",
      "Epoch  12 Batch  100/538 - Train Accuracy:  0.978, Validation Accuracy:  0.973, Loss:  1.188\n",
      "Epoch  12 Batch  101/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.096\n",
      "Epoch  12 Batch  102/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.099\n",
      "Epoch  12 Batch  103/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.118\n",
      "Epoch  12 Batch  104/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.137\n",
      "Epoch  12 Batch  105/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  12 Batch  106/538 - Train Accuracy:  0.986, Validation Accuracy:  0.972, Loss:  1.119\n",
      "Epoch  12 Batch  107/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.169\n",
      "Epoch  12 Batch  108/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.113\n",
      "Epoch  12 Batch  109/538 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  1.151\n",
      "Epoch  12 Batch  110/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.117\n",
      "Epoch  12 Batch  111/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.122\n",
      "Epoch  12 Batch  112/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.166\n",
      "Epoch  12 Batch  113/538 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  1.128\n",
      "Epoch  12 Batch  114/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.150\n",
      "Epoch  12 Batch  115/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.157\n",
      "Epoch  12 Batch  116/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.218\n",
      "Epoch  12 Batch  117/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.127\n",
      "Epoch  12 Batch  118/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch  12 Batch  119/538 - Train Accuracy:  0.989, Validation Accuracy:  0.969, Loss:  1.144\n",
      "Epoch  12 Batch  120/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.156\n",
      "Epoch  12 Batch  121/538 - Train Accuracy:  0.970, Validation Accuracy:  0.974, Loss:  1.149\n",
      "Epoch  12 Batch  122/538 - Train Accuracy:  0.965, Validation Accuracy:  0.974, Loss:  1.156\n",
      "Epoch  12 Batch  123/538 - Train Accuracy:  0.969, Validation Accuracy:  0.977, Loss:  1.208\n",
      "Epoch  12 Batch  124/538 - Train Accuracy:  0.965, Validation Accuracy:  0.974, Loss:  1.163\n",
      "Epoch  12 Batch  125/538 - Train Accuracy:  0.974, Validation Accuracy:  0.974, Loss:  1.161\n",
      "Epoch  12 Batch  126/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.105\n",
      "Epoch  12 Batch  127/538 - Train Accuracy:  0.969, Validation Accuracy:  0.972, Loss:  1.180\n",
      "Epoch  12 Batch  128/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.148\n",
      "Epoch  12 Batch  129/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.147\n",
      "Epoch  12 Batch  130/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  12 Batch  131/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.174\n",
      "Epoch  12 Batch  132/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.158\n",
      "Epoch  12 Batch  133/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.100\n",
      "Epoch  12 Batch  134/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch  12 Batch  135/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.180\n",
      "Epoch  12 Batch  136/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.155\n",
      "Epoch  12 Batch  137/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.141\n",
      "Epoch  12 Batch  138/538 - Train Accuracy:  0.969, Validation Accuracy:  0.969, Loss:  1.142\n",
      "Epoch  12 Batch  139/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.176\n",
      "Epoch  12 Batch  140/538 - Train Accuracy:  0.958, Validation Accuracy:  0.971, Loss:  1.137\n",
      "Epoch  12 Batch  141/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.150\n",
      "Epoch  12 Batch  142/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.099\n",
      "Epoch  12 Batch  143/538 - Train Accuracy:  0.972, Validation Accuracy:  0.975, Loss:  1.147\n",
      "Epoch  12 Batch  144/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.156\n",
      "Epoch  12 Batch  145/538 - Train Accuracy:  0.971, Validation Accuracy:  0.975, Loss:  1.155\n",
      "Epoch  12 Batch  146/538 - Train Accuracy:  0.974, Validation Accuracy:  0.976, Loss:  1.144\n",
      "Epoch  12 Batch  147/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.116\n",
      "Epoch  12 Batch  148/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.202\n",
      "Epoch  12 Batch  149/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.132\n",
      "Epoch  12 Batch  150/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.125\n",
      "Epoch  12 Batch  151/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.138\n",
      "Epoch  12 Batch  152/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.134\n",
      "Epoch  12 Batch  153/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.169\n",
      "Epoch  12 Batch  154/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.145\n",
      "Epoch  12 Batch  155/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.192\n",
      "Epoch  12 Batch  156/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.095\n",
      "Epoch  12 Batch  157/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.162\n",
      "Epoch  12 Batch  158/538 - Train Accuracy:  0.986, Validation Accuracy:  0.968, Loss:  1.116\n",
      "Epoch  12 Batch  159/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.163\n",
      "Epoch  12 Batch  160/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.180\n",
      "Epoch  12 Batch  161/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.157\n",
      "Epoch  12 Batch  162/538 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  1.144\n",
      "Epoch  12 Batch  163/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.206\n",
      "Epoch  12 Batch  164/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.137\n",
      "Epoch  12 Batch  165/538 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  1.115\n",
      "Epoch  12 Batch  166/538 - Train Accuracy:  0.986, Validation Accuracy:  0.963, Loss:  1.122\n",
      "Epoch  12 Batch  167/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.178\n",
      "Epoch  12 Batch  168/538 - Train Accuracy:  0.970, Validation Accuracy:  0.968, Loss:  1.158\n",
      "Epoch  12 Batch  169/538 - Train Accuracy:  0.986, Validation Accuracy:  0.968, Loss:  1.148\n",
      "Epoch  12 Batch  170/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.110\n",
      "Epoch  12 Batch  171/538 - Train Accuracy:  0.967, Validation Accuracy:  0.972, Loss:  1.127\n",
      "Epoch  12 Batch  172/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.124\n",
      "Epoch  12 Batch  173/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.169\n",
      "Epoch  12 Batch  174/538 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  1.128\n",
      "Epoch  12 Batch  175/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.146\n",
      "Epoch  12 Batch  176/538 - Train Accuracy:  0.974, Validation Accuracy:  0.975, Loss:  1.162\n",
      "Epoch  12 Batch  177/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.113\n",
      "Epoch  12 Batch  178/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.152\n",
      "Epoch  12 Batch  179/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.129\n",
      "Epoch  12 Batch  180/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.143\n",
      "Epoch  12 Batch  181/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.133\n",
      "Epoch  12 Batch  182/538 - Train Accuracy:  0.988, Validation Accuracy:  0.970, Loss:  1.162\n",
      "Epoch  12 Batch  183/538 - Train Accuracy:  0.989, Validation Accuracy:  0.970, Loss:  1.130\n",
      "Epoch  12 Batch  184/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.141\n",
      "Epoch  12 Batch  185/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch  12 Batch  186/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.082\n",
      "Epoch  12 Batch  187/538 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  1.122\n",
      "Epoch  12 Batch  188/538 - Train Accuracy:  0.970, Validation Accuracy:  0.965, Loss:  1.084\n",
      "Epoch  12 Batch  189/538 - Train Accuracy:  0.989, Validation Accuracy:  0.970, Loss:  1.156\n",
      "Epoch  12 Batch  190/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.131\n",
      "Epoch  12 Batch  191/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.165\n",
      "Epoch  12 Batch  192/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.124\n",
      "Epoch  12 Batch  193/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.135\n",
      "Epoch  12 Batch  194/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.125\n",
      "Epoch  12 Batch  195/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch  12 Batch  196/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.126\n",
      "Epoch  12 Batch  197/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.116\n",
      "Epoch  12 Batch  198/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.144\n",
      "Epoch  12 Batch  199/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.169\n",
      "Epoch  12 Batch  200/538 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  1.133\n",
      "Epoch  12 Batch  201/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.175\n",
      "Epoch  12 Batch  202/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.129\n",
      "Epoch  12 Batch  203/538 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  1.152\n",
      "Epoch  12 Batch  204/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.120\n",
      "Epoch  12 Batch  205/538 - Train Accuracy:  0.975, Validation Accuracy:  0.963, Loss:  1.170\n",
      "Epoch  12 Batch  206/538 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  1.165\n",
      "Epoch  12 Batch  207/538 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  1.151\n",
      "Epoch  12 Batch  208/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.121\n",
      "Epoch  12 Batch  209/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.108\n",
      "Epoch  12 Batch  210/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.142\n",
      "Epoch  12 Batch  211/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.196\n",
      "Epoch  12 Batch  212/538 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  1.159\n",
      "Epoch  12 Batch  213/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.172\n",
      "Epoch  12 Batch  214/538 - Train Accuracy:  0.979, Validation Accuracy:  0.977, Loss:  1.130\n",
      "Epoch  12 Batch  215/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.162\n",
      "Epoch  12 Batch  216/538 - Train Accuracy:  0.973, Validation Accuracy:  0.976, Loss:  1.150\n",
      "Epoch  12 Batch  217/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.132\n",
      "Epoch  12 Batch  218/538 - Train Accuracy:  0.987, Validation Accuracy:  0.973, Loss:  1.137\n",
      "Epoch  12 Batch  219/538 - Train Accuracy:  0.964, Validation Accuracy:  0.971, Loss:  1.165\n",
      "Epoch  12 Batch  220/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.130\n",
      "Epoch  12 Batch  221/538 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  1.126\n",
      "Epoch  12 Batch  222/538 - Train Accuracy:  0.987, Validation Accuracy:  0.967, Loss:  1.132\n",
      "Epoch  12 Batch  223/538 - Train Accuracy:  0.988, Validation Accuracy:  0.960, Loss:  1.102\n",
      "Epoch  12 Batch  224/538 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  1.123\n",
      "Epoch  12 Batch  225/538 - Train Accuracy:  0.974, Validation Accuracy:  0.959, Loss:  1.120\n",
      "Epoch  12 Batch  226/538 - Train Accuracy:  0.971, Validation Accuracy:  0.961, Loss:  1.161\n",
      "Epoch  12 Batch  227/538 - Train Accuracy:  0.964, Validation Accuracy:  0.967, Loss:  1.153\n",
      "Epoch  12 Batch  228/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.148\n",
      "Epoch  12 Batch  229/538 - Train Accuracy:  0.976, Validation Accuracy:  0.965, Loss:  1.175\n",
      "Epoch  12 Batch  230/538 - Train Accuracy:  0.963, Validation Accuracy:  0.966, Loss:  1.145\n",
      "Epoch  12 Batch  231/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.166\n",
      "Epoch  12 Batch  232/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.106\n",
      "Epoch  12 Batch  233/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.160\n",
      "Epoch  12 Batch  234/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.134\n",
      "Epoch  12 Batch  235/538 - Train Accuracy:  0.982, Validation Accuracy:  0.961, Loss:  1.126\n",
      "Epoch  12 Batch  236/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.149\n",
      "Epoch  12 Batch  237/538 - Train Accuracy:  0.980, Validation Accuracy:  0.960, Loss:  1.103\n",
      "Epoch  12 Batch  238/538 - Train Accuracy:  0.976, Validation Accuracy:  0.960, Loss:  1.134\n",
      "Epoch  12 Batch  239/538 - Train Accuracy:  0.969, Validation Accuracy:  0.960, Loss:  1.136\n",
      "Epoch  12 Batch  240/538 - Train Accuracy:  0.978, Validation Accuracy:  0.962, Loss:  1.158\n",
      "Epoch  12 Batch  241/538 - Train Accuracy:  0.968, Validation Accuracy:  0.967, Loss:  1.111\n",
      "Epoch  12 Batch  242/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.122\n",
      "Epoch  12 Batch  243/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.141\n",
      "Epoch  12 Batch  244/538 - Train Accuracy:  0.968, Validation Accuracy:  0.976, Loss:  1.182\n",
      "Epoch  12 Batch  245/538 - Train Accuracy:  0.970, Validation Accuracy:  0.973, Loss:  1.156\n",
      "Epoch  12 Batch  246/538 - Train Accuracy:  0.980, Validation Accuracy:  0.974, Loss:  1.119\n",
      "Epoch  12 Batch  247/538 - Train Accuracy:  0.966, Validation Accuracy:  0.973, Loss:  1.157\n",
      "Epoch  12 Batch  248/538 - Train Accuracy:  0.976, Validation Accuracy:  0.976, Loss:  1.112\n",
      "Epoch  12 Batch  249/538 - Train Accuracy:  0.971, Validation Accuracy:  0.978, Loss:  1.141\n",
      "Epoch  12 Batch  250/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.127\n",
      "Epoch  12 Batch  251/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.099\n",
      "Epoch  12 Batch  252/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.123\n",
      "Epoch  12 Batch  253/538 - Train Accuracy:  0.964, Validation Accuracy:  0.965, Loss:  1.157\n",
      "Epoch  12 Batch  254/538 - Train Accuracy:  0.967, Validation Accuracy:  0.963, Loss:  1.150\n",
      "Epoch  12 Batch  255/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.152\n",
      "Epoch  12 Batch  256/538 - Train Accuracy:  0.968, Validation Accuracy:  0.966, Loss:  1.107\n",
      "Epoch  12 Batch  257/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.126\n",
      "Epoch  12 Batch  258/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.191\n",
      "Epoch  12 Batch  259/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.146\n",
      "Epoch  12 Batch  260/538 - Train Accuracy:  0.963, Validation Accuracy:  0.978, Loss:  1.142\n",
      "Epoch  12 Batch  261/538 - Train Accuracy:  0.965, Validation Accuracy:  0.976, Loss:  1.125\n",
      "Epoch  12 Batch  262/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.118\n",
      "Epoch  12 Batch  263/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.143\n",
      "Epoch  12 Batch  264/538 - Train Accuracy:  0.968, Validation Accuracy:  0.975, Loss:  1.180\n",
      "Epoch  12 Batch  265/538 - Train Accuracy:  0.966, Validation Accuracy:  0.973, Loss:  1.150\n",
      "Epoch  12 Batch  266/538 - Train Accuracy:  0.964, Validation Accuracy:  0.971, Loss:  1.135\n",
      "Epoch  12 Batch  267/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.149\n",
      "Epoch  12 Batch  268/538 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  1.136\n",
      "Epoch  12 Batch  269/538 - Train Accuracy:  0.964, Validation Accuracy:  0.973, Loss:  1.125\n",
      "Epoch  12 Batch  270/538 - Train Accuracy:  0.971, Validation Accuracy:  0.975, Loss:  1.141\n",
      "Epoch  12 Batch  271/538 - Train Accuracy:  0.966, Validation Accuracy:  0.978, Loss:  1.160\n",
      "Epoch  12 Batch  272/538 - Train Accuracy:  0.980, Validation Accuracy:  0.977, Loss:  1.175\n",
      "Epoch  12 Batch  273/538 - Train Accuracy:  0.969, Validation Accuracy:  0.976, Loss:  1.169\n",
      "Epoch  12 Batch  274/538 - Train Accuracy:  0.953, Validation Accuracy:  0.975, Loss:  1.132\n",
      "Epoch  12 Batch  275/538 - Train Accuracy:  0.975, Validation Accuracy:  0.977, Loss:  1.143\n",
      "Epoch  12 Batch  276/538 - Train Accuracy:  0.966, Validation Accuracy:  0.977, Loss:  1.146\n",
      "Epoch  12 Batch  277/538 - Train Accuracy:  0.977, Validation Accuracy:  0.980, Loss:  1.184\n",
      "Epoch  12 Batch  278/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.175\n",
      "Epoch  12 Batch  279/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.124\n",
      "Epoch  12 Batch  280/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.097\n",
      "Epoch  12 Batch  281/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.191\n",
      "Epoch  12 Batch  282/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.168\n",
      "Epoch  12 Batch  283/538 - Train Accuracy:  0.986, Validation Accuracy:  0.977, Loss:  1.102\n",
      "Epoch  12 Batch  284/538 - Train Accuracy:  0.976, Validation Accuracy:  0.976, Loss:  1.124\n",
      "Epoch  12 Batch  285/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.131\n",
      "Epoch  12 Batch  286/538 - Train Accuracy:  0.969, Validation Accuracy:  0.975, Loss:  1.117\n",
      "Epoch  12 Batch  287/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.116\n",
      "Epoch  12 Batch  288/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.162\n",
      "Epoch  12 Batch  289/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.170\n",
      "Epoch  12 Batch  290/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.089\n",
      "Epoch  12 Batch  291/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.164\n",
      "Epoch  12 Batch  292/538 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  1.111\n",
      "Epoch  12 Batch  293/538 - Train Accuracy:  0.971, Validation Accuracy:  0.977, Loss:  1.102\n",
      "Epoch  12 Batch  294/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.161\n",
      "Epoch  12 Batch  295/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.121\n",
      "Epoch  12 Batch  296/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.157\n",
      "Epoch  12 Batch  297/538 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  1.045\n",
      "Epoch  12 Batch  298/538 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  1.114\n",
      "Epoch  12 Batch  299/538 - Train Accuracy:  0.970, Validation Accuracy:  0.975, Loss:  1.132\n",
      "Epoch  12 Batch  300/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.167\n",
      "Epoch  12 Batch  301/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.155\n",
      "Epoch  12 Batch  302/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.160\n",
      "Epoch  12 Batch  303/538 - Train Accuracy:  0.974, Validation Accuracy:  0.976, Loss:  1.136\n",
      "Epoch  12 Batch  304/538 - Train Accuracy:  0.976, Validation Accuracy:  0.976, Loss:  1.099\n",
      "Epoch  12 Batch  305/538 - Train Accuracy:  0.986, Validation Accuracy:  0.973, Loss:  1.139\n",
      "Epoch  12 Batch  306/538 - Train Accuracy:  0.983, Validation Accuracy:  0.981, Loss:  1.099\n",
      "Epoch  12 Batch  307/538 - Train Accuracy:  0.980, Validation Accuracy:  0.981, Loss:  1.159\n",
      "Epoch  12 Batch  308/538 - Train Accuracy:  0.983, Validation Accuracy:  0.981, Loss:  1.133\n",
      "Epoch  12 Batch  309/538 - Train Accuracy:  0.975, Validation Accuracy:  0.979, Loss:  1.167\n",
      "Epoch  12 Batch  310/538 - Train Accuracy:  0.980, Validation Accuracy:  0.977, Loss:  1.136\n",
      "Epoch  12 Batch  311/538 - Train Accuracy:  0.971, Validation Accuracy:  0.977, Loss:  1.158\n",
      "Epoch  12 Batch  312/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.126\n",
      "Epoch  12 Batch  313/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.144\n",
      "Epoch  12 Batch  314/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.110\n",
      "Epoch  12 Batch  315/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.120\n",
      "Epoch  12 Batch  316/538 - Train Accuracy:  0.967, Validation Accuracy:  0.973, Loss:  1.126\n",
      "Epoch  12 Batch  317/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.171\n",
      "Epoch  12 Batch  318/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.112\n",
      "Epoch  12 Batch  319/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.124\n",
      "Epoch  12 Batch  320/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.125\n",
      "Epoch  12 Batch  321/538 - Train Accuracy:  0.967, Validation Accuracy:  0.976, Loss:  1.174\n",
      "Epoch  12 Batch  322/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.130\n",
      "Epoch  12 Batch  323/538 - Train Accuracy:  0.988, Validation Accuracy:  0.975, Loss:  1.154\n",
      "Epoch  12 Batch  324/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.072\n",
      "Epoch  12 Batch  325/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.130\n",
      "Epoch  12 Batch  326/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.134\n",
      "Epoch  12 Batch  327/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.135\n",
      "Epoch  12 Batch  328/538 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  1.133\n",
      "Epoch  12 Batch  329/538 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  1.097\n",
      "Epoch  12 Batch  330/538 - Train Accuracy:  0.983, Validation Accuracy:  0.965, Loss:  1.182\n",
      "Epoch  12 Batch  331/538 - Train Accuracy:  0.988, Validation Accuracy:  0.965, Loss:  1.158\n",
      "Epoch  12 Batch  332/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.134\n",
      "Epoch  12 Batch  333/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.178\n",
      "Epoch  12 Batch  334/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.119\n",
      "Epoch  12 Batch  335/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.159\n",
      "Epoch  12 Batch  336/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.132\n",
      "Epoch  12 Batch  337/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.169\n",
      "Epoch  12 Batch  338/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.141\n",
      "Epoch  12 Batch  339/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.128\n",
      "Epoch  12 Batch  340/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.166\n",
      "Epoch  12 Batch  341/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.147\n",
      "Epoch  12 Batch  342/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.124\n",
      "Epoch  12 Batch  343/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.181\n",
      "Epoch  12 Batch  344/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.092\n",
      "Epoch  12 Batch  345/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.122\n",
      "Epoch  12 Batch  346/538 - Train Accuracy:  0.986, Validation Accuracy:  0.970, Loss:  1.114\n",
      "Epoch  12 Batch  347/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.119\n",
      "Epoch  12 Batch  348/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch  12 Batch  349/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.135\n",
      "Epoch  12 Batch  350/538 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  1.126\n",
      "Epoch  12 Batch  351/538 - Train Accuracy:  0.968, Validation Accuracy:  0.971, Loss:  1.073\n",
      "Epoch  12 Batch  352/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.241\n",
      "Epoch  12 Batch  353/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.154\n",
      "Epoch  12 Batch  354/538 - Train Accuracy:  0.986, Validation Accuracy:  0.964, Loss:  1.130\n",
      "Epoch  12 Batch  355/538 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  1.200\n",
      "Epoch  12 Batch  356/538 - Train Accuracy:  0.981, Validation Accuracy:  0.965, Loss:  1.106\n",
      "Epoch  12 Batch  357/538 - Train Accuracy:  0.972, Validation Accuracy:  0.965, Loss:  1.199\n",
      "Epoch  12 Batch  358/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.117\n",
      "Epoch  12 Batch  359/538 - Train Accuracy:  0.983, Validation Accuracy:  0.965, Loss:  1.167\n",
      "Epoch  12 Batch  360/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.129\n",
      "Epoch  12 Batch  361/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.180\n",
      "Epoch  12 Batch  362/538 - Train Accuracy:  0.986, Validation Accuracy:  0.976, Loss:  1.181\n",
      "Epoch  12 Batch  363/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.153\n",
      "Epoch  12 Batch  364/538 - Train Accuracy:  0.973, Validation Accuracy:  0.976, Loss:  1.149\n",
      "Epoch  12 Batch  365/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.140\n",
      "Epoch  12 Batch  366/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.165\n",
      "Epoch  12 Batch  367/538 - Train Accuracy:  0.988, Validation Accuracy:  0.971, Loss:  1.127\n",
      "Epoch  12 Batch  368/538 - Train Accuracy:  0.991, Validation Accuracy:  0.971, Loss:  1.174\n",
      "Epoch  12 Batch  369/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.133\n",
      "Epoch  12 Batch  370/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.135\n",
      "Epoch  12 Batch  371/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.169\n",
      "Epoch  12 Batch  372/538 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  1.161\n",
      "Epoch  12 Batch  373/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.135\n",
      "Epoch  12 Batch  374/538 - Train Accuracy:  0.981, Validation Accuracy:  0.967, Loss:  1.140\n",
      "Epoch  12 Batch  375/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.155\n",
      "Epoch  12 Batch  376/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.179\n",
      "Epoch  12 Batch  377/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.151\n",
      "Epoch  12 Batch  378/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.103\n",
      "Epoch  12 Batch  379/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.106\n",
      "Epoch  12 Batch  380/538 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  1.113\n",
      "Epoch  12 Batch  381/538 - Train Accuracy:  0.988, Validation Accuracy:  0.963, Loss:  1.166\n",
      "Epoch  12 Batch  382/538 - Train Accuracy:  0.976, Validation Accuracy:  0.961, Loss:  1.149\n",
      "Epoch  12 Batch  383/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.153\n",
      "Epoch  12 Batch  384/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.162\n",
      "Epoch  12 Batch  385/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.112\n",
      "Epoch  12 Batch  386/538 - Train Accuracy:  0.989, Validation Accuracy:  0.971, Loss:  1.103\n",
      "Epoch  12 Batch  387/538 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  1.143\n",
      "Epoch  12 Batch  388/538 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  1.180\n",
      "Epoch  12 Batch  389/538 - Train Accuracy:  0.973, Validation Accuracy:  0.959, Loss:  1.148\n",
      "Epoch  12 Batch  390/538 - Train Accuracy:  0.981, Validation Accuracy:  0.957, Loss:  1.089\n",
      "Epoch  12 Batch  391/538 - Train Accuracy:  0.979, Validation Accuracy:  0.957, Loss:  1.117\n",
      "Epoch  12 Batch  392/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.088\n",
      "Epoch  12 Batch  393/538 - Train Accuracy:  0.979, Validation Accuracy:  0.964, Loss:  1.150\n",
      "Epoch  12 Batch  394/538 - Train Accuracy:  0.960, Validation Accuracy:  0.959, Loss:  1.116\n",
      "Epoch  12 Batch  395/538 - Train Accuracy:  0.975, Validation Accuracy:  0.962, Loss:  1.159\n",
      "Epoch  12 Batch  396/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.149\n",
      "Epoch  12 Batch  397/538 - Train Accuracy:  0.982, Validation Accuracy:  0.965, Loss:  1.225\n",
      "Epoch  12 Batch  398/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.132\n",
      "Epoch  12 Batch  399/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.113\n",
      "Epoch  12 Batch  400/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.162\n",
      "Epoch  12 Batch  401/538 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  1.127\n",
      "Epoch  12 Batch  402/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.140\n",
      "Epoch  12 Batch  403/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.163\n",
      "Epoch  12 Batch  404/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch  12 Batch  405/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.169\n",
      "Epoch  12 Batch  406/538 - Train Accuracy:  0.976, Validation Accuracy:  0.966, Loss:  1.160\n",
      "Epoch  12 Batch  407/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.166\n",
      "Epoch  12 Batch  408/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.123\n",
      "Epoch  12 Batch  409/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.140\n",
      "Epoch  12 Batch  410/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.111\n",
      "Epoch  12 Batch  411/538 - Train Accuracy:  0.986, Validation Accuracy:  0.973, Loss:  1.127\n",
      "Epoch  12 Batch  412/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.139\n",
      "Epoch  12 Batch  413/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.161\n",
      "Epoch  12 Batch  414/538 - Train Accuracy:  0.960, Validation Accuracy:  0.963, Loss:  1.168\n",
      "Epoch  12 Batch  415/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.130\n",
      "Epoch  12 Batch  416/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.134\n",
      "Epoch  12 Batch  417/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.149\n",
      "Epoch  12 Batch  418/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.152\n",
      "Epoch  12 Batch  419/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.124\n",
      "Epoch  12 Batch  420/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.155\n",
      "Epoch  12 Batch  421/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.121\n",
      "Epoch  12 Batch  422/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.213\n",
      "Epoch  12 Batch  423/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.133\n",
      "Epoch  12 Batch  424/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.106\n",
      "Epoch  12 Batch  425/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.114\n",
      "Epoch  12 Batch  426/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.126\n",
      "Epoch  12 Batch  427/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.165\n",
      "Epoch  12 Batch  428/538 - Train Accuracy:  0.979, Validation Accuracy:  0.977, Loss:  1.124\n",
      "Epoch  12 Batch  429/538 - Train Accuracy:  0.991, Validation Accuracy:  0.973, Loss:  1.148\n",
      "Epoch  12 Batch  430/538 - Train Accuracy:  0.971, Validation Accuracy:  0.973, Loss:  1.163\n",
      "Epoch  12 Batch  431/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.101\n",
      "Epoch  12 Batch  432/538 - Train Accuracy:  0.966, Validation Accuracy:  0.968, Loss:  1.142\n",
      "Epoch  12 Batch  433/538 - Train Accuracy:  0.954, Validation Accuracy:  0.968, Loss:  1.194\n",
      "Epoch  12 Batch  434/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.122\n",
      "Epoch  12 Batch  435/538 - Train Accuracy:  0.973, Validation Accuracy:  0.972, Loss:  1.174\n",
      "Epoch  12 Batch  436/538 - Train Accuracy:  0.963, Validation Accuracy:  0.970, Loss:  1.140\n",
      "Epoch  12 Batch  437/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.088\n",
      "Epoch  12 Batch  438/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.159\n",
      "Epoch  12 Batch  439/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.158\n",
      "Epoch  12 Batch  440/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.150\n",
      "Epoch  12 Batch  441/538 - Train Accuracy:  0.969, Validation Accuracy:  0.965, Loss:  1.137\n",
      "Epoch  12 Batch  442/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.142\n",
      "Epoch  12 Batch  443/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.110\n",
      "Epoch  12 Batch  444/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.133\n",
      "Epoch  12 Batch  445/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.095\n",
      "Epoch  12 Batch  446/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.124\n",
      "Epoch  12 Batch  447/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.158\n",
      "Epoch  12 Batch  448/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.127\n",
      "Epoch  12 Batch  449/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.167\n",
      "Epoch  12 Batch  450/538 - Train Accuracy:  0.962, Validation Accuracy:  0.973, Loss:  1.098\n",
      "Epoch  12 Batch  451/538 - Train Accuracy:  0.960, Validation Accuracy:  0.973, Loss:  1.112\n",
      "Epoch  12 Batch  452/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.135\n",
      "Epoch  12 Batch  453/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.135\n",
      "Epoch  12 Batch  454/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.155\n",
      "Epoch  12 Batch  455/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.188\n",
      "Epoch  12 Batch  456/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.190\n",
      "Epoch  12 Batch  457/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.143\n",
      "Epoch  12 Batch  458/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.113\n",
      "Epoch  12 Batch  459/538 - Train Accuracy:  0.987, Validation Accuracy:  0.969, Loss:  1.120\n",
      "Epoch  12 Batch  460/538 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  1.146\n",
      "Epoch  12 Batch  461/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.157\n",
      "Epoch  12 Batch  462/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.172\n",
      "Epoch  12 Batch  463/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.164\n",
      "Epoch  12 Batch  464/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.148\n",
      "Epoch  12 Batch  465/538 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  1.162\n",
      "Epoch  12 Batch  466/538 - Train Accuracy:  0.966, Validation Accuracy:  0.973, Loss:  1.117\n",
      "Epoch  12 Batch  467/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.147\n",
      "Epoch  12 Batch  468/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.132\n",
      "Epoch  12 Batch  469/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.183\n",
      "Epoch  12 Batch  470/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.130\n",
      "Epoch  12 Batch  471/538 - Train Accuracy:  0.987, Validation Accuracy:  0.966, Loss:  1.137\n",
      "Epoch  12 Batch  472/538 - Train Accuracy:  0.993, Validation Accuracy:  0.965, Loss:  1.115\n",
      "Epoch  12 Batch  473/538 - Train Accuracy:  0.987, Validation Accuracy:  0.965, Loss:  1.127\n",
      "Epoch  12 Batch  474/538 - Train Accuracy:  0.967, Validation Accuracy:  0.965, Loss:  1.145\n",
      "Epoch  12 Batch  475/538 - Train Accuracy:  0.987, Validation Accuracy:  0.977, Loss:  1.170\n",
      "Epoch  12 Batch  476/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.084\n",
      "Epoch  12 Batch  477/538 - Train Accuracy:  0.975, Validation Accuracy:  0.977, Loss:  1.136\n",
      "Epoch  12 Batch  478/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.115\n",
      "Epoch  12 Batch  479/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.156\n",
      "Epoch  12 Batch  480/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.120\n",
      "Epoch  12 Batch  481/538 - Train Accuracy:  0.986, Validation Accuracy:  0.973, Loss:  1.144\n",
      "Epoch  12 Batch  482/538 - Train Accuracy:  0.972, Validation Accuracy:  0.975, Loss:  1.161\n",
      "Epoch  12 Batch  483/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.118\n",
      "Epoch  12 Batch  484/538 - Train Accuracy:  0.968, Validation Accuracy:  0.959, Loss:  1.103\n",
      "Epoch  12 Batch  485/538 - Train Accuracy:  0.981, Validation Accuracy:  0.955, Loss:  1.159\n",
      "Epoch  12 Batch  486/538 - Train Accuracy:  0.972, Validation Accuracy:  0.952, Loss:  1.161\n",
      "Epoch  12 Batch  487/538 - Train Accuracy:  0.979, Validation Accuracy:  0.952, Loss:  1.116\n",
      "Epoch  12 Batch  488/538 - Train Accuracy:  0.980, Validation Accuracy:  0.962, Loss:  1.115\n",
      "Epoch  12 Batch  489/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.108\n",
      "Epoch  12 Batch  490/538 - Train Accuracy:  0.969, Validation Accuracy:  0.974, Loss:  1.146\n",
      "Epoch  12 Batch  491/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.127\n",
      "Epoch  12 Batch  492/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.124\n",
      "Epoch  12 Batch  493/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.164\n",
      "Epoch  12 Batch  494/538 - Train Accuracy:  0.966, Validation Accuracy:  0.968, Loss:  1.146\n",
      "Epoch  12 Batch  495/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.146\n",
      "Epoch  12 Batch  496/538 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  1.096\n",
      "Epoch  12 Batch  497/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.147\n",
      "Epoch  12 Batch  498/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.139\n",
      "Epoch  12 Batch  499/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.153\n",
      "Epoch  12 Batch  500/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.145\n",
      "Epoch  12 Batch  501/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.182\n",
      "Epoch  12 Batch  502/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.156\n",
      "Epoch  12 Batch  503/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.135\n",
      "Epoch  12 Batch  504/538 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  1.100\n",
      "Epoch  12 Batch  505/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.112\n",
      "Epoch  12 Batch  506/538 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  1.141\n",
      "Epoch  12 Batch  507/538 - Train Accuracy:  0.975, Validation Accuracy:  0.977, Loss:  1.162\n",
      "Epoch  12 Batch  508/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.141\n",
      "Epoch  12 Batch  509/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.184\n",
      "Epoch  12 Batch  510/538 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  1.127\n",
      "Epoch  12 Batch  511/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.130\n",
      "Epoch  12 Batch  512/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.152\n",
      "Epoch  12 Batch  513/538 - Train Accuracy:  0.967, Validation Accuracy:  0.973, Loss:  1.108\n",
      "Epoch  12 Batch  514/538 - Train Accuracy:  0.988, Validation Accuracy:  0.970, Loss:  1.154\n",
      "Epoch  12 Batch  515/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.170\n",
      "Epoch  12 Batch  516/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.127\n",
      "Epoch  12 Batch  517/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.169\n",
      "Epoch  12 Batch  518/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.123\n",
      "Epoch  12 Batch  519/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.112\n",
      "Epoch  12 Batch  520/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.113\n",
      "Epoch  12 Batch  521/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.130\n",
      "Epoch  12 Batch  522/538 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  1.191\n",
      "Epoch  12 Batch  523/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.122\n",
      "Epoch  12 Batch  524/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.130\n",
      "Epoch  12 Batch  525/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.124\n",
      "Epoch  12 Batch  526/538 - Train Accuracy:  0.972, Validation Accuracy:  0.978, Loss:  1.089\n",
      "Epoch  12 Batch  527/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.162\n",
      "Epoch  12 Batch  528/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.168\n",
      "Epoch  12 Batch  529/538 - Train Accuracy:  0.967, Validation Accuracy:  0.974, Loss:  1.125\n",
      "Epoch  12 Batch  530/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.208\n",
      "Epoch  12 Batch  531/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.134\n",
      "Epoch  12 Batch  532/538 - Train Accuracy:  0.976, Validation Accuracy:  0.975, Loss:  1.137\n",
      "Epoch  12 Batch  533/538 - Train Accuracy:  0.973, Validation Accuracy:  0.975, Loss:  1.153\n",
      "Epoch  12 Batch  534/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.101\n",
      "Epoch  12 Batch  535/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.108\n",
      "Epoch  12 Batch  536/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.122\n",
      "Epoch  13 Batch    0/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.132\n",
      "Epoch  13 Batch    1/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.186\n",
      "Epoch  13 Batch    2/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.142\n",
      "Epoch  13 Batch    3/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.170\n",
      "Epoch  13 Batch    4/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.144\n",
      "Epoch  13 Batch    5/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.107\n",
      "Epoch  13 Batch    6/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.156\n",
      "Epoch  13 Batch    7/538 - Train Accuracy:  0.991, Validation Accuracy:  0.971, Loss:  1.138\n",
      "Epoch  13 Batch    8/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.123\n",
      "Epoch  13 Batch    9/538 - Train Accuracy:  0.972, Validation Accuracy:  0.963, Loss:  1.166\n",
      "Epoch  13 Batch   10/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.150\n",
      "Epoch  13 Batch   11/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch  13 Batch   12/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.116\n",
      "Epoch  13 Batch   13/538 - Train Accuracy:  0.987, Validation Accuracy:  0.973, Loss:  1.129\n",
      "Epoch  13 Batch   14/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.165\n",
      "Epoch  13 Batch   15/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.088\n",
      "Epoch  13 Batch   16/538 - Train Accuracy:  0.976, Validation Accuracy:  0.960, Loss:  1.152\n",
      "Epoch  13 Batch   17/538 - Train Accuracy:  0.987, Validation Accuracy:  0.960, Loss:  1.160\n",
      "Epoch  13 Batch   18/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.119\n",
      "Epoch  13 Batch   19/538 - Train Accuracy:  0.983, Validation Accuracy:  0.964, Loss:  1.141\n",
      "Epoch  13 Batch   20/538 - Train Accuracy:  0.976, Validation Accuracy:  0.965, Loss:  1.099\n",
      "Epoch  13 Batch   21/538 - Train Accuracy:  0.989, Validation Accuracy:  0.965, Loss:  1.133\n",
      "Epoch  13 Batch   22/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.156\n",
      "Epoch  13 Batch   23/538 - Train Accuracy:  0.974, Validation Accuracy:  0.974, Loss:  1.143\n",
      "Epoch  13 Batch   24/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.148\n",
      "Epoch  13 Batch   25/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.106\n",
      "Epoch  13 Batch   26/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.164\n",
      "Epoch  13 Batch   27/538 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  1.184\n",
      "Epoch  13 Batch   28/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.160\n",
      "Epoch  13 Batch   29/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.166\n",
      "Epoch  13 Batch   30/538 - Train Accuracy:  0.961, Validation Accuracy:  0.973, Loss:  1.142\n",
      "Epoch  13 Batch   31/538 - Train Accuracy:  0.988, Validation Accuracy:  0.971, Loss:  1.141\n",
      "Epoch  13 Batch   32/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.143\n",
      "Epoch  13 Batch   33/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  13 Batch   34/538 - Train Accuracy:  0.971, Validation Accuracy:  0.973, Loss:  1.117\n",
      "Epoch  13 Batch   35/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.111\n",
      "Epoch  13 Batch   36/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.100\n",
      "Epoch  13 Batch   37/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.160\n",
      "Epoch  13 Batch   38/538 - Train Accuracy:  0.972, Validation Accuracy:  0.972, Loss:  1.166\n",
      "Epoch  13 Batch   39/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.123\n",
      "Epoch  13 Batch   40/538 - Train Accuracy:  0.983, Validation Accuracy:  0.963, Loss:  1.181\n",
      "Epoch  13 Batch   41/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.136\n",
      "Epoch  13 Batch   42/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.112\n",
      "Epoch  13 Batch   43/538 - Train Accuracy:  0.968, Validation Accuracy:  0.969, Loss:  1.131\n",
      "Epoch  13 Batch   44/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.141\n",
      "Epoch  13 Batch   45/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.182\n",
      "Epoch  13 Batch   46/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.177\n",
      "Epoch  13 Batch   47/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.149\n",
      "Epoch  13 Batch   48/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.121\n",
      "Epoch  13 Batch   49/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.116\n",
      "Epoch  13 Batch   50/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.110\n",
      "Epoch  13 Batch   51/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.155\n",
      "Epoch  13 Batch   52/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.118\n",
      "Epoch  13 Batch   53/538 - Train Accuracy:  0.969, Validation Accuracy:  0.974, Loss:  1.065\n",
      "Epoch  13 Batch   54/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.137\n",
      "Epoch  13 Batch   55/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.110\n",
      "Epoch  13 Batch   56/538 - Train Accuracy:  0.967, Validation Accuracy:  0.974, Loss:  1.154\n",
      "Epoch  13 Batch   57/538 - Train Accuracy:  0.965, Validation Accuracy:  0.974, Loss:  1.094\n",
      "Epoch  13 Batch   58/538 - Train Accuracy:  0.979, Validation Accuracy:  0.976, Loss:  1.151\n",
      "Epoch  13 Batch   59/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.158\n",
      "Epoch  13 Batch   60/538 - Train Accuracy:  0.982, Validation Accuracy:  0.979, Loss:  1.140\n",
      "Epoch  13 Batch   61/538 - Train Accuracy:  0.969, Validation Accuracy:  0.978, Loss:  1.164\n",
      "Epoch  13 Batch   62/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.164\n",
      "Epoch  13 Batch   63/538 - Train Accuracy:  0.978, Validation Accuracy:  0.973, Loss:  1.104\n",
      "Epoch  13 Batch   64/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.136\n",
      "Epoch  13 Batch   65/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.126\n",
      "Epoch  13 Batch   66/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.126\n",
      "Epoch  13 Batch   67/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.117\n",
      "Epoch  13 Batch   68/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.163\n",
      "Epoch  13 Batch   69/538 - Train Accuracy:  0.981, Validation Accuracy:  0.978, Loss:  1.097\n",
      "Epoch  13 Batch   70/538 - Train Accuracy:  0.974, Validation Accuracy:  0.975, Loss:  1.162\n",
      "Epoch  13 Batch   71/538 - Train Accuracy:  0.972, Validation Accuracy:  0.975, Loss:  1.175\n",
      "Epoch  13 Batch   72/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.130\n",
      "Epoch  13 Batch   73/538 - Train Accuracy:  0.967, Validation Accuracy:  0.964, Loss:  1.109\n",
      "Epoch  13 Batch   74/538 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  1.144\n",
      "Epoch  13 Batch   75/538 - Train Accuracy:  0.982, Validation Accuracy:  0.965, Loss:  1.170\n",
      "Epoch  13 Batch   76/538 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  1.153\n",
      "Epoch  13 Batch   77/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.121\n",
      "Epoch  13 Batch   78/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.157\n",
      "Epoch  13 Batch   79/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.156\n",
      "Epoch  13 Batch   80/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.171\n",
      "Epoch  13 Batch   81/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.106\n",
      "Epoch  13 Batch   82/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.149\n",
      "Epoch  13 Batch   83/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.134\n",
      "Epoch  13 Batch   84/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.101\n",
      "Epoch  13 Batch   85/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.148\n",
      "Epoch  13 Batch   86/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.160\n",
      "Epoch  13 Batch   87/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.100\n",
      "Epoch  13 Batch   88/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.107\n",
      "Epoch  13 Batch   89/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.173\n",
      "Epoch  13 Batch   90/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.194\n",
      "Epoch  13 Batch   91/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.170\n",
      "Epoch  13 Batch   92/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.130\n",
      "Epoch  13 Batch   93/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.137\n",
      "Epoch  13 Batch   94/538 - Train Accuracy:  0.987, Validation Accuracy:  0.969, Loss:  1.139\n",
      "Epoch  13 Batch   95/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.148\n",
      "Epoch  13 Batch   96/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.160\n",
      "Epoch  13 Batch   97/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.124\n",
      "Epoch  13 Batch   98/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.127\n",
      "Epoch  13 Batch   99/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.132\n",
      "Epoch  13 Batch  100/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.103\n",
      "Epoch  13 Batch  101/538 - Train Accuracy:  0.967, Validation Accuracy:  0.970, Loss:  1.136\n",
      "Epoch  13 Batch  102/538 - Train Accuracy:  0.971, Validation Accuracy:  0.970, Loss:  1.121\n",
      "Epoch  13 Batch  103/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.142\n",
      "Epoch  13 Batch  104/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.082\n",
      "Epoch  13 Batch  105/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.162\n",
      "Epoch  13 Batch  106/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.122\n",
      "Epoch  13 Batch  107/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.147\n",
      "Epoch  13 Batch  108/538 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  1.195\n",
      "Epoch  13 Batch  109/538 - Train Accuracy:  0.986, Validation Accuracy:  0.975, Loss:  1.139\n",
      "Epoch  13 Batch  110/538 - Train Accuracy:  0.971, Validation Accuracy:  0.975, Loss:  1.143\n",
      "Epoch  13 Batch  111/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.089\n",
      "Epoch  13 Batch  112/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.121\n",
      "Epoch  13 Batch  113/538 - Train Accuracy:  0.964, Validation Accuracy:  0.972, Loss:  1.156\n",
      "Epoch  13 Batch  114/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.109\n",
      "Epoch  13 Batch  115/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.119\n",
      "Epoch  13 Batch  116/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.173\n",
      "Epoch  13 Batch  117/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.185\n",
      "Epoch  13 Batch  118/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.152\n",
      "Epoch  13 Batch  119/538 - Train Accuracy:  0.987, Validation Accuracy:  0.969, Loss:  1.156\n",
      "Epoch  13 Batch  120/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.147\n",
      "Epoch  13 Batch  121/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch  13 Batch  122/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch  13 Batch  123/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.173\n",
      "Epoch  13 Batch  124/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.134\n",
      "Epoch  13 Batch  125/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.143\n",
      "Epoch  13 Batch  126/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.122\n",
      "Epoch  13 Batch  127/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.175\n",
      "Epoch  13 Batch  128/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.167\n",
      "Epoch  13 Batch  129/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.118\n",
      "Epoch  13 Batch  130/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.218\n",
      "Epoch  13 Batch  131/538 - Train Accuracy:  0.989, Validation Accuracy:  0.968, Loss:  1.156\n",
      "Epoch  13 Batch  132/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.136\n",
      "Epoch  13 Batch  133/538 - Train Accuracy:  0.981, Validation Accuracy:  0.964, Loss:  1.083\n",
      "Epoch  13 Batch  134/538 - Train Accuracy:  0.983, Validation Accuracy:  0.964, Loss:  1.187\n",
      "Epoch  13 Batch  135/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.108\n",
      "Epoch  13 Batch  136/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.180\n",
      "Epoch  13 Batch  137/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.127\n",
      "Epoch  13 Batch  138/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.117\n",
      "Epoch  13 Batch  139/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.111\n",
      "Epoch  13 Batch  140/538 - Train Accuracy:  0.962, Validation Accuracy:  0.970, Loss:  1.154\n",
      "Epoch  13 Batch  141/538 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  1.083\n",
      "Epoch  13 Batch  142/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.132\n",
      "Epoch  13 Batch  143/538 - Train Accuracy:  0.971, Validation Accuracy:  0.976, Loss:  1.157\n",
      "Epoch  13 Batch  144/538 - Train Accuracy:  0.986, Validation Accuracy:  0.973, Loss:  1.095\n",
      "Epoch  13 Batch  145/538 - Train Accuracy:  0.967, Validation Accuracy:  0.972, Loss:  1.159\n",
      "Epoch  13 Batch  146/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.139\n",
      "Epoch  13 Batch  147/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.131\n",
      "Epoch  13 Batch  148/538 - Train Accuracy:  0.964, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  13 Batch  149/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.128\n",
      "Epoch  13 Batch  150/538 - Train Accuracy:  0.986, Validation Accuracy:  0.975, Loss:  1.195\n",
      "Epoch  13 Batch  151/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.122\n",
      "Epoch  13 Batch  152/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.164\n",
      "Epoch  13 Batch  153/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.142\n",
      "Epoch  13 Batch  154/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.122\n",
      "Epoch  13 Batch  155/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.182\n",
      "Epoch  13 Batch  156/538 - Train Accuracy:  0.987, Validation Accuracy:  0.966, Loss:  1.190\n",
      "Epoch  13 Batch  157/538 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  1.146\n",
      "Epoch  13 Batch  158/538 - Train Accuracy:  0.988, Validation Accuracy:  0.960, Loss:  1.169\n",
      "Epoch  13 Batch  159/538 - Train Accuracy:  0.963, Validation Accuracy:  0.963, Loss:  1.169\n",
      "Epoch  13 Batch  160/538 - Train Accuracy:  0.971, Validation Accuracy:  0.956, Loss:  1.128\n",
      "Epoch  13 Batch  161/538 - Train Accuracy:  0.975, Validation Accuracy:  0.956, Loss:  1.151\n",
      "Epoch  13 Batch  162/538 - Train Accuracy:  0.978, Validation Accuracy:  0.952, Loss:  1.137\n",
      "Epoch  13 Batch  163/538 - Train Accuracy:  0.973, Validation Accuracy:  0.960, Loss:  1.150\n",
      "Epoch  13 Batch  164/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.114\n",
      "Epoch  13 Batch  165/538 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  1.107\n",
      "Epoch  13 Batch  166/538 - Train Accuracy:  0.979, Validation Accuracy:  0.962, Loss:  1.124\n",
      "Epoch  13 Batch  167/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.167\n",
      "Epoch  13 Batch  168/538 - Train Accuracy:  0.966, Validation Accuracy:  0.963, Loss:  1.121\n",
      "Epoch  13 Batch  169/538 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  1.093\n",
      "Epoch  13 Batch  170/538 - Train Accuracy:  0.962, Validation Accuracy:  0.967, Loss:  1.136\n",
      "Epoch  13 Batch  171/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.148\n",
      "Epoch  13 Batch  172/538 - Train Accuracy:  0.969, Validation Accuracy:  0.968, Loss:  1.154\n",
      "Epoch  13 Batch  173/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.184\n",
      "Epoch  13 Batch  174/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.180\n",
      "Epoch  13 Batch  175/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.149\n",
      "Epoch  13 Batch  176/538 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  1.150\n",
      "Epoch  13 Batch  177/538 - Train Accuracy:  0.973, Validation Accuracy:  0.965, Loss:  1.184\n",
      "Epoch  13 Batch  178/538 - Train Accuracy:  0.950, Validation Accuracy:  0.967, Loss:  1.189\n",
      "Epoch  13 Batch  179/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.151\n",
      "Epoch  13 Batch  180/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.172\n",
      "Epoch  13 Batch  181/538 - Train Accuracy:  0.962, Validation Accuracy:  0.968, Loss:  1.157\n",
      "Epoch  13 Batch  182/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.153\n",
      "Epoch  13 Batch  183/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.158\n",
      "Epoch  13 Batch  184/538 - Train Accuracy:  0.933, Validation Accuracy:  0.953, Loss:  1.121\n",
      "Epoch  13 Batch  185/538 - Train Accuracy:  0.958, Validation Accuracy:  0.945, Loss:  1.181\n",
      "Epoch  13 Batch  186/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.147\n",
      "Epoch  13 Batch  187/538 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  1.111\n",
      "Epoch  13 Batch  188/538 - Train Accuracy:  0.962, Validation Accuracy:  0.960, Loss:  1.184\n",
      "Epoch  13 Batch  189/538 - Train Accuracy:  0.962, Validation Accuracy:  0.956, Loss:  1.139\n",
      "Epoch  13 Batch  190/538 - Train Accuracy:  0.967, Validation Accuracy:  0.956, Loss:  1.155\n",
      "Epoch  13 Batch  191/538 - Train Accuracy:  0.976, Validation Accuracy:  0.961, Loss:  1.126\n",
      "Epoch  13 Batch  192/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.147\n",
      "Epoch  13 Batch  193/538 - Train Accuracy:  0.972, Validation Accuracy:  0.962, Loss:  1.190\n",
      "Epoch  13 Batch  194/538 - Train Accuracy:  0.964, Validation Accuracy:  0.963, Loss:  1.170\n",
      "Epoch  13 Batch  195/538 - Train Accuracy:  0.977, Validation Accuracy:  0.965, Loss:  1.157\n",
      "Epoch  13 Batch  196/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.170\n",
      "Epoch  13 Batch  197/538 - Train Accuracy:  0.969, Validation Accuracy:  0.966, Loss:  1.142\n",
      "Epoch  13 Batch  198/538 - Train Accuracy:  0.969, Validation Accuracy:  0.967, Loss:  1.137\n",
      "Epoch  13 Batch  199/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.204\n",
      "Epoch  13 Batch  200/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.182\n",
      "Epoch  13 Batch  201/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.163\n",
      "Epoch  13 Batch  202/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.145\n",
      "Epoch  13 Batch  203/538 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  1.114\n",
      "Epoch  13 Batch  204/538 - Train Accuracy:  0.962, Validation Accuracy:  0.966, Loss:  1.131\n",
      "Epoch  13 Batch  205/538 - Train Accuracy:  0.972, Validation Accuracy:  0.966, Loss:  1.175\n",
      "Epoch  13 Batch  206/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.136\n",
      "Epoch  13 Batch  207/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.110\n",
      "Epoch  13 Batch  208/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.181\n",
      "Epoch  13 Batch  209/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.162\n",
      "Epoch  13 Batch  210/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.147\n",
      "Epoch  13 Batch  211/538 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  1.142\n",
      "Epoch  13 Batch  212/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.162\n",
      "Epoch  13 Batch  213/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.117\n",
      "Epoch  13 Batch  214/538 - Train Accuracy:  0.974, Validation Accuracy:  0.968, Loss:  1.172\n",
      "Epoch  13 Batch  215/538 - Train Accuracy:  0.982, Validation Accuracy:  0.965, Loss:  1.161\n",
      "Epoch  13 Batch  216/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch  13 Batch  217/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.173\n",
      "Epoch  13 Batch  218/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.125\n",
      "Epoch  13 Batch  219/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.120\n",
      "Epoch  13 Batch  220/538 - Train Accuracy:  0.965, Validation Accuracy:  0.968, Loss:  1.139\n",
      "Epoch  13 Batch  221/538 - Train Accuracy:  0.978, Validation Accuracy:  0.964, Loss:  1.151\n",
      "Epoch  13 Batch  222/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.166\n",
      "Epoch  13 Batch  223/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.131\n",
      "Epoch  13 Batch  224/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.152\n",
      "Epoch  13 Batch  225/538 - Train Accuracy:  0.968, Validation Accuracy:  0.972, Loss:  1.137\n",
      "Epoch  13 Batch  226/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.121\n",
      "Epoch  13 Batch  227/538 - Train Accuracy:  0.967, Validation Accuracy:  0.969, Loss:  1.189\n",
      "Epoch  13 Batch  228/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.185\n",
      "Epoch  13 Batch  229/538 - Train Accuracy:  0.977, Validation Accuracy:  0.961, Loss:  1.126\n",
      "Epoch  13 Batch  230/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.156\n",
      "Epoch  13 Batch  231/538 - Train Accuracy:  0.981, Validation Accuracy:  0.963, Loss:  1.123\n",
      "Epoch  13 Batch  232/538 - Train Accuracy:  0.968, Validation Accuracy:  0.963, Loss:  1.171\n",
      "Epoch  13 Batch  233/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.150\n",
      "Epoch  13 Batch  234/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.178\n",
      "Epoch  13 Batch  235/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.155\n",
      "Epoch  13 Batch  236/538 - Train Accuracy:  0.963, Validation Accuracy:  0.966, Loss:  1.120\n",
      "Epoch  13 Batch  237/538 - Train Accuracy:  0.986, Validation Accuracy:  0.970, Loss:  1.128\n",
      "Epoch  13 Batch  238/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.164\n",
      "Epoch  13 Batch  239/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.134\n",
      "Epoch  13 Batch  240/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.157\n",
      "Epoch  13 Batch  241/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.192\n",
      "Epoch  13 Batch  242/538 - Train Accuracy:  0.988, Validation Accuracy:  0.964, Loss:  1.182\n",
      "Epoch  13 Batch  243/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.179\n",
      "Epoch  13 Batch  244/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.114\n",
      "Epoch  13 Batch  245/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.095\n",
      "Epoch  13 Batch  246/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.153\n",
      "Epoch  13 Batch  247/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.165\n",
      "Epoch  13 Batch  248/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.085\n",
      "Epoch  13 Batch  249/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.138\n",
      "Epoch  13 Batch  250/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.094\n",
      "Epoch  13 Batch  251/538 - Train Accuracy:  0.982, Validation Accuracy:  0.976, Loss:  1.127\n",
      "Epoch  13 Batch  252/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.119\n",
      "Epoch  13 Batch  253/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.151\n",
      "Epoch  13 Batch  254/538 - Train Accuracy:  0.968, Validation Accuracy:  0.974, Loss:  1.126\n",
      "Epoch  13 Batch  255/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.148\n",
      "Epoch  13 Batch  256/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.123\n",
      "Epoch  13 Batch  257/538 - Train Accuracy:  0.986, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch  13 Batch  258/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.190\n",
      "Epoch  13 Batch  259/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.162\n",
      "Epoch  13 Batch  260/538 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  1.187\n",
      "Epoch  13 Batch  261/538 - Train Accuracy:  0.970, Validation Accuracy:  0.970, Loss:  1.188\n",
      "Epoch  13 Batch  262/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.117\n",
      "Epoch  13 Batch  263/538 - Train Accuracy:  0.970, Validation Accuracy:  0.966, Loss:  1.152\n",
      "Epoch  13 Batch  264/538 - Train Accuracy:  0.963, Validation Accuracy:  0.960, Loss:  1.101\n",
      "Epoch  13 Batch  265/538 - Train Accuracy:  0.958, Validation Accuracy:  0.962, Loss:  1.161\n",
      "Epoch  13 Batch  266/538 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  1.152\n",
      "Epoch  13 Batch  267/538 - Train Accuracy:  0.964, Validation Accuracy:  0.961, Loss:  1.150\n",
      "Epoch  13 Batch  268/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.129\n",
      "Epoch  13 Batch  269/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.114\n",
      "Epoch  13 Batch  270/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.167\n",
      "Epoch  13 Batch  271/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.124\n",
      "Epoch  13 Batch  272/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.151\n",
      "Epoch  13 Batch  273/538 - Train Accuracy:  0.969, Validation Accuracy:  0.973, Loss:  1.115\n",
      "Epoch  13 Batch  274/538 - Train Accuracy:  0.962, Validation Accuracy:  0.972, Loss:  1.163\n",
      "Epoch  13 Batch  275/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.159\n",
      "Epoch  13 Batch  276/538 - Train Accuracy:  0.975, Validation Accuracy:  0.968, Loss:  1.144\n",
      "Epoch  13 Batch  277/538 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  1.131\n",
      "Epoch  13 Batch  278/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.124\n",
      "Epoch  13 Batch  279/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.147\n",
      "Epoch  13 Batch  280/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch  13 Batch  281/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.112\n",
      "Epoch  13 Batch  282/538 - Train Accuracy:  0.978, Validation Accuracy:  0.973, Loss:  1.135\n",
      "Epoch  13 Batch  283/538 - Train Accuracy:  0.987, Validation Accuracy:  0.975, Loss:  1.138\n",
      "Epoch  13 Batch  284/538 - Train Accuracy:  0.966, Validation Accuracy:  0.977, Loss:  1.127\n",
      "Epoch  13 Batch  285/538 - Train Accuracy:  0.981, Validation Accuracy:  0.979, Loss:  1.120\n",
      "Epoch  13 Batch  286/538 - Train Accuracy:  0.965, Validation Accuracy:  0.978, Loss:  1.133\n",
      "Epoch  13 Batch  287/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.157\n",
      "Epoch  13 Batch  288/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.151\n",
      "Epoch  13 Batch  289/538 - Train Accuracy:  0.974, Validation Accuracy:  0.975, Loss:  1.150\n",
      "Epoch  13 Batch  290/538 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  1.125\n",
      "Epoch  13 Batch  291/538 - Train Accuracy:  0.985, Validation Accuracy:  0.977, Loss:  1.150\n",
      "Epoch  13 Batch  292/538 - Train Accuracy:  0.991, Validation Accuracy:  0.979, Loss:  1.128\n",
      "Epoch  13 Batch  293/538 - Train Accuracy:  0.979, Validation Accuracy:  0.978, Loss:  1.124\n",
      "Epoch  13 Batch  294/538 - Train Accuracy:  0.983, Validation Accuracy:  0.978, Loss:  1.176\n",
      "Epoch  13 Batch  295/538 - Train Accuracy:  0.977, Validation Accuracy:  0.978, Loss:  1.138\n",
      "Epoch  13 Batch  296/538 - Train Accuracy:  0.968, Validation Accuracy:  0.978, Loss:  1.169\n",
      "Epoch  13 Batch  297/538 - Train Accuracy:  0.986, Validation Accuracy:  0.974, Loss:  1.069\n",
      "Epoch  13 Batch  298/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch  13 Batch  299/538 - Train Accuracy:  0.969, Validation Accuracy:  0.970, Loss:  1.159\n",
      "Epoch  13 Batch  300/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.107\n",
      "Epoch  13 Batch  301/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.145\n",
      "Epoch  13 Batch  302/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.152\n",
      "Epoch  13 Batch  303/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.139\n",
      "Epoch  13 Batch  304/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.134\n",
      "Epoch  13 Batch  305/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.163\n",
      "Epoch  13 Batch  306/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.124\n",
      "Epoch  13 Batch  307/538 - Train Accuracy:  0.988, Validation Accuracy:  0.976, Loss:  1.124\n",
      "Epoch  13 Batch  308/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.153\n",
      "Epoch  13 Batch  309/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.184\n",
      "Epoch  13 Batch  310/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.169\n",
      "Epoch  13 Batch  311/538 - Train Accuracy:  0.972, Validation Accuracy:  0.973, Loss:  1.163\n",
      "Epoch  13 Batch  312/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.129\n",
      "Epoch  13 Batch  313/538 - Train Accuracy:  0.966, Validation Accuracy:  0.973, Loss:  1.116\n",
      "Epoch  13 Batch  314/538 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  1.070\n",
      "Epoch  13 Batch  315/538 - Train Accuracy:  0.989, Validation Accuracy:  0.971, Loss:  1.139\n",
      "Epoch  13 Batch  316/538 - Train Accuracy:  0.969, Validation Accuracy:  0.973, Loss:  1.131\n",
      "Epoch  13 Batch  317/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.164\n",
      "Epoch  13 Batch  318/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.137\n",
      "Epoch  13 Batch  319/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.167\n",
      "Epoch  13 Batch  320/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.100\n",
      "Epoch  13 Batch  321/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.180\n",
      "Epoch  13 Batch  322/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.157\n",
      "Epoch  13 Batch  323/538 - Train Accuracy:  0.986, Validation Accuracy:  0.967, Loss:  1.145\n",
      "Epoch  13 Batch  324/538 - Train Accuracy:  0.976, Validation Accuracy:  0.962, Loss:  1.190\n",
      "Epoch  13 Batch  325/538 - Train Accuracy:  0.983, Validation Accuracy:  0.962, Loss:  1.102\n",
      "Epoch  13 Batch  326/538 - Train Accuracy:  0.985, Validation Accuracy:  0.965, Loss:  1.170\n",
      "Epoch  13 Batch  327/538 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  1.152\n",
      "Epoch  13 Batch  328/538 - Train Accuracy:  0.988, Validation Accuracy:  0.963, Loss:  1.112\n",
      "Epoch  13 Batch  329/538 - Train Accuracy:  0.993, Validation Accuracy:  0.963, Loss:  1.162\n",
      "Epoch  13 Batch  330/538 - Train Accuracy:  0.986, Validation Accuracy:  0.965, Loss:  1.114\n",
      "Epoch  13 Batch  331/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.157\n",
      "Epoch  13 Batch  332/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.178\n",
      "Epoch  13 Batch  333/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.080\n",
      "Epoch  13 Batch  334/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.153\n",
      "Epoch  13 Batch  335/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.137\n",
      "Epoch  13 Batch  336/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.136\n",
      "Epoch  13 Batch  337/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.145\n",
      "Epoch  13 Batch  338/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.183\n",
      "Epoch  13 Batch  339/538 - Train Accuracy:  0.972, Validation Accuracy:  0.967, Loss:  1.094\n",
      "Epoch  13 Batch  340/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.145\n",
      "Epoch  13 Batch  341/538 - Train Accuracy:  0.974, Validation Accuracy:  0.970, Loss:  1.137\n",
      "Epoch  13 Batch  342/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.128\n",
      "Epoch  13 Batch  343/538 - Train Accuracy:  0.993, Validation Accuracy:  0.968, Loss:  1.181\n",
      "Epoch  13 Batch  344/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.137\n",
      "Epoch  13 Batch  345/538 - Train Accuracy:  0.990, Validation Accuracy:  0.966, Loss:  1.176\n",
      "Epoch  13 Batch  346/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.172\n",
      "Epoch  13 Batch  347/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.193\n",
      "Epoch  13 Batch  348/538 - Train Accuracy:  0.970, Validation Accuracy:  0.963, Loss:  1.136\n",
      "Epoch  13 Batch  349/538 - Train Accuracy:  0.986, Validation Accuracy:  0.966, Loss:  1.108\n",
      "Epoch  13 Batch  350/538 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  1.182\n",
      "Epoch  13 Batch  351/538 - Train Accuracy:  0.973, Validation Accuracy:  0.967, Loss:  1.114\n",
      "Epoch  13 Batch  352/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.130\n",
      "Epoch  13 Batch  353/538 - Train Accuracy:  0.963, Validation Accuracy:  0.968, Loss:  1.125\n",
      "Epoch  13 Batch  354/538 - Train Accuracy:  0.984, Validation Accuracy:  0.966, Loss:  1.108\n",
      "Epoch  13 Batch  355/538 - Train Accuracy:  0.987, Validation Accuracy:  0.966, Loss:  1.128\n",
      "Epoch  13 Batch  356/538 - Train Accuracy:  0.980, Validation Accuracy:  0.962, Loss:  1.136\n",
      "Epoch  13 Batch  357/538 - Train Accuracy:  0.980, Validation Accuracy:  0.960, Loss:  1.122\n",
      "Epoch  13 Batch  358/538 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  1.169\n",
      "Epoch  13 Batch  359/538 - Train Accuracy:  0.986, Validation Accuracy:  0.967, Loss:  1.102\n",
      "Epoch  13 Batch  360/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.127\n",
      "Epoch  13 Batch  361/538 - Train Accuracy:  0.984, Validation Accuracy:  0.964, Loss:  1.125\n",
      "Epoch  13 Batch  362/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.128\n",
      "Epoch  13 Batch  363/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.168\n",
      "Epoch  13 Batch  364/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.155\n",
      "Epoch  13 Batch  365/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.113\n",
      "Epoch  13 Batch  366/538 - Train Accuracy:  0.972, Validation Accuracy:  0.975, Loss:  1.155\n",
      "Epoch  13 Batch  367/538 - Train Accuracy:  0.986, Validation Accuracy:  0.974, Loss:  1.173\n",
      "Epoch  13 Batch  368/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.175\n",
      "Epoch  13 Batch  369/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.181\n",
      "Epoch  13 Batch  370/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.165\n",
      "Epoch  13 Batch  371/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.187\n",
      "Epoch  13 Batch  372/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.147\n",
      "Epoch  13 Batch  373/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.172\n",
      "Epoch  13 Batch  374/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.140\n",
      "Epoch  13 Batch  375/538 - Train Accuracy:  0.976, Validation Accuracy:  0.963, Loss:  1.207\n",
      "Epoch  13 Batch  376/538 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  1.144\n",
      "Epoch  13 Batch  377/538 - Train Accuracy:  0.984, Validation Accuracy:  0.959, Loss:  1.184\n",
      "Epoch  13 Batch  378/538 - Train Accuracy:  0.972, Validation Accuracy:  0.959, Loss:  1.133\n",
      "Epoch  13 Batch  379/538 - Train Accuracy:  0.983, Validation Accuracy:  0.960, Loss:  1.144\n",
      "Epoch  13 Batch  380/538 - Train Accuracy:  0.985, Validation Accuracy:  0.962, Loss:  1.180\n",
      "Epoch  13 Batch  381/538 - Train Accuracy:  0.985, Validation Accuracy:  0.959, Loss:  1.136\n",
      "Epoch  13 Batch  382/538 - Train Accuracy:  0.966, Validation Accuracy:  0.959, Loss:  1.142\n",
      "Epoch  13 Batch  383/538 - Train Accuracy:  0.980, Validation Accuracy:  0.961, Loss:  1.132\n",
      "Epoch  13 Batch  384/538 - Train Accuracy:  0.973, Validation Accuracy:  0.961, Loss:  1.106\n",
      "Epoch  13 Batch  385/538 - Train Accuracy:  0.974, Validation Accuracy:  0.962, Loss:  1.101\n",
      "Epoch  13 Batch  386/538 - Train Accuracy:  0.985, Validation Accuracy:  0.962, Loss:  1.099\n",
      "Epoch  13 Batch  387/538 - Train Accuracy:  0.983, Validation Accuracy:  0.965, Loss:  1.144\n",
      "Epoch  13 Batch  388/538 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  1.142\n",
      "Epoch  13 Batch  389/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.120\n",
      "Epoch  13 Batch  390/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.131\n",
      "Epoch  13 Batch  391/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.145\n",
      "Epoch  13 Batch  392/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.175\n",
      "Epoch  13 Batch  393/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.113\n",
      "Epoch  13 Batch  394/538 - Train Accuracy:  0.966, Validation Accuracy:  0.968, Loss:  1.141\n",
      "Epoch  13 Batch  395/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.130\n",
      "Epoch  13 Batch  396/538 - Train Accuracy:  0.981, Validation Accuracy:  0.967, Loss:  1.071\n",
      "Epoch  13 Batch  397/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.089\n",
      "Epoch  13 Batch  398/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.126\n",
      "Epoch  13 Batch  399/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.135\n",
      "Epoch  13 Batch  400/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.156\n",
      "Epoch  13 Batch  401/538 - Train Accuracy:  0.989, Validation Accuracy:  0.972, Loss:  1.097\n",
      "Epoch  13 Batch  402/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.168\n",
      "Epoch  13 Batch  403/538 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  1.181\n",
      "Epoch  13 Batch  404/538 - Train Accuracy:  0.983, Validation Accuracy:  0.963, Loss:  1.185\n",
      "Epoch  13 Batch  405/538 - Train Accuracy:  0.978, Validation Accuracy:  0.963, Loss:  1.154\n",
      "Epoch  13 Batch  406/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.096\n",
      "Epoch  13 Batch  407/538 - Train Accuracy:  0.977, Validation Accuracy:  0.963, Loss:  1.163\n",
      "Epoch  13 Batch  408/538 - Train Accuracy:  0.973, Validation Accuracy:  0.963, Loss:  1.149\n",
      "Epoch  13 Batch  409/538 - Train Accuracy:  0.978, Validation Accuracy:  0.961, Loss:  1.098\n",
      "Epoch  13 Batch  410/538 - Train Accuracy:  0.986, Validation Accuracy:  0.964, Loss:  1.148\n",
      "Epoch  13 Batch  411/538 - Train Accuracy:  0.984, Validation Accuracy:  0.966, Loss:  1.127\n",
      "Epoch  13 Batch  412/538 - Train Accuracy:  0.989, Validation Accuracy:  0.966, Loss:  1.132\n",
      "Epoch  13 Batch  413/538 - Train Accuracy:  0.986, Validation Accuracy:  0.970, Loss:  1.174\n",
      "Epoch  13 Batch  414/538 - Train Accuracy:  0.956, Validation Accuracy:  0.970, Loss:  1.165\n",
      "Epoch  13 Batch  415/538 - Train Accuracy:  0.973, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  13 Batch  416/538 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  1.121\n",
      "Epoch  13 Batch  417/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.139\n",
      "Epoch  13 Batch  418/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.145\n",
      "Epoch  13 Batch  419/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.144\n",
      "Epoch  13 Batch  420/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch  13 Batch  421/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  13 Batch  422/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.112\n",
      "Epoch  13 Batch  423/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.127\n",
      "Epoch  13 Batch  424/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.145\n",
      "Epoch  13 Batch  425/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.142\n",
      "Epoch  13 Batch  426/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.136\n",
      "Epoch  13 Batch  427/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.152\n",
      "Epoch  13 Batch  428/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.114\n",
      "Epoch  13 Batch  429/538 - Train Accuracy:  0.989, Validation Accuracy:  0.972, Loss:  1.128\n",
      "Epoch  13 Batch  430/538 - Train Accuracy:  0.984, Validation Accuracy:  0.972, Loss:  1.151\n",
      "Epoch  13 Batch  431/538 - Train Accuracy:  0.974, Validation Accuracy:  0.972, Loss:  1.155\n",
      "Epoch  13 Batch  432/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.145\n",
      "Epoch  13 Batch  433/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.151\n",
      "Epoch  13 Batch  434/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.121\n",
      "Epoch  13 Batch  435/538 - Train Accuracy:  0.978, Validation Accuracy:  0.969, Loss:  1.176\n",
      "Epoch  13 Batch  436/538 - Train Accuracy:  0.968, Validation Accuracy:  0.968, Loss:  1.172\n",
      "Epoch  13 Batch  437/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.132\n",
      "Epoch  13 Batch  438/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.126\n",
      "Epoch  13 Batch  439/538 - Train Accuracy:  0.988, Validation Accuracy:  0.966, Loss:  1.120\n",
      "Epoch  13 Batch  440/538 - Train Accuracy:  0.988, Validation Accuracy:  0.966, Loss:  1.115\n",
      "Epoch  13 Batch  441/538 - Train Accuracy:  0.963, Validation Accuracy:  0.967, Loss:  1.111\n",
      "Epoch  13 Batch  442/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.154\n",
      "Epoch  13 Batch  443/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.096\n",
      "Epoch  13 Batch  444/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.203\n",
      "Epoch  13 Batch  445/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.156\n",
      "Epoch  13 Batch  446/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.182\n",
      "Epoch  13 Batch  447/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.137\n",
      "Epoch  13 Batch  448/538 - Train Accuracy:  0.974, Validation Accuracy:  0.973, Loss:  1.152\n",
      "Epoch  13 Batch  449/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.125\n",
      "Epoch  13 Batch  450/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.149\n",
      "Epoch  13 Batch  451/538 - Train Accuracy:  0.969, Validation Accuracy:  0.973, Loss:  1.119\n",
      "Epoch  13 Batch  452/538 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  1.133\n",
      "Epoch  13 Batch  453/538 - Train Accuracy:  0.972, Validation Accuracy:  0.974, Loss:  1.093\n",
      "Epoch  13 Batch  454/538 - Train Accuracy:  0.980, Validation Accuracy:  0.974, Loss:  1.156\n",
      "Epoch  13 Batch  455/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.127\n",
      "Epoch  13 Batch  456/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.129\n",
      "Epoch  13 Batch  457/538 - Train Accuracy:  0.971, Validation Accuracy:  0.968, Loss:  1.161\n",
      "Epoch  13 Batch  458/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch  13 Batch  459/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.110\n",
      "Epoch  13 Batch  460/538 - Train Accuracy:  0.987, Validation Accuracy:  0.965, Loss:  1.127\n",
      "Epoch  13 Batch  461/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.157\n",
      "Epoch  13 Batch  462/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.153\n",
      "Epoch  13 Batch  463/538 - Train Accuracy:  0.959, Validation Accuracy:  0.972, Loss:  1.119\n",
      "Epoch  13 Batch  464/538 - Train Accuracy:  0.984, Validation Accuracy:  0.966, Loss:  1.107\n",
      "Epoch  13 Batch  465/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.154\n",
      "Epoch  13 Batch  466/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.144\n",
      "Epoch  13 Batch  467/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.166\n",
      "Epoch  13 Batch  468/538 - Train Accuracy:  0.983, Validation Accuracy:  0.963, Loss:  1.160\n",
      "Epoch  13 Batch  469/538 - Train Accuracy:  0.975, Validation Accuracy:  0.965, Loss:  1.155\n",
      "Epoch  13 Batch  470/538 - Train Accuracy:  0.971, Validation Accuracy:  0.963, Loss:  1.213\n",
      "Epoch  13 Batch  471/538 - Train Accuracy:  0.988, Validation Accuracy:  0.963, Loss:  1.099\n",
      "Epoch  13 Batch  472/538 - Train Accuracy:  0.994, Validation Accuracy:  0.963, Loss:  1.105\n",
      "Epoch  13 Batch  473/538 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  1.171\n",
      "Epoch  13 Batch  474/538 - Train Accuracy:  0.985, Validation Accuracy:  0.965, Loss:  1.125\n",
      "Epoch  13 Batch  475/538 - Train Accuracy:  0.986, Validation Accuracy:  0.962, Loss:  1.113\n",
      "Epoch  13 Batch  476/538 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  1.130\n",
      "Epoch  13 Batch  477/538 - Train Accuracy:  0.971, Validation Accuracy:  0.964, Loss:  1.171\n",
      "Epoch  13 Batch  478/538 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  1.125\n",
      "Epoch  13 Batch  479/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.134\n",
      "Epoch  13 Batch  480/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.208\n",
      "Epoch  13 Batch  481/538 - Train Accuracy:  0.988, Validation Accuracy:  0.971, Loss:  1.158\n",
      "Epoch  13 Batch  482/538 - Train Accuracy:  0.972, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch  13 Batch  483/538 - Train Accuracy:  0.969, Validation Accuracy:  0.971, Loss:  1.116\n",
      "Epoch  13 Batch  484/538 - Train Accuracy:  0.969, Validation Accuracy:  0.972, Loss:  1.152\n",
      "Epoch  13 Batch  485/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.153\n",
      "Epoch  13 Batch  486/538 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  1.144\n",
      "Epoch  13 Batch  487/538 - Train Accuracy:  0.986, Validation Accuracy:  0.974, Loss:  1.113\n",
      "Epoch  13 Batch  488/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.161\n",
      "Epoch  13 Batch  489/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.119\n",
      "Epoch  13 Batch  490/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.115\n",
      "Epoch  13 Batch  491/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.151\n",
      "Epoch  13 Batch  492/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.127\n",
      "Epoch  13 Batch  493/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.168\n",
      "Epoch  13 Batch  494/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.158\n",
      "Epoch  13 Batch  495/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.126\n",
      "Epoch  13 Batch  496/538 - Train Accuracy:  0.986, Validation Accuracy:  0.970, Loss:  1.140\n",
      "Epoch  13 Batch  497/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.163\n",
      "Epoch  13 Batch  498/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.145\n",
      "Epoch  13 Batch  499/538 - Train Accuracy:  0.970, Validation Accuracy:  0.973, Loss:  1.126\n",
      "Epoch  13 Batch  500/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.151\n",
      "Epoch  13 Batch  501/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.111\n",
      "Epoch  13 Batch  502/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.095\n",
      "Epoch  13 Batch  503/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.102\n",
      "Epoch  13 Batch  504/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.156\n",
      "Epoch  13 Batch  505/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.160\n",
      "Epoch  13 Batch  506/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.121\n",
      "Epoch  13 Batch  507/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.161\n",
      "Epoch  13 Batch  508/538 - Train Accuracy:  0.975, Validation Accuracy:  0.969, Loss:  1.144\n",
      "Epoch  13 Batch  509/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.158\n",
      "Epoch  13 Batch  510/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.169\n",
      "Epoch  13 Batch  511/538 - Train Accuracy:  0.971, Validation Accuracy:  0.972, Loss:  1.158\n",
      "Epoch  13 Batch  512/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.174\n",
      "Epoch  13 Batch  513/538 - Train Accuracy:  0.965, Validation Accuracy:  0.972, Loss:  1.161\n",
      "Epoch  13 Batch  514/538 - Train Accuracy:  0.986, Validation Accuracy:  0.972, Loss:  1.147\n",
      "Epoch  13 Batch  515/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.130\n",
      "Epoch  13 Batch  516/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.176\n",
      "Epoch  13 Batch  517/538 - Train Accuracy:  0.985, Validation Accuracy:  0.967, Loss:  1.090\n",
      "Epoch  13 Batch  518/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.153\n",
      "Epoch  13 Batch  519/538 - Train Accuracy:  0.987, Validation Accuracy:  0.960, Loss:  1.127\n",
      "Epoch  13 Batch  520/538 - Train Accuracy:  0.983, Validation Accuracy:  0.963, Loss:  1.112\n",
      "Epoch  13 Batch  521/538 - Train Accuracy:  0.988, Validation Accuracy:  0.963, Loss:  1.152\n",
      "Epoch  13 Batch  522/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.160\n",
      "Epoch  13 Batch  523/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.157\n",
      "Epoch  13 Batch  524/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.119\n",
      "Epoch  13 Batch  525/538 - Train Accuracy:  0.976, Validation Accuracy:  0.975, Loss:  1.173\n",
      "Epoch  13 Batch  526/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.156\n",
      "Epoch  13 Batch  527/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.124\n",
      "Epoch  13 Batch  528/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.140\n",
      "Epoch  13 Batch  529/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.162\n",
      "Epoch  13 Batch  530/538 - Train Accuracy:  0.984, Validation Accuracy:  0.970, Loss:  1.123\n",
      "Epoch  13 Batch  531/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.085\n",
      "Epoch  13 Batch  532/538 - Train Accuracy:  0.971, Validation Accuracy:  0.973, Loss:  1.125\n",
      "Epoch  13 Batch  533/538 - Train Accuracy:  0.974, Validation Accuracy:  0.973, Loss:  1.143\n",
      "Epoch  13 Batch  534/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.151\n",
      "Epoch  13 Batch  535/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.117\n",
      "Epoch  13 Batch  536/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.141\n",
      "Epoch  14 Batch    0/538 - Train Accuracy:  0.981, Validation Accuracy:  0.968, Loss:  1.110\n",
      "Epoch  14 Batch    1/538 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  1.109\n",
      "Epoch  14 Batch    2/538 - Train Accuracy:  0.981, Validation Accuracy:  0.967, Loss:  1.103\n",
      "Epoch  14 Batch    3/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.183\n",
      "Epoch  14 Batch    4/538 - Train Accuracy:  0.989, Validation Accuracy:  0.970, Loss:  1.068\n",
      "Epoch  14 Batch    5/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.092\n",
      "Epoch  14 Batch    6/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  14 Batch    7/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch  14 Batch    8/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.127\n",
      "Epoch  14 Batch    9/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.157\n",
      "Epoch  14 Batch   10/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.154\n",
      "Epoch  14 Batch   11/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.134\n",
      "Epoch  14 Batch   12/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.115\n",
      "Epoch  14 Batch   13/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.107\n",
      "Epoch  14 Batch   14/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.113\n",
      "Epoch  14 Batch   15/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  14 Batch   16/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.133\n",
      "Epoch  14 Batch   17/538 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  1.085\n",
      "Epoch  14 Batch   18/538 - Train Accuracy:  0.989, Validation Accuracy:  0.970, Loss:  1.174\n",
      "Epoch  14 Batch   19/538 - Train Accuracy:  0.979, Validation Accuracy:  0.970, Loss:  1.141\n",
      "Epoch  14 Batch   20/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.169\n",
      "Epoch  14 Batch   21/538 - Train Accuracy:  0.989, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  14 Batch   22/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.149\n",
      "Epoch  14 Batch   23/538 - Train Accuracy:  0.980, Validation Accuracy:  0.968, Loss:  1.197\n",
      "Epoch  14 Batch   24/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.164\n",
      "Epoch  14 Batch   25/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.190\n",
      "Epoch  14 Batch   26/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.137\n",
      "Epoch  14 Batch   27/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.111\n",
      "Epoch  14 Batch   28/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.088\n",
      "Epoch  14 Batch   29/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.146\n",
      "Epoch  14 Batch   30/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.131\n",
      "Epoch  14 Batch   31/538 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  1.136\n",
      "Epoch  14 Batch   32/538 - Train Accuracy:  0.980, Validation Accuracy:  0.977, Loss:  1.129\n",
      "Epoch  14 Batch   33/538 - Train Accuracy:  0.971, Validation Accuracy:  0.973, Loss:  1.161\n",
      "Epoch  14 Batch   34/538 - Train Accuracy:  0.974, Validation Accuracy:  0.967, Loss:  1.142\n",
      "Epoch  14 Batch   35/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.100\n",
      "Epoch  14 Batch   36/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.122\n",
      "Epoch  14 Batch   37/538 - Train Accuracy:  0.977, Validation Accuracy:  0.970, Loss:  1.132\n",
      "Epoch  14 Batch   38/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.093\n",
      "Epoch  14 Batch   39/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.075\n",
      "Epoch  14 Batch   40/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.103\n",
      "Epoch  14 Batch   41/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.101\n",
      "Epoch  14 Batch   42/538 - Train Accuracy:  0.989, Validation Accuracy:  0.969, Loss:  1.165\n",
      "Epoch  14 Batch   43/538 - Train Accuracy:  0.970, Validation Accuracy:  0.969, Loss:  1.183\n",
      "Epoch  14 Batch   44/538 - Train Accuracy:  0.986, Validation Accuracy:  0.965, Loss:  1.125\n",
      "Epoch  14 Batch   45/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.179\n",
      "Epoch  14 Batch   46/538 - Train Accuracy:  0.989, Validation Accuracy:  0.968, Loss:  1.161\n",
      "Epoch  14 Batch   47/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.201\n",
      "Epoch  14 Batch   48/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.102\n",
      "Epoch  14 Batch   49/538 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  1.136\n",
      "Epoch  14 Batch   50/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.112\n",
      "Epoch  14 Batch   51/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.135\n",
      "Epoch  14 Batch   52/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.114\n",
      "Epoch  14 Batch   53/538 - Train Accuracy:  0.969, Validation Accuracy:  0.969, Loss:  1.108\n",
      "Epoch  14 Batch   54/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.116\n",
      "Epoch  14 Batch   55/538 - Train Accuracy:  0.989, Validation Accuracy:  0.972, Loss:  1.099\n",
      "Epoch  14 Batch   56/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.147\n",
      "Epoch  14 Batch   57/538 - Train Accuracy:  0.966, Validation Accuracy:  0.973, Loss:  1.166\n",
      "Epoch  14 Batch   58/538 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  1.119\n",
      "Epoch  14 Batch   59/538 - Train Accuracy:  0.969, Validation Accuracy:  0.975, Loss:  1.147\n",
      "Epoch  14 Batch   60/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.129\n",
      "Epoch  14 Batch   61/538 - Train Accuracy:  0.974, Validation Accuracy:  0.975, Loss:  1.150\n",
      "Epoch  14 Batch   62/538 - Train Accuracy:  0.973, Validation Accuracy:  0.975, Loss:  1.155\n",
      "Epoch  14 Batch   63/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.141\n",
      "Epoch  14 Batch   64/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.149\n",
      "Epoch  14 Batch   65/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.101\n",
      "Epoch  14 Batch   66/538 - Train Accuracy:  0.986, Validation Accuracy:  0.975, Loss:  1.203\n",
      "Epoch  14 Batch   67/538 - Train Accuracy:  0.982, Validation Accuracy:  0.972, Loss:  1.159\n",
      "Epoch  14 Batch   68/538 - Train Accuracy:  0.974, Validation Accuracy:  0.971, Loss:  1.179\n",
      "Epoch  14 Batch   69/538 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  1.178\n",
      "Epoch  14 Batch   70/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.118\n",
      "Epoch  14 Batch   71/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.186\n",
      "Epoch  14 Batch   72/538 - Train Accuracy:  0.968, Validation Accuracy:  0.970, Loss:  1.186\n",
      "Epoch  14 Batch   73/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.156\n",
      "Epoch  14 Batch   74/538 - Train Accuracy:  0.987, Validation Accuracy:  0.977, Loss:  1.140\n",
      "Epoch  14 Batch   75/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.141\n",
      "Epoch  14 Batch   76/538 - Train Accuracy:  0.989, Validation Accuracy:  0.975, Loss:  1.155\n",
      "Epoch  14 Batch   77/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.163\n",
      "Epoch  14 Batch   78/538 - Train Accuracy:  0.973, Validation Accuracy:  0.971, Loss:  1.135\n",
      "Epoch  14 Batch   79/538 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  1.131\n",
      "Epoch  14 Batch   80/538 - Train Accuracy:  0.983, Validation Accuracy:  0.970, Loss:  1.121\n",
      "Epoch  14 Batch   81/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.162\n",
      "Epoch  14 Batch   82/538 - Train Accuracy:  0.978, Validation Accuracy:  0.977, Loss:  1.120\n",
      "Epoch  14 Batch   83/538 - Train Accuracy:  0.976, Validation Accuracy:  0.973, Loss:  1.154\n",
      "Epoch  14 Batch   84/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.159\n",
      "Epoch  14 Batch   85/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.122\n",
      "Epoch  14 Batch   86/538 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  1.138\n",
      "Epoch  14 Batch   87/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.134\n",
      "Epoch  14 Batch   88/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.153\n",
      "Epoch  14 Batch   89/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.143\n",
      "Epoch  14 Batch   90/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.115\n",
      "Epoch  14 Batch   91/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.142\n",
      "Epoch  14 Batch   92/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.163\n",
      "Epoch  14 Batch   93/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.121\n",
      "Epoch  14 Batch   94/538 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  1.134\n",
      "Epoch  14 Batch   95/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.135\n",
      "Epoch  14 Batch   96/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.110\n",
      "Epoch  14 Batch   97/538 - Train Accuracy:  0.982, Validation Accuracy:  0.977, Loss:  1.107\n",
      "Epoch  14 Batch   98/538 - Train Accuracy:  0.977, Validation Accuracy:  0.977, Loss:  1.118\n",
      "Epoch  14 Batch   99/538 - Train Accuracy:  0.986, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  14 Batch  100/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.120\n",
      "Epoch  14 Batch  101/538 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  1.158\n",
      "Epoch  14 Batch  102/538 - Train Accuracy:  0.972, Validation Accuracy:  0.977, Loss:  1.130\n",
      "Epoch  14 Batch  103/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.149\n",
      "Epoch  14 Batch  104/538 - Train Accuracy:  0.986, Validation Accuracy:  0.974, Loss:  1.126\n",
      "Epoch  14 Batch  105/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.180\n",
      "Epoch  14 Batch  106/538 - Train Accuracy:  0.976, Validation Accuracy:  0.974, Loss:  1.120\n",
      "Epoch  14 Batch  107/538 - Train Accuracy:  0.971, Validation Accuracy:  0.974, Loss:  1.148\n",
      "Epoch  14 Batch  108/538 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  1.140\n",
      "Epoch  14 Batch  109/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.134\n",
      "Epoch  14 Batch  110/538 - Train Accuracy:  0.987, Validation Accuracy:  0.970, Loss:  1.087\n",
      "Epoch  14 Batch  111/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.126\n",
      "Epoch  14 Batch  112/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch  14 Batch  113/538 - Train Accuracy:  0.969, Validation Accuracy:  0.973, Loss:  1.161\n",
      "Epoch  14 Batch  114/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.127\n",
      "Epoch  14 Batch  115/538 - Train Accuracy:  0.976, Validation Accuracy:  0.975, Loss:  1.135\n",
      "Epoch  14 Batch  116/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.110\n",
      "Epoch  14 Batch  117/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.128\n",
      "Epoch  14 Batch  118/538 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  1.167\n",
      "Epoch  14 Batch  119/538 - Train Accuracy:  0.991, Validation Accuracy:  0.973, Loss:  1.113\n",
      "Epoch  14 Batch  120/538 - Train Accuracy:  0.982, Validation Accuracy:  0.976, Loss:  1.165\n",
      "Epoch  14 Batch  121/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.121\n",
      "Epoch  14 Batch  122/538 - Train Accuracy:  0.978, Validation Accuracy:  0.979, Loss:  1.154\n",
      "Epoch  14 Batch  123/538 - Train Accuracy:  0.974, Validation Accuracy:  0.976, Loss:  1.172\n",
      "Epoch  14 Batch  124/538 - Train Accuracy:  0.975, Validation Accuracy:  0.979, Loss:  1.098\n",
      "Epoch  14 Batch  125/538 - Train Accuracy:  0.979, Validation Accuracy:  0.979, Loss:  1.138\n",
      "Epoch  14 Batch  126/538 - Train Accuracy:  0.981, Validation Accuracy:  0.977, Loss:  1.108\n",
      "Epoch  14 Batch  127/538 - Train Accuracy:  0.979, Validation Accuracy:  0.977, Loss:  1.099\n",
      "Epoch  14 Batch  128/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.098\n",
      "Epoch  14 Batch  129/538 - Train Accuracy:  0.984, Validation Accuracy:  0.976, Loss:  1.174\n",
      "Epoch  14 Batch  130/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.123\n",
      "Epoch  14 Batch  131/538 - Train Accuracy:  0.987, Validation Accuracy:  0.975, Loss:  1.108\n",
      "Epoch  14 Batch  132/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.104\n",
      "Epoch  14 Batch  133/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch  14 Batch  134/538 - Train Accuracy:  0.984, Validation Accuracy:  0.966, Loss:  1.106\n",
      "Epoch  14 Batch  135/538 - Train Accuracy:  0.975, Validation Accuracy:  0.964, Loss:  1.129\n",
      "Epoch  14 Batch  136/538 - Train Accuracy:  0.978, Validation Accuracy:  0.967, Loss:  1.158\n",
      "Epoch  14 Batch  137/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.198\n",
      "Epoch  14 Batch  138/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.140\n",
      "Epoch  14 Batch  139/538 - Train Accuracy:  0.971, Validation Accuracy:  0.969, Loss:  1.179\n",
      "Epoch  14 Batch  140/538 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  1.127\n",
      "Epoch  14 Batch  141/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.143\n",
      "Epoch  14 Batch  142/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.148\n",
      "Epoch  14 Batch  143/538 - Train Accuracy:  0.974, Validation Accuracy:  0.965, Loss:  1.128\n",
      "Epoch  14 Batch  144/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.150\n",
      "Epoch  14 Batch  145/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.128\n",
      "Epoch  14 Batch  146/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.101\n",
      "Epoch  14 Batch  147/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.172\n",
      "Epoch  14 Batch  148/538 - Train Accuracy:  0.971, Validation Accuracy:  0.977, Loss:  1.171\n",
      "Epoch  14 Batch  149/538 - Train Accuracy:  0.985, Validation Accuracy:  0.979, Loss:  1.193\n",
      "Epoch  14 Batch  150/538 - Train Accuracy:  0.982, Validation Accuracy:  0.978, Loss:  1.129\n",
      "Epoch  14 Batch  151/538 - Train Accuracy:  0.963, Validation Accuracy:  0.980, Loss:  1.134\n",
      "Epoch  14 Batch  152/538 - Train Accuracy:  0.983, Validation Accuracy:  0.977, Loss:  1.130\n",
      "Epoch  14 Batch  153/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.082\n",
      "Epoch  14 Batch  154/538 - Train Accuracy:  0.975, Validation Accuracy:  0.970, Loss:  1.129\n",
      "Epoch  14 Batch  155/538 - Train Accuracy:  0.983, Validation Accuracy:  0.970, Loss:  1.157\n",
      "Epoch  14 Batch  156/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.084\n",
      "Epoch  14 Batch  157/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.184\n",
      "Epoch  14 Batch  158/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.152\n",
      "Epoch  14 Batch  159/538 - Train Accuracy:  0.974, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch  14 Batch  160/538 - Train Accuracy:  0.976, Validation Accuracy:  0.966, Loss:  1.159\n",
      "Epoch  14 Batch  161/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.129\n",
      "Epoch  14 Batch  162/538 - Train Accuracy:  0.985, Validation Accuracy:  0.964, Loss:  1.183\n",
      "Epoch  14 Batch  163/538 - Train Accuracy:  0.972, Validation Accuracy:  0.969, Loss:  1.138\n",
      "Epoch  14 Batch  164/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.119\n",
      "Epoch  14 Batch  165/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.153\n",
      "Epoch  14 Batch  166/538 - Train Accuracy:  0.988, Validation Accuracy:  0.970, Loss:  1.160\n",
      "Epoch  14 Batch  167/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.211\n",
      "Epoch  14 Batch  168/538 - Train Accuracy:  0.972, Validation Accuracy:  0.971, Loss:  1.174\n",
      "Epoch  14 Batch  169/538 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  1.120\n",
      "Epoch  14 Batch  170/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.137\n",
      "Epoch  14 Batch  171/538 - Train Accuracy:  0.966, Validation Accuracy:  0.973, Loss:  1.116\n",
      "Epoch  14 Batch  172/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.172\n",
      "Epoch  14 Batch  173/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.165\n",
      "Epoch  14 Batch  174/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.074\n",
      "Epoch  14 Batch  175/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.135\n",
      "Epoch  14 Batch  176/538 - Train Accuracy:  0.986, Validation Accuracy:  0.970, Loss:  1.130\n",
      "Epoch  14 Batch  177/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.080\n",
      "Epoch  14 Batch  178/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.114\n",
      "Epoch  14 Batch  179/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.153\n",
      "Epoch  14 Batch  180/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.115\n",
      "Epoch  14 Batch  181/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.157\n",
      "Epoch  14 Batch  182/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.141\n",
      "Epoch  14 Batch  183/538 - Train Accuracy:  0.987, Validation Accuracy:  0.972, Loss:  1.118\n",
      "Epoch  14 Batch  184/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.134\n",
      "Epoch  14 Batch  185/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.175\n",
      "Epoch  14 Batch  186/538 - Train Accuracy:  0.983, Validation Accuracy:  0.976, Loss:  1.157\n",
      "Epoch  14 Batch  187/538 - Train Accuracy:  0.979, Validation Accuracy:  0.977, Loss:  1.174\n",
      "Epoch  14 Batch  188/538 - Train Accuracy:  0.974, Validation Accuracy:  0.976, Loss:  1.111\n",
      "Epoch  14 Batch  189/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.122\n",
      "Epoch  14 Batch  190/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.190\n",
      "Epoch  14 Batch  191/538 - Train Accuracy:  0.990, Validation Accuracy:  0.974, Loss:  1.142\n",
      "Epoch  14 Batch  192/538 - Train Accuracy:  0.984, Validation Accuracy:  0.972, Loss:  1.107\n",
      "Epoch  14 Batch  193/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.114\n",
      "Epoch  14 Batch  194/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.183\n",
      "Epoch  14 Batch  195/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.130\n",
      "Epoch  14 Batch  196/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.165\n",
      "Epoch  14 Batch  197/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.118\n",
      "Epoch  14 Batch  198/538 - Train Accuracy:  0.966, Validation Accuracy:  0.971, Loss:  1.157\n",
      "Epoch  14 Batch  199/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.137\n",
      "Epoch  14 Batch  200/538 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  1.131\n",
      "Epoch  14 Batch  201/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.146\n",
      "Epoch  14 Batch  202/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.085\n",
      "Epoch  14 Batch  203/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.160\n",
      "Epoch  14 Batch  204/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.096\n",
      "Epoch  14 Batch  205/538 - Train Accuracy:  0.967, Validation Accuracy:  0.975, Loss:  1.205\n",
      "Epoch  14 Batch  206/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.120\n",
      "Epoch  14 Batch  207/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.141\n",
      "Epoch  14 Batch  208/538 - Train Accuracy:  0.971, Validation Accuracy:  0.973, Loss:  1.167\n",
      "Epoch  14 Batch  209/538 - Train Accuracy:  0.984, Validation Accuracy:  0.973, Loss:  1.094\n",
      "Epoch  14 Batch  210/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.150\n",
      "Epoch  14 Batch  211/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.134\n",
      "Epoch  14 Batch  212/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.116\n",
      "Epoch  14 Batch  213/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.151\n",
      "Epoch  14 Batch  214/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.147\n",
      "Epoch  14 Batch  215/538 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  1.136\n",
      "Epoch  14 Batch  216/538 - Train Accuracy:  0.979, Validation Accuracy:  0.967, Loss:  1.137\n",
      "Epoch  14 Batch  217/538 - Train Accuracy:  0.985, Validation Accuracy:  0.966, Loss:  1.153\n",
      "Epoch  14 Batch  218/538 - Train Accuracy:  0.984, Validation Accuracy:  0.966, Loss:  1.101\n",
      "Epoch  14 Batch  219/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.173\n",
      "Epoch  14 Batch  220/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.152\n",
      "Epoch  14 Batch  221/538 - Train Accuracy:  0.979, Validation Accuracy:  0.966, Loss:  1.161\n",
      "Epoch  14 Batch  222/538 - Train Accuracy:  0.988, Validation Accuracy:  0.965, Loss:  1.123\n",
      "Epoch  14 Batch  223/538 - Train Accuracy:  0.987, Validation Accuracy:  0.967, Loss:  1.081\n",
      "Epoch  14 Batch  224/538 - Train Accuracy:  0.971, Validation Accuracy:  0.967, Loss:  1.150\n",
      "Epoch  14 Batch  225/538 - Train Accuracy:  0.973, Validation Accuracy:  0.969, Loss:  1.159\n",
      "Epoch  14 Batch  226/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.184\n",
      "Epoch  14 Batch  227/538 - Train Accuracy:  0.974, Validation Accuracy:  0.973, Loss:  1.123\n",
      "Epoch  14 Batch  228/538 - Train Accuracy:  0.975, Validation Accuracy:  0.973, Loss:  1.149\n",
      "Epoch  14 Batch  229/538 - Train Accuracy:  0.986, Validation Accuracy:  0.973, Loss:  1.133\n",
      "Epoch  14 Batch  230/538 - Train Accuracy:  0.977, Validation Accuracy:  0.973, Loss:  1.159\n",
      "Epoch  14 Batch  231/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.198\n",
      "Epoch  14 Batch  232/538 - Train Accuracy:  0.983, Validation Accuracy:  0.973, Loss:  1.108\n",
      "Epoch  14 Batch  233/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.147\n",
      "Epoch  14 Batch  234/538 - Train Accuracy:  0.990, Validation Accuracy:  0.976, Loss:  1.129\n",
      "Epoch  14 Batch  235/538 - Train Accuracy:  0.984, Validation Accuracy:  0.976, Loss:  1.139\n",
      "Epoch  14 Batch  236/538 - Train Accuracy:  0.977, Validation Accuracy:  0.979, Loss:  1.160\n",
      "Epoch  14 Batch  237/538 - Train Accuracy:  0.980, Validation Accuracy:  0.976, Loss:  1.153\n",
      "Epoch  14 Batch  238/538 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  1.182\n",
      "Epoch  14 Batch  239/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.165\n",
      "Epoch  14 Batch  240/538 - Train Accuracy:  0.984, Validation Accuracy:  0.974, Loss:  1.143\n",
      "Epoch  14 Batch  241/538 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  1.143\n",
      "Epoch  14 Batch  242/538 - Train Accuracy:  0.985, Validation Accuracy:  0.971, Loss:  1.182\n",
      "Epoch  14 Batch  243/538 - Train Accuracy:  0.980, Validation Accuracy:  0.970, Loss:  1.164\n",
      "Epoch  14 Batch  244/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.180\n",
      "Epoch  14 Batch  245/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.114\n",
      "Epoch  14 Batch  246/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.133\n",
      "Epoch  14 Batch  247/538 - Train Accuracy:  0.970, Validation Accuracy:  0.971, Loss:  1.161\n",
      "Epoch  14 Batch  248/538 - Train Accuracy:  0.975, Validation Accuracy:  0.971, Loss:  1.125\n",
      "Epoch  14 Batch  249/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.122\n",
      "Epoch  14 Batch  250/538 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  1.126\n",
      "Epoch  14 Batch  251/538 - Train Accuracy:  0.986, Validation Accuracy:  0.966, Loss:  1.143\n",
      "Epoch  14 Batch  252/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.137\n",
      "Epoch  14 Batch  253/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.129\n",
      "Epoch  14 Batch  254/538 - Train Accuracy:  0.965, Validation Accuracy:  0.969, Loss:  1.127\n",
      "Epoch  14 Batch  255/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.157\n",
      "Epoch  14 Batch  256/538 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  1.170\n",
      "Epoch  14 Batch  257/538 - Train Accuracy:  0.986, Validation Accuracy:  0.974, Loss:  1.108\n",
      "Epoch  14 Batch  258/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.159\n",
      "Epoch  14 Batch  259/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.153\n",
      "Epoch  14 Batch  260/538 - Train Accuracy:  0.957, Validation Accuracy:  0.968, Loss:  1.175\n",
      "Epoch  14 Batch  261/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.171\n",
      "Epoch  14 Batch  262/538 - Train Accuracy:  0.978, Validation Accuracy:  0.970, Loss:  1.176\n",
      "Epoch  14 Batch  263/538 - Train Accuracy:  0.977, Validation Accuracy:  0.972, Loss:  1.164\n",
      "Epoch  14 Batch  264/538 - Train Accuracy:  0.976, Validation Accuracy:  0.977, Loss:  1.114\n",
      "Epoch  14 Batch  265/538 - Train Accuracy:  0.966, Validation Accuracy:  0.968, Loss:  1.091\n",
      "Epoch  14 Batch  266/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.115\n",
      "Epoch  14 Batch  267/538 - Train Accuracy:  0.971, Validation Accuracy:  0.966, Loss:  1.150\n",
      "Epoch  14 Batch  268/538 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  1.151\n",
      "Epoch  14 Batch  269/538 - Train Accuracy:  0.976, Validation Accuracy:  0.964, Loss:  1.170\n",
      "Epoch  14 Batch  270/538 - Train Accuracy:  0.980, Validation Accuracy:  0.964, Loss:  1.145\n",
      "Epoch  14 Batch  271/538 - Train Accuracy:  0.974, Validation Accuracy:  0.966, Loss:  1.165\n",
      "Epoch  14 Batch  272/538 - Train Accuracy:  0.977, Validation Accuracy:  0.969, Loss:  1.173\n",
      "Epoch  14 Batch  273/538 - Train Accuracy:  0.976, Validation Accuracy:  0.969, Loss:  1.174\n",
      "Epoch  14 Batch  274/538 - Train Accuracy:  0.970, Validation Accuracy:  0.972, Loss:  1.106\n",
      "Epoch  14 Batch  275/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.169\n",
      "Epoch  14 Batch  276/538 - Train Accuracy:  0.978, Validation Accuracy:  0.974, Loss:  1.130\n",
      "Epoch  14 Batch  277/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.139\n",
      "Epoch  14 Batch  278/538 - Train Accuracy:  0.981, Validation Accuracy:  0.976, Loss:  1.126\n",
      "Epoch  14 Batch  279/538 - Train Accuracy:  0.987, Validation Accuracy:  0.974, Loss:  1.146\n",
      "Epoch  14 Batch  280/538 - Train Accuracy:  0.989, Validation Accuracy:  0.975, Loss:  1.174\n",
      "Epoch  14 Batch  281/538 - Train Accuracy:  0.976, Validation Accuracy:  0.970, Loss:  1.097\n",
      "Epoch  14 Batch  282/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.164\n",
      "Epoch  14 Batch  283/538 - Train Accuracy:  0.987, Validation Accuracy:  0.971, Loss:  1.152\n",
      "Epoch  14 Batch  284/538 - Train Accuracy:  0.975, Validation Accuracy:  0.974, Loss:  1.100\n",
      "Epoch  14 Batch  285/538 - Train Accuracy:  0.979, Validation Accuracy:  0.972, Loss:  1.154\n",
      "Epoch  14 Batch  286/538 - Train Accuracy:  0.975, Validation Accuracy:  0.972, Loss:  1.181\n",
      "Epoch  14 Batch  287/538 - Train Accuracy:  0.981, Validation Accuracy:  0.972, Loss:  1.173\n",
      "Epoch  14 Batch  288/538 - Train Accuracy:  0.979, Validation Accuracy:  0.977, Loss:  1.127\n",
      "Epoch  14 Batch  289/538 - Train Accuracy:  0.979, Validation Accuracy:  0.980, Loss:  1.127\n",
      "Epoch  14 Batch  290/538 - Train Accuracy:  0.985, Validation Accuracy:  0.980, Loss:  1.125\n",
      "Epoch  14 Batch  291/538 - Train Accuracy:  0.985, Validation Accuracy:  0.980, Loss:  1.120\n",
      "Epoch  14 Batch  292/538 - Train Accuracy:  0.987, Validation Accuracy:  0.981, Loss:  1.130\n",
      "Epoch  14 Batch  293/538 - Train Accuracy:  0.982, Validation Accuracy:  0.977, Loss:  1.128\n",
      "Epoch  14 Batch  294/538 - Train Accuracy:  0.983, Validation Accuracy:  0.980, Loss:  1.189\n",
      "Epoch  14 Batch  295/538 - Train Accuracy:  0.986, Validation Accuracy:  0.978, Loss:  1.129\n",
      "Epoch  14 Batch  296/538 - Train Accuracy:  0.977, Validation Accuracy:  0.978, Loss:  1.150\n",
      "Epoch  14 Batch  297/538 - Train Accuracy:  0.991, Validation Accuracy:  0.980, Loss:  1.128\n",
      "Epoch  14 Batch  298/538 - Train Accuracy:  0.978, Validation Accuracy:  0.976, Loss:  1.120\n",
      "Epoch  14 Batch  299/538 - Train Accuracy:  0.981, Validation Accuracy:  0.979, Loss:  1.112\n",
      "Epoch  14 Batch  300/538 - Train Accuracy:  0.984, Validation Accuracy:  0.979, Loss:  1.166\n",
      "Epoch  14 Batch  301/538 - Train Accuracy:  0.983, Validation Accuracy:  0.981, Loss:  1.147\n",
      "Epoch  14 Batch  302/538 - Train Accuracy:  0.990, Validation Accuracy:  0.981, Loss:  1.109\n",
      "Epoch  14 Batch  303/538 - Train Accuracy:  0.980, Validation Accuracy:  0.981, Loss:  1.168\n",
      "Epoch  14 Batch  304/538 - Train Accuracy:  0.984, Validation Accuracy:  0.979, Loss:  1.129\n",
      "Epoch  14 Batch  305/538 - Train Accuracy:  0.981, Validation Accuracy:  0.977, Loss:  1.113\n",
      "Epoch  14 Batch  306/538 - Train Accuracy:  0.986, Validation Accuracy:  0.979, Loss:  1.139\n",
      "Epoch  14 Batch  307/538 - Train Accuracy:  0.986, Validation Accuracy:  0.975, Loss:  1.122\n",
      "Epoch  14 Batch  308/538 - Train Accuracy:  0.988, Validation Accuracy:  0.977, Loss:  1.112\n",
      "Epoch  14 Batch  309/538 - Train Accuracy:  0.976, Validation Accuracy:  0.977, Loss:  1.160\n",
      "Epoch  14 Batch  310/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.124\n",
      "Epoch  14 Batch  311/538 - Train Accuracy:  0.977, Validation Accuracy:  0.976, Loss:  1.158\n",
      "Epoch  14 Batch  312/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.155\n",
      "Epoch  14 Batch  313/538 - Train Accuracy:  0.970, Validation Accuracy:  0.976, Loss:  1.105\n",
      "Epoch  14 Batch  314/538 - Train Accuracy:  0.985, Validation Accuracy:  0.976, Loss:  1.145\n",
      "Epoch  14 Batch  315/538 - Train Accuracy:  0.983, Validation Accuracy:  0.974, Loss:  1.242\n",
      "Epoch  14 Batch  316/538 - Train Accuracy:  0.977, Validation Accuracy:  0.974, Loss:  1.128\n",
      "Epoch  14 Batch  317/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.153\n",
      "Epoch  14 Batch  318/538 - Train Accuracy:  0.982, Validation Accuracy:  0.974, Loss:  1.098\n",
      "Epoch  14 Batch  319/538 - Train Accuracy:  0.978, Validation Accuracy:  0.975, Loss:  1.164\n",
      "Epoch  14 Batch  320/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.163\n",
      "Epoch  14 Batch  321/538 - Train Accuracy:  0.983, Validation Accuracy:  0.975, Loss:  1.098\n",
      "Epoch  14 Batch  322/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.092\n",
      "Epoch  14 Batch  323/538 - Train Accuracy:  0.985, Validation Accuracy:  0.977, Loss:  1.125\n",
      "Epoch  14 Batch  324/538 - Train Accuracy:  0.986, Validation Accuracy:  0.977, Loss:  1.122\n",
      "Epoch  14 Batch  325/538 - Train Accuracy:  0.989, Validation Accuracy:  0.973, Loss:  1.145\n",
      "Epoch  14 Batch  326/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.102\n",
      "Epoch  14 Batch  327/538 - Train Accuracy:  0.986, Validation Accuracy:  0.965, Loss:  1.149\n",
      "Epoch  14 Batch  328/538 - Train Accuracy:  0.987, Validation Accuracy:  0.966, Loss:  1.123\n",
      "Epoch  14 Batch  329/538 - Train Accuracy:  0.988, Validation Accuracy:  0.965, Loss:  1.106\n",
      "Epoch  14 Batch  330/538 - Train Accuracy:  0.985, Validation Accuracy:  0.965, Loss:  1.095\n",
      "Epoch  14 Batch  331/538 - Train Accuracy:  0.990, Validation Accuracy:  0.966, Loss:  1.170\n",
      "Epoch  14 Batch  332/538 - Train Accuracy:  0.984, Validation Accuracy:  0.971, Loss:  1.109\n",
      "Epoch  14 Batch  333/538 - Train Accuracy:  0.978, Validation Accuracy:  0.971, Loss:  1.148\n",
      "Epoch  14 Batch  334/538 - Train Accuracy:  0.984, Validation Accuracy:  0.972, Loss:  1.145\n",
      "Epoch  14 Batch  335/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.187\n",
      "Epoch  14 Batch  336/538 - Train Accuracy:  0.976, Validation Accuracy:  0.971, Loss:  1.120\n",
      "Epoch  14 Batch  337/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.099\n",
      "Epoch  14 Batch  338/538 - Train Accuracy:  0.985, Validation Accuracy:  0.973, Loss:  1.166\n",
      "Epoch  14 Batch  339/538 - Train Accuracy:  0.973, Validation Accuracy:  0.973, Loss:  1.139\n",
      "Epoch  14 Batch  340/538 - Train Accuracy:  0.982, Validation Accuracy:  0.973, Loss:  1.098\n",
      "Epoch  14 Batch  341/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.170\n",
      "Epoch  14 Batch  342/538 - Train Accuracy:  0.987, Validation Accuracy:  0.969, Loss:  1.153\n",
      "Epoch  14 Batch  343/538 - Train Accuracy:  0.986, Validation Accuracy:  0.969, Loss:  1.127\n",
      "Epoch  14 Batch  344/538 - Train Accuracy:  0.984, Validation Accuracy:  0.965, Loss:  1.143\n",
      "Epoch  14 Batch  345/538 - Train Accuracy:  0.985, Validation Accuracy:  0.963, Loss:  1.141\n",
      "Epoch  14 Batch  346/538 - Train Accuracy:  0.982, Validation Accuracy:  0.963, Loss:  1.164\n",
      "Epoch  14 Batch  347/538 - Train Accuracy:  0.984, Validation Accuracy:  0.963, Loss:  1.151\n",
      "Epoch  14 Batch  348/538 - Train Accuracy:  0.977, Validation Accuracy:  0.968, Loss:  1.164\n",
      "Epoch  14 Batch  349/538 - Train Accuracy:  0.986, Validation Accuracy:  0.970, Loss:  1.149\n",
      "Epoch  14 Batch  350/538 - Train Accuracy:  0.980, Validation Accuracy:  0.975, Loss:  1.140\n",
      "Epoch  14 Batch  351/538 - Train Accuracy:  0.973, Validation Accuracy:  0.976, Loss:  1.158\n",
      "Epoch  14 Batch  352/538 - Train Accuracy:  0.975, Validation Accuracy:  0.978, Loss:  1.171\n",
      "Epoch  14 Batch  353/538 - Train Accuracy:  0.973, Validation Accuracy:  0.980, Loss:  1.184\n",
      "Epoch  14 Batch  354/538 - Train Accuracy:  0.988, Validation Accuracy:  0.978, Loss:  1.147\n",
      "Epoch  14 Batch  355/538 - Train Accuracy:  0.988, Validation Accuracy:  0.978, Loss:  1.148\n",
      "Epoch  14 Batch  356/538 - Train Accuracy:  0.984, Validation Accuracy:  0.976, Loss:  1.175\n",
      "Epoch  14 Batch  357/538 - Train Accuracy:  0.979, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  14 Batch  358/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.142\n",
      "Epoch  14 Batch  359/538 - Train Accuracy:  0.987, Validation Accuracy:  0.976, Loss:  1.158\n",
      "Epoch  14 Batch  360/538 - Train Accuracy:  0.980, Validation Accuracy:  0.976, Loss:  1.109\n",
      "Epoch  14 Batch  361/538 - Train Accuracy:  0.975, Validation Accuracy:  0.975, Loss:  1.154\n",
      "Epoch  14 Batch  362/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.134\n",
      "Epoch  14 Batch  363/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.116\n",
      "Epoch  14 Batch  364/538 - Train Accuracy:  0.973, Validation Accuracy:  0.974, Loss:  1.188\n",
      "Epoch  14 Batch  365/538 - Train Accuracy:  0.966, Validation Accuracy:  0.974, Loss:  1.134\n",
      "Epoch  14 Batch  366/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.160\n",
      "Epoch  14 Batch  367/538 - Train Accuracy:  0.988, Validation Accuracy:  0.974, Loss:  1.091\n",
      "Epoch  14 Batch  368/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.119\n",
      "Epoch  14 Batch  369/538 - Train Accuracy:  0.981, Validation Accuracy:  0.974, Loss:  1.160\n",
      "Epoch  14 Batch  370/538 - Train Accuracy:  0.985, Validation Accuracy:  0.976, Loss:  1.142\n",
      "Epoch  14 Batch  371/538 - Train Accuracy:  0.992, Validation Accuracy:  0.979, Loss:  1.134\n",
      "Epoch  14 Batch  372/538 - Train Accuracy:  0.977, Validation Accuracy:  0.977, Loss:  1.160\n",
      "Epoch  14 Batch  373/538 - Train Accuracy:  0.971, Validation Accuracy:  0.977, Loss:  1.176\n",
      "Epoch  14 Batch  374/538 - Train Accuracy:  0.986, Validation Accuracy:  0.977, Loss:  1.120\n",
      "Epoch  14 Batch  375/538 - Train Accuracy:  0.991, Validation Accuracy:  0.976, Loss:  1.157\n",
      "Epoch  14 Batch  376/538 - Train Accuracy:  0.979, Validation Accuracy:  0.974, Loss:  1.106\n",
      "Epoch  14 Batch  377/538 - Train Accuracy:  0.976, Validation Accuracy:  0.972, Loss:  1.127\n",
      "Epoch  14 Batch  378/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.130\n",
      "Epoch  14 Batch  379/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.138\n",
      "Epoch  14 Batch  380/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.191\n",
      "Epoch  14 Batch  381/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.152\n",
      "Epoch  14 Batch  382/538 - Train Accuracy:  0.966, Validation Accuracy:  0.966, Loss:  1.139\n",
      "Epoch  14 Batch  383/538 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  1.105\n",
      "Epoch  14 Batch  384/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.133\n",
      "Epoch  14 Batch  385/538 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  1.147\n",
      "Epoch  14 Batch  386/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.119\n",
      "Epoch  14 Batch  387/538 - Train Accuracy:  0.989, Validation Accuracy:  0.964, Loss:  1.144\n",
      "Epoch  14 Batch  388/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.158\n",
      "Epoch  14 Batch  389/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.097\n",
      "Epoch  14 Batch  390/538 - Train Accuracy:  0.987, Validation Accuracy:  0.967, Loss:  1.138\n",
      "Epoch  14 Batch  391/538 - Train Accuracy:  0.974, Validation Accuracy:  0.964, Loss:  1.088\n",
      "Epoch  14 Batch  392/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.158\n",
      "Epoch  14 Batch  393/538 - Train Accuracy:  0.982, Validation Accuracy:  0.966, Loss:  1.135\n",
      "Epoch  14 Batch  394/538 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  1.137\n",
      "Epoch  14 Batch  395/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.158\n",
      "Epoch  14 Batch  396/538 - Train Accuracy:  0.983, Validation Accuracy:  0.969, Loss:  1.205\n",
      "Epoch  14 Batch  397/538 - Train Accuracy:  0.982, Validation Accuracy:  0.969, Loss:  1.114\n",
      "Epoch  14 Batch  398/538 - Train Accuracy:  0.985, Validation Accuracy:  0.969, Loss:  1.133\n",
      "Epoch  14 Batch  399/538 - Train Accuracy:  0.986, Validation Accuracy:  0.968, Loss:  1.133\n",
      "Epoch  14 Batch  400/538 - Train Accuracy:  0.980, Validation Accuracy:  0.969, Loss:  1.187\n",
      "Epoch  14 Batch  401/538 - Train Accuracy:  0.988, Validation Accuracy:  0.970, Loss:  1.147\n",
      "Epoch  14 Batch  402/538 - Train Accuracy:  0.991, Validation Accuracy:  0.972, Loss:  1.168\n",
      "Epoch  14 Batch  403/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.157\n",
      "Epoch  14 Batch  404/538 - Train Accuracy:  0.979, Validation Accuracy:  0.973, Loss:  1.093\n",
      "Epoch  14 Batch  405/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  14 Batch  406/538 - Train Accuracy:  0.981, Validation Accuracy:  0.975, Loss:  1.141\n",
      "Epoch  14 Batch  407/538 - Train Accuracy:  0.985, Validation Accuracy:  0.975, Loss:  1.128\n",
      "Epoch  14 Batch  408/538 - Train Accuracy:  0.971, Validation Accuracy:  0.975, Loss:  1.139\n",
      "Epoch  14 Batch  409/538 - Train Accuracy:  0.980, Validation Accuracy:  0.972, Loss:  1.130\n",
      "Epoch  14 Batch  410/538 - Train Accuracy:  0.990, Validation Accuracy:  0.973, Loss:  1.152\n",
      "Epoch  14 Batch  411/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.134\n",
      "Epoch  14 Batch  412/538 - Train Accuracy:  0.987, Validation Accuracy:  0.968, Loss:  1.078\n",
      "Epoch  14 Batch  413/538 - Train Accuracy:  0.989, Validation Accuracy:  0.965, Loss:  1.175\n",
      "Epoch  14 Batch  414/538 - Train Accuracy:  0.970, Validation Accuracy:  0.964, Loss:  1.122\n",
      "Epoch  14 Batch  415/538 - Train Accuracy:  0.964, Validation Accuracy:  0.964, Loss:  1.181\n",
      "Epoch  14 Batch  416/538 - Train Accuracy:  0.988, Validation Accuracy:  0.967, Loss:  1.143\n",
      "Epoch  14 Batch  417/538 - Train Accuracy:  0.983, Validation Accuracy:  0.966, Loss:  1.175\n",
      "Epoch  14 Batch  418/538 - Train Accuracy:  0.983, Validation Accuracy:  0.967, Loss:  1.178\n",
      "Epoch  14 Batch  419/538 - Train Accuracy:  0.986, Validation Accuracy:  0.969, Loss:  1.148\n",
      "Epoch  14 Batch  420/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.118\n",
      "Epoch  14 Batch  421/538 - Train Accuracy:  0.988, Validation Accuracy:  0.969, Loss:  1.146\n",
      "Epoch  14 Batch  422/538 - Train Accuracy:  0.988, Validation Accuracy:  0.972, Loss:  1.127\n",
      "Epoch  14 Batch  423/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.153\n",
      "Epoch  14 Batch  424/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.196\n",
      "Epoch  14 Batch  425/538 - Train Accuracy:  0.977, Validation Accuracy:  0.971, Loss:  1.154\n",
      "Epoch  14 Batch  426/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.140\n",
      "Epoch  14 Batch  427/538 - Train Accuracy:  0.971, Validation Accuracy:  0.971, Loss:  1.152\n",
      "Epoch  14 Batch  428/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.125\n",
      "Epoch  14 Batch  429/538 - Train Accuracy:  0.985, Validation Accuracy:  0.970, Loss:  1.133\n",
      "Epoch  14 Batch  430/538 - Train Accuracy:  0.983, Validation Accuracy:  0.970, Loss:  1.104\n",
      "Epoch  14 Batch  431/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.153\n",
      "Epoch  14 Batch  432/538 - Train Accuracy:  0.976, Validation Accuracy:  0.967, Loss:  1.112\n",
      "Epoch  14 Batch  433/538 - Train Accuracy:  0.963, Validation Accuracy:  0.969, Loss:  1.166\n",
      "Epoch  14 Batch  434/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.189\n",
      "Epoch  14 Batch  435/538 - Train Accuracy:  0.979, Validation Accuracy:  0.965, Loss:  1.129\n",
      "Epoch  14 Batch  436/538 - Train Accuracy:  0.967, Validation Accuracy:  0.967, Loss:  1.120\n",
      "Epoch  14 Batch  437/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.146\n",
      "Epoch  14 Batch  438/538 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  1.104\n",
      "Epoch  14 Batch  439/538 - Train Accuracy:  0.990, Validation Accuracy:  0.967, Loss:  1.146\n",
      "Epoch  14 Batch  440/538 - Train Accuracy:  0.988, Validation Accuracy:  0.967, Loss:  1.158\n",
      "Epoch  14 Batch  441/538 - Train Accuracy:  0.974, Validation Accuracy:  0.967, Loss:  1.143\n",
      "Epoch  14 Batch  442/538 - Train Accuracy:  0.975, Validation Accuracy:  0.967, Loss:  1.066\n",
      "Epoch  14 Batch  443/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.101\n",
      "Epoch  14 Batch  444/538 - Train Accuracy:  0.980, Validation Accuracy:  0.963, Loss:  1.144\n",
      "Epoch  14 Batch  445/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.114\n",
      "Epoch  14 Batch  446/538 - Train Accuracy:  0.979, Validation Accuracy:  0.963, Loss:  1.107\n",
      "Epoch  14 Batch  447/538 - Train Accuracy:  0.985, Validation Accuracy:  0.964, Loss:  1.113\n",
      "Epoch  14 Batch  448/538 - Train Accuracy:  0.981, Validation Accuracy:  0.966, Loss:  1.113\n",
      "Epoch  14 Batch  449/538 - Train Accuracy:  0.988, Validation Accuracy:  0.969, Loss:  1.185\n",
      "Epoch  14 Batch  450/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.111\n",
      "Epoch  14 Batch  451/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.096\n",
      "Epoch  14 Batch  452/538 - Train Accuracy:  0.978, Validation Accuracy:  0.965, Loss:  1.122\n",
      "Epoch  14 Batch  453/538 - Train Accuracy:  0.980, Validation Accuracy:  0.961, Loss:  1.173\n",
      "Epoch  14 Batch  454/538 - Train Accuracy:  0.978, Validation Accuracy:  0.957, Loss:  1.140\n",
      "Epoch  14 Batch  455/538 - Train Accuracy:  0.972, Validation Accuracy:  0.956, Loss:  1.150\n",
      "Epoch  14 Batch  456/538 - Train Accuracy:  0.970, Validation Accuracy:  0.958, Loss:  1.163\n",
      "Epoch  14 Batch  457/538 - Train Accuracy:  0.979, Validation Accuracy:  0.960, Loss:  1.138\n",
      "Epoch  14 Batch  458/538 - Train Accuracy:  0.987, Validation Accuracy:  0.963, Loss:  1.161\n",
      "Epoch  14 Batch  459/538 - Train Accuracy:  0.990, Validation Accuracy:  0.968, Loss:  1.107\n",
      "Epoch  14 Batch  460/538 - Train Accuracy:  0.982, Validation Accuracy:  0.970, Loss:  1.132\n",
      "Epoch  14 Batch  461/538 - Train Accuracy:  0.981, Validation Accuracy:  0.971, Loss:  1.152\n",
      "Epoch  14 Batch  462/538 - Train Accuracy:  0.972, Validation Accuracy:  0.968, Loss:  1.171\n",
      "Epoch  14 Batch  463/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.165\n",
      "Epoch  14 Batch  464/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.143\n",
      "Epoch  14 Batch  465/538 - Train Accuracy:  0.976, Validation Accuracy:  0.968, Loss:  1.150\n",
      "Epoch  14 Batch  466/538 - Train Accuracy:  0.972, Validation Accuracy:  0.972, Loss:  1.217\n",
      "Epoch  14 Batch  467/538 - Train Accuracy:  0.985, Validation Accuracy:  0.974, Loss:  1.138\n",
      "Epoch  14 Batch  468/538 - Train Accuracy:  0.986, Validation Accuracy:  0.974, Loss:  1.161\n",
      "Epoch  14 Batch  469/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.151\n",
      "Epoch  14 Batch  470/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.134\n",
      "Epoch  14 Batch  471/538 - Train Accuracy:  0.988, Validation Accuracy:  0.969, Loss:  1.105\n",
      "Epoch  14 Batch  472/538 - Train Accuracy:  0.994, Validation Accuracy:  0.970, Loss:  1.109\n",
      "Epoch  14 Batch  473/538 - Train Accuracy:  0.989, Validation Accuracy:  0.968, Loss:  1.143\n",
      "Epoch  14 Batch  474/538 - Train Accuracy:  0.984, Validation Accuracy:  0.968, Loss:  1.156\n",
      "Epoch  14 Batch  475/538 - Train Accuracy:  0.990, Validation Accuracy:  0.967, Loss:  1.164\n",
      "Epoch  14 Batch  476/538 - Train Accuracy:  0.982, Validation Accuracy:  0.967, Loss:  1.160\n",
      "Epoch  14 Batch  477/538 - Train Accuracy:  0.982, Validation Accuracy:  0.968, Loss:  1.165\n",
      "Epoch  14 Batch  478/538 - Train Accuracy:  0.990, Validation Accuracy:  0.968, Loss:  1.131\n",
      "Epoch  14 Batch  479/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.166\n",
      "Epoch  14 Batch  480/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.158\n",
      "Epoch  14 Batch  481/538 - Train Accuracy:  0.988, Validation Accuracy:  0.968, Loss:  1.122\n",
      "Epoch  14 Batch  482/538 - Train Accuracy:  0.985, Validation Accuracy:  0.967, Loss:  1.086\n",
      "Epoch  14 Batch  483/538 - Train Accuracy:  0.970, Validation Accuracy:  0.967, Loss:  1.121\n",
      "Epoch  14 Batch  484/538 - Train Accuracy:  0.966, Validation Accuracy:  0.967, Loss:  1.166\n",
      "Epoch  14 Batch  485/538 - Train Accuracy:  0.980, Validation Accuracy:  0.966, Loss:  1.121\n",
      "Epoch  14 Batch  486/538 - Train Accuracy:  0.991, Validation Accuracy:  0.966, Loss:  1.149\n",
      "Epoch  14 Batch  487/538 - Train Accuracy:  0.987, Validation Accuracy:  0.966, Loss:  1.121\n",
      "Epoch  14 Batch  488/538 - Train Accuracy:  0.986, Validation Accuracy:  0.966, Loss:  1.118\n",
      "Epoch  14 Batch  489/538 - Train Accuracy:  0.981, Validation Accuracy:  0.965, Loss:  1.132\n",
      "Epoch  14 Batch  490/538 - Train Accuracy:  0.978, Validation Accuracy:  0.966, Loss:  1.158\n",
      "Epoch  14 Batch  491/538 - Train Accuracy:  0.975, Validation Accuracy:  0.966, Loss:  1.106\n",
      "Epoch  14 Batch  492/538 - Train Accuracy:  0.979, Validation Accuracy:  0.968, Loss:  1.067\n",
      "Epoch  14 Batch  493/538 - Train Accuracy:  0.978, Validation Accuracy:  0.972, Loss:  1.127\n",
      "Epoch  14 Batch  494/538 - Train Accuracy:  0.983, Validation Accuracy:  0.972, Loss:  1.165\n",
      "Epoch  14 Batch  495/538 - Train Accuracy:  0.988, Validation Accuracy:  0.972, Loss:  1.126\n",
      "Epoch  14 Batch  496/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.172\n",
      "Epoch  14 Batch  497/538 - Train Accuracy:  0.979, Validation Accuracy:  0.969, Loss:  1.141\n",
      "Epoch  14 Batch  498/538 - Train Accuracy:  0.986, Validation Accuracy:  0.968, Loss:  1.133\n",
      "Epoch  14 Batch  499/538 - Train Accuracy:  0.976, Validation Accuracy:  0.965, Loss:  1.154\n",
      "Epoch  14 Batch  500/538 - Train Accuracy:  0.986, Validation Accuracy:  0.963, Loss:  1.146\n",
      "Epoch  14 Batch  501/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.149\n",
      "Epoch  14 Batch  502/538 - Train Accuracy:  0.982, Validation Accuracy:  0.964, Loss:  1.075\n",
      "Epoch  14 Batch  503/538 - Train Accuracy:  0.977, Validation Accuracy:  0.967, Loss:  1.146\n",
      "Epoch  14 Batch  504/538 - Train Accuracy:  0.987, Validation Accuracy:  0.967, Loss:  1.121\n",
      "Epoch  14 Batch  505/538 - Train Accuracy:  0.980, Validation Accuracy:  0.967, Loss:  1.165\n",
      "Epoch  14 Batch  506/538 - Train Accuracy:  0.986, Validation Accuracy:  0.972, Loss:  1.184\n",
      "Epoch  14 Batch  507/538 - Train Accuracy:  0.987, Validation Accuracy:  0.972, Loss:  1.135\n",
      "Epoch  14 Batch  508/538 - Train Accuracy:  0.982, Validation Accuracy:  0.971, Loss:  1.160\n",
      "Epoch  14 Batch  509/538 - Train Accuracy:  0.986, Validation Accuracy:  0.971, Loss:  1.146\n",
      "Epoch  14 Batch  510/538 - Train Accuracy:  0.979, Validation Accuracy:  0.971, Loss:  1.158\n",
      "Epoch  14 Batch  511/538 - Train Accuracy:  0.981, Validation Accuracy:  0.970, Loss:  1.151\n",
      "Epoch  14 Batch  512/538 - Train Accuracy:  0.985, Validation Accuracy:  0.972, Loss:  1.106\n",
      "Epoch  14 Batch  513/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.176\n",
      "Epoch  14 Batch  514/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.118\n",
      "Epoch  14 Batch  515/538 - Train Accuracy:  0.973, Validation Accuracy:  0.968, Loss:  1.128\n",
      "Epoch  14 Batch  516/538 - Train Accuracy:  0.985, Validation Accuracy:  0.968, Loss:  1.145\n",
      "Epoch  14 Batch  517/538 - Train Accuracy:  0.978, Validation Accuracy:  0.968, Loss:  1.118\n",
      "Epoch  14 Batch  518/538 - Train Accuracy:  0.983, Validation Accuracy:  0.968, Loss:  1.162\n",
      "Epoch  14 Batch  519/538 - Train Accuracy:  0.977, Validation Accuracy:  0.966, Loss:  1.119\n",
      "Epoch  14 Batch  520/538 - Train Accuracy:  0.980, Validation Accuracy:  0.965, Loss:  1.144\n",
      "Epoch  14 Batch  521/538 - Train Accuracy:  0.985, Validation Accuracy:  0.965, Loss:  1.152\n",
      "Epoch  14 Batch  522/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.132\n",
      "Epoch  14 Batch  523/538 - Train Accuracy:  0.984, Validation Accuracy:  0.969, Loss:  1.156\n",
      "Epoch  14 Batch  524/538 - Train Accuracy:  0.984, Validation Accuracy:  0.967, Loss:  1.155\n",
      "Epoch  14 Batch  525/538 - Train Accuracy:  0.981, Validation Accuracy:  0.969, Loss:  1.208\n",
      "Epoch  14 Batch  526/538 - Train Accuracy:  0.973, Validation Accuracy:  0.970, Loss:  1.174\n",
      "Epoch  14 Batch  527/538 - Train Accuracy:  0.990, Validation Accuracy:  0.970, Loss:  1.141\n",
      "Epoch  14 Batch  528/538 - Train Accuracy:  0.986, Validation Accuracy:  0.969, Loss:  1.178\n",
      "Epoch  14 Batch  529/538 - Train Accuracy:  0.983, Validation Accuracy:  0.971, Loss:  1.139\n",
      "Epoch  14 Batch  530/538 - Train Accuracy:  0.984, Validation Accuracy:  0.975, Loss:  1.157\n",
      "Epoch  14 Batch  531/538 - Train Accuracy:  0.982, Validation Accuracy:  0.975, Loss:  1.152\n",
      "Epoch  14 Batch  532/538 - Train Accuracy:  0.977, Validation Accuracy:  0.975, Loss:  1.160\n",
      "Epoch  14 Batch  533/538 - Train Accuracy:  0.980, Validation Accuracy:  0.976, Loss:  1.112\n",
      "Epoch  14 Batch  534/538 - Train Accuracy:  0.981, Validation Accuracy:  0.973, Loss:  1.166\n",
      "Epoch  14 Batch  535/538 - Train Accuracy:  0.980, Validation Accuracy:  0.973, Loss:  1.119\n",
      "Epoch  14 Batch  536/538 - Train Accuracy:  0.980, Validation Accuracy:  0.971, Loss:  1.183\n",
      "Model Trained and Saved\n"
     ]
    }
   ],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "import time\n",
    "\n",
    "def get_accuracy(target, logits):\n",
    "    \"\"\"\n",
    "    Calculate accuracy\n",
    "    \"\"\"\n",
    "    max_seq = max(target.shape[1], logits.shape[1])\n",
    "    if max_seq - target.shape[1]:\n",
    "        target = np.pad(\n",
    "            target,\n",
    "            [(0,0),(0,max_seq - target.shape[1])],\n",
    "            'constant')\n",
    "    if max_seq - logits.shape[1]:\n",
    "        logits = np.pad(\n",
    "            logits,\n",
    "            [(0,0),(0,max_seq - logits.shape[1]), (0,0)],\n",
    "            'constant')\n",
    "\n",
    "    return np.mean(np.equal(target, np.argmax(logits, 2)))\n",
    "\n",
    "train_source = source_int_text[batch_size:]\n",
    "train_target = target_int_text[batch_size:]\n",
    "\n",
    "valid_source = helper.pad_sentence_batch(source_int_text[:batch_size])\n",
    "valid_target = helper.pad_sentence_batch(target_int_text[:batch_size])\n",
    "\n",
    "with tf.Session(graph=train_graph) as sess:\n",
    "    sess.run(tf.global_variables_initializer())\n",
    "\n",
    "    for epoch_i in range(epochs):\n",
    "        for batch_i, (source_batch, target_batch) in enumerate(\n",
    "                helper.batch_data(train_source, train_target, batch_size)):\n",
    "            start_time = time.time()\n",
    "            \n",
    "            _, loss = sess.run(\n",
    "                [train_op, cost],\n",
    "                {input_data: source_batch,\n",
    "                 targets: target_batch,\n",
    "                 lr: learning_rate,\n",
    "                 sequence_length: target_batch.shape[1],\n",
    "                 keep_prob: keep_probability})\n",
    "            \n",
    "            batch_train_logits = sess.run(\n",
    "                inference_logits,\n",
    "                {input_data: source_batch, keep_prob: 1.0})\n",
    "            batch_valid_logits = sess.run(\n",
    "                inference_logits,\n",
    "                {input_data: valid_source, keep_prob: 1.0})\n",
    "                \n",
    "            train_acc = get_accuracy(target_batch, batch_train_logits)\n",
    "            valid_acc = get_accuracy(np.array(valid_target), batch_valid_logits)\n",
    "            end_time = time.time()\n",
    "            print('Epoch {:>3} Batch {:>4}/{} - Train Accuracy: {:>6.3f}, Validation Accuracy: {:>6.3f}, Loss: {:>6.3f}'\n",
    "                  .format(epoch_i, batch_i, len(source_int_text) // batch_size, train_acc, valid_acc, loss))\n",
    "\n",
    "    # Save Model\n",
    "    saver = tf.train.Saver()\n",
    "    saver.save(sess, save_path)\n",
    "    print('Model Trained and Saved')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "### Save Parameters\n",
    "Save the `batch_size` and `save_path` parameters for inference."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "# Save parameters for checkpoint\n",
    "helper.save_params(save_path)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "# Checkpoint"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "import tensorflow as tf\n",
    "import numpy as np\n",
    "import helper\n",
    "import problem_unittests as tests\n",
    "\n",
    "_, (source_vocab_to_int, target_vocab_to_int), (source_int_to_vocab, target_int_to_vocab) = helper.load_preprocess()\n",
    "load_path = helper.load_params()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "## Sentence to Sequence\n",
    "To feed a sentence into the model for translation, you first need to preprocess it.  Implement the function `sentence_to_seq()` to preprocess new sentences.\n",
    "\n",
    "- Convert the sentence to lowercase\n",
    "- Convert words into ids using `vocab_to_int`\n",
    " - Convert words not in the vocabulary, to the `<UNK>` word id."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Tests Passed\n"
     ]
    }
   ],
   "source": [
    "def sentence_to_seq(sentence, vocab_to_int):\n",
    "    \"\"\"\n",
    "    Convert a sentence to a sequence of ids\n",
    "    :param sentence: String\n",
    "    :param vocab_to_int: Dictionary to go from the words to an id\n",
    "    :return: List of word ids\n",
    "    \"\"\"\n",
    "    # TODO: Implement Function\n",
    "    seq = [vocab_to_int.get(word, vocab_to_int['<UNK>']) for word in sentence.lower().split()]\n",
    "    return seq\n",
    "\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "tests.test_sentence_to_seq(sentence_to_seq)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "## Translate\n",
    "This will translate `translate_sentence` from English to French."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false,
    "deletable": true,
    "editable": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Input\n",
      "  Word Ids:      [75, 199, 100, 189, 6, 202, 46]\n",
      "  English Words: ['he', 'saw', 'a', 'old', 'yellow', 'truck', '.']\n",
      "\n",
      "Prediction\n",
      "  Word Ids:      [253, 138, 111, 275, 167, 201, 240, 295, 1]\n",
      "  French Words: ['il', 'a', 'vu', 'un', 'vieux', 'camion', 'jaune', '.', '<EOS>']\n"
     ]
    }
   ],
   "source": [
    "translate_sentence = 'he saw a old yellow truck .'\n",
    "\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL\n",
    "\"\"\"\n",
    "translate_sentence = sentence_to_seq(translate_sentence, source_vocab_to_int)\n",
    "\n",
    "loaded_graph = tf.Graph()\n",
    "with tf.Session(graph=loaded_graph) as sess:\n",
    "    # Load saved model\n",
    "    loader = tf.train.import_meta_graph(load_path + '.meta')\n",
    "    loader.restore(sess, load_path)\n",
    "\n",
    "    input_data = loaded_graph.get_tensor_by_name('input:0')\n",
    "    logits = loaded_graph.get_tensor_by_name('logits:0')\n",
    "    keep_prob = loaded_graph.get_tensor_by_name('keep_prob:0')\n",
    "\n",
    "    translate_logits = sess.run(logits, {input_data: [translate_sentence], keep_prob: 1.0})[0]\n",
    "\n",
    "print('Input')\n",
    "print('  Word Ids:      {}'.format([i for i in translate_sentence]))\n",
    "print('  English Words: {}'.format([source_int_to_vocab[i] for i in translate_sentence]))\n",
    "\n",
    "print('\\nPrediction')\n",
    "print('  Word Ids:      {}'.format([i for i in np.argmax(translate_logits, 1)]))\n",
    "print('  French Words: {}'.format([target_int_to_vocab[i] for i in np.argmax(translate_logits, 1)]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "deletable": true,
    "editable": true
   },
   "source": [
    "## Imperfect Translation\n",
    "You might notice that some sentences translate better than others.  Since the dataset you're using only has a vocabulary of 227 English words of the thousands that you use, you're only going to see good results using these words.  For this project, you don't need a perfect translation. However, if you want to create a better translation model, you'll need better data.\n",
    "\n",
    "You can train on the [WMT10 French-English corpus](http://www.statmt.org/wmt10/training-giga-fren.tar).  This dataset has more vocabulary and richer in topics discussed.  However, this will take you days to train, so make sure you've a GPU and the neural network is performing well on dataset we provided.  Just make sure you play with the WMT10 corpus after you've submitted this project.\n",
    "## Submitting This Project\n",
    "When submitting this project, make sure to run all the cells before saving the notebook. Save the notebook file as \"dlnd_language_translation.ipynb\" and save it as a HTML file under \"File\" -> \"Download as\". Include the \"helper.py\" and \"problem_unittests.py\" files in your submission."
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}