SpaceX_Machine Learning Prediction_Part_5.ipynb

{
    "cells": [
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "<center>\n    <img src=\"https://gitlab.com/ibm/skills-network/courses/placeholder101/-/raw/master/labs/module%201/images/IDSNlogo.png\" width=\"300\" alt=\"cognitiveclass.ai logo\"  />\n</center>\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "# **Space X  Falcon 9 First Stage Landing Prediction**\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## Assignment:  Machine Learning Prediction\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Estimated time needed: **60** minutes\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Space X advertises Falcon 9 rocket launches on its website with a cost of 62 million dollars; other providers cost upward of 165 million dollars each, much of the savings is because Space X can reuse the first stage. Therefore if we can determine if the first stage will land, we can determine the cost of a launch. This information can be used if an alternate company wants to bid against space X for a rocket launch.   In this lab, you will create a machine learning pipeline  to predict if the first stage will land given the data from the preceding labs.\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/landing\\_1.gif)\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Several examples of an unsuccessful landing are shown here:\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/crash.gif)\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Most unsuccessful landings are planed. Space X; performs a controlled landing in the oceans.\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## Objectives\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Perform exploratory  Data Analysis and determine Training Labels\n\n*   create a column for the class\n*   Standardize the data\n*   Split into training data and test data\n\n\\-Find best Hyperparameter for SVM, Classification Trees and Logistic Regression\n\n*   Find the method performs best using test data\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": ""
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "***\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## Import Libraries and Define Auxiliary Functions\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "We will import the following libraries for the lab\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "# Pandas is a software library written for the Python programming language for data manipulation and analysis.\nimport pandas as pd\n# NumPy is a library for the Python programming language, adding support for large, multi-dimensional arrays and matrices, along with a large collection of high-level mathematical functions to operate on these arrays\nimport numpy as np\n# Matplotlib is a plotting library for python and pyplot gives us a MatLab like plotting framework. We will use this in our plotter function to plot data.\nimport matplotlib.pyplot as plt\n#Seaborn is a Python data visualization library based on matplotlib. It provides a high-level interface for drawing attractive and informative statistical graphics\nimport seaborn as sns\n# Preprocessing allows us to standarsize our data\nfrom sklearn import preprocessing\n# Allows us to split our data into training and testing data\nfrom sklearn.model_selection import train_test_split\n# Allows us to test parameters of classification algorithms and find the best one\nfrom sklearn.model_selection import GridSearchCV\n# Logistic Regression classification algorithm\nfrom sklearn.linear_model import LogisticRegression\n# Support Vector Machine classification algorithm\nfrom sklearn.svm import SVC\n# Decision Tree classification algorithm\nfrom sklearn.tree import DecisionTreeClassifier\n# K Nearest Neighbors classification algorithm\nfrom sklearn.neighbors import KNeighborsClassifier",
            "execution_count": 35,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "This function is to plot the confusion matrix.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "def plot_confusion_matrix(y,y_predict):\n    \"this function plots the confusion matrix\"\n    from sklearn.metrics import confusion_matrix\n\n    cm = confusion_matrix(y, y_predict)\n    ax= plt.subplot()\n    sns.heatmap(cm, annot=True, ax = ax); #annot=True to annotate cells\n    ax.set_xlabel('Predicted labels')\n    ax.set_ylabel('True labels')\n    ax.set_title('Confusion Matrix'); \n    ax.xaxis.set_ticklabels(['did not land', 'land']); ax.yaxis.set_ticklabels(['did not land', 'landed'])",
            "execution_count": 2,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## Load the dataframe\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Load the data\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "data = pd.read_csv(\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_2.csv\")\n\n# If you were unable to complete the previous lab correctly you can uncomment and load this csv\n\n# data = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/dataset_part_2.csv')\n\ndata.head()",
            "execution_count": 3,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 3,
                    "data": {
                        "text/plain": "   FlightNumber        Date BoosterVersion  PayloadMass Orbit    LaunchSite  \\\n0             1  2010-06-04       Falcon 9  6104.959412   LEO  CCAFS SLC 40   \n1             2  2012-05-22       Falcon 9   525.000000   LEO  CCAFS SLC 40   \n2             3  2013-03-01       Falcon 9   677.000000   ISS  CCAFS SLC 40   \n3             4  2013-09-29       Falcon 9   500.000000    PO   VAFB SLC 4E   \n4             5  2013-12-03       Falcon 9  3170.000000   GTO  CCAFS SLC 40   \n\n       Outcome  Flights  GridFins  Reused   Legs LandingPad  Block  \\\n0    None None        1     False   False  False        NaN    1.0   \n1    None None        1     False   False  False        NaN    1.0   \n2    None None        1     False   False  False        NaN    1.0   \n3  False Ocean        1     False   False  False        NaN    1.0   \n4    None None        1     False   False  False        NaN    1.0   \n\n   ReusedCount Serial   Longitude   Latitude  Class  \n0            0  B0003  -80.577366  28.561857      0  \n1            0  B0005  -80.577366  28.561857      0  \n2            0  B0007  -80.577366  28.561857      0  \n3            0  B1003 -120.610829  34.632093      0  \n4            0  B1004  -80.577366  28.561857      0  ",
                        "text/html": "<div>\n<style scoped>\n    .dataframe tbody tr th:only-of-type {\n        vertical-align: middle;\n    }\n\n    .dataframe tbody tr th {\n        vertical-align: top;\n    }\n\n    .dataframe thead th {\n        text-align: right;\n    }\n</style>\n<table border=\"1\" class=\"dataframe\">\n  <thead>\n    <tr style=\"text-align: right;\">\n      <th></th>\n      <th>FlightNumber</th>\n      <th>Date</th>\n      <th>BoosterVersion</th>\n      <th>PayloadMass</th>\n      <th>Orbit</th>\n      <th>LaunchSite</th>\n      <th>Outcome</th>\n      <th>Flights</th>\n      <th>GridFins</th>\n      <th>Reused</th>\n      <th>Legs</th>\n      <th>LandingPad</th>\n      <th>Block</th>\n      <th>ReusedCount</th>\n      <th>Serial</th>\n      <th>Longitude</th>\n      <th>Latitude</th>\n      <th>Class</th>\n    </tr>\n  </thead>\n  <tbody>\n    <tr>\n      <th>0</th>\n      <td>1</td>\n      <td>2010-06-04</td>\n      <td>Falcon 9</td>\n      <td>6104.959412</td>\n      <td>LEO</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B0003</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>1</th>\n      <td>2</td>\n      <td>2012-05-22</td>\n      <td>Falcon 9</td>\n      <td>525.000000</td>\n      <td>LEO</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B0005</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>2</th>\n      <td>3</td>\n      <td>2013-03-01</td>\n      <td>Falcon 9</td>\n      <td>677.000000</td>\n      <td>ISS</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B0007</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>3</th>\n      <td>4</td>\n      <td>2013-09-29</td>\n      <td>Falcon 9</td>\n      <td>500.000000</td>\n      <td>PO</td>\n      <td>VAFB SLC 4E</td>\n      <td>False Ocean</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B1003</td>\n      <td>-120.610829</td>\n      <td>34.632093</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>4</th>\n      <td>5</td>\n      <td>2013-12-03</td>\n      <td>Falcon 9</td>\n      <td>3170.000000</td>\n      <td>GTO</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B1004</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n  </tbody>\n</table>\n</div>"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "X = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_3.csv')\n\n# If you were unable to complete the previous lab correctly you can uncomment and load this csv\n\n# X = pd.read_csv('https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/dataset_part_3.csv')\n\nX.head(100)",
            "execution_count": 107,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 107,
                    "data": {
                        "text/plain": "    FlightNumber   PayloadMass  Flights  Block  ReusedCount  Orbit_ES-L1  \\\n0            1.0   6104.959412      1.0    1.0          0.0          0.0   \n1            2.0    525.000000      1.0    1.0          0.0          0.0   \n2            3.0    677.000000      1.0    1.0          0.0          0.0   \n3            4.0    500.000000      1.0    1.0          0.0          0.0   \n4            5.0   3170.000000      1.0    1.0          0.0          0.0   \n..           ...           ...      ...    ...          ...          ...   \n85          86.0  15400.000000      2.0    5.0          2.0          0.0   \n86          87.0  15400.000000      3.0    5.0          2.0          0.0   \n87          88.0  15400.000000      6.0    5.0          5.0          0.0   \n88          89.0  15400.000000      3.0    5.0          2.0          0.0   \n89          90.0   3681.000000      1.0    5.0          0.0          0.0   \n\n    Orbit_GEO  Orbit_GTO  Orbit_HEO  Orbit_ISS  ...  Serial_B1058  \\\n0         0.0        0.0        0.0        0.0  ...           0.0   \n1         0.0        0.0        0.0        0.0  ...           0.0   \n2         0.0        0.0        0.0        1.0  ...           0.0   \n3         0.0        0.0        0.0        0.0  ...           0.0   \n4         0.0        1.0        0.0        0.0  ...           0.0   \n..        ...        ...        ...        ...  ...           ...   \n85        0.0        0.0        0.0        0.0  ...           0.0   \n86        0.0        0.0        0.0        0.0  ...           1.0   \n87        0.0        0.0        0.0        0.0  ...           0.0   \n88        0.0        0.0        0.0        0.0  ...           0.0   \n89        0.0        0.0        0.0        0.0  ...           0.0   \n\n    Serial_B1059  Serial_B1060  Serial_B1062  GridFins_False  GridFins_True  \\\n0            0.0           0.0           0.0             1.0            0.0   \n1            0.0           0.0           0.0             1.0            0.0   \n2            0.0           0.0           0.0             1.0            0.0   \n3            0.0           0.0           0.0             1.0            0.0   \n4            0.0           0.0           0.0             1.0            0.0   \n..           ...           ...           ...             ...            ...   \n85           0.0           1.0           0.0             0.0            1.0   \n86           0.0           0.0           0.0             0.0            1.0   \n87           0.0           0.0           0.0             0.0            1.0   \n88           0.0           1.0           0.0             0.0            1.0   \n89           0.0           0.0           1.0             0.0            1.0   \n\n    Reused_False  Reused_True  Legs_False  Legs_True  \n0            1.0          0.0         1.0        0.0  \n1            1.0          0.0         1.0        0.0  \n2            1.0          0.0         1.0        0.0  \n3            1.0          0.0         1.0        0.0  \n4            1.0          0.0         1.0        0.0  \n..           ...          ...         ...        ...  \n85           0.0          1.0         0.0        1.0  \n86           0.0          1.0         0.0        1.0  \n87           0.0          1.0         0.0        1.0  \n88           0.0          1.0         0.0        1.0  \n89           1.0          0.0         0.0        1.0  \n\n[90 rows x 83 columns]",
                        "text/html": "<div>\n<style scoped>\n    .dataframe tbody tr th:only-of-type {\n        vertical-align: middle;\n    }\n\n    .dataframe tbody tr th {\n        vertical-align: top;\n    }\n\n    .dataframe thead th {\n        text-align: right;\n    }\n</style>\n<table border=\"1\" class=\"dataframe\">\n  <thead>\n    <tr style=\"text-align: right;\">\n      <th></th>\n      <th>FlightNumber</th>\n      <th>PayloadMass</th>\n      <th>Flights</th>\n      <th>Block</th>\n      <th>ReusedCount</th>\n      <th>Orbit_ES-L1</th>\n      <th>Orbit_GEO</th>\n      <th>Orbit_GTO</th>\n      <th>Orbit_HEO</th>\n      <th>Orbit_ISS</th>\n      <th>...</th>\n      <th>Serial_B1058</th>\n      <th>Serial_B1059</th>\n      <th>Serial_B1060</th>\n      <th>Serial_B1062</th>\n      <th>GridFins_False</th>\n      <th>GridFins_True</th>\n      <th>Reused_False</th>\n      <th>Reused_True</th>\n      <th>Legs_False</th>\n      <th>Legs_True</th>\n    </tr>\n  </thead>\n  <tbody>\n    <tr>\n      <th>0</th>\n      <td>1.0</td>\n      <td>6104.959412</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>1</th>\n      <td>2.0</td>\n      <td>525.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>2</th>\n      <td>3.0</td>\n      <td>677.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>3</th>\n      <td>4.0</td>\n      <td>500.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>4</th>\n      <td>5.0</td>\n      <td>3170.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>...</th>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n    </tr>\n    <tr>\n      <th>85</th>\n      <td>86.0</td>\n      <td>15400.000000</td>\n      <td>2.0</td>\n      <td>5.0</td>\n      <td>2.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>86</th>\n      <td>87.0</td>\n      <td>15400.000000</td>\n      <td>3.0</td>\n      <td>5.0</td>\n      <td>2.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>87</th>\n      <td>88.0</td>\n      <td>15400.000000</td>\n      <td>6.0</td>\n      <td>5.0</td>\n      <td>5.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>88</th>\n      <td>89.0</td>\n      <td>15400.000000</td>\n      <td>3.0</td>\n      <td>5.0</td>\n      <td>2.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>89</th>\n      <td>90.0</td>\n      <td>3681.000000</td>\n      <td>1.0</td>\n      <td>5.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n  </tbody>\n</table>\n<p>90 rows \u00d7 83 columns</p>\n</div>"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  1\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Create a NumPy array from the column <code>Class</code> in <code>data</code>, by applying the method <code>to_numpy()</code>  then\nassign it  to the variable <code>Y</code>,make sure the output is a  Pandas series (only one bracket df\\['name of  column']).\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "Y=data[\"Class\"].to_numpy()",
            "execution_count": 6,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  2\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Standardize the data in <code>X</code> then reassign it to the variable  <code>X</code> using the transform provided below.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "# students get this \nX = preprocessing.StandardScaler().fit(X).transform(X)\nlen(X)",
            "execution_count": 108,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 108,
                    "data": {
                        "text/plain": "90"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "",
            "execution_count": null,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "We split the data into training and testing data using the  function  <code>train_test_split</code>.   The training data is divided into validation data, a second set used for training  data; then the models are trained and hyperparameters are selected using the function <code>GridSearchCV</code>.\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  3\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Use the function train_test_split to split the data X and Y into training and test data. Set the parameter test_size to  0.2 and random_state to 2. The training data and test data should be assigned to the following labels.\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "<code>X_train, X_test, Y_train, Y_test</code>\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "X_train, X_test, Y_train, Y_test = train_test_split( X, Y, test_size=0.2, random_state=2)",
            "execution_count": 29,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "we can see we only have 18 test samples.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "Y_test.shape",
            "execution_count": 30,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 30,
                    "data": {
                        "text/plain": "(18,)"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  4\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Create a logistic regression object  then create a  GridSearchCV object  <code>logreg_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "parameters ={'C':[0.01,0.1,1],\n             'penalty':['l2'],\n             'solver':['lbfgs']}",
            "execution_count": 31,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "parameters ={\"C\":[0.01,0.1,1],'penalty':['l2'], 'solver':['lbfgs']}# l1 lasso l2 ridge\nlr=LogisticRegression()\nlogreg_cv=GridSearchCV(lr,cv=10, param_grid=parameters).fit(X_train, Y_train)",
            "execution_count": 59,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 59,
                    "data": {
                        "text/plain": "GridSearchCV(cv=10, estimator=LogisticRegression(),\n             param_grid={'C': [0.01, 0.1, 1], 'penalty': ['l2'],\n                         'solver': ['lbfgs']})"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "We output the <code>GridSearchCV</code> object for logistic regression. We display the best parameters using the data attribute <code>best_params\\_</code> and the accuracy on the validation data using the data attribute <code>best_score\\_</code>.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "print(\"tuned hpyerparameters :(best parameters) \",logreg_cv.best_params_)\nprint(\"accuracy :\",logreg_cv.best_score_)",
            "execution_count": 44,
            "outputs": [
                {
                    "output_type": "stream",
                    "text": "tuned hpyerparameters :(best parameters)  {'C': 0.01, 'penalty': 'l2', 'solver': 'lbfgs'}\naccuracy : 0.8464285714285713\n",
                    "name": "stdout"
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  5\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Calculate the accuracy on the test data using the method <code>score</code>:\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "yhat_prob = logreg_cv.predict_proba(X_test)\nfrom sklearn.metrics import log_loss\nlog_loss(Y_test, yhat_prob)",
            "execution_count": 75,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 75,
                    "data": {
                        "text/plain": "0.4786666968559153"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Lets look at the confusion matrix:\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "yhat=logreg_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)",
            "execution_count": 47,
            "outputs": [
                {
                    "output_type": "display_data",
                    "data": {
                        "text/plain": "<Figure size 432x288 with 2 Axes>",
                        "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAfzUlEQVR4nO3dd5xdVbnG8d8zkwABktA7mKCAAlKkSJEmFjpBVKpXAQ1caZYLgnKJgI2rcMUrlogIhIAUKVKkSDGAICEh9KbUkEACCAQIkMy894+9DhyGmTllzj5nn8zz5bM/c84ua63MHN5Z8+611lZEYGZmxdPR6gaYmVnvHKDNzArKAdrMrKAcoM3MCsoB2sysoBygzcwKygHaBkzSMElXSHpF0kUDKGc/Sdc1sm2tIOkvkr7c6nZY+3OAHkQk7SvpLkmvSZqZAsknGlD054HlgaUj4gv1FhIREyPiMw1oz3tI2lZSSLqkx/710/6bqyzn+5LOrXReROwYEWfX2VyzdzhADxKSvgX8HPgRWTBdDfgVsHsDiv8A8GhEzG9AWXmZDWwhaemyfV8GHm1UBcr4/ylrGH+YBgFJI4ETgUMj4pKIeD0i5kXEFRFxVDpnYUk/lzQjbT+XtHA6tq2k6ZK+LWlW6n0fkI6dABwP7JV65gf17GlKGpV6qkPS+69IelzSHElPSNqvbP+tZddtIWlySp1MlrRF2bGbJZ0k6bZUznWSlunn2/A2cBmwd7q+E/giMLHH9+o0Sc9IelXSFElbpf07AN8t+3feU9aOH0q6DXgDWD3t+2o6/mtJF5eVf7KkGySp6h+gDVoO0IPD5sAiwKX9nPM9YDNgA2B9YFPguLLjKwAjgZWBg4DTJS0ZEePIeuUXRMTiEfH7/hoiaTHgF8COETEc2AKY1st5SwFXpXOXBk4FrurRA94XOABYDlgI+K/+6gbOAf4jvf4s8AAwo8c5k8m+B0sB5wEXSVokIq7p8e9cv+yaLwFjgeHAUz3K+zawXvrlsxXZ9+7L4TUWrAoO0IPD0sALFVIQ+wEnRsSsiJgNnEAWeErmpePzIuJq4DVgrTrb0w2sK2lYRMyMiAd6OWdn4LGImBAR8yPifOBhYNeyc/4QEY9GxFzgQrLA2qeI+DuwlKS1yAL1Ob2cc25EvJjqPAVYmMr/zrMi4oF0zbwe5b0B7E/2C+Zc4PCImF6hPDPAAXqweBFYppRi6MNKvLf391Ta904ZPQL8G8DitTYkIl4H9gIOAWZKukrSh6toT6lNK5e9f66O9kwADgO2o5e/KFIa56GUVnmZ7K+G/lInAM/0dzAi7gQeB0T2i8SsKg7Qg8PtwJvAmH7OmUF2s69kNd7/53+1XgcWLXu/QvnBiLg2Ij4NrEjWK/5dFe0ptenZOttUMgH4OnB16t2+I6UgvkOWm14yIpYAXiELrAB9pSX6TVdIOpSsJz4DOLr+pttg4wA9CETEK2Q38k6XNEbSopKGStpR0v+k084HjpO0bLrZdjzZn+T1mAZsLWm1dIPy2NIBSctL2i3lot8iS5V09VLG1cCaaWjgEEl7AWsDV9bZJgAi4glgG7Kce0/DgflkIz6GSDoeGFF2/HlgVC0jNSStCfyALM3xJeBoSf2mYsxKHKAHiYg4FfgW2Y2/2WR/lh9GNrIBsiByF3AvcB8wNe2rp67rgQtSWVN4b1DtILtxNgN4iSxYfr2XMl4EdknnvkjW89wlIl6op009yr41Inr76+Ba4C9kQ++eIvurozx9UZqE86KkqZXqSSmlc4GTI+KeiHiMbCTIhNIIGbP+yDeTzcyKyT1oM7OCcoA2M2swSWemSV33l+37qaSHJd0r6VJJS1QqxwHazKzxzgJ26LHvemDdiFiP7D7HsT0v6skB2syswSJiEtlN8PJ915XNJbgDWKVSOf1NXGipA0d93ncvzawqZz558YDXNpn3wuNVx5yFlv3gwWTT+0vGR8T4Gqo7kGykU78KG6DNzIoqBeNaAvI7JH2PbLz9xErnOkCbmQF09zZfqrGUPchhF2D7ahbMcoA2MwPoync587Rk7XeAbXouM9AXB2gzMyCiu2FlSTof2JZskbLpwDiyURsLA9en5cDviIhD+ivHAdrMDKC7cQE6IvbpZXe/a6X3xgHazAyggT3oRnGANjODptwkrJUDtJkZuAdtZlZUkfMojno4QJuZQUNvEjaKA7SZGTjFYWZWWL5JaGZWUO5Bm5kVlG8SmpkVlG8SmpkVU4Rz0GZmxeQctJlZQTnFYWZWUO5Bm5kVVNe8VrfgfRygzczAKQ4zs8JyisPMrKDcgzYzKygHaDOzYgrfJDQzKyjnoM3MCsopDjOzgnIP2sysoNyDNjMrKPegzcwKar4X7DczK6YC9qA7Wt0AM7NC6O6ufqtA0pmSZkm6v2zfUpKul/RY+rpkpXIcoM3MIOtBV7tVdhawQ499xwA3RMQawA3pfb8coM3MoKE96IiYBLzUY/fuwNnp9dnAmErlOAdtZgbNyEEvHxEzASJipqTlKl3gAG1mBjWN4pA0Fhhbtmt8RIxvdJMcoM3MACJqODXGA7UG5OclrZh6zysCsypd4By0mRk0NAfdhz8DX06vvwxcXukC96DNzKChU70lnQ9sCywjaTowDvgJcKGkg4CngS9UKscB2swMGnqTMCL26ePQ9rWU4wBtZgbQ1dXqFryPA7SZGXg1OzOzwnKANjMrqAIuluQAbWYGRHf146CbxQHazAyc4jAzKyyP4jAzKyj3oM3MCsoB2moxZOGhHHPBiQxdeCgdnZ3c9Zfbufx/L2x1s6zF/LnISQ2LJTWLA3SBzX9rHj/d9wTeeuNNOod0cuzFP+C+m+/m8bsfa3XTrIX8ucjJYOhBS5oD9PmrKCJGNLrOBdlbb7wJQOeQTjqHdPbznbXBxJ+LHAyGYXYRMRxA0onAc8AEQMB+wPBG17egU0cH4648meU+sAI3TriWx6e5l2T+XOSigKM48lwP+rMR8auImBMRr0bEr4E9+7tA0lhJd0m665E5j+fYtPYR3d18f6ej+PbmBzN6/Q+x8pqrtrpJVgD+XDRedHdXvTVLngG6S9J+kjoldUjaD+j3V1REjI+IjSNi47WGr55j09rP3Fff4JE7HmDdbTZsdVOsQPy5aKDuqH5rkjwD9L7AF4Hn0/aFtM+qNHypEQwbsSgAQxdeiLW3XI/n/vVsi1tlrebPRU6iu/qtSXIbxRERT5I9ZtzqNHK5JTnolMPo6OhAHWLyVX/nnhuntLpZ1mL+XORkMNwkLJG0LPA1YFR5PRFxYF51LmimP/wUJ+x8VKubYQXjz0VO5hfvJmGe46AvB24B/kqF3LOZWcsNsuVGF42I7+RYvplZ4xQwxZHnTcIrJe2UY/lmZg1TxGF2efagjwS+K+ktYB7ZZJXwTEIzK6QC9qDzHMXhWYNm1j4GU4AGkLQksAawSGlfREzKs04zs7oUcKp3nsPsvkqW5lgFmAZsBtwOfDKvOs3M6lXEZxLmeZPwSGAT4KmI2A7YEJidY31mZvUr4FTvPFMcb0bEm5KQtHBEPCxprRzrMzOr32BYD7rMdElLAJcB10v6NzAjx/rMzOpXwBRHnqM49kgvvy/pJmAkcE1e9ZmZDUgDA7SkbwJfJXuUwn3AARHxZq3l5PFElaV62X1f+ro48FKj6zQzG6joakyKQ9LKwBHA2hExV9KFwN7AWbWWlUcPegrZbw2V7Su9D8ALPZtZ8TQ2xTEEGCZpHrAodaZ383jk1ehGl2lmlrdahtlJGguMLds1PiLGA0TEs5J+BjwNzAWui4jr6mmTn+ptZgY19aBTMB7f27E0QW93YDTwMnCRpP0j4txam5TnOGgzs/bRXcPWv08BT0TE7IiYB1wCbFFPk9yDNjMDYn7DxkE/DWwmaVGyFMf2wF31FJRbD1rShGr2mZkVQoN60BHxD+BiYCrZCLYO+kiHVJJnD3qd8jeSOoGNcqzPzKxujVyLIyLGAeMGWk7De9CSjpU0B1hP0quS5qT3s8geg2VmVjyNy0E3TMMDdET8OK0F/dOIGBERw9O2dEQc2+j6zMwaIbqj6q1Z8pzqfayk3YCt066bI+LKvOozMxuQ4q2VlOt60D8GNgUmpl1HStrSvWgzK6KY3+oWvF+eNwl3BjaIyJ5lLuls4G7AAdrMCicK2IOuKQctaUlJ69VwyRJlr0fWUpeZWVMV8CZhxR60pJuB3dK504DZkv4WEd+qcOmPgbvTUqMiy0W792xmhVTEHnQ1KY6REfFqesbgHyJinKR7K10UEeen4L4JWYD+TkQ8N7Dmmpnlo4gBupoUxxBJKwJfBGodhdEBvAD8G1hT0tYVzjcza4noUtVbs1TTgz4RuBa4NSImS1odeKzSRZJOBvYCHuDdrE0Ak+psq5lZborYg64YoCPiIuCisvePA3tWUfYYYK2IeKv+5pmZNUd0N69nXK0+A7Sk/yPr8fYqIo6oUPbjwFDAAdrMCq/detB1LY9X5g1gmqQbKAvSVQR2M7Omi2ijHnREnF3+XtJiEfF6DWX/OW1mZoXXbj1oACRtDvye7Incq0laHzg4Ir7e33U9A7yZWZF1N3F0RrWqGWb3c+CzwIsAEXEP7y6AZGa2QIhuVb01S1VrcUTEM9J7GtWVT3PMzFqjrUZxlHlG0hZASFoIOAJ4KN9mmZk1VzRvmeeqVROgDwFOA1YGniWbtHJoXydLuoL+h+ftVmMbzcxy15Y96Ih4AdivhjJ/lr5+DlgBODe93wd4spbGmZk1S1sNsytJU7tPAzYj6xnfDnwzzSh8n4j4W7rupIgov5l4hSRP8zazQupq01Ec5wEXAisCK5FN+z6/iuuWTcEdAEmjgWXraaSZWd4iVPXWLNXkoBURE8renyvpsCqu+yZws6RST3sUcHCN7TMza4q2ykFLWiq9vEnSMcAfyVIcewFXVSo4Iq6RtAbw4bTrYS+cZGZF1W6jOKaQBeTSr5Xy3m8AJ/V2kaRPRsSNkj7X49AHJRERl9TdWjOznLRVDzoiRtdZ5jbAjcCuvRULOECbWeF0ddf0iNamqGomoaR1gbWBRUr7IuKc3s6NiHHp6wGNaKCZWTO0W4oDAEnjgG3JAvTVwI7ArUCvAVpSvw+TjYhTa26lmVnOuhs4OkPSEsAZwLpkmYMDI+L2Wsuppgf9eWB94O6IOEDS8qnivgxPX9cie2BsacnRXfHjrsysoBo8fO404JqI+HxaImPRegqpJkDPjYhuSfMljQBmAav3dXJEnAAg6TrgYxExJ73/PmWPzjIzK5JGpThSnNwa+EpWbrwNvF1PWdUE6LtSd/13ZCM7XgPurOK61Xo06m2ysdBVOWdGzX8N2CAwd8YtrW6CLaBqSXFIGguMLds1PiLGp9erA7OBP6T186cAR9b4wBOgurU4Sgvz/0bSNcCIiLi3irInAHdKupQsB7MH4EX8zayQahnFkYLx+D4ODwE+BhweEf+QdBpwDPDftbapv4kqH+vvWERM7a/giPihpL8AW6VdB0TE3bU20MysGRo4iGM6MD0i/pHeX0wWoGvWXw/6lH6OBfDJSoWnIN5vIDczK4JGjeKIiOckPSNprYh4BNgeeLCesvqbqLJdvQ00M2s3DR7FcTgwMY3geByoa15IVRNVzMwWdI18qHdETAM2Hmg5DtBmZkDQRmtxmJkNJvML+ESViuNKlNlf0vHp/WqSNs2/aWZmzROo6q1Zqhn49ytgc7JnCgLMAU7PrUVmZi3QXcPWLNWkOD4eER+TdDdARPw73Zk0M1tgtGsOep6kTtI4bknL0txfImZmuStiUKsmQP8CuBRYTtIPyVa3Oy7XVpmZNVlXO/agI2KipClks2EEjImIh3JvmZlZExXwiVdVLdi/GvAGcEX5voh4Os+GmZk1U3c79qDJnuBdenjsIsBo4BFgnRzbZWbWVAV84lVVKY6Plr9Pq9wd3MfpZmZtqV1vEr5HREyVtEkejTEza5VutWGKo8dDYDvIFqKenVuLzMxaoKvVDehFNT3o4WWv55PlpP+UT3PMzFqj7UZxpAkqi0fEUU1qj5lZS7TVKA5JQyJifn+PvjIzW1C02yiOO8nyzdMk/Rm4CHjnqbQRcUnObTMza5q2S3EkSwEvkj2DsDQeOgAHaDNbYLTbMLvl0giO+3k3MJcU8a8BM7O6dbVZD7oTWBx6zZw7QJvZAqXdetAzI+LEprXEzKyF2i1AF7DDb2aWjwI+krDfAL1901phZtZibdWDjoiXmtkQM7NWatep3mZmC7x2HQdtZrbAa6sUh5nZYFLEAN3R6gaYmRVB1LBVQ1KnpLslXVlvm9yDNjMjlxz0kcBDwIh6C3AP2syMbBRHtVslklYBdgbOGEibHKDNzIBuoupN0lhJd5VtY3sU93PgaAaY2naKw8yM2iJpRIwHxvd2TNIuwKyImCJp24G0yQHazIyGrgC3JbCbpJ2ARYARks6NiP1rLcgpDjMzsh50tVt/IuLYiFglIkYBewM31hOcwT1oMzMA5qt4qyg7QJuZkc8i9xFxM3Bzvdc7QJuZUcyZhA7QZmZkw+yKxgHazIxiPsfPAdrMDKc4zMwKq6uAfWgHaDMz3IM2MyuscA/azKyYitiD9lTvgvvsZ7blgfsn8fCDt3L0UYe2ujnWIsf96FS23nlvxux/yDv7fvbLM9h1n6+xx3/8J0cceyKvznmthS1sf7WsZtcsDtAF1tHRwS9O+yG77Lo/H11/O/baawwf+cgarW6WtcCYnT7Nb079wXv2bb7Jhlw64Tdces6vGbXqypwx4YIWtW7B0OgnqjSCA3SBbbrJhvzrX0/yxBNPM2/ePC688HJ22/WzrW6WtcDGG3yUkSOGv2fflh/fiCFDOgFYb50P8/ysF1rRtAXGfKLqrVkcoAtspZVX4JnpM955P/3Zmay00gotbJEV1aVXXccnNt+k1c1oa1HDf82Sy01CSZ/r73hEXNLHdWOBsQDqHElHx2I5tK59SO9/SFpE8e40W2v99uzz6ezsZJfPbNfqprS1It4kzGsUx67p63LAFsCN6f12ZCs79Rqgy59SMGShlQd9JHp2+kxWXWWld96vsvKKzJz5fAtbZEVz+dXXM+m2OznjFz/u9Re6Va+Iw+xySXFExAERcQBZPn3tiNgzIvYE1smjvgXV5Lum8aEPjWbUqFUZOnQoX/zi7lxx5XWtbpYVxK133MXvJ17E/508jmGLLNLq5rS9Ri3Y30h5j4MeFREzy94/D6yZc50LjK6uLo78xnFcfdV5dHZ0cNbZF/Dgg4+2ulnWAkeN+wmT776Xl19+le3H7M/XD/oSZ0y4gLfnzeNr3/gekN0oHHf04S1uafvqKmD6UHnmNCX9ElgDOJ+sN7038M+IqPgpcorDejN3xi2tboIV0NBlVh9wfmffD+xRdcw576lLm5JPyrUHHRGHSdoD2DrtGh8Rl+ZZp5lZPYqYg27GVO+pwJyI+KukRSUNj4g5TajXzKxqRRzFkes4aElfAy4Gfpt2rQxclmedZmb1GIxTvQ8FtgReBYiIx8iG3pmZFcqgmahS5q2IeLs0PlPSEIr5ZBkzG+SKOIoj7wD9N0nfBYZJ+jTwdeCKnOs0M6tZER8am3eK4xhgNnAfcDBwNXBcznWamdVs0E1UiYhu4HdpMzMrrEEzzE7SffSTa46I9fKo18ysXkVMceTVg94lfS09AmRC+rof8EZOdZqZ1a2IK0XmEqAj4ikASVtGxJZlh46RdBtwYh71mpnVq6tBPWhJqwLnACuQpazHR8Rp9ZSV903CxSR9ovRG0hbA4F7k2cwKqYETVeYD346IjwCbAYdKWrueNuU9zO4g4ExJI9P7l4EDc67TzKxmjUpxpBU8Z6bXcyQ9RDaL+sFay8p7FMcUYH1JI8hWznslz/rMzOqVx01CSaOADYF/1HN9rgFa0sLAnsAoYEhpRmFEOAdtZoVSyzC78sfzJePTE6HKz1kc+BPwjYh4tZ425Z3iuBx4BZgCvJVzXWZmdatlqnf54/l6I2koWXCe2NczWKuRd4BeJSJ2yLkOM7MBa1SKQ1mq4PfAQxFx6kDKynsUx98lfTTnOszMBqyBozi2BL4EfFLStLTtVE+b8u5BfwL4iqQnyFIcAsIzCc2saBo4iuNWslg3YHkH6B1zLt/MrCEG01Rv4D0zCpcD/Fx4MyusQbNYUomk3YBTgJWAWcAHgIeAdfKs18ysVl1RvKcS5n2T8CSyqY6PRsRoYHvgtpzrNDOrWURUvTVL3gF6XkS8CHRI6oiIm4ANcq7TzKxmRXxobN43CV9Os2kmARMlzSJbSMTMrFCKmIPOuwe9OzAX+CZwDfAvYNec6zQzq1l3RNVbs+Q9iuP1srdn51mXmdlAFLEHndcjr+bQ+yOvShNVRuRRr5lZvYo4iiOvJ6oMz6NcM7O8NDN1Ua28bxKambWFQZPiMDNrN+5Bm5kVlHvQZmYF1RVdrW7C+zhAm5nRuOVGG8kB2syMQbjcqJlZu3AP2sysoDyKw8ysoDyKw8ysoAbNVG8zs3bjHLSZWUE5B21mVlDuQZuZFZTHQZuZFZR70GZmBeVRHGZmBeWbhGZmBVXEFEfeT/U2M2sLUcN/lUjaQdIjkv4p6Zh62+QetJkZjetBS+oETgc+DUwHJkv6c0Q8WGtZDtBmZjQ0B70p8M+IeBxA0h+B3YEFJ0DPf/tZtboNRSFpbESMb3U7rFj8uWisWmKOpLHA2LJd48t+FisDz5Qdmw58vJ42OQfdHsZWPsUGIX8uWiQixkfExmVb+S/K3gJ9Xd1zB2gzs8aaDqxa9n4VYEY9BTlAm5k11mRgDUmjJS0E7A38uZ6CCpuDtvdwntF6489FAUXEfEmHAdcCncCZEfFAPWWpiIOzzczMKQ4zs8JygDYzKygH6AGQ9H1J/5VenyjpU72cs62kKxtU33f7OfakpGUaVM9rjSjH6tOo77+kUZLub0RZ1hoO0A0SEcdHxF9zrqbPAG1mCx4H6BpJ+l5aBOWvwFpl+8+S9Pn0egdJD0u6FfhcH+V8RdIlkq6R9Jik/yk7to+k+yTdL+nktO8nwDBJ0yRNrNDGyyRNkfRAmvFU2v+apB9KukfSHZKWT/tHS7pd0mRJJw3g22MNJGlxSTdImpo+D7un/aMkPSTpd+lnfJ2kYenYRunneztwaEv/ATZgDtA1kLQR2ZjGDckC7ya9nLMI8DtgV2ArYIV+itwA2Av4KLCXpFUlrQScDHwyHd9E0piIOAaYGxEbRMR+FZp6YERsBGwMHCFp6bR/MeCOiFgfmAR8Le0/Dfh1RGwCPFehbGueN4E9IuJjwHbAKZJKs9TWAE6PiHWAl4E90/4/AEdExOZNb601nAN0bbYCLo2INyLiVXoffP5h4ImIeCyyMYzn9lPeDRHxSkS8SbaQygfIgv7NETE7IuYDE4Gta2znEZLuAe4gm9G0Rtr/NlDKh08BRqXXWwLnp9cTaqzL8iPgR5LuBf5KtsbD8unYExExLb2eAoySNBJYIiL+lvb7Z9nmPFGldtUMHK92cPlbZa+7yH4eA1okStK2wKeAzSPiDUk3A4ukw/Pi3YHvpfpKPCC+ePYDlgU2ioh5kp7k3Z9lz8/OMLLPjn+OCxD3oGszCdhD0jBJw8nSGD09DIyW9MH0fp8a6/gHsI2kZdK6svsApR7RPElDK1w/Evh3Cs4fBjaros7byFI3kAUFK4aRwKwUnLcj+wurTxHxMvCKpE+kXf5ZtjkH6BpExFTgAmAa8Cfgll7OeZNslbGr0k3Cp2qsYyZwLHATcA8wNSIuT4fHA/dWuEl4DTAk/Vl8Elmao5IjgUMlTSYLClYME4GNJd1FFmwfruKaA4DT003CuXk2zvLnqd5mZgXlHrSZWUE5QJuZFZQDtJlZQTlAm5kVlAO0mVlBOUDb+0jqSmt+3C/pIkmLDqCs8jVKzpC0dj/nbitpizrq6HUlv2pW+Kt15bjyFQzN8uYAbb0prfmxLtn08EPKD6YJNDWLiK9GxIP9nLItUHOANltQOUBbJbcAH0q925sknQfcJ6lT0k/TCnj3SjoYQJlfSnpQ0lXAcqWCJN0saeP0eoe0Sts9acW2UWS/CL6Zeu9bSVpW0p9SHZMlbZmuXTqt4Ha3pN9SxfT4vlb4S8dOSW25QdKyad8Hla00OEXSLWlWZs8yj0j/znsl/bG+b69Z37wWh/VJ0hBgR7LZiQCbAutGxBMpyL0SEZtIWhi4TdJ1ZCv9rUW2Qt/yZItAndmj3GXJVvzbOpW1VES8JOk3wGsR8bN03nnA/0bErZJWI3sI50eAccCtEXGipJ3JZm5WcmCqYxgwWdKfIuJFshX+pkbEtyUdn8o+jGzW5iER8ZikjwO/IlthsNwxwOiIeEvSElV9U81q4ABtvRkmqbRS2i3A78lSD3dGxBNp/2eA9Ur5ZbIp4muQrbx3fkR0ATMk3dhL+ZsBk0plRcRLfbTjU8Da766wyYi0BsrWpHW2I+IqSf+u4t90hKQ90uvSCn8vAt1k0/chW3nwEkmLp3/vRWV1L9xLmfcCEyVdBlxWRRvMauIAbb2ZGxEblO9Iger18l3A4RFxbY/zdqLyimrVrrrWQbYq33vWlEhtqXqNggor/PUUqd6Xe34PerEz2S+L3YD/lrROWiLWrCGcg7Z6XQv8Z2l1PUlrSlqMbMW/vVOOekWyheZ7up1sxb7R6dql0v45wPCy864jSzeQzisFzEmkldok7QgsWaGt/a3w1wGU/grYlyx18irwhKQvpDokaf3yAiV1AKtGxE3A0cASwOIV2mFWE/egrV5nkC34P1VZl3Y2MAa4lCxXex/wKO8ulfqOiJidctiXpEA3C/g0cAVwsbJHOx0OHEG2Mtu9ZJ/VSWQ3Ek8Azpc0NZX/dIW2XgMcksp5hPeu8Pc6sI6kKcArZE+4gewXwK8lHQcMBf5ItrpgSSdwrrJF8kWWK3+5QjvMauLV7MzMCsopDjOzgnKANjMrKAdoM7OCcoA2MysoB2gzs4JygDYzKygHaDOzgvp/HyntxAMn4Z8AAAAASUVORK5CYII=\n"
                    },
                    "metadata": {
                        "needs_background": "light"
                    }
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Examining the confusion matrix, we see that logistic regression can distinguish between the different classes.  We see that the major problem is false positives.\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  6\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Create a support vector machine object then  create a  <code>GridSearchCV</code> object  <code>svm_cv</code> with cv - 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "parameters = {'kernel':('linear', 'rbf','poly','rbf', 'sigmoid'),\n              'C': np.logspace(-3, 3, 5),\n              'gamma':np.logspace(-3, 3, 5)}\nsvm = SVC(kernel=\"sigmoid\")",
            "execution_count": 99,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "svm_cv=GridSearchCV(svm,cv=10, param_grid=parameters).fit(X_train, Y_train)",
            "execution_count": 100,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "print(\"tuned hpyerparameters :(best parameters) \",svm_cv.best_params_)\nprint(\"accuracy :\",svm_cv.best_score_)",
            "execution_count": 101,
            "outputs": [
                {
                    "output_type": "stream",
                    "text": "tuned hpyerparameters :(best parameters)  {'C': 1.0, 'gamma': 0.03162277660168379, 'kernel': 'sigmoid'}\naccuracy : 0.8482142857142856\n",
                    "name": "stdout"
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  7\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Calculate the accuracy on the test data using the method <code>score</code>:\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "from sklearn.metrics import f1_score\nf1_score(Y_test,svm_cv.predict(X_test),average=\"weighted\")",
            "execution_count": 102,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 102,
                    "data": {
                        "text/plain": "0.8148148148148149"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "We can plot the confusion matrix\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "yhat=svm_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)",
            "execution_count": 79,
            "outputs": [
                {
                    "output_type": "display_data",
                    "data": {
                        "text/plain": "<Figure size 432x288 with 2 Axes>",
                        "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAfzUlEQVR4nO3dd5xdVbnG8d8zkwABktA7mKCAAlKkSJEmFjpBVKpXAQ1caZYLgnKJgI2rcMUrlogIhIAUKVKkSDGAICEh9KbUkEACCAQIkMy894+9DhyGmTllzj5nn8zz5bM/c84ua63MHN5Z8+611lZEYGZmxdPR6gaYmVnvHKDNzArKAdrMrKAcoM3MCsoB2sysoBygzcwKygHaBkzSMElXSHpF0kUDKGc/Sdc1sm2tIOkvkr7c6nZY+3OAHkQk7SvpLkmvSZqZAsknGlD054HlgaUj4gv1FhIREyPiMw1oz3tI2lZSSLqkx/710/6bqyzn+5LOrXReROwYEWfX2VyzdzhADxKSvgX8HPgRWTBdDfgVsHsDiv8A8GhEzG9AWXmZDWwhaemyfV8GHm1UBcr4/ylrGH+YBgFJI4ETgUMj4pKIeD0i5kXEFRFxVDpnYUk/lzQjbT+XtHA6tq2k6ZK+LWlW6n0fkI6dABwP7JV65gf17GlKGpV6qkPS+69IelzSHElPSNqvbP+tZddtIWlySp1MlrRF2bGbJZ0k6bZUznWSlunn2/A2cBmwd7q+E/giMLHH9+o0Sc9IelXSFElbpf07AN8t+3feU9aOH0q6DXgDWD3t+2o6/mtJF5eVf7KkGySp6h+gDVoO0IPD5sAiwKX9nPM9YDNgA2B9YFPguLLjKwAjgZWBg4DTJS0ZEePIeuUXRMTiEfH7/hoiaTHgF8COETEc2AKY1st5SwFXpXOXBk4FrurRA94XOABYDlgI+K/+6gbOAf4jvf4s8AAwo8c5k8m+B0sB5wEXSVokIq7p8e9cv+yaLwFjgeHAUz3K+zawXvrlsxXZ9+7L4TUWrAoO0IPD0sALFVIQ+wEnRsSsiJgNnEAWeErmpePzIuJq4DVgrTrb0w2sK2lYRMyMiAd6OWdn4LGImBAR8yPifOBhYNeyc/4QEY9GxFzgQrLA2qeI+DuwlKS1yAL1Ob2cc25EvJjqPAVYmMr/zrMi4oF0zbwe5b0B7E/2C+Zc4PCImF6hPDPAAXqweBFYppRi6MNKvLf391Ta904ZPQL8G8DitTYkIl4H9gIOAWZKukrSh6toT6lNK5e9f66O9kwADgO2o5e/KFIa56GUVnmZ7K+G/lInAM/0dzAi7gQeB0T2i8SsKg7Qg8PtwJvAmH7OmUF2s69kNd7/53+1XgcWLXu/QvnBiLg2Ij4NrEjWK/5dFe0ptenZOttUMgH4OnB16t2+I6UgvkOWm14yIpYAXiELrAB9pSX6TVdIOpSsJz4DOLr+pttg4wA9CETEK2Q38k6XNEbSopKGStpR0v+k084HjpO0bLrZdjzZn+T1mAZsLWm1dIPy2NIBSctL2i3lot8iS5V09VLG1cCaaWjgEEl7AWsDV9bZJgAi4glgG7Kce0/DgflkIz6GSDoeGFF2/HlgVC0jNSStCfyALM3xJeBoSf2mYsxKHKAHiYg4FfgW2Y2/2WR/lh9GNrIBsiByF3AvcB8wNe2rp67rgQtSWVN4b1DtILtxNgN4iSxYfr2XMl4EdknnvkjW89wlIl6op009yr41Inr76+Ba4C9kQ++eIvurozx9UZqE86KkqZXqSSmlc4GTI+KeiHiMbCTIhNIIGbP+yDeTzcyKyT1oM7OCcoA2M2swSWemSV33l+37qaSHJd0r6VJJS1QqxwHazKzxzgJ26LHvemDdiFiP7D7HsT0v6skB2syswSJiEtlN8PJ915XNJbgDWKVSOf1NXGipA0d93ncvzawqZz558YDXNpn3wuNVx5yFlv3gwWTT+0vGR8T4Gqo7kGykU78KG6DNzIoqBeNaAvI7JH2PbLz9xErnOkCbmQF09zZfqrGUPchhF2D7ahbMcoA2MwPoync587Rk7XeAbXouM9AXB2gzMyCiu2FlSTof2JZskbLpwDiyURsLA9en5cDviIhD+ivHAdrMDKC7cQE6IvbpZXe/a6X3xgHazAyggT3oRnGANjODptwkrJUDtJkZuAdtZlZUkfMojno4QJuZQUNvEjaKA7SZGTjFYWZWWL5JaGZWUO5Bm5kVlG8SmpkVlG8SmpkVU4Rz0GZmxeQctJlZQTnFYWZWUO5Bm5kVVNe8VrfgfRygzczAKQ4zs8JyisPMrKDcgzYzKygHaDOzYgrfJDQzKyjnoM3MCsopDjOzgnIP2sysoNyDNjMrKPegzcwKar4X7DczK6YC9qA7Wt0AM7NC6O6ufqtA0pmSZkm6v2zfUpKul/RY+rpkpXIcoM3MIOtBV7tVdhawQ499xwA3RMQawA3pfb8coM3MoKE96IiYBLzUY/fuwNnp9dnAmErlOAdtZgbNyEEvHxEzASJipqTlKl3gAG1mBjWN4pA0Fhhbtmt8RIxvdJMcoM3MACJqODXGA7UG5OclrZh6zysCsypd4By0mRk0NAfdhz8DX06vvwxcXukC96DNzKChU70lnQ9sCywjaTowDvgJcKGkg4CngS9UKscB2swMGnqTMCL26ePQ9rWU4wBtZgbQ1dXqFryPA7SZGXg1OzOzwnKANjMrqAIuluQAbWYGRHf146CbxQHazAyc4jAzKyyP4jAzKyj3oM3MCsoB2moxZOGhHHPBiQxdeCgdnZ3c9Zfbufx/L2x1s6zF/LnISQ2LJTWLA3SBzX9rHj/d9wTeeuNNOod0cuzFP+C+m+/m8bsfa3XTrIX8ucjJYOhBS5oD9PmrKCJGNLrOBdlbb7wJQOeQTjqHdPbznbXBxJ+LHAyGYXYRMRxA0onAc8AEQMB+wPBG17egU0cH4648meU+sAI3TriWx6e5l2T+XOSigKM48lwP+rMR8auImBMRr0bEr4E9+7tA0lhJd0m665E5j+fYtPYR3d18f6ej+PbmBzN6/Q+x8pqrtrpJVgD+XDRedHdXvTVLngG6S9J+kjoldUjaD+j3V1REjI+IjSNi47WGr55j09rP3Fff4JE7HmDdbTZsdVOsQPy5aKDuqH5rkjwD9L7AF4Hn0/aFtM+qNHypEQwbsSgAQxdeiLW3XI/n/vVsi1tlrebPRU6iu/qtSXIbxRERT5I9ZtzqNHK5JTnolMPo6OhAHWLyVX/nnhuntLpZ1mL+XORkMNwkLJG0LPA1YFR5PRFxYF51LmimP/wUJ+x8VKubYQXjz0VO5hfvJmGe46AvB24B/kqF3LOZWcsNsuVGF42I7+RYvplZ4xQwxZHnTcIrJe2UY/lmZg1TxGF2efagjwS+K+ktYB7ZZJXwTEIzK6QC9qDzHMXhWYNm1j4GU4AGkLQksAawSGlfREzKs04zs7oUcKp3nsPsvkqW5lgFmAZsBtwOfDKvOs3M6lXEZxLmeZPwSGAT4KmI2A7YEJidY31mZvUr4FTvPFMcb0bEm5KQtHBEPCxprRzrMzOr32BYD7rMdElLAJcB10v6NzAjx/rMzOpXwBRHnqM49kgvvy/pJmAkcE1e9ZmZDUgDA7SkbwJfJXuUwn3AARHxZq3l5PFElaV62X1f+ro48FKj6zQzG6joakyKQ9LKwBHA2hExV9KFwN7AWbWWlUcPegrZbw2V7Su9D8ALPZtZ8TQ2xTEEGCZpHrAodaZ383jk1ehGl2lmlrdahtlJGguMLds1PiLGA0TEs5J+BjwNzAWui4jr6mmTn+ptZgY19aBTMB7f27E0QW93YDTwMnCRpP0j4txam5TnOGgzs/bRXcPWv08BT0TE7IiYB1wCbFFPk9yDNjMDYn7DxkE/DWwmaVGyFMf2wF31FJRbD1rShGr2mZkVQoN60BHxD+BiYCrZCLYO+kiHVJJnD3qd8jeSOoGNcqzPzKxujVyLIyLGAeMGWk7De9CSjpU0B1hP0quS5qT3s8geg2VmVjyNy0E3TMMDdET8OK0F/dOIGBERw9O2dEQc2+j6zMwaIbqj6q1Z8pzqfayk3YCt066bI+LKvOozMxuQ4q2VlOt60D8GNgUmpl1HStrSvWgzK6KY3+oWvF+eNwl3BjaIyJ5lLuls4G7AAdrMCicK2IOuKQctaUlJ69VwyRJlr0fWUpeZWVMV8CZhxR60pJuB3dK504DZkv4WEd+qcOmPgbvTUqMiy0W792xmhVTEHnQ1KY6REfFqesbgHyJinKR7K10UEeen4L4JWYD+TkQ8N7Dmmpnlo4gBupoUxxBJKwJfBGodhdEBvAD8G1hT0tYVzjcza4noUtVbs1TTgz4RuBa4NSImS1odeKzSRZJOBvYCHuDdrE0Ak+psq5lZborYg64YoCPiIuCisvePA3tWUfYYYK2IeKv+5pmZNUd0N69nXK0+A7Sk/yPr8fYqIo6oUPbjwFDAAdrMCq/detB1LY9X5g1gmqQbKAvSVQR2M7Omi2ijHnREnF3+XtJiEfF6DWX/OW1mZoXXbj1oACRtDvye7Incq0laHzg4Ir7e33U9A7yZWZF1N3F0RrWqGWb3c+CzwIsAEXEP7y6AZGa2QIhuVb01S1VrcUTEM9J7GtWVT3PMzFqjrUZxlHlG0hZASFoIOAJ4KN9mmZk1VzRvmeeqVROgDwFOA1YGniWbtHJoXydLuoL+h+ftVmMbzcxy15Y96Ih4AdivhjJ/lr5+DlgBODe93wd4spbGmZk1S1sNsytJU7tPAzYj6xnfDnwzzSh8n4j4W7rupIgov5l4hSRP8zazQupq01Ec5wEXAisCK5FN+z6/iuuWTcEdAEmjgWXraaSZWd4iVPXWLNXkoBURE8renyvpsCqu+yZws6RST3sUcHCN7TMza4q2ykFLWiq9vEnSMcAfyVIcewFXVSo4Iq6RtAbw4bTrYS+cZGZF1W6jOKaQBeTSr5Xy3m8AJ/V2kaRPRsSNkj7X49AHJRERl9TdWjOznLRVDzoiRtdZ5jbAjcCuvRULOECbWeF0ddf0iNamqGomoaR1gbWBRUr7IuKc3s6NiHHp6wGNaKCZWTO0W4oDAEnjgG3JAvTVwI7ArUCvAVpSvw+TjYhTa26lmVnOuhs4OkPSEsAZwLpkmYMDI+L2Wsuppgf9eWB94O6IOEDS8qnivgxPX9cie2BsacnRXfHjrsysoBo8fO404JqI+HxaImPRegqpJkDPjYhuSfMljQBmAav3dXJEnAAg6TrgYxExJ73/PmWPzjIzK5JGpThSnNwa+EpWbrwNvF1PWdUE6LtSd/13ZCM7XgPurOK61Xo06m2ysdBVOWdGzX8N2CAwd8YtrW6CLaBqSXFIGguMLds1PiLGp9erA7OBP6T186cAR9b4wBOgurU4Sgvz/0bSNcCIiLi3irInAHdKupQsB7MH4EX8zayQahnFkYLx+D4ODwE+BhweEf+QdBpwDPDftbapv4kqH+vvWERM7a/giPihpL8AW6VdB0TE3bU20MysGRo4iGM6MD0i/pHeX0wWoGvWXw/6lH6OBfDJSoWnIN5vIDczK4JGjeKIiOckPSNprYh4BNgeeLCesvqbqLJdvQ00M2s3DR7FcTgwMY3geByoa15IVRNVzMwWdI18qHdETAM2Hmg5DtBmZkDQRmtxmJkNJvML+ESViuNKlNlf0vHp/WqSNs2/aWZmzROo6q1Zqhn49ytgc7JnCgLMAU7PrUVmZi3QXcPWLNWkOD4eER+TdDdARPw73Zk0M1tgtGsOep6kTtI4bknL0txfImZmuStiUKsmQP8CuBRYTtIPyVa3Oy7XVpmZNVlXO/agI2KipClks2EEjImIh3JvmZlZExXwiVdVLdi/GvAGcEX5voh4Os+GmZk1U3c79qDJnuBdenjsIsBo4BFgnRzbZWbWVAV84lVVKY6Plr9Pq9wd3MfpZmZtqV1vEr5HREyVtEkejTEza5VutWGKo8dDYDvIFqKenVuLzMxaoKvVDehFNT3o4WWv55PlpP+UT3PMzFqj7UZxpAkqi0fEUU1qj5lZS7TVKA5JQyJifn+PvjIzW1C02yiOO8nyzdMk/Rm4CHjnqbQRcUnObTMza5q2S3EkSwEvkj2DsDQeOgAHaDNbYLTbMLvl0giO+3k3MJcU8a8BM7O6dbVZD7oTWBx6zZw7QJvZAqXdetAzI+LEprXEzKyF2i1AF7DDb2aWjwI+krDfAL1901phZtZibdWDjoiXmtkQM7NWatep3mZmC7x2HQdtZrbAa6sUh5nZYFLEAN3R6gaYmRVB1LBVQ1KnpLslXVlvm9yDNjMjlxz0kcBDwIh6C3AP2syMbBRHtVslklYBdgbOGEibHKDNzIBuoupN0lhJd5VtY3sU93PgaAaY2naKw8yM2iJpRIwHxvd2TNIuwKyImCJp24G0yQHazIyGrgC3JbCbpJ2ARYARks6NiP1rLcgpDjMzsh50tVt/IuLYiFglIkYBewM31hOcwT1oMzMA5qt4qyg7QJuZkc8i9xFxM3Bzvdc7QJuZUcyZhA7QZmZkw+yKxgHazIxiPsfPAdrMDKc4zMwKq6uAfWgHaDMz3IM2MyuscA/azKyYitiD9lTvgvvsZ7blgfsn8fCDt3L0UYe2ujnWIsf96FS23nlvxux/yDv7fvbLM9h1n6+xx3/8J0cceyKvznmthS1sf7WsZtcsDtAF1tHRwS9O+yG77Lo/H11/O/baawwf+cgarW6WtcCYnT7Nb079wXv2bb7Jhlw64Tdces6vGbXqypwx4YIWtW7B0OgnqjSCA3SBbbrJhvzrX0/yxBNPM2/ePC688HJ22/WzrW6WtcDGG3yUkSOGv2fflh/fiCFDOgFYb50P8/ysF1rRtAXGfKLqrVkcoAtspZVX4JnpM955P/3Zmay00gotbJEV1aVXXccnNt+k1c1oa1HDf82Sy01CSZ/r73hEXNLHdWOBsQDqHElHx2I5tK59SO9/SFpE8e40W2v99uzz6ezsZJfPbNfqprS1It4kzGsUx67p63LAFsCN6f12ZCs79Rqgy59SMGShlQd9JHp2+kxWXWWld96vsvKKzJz5fAtbZEVz+dXXM+m2OznjFz/u9Re6Va+Iw+xySXFExAERcQBZPn3tiNgzIvYE1smjvgXV5Lum8aEPjWbUqFUZOnQoX/zi7lxx5XWtbpYVxK133MXvJ17E/508jmGLLNLq5rS9Ri3Y30h5j4MeFREzy94/D6yZc50LjK6uLo78xnFcfdV5dHZ0cNbZF/Dgg4+2ulnWAkeN+wmT776Xl19+le3H7M/XD/oSZ0y4gLfnzeNr3/gekN0oHHf04S1uafvqKmD6UHnmNCX9ElgDOJ+sN7038M+IqPgpcorDejN3xi2tboIV0NBlVh9wfmffD+xRdcw576lLm5JPyrUHHRGHSdoD2DrtGh8Rl+ZZp5lZPYqYg27GVO+pwJyI+KukRSUNj4g5TajXzKxqRRzFkes4aElfAy4Gfpt2rQxclmedZmb1GIxTvQ8FtgReBYiIx8iG3pmZFcqgmahS5q2IeLs0PlPSEIr5ZBkzG+SKOIoj7wD9N0nfBYZJ+jTwdeCKnOs0M6tZER8am3eK4xhgNnAfcDBwNXBcznWamdVs0E1UiYhu4HdpMzMrrEEzzE7SffSTa46I9fKo18ysXkVMceTVg94lfS09AmRC+rof8EZOdZqZ1a2IK0XmEqAj4ikASVtGxJZlh46RdBtwYh71mpnVq6tBPWhJqwLnACuQpazHR8Rp9ZSV903CxSR9ovRG0hbA4F7k2cwKqYETVeYD346IjwCbAYdKWrueNuU9zO4g4ExJI9P7l4EDc67TzKxmjUpxpBU8Z6bXcyQ9RDaL+sFay8p7FMcUYH1JI8hWznslz/rMzOqVx01CSaOADYF/1HN9rgFa0sLAnsAoYEhpRmFEOAdtZoVSyzC78sfzJePTE6HKz1kc+BPwjYh4tZ425Z3iuBx4BZgCvJVzXWZmdatlqnf54/l6I2koWXCe2NczWKuRd4BeJSJ2yLkOM7MBa1SKQ1mq4PfAQxFx6kDKynsUx98lfTTnOszMBqyBozi2BL4EfFLStLTtVE+b8u5BfwL4iqQnyFIcAsIzCc2saBo4iuNWslg3YHkH6B1zLt/MrCEG01Rv4D0zCpcD/Fx4MyusQbNYUomk3YBTgJWAWcAHgIeAdfKs18ysVl1RvKcS5n2T8CSyqY6PRsRoYHvgtpzrNDOrWURUvTVL3gF6XkS8CHRI6oiIm4ANcq7TzKxmRXxobN43CV9Os2kmARMlzSJbSMTMrFCKmIPOuwe9OzAX+CZwDfAvYNec6zQzq1l3RNVbs+Q9iuP1srdn51mXmdlAFLEHndcjr+bQ+yOvShNVRuRRr5lZvYo4iiOvJ6oMz6NcM7O8NDN1Ua28bxKambWFQZPiMDNrN+5Bm5kVlHvQZmYF1RVdrW7C+zhAm5nRuOVGG8kB2syMQbjcqJlZu3AP2sysoDyKw8ysoDyKw8ysoAbNVG8zs3bjHLSZWUE5B21mVlDuQZuZFZTHQZuZFZR70GZmBeVRHGZmBeWbhGZmBVXEFEfeT/U2M2sLUcN/lUjaQdIjkv4p6Zh62+QetJkZjetBS+oETgc+DUwHJkv6c0Q8WGtZDtBmZjQ0B70p8M+IeBxA0h+B3YEFJ0DPf/tZtboNRSFpbESMb3U7rFj8uWisWmKOpLHA2LJd48t+FisDz5Qdmw58vJ42OQfdHsZWPsUGIX8uWiQixkfExmVb+S/K3gJ9Xd1zB2gzs8aaDqxa9n4VYEY9BTlAm5k11mRgDUmjJS0E7A38uZ6CCpuDtvdwntF6489FAUXEfEmHAdcCncCZEfFAPWWpiIOzzczMKQ4zs8JygDYzKygH6AGQ9H1J/5VenyjpU72cs62kKxtU33f7OfakpGUaVM9rjSjH6tOo77+kUZLub0RZ1hoO0A0SEcdHxF9zrqbPAG1mCx4H6BpJ+l5aBOWvwFpl+8+S9Pn0egdJD0u6FfhcH+V8RdIlkq6R9Jik/yk7to+k+yTdL+nktO8nwDBJ0yRNrNDGyyRNkfRAmvFU2v+apB9KukfSHZKWT/tHS7pd0mRJJw3g22MNJGlxSTdImpo+D7un/aMkPSTpd+lnfJ2kYenYRunneztwaEv/ATZgDtA1kLQR2ZjGDckC7ya9nLMI8DtgV2ArYIV+itwA2Av4KLCXpFUlrQScDHwyHd9E0piIOAaYGxEbRMR+FZp6YERsBGwMHCFp6bR/MeCOiFgfmAR8Le0/Dfh1RGwCPFehbGueN4E9IuJjwHbAKZJKs9TWAE6PiHWAl4E90/4/AEdExOZNb601nAN0bbYCLo2INyLiVXoffP5h4ImIeCyyMYzn9lPeDRHxSkS8SbaQygfIgv7NETE7IuYDE4Gta2znEZLuAe4gm9G0Rtr/NlDKh08BRqXXWwLnp9cTaqzL8iPgR5LuBf5KtsbD8unYExExLb2eAoySNBJYIiL+lvb7Z9nmPFGldtUMHK92cPlbZa+7yH4eA1okStK2wKeAzSPiDUk3A4ukw/Pi3YHvpfpKPCC+ePYDlgU2ioh5kp7k3Z9lz8/OMLLPjn+OCxD3oGszCdhD0jBJw8nSGD09DIyW9MH0fp8a6/gHsI2kZdK6svsApR7RPElDK1w/Evh3Cs4fBjaros7byFI3kAUFK4aRwKwUnLcj+wurTxHxMvCKpE+kXf5ZtjkH6BpExFTgAmAa8Cfgll7OeZNslbGr0k3Cp2qsYyZwLHATcA8wNSIuT4fHA/dWuEl4DTAk/Vl8Elmao5IjgUMlTSYLClYME4GNJd1FFmwfruKaA4DT003CuXk2zvLnqd5mZgXlHrSZWUE5QJuZFZQDtJlZQTlAm5kVlAO0mVlBOUDb+0jqSmt+3C/pIkmLDqCs8jVKzpC0dj/nbitpizrq6HUlv2pW+Kt15bjyFQzN8uYAbb0prfmxLtn08EPKD6YJNDWLiK9GxIP9nLItUHOANltQOUBbJbcAH0q925sknQfcJ6lT0k/TCnj3SjoYQJlfSnpQ0lXAcqWCJN0saeP0eoe0Sts9acW2UWS/CL6Zeu9bSVpW0p9SHZMlbZmuXTqt4Ha3pN9SxfT4vlb4S8dOSW25QdKyad8Hla00OEXSLWlWZs8yj0j/znsl/bG+b69Z37wWh/VJ0hBgR7LZiQCbAutGxBMpyL0SEZtIWhi4TdJ1ZCv9rUW2Qt/yZItAndmj3GXJVvzbOpW1VES8JOk3wGsR8bN03nnA/0bErZJWI3sI50eAccCtEXGipJ3JZm5WcmCqYxgwWdKfIuJFshX+pkbEtyUdn8o+jGzW5iER8ZikjwO/IlthsNwxwOiIeEvSElV9U81q4ABtvRkmqbRS2i3A78lSD3dGxBNp/2eA9Ur5ZbIp4muQrbx3fkR0ATMk3dhL+ZsBk0plRcRLfbTjU8Da766wyYi0BsrWpHW2I+IqSf+u4t90hKQ90uvSCn8vAt1k0/chW3nwEkmLp3/vRWV1L9xLmfcCEyVdBlxWRRvMauIAbb2ZGxEblO9Iger18l3A4RFxbY/zdqLyimrVrrrWQbYq33vWlEhtqXqNggor/PUUqd6Xe34PerEz2S+L3YD/lrROWiLWrCGcg7Z6XQv8Z2l1PUlrSlqMbMW/vVOOekWyheZ7up1sxb7R6dql0v45wPCy864jSzeQzisFzEmkldok7QgsWaGt/a3w1wGU/grYlyx18irwhKQvpDokaf3yAiV1AKtGxE3A0cASwOIV2mFWE/egrV5nkC34P1VZl3Y2MAa4lCxXex/wKO8ulfqOiJidctiXpEA3C/g0cAVwsbJHOx0OHEG2Mtu9ZJ/VSWQ3Ek8Azpc0NZX/dIW2XgMcksp5hPeu8Pc6sI6kKcArZE+4gewXwK8lHQcMBf5ItrpgSSdwrrJF8kWWK3+5QjvMauLV7MzMCsopDjOzgnKANjMrKAdoM7OCcoA2MysoB2gzs4JygDYzKygHaDOzgvp/HyntxAMn4Z8AAAAASUVORK5CYII=\n"
                    },
                    "metadata": {
                        "needs_background": "light"
                    }
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  8\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Create a decision tree classifier object then  create a  <code>GridSearchCV</code> object  <code>tree_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "parameters = {'criterion': ['gini', 'entropy'],\n     'splitter': ['best', 'random'],\n     'max_depth': [2*n for n in range(1,10)],\n     'max_features': ['auto', 'sqrt'],\n     'min_samples_leaf': [1, 2, 4],\n     'min_samples_split': [2, 5, 10]}\n\ntree = DecisionTreeClassifier()",
            "execution_count": 80,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "tree_cv=GridSearchCV(tree,cv=10, param_grid=parameters).fit(X_train, Y_train)",
            "execution_count": 81,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "print(\"tuned hpyerparameters :(best parameters) \",tree_cv.best_params_)\nprint(\"accuracy :\",tree_cv.best_score_)",
            "execution_count": 82,
            "outputs": [
                {
                    "output_type": "stream",
                    "text": "tuned hpyerparameters :(best parameters)  {'criterion': 'gini', 'max_depth': 2, 'max_features': 'sqrt', 'min_samples_leaf': 4, 'min_samples_split': 10, 'splitter': 'random'}\naccuracy : 0.875\n",
                    "name": "stdout"
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  9\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Calculate the accuracy of tree_cv on the test data using the method <code>score</code>:\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "f1_score(Y_test,tree_cv.predict(X_test))",
            "execution_count": 103,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 103,
                    "data": {
                        "text/plain": "0.8"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "We can plot the confusion matrix\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "yhat = svm_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)",
            "execution_count": 84,
            "outputs": [
                {
                    "output_type": "display_data",
                    "data": {
                        "text/plain": "<Figure size 432x288 with 2 Axes>",
                        "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAfzUlEQVR4nO3dd5xdVbnG8d8zkwABktA7mKCAAlKkSJEmFjpBVKpXAQ1caZYLgnKJgI2rcMUrlogIhIAUKVKkSDGAICEh9KbUkEACCAQIkMy894+9DhyGmTllzj5nn8zz5bM/c84ua63MHN5Z8+611lZEYGZmxdPR6gaYmVnvHKDNzArKAdrMrKAcoM3MCsoB2sysoBygzcwKygHaBkzSMElXSHpF0kUDKGc/Sdc1sm2tIOkvkr7c6nZY+3OAHkQk7SvpLkmvSZqZAsknGlD054HlgaUj4gv1FhIREyPiMw1oz3tI2lZSSLqkx/710/6bqyzn+5LOrXReROwYEWfX2VyzdzhADxKSvgX8HPgRWTBdDfgVsHsDiv8A8GhEzG9AWXmZDWwhaemyfV8GHm1UBcr4/ylrGH+YBgFJI4ETgUMj4pKIeD0i5kXEFRFxVDpnYUk/lzQjbT+XtHA6tq2k6ZK+LWlW6n0fkI6dABwP7JV65gf17GlKGpV6qkPS+69IelzSHElPSNqvbP+tZddtIWlySp1MlrRF2bGbJZ0k6bZUznWSlunn2/A2cBmwd7q+E/giMLHH9+o0Sc9IelXSFElbpf07AN8t+3feU9aOH0q6DXgDWD3t+2o6/mtJF5eVf7KkGySp6h+gDVoO0IPD5sAiwKX9nPM9YDNgA2B9YFPguLLjKwAjgZWBg4DTJS0ZEePIeuUXRMTiEfH7/hoiaTHgF8COETEc2AKY1st5SwFXpXOXBk4FrurRA94XOABYDlgI+K/+6gbOAf4jvf4s8AAwo8c5k8m+B0sB5wEXSVokIq7p8e9cv+yaLwFjgeHAUz3K+zawXvrlsxXZ9+7L4TUWrAoO0IPD0sALFVIQ+wEnRsSsiJgNnEAWeErmpePzIuJq4DVgrTrb0w2sK2lYRMyMiAd6OWdn4LGImBAR8yPifOBhYNeyc/4QEY9GxFzgQrLA2qeI+DuwlKS1yAL1Ob2cc25EvJjqPAVYmMr/zrMi4oF0zbwe5b0B7E/2C+Zc4PCImF6hPDPAAXqweBFYppRi6MNKvLf391Ta904ZPQL8G8DitTYkIl4H9gIOAWZKukrSh6toT6lNK5e9f66O9kwADgO2o5e/KFIa56GUVnmZ7K+G/lInAM/0dzAi7gQeB0T2i8SsKg7Qg8PtwJvAmH7OmUF2s69kNd7/53+1XgcWLXu/QvnBiLg2Ij4NrEjWK/5dFe0ptenZOttUMgH4OnB16t2+I6UgvkOWm14yIpYAXiELrAB9pSX6TVdIOpSsJz4DOLr+pttg4wA9CETEK2Q38k6XNEbSopKGStpR0v+k084HjpO0bLrZdjzZn+T1mAZsLWm1dIPy2NIBSctL2i3lot8iS5V09VLG1cCaaWjgEEl7AWsDV9bZJgAi4glgG7Kce0/DgflkIz6GSDoeGFF2/HlgVC0jNSStCfyALM3xJeBoSf2mYsxKHKAHiYg4FfgW2Y2/2WR/lh9GNrIBsiByF3AvcB8wNe2rp67rgQtSWVN4b1DtILtxNgN4iSxYfr2XMl4EdknnvkjW89wlIl6op009yr41Inr76+Ba4C9kQ++eIvurozx9UZqE86KkqZXqSSmlc4GTI+KeiHiMbCTIhNIIGbP+yDeTzcyKyT1oM7OCcoA2M2swSWemSV33l+37qaSHJd0r6VJJS1QqxwHazKzxzgJ26LHvemDdiFiP7D7HsT0v6skB2syswSJiEtlN8PJ915XNJbgDWKVSOf1NXGipA0d93ncvzawqZz558YDXNpn3wuNVx5yFlv3gwWTT+0vGR8T4Gqo7kGykU78KG6DNzIoqBeNaAvI7JH2PbLz9xErnOkCbmQF09zZfqrGUPchhF2D7ahbMcoA2MwPoync587Rk7XeAbXouM9AXB2gzMyCiu2FlSTof2JZskbLpwDiyURsLA9en5cDviIhD+ivHAdrMDKC7cQE6IvbpZXe/a6X3xgHazAyggT3oRnGANjODptwkrJUDtJkZuAdtZlZUkfMojno4QJuZQUNvEjaKA7SZGTjFYWZWWL5JaGZWUO5Bm5kVlG8SmpkVlG8SmpkVU4Rz0GZmxeQctJlZQTnFYWZWUO5Bm5kVVNe8VrfgfRygzczAKQ4zs8JyisPMrKDcgzYzKygHaDOzYgrfJDQzKyjnoM3MCsopDjOzgnIP2sysoNyDNjMrKPegzcwKar4X7DczK6YC9qA7Wt0AM7NC6O6ufqtA0pmSZkm6v2zfUpKul/RY+rpkpXIcoM3MIOtBV7tVdhawQ499xwA3RMQawA3pfb8coM3MoKE96IiYBLzUY/fuwNnp9dnAmErlOAdtZgbNyEEvHxEzASJipqTlKl3gAG1mBjWN4pA0Fhhbtmt8RIxvdJMcoM3MACJqODXGA7UG5OclrZh6zysCsypd4By0mRk0NAfdhz8DX06vvwxcXukC96DNzKChU70lnQ9sCywjaTowDvgJcKGkg4CngS9UKscB2swMGnqTMCL26ePQ9rWU4wBtZgbQ1dXqFryPA7SZGXg1OzOzwnKANjMrqAIuluQAbWYGRHf146CbxQHazAyc4jAzKyyP4jAzKyj3oM3MCsoB2moxZOGhHHPBiQxdeCgdnZ3c9Zfbufx/L2x1s6zF/LnISQ2LJTWLA3SBzX9rHj/d9wTeeuNNOod0cuzFP+C+m+/m8bsfa3XTrIX8ucjJYOhBS5oD9PmrKCJGNLrOBdlbb7wJQOeQTjqHdPbznbXBxJ+LHAyGYXYRMRxA0onAc8AEQMB+wPBG17egU0cH4648meU+sAI3TriWx6e5l2T+XOSigKM48lwP+rMR8auImBMRr0bEr4E9+7tA0lhJd0m665E5j+fYtPYR3d18f6ej+PbmBzN6/Q+x8pqrtrpJVgD+XDRedHdXvTVLngG6S9J+kjoldUjaD+j3V1REjI+IjSNi47WGr55j09rP3Fff4JE7HmDdbTZsdVOsQPy5aKDuqH5rkjwD9L7AF4Hn0/aFtM+qNHypEQwbsSgAQxdeiLW3XI/n/vVsi1tlrebPRU6iu/qtSXIbxRERT5I9ZtzqNHK5JTnolMPo6OhAHWLyVX/nnhuntLpZ1mL+XORkMNwkLJG0LPA1YFR5PRFxYF51LmimP/wUJ+x8VKubYQXjz0VO5hfvJmGe46AvB24B/kqF3LOZWcsNsuVGF42I7+RYvplZ4xQwxZHnTcIrJe2UY/lmZg1TxGF2efagjwS+K+ktYB7ZZJXwTEIzK6QC9qDzHMXhWYNm1j4GU4AGkLQksAawSGlfREzKs04zs7oUcKp3nsPsvkqW5lgFmAZsBtwOfDKvOs3M6lXEZxLmeZPwSGAT4KmI2A7YEJidY31mZvUr4FTvPFMcb0bEm5KQtHBEPCxprRzrMzOr32BYD7rMdElLAJcB10v6NzAjx/rMzOpXwBRHnqM49kgvvy/pJmAkcE1e9ZmZDUgDA7SkbwJfJXuUwn3AARHxZq3l5PFElaV62X1f+ro48FKj6zQzG6joakyKQ9LKwBHA2hExV9KFwN7AWbWWlUcPegrZbw2V7Su9D8ALPZtZ8TQ2xTEEGCZpHrAodaZ383jk1ehGl2lmlrdahtlJGguMLds1PiLGA0TEs5J+BjwNzAWui4jr6mmTn+ptZgY19aBTMB7f27E0QW93YDTwMnCRpP0j4txam5TnOGgzs/bRXcPWv08BT0TE7IiYB1wCbFFPk9yDNjMDYn7DxkE/DWwmaVGyFMf2wF31FJRbD1rShGr2mZkVQoN60BHxD+BiYCrZCLYO+kiHVJJnD3qd8jeSOoGNcqzPzKxujVyLIyLGAeMGWk7De9CSjpU0B1hP0quS5qT3s8geg2VmVjyNy0E3TMMDdET8OK0F/dOIGBERw9O2dEQc2+j6zMwaIbqj6q1Z8pzqfayk3YCt066bI+LKvOozMxuQ4q2VlOt60D8GNgUmpl1HStrSvWgzK6KY3+oWvF+eNwl3BjaIyJ5lLuls4G7AAdrMCicK2IOuKQctaUlJ69VwyRJlr0fWUpeZWVMV8CZhxR60pJuB3dK504DZkv4WEd+qcOmPgbvTUqMiy0W792xmhVTEHnQ1KY6REfFqesbgHyJinKR7K10UEeen4L4JWYD+TkQ8N7Dmmpnlo4gBupoUxxBJKwJfBGodhdEBvAD8G1hT0tYVzjcza4noUtVbs1TTgz4RuBa4NSImS1odeKzSRZJOBvYCHuDdrE0Ak+psq5lZborYg64YoCPiIuCisvePA3tWUfYYYK2IeKv+5pmZNUd0N69nXK0+A7Sk/yPr8fYqIo6oUPbjwFDAAdrMCq/detB1LY9X5g1gmqQbKAvSVQR2M7Omi2ijHnREnF3+XtJiEfF6DWX/OW1mZoXXbj1oACRtDvye7Incq0laHzg4Ir7e33U9A7yZWZF1N3F0RrWqGWb3c+CzwIsAEXEP7y6AZGa2QIhuVb01S1VrcUTEM9J7GtWVT3PMzFqjrUZxlHlG0hZASFoIOAJ4KN9mmZk1VzRvmeeqVROgDwFOA1YGniWbtHJoXydLuoL+h+ftVmMbzcxy15Y96Ih4AdivhjJ/lr5+DlgBODe93wd4spbGmZk1S1sNsytJU7tPAzYj6xnfDnwzzSh8n4j4W7rupIgov5l4hSRP8zazQupq01Ec5wEXAisCK5FN+z6/iuuWTcEdAEmjgWXraaSZWd4iVPXWLNXkoBURE8renyvpsCqu+yZws6RST3sUcHCN7TMza4q2ykFLWiq9vEnSMcAfyVIcewFXVSo4Iq6RtAbw4bTrYS+cZGZF1W6jOKaQBeTSr5Xy3m8AJ/V2kaRPRsSNkj7X49AHJRERl9TdWjOznLRVDzoiRtdZ5jbAjcCuvRULOECbWeF0ddf0iNamqGomoaR1gbWBRUr7IuKc3s6NiHHp6wGNaKCZWTO0W4oDAEnjgG3JAvTVwI7ArUCvAVpSvw+TjYhTa26lmVnOuhs4OkPSEsAZwLpkmYMDI+L2Wsuppgf9eWB94O6IOEDS8qnivgxPX9cie2BsacnRXfHjrsysoBo8fO404JqI+HxaImPRegqpJkDPjYhuSfMljQBmAav3dXJEnAAg6TrgYxExJ73/PmWPzjIzK5JGpThSnNwa+EpWbrwNvF1PWdUE6LtSd/13ZCM7XgPurOK61Xo06m2ysdBVOWdGzX8N2CAwd8YtrW6CLaBqSXFIGguMLds1PiLGp9erA7OBP6T186cAR9b4wBOgurU4Sgvz/0bSNcCIiLi3irInAHdKupQsB7MH4EX8zayQahnFkYLx+D4ODwE+BhweEf+QdBpwDPDftbapv4kqH+vvWERM7a/giPihpL8AW6VdB0TE3bU20MysGRo4iGM6MD0i/pHeX0wWoGvWXw/6lH6OBfDJSoWnIN5vIDczK4JGjeKIiOckPSNprYh4BNgeeLCesvqbqLJdvQ00M2s3DR7FcTgwMY3geByoa15IVRNVzMwWdI18qHdETAM2Hmg5DtBmZkDQRmtxmJkNJvML+ESViuNKlNlf0vHp/WqSNs2/aWZmzROo6q1Zqhn49ytgc7JnCgLMAU7PrUVmZi3QXcPWLNWkOD4eER+TdDdARPw73Zk0M1tgtGsOep6kTtI4bknL0txfImZmuStiUKsmQP8CuBRYTtIPyVa3Oy7XVpmZNVlXO/agI2KipClks2EEjImIh3JvmZlZExXwiVdVLdi/GvAGcEX5voh4Os+GmZk1U3c79qDJnuBdenjsIsBo4BFgnRzbZWbWVAV84lVVKY6Plr9Pq9wd3MfpZmZtqV1vEr5HREyVtEkejTEza5VutWGKo8dDYDvIFqKenVuLzMxaoKvVDehFNT3o4WWv55PlpP+UT3PMzFqj7UZxpAkqi0fEUU1qj5lZS7TVKA5JQyJifn+PvjIzW1C02yiOO8nyzdMk/Rm4CHjnqbQRcUnObTMza5q2S3EkSwEvkj2DsDQeOgAHaDNbYLTbMLvl0giO+3k3MJcU8a8BM7O6dbVZD7oTWBx6zZw7QJvZAqXdetAzI+LEprXEzKyF2i1AF7DDb2aWjwI+krDfAL1901phZtZibdWDjoiXmtkQM7NWatep3mZmC7x2HQdtZrbAa6sUh5nZYFLEAN3R6gaYmRVB1LBVQ1KnpLslXVlvm9yDNjMjlxz0kcBDwIh6C3AP2syMbBRHtVslklYBdgbOGEibHKDNzIBuoupN0lhJd5VtY3sU93PgaAaY2naKw8yM2iJpRIwHxvd2TNIuwKyImCJp24G0yQHazIyGrgC3JbCbpJ2ARYARks6NiP1rLcgpDjMzsh50tVt/IuLYiFglIkYBewM31hOcwT1oMzMA5qt4qyg7QJuZkc8i9xFxM3Bzvdc7QJuZUcyZhA7QZmZkw+yKxgHazIxiPsfPAdrMDKc4zMwKq6uAfWgHaDMz3IM2MyuscA/azKyYitiD9lTvgvvsZ7blgfsn8fCDt3L0UYe2ujnWIsf96FS23nlvxux/yDv7fvbLM9h1n6+xx3/8J0cceyKvznmthS1sf7WsZtcsDtAF1tHRwS9O+yG77Lo/H11/O/baawwf+cgarW6WtcCYnT7Nb079wXv2bb7Jhlw64Tdces6vGbXqypwx4YIWtW7B0OgnqjSCA3SBbbrJhvzrX0/yxBNPM2/ePC688HJ22/WzrW6WtcDGG3yUkSOGv2fflh/fiCFDOgFYb50P8/ysF1rRtAXGfKLqrVkcoAtspZVX4JnpM955P/3Zmay00gotbJEV1aVXXccnNt+k1c1oa1HDf82Sy01CSZ/r73hEXNLHdWOBsQDqHElHx2I5tK59SO9/SFpE8e40W2v99uzz6ezsZJfPbNfqprS1It4kzGsUx67p63LAFsCN6f12ZCs79Rqgy59SMGShlQd9JHp2+kxWXWWld96vsvKKzJz5fAtbZEVz+dXXM+m2OznjFz/u9Re6Va+Iw+xySXFExAERcQBZPn3tiNgzIvYE1smjvgXV5Lum8aEPjWbUqFUZOnQoX/zi7lxx5XWtbpYVxK133MXvJ17E/508jmGLLNLq5rS9Ri3Y30h5j4MeFREzy94/D6yZc50LjK6uLo78xnFcfdV5dHZ0cNbZF/Dgg4+2ulnWAkeN+wmT776Xl19+le3H7M/XD/oSZ0y4gLfnzeNr3/gekN0oHHf04S1uafvqKmD6UHnmNCX9ElgDOJ+sN7038M+IqPgpcorDejN3xi2tboIV0NBlVh9wfmffD+xRdcw576lLm5JPyrUHHRGHSdoD2DrtGh8Rl+ZZp5lZPYqYg27GVO+pwJyI+KukRSUNj4g5TajXzKxqRRzFkes4aElfAy4Gfpt2rQxclmedZmb1GIxTvQ8FtgReBYiIx8iG3pmZFcqgmahS5q2IeLs0PlPSEIr5ZBkzG+SKOIoj7wD9N0nfBYZJ+jTwdeCKnOs0M6tZER8am3eK4xhgNnAfcDBwNXBcznWamdVs0E1UiYhu4HdpMzMrrEEzzE7SffSTa46I9fKo18ysXkVMceTVg94lfS09AmRC+rof8EZOdZqZ1a2IK0XmEqAj4ikASVtGxJZlh46RdBtwYh71mpnVq6tBPWhJqwLnACuQpazHR8Rp9ZSV903CxSR9ovRG0hbA4F7k2cwKqYETVeYD346IjwCbAYdKWrueNuU9zO4g4ExJI9P7l4EDc67TzKxmjUpxpBU8Z6bXcyQ9RDaL+sFay8p7FMcUYH1JI8hWznslz/rMzOqVx01CSaOADYF/1HN9rgFa0sLAnsAoYEhpRmFEOAdtZoVSyzC78sfzJePTE6HKz1kc+BPwjYh4tZ425Z3iuBx4BZgCvJVzXWZmdatlqnf54/l6I2koWXCe2NczWKuRd4BeJSJ2yLkOM7MBa1SKQ1mq4PfAQxFx6kDKynsUx98lfTTnOszMBqyBozi2BL4EfFLStLTtVE+b8u5BfwL4iqQnyFIcAsIzCc2saBo4iuNWslg3YHkH6B1zLt/MrCEG01Rv4D0zCpcD/Fx4MyusQbNYUomk3YBTgJWAWcAHgIeAdfKs18ysVl1RvKcS5n2T8CSyqY6PRsRoYHvgtpzrNDOrWURUvTVL3gF6XkS8CHRI6oiIm4ANcq7TzKxmRXxobN43CV9Os2kmARMlzSJbSMTMrFCKmIPOuwe9OzAX+CZwDfAvYNec6zQzq1l3RNVbs+Q9iuP1srdn51mXmdlAFLEHndcjr+bQ+yOvShNVRuRRr5lZvYo4iiOvJ6oMz6NcM7O8NDN1Ua28bxKambWFQZPiMDNrN+5Bm5kVlHvQZmYF1RVdrW7C+zhAm5nRuOVGG8kB2syMQbjcqJlZu3AP2sysoDyKw8ysoDyKw8ysoAbNVG8zs3bjHLSZWUE5B21mVlDuQZuZFZTHQZuZFZR70GZmBeVRHGZmBeWbhGZmBVXEFEfeT/U2M2sLUcN/lUjaQdIjkv4p6Zh62+QetJkZjetBS+oETgc+DUwHJkv6c0Q8WGtZDtBmZjQ0B70p8M+IeBxA0h+B3YEFJ0DPf/tZtboNRSFpbESMb3U7rFj8uWisWmKOpLHA2LJd48t+FisDz5Qdmw58vJ42OQfdHsZWPsUGIX8uWiQixkfExmVb+S/K3gJ9Xd1zB2gzs8aaDqxa9n4VYEY9BTlAm5k11mRgDUmjJS0E7A38uZ6CCpuDtvdwntF6489FAUXEfEmHAdcCncCZEfFAPWWpiIOzzczMKQ4zs8JygDYzKygH6AGQ9H1J/5VenyjpU72cs62kKxtU33f7OfakpGUaVM9rjSjH6tOo77+kUZLub0RZ1hoO0A0SEcdHxF9zrqbPAG1mCx4H6BpJ+l5aBOWvwFpl+8+S9Pn0egdJD0u6FfhcH+V8RdIlkq6R9Jik/yk7to+k+yTdL+nktO8nwDBJ0yRNrNDGyyRNkfRAmvFU2v+apB9KukfSHZKWT/tHS7pd0mRJJw3g22MNJGlxSTdImpo+D7un/aMkPSTpd+lnfJ2kYenYRunneztwaEv/ATZgDtA1kLQR2ZjGDckC7ya9nLMI8DtgV2ArYIV+itwA2Av4KLCXpFUlrQScDHwyHd9E0piIOAaYGxEbRMR+FZp6YERsBGwMHCFp6bR/MeCOiFgfmAR8Le0/Dfh1RGwCPFehbGueN4E9IuJjwHbAKZJKs9TWAE6PiHWAl4E90/4/AEdExOZNb601nAN0bbYCLo2INyLiVXoffP5h4ImIeCyyMYzn9lPeDRHxSkS8SbaQygfIgv7NETE7IuYDE4Gta2znEZLuAe4gm9G0Rtr/NlDKh08BRqXXWwLnp9cTaqzL8iPgR5LuBf5KtsbD8unYExExLb2eAoySNBJYIiL+lvb7Z9nmPFGldtUMHK92cPlbZa+7yH4eA1okStK2wKeAzSPiDUk3A4ukw/Pi3YHvpfpKPCC+ePYDlgU2ioh5kp7k3Z9lz8/OMLLPjn+OCxD3oGszCdhD0jBJw8nSGD09DIyW9MH0fp8a6/gHsI2kZdK6svsApR7RPElDK1w/Evh3Cs4fBjaros7byFI3kAUFK4aRwKwUnLcj+wurTxHxMvCKpE+kXf5ZtjkH6BpExFTgAmAa8Cfgll7OeZNslbGr0k3Cp2qsYyZwLHATcA8wNSIuT4fHA/dWuEl4DTAk/Vl8Elmao5IjgUMlTSYLClYME4GNJd1FFmwfruKaA4DT003CuXk2zvLnqd5mZgXlHrSZWUE5QJuZFZQDtJlZQTlAm5kVlAO0mVlBOUDb+0jqSmt+3C/pIkmLDqCs8jVKzpC0dj/nbitpizrq6HUlv2pW+Kt15bjyFQzN8uYAbb0prfmxLtn08EPKD6YJNDWLiK9GxIP9nLItUHOANltQOUBbJbcAH0q925sknQfcJ6lT0k/TCnj3SjoYQJlfSnpQ0lXAcqWCJN0saeP0eoe0Sts9acW2UWS/CL6Zeu9bSVpW0p9SHZMlbZmuXTqt4Ha3pN9SxfT4vlb4S8dOSW25QdKyad8Hla00OEXSLWlWZs8yj0j/znsl/bG+b69Z37wWh/VJ0hBgR7LZiQCbAutGxBMpyL0SEZtIWhi4TdJ1ZCv9rUW2Qt/yZItAndmj3GXJVvzbOpW1VES8JOk3wGsR8bN03nnA/0bErZJWI3sI50eAccCtEXGipJ3JZm5WcmCqYxgwWdKfIuJFshX+pkbEtyUdn8o+jGzW5iER8ZikjwO/IlthsNwxwOiIeEvSElV9U81q4ABtvRkmqbRS2i3A78lSD3dGxBNp/2eA9Ur5ZbIp4muQrbx3fkR0ATMk3dhL+ZsBk0plRcRLfbTjU8Da766wyYi0BsrWpHW2I+IqSf+u4t90hKQ90uvSCn8vAt1k0/chW3nwEkmLp3/vRWV1L9xLmfcCEyVdBlxWRRvMauIAbb2ZGxEblO9Iger18l3A4RFxbY/zdqLyimrVrrrWQbYq33vWlEhtqXqNggor/PUUqd6Xe34PerEz2S+L3YD/lrROWiLWrCGcg7Z6XQv8Z2l1PUlrSlqMbMW/vVOOekWyheZ7up1sxb7R6dql0v45wPCy864jSzeQzisFzEmkldok7QgsWaGt/a3w1wGU/grYlyx18irwhKQvpDokaf3yAiV1AKtGxE3A0cASwOIV2mFWE/egrV5nkC34P1VZl3Y2MAa4lCxXex/wKO8ulfqOiJidctiXpEA3C/g0cAVwsbJHOx0OHEG2Mtu9ZJ/VSWQ3Ek8Azpc0NZX/dIW2XgMcksp5hPeu8Pc6sI6kKcArZE+4gewXwK8lHQcMBf5ItrpgSSdwrrJF8kWWK3+5QjvMauLV7MzMCsopDjOzgnKANjMrKAdoM7OCcoA2MysoB2gzs4JygDYzKygHaDOzgvp/HyntxAMn4Z8AAAAASUVORK5CYII=\n"
                    },
                    "metadata": {
                        "needs_background": "light"
                    }
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  10\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Create a k nearest neighbors object then  create a  <code>GridSearchCV</code> object  <code>knn_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "parameters = {'n_neighbors': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n              'algorithm': ['auto', 'ball_tree', 'kd_tree', 'brute'],\n              'p': [1,2]}\n\nKNN = KNeighborsClassifier()",
            "execution_count": 85,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "knn_cv=GridSearchCV(KNN,cv=10, param_grid=parameters).fit(X_train, Y_train)",
            "execution_count": 86,
            "outputs": []
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "print(\"tuned hpyerparameters :(best parameters) \",knn_cv.best_params_)\nprint(\"accuracy :\",knn_cv.best_score_)",
            "execution_count": 87,
            "outputs": [
                {
                    "output_type": "stream",
                    "text": "tuned hpyerparameters :(best parameters)  {'algorithm': 'auto', 'n_neighbors': 10, 'p': 1}\naccuracy : 0.8482142857142858\n",
                    "name": "stdout"
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  11\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Calculate the accuracy of tree_cv on the test data using the method <code>score</code>:\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "f1_score(Y_test,knn_cv.predict(X_test),average=\"weighted\")",
            "execution_count": 88,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 88,
                    "data": {
                        "text/plain": "0.8148148148148149"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "We can plot the confusion matrix\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "yhat = knn_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)",
            "execution_count": 89,
            "outputs": [
                {
                    "output_type": "display_data",
                    "data": {
                        "text/plain": "<Figure size 432x288 with 2 Axes>",
                        "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWgAAAEWCAYAAABLzQ1kAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAfzUlEQVR4nO3dd5xdVbnG8d8zkwABktA7mKCAAlKkSJEmFjpBVKpXAQ1caZYLgnKJgI2rcMUrlogIhIAUKVKkSDGAICEh9KbUkEACCAQIkMy894+9DhyGmTllzj5nn8zz5bM/c84ua63MHN5Z8+611lZEYGZmxdPR6gaYmVnvHKDNzArKAdrMrKAcoM3MCsoB2sysoBygzcwKygHaBkzSMElXSHpF0kUDKGc/Sdc1sm2tIOkvkr7c6nZY+3OAHkQk7SvpLkmvSZqZAsknGlD054HlgaUj4gv1FhIREyPiMw1oz3tI2lZSSLqkx/710/6bqyzn+5LOrXReROwYEWfX2VyzdzhADxKSvgX8HPgRWTBdDfgVsHsDiv8A8GhEzG9AWXmZDWwhaemyfV8GHm1UBcr4/ylrGH+YBgFJI4ETgUMj4pKIeD0i5kXEFRFxVDpnYUk/lzQjbT+XtHA6tq2k6ZK+LWlW6n0fkI6dABwP7JV65gf17GlKGpV6qkPS+69IelzSHElPSNqvbP+tZddtIWlySp1MlrRF2bGbJZ0k6bZUznWSlunn2/A2cBmwd7q+E/giMLHH9+o0Sc9IelXSFElbpf07AN8t+3feU9aOH0q6DXgDWD3t+2o6/mtJF5eVf7KkGySp6h+gDVoO0IPD5sAiwKX9nPM9YDNgA2B9YFPguLLjKwAjgZWBg4DTJS0ZEePIeuUXRMTiEfH7/hoiaTHgF8COETEc2AKY1st5SwFXpXOXBk4FrurRA94XOABYDlgI+K/+6gbOAf4jvf4s8AAwo8c5k8m+B0sB5wEXSVokIq7p8e9cv+yaLwFjgeHAUz3K+zawXvrlsxXZ9+7L4TUWrAoO0IPD0sALFVIQ+wEnRsSsiJgNnEAWeErmpePzIuJq4DVgrTrb0w2sK2lYRMyMiAd6OWdn4LGImBAR8yPifOBhYNeyc/4QEY9GxFzgQrLA2qeI+DuwlKS1yAL1Ob2cc25EvJjqPAVYmMr/zrMi4oF0zbwe5b0B7E/2C+Zc4PCImF6hPDPAAXqweBFYppRi6MNKvLf391Ta904ZPQL8G8DitTYkIl4H9gIOAWZKukrSh6toT6lNK5e9f66O9kwADgO2o5e/KFIa56GUVnmZ7K+G/lInAM/0dzAi7gQeB0T2i8SsKg7Qg8PtwJvAmH7OmUF2s69kNd7/53+1XgcWLXu/QvnBiLg2Ij4NrEjWK/5dFe0ptenZOttUMgH4OnB16t2+I6UgvkOWm14yIpYAXiELrAB9pSX6TVdIOpSsJz4DOLr+pttg4wA9CETEK2Q38k6XNEbSopKGStpR0v+k084HjpO0bLrZdjzZn+T1mAZsLWm1dIPy2NIBSctL2i3lot8iS5V09VLG1cCaaWjgEEl7AWsDV9bZJgAi4glgG7Kce0/DgflkIz6GSDoeGFF2/HlgVC0jNSStCfyALM3xJeBoSf2mYsxKHKAHiYg4FfgW2Y2/2WR/lh9GNrIBsiByF3AvcB8wNe2rp67rgQtSWVN4b1DtILtxNgN4iSxYfr2XMl4EdknnvkjW89wlIl6op009yr41Inr76+Ba4C9kQ++eIvurozx9UZqE86KkqZXqSSmlc4GTI+KeiHiMbCTIhNIIGbP+yDeTzcyKyT1oM7OCcoA2M2swSWemSV33l+37qaSHJd0r6VJJS1QqxwHazKzxzgJ26LHvemDdiFiP7D7HsT0v6skB2syswSJiEtlN8PJ915XNJbgDWKVSOf1NXGipA0d93ncvzawqZz558YDXNpn3wuNVx5yFlv3gwWTT+0vGR8T4Gqo7kGykU78KG6DNzIoqBeNaAvI7JH2PbLz9xErnOkCbmQF09zZfqrGUPchhF2D7ahbMcoA2MwPoync587Rk7XeAbXouM9AXB2gzMyCiu2FlSTof2JZskbLpwDiyURsLA9en5cDviIhD+ivHAdrMDKC7cQE6IvbpZXe/a6X3xgHazAyggT3oRnGANjODptwkrJUDtJkZuAdtZlZUkfMojno4QJuZQUNvEjaKA7SZGTjFYWZWWL5JaGZWUO5Bm5kVlG8SmpkVlG8SmpkVU4Rz0GZmxeQctJlZQTnFYWZWUO5Bm5kVVNe8VrfgfRygzczAKQ4zs8JyisPMrKDcgzYzKygHaDOzYgrfJDQzKyjnoM3MCsopDjOzgnIP2sysoNyDNjMrKPegzcwKar4X7DczK6YC9qA7Wt0AM7NC6O6ufqtA0pmSZkm6v2zfUpKul/RY+rpkpXIcoM3MIOtBV7tVdhawQ499xwA3RMQawA3pfb8coM3MoKE96IiYBLzUY/fuwNnp9dnAmErlOAdtZgbNyEEvHxEzASJipqTlKl3gAG1mBjWN4pA0Fhhbtmt8RIxvdJMcoM3MACJqODXGA7UG5OclrZh6zysCsypd4By0mRk0NAfdhz8DX06vvwxcXukC96DNzKChU70lnQ9sCywjaTowDvgJcKGkg4CngS9UKscB2swMGnqTMCL26ePQ9rWU4wBtZgbQ1dXqFryPA7SZGXg1OzOzwnKANjMrqAIuluQAbWYGRHf146CbxQHazAyc4jAzKyyP4jAzKyj3oM3MCsoB2moxZOGhHHPBiQxdeCgdnZ3c9Zfbufx/L2x1s6zF/LnISQ2LJTWLA3SBzX9rHj/d9wTeeuNNOod0cuzFP+C+m+/m8bsfa3XTrIX8ucjJYOhBS5oD9PmrKCJGNLrOBdlbb7wJQOeQTjqHdPbznbXBxJ+LHAyGYXYRMRxA0onAc8AEQMB+wPBG17egU0cH4648meU+sAI3TriWx6e5l2T+XOSigKM48lwP+rMR8auImBMRr0bEr4E9+7tA0lhJd0m665E5j+fYtPYR3d18f6ej+PbmBzN6/Q+x8pqrtrpJVgD+XDRedHdXvTVLngG6S9J+kjoldUjaD+j3V1REjI+IjSNi47WGr55j09rP3Fff4JE7HmDdbTZsdVOsQPy5aKDuqH5rkjwD9L7AF4Hn0/aFtM+qNHypEQwbsSgAQxdeiLW3XI/n/vVsi1tlrebPRU6iu/qtSXIbxRERT5I9ZtzqNHK5JTnolMPo6OhAHWLyVX/nnhuntLpZ1mL+XORkMNwkLJG0LPA1YFR5PRFxYF51LmimP/wUJ+x8VKubYQXjz0VO5hfvJmGe46AvB24B/kqF3LOZWcsNsuVGF42I7+RYvplZ4xQwxZHnTcIrJe2UY/lmZg1TxGF2efagjwS+K+ktYB7ZZJXwTEIzK6QC9qDzHMXhWYNm1j4GU4AGkLQksAawSGlfREzKs04zs7oUcKp3nsPsvkqW5lgFmAZsBtwOfDKvOs3M6lXEZxLmeZPwSGAT4KmI2A7YEJidY31mZvUr4FTvPFMcb0bEm5KQtHBEPCxprRzrMzOr32BYD7rMdElLAJcB10v6NzAjx/rMzOpXwBRHnqM49kgvvy/pJmAkcE1e9ZmZDUgDA7SkbwJfJXuUwn3AARHxZq3l5PFElaV62X1f+ro48FKj6zQzG6joakyKQ9LKwBHA2hExV9KFwN7AWbWWlUcPegrZbw2V7Su9D8ALPZtZ8TQ2xTEEGCZpHrAodaZ383jk1ehGl2lmlrdahtlJGguMLds1PiLGA0TEs5J+BjwNzAWui4jr6mmTn+ptZgY19aBTMB7f27E0QW93YDTwMnCRpP0j4txam5TnOGgzs/bRXcPWv08BT0TE7IiYB1wCbFFPk9yDNjMDYn7DxkE/DWwmaVGyFMf2wF31FJRbD1rShGr2mZkVQoN60BHxD+BiYCrZCLYO+kiHVJJnD3qd8jeSOoGNcqzPzKxujVyLIyLGAeMGWk7De9CSjpU0B1hP0quS5qT3s8geg2VmVjyNy0E3TMMDdET8OK0F/dOIGBERw9O2dEQc2+j6zMwaIbqj6q1Z8pzqfayk3YCt066bI+LKvOozMxuQ4q2VlOt60D8GNgUmpl1HStrSvWgzK6KY3+oWvF+eNwl3BjaIyJ5lLuls4G7AAdrMCicK2IOuKQctaUlJ69VwyRJlr0fWUpeZWVMV8CZhxR60pJuB3dK504DZkv4WEd+qcOmPgbvTUqMiy0W792xmhVTEHnQ1KY6REfFqesbgHyJinKR7K10UEeen4L4JWYD+TkQ8N7Dmmpnlo4gBupoUxxBJKwJfBGodhdEBvAD8G1hT0tYVzjcza4noUtVbs1TTgz4RuBa4NSImS1odeKzSRZJOBvYCHuDdrE0Ak+psq5lZborYg64YoCPiIuCisvePA3tWUfYYYK2IeKv+5pmZNUd0N69nXK0+A7Sk/yPr8fYqIo6oUPbjwFDAAdrMCq/detB1LY9X5g1gmqQbKAvSVQR2M7Omi2ijHnREnF3+XtJiEfF6DWX/OW1mZoXXbj1oACRtDvye7Incq0laHzg4Ir7e33U9A7yZWZF1N3F0RrWqGWb3c+CzwIsAEXEP7y6AZGa2QIhuVb01S1VrcUTEM9J7GtWVT3PMzFqjrUZxlHlG0hZASFoIOAJ4KN9mmZk1VzRvmeeqVROgDwFOA1YGniWbtHJoXydLuoL+h+ftVmMbzcxy15Y96Ih4AdivhjJ/lr5+DlgBODe93wd4spbGmZk1S1sNsytJU7tPAzYj6xnfDnwzzSh8n4j4W7rupIgov5l4hSRP8zazQupq01Ec5wEXAisCK5FN+z6/iuuWTcEdAEmjgWXraaSZWd4iVPXWLNXkoBURE8renyvpsCqu+yZws6RST3sUcHCN7TMza4q2ykFLWiq9vEnSMcAfyVIcewFXVSo4Iq6RtAbw4bTrYS+cZGZF1W6jOKaQBeTSr5Xy3m8AJ/V2kaRPRsSNkj7X49AHJRERl9TdWjOznLRVDzoiRtdZ5jbAjcCuvRULOECbWeF0ddf0iNamqGomoaR1gbWBRUr7IuKc3s6NiHHp6wGNaKCZWTO0W4oDAEnjgG3JAvTVwI7ArUCvAVpSvw+TjYhTa26lmVnOuhs4OkPSEsAZwLpkmYMDI+L2Wsuppgf9eWB94O6IOEDS8qnivgxPX9cie2BsacnRXfHjrsysoBo8fO404JqI+HxaImPRegqpJkDPjYhuSfMljQBmAav3dXJEnAAg6TrgYxExJ73/PmWPzjIzK5JGpThSnNwa+EpWbrwNvF1PWdUE6LtSd/13ZCM7XgPurOK61Xo06m2ysdBVOWdGzX8N2CAwd8YtrW6CLaBqSXFIGguMLds1PiLGp9erA7OBP6T186cAR9b4wBOgurU4Sgvz/0bSNcCIiLi3irInAHdKupQsB7MH4EX8zayQahnFkYLx+D4ODwE+BhweEf+QdBpwDPDftbapv4kqH+vvWERM7a/giPihpL8AW6VdB0TE3bU20MysGRo4iGM6MD0i/pHeX0wWoGvWXw/6lH6OBfDJSoWnIN5vIDczK4JGjeKIiOckPSNprYh4BNgeeLCesvqbqLJdvQ00M2s3DR7FcTgwMY3geByoa15IVRNVzMwWdI18qHdETAM2Hmg5DtBmZkDQRmtxmJkNJvML+ESViuNKlNlf0vHp/WqSNs2/aWZmzROo6q1Zqhn49ytgc7JnCgLMAU7PrUVmZi3QXcPWLNWkOD4eER+TdDdARPw73Zk0M1tgtGsOep6kTtI4bknL0txfImZmuStiUKsmQP8CuBRYTtIPyVa3Oy7XVpmZNVlXO/agI2KipClks2EEjImIh3JvmZlZExXwiVdVLdi/GvAGcEX5voh4Os+GmZk1U3c79qDJnuBdenjsIsBo4BFgnRzbZWbWVAV84lVVKY6Plr9Pq9wd3MfpZmZtqV1vEr5HREyVtEkejTEza5VutWGKo8dDYDvIFqKenVuLzMxaoKvVDehFNT3o4WWv55PlpP+UT3PMzFqj7UZxpAkqi0fEUU1qj5lZS7TVKA5JQyJifn+PvjIzW1C02yiOO8nyzdMk/Rm4CHjnqbQRcUnObTMza5q2S3EkSwEvkj2DsDQeOgAHaDNbYLTbMLvl0giO+3k3MJcU8a8BM7O6dbVZD7oTWBx6zZw7QJvZAqXdetAzI+LEprXEzKyF2i1AF7DDb2aWjwI+krDfAL1901phZtZibdWDjoiXmtkQM7NWatep3mZmC7x2HQdtZrbAa6sUh5nZYFLEAN3R6gaYmRVB1LBVQ1KnpLslXVlvm9yDNjMjlxz0kcBDwIh6C3AP2syMbBRHtVslklYBdgbOGEibHKDNzIBuoupN0lhJd5VtY3sU93PgaAaY2naKw8yM2iJpRIwHxvd2TNIuwKyImCJp24G0yQHazIyGrgC3JbCbpJ2ARYARks6NiP1rLcgpDjMzsh50tVt/IuLYiFglIkYBewM31hOcwT1oMzMA5qt4qyg7QJuZkc8i9xFxM3Bzvdc7QJuZUcyZhA7QZmZkw+yKxgHazIxiPsfPAdrMDKc4zMwKq6uAfWgHaDMz3IM2MyuscA/azKyYitiD9lTvgvvsZ7blgfsn8fCDt3L0UYe2ujnWIsf96FS23nlvxux/yDv7fvbLM9h1n6+xx3/8J0cceyKvznmthS1sf7WsZtcsDtAF1tHRwS9O+yG77Lo/H11/O/baawwf+cgarW6WtcCYnT7Nb079wXv2bb7Jhlw64Tdces6vGbXqypwx4YIWtW7B0OgnqjSCA3SBbbrJhvzrX0/yxBNPM2/ePC688HJ22/WzrW6WtcDGG3yUkSOGv2fflh/fiCFDOgFYb50P8/ysF1rRtAXGfKLqrVkcoAtspZVX4JnpM955P/3Zmay00gotbJEV1aVXXccnNt+k1c1oa1HDf82Sy01CSZ/r73hEXNLHdWOBsQDqHElHx2I5tK59SO9/SFpE8e40W2v99uzz6ezsZJfPbNfqprS1It4kzGsUx67p63LAFsCN6f12ZCs79Rqgy59SMGShlQd9JHp2+kxWXWWld96vsvKKzJz5fAtbZEVz+dXXM+m2OznjFz/u9Re6Va+Iw+xySXFExAERcQBZPn3tiNgzIvYE1smjvgXV5Lum8aEPjWbUqFUZOnQoX/zi7lxx5XWtbpYVxK133MXvJ17E/508jmGLLNLq5rS9Ri3Y30h5j4MeFREzy94/D6yZc50LjK6uLo78xnFcfdV5dHZ0cNbZF/Dgg4+2ulnWAkeN+wmT776Xl19+le3H7M/XD/oSZ0y4gLfnzeNr3/gekN0oHHf04S1uafvqKmD6UHnmNCX9ElgDOJ+sN7038M+IqPgpcorDejN3xi2tboIV0NBlVh9wfmffD+xRdcw576lLm5JPyrUHHRGHSdoD2DrtGh8Rl+ZZp5lZPYqYg27GVO+pwJyI+KukRSUNj4g5TajXzKxqRRzFkes4aElfAy4Gfpt2rQxclmedZmb1GIxTvQ8FtgReBYiIx8iG3pmZFcqgmahS5q2IeLs0PlPSEIr5ZBkzG+SKOIoj7wD9N0nfBYZJ+jTwdeCKnOs0M6tZER8am3eK4xhgNnAfcDBwNXBcznWamdVs0E1UiYhu4HdpMzMrrEEzzE7SffSTa46I9fKo18ysXkVMceTVg94lfS09AmRC+rof8EZOdZqZ1a2IK0XmEqAj4ikASVtGxJZlh46RdBtwYh71mpnVq6tBPWhJqwLnACuQpazHR8Rp9ZSV903CxSR9ovRG0hbA4F7k2cwKqYETVeYD346IjwCbAYdKWrueNuU9zO4g4ExJI9P7l4EDc67TzKxmjUpxpBU8Z6bXcyQ9RDaL+sFay8p7FMcUYH1JI8hWznslz/rMzOqVx01CSaOADYF/1HN9rgFa0sLAnsAoYEhpRmFEOAdtZoVSyzC78sfzJePTE6HKz1kc+BPwjYh4tZ425Z3iuBx4BZgCvJVzXWZmdatlqnf54/l6I2koWXCe2NczWKuRd4BeJSJ2yLkOM7MBa1SKQ1mq4PfAQxFx6kDKynsUx98lfTTnOszMBqyBozi2BL4EfFLStLTtVE+b8u5BfwL4iqQnyFIcAsIzCc2saBo4iuNWslg3YHkH6B1zLt/MrCEG01Rv4D0zCpcD/Fx4MyusQbNYUomk3YBTgJWAWcAHgIeAdfKs18ysVl1RvKcS5n2T8CSyqY6PRsRoYHvgtpzrNDOrWURUvTVL3gF6XkS8CHRI6oiIm4ANcq7TzKxmRXxobN43CV9Os2kmARMlzSJbSMTMrFCKmIPOuwe9OzAX+CZwDfAvYNec6zQzq1l3RNVbs+Q9iuP1srdn51mXmdlAFLEHndcjr+bQ+yOvShNVRuRRr5lZvYo4iiOvJ6oMz6NcM7O8NDN1Ua28bxKambWFQZPiMDNrN+5Bm5kVlHvQZmYF1RVdrW7C+zhAm5nRuOVGG8kB2syMQbjcqJlZu3AP2sysoDyKw8ysoDyKw8ysoAbNVG8zs3bjHLSZWUE5B21mVlDuQZuZFZTHQZuZFZR70GZmBeVRHGZmBeWbhGZmBVXEFEfeT/U2M2sLUcN/lUjaQdIjkv4p6Zh62+QetJkZjetBS+oETgc+DUwHJkv6c0Q8WGtZDtBmZjQ0B70p8M+IeBxA0h+B3YEFJ0DPf/tZtboNRSFpbESMb3U7rFj8uWisWmKOpLHA2LJd48t+FisDz5Qdmw58vJ42OQfdHsZWPsUGIX8uWiQixkfExmVb+S/K3gJ9Xd1zB2gzs8aaDqxa9n4VYEY9BTlAm5k11mRgDUmjJS0E7A38uZ6CCpuDtvdwntF6489FAUXEfEmHAdcCncCZEfFAPWWpiIOzzczMKQ4zs8JygDYzKygH6AGQ9H1J/5VenyjpU72cs62kKxtU33f7OfakpGUaVM9rjSjH6tOo77+kUZLub0RZ1hoO0A0SEcdHxF9zrqbPAG1mCx4H6BpJ+l5aBOWvwFpl+8+S9Pn0egdJD0u6FfhcH+V8RdIlkq6R9Jik/yk7to+k+yTdL+nktO8nwDBJ0yRNrNDGyyRNkfRAmvFU2v+apB9KukfSHZKWT/tHS7pd0mRJJw3g22MNJGlxSTdImpo+D7un/aMkPSTpd+lnfJ2kYenYRunneztwaEv/ATZgDtA1kLQR2ZjGDckC7ya9nLMI8DtgV2ArYIV+itwA2Av4KLCXpFUlrQScDHwyHd9E0piIOAaYGxEbRMR+FZp6YERsBGwMHCFp6bR/MeCOiFgfmAR8Le0/Dfh1RGwCPFehbGueN4E9IuJjwHbAKZJKs9TWAE6PiHWAl4E90/4/AEdExOZNb601nAN0bbYCLo2INyLiVXoffP5h4ImIeCyyMYzn9lPeDRHxSkS8SbaQygfIgv7NETE7IuYDE4Gta2znEZLuAe4gm9G0Rtr/NlDKh08BRqXXWwLnp9cTaqzL8iPgR5LuBf5KtsbD8unYExExLb2eAoySNBJYIiL+lvb7Z9nmPFGldtUMHK92cPlbZa+7yH4eA1okStK2wKeAzSPiDUk3A4ukw/Pi3YHvpfpKPCC+ePYDlgU2ioh5kp7k3Z9lz8/OMLLPjn+OCxD3oGszCdhD0jBJw8nSGD09DIyW9MH0fp8a6/gHsI2kZdK6svsApR7RPElDK1w/Evh3Cs4fBjaros7byFI3kAUFK4aRwKwUnLcj+wurTxHxMvCKpE+kXf5ZtjkH6BpExFTgAmAa8Cfgll7OeZNslbGr0k3Cp2qsYyZwLHATcA8wNSIuT4fHA/dWuEl4DTAk/Vl8Elmao5IjgUMlTSYLClYME4GNJd1FFmwfruKaA4DT003CuXk2zvLnqd5mZgXlHrSZWUE5QJuZFZQDtJlZQTlAm5kVlAO0mVlBOUDb+0jqSmt+3C/pIkmLDqCs8jVKzpC0dj/nbitpizrq6HUlv2pW+Kt15bjyFQzN8uYAbb0prfmxLtn08EPKD6YJNDWLiK9GxIP9nLItUHOANltQOUBbJbcAH0q925sknQfcJ6lT0k/TCnj3SjoYQJlfSnpQ0lXAcqWCJN0saeP0eoe0Sts9acW2UWS/CL6Zeu9bSVpW0p9SHZMlbZmuXTqt4Ha3pN9SxfT4vlb4S8dOSW25QdKyad8Hla00OEXSLWlWZs8yj0j/znsl/bG+b69Z37wWh/VJ0hBgR7LZiQCbAutGxBMpyL0SEZtIWhi4TdJ1ZCv9rUW2Qt/yZItAndmj3GXJVvzbOpW1VES8JOk3wGsR8bN03nnA/0bErZJWI3sI50eAccCtEXGipJ3JZm5WcmCqYxgwWdKfIuJFshX+pkbEtyUdn8o+jGzW5iER8ZikjwO/IlthsNwxwOiIeEvSElV9U81q4ABtvRkmqbRS2i3A78lSD3dGxBNp/2eA9Ur5ZbIp4muQrbx3fkR0ATMk3dhL+ZsBk0plRcRLfbTjU8Da766wyYi0BsrWpHW2I+IqSf+u4t90hKQ90uvSCn8vAt1k0/chW3nwEkmLp3/vRWV1L9xLmfcCEyVdBlxWRRvMauIAbb2ZGxEblO9Iger18l3A4RFxbY/zdqLyimrVrrrWQbYq33vWlEhtqXqNggor/PUUqd6Xe34PerEz2S+L3YD/lrROWiLWrCGcg7Z6XQv8Z2l1PUlrSlqMbMW/vVOOekWyheZ7up1sxb7R6dql0v45wPCy864jSzeQzisFzEmkldok7QgsWaGt/a3w1wGU/grYlyx18irwhKQvpDokaf3yAiV1AKtGxE3A0cASwOIV2mFWE/egrV5nkC34P1VZl3Y2MAa4lCxXex/wKO8ulfqOiJidctiXpEA3C/g0cAVwsbJHOx0OHEG2Mtu9ZJ/VSWQ3Ek8Azpc0NZX/dIW2XgMcksp5hPeu8Pc6sI6kKcArZE+4gewXwK8lHQcMBf5ItrpgSSdwrrJF8kWWK3+5QjvMauLV7MzMCsopDjOzgnKANjMrKAdoM7OCcoA2MysoB2gzs4JygDYzKygHaDOzgvp/HyntxAMn4Z8AAAAASUVORK5CYII=\n"
                    },
                    "metadata": {
                        "needs_background": "light"
                    }
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## TASK  12\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Find the method performs best:\n"
        },
        {
            "metadata": {},
            "cell_type": "code",
            "source": "KNN",
            "execution_count": 90,
            "outputs": [
                {
                    "output_type": "execute_result",
                    "execution_count": 90,
                    "data": {
                        "text/plain": "KNeighborsClassifier()"
                    },
                    "metadata": {}
                }
            ]
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## Authors\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "<a href=\"https://www.linkedin.com/in/joseph-s-50398b136/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDS0321ENSkillsNetwork26802033-2021-01-01\">Joseph Santarcangelo</a> has a PhD in Electrical Engineering, his research focused on using machine learning, signal processing, and computer vision to determine how videos impact human cognition. Joseph has been working for IBM since he completed his PhD.\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "## Change Log\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "| Date (YYYY-MM-DD) | Version | Changed By    | Change Description      |\n| ----------------- | ------- | ------------- | ----------------------- |\n| 2021-08-31        | 1.1     | Lakshmi Holla | Modified markdown       |\n| 2020-09-20        | 1.0     | Joseph        | Modified Multiple Areas |\n"
        },
        {
            "metadata": {},
            "cell_type": "markdown",
            "source": "Copyright \u00a9 2020 IBM Corporation. All rights reserved.\n"
        }
    ],
    "metadata": {
        "kernelspec": {
            "name": "python3",
            "display_name": "Python 3.7",
            "language": "python"
        },
        "language_info": {
            "name": "python",
            "version": "3.7.11",
            "mimetype": "text/x-python",
            "codemirror_mode": {
                "name": "ipython",
                "version": 3
            },
            "pygments_lexer": "ipython3",
            "nbconvert_exporter": "python",
            "file_extension": ".py"
        }
    },
    "nbformat": 4,
    "nbformat_minor": 4
}