1_Cleaning_Processing_EDA.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##  Project Overall Objects\n",
    "\n",
    "This notebook file would approach and achieve the objects highlighted in **black**. Those in *<font color=grey>grey</font>* would be accomplished in later analysis.\n",
    "\n",
    "- Clean dirty log data and transform it for analytics.\n",
    "- Exploratory Data Analysis (EDA)\n",
    "- Find the conversion rate of users, identify key factors that bottleneck the conversion rate.\n",
    "\n",
    "- <font color=grey> Propose any hypothesis and test through analyzing features. </font>\n",
    "- <font color=grey> Build machine learning models to predict user behaviors, including but not limited to signup, churn, etc. </font>\n",
    "- <font color=grey> Discover interesting insights in the dataset and suggest how to improve the user signup rate. </font>\n",
    "\n",
    "This notebook file is meant to facilitate the analyst to dive deep into the dataset, given the results from Summary_Statistics. Some of the analysis might appear to be repetitive and or similar to what has been achieved in 0_Summary_Statistics, but the analysis are in fact being applied on different parts/keys of the whole dataset. \n",
    "\n",
    "The previous step is to give the analyst a quick understanding of the overall performance of the given dataset by looking into the distribution of data within each type. In this phase, we would be doing real data cleaning, and EDA to transform the dataset into one that's more readable and understandable for members in other teams. \n",
    "\n",
    "The outpuf of this notebook is a well-cleaned dataset, after EDA, with most of the originally features/keys remaining, together with a conversion rate chart of different events."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import json\n",
    "import os\n",
    "import datetime\n",
    "import numpy as np\n",
    "import warnings\n",
    "warnings.filterwarnings('ignore')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "def to_date(epoch):\n",
    "    return datetime.datetime.fromtimestamp(epoch/1000).strftime(\"%Y-%m-%d\")\n",
    "# first convert from milliseconds to seconds, and then convert format from time stamp"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# this finds our txt files\n",
    "filename = \"data/UBA_sample_data.txt\"\n",
    "data = []\n",
    "for line in open(filename, 'r'):\n",
    "    data.append(json.loads(line))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "75092"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# total number of rows\n",
    "len(data)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "hash: change from browser and cookie id to protect user privacy, randomnized id, can be used to conduct unbiased experiments/tran test split"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "# here I define my pandas Dataframe with the columns I want to get from the text\n",
    "# If any of the following features are out of your interest\n",
    "# simple just remove the array creation here, and the value assignment in the following cell.\n",
    "nocache = []\n",
    "dist_id = []\n",
    "event = []\n",
    "\n",
    "browser = []\n",
    "browser_v = []\n",
    "ip = []\n",
    "is_fd = []\n",
    "is_ft = []\n",
    "latest_r = []\n",
    "latest_rh = []\n",
    "latest_ch = []\n",
    "latest_utm_campaign = []\n",
    "latest_utm_content = []\n",
    "latest_utm_m = []\n",
    "latest_utm_s = []\n",
    "latest_utm_t = []\n",
    "model = []\n",
    "os = []\n",
    "os_version = []\n",
    "screen_h = []\n",
    "screen_w = []\n",
    "session_r = []\n",
    "session_rh = []\n",
    "time = []\n",
    "day = []\n",
    "\n",
    "pageP = []\n",
    "pageS = []\n",
    "pageUrl = []\n",
    "session_p = []\n",
    "name = []\n",
    "requestBtn = []\n",
    "isSuccess = []\n",
    "isMsg = []\n",
    "page = []\n",
    "site_url = []\n",
    "from_url = []\n",
    "referrerUrl = []\n",
    "referrHostUrl = []\n",
    "siteUrl = []\n",
    "url_path = []\n",
    "url = []\n",
    "title = []\n",
    "result = []\n",
    "referrer = []\n",
    "refer_Host = []\n",
    "title = []\n",
    "ch = []\n",
    "tp = []"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "#define NA and use get to assign NA when the key value not found \n",
    "na = None\n",
    "\n",
    "for i in range(len(data)):\n",
    "    tp.append(data[i].get('type',na))\n",
    "    nocache.append(data[i].get('_nocache',na)) \n",
    "    dist_id.append(data[i]['distinct_id'])\n",
    "    event.append(data[i].get('event',na))\n",
    "    pageP.append(data[i]['properties'].get('pagePosition',na))\n",
    "    pageS.append(data[i]['properties'].get('pageStayTime',na))\n",
    "    pageUrl.append(data[i]['properties'].get('pageUrl',na))\n",
    "    session_p.append(data[i]['properties'].get('session_page_url',na))\n",
    "    latest_r.append(data[i]['properties'].get('$latest_referrer',na)) \n",
    "    latest_rh.append(data[i]['properties'].get('$latest_referrer_host',na))\n",
    "    latest_ch.append(data[i]['properties'].get('_latest_ch',na))\n",
    "    latest_utm_campaign.append(data[i]['properties'].get('$latest_utm_campaign',na))\n",
    "    latest_utm_content.append(data[i]['properties'].get('$latest_utm_content',na))\n",
    "    latest_utm_m.append(data[i]['properties'].get('$latest_utm_medium',na))\n",
    "    latest_utm_s.append(data[i]['properties'].get('$latest_utm_source',na))\n",
    "    latest_utm_t.append(data[i]['properties'].get('$latest_utm_term',na))\n",
    "    name.append(data[i]['properties'].get('name',na))\n",
    "    requestBtn.append(data[i]['properties'].get('requestBtn',na))\n",
    "    isSuccess.append(data[i]['properties'].get('isSuccess',na))\n",
    "    isMsg.append(data[i]['properties'].get('isMsg',na))\n",
    "    page.append(data[i]['properties'].get('page',na))\n",
    "    site_url.append(data[i]['properties'].get('site_url',na))\n",
    "    from_url.append(data[i]['properties'].get('from_url',na))\n",
    "    referrerUrl.append(data[i]['properties'].get('referrerUrl',na))\n",
    "    referrHostUrl.append(data[i]['properties'].get('referrHostUrl',na))\n",
    "    siteUrl.append(data[i]['properties'].get('siteUrl',na))\n",
    "    url_path.append(data[i]['properties'].get('$url_path',na))\n",
    "    url.append(data[i]['properties'].get('$url',na))\n",
    "    result.append(data[i]['properties'].get('result',na))\n",
    "    referrer.append(data[i]['properties'].get('$referrer',na))\n",
    "    refer_Host.append(data[i]['properties'].get('$referrer_host',na))\n",
    "    title.append(data[i]['properties'].get('$title',na))\n",
    "    ch.append(data[i]['properties'].get('$referrer_host',na))        \n",
    "    browser.append(data[i]['properties'].get('$browser',na)) \n",
    "    browser_v.append(data[i]['properties'].get('$browser_version',na)) \n",
    "    ip.append(data[i]['properties'].get('$ip',na)) \n",
    "    is_fd.append(data[i]['properties'].get('$is_first_day',na)) \n",
    "    is_ft.append(data[i]['properties'].get('$is_first_time',na))      \n",
    "    model.append(data[i]['properties'].get('$model',na))\n",
    "    os.append(data[i]['properties'].get('$os',na))\n",
    "    os_version.append(data[i]['properties'].get('$os_version',na))\n",
    "    screen_h.append(data[i]['properties'].get('$screen_height',na))\n",
    "    screen_w.append(data[i]['properties'].get('$screen_width',na))\n",
    "    session_r.append(data[i]['properties'].get('_session_referrer',na))\n",
    "    session_rh.append(data[i]['properties'].get('_session_referrer_host',na))\n",
    "    time.append(data[i]['time'])\n",
    "    day.append(to_date(data[i]['time']))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "#generate pandas dataframe\n",
    "df = pd.DataFrame({'nocache':nocache, \n",
    "    'dist_id': dist_id,\n",
    "    'event':event,\n",
    "    'browser':browser,\n",
    "    'browser_v':browser_v,\n",
    "    'ip':ip,\n",
    "    'is_fd':is_fd,\n",
    "    'is_ft':is_ft,\n",
    "    'latest_r':latest_r,\n",
    "    'latest_rh':latest_rh,\n",
    "    'latest_ch':latest_ch,\n",
    "    'latest_utm_campaign':latest_utm_campaign,\n",
    "    'latest_utm_content':latest_utm_content,\n",
    "    'latest_utm_m':latest_utm_m,\n",
    "    'latest_utm_s':latest_utm_s,\n",
    "    'latest_utm_t':latest_utm_t,\n",
    "    'model':model,\n",
    "    'os':os,\n",
    "    'os_version':os_version,\n",
    "    'screen_h':screen_h,\n",
    "    'screen_w':screen_w,\n",
    "    'screen_r':session_r,\n",
    "    'screen_rh':session_rh,\n",
    "    'time':time,\n",
    "    'pageP':pageP,\n",
    "    'pageS':pageS,\n",
    "    'pageUrl':pageUrl,\n",
    "    'session_p':session_p,\n",
    "    'name':name,\n",
    "    'requestBtn':requestBtn,\n",
    "    'isSuccess':isSuccess,\n",
    "    'isMsg':isMsg,\n",
    "    'page':page,\n",
    "    'site_url':site_url,\n",
    "    'from_url':from_url,\n",
    "    'referrerUrl':referrerUrl,\n",
    "    'referrHostUrl':referrHostUrl,\n",
    "    'siteUrl':siteUrl,\n",
    "    'url_path':url_path,\n",
    "    'url':url,\n",
    "    'title':title,\n",
    "    'result':result,\n",
    "    'referrer':referrer,\n",
    "    'refer_Host':refer_Host,\n",
    "    'ch':ch,\n",
    "    'tp':tp,\n",
    "    'day':day})"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>browser</th>\n",
       "      <th>browser_v</th>\n",
       "      <th>ch</th>\n",
       "      <th>day</th>\n",
       "      <th>dist_id</th>\n",
       "      <th>event</th>\n",
       "      <th>from_url</th>\n",
       "      <th>ip</th>\n",
       "      <th>isMsg</th>\n",
       "      <th>isSuccess</th>\n",
       "      <th>...</th>\n",
       "      <th>screen_rh</th>\n",
       "      <th>screen_w</th>\n",
       "      <th>session_p</th>\n",
       "      <th>siteUrl</th>\n",
       "      <th>site_url</th>\n",
       "      <th>time</th>\n",
       "      <th>title</th>\n",
       "      <th>tp</th>\n",
       "      <th>url</th>\n",
       "      <th>url_path</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>chrome</td>\n",
       "      <td>56</td>\n",
       "      <td>None</td>\n",
       "      <td>2017-03-06</td>\n",
       "      <td>595466e9a8e733434ce08de16e927d985e0b5d48</td>\n",
       "      <td>index_leave</td>\n",
       "      <td>None</td>\n",
       "      <td>219.135.131.99</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>...</td>\n",
       "      <td>www.baidu.com</td>\n",
       "      <td>1280.0</td>\n",
       "      <td>https://www.sensorsdata.cn/?utm_source=baidu&amp;u...</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>1488791047953</td>\n",
       "      <td>None</td>\n",
       "      <td>track</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>2017-03-31</td>\n",
       "      <td>9939d3e087bca29c42334d96dccd25ca0e06652a</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>...</td>\n",
       "      <td>None</td>\n",
       "      <td>NaN</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>1490958296645</td>\n",
       "      <td>None</td>\n",
       "      <td>profile_set_once</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>chrome</td>\n",
       "      <td>56</td>\n",
       "      <td></td>\n",
       "      <td>2017-03-06</td>\n",
       "      <td>9939d3e087bca29c42334d96dccd25ca0e06652a</td>\n",
       "      <td>$pageview</td>\n",
       "      <td>None</td>\n",
       "      <td>111.204.198.242</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td>1366.0</td>\n",
       "      <td>https://sensorsdata.cn/?ch=demo</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>1488791050856</td>\n",
       "      <td>神策数据 | Sensors Data - 国内领先的用户行为分析产品</td>\n",
       "      <td>track</td>\n",
       "      <td>https://sensorsdata.cn/?ch=demo</td>\n",
       "      <td>/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>chrome</td>\n",
       "      <td>56</td>\n",
       "      <td>None</td>\n",
       "      <td>2017-03-06</td>\n",
       "      <td>9939d3e087bca29c42334d96dccd25ca0e06652a</td>\n",
       "      <td>btnClick</td>\n",
       "      <td>None</td>\n",
       "      <td>111.204.198.242</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td>1366.0</td>\n",
       "      <td>https://sensorsdata.cn/?ch=demo</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>1488791051772</td>\n",
       "      <td>None</td>\n",
       "      <td>track</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>chrome</td>\n",
       "      <td>56</td>\n",
       "      <td>None</td>\n",
       "      <td>2017-03-06</td>\n",
       "      <td>9939d3e087bca29c42334d96dccd25ca0e06652a</td>\n",
       "      <td>btnClick</td>\n",
       "      <td>None</td>\n",
       "      <td>111.204.198.242</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>...</td>\n",
       "      <td></td>\n",
       "      <td>1366.0</td>\n",
       "      <td>https://sensorsdata.cn/?ch=demo</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>1488791056032</td>\n",
       "      <td>None</td>\n",
       "      <td>track</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 47 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "  browser browser_v    ch         day  \\\n",
       "0  chrome        56  None  2017-03-06   \n",
       "1    None      None  None  2017-03-31   \n",
       "2  chrome        56        2017-03-06   \n",
       "3  chrome        56  None  2017-03-06   \n",
       "4  chrome        56  None  2017-03-06   \n",
       "\n",
       "                                    dist_id        event from_url  \\\n",
       "0  595466e9a8e733434ce08de16e927d985e0b5d48  index_leave     None   \n",
       "1  9939d3e087bca29c42334d96dccd25ca0e06652a         None     None   \n",
       "2  9939d3e087bca29c42334d96dccd25ca0e06652a    $pageview     None   \n",
       "3  9939d3e087bca29c42334d96dccd25ca0e06652a     btnClick     None   \n",
       "4  9939d3e087bca29c42334d96dccd25ca0e06652a     btnClick     None   \n",
       "\n",
       "                ip isMsg isSuccess   ...         screen_rh screen_w  \\\n",
       "0   219.135.131.99  None      None   ...     www.baidu.com   1280.0   \n",
       "1             None  None      None   ...              None      NaN   \n",
       "2  111.204.198.242  None      None   ...                     1366.0   \n",
       "3  111.204.198.242  None      None   ...                     1366.0   \n",
       "4  111.204.198.242  None      None   ...                     1366.0   \n",
       "\n",
       "                                           session_p siteUrl site_url  \\\n",
       "0  https://www.sensorsdata.cn/?utm_source=baidu&u...    None     None   \n",
       "1                                               None    None     None   \n",
       "2                    https://sensorsdata.cn/?ch=demo    None     None   \n",
       "3                    https://sensorsdata.cn/?ch=demo    None     None   \n",
       "4                    https://sensorsdata.cn/?ch=demo    None     None   \n",
       "\n",
       "            time                                title                tp  \\\n",
       "0  1488791047953                                 None             track   \n",
       "1  1490958296645                                 None  profile_set_once   \n",
       "2  1488791050856  神策数据 | Sensors Data - 国内领先的用户行为分析产品             track   \n",
       "3  1488791051772                                 None             track   \n",
       "4  1488791056032                                 None             track   \n",
       "\n",
       "                               url url_path  \n",
       "0                             None     None  \n",
       "1                             None     None  \n",
       "2  https://sensorsdata.cn/?ch=demo        /  \n",
       "3                             None     None  \n",
       "4                             None     None  \n",
       "\n",
       "[5 rows x 47 columns]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Create Pandas DataFrame filters based on different events\n",
    "df_ileave = df.loc[df.event == 'index_leave']\n",
    "df_btnclick = df.loc[df.event == 'btnClick']\n",
    "df_aleave = df.loc[df.event == 'about_leave']\n",
    "df_form = df.loc[df.event == 'formSubmit']\n",
    "df_submit = df.loc[df.event == 'clickSubmit']\n",
    "df_cleave = df.loc[df.event == 'courses_leave']\n",
    "df_dleave = df.loc[df.event == 'demo_leave']\n",
    "df_playleave = df.loc[df.event == 'courses_play_leave']\n",
    "df_close = df.loc[df.event == 'page_close']\n",
    "df_view = df.loc[df.event == '$pageview']\n",
    "df_send = df.loc[df.event == 'click_send_cellphone']\n",
    "df_verify = df.loc[df.event == 'verify_cellphone_code']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "# save DataFrame to csv file\n",
    "ileave = 'data/index_leave.csv'\n",
    "df_ileave.to_csv(ileave, index=False)\n",
    "btnclick = 'data/btnClick.csv'\n",
    "df_btnclick.to_csv(btnclick, index=False)\n",
    "aleave = 'data/about_leave.csv'\n",
    "df_aleave.to_csv(aleave, index=False)\n",
    "form = 'data/formSubmit.csv'\n",
    "df_form.to_csv(form, index=False)\n",
    "submit = 'data/clickSubmit.csv'\n",
    "df_submit.to_csv(submit, index=False)\n",
    "cleave = 'data/courses_leave.csv'\n",
    "df_cleave.to_csv(cleave, index=False)\n",
    "dleave = 'data/demo_leave.csv'\n",
    "df_dleave.to_csv(dleave, index=False)\n",
    "playleave = 'data/courses_play_leave.csv'\n",
    "df_playleave.to_csv(playleave, index=False)\n",
    "close = 'data/page_close.csv'\n",
    "df_close.to_csv(close, index=False)\n",
    "view = 'data/pageview.csv'\n",
    "df_view.to_csv(view, index=False)\n",
    "send = 'data/click_send_cellphone.csv'\n",
    "df_send.to_csv(send, index=False)\n",
    "verify = 'data/verify_cellphone_code.csv'\n",
    "df_verify.to_csv(verify, index=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Export the selected features for future quick reference\n",
    "data_all = 'data/data_all.csv'\n",
    "df.to_csv(data_all, index=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "track               65673\n",
       "profile_set_once     9419\n",
       "Name: tp, dtype: int64"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['tp'].value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "track: keep track of an event, as shown in events below\n",
    "profile set once: used for first time activate, register, ignored when profile already exist"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "$pageview                32620\n",
       "btnClick                 13866\n",
       "index_leave              10394\n",
       "demo_leave                3411\n",
       "about_leave               1032\n",
       "courses_leave              906\n",
       "formSubmit                 791\n",
       "courses_play_leave         747\n",
       "click_send_cellphone       600\n",
       "verify_cellphone_code      563\n",
       "clickSubmit                513\n",
       "page_close                 230\n",
       "Name: event, dtype: int64"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['event'].value_counts()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- possible user behavior analysis: pageview, btnClick\n",
    "- funnel analysis: page view > formSubmit(791) > click_send_cellphone(600) > verify_cellphone_code(563) > clickSubmit(513)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count                                        75092\n",
       "unique                                       11756\n",
       "top       835cc4405ee7e42e5b401a25e65b4830b02af7d3\n",
       "freq                                           254\n",
       "Name: dist_id, dtype: object"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['dist_id'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count             75092\n",
       "unique            75065\n",
       "top       7104818490333\n",
       "freq                  7\n",
       "Name: nocache, dtype: object"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['nocache'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count               65673\n",
       "unique               9870\n",
       "top       113.208.116.250\n",
       "freq                 1399\n",
       "Name: ip, dtype: object"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['ip'].describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Above are some sample looks at some selected features. Always to be sure to check the highlevel summary of a list of data of a feature before diving into deeper selection of identifier and or EDA."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##  Choice of identifier\n",
    "- distinct_id, hash: change from browser and cookie id to protect user privacy; 11756 distinct values\n",
    "- nocache: might be simplified identifier. The number of distinct nocache is 75065. The frequency is too low. \n",
    "- ip: 9870 distinct values, each ip address can have multiple users\n",
    "- distinct_id is a better identifier，it is random，and can be used for unbiased experiments/tran test split"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "% matplotlib inline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count          75092\n",
       "unique            10\n",
       "top       2017-03-09\n",
       "freq           10304\n",
       "Name: day, dtype: object"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['day'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x122b067b8>"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYcAAAENCAYAAADkNanAAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAFBpJREFUeJzt3X2wnnV95/H3R6IUFHkMiAm7Qc1aUatiBLYdXZe4PNk2tpUR60hk2WYfqNpduxbXnQlV2cUdt6gdpZMRNDgOiGgHVmkx5aG2uwsS5JnAJoKSFJS4QXSklQa/+8f9S/c2v5Onc5/c586c92vmzLmu7/W7rut7IMnnXI93qgpJkoY9a7YbkCRNHsNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktSZN9sNTNcRRxxRixYtmu02JGmfcfvtt/+gqubvzth9NhwWLVrE2rVrZ7sNSdpnJPnu7o71tJIkqWM4SJI6hoMkqWM4SJI6hoMkqWM4SJI6hoMkqWM4SJI6++xDcNq3rPvFl428jZc9sG4GOpG0OzxykCR1dhkOSS5L8niSe4dqhyVZk2R9+35oqyfJJ5NsSHJ3kuOH1lnexq9Psnyo/tok97R1PpkkM/1DSpL2zO4cOXwOOG272vnADVW1GLihzQOcDixuXyuAS2AQJsBK4ETgBGDltkBpY1YMrbf9viRJY7bLcKiqbwBbtisvA1a36dXAW4bql9fALcAhSY4GTgXWVNWWqnoCWAOc1pY9v6r+d1UVcPnQtiRJs2S6F6SPqqrHAKrqsSRHtvoCYOPQuE2ttrP6pinqkuaACy64YCK2od5MX5Ce6npBTaM+9caTFUnWJlm7efPmabYoSdqV6YbD99spIdr3x1t9E3DM0LiFwKO7qC+coj6lqlpVVUuqasn8+bv1eRWSpGmYbjhcC2y742g5cM1Q/ex219JJwJPt9NP1wClJDm0Xok8Brm/LfpzkpHaX0tlD25IkzZJdXnNIcgXwRuCIJJsY3HV0EXBVknOBR4Az2/DrgDOADcBTwDkAVbUlyYeB29q4D1XVtovc/5bBHVEHAH/WviRJs2iX4VBVb9/BoqVTjC3gvB1s5zLgsinqa4FX7KoPSdL4+IS0JKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKnjJ8FJ0gR4wU13jryN7/3zV89AJwMeOUiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKnj6zPmgFeufuXI27hn+T0z0ImkfYVHDpKkjkcOe9MFB8/ANp4cfRuStIc8cpAkdQwHSVLHcJAkdQwHSVLHcJAkdQwHSVLHcJAkdQwHSVLHcJAkdQwHSVJnpHBI8u+T3Jfk3iRXJPmFJMcmuTXJ+iRfTPKcNnb/Nr+hLV80tJ0PtPqDSU4d7UeSJI1q2uGQZAHwHmBJVb0C2A84C/gocHFVLQaeAM5tq5wLPFFVLwEubuNIclxb7+XAacCnk+w33b4kSaMb9bTSPOCAJPOAA4HHgJOBq9vy1cBb2vSyNk9bvjRJWv3KqvppVT0MbABOGLEvSdIIpv1W1qr6myQfAx4B/hb4OnA78MOq2tqGbQIWtOkFwMa27tYkTwKHt/otQ5seXmfaFp3/tVE3wXcuevPI25CkfdEop5UOZfBb/7HAC4HnAqdPMbS2rbKDZTuqT7XPFUnWJlm7efPmPW9akrRbRjmt9Cbg4araXFV/D3wF+GXgkHaaCWAh8Gib3gQcA9CWHwxsGa5Psc7PqapVVbWkqpbMnz9/hNYlSTszSjg8ApyU5MB27WApcD9wE/DWNmY5cE2bvrbN05bfWFXV6me1u5mOBRYD3xyhL0nSiEa55nBrkquBbwFbgTuAVcDXgCuTfKTVLm2rXAp8PskGBkcMZ7Xt3JfkKgbBshU4r6qemW5fkqTRjfQxoVW1Eli5XfkhprjbqKr+DjhzB9u5ELhwlF4kSTPHJ6QlSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUGSkckhyS5OokDyRZl+SfJjksyZok69v3Q9vYJPlkkg1J7k5y/NB2lrfx65MsH/WHkiSNZtQjh08Af15Vvwi8ClgHnA/cUFWLgRvaPMDpwOL2tQK4BCDJYcBK4ETgBGDltkCRJM2OedNdMcnzgTcA7wKoqqeBp5MsA97Yhq0Gbgb+AFgGXF5VBdzSjjqObmPXVNWWtt01wGnAFdPtTZL2xA03vnjkbSw9+dsz0MnkGOXI4UXAZuCzSe5I8pkkzwWOqqrHANr3I9v4BcDGofU3tdqO6p0kK5KsTbJ28+bNI7QuSdqZUcJhHnA8cElVvQb4Cf//FNJUMkWtdlLvi1WrqmpJVS2ZP3/+nvYrSdpNo4TDJmBTVd3a5q9mEBbfb6eLaN8fHxp/zND6C4FHd1KXJM2SaYdDVX0P2Jjkpa20FLgfuBbYdsfRcuCaNn0tcHa7a+kk4Ml22ul64JQkh7YL0ae0miRplkz7gnTzbuALSZ4DPAScwyBwrkpyLvAIcGYbex1wBrABeKqNpaq2JPkwcFsb96FtF6clSbNjpHCoqjuBJVMsWjrF2ALO28F2LgMuG6UXSdLMGfXIQdI+atP5fzXyNhZe9PoZ6ESTyNdnSJI6hoMkqWM4SJI6hoMkqWM4SJI6hoMkqWM4SJI6hoMkqWM4SJI6hoMkqePrMzSnfOrf3DjyNs77k5NnoBNpsnnkIEnqGA6SpI7hIEnqGA6SpI7hIEnqGA6SpI7hIEnqGA6SpI7hIEnqGA6SpI7hIEnqGA6SpI7hIEnqGA6SpI7hIEnqGA6SpI7hIEnqGA6SpI7hIEnqjBwOSfZLckeSr7b5Y5PcmmR9ki8meU6r79/mN7Tli4a28YFWfzDJqaP2JEkazUwcObwXWDc0/1Hg4qpaDDwBnNvq5wJPVNVLgIvbOJIcB5wFvBw4Dfh0kv1moC9J0jSNFA5JFgJvBj7T5gOcDFzdhqwG3tKml7V52vKlbfwy4Mqq+mlVPQxsAE4YpS9J0mhGPXL4OPB+4Gdt/nDgh1W1tc1vAha06QXARoC2/Mk2/h/qU6wjSZoF0w6HJL8KPF5Vtw+Xpxhau1i2s3W23+eKJGuTrN28efMe9StJ2n2jHDn8CvDrSb4DXMngdNLHgUOSzGtjFgKPtulNwDEAbfnBwJbh+hTr/JyqWlVVS6pqyfz580doXZK0M9MOh6r6QFUtrKpFDC4o31hV7wBuAt7ahi0HrmnT17Z52vIbq6pa/ax2N9OxwGLgm9PtS5I0unm7HrLH/gC4MslHgDuAS1v9UuDzSTYwOGI4C6Cq7ktyFXA/sBU4r6qe2Qt9SZJ204yEQ1XdDNzcph9iiruNqurvgDN3sP6FwIUz0YskaXQ+IS1J6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqTOvNluQJpr/vvbfnXkbbzvi1+dgU6kHfPIQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSZ1ph0OSY5LclGRdkvuSvLfVD0uyJsn69v3QVk+STybZkOTuJMcPbWt5G78+yfLRfyxJ0ihGOXLYCryvql4GnAScl+Q44HzghqpaDNzQ5gFOBxa3rxXAJTAIE2AlcCJwArByW6BIkmbHtMOhqh6rqm+16R8D64AFwDJgdRu2GnhLm14GXF4DtwCHJDkaOBVYU1VbquoJYA1w2nT7kiSNbkauOSRZBLwGuBU4qqoeg0GAAEe2YQuAjUOrbWq1HdUlSbNk5HBI8jzgy8DvVdWPdjZ0ilrtpD7VvlYkWZtk7ebNm/e8WUnSbhkpHJI8m0EwfKGqvtLK32+ni2jfH2/1TcAxQ6svBB7dSb1TVauqaklVLZk/f/4orUuSdmKUu5UCXAqsq6o/Glp0LbDtjqPlwDVD9bPbXUsnAU+2007XA6ckObRdiD6l1SRJs2SUz3P4FeCdwD1J7my1/wRcBFyV5FzgEeDMtuw64AxgA/AUcA5AVW1J8mHgtjbuQ1W1ZYS+JEkjmnY4VNVfM/X1AoClU4wv4LwdbOsy4LLp9iJJmlk+IS1J6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6kxMOCQ5LcmDSTYkOX+2+5GkuWwiwiHJfsCngNOB44C3JzludruSpLlrIsIBOAHYUFUPVdXTwJXAslnuSZLmrEkJhwXAxqH5Ta0mSZoFqarZ7oEkZwKnVtW/avPvBE6oqndvN24FsKLNvhR4cITdHgH8YIT1Z8ok9DEJPcBk9DEJPcBk9DEJPcBk9DEJPcDoffzjqpq/OwPnjbCTmbQJOGZofiHw6PaDqmoVsGomdphkbVUtmYlt7et9TEIPk9LHJPQwKX1MQg+T0sck9DDuPibltNJtwOIkxyZ5DnAWcO0s9yRJc9ZEHDlU1dYkvwtcD+wHXFZV981yW5I0Z01EOABU1XXAdWPc5YycnpoBk9DHJPQAk9HHJPQAk9HHJPQAk9HHJPQAY+xjIi5IS5Imy6Rcc5AkTRDDQZLUmZhrDhqPobvBHq2qv0jy28AvA+uAVVX197PaoKSJMCeuOSQ5EVhXVT9KcgBwPnA8cD/wX6rqyTH18R7gT6tq4y4H770evsDgl4IDgR8CzwO+Aixl8Odh+Zj6eDHwGwyeb9kKrAeuGNf/C0k7N1fC4T7gVe2W2VXAU8DVDP5BfFVV/eaY+ngS+AnwbeAK4EtVtXkc+x7q4e6q+qUk84C/AV5YVc8kCXBXVf3SGHp4D/BrwF8CZwB3Ak8wCIt/V1U37+0epD2R5Miqeny2+wBIsqqqVux65GjmyjWHZ1XV1ja9pKp+r6r+uqr+EHjRGPt4iMHT3x8GXgvcn+TPkyxPctCYenhWO7V0EIOjh4NbfX/g2WPq4XeA06rqI8CbgOOq6oPAacDFY+qBJAcnuSjJA0n+b/ta12qHjKuPnUnyZ2Paz/OT/Nckn2+nGoeXfXocPbR9vSDJJUk+leTwJBckuSfJVUmOHlMPh233dTjwzSSHJjlslnoY7uWMcfQwV6453JvknKr6LHBXkiVVtTbJPwHGeY69qupnwNeBryd5NoPXlL8d+BiwW+88GdGlwAMMHjb8IPClJA8BJzF4G+64zAOeYRBKBwFU1SPtv8m4XAXcCLyxqr4Hg3+cgOXAl4B/MY4mkhy/o0XAq8fRA/BZBqf2vgz8yyS/Bfx2Vf2UwZ+Ncfkc8DXgucBNwBeANzN4S/OfMJ63Nf8A+O52tQXAt4BiPL9Qbm49ZKhWbf7IMex/zpxWOhj4BPB6Bv/jj2fwFtiNwHuq6q4x9XFHVb1mB8sOqKq/HVMfLwSoqkfbb8hvAh6pqm+Oaf/vBc4FbgHeAHy0qj6bZD7w5ap6w5j6eLCqXrqny/ZCH88wOMWWKRafVFUHjKGHO6vq1UPzH2TwG+qvA2uqakcBNtN9/MPfkSSPVNU/2lGPe7GH32fwd+I/VtU9rfZwVR27t/c91MN6YGlVPTLFso1VdcwUq82oOXHk0C5yvqudunkRg597U1V9f8ytvG1HC8YVDG1fjw5N/5DB9ZexqapPJPkL4GXAH1XVA62+mUFYjMt3k7wfWL3tz0KSo4B38fOvkN/b1gH/uqrWb78gybj62D/Js9qRLVV1YZJNwDcY3LQwLsOnui/fbtl+42igqj6W5Erg4vbffyWD39rH6ePAoUAXDsB/G0cDc+WaAwBV9eOququqbp+FYKCq/s+49zmpquq+qrp6WzDMkrcBhwN/mWRLki3AzcBhwJlj7OMCdvx38d07qM+0/wGcPFyoqtXA+4Cnx9QDwDVJntf2/5+3FZO8hNFe0b9HqmpTVZ3J4NTWGgbX58amqj7FILBfB5DkuCT/IckZVfXH4+hhTpxWkvbU0DWqOd/HJPQwm320299fXFX3jquHJCsZXI+cxyCcTmTwi8ubgOur6sK93oPhIPW2P989l/uYhB4mpY9x9ZDkHgY3I+wPfA9YOPSc1q3juOV8TlxzkKaS5O4dLQKOmkt9TEIPk9LHJPQAbK2qZ4Cnkny7qn4Eg2uTSX42jgYMB81lRwGnMngAb1iA/zXH+piEHialj0no4ekkB1bVUwyeiRo0MLjz0nCQ9rKvAs+rqju3X5Dk5jnWxyT0MCl9TEIPb2jPmLDtDrLm2Qyew9nrvOYgSerMqVtZJUm7x3CQJHUMB2kE7cVwvz/bfUgzzXCQJHUMB2kPJflgkgfb+6Fe2mq/k+S2JHcl+XKSA5MclOThbW+aba/F/s6Y3zwrTYvhIO2BJK9l8DGrrwF+E3hdW/SVqnpdVb2KwYv0zq2qHzN45cGb25izGLx11o9i1cQzHKQ983oGH/X6VHtq9dpWf0WSv2qvPXgH8PJW/wxwTps+h8HnJkgTz3CQ9txUDwd9Dvjdqnol8IfALwBU1f8EFiX5Z8B+VXXv2LqURmA4SHvmG8BvJDmgfT7Ir7X6QcBj7XrCO7Zb53IGnxnuUYP2GT4hLe2h9ilpZzP4GMdNwP3AT4D3t9o9wEFV9a42/gXAw8DR7cOVpIlnOEh7WZK3Asuq6p2z3Yu0u3zxnrQXJfljBh/acsZs9yLtCY8cJEkdL0hLkjqGgySpYzhIkjqGgySpYzhIkjqGgySp8/8ASff/13vo4HQAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df[\"day\"] = df[\"day\"].astype(\"datetime64\")\n",
    "df[\"day\"].groupby(df[\"day\"].dt.day).count().plot(kind=\"bar\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "2017 March, 11th and 12th are weekends, have the least number of counts"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x12f9517f0>"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYcAAAEGCAYAAACO8lkDAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAEyFJREFUeJzt3X+sX/V93/Hnq3ZISAexCReGbDIz1cpK2ELANZ6i/QqtsclWsypIoKj2kLU7ITK10qbOWf/wCkVK/lk2TykSCi521YWypBFWZ+q6TqJ2ExBfGgoBgnxDEnxlCre1IbSsYaTv/XE/Xr/y52vf7702/pryfEhH55z3eZ9zP9+/Xvec8/nem6pCkqRBPzbuAUiSzj2GgySpYzhIkjqGgySpYzhIkjqGgySpYzhIkjqGgySpYzhIkjpLxz2Axbr44otr1apV4x6GJL1tPP74439aVROj9L5tw2HVqlVMTU2NexiS9LaR5Puj9vpYSZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSR3DQZLUMRwkSZ237ZfgdOas2vY/xz0E6aS+95mPj3sI70jeOUiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKkzbzgk+WCSJwaWHyT5xSQXJdmf5FBbL2/9SbIjyXSSJ5NcM3CtLa3/UJItA/VrkzzVztmRJG/Nx5UkjWLecKiq56rq6qq6GrgWeB34CrANOFBVq4EDbR9gI7C6LZPAPQBJLgK2A9cBa4HtxwOl9UwOnLfhjHw6SdKiLPSx0vXAd6rq+8AmYFer7wJuatubgN0151FgWZLLgBuA/VV1tKqOAfuBDe3YhVX1SFUVsHvgWpKkMVhoONwCfLFtX1pVLwK09SWtvgI4PHDOTKudqj4zpC5JGpORwyHJecDPAv9jvtYhtVpEfdgYJpNMJZmanZ2dZxiSpMVayJ3DRuCPquqltv9SeyREW7/c6jPA5QPnrQSOzFNfOaTeqap7q2pNVa2ZmJhYwNAlSQuxkHC4lb9+pASwBzg+42gL8NBAfXObtbQOeLU9dtoHrE+yvL2IXg/sa8deS7KuzVLaPHAtSdIYjPSf4JK8F/gZ4N8MlD8DPJhkK/ACcHOr7wVuBKaZm9l0G0BVHU1yF3Cw9d1ZVUfb9u3A/cD5wMNtkSSNyUjhUFWvA+8/ofZnzM1eOrG3gDtOcp2dwM4h9SngqlHGIkl66/kNaUlSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSZ6RwSLIsyZeSfDvJs0n+YZKLkuxPcqitl7feJNmRZDrJk0muGbjOltZ/KMmWgfq1SZ5q5+xIkjP/USVJoxr1zuG/Ar9bVX8P+DDwLLANOFBVq4EDbR9gI7C6LZPAPQBJLgK2A9cBa4HtxwOl9UwOnLfh9D6WJOl0zBsOSS4E/jFwH0BVvVFVrwCbgF2tbRdwU9veBOyuOY8Cy5JcBtwA7K+qo1V1DNgPbGjHLqyqR6qqgN0D15IkjcEodw5/F5gFfj3JN5N8IcmPA5dW1YsAbX1J618BHB44f6bVTlWfGVLvJJlMMpVkanZ2doShS5IWY5RwWApcA9xTVR8B/oK/foQ0zLD3BbWIel+sureq1lTVmomJiVOPWpK0aKOEwwwwU1WPtf0vMRcWL7VHQrT1ywP9lw+cvxI4Mk995ZC6JGlM5g2HqvoT4HCSD7bS9cAzwB7g+IyjLcBDbXsPsLnNWloHvNoeO+0D1idZ3l5Erwf2tWOvJVnXZiltHriWJGkMlo7Y92+B30xyHvA8cBtzwfJgkq3AC8DNrXcvcCMwDbzeeqmqo0nuAg62vjur6mjbvh24HzgfeLgtkqQxGSkcquoJYM2QQ9cP6S3gjpNcZyewc0h9CrhqlLFIkt56fkNaktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJnZHCIcn3kjyV5IkkU612UZL9SQ619fJWT5IdSaaTPJnkmoHrbGn9h5JsGahf264/3c7Nmf6gkqTRLeTO4Z9V1dVVdfx/SW8DDlTVauBA2wfYCKxuyyRwD8yFCbAduA5YC2w/HiitZ3LgvA2L/kSSpNN2Oo+VNgG72vYu4KaB+u6a8yiwLMllwA3A/qo6WlXHgP3Ahnbswqp6pKoK2D1wLUnSGIwaDgX8XpLHk0y22qVV9SJAW1/S6iuAwwPnzrTaqeozQ+qSpDFZOmLfR6vqSJJLgP1Jvn2K3mHvC2oR9f7Cc8E0CfCBD3zg1COWJC3aSHcOVXWkrV8GvsLcO4OX2iMh2vrl1j4DXD5w+krgyDz1lUPqw8Zxb1Wtqao1ExMTowxdkrQI84ZDkh9PcsHxbWA98C1gD3B8xtEW4KG2vQfY3GYtrQNebY+d9gHrkyxvL6LXA/vasdeSrGuzlDYPXEuSNAajPFa6FPhKm126FPjvVfW7SQ4CDybZCrwA3Nz69wI3AtPA68BtAFV1NMldwMHWd2dVHW3btwP3A+cDD7dFkjQm84ZDVT0PfHhI/c+A64fUC7jjJNfaCewcUp8CrhphvJKks8BvSEuSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOoaDJKljOEiSOiOHQ5IlSb6Z5Hfa/hVJHktyKMlvJTmv1d/d9qfb8VUD1/h0qz+X5IaB+oZWm06y7cx9PEnSYizkzuEXgGcH9j8LfK6qVgPHgK2tvhU4VlU/AXyu9ZHkSuAW4EPABuDXWuAsAT4PbASuBG5tvZKkMRkpHJKsBD4OfKHtB/gY8KXWsgu4qW1vavu049e3/k3AA1X1w6r6LjANrG3LdFU9X1VvAA+0XknSmIx65/BfgF8C/qrtvx94parebPszwIq2vQI4DNCOv9r6/3/9hHNOVu8kmUwylWRqdnZ2xKFLkhZq3nBI8s+Bl6vq8cHykNaa59hC632x6t6qWlNVayYmJk4xaknS6Vg6Qs9HgZ9NciPwHuBC5u4kliVZ2u4OVgJHWv8McDkwk2Qp8D7g6ED9uMFzTlaXJI3BvHcOVfXpqlpZVauYe6H81ar6JPA14BOtbQvwUNve0/Zpx79aVdXqt7TZTFcAq4FvAAeB1W3203ntZ+w5I59OkrQoo9w5nMx/AB5I8qvAN4H7Wv0+4DeSTDN3x3ALQFU9neRB4BngTeCOqvoRQJJPAfuAJcDOqnr6NMYlSTpNCwqHqvo68PW2/TxzM41O7PlL4OaTnH83cPeQ+l5g70LGIkl66/gNaUlSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHXmDYck70nyjSR/nOTpJL/S6lckeSzJoSS/leS8Vn93259ux1cNXOvTrf5ckhsG6htabTrJtjP/MSVJCzHKncMPgY9V1YeBq4ENSdYBnwU+V1WrgWPA1ta/FThWVT8BfK71keRK4BbgQ8AG4NeSLEmyBPg8sBG4Eri19UqSxmTecKg5f95239WWAj4GfKnVdwE3te1NbZ92/PokafUHquqHVfVdYBpY25bpqnq+qt4AHmi9kqQxGemdQ/sN/wngZWA/8B3glap6s7XMACva9grgMEA7/irw/sH6CeecrC5JGpORwqGqflRVVwMrmftN/yeHtbV1TnJsofVOkskkU0mmZmdn5x+4JGlRFjRbqapeAb4OrAOWJVnaDq0EjrTtGeBygHb8fcDRwfoJ55ysPuzn31tVa6pqzcTExEKGLklagFFmK00kWda2zwd+GngW+Brwida2BXiobe9p+7TjX62qavVb2mymK4DVwDeAg8DqNvvpPOZeWu85Ex9OkrQ4S+dv4TJgV5tV9GPAg1X1O0meAR5I8qvAN4H7Wv99wG8kmWbujuEWgKp6OsmDwDPAm8AdVfUjgCSfAvYBS4CdVfX0GfuEkqQFmzccqupJ4CND6s8z9/7hxPpfAjef5Fp3A3cPqe8F9o4wXknSWeA3pCVJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJHcNBktQxHCRJnXnDIcnlSb6W5NkkTyf5hVa/KMn+JIfaenmrJ8mOJNNJnkxyzcC1trT+Q0m2DNSvTfJUO2dHkrwVH1aSNJpR7hzeBP5dVf0ksA64I8mVwDbgQFWtBg60fYCNwOq2TAL3wFyYANuB64C1wPbjgdJ6JgfO23D6H02StFjzhkNVvVhVf9S2XwOeBVYAm4BdrW0XcFPb3gTsrjmPAsuSXAbcAOyvqqNVdQzYD2xoxy6sqkeqqoDdA9eSJI3Bgt45JFkFfAR4DLi0ql6EuQABLmltK4DDA6fNtNqp6jND6sN+/mSSqSRTs7OzCxm6JGkBRg6HJH8L+DLwi1X1g1O1DqnVIup9sereqlpTVWsmJibmG7IkaZFGCock72IuGH6zqn67lV9qj4Ro65dbfQa4fOD0lcCReeorh9QlSWMyymylAPcBz1bVfx44tAc4PuNoC/DQQH1zm7W0Dni1PXbaB6xPsry9iF4P7GvHXkuyrv2szQPXkiSNwdIRej4K/DzwVJInWu0/Ap8BHkyyFXgBuLkd2wvcCEwDrwO3AVTV0SR3AQdb351VdbRt3w7cD5wPPNwWSdKYzBsOVfW/GP5eAOD6If0F3HGSa+0Edg6pTwFXzTcWSdLZ4TekJUkdw0GS1DEcJEkdw0GS1DEcJEkdw0GS1DEcJEkdw0GS1DEcJEkdw0GS1DEcJEkdw0GS1DEcJEkdw0GS1DEcJEkdw0GS1DEcJEkdw0GS1DEcJEmdecMhyc4kLyf51kDtoiT7kxxq6+WtniQ7kkwneTLJNQPnbGn9h5JsGahfm+Spds6OJCf7f9WSpLNklDuH+4ENJ9S2AQeqajVwoO0DbARWt2USuAfmwgTYDlwHrAW2Hw+U1jM5cN6JP0uSdJbNGw5V9QfA0RPKm4BdbXsXcNNAfXfNeRRYluQy4AZgf1UdrapjwH5gQzt2YVU9UlUF7B64liRpTBb7zuHSqnoRoK0vafUVwOGBvplWO1V9Zkh9qCSTSaaSTM3Ozi5y6JKk+ZzpF9LD3hfUIupDVdW9VbWmqtZMTEwscoiSpPksNhxeao+EaOuXW30GuHygbyVwZJ76yiF1SdIYLTYc9gDHZxxtAR4aqG9us5bWAa+2x077gPVJlrcX0euBfe3Ya0nWtVlKmweuJUkak6XzNST5IvBPgYuTzDA36+gzwINJtgIvADe39r3AjcA08DpwG0BVHU1yF3Cw9d1ZVcdfct/O3Iyo84GH2yJJGqN5w6Gqbj3JoeuH9BZwx0musxPYOaQ+BVw13zgkSWeP35CWJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lSx3CQJHUMB0lS55wJhyQbkjyXZDrJtnGPR5Leyc6JcEiyBPg8sBG4Erg1yZXjHZUkvXOdE+EArAWmq+r5qnoDeADYNOYxSdI71rkSDiuAwwP7M60mSRqDpeMeQJMhteqakklgsu3+eZLn3tJRSYtzMfCn4x7E3xT57LhH8DfK3xm18VwJhxng8oH9lcCRE5uq6l7g3rM1KGkxkkxV1Zpxj0M6HefKY6WDwOokVyQ5D7gF2DPmMUnSO9Y5cedQVW8m+RSwD1gC7Kyqp8c8LEl6x0pV92hf0mlIMtkegUpvW4aDJKlzrrxzkCSdQwwHSVLnnHghLb2dJVkLVFUdbH/2ZQPw7araO+ahSYvmOwfpNCTZztzfBFsK7AeuA74O/DSwr6ruHt/opMUzHKTTkOQp4Grg3cCfACur6gdJzgceq6p/MNYBSovkOwfp9LxZVT+qqteB71TVDwCq6v8AfzXeoUmLZzhIp+eNJO9t29ceLyZ5H4aD3sZ8rCSdhiTvrqofDqlfDFxWVU+NYVjSaTMcJEkdHytJkjqGgySpYzhIpyHJf0ry78c9DulMMxwkSR3DQVqgJL+c5Lkkvw98sNX+dZKDSf44yZeTvDfJBUm+m+RdrefCJN87vi+dywwHaQGSXMvcfyr8CPBzwE+1Q79dVT9VVR8GngW2VtVrzP0pjY+3nluAL1fV/z27o5YWznCQFuYfAV+pqtfbt6GP/zvbq5L8YftzGp8EPtTqXwBua9u3Ab9+VkcrLZLhIC3csC8H3Q98qqr+PvArwHsAqup/A6uS/BNgSVV966yNUjoNhoO0MH8A/Msk5ye5APgXrX4B8GJ7n/DJE87ZDXwR7xr0NuI3pKUFSvLLwGbg+8AM8AzwF8AvtdpTwAVV9a9a/98Gvsvcn9N4ZRxjlhbKcJDeYkk+AWyqqp8f91ikUfmf4KS3UJL/xtw/A7px3GORFsI7B0lSxxfSkqSO4SBJ6hgOkqSO4SBJ6hgOkqSO4SBJ6vw/qpuwlwX+LiUAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df[\"day\"].groupby(df[\"day\"].dt.month).count().plot(kind=\"bar\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- All the data collected on March 2017, and only distribute in 6th-14th and 31st\n",
    "- 31st is a wrong data, should be eliminated from the dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "df = df[df.day != \"2017-03-31\"]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Check missing data and propose possible missing data imputation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "Int64Index: 65673 entries, 0 to 75090\n",
      "Data columns (total 47 columns):\n",
      "browser                65673 non-null object\n",
      "browser_v              65673 non-null object\n",
      "ch                     32335 non-null object\n",
      "day                    65673 non-null datetime64[ns]\n",
      "dist_id                65673 non-null object\n",
      "event                  65673 non-null object\n",
      "from_url               982 non-null object\n",
      "ip                     65673 non-null object\n",
      "isMsg                  469 non-null object\n",
      "isSuccess              791 non-null object\n",
      "is_fd                  65673 non-null object\n",
      "is_ft                  65673 non-null object\n",
      "latest_ch              8537 non-null object\n",
      "latest_r               64862 non-null object\n",
      "latest_rh              64862 non-null object\n",
      "latest_utm_campaign    39903 non-null object\n",
      "latest_utm_content     38763 non-null object\n",
      "latest_utm_m           39691 non-null object\n",
      "latest_utm_s           40583 non-null object\n",
      "latest_utm_t           39095 non-null object\n",
      "model                  65673 non-null object\n",
      "name                   15170 non-null object\n",
      "nocache                65673 non-null object\n",
      "os                     65673 non-null object\n",
      "os_version             65673 non-null object\n",
      "page                   11716 non-null object\n",
      "pageP                  16490 non-null float64\n",
      "pageS                  16720 non-null float64\n",
      "pageUrl                30356 non-null object\n",
      "refer_Host             32335 non-null object\n",
      "referrHostUrl          469 non-null object\n",
      "referrer               32334 non-null object\n",
      "referrerUrl            469 non-null object\n",
      "requestBtn             4271 non-null object\n",
      "result                 1163 non-null object\n",
      "screen_h               65673 non-null float64\n",
      "screen_r               63046 non-null object\n",
      "screen_rh              63039 non-null object\n",
      "screen_w               65673 non-null float64\n",
      "session_p              62766 non-null object\n",
      "siteUrl                469 non-null object\n",
      "site_url               982 non-null object\n",
      "time                   65673 non-null int64\n",
      "title                  32620 non-null object\n",
      "tp                     65673 non-null object\n",
      "url                    32598 non-null object\n",
      "url_path               32620 non-null object\n",
      "dtypes: datetime64[ns](1), float64(4), int64(1), object(41)\n",
      "memory usage: 24.1+ MB\n"
     ]
    }
   ],
   "source": [
    "df.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "browser                    0\n",
       "browser_v                  0\n",
       "ch                     33338\n",
       "day                        0\n",
       "dist_id                    0\n",
       "event                      0\n",
       "from_url               64691\n",
       "ip                         0\n",
       "isMsg                  65204\n",
       "isSuccess              64882\n",
       "is_fd                      0\n",
       "is_ft                      0\n",
       "latest_ch              57136\n",
       "latest_r                 811\n",
       "latest_rh                811\n",
       "latest_utm_campaign    25770\n",
       "latest_utm_content     26910\n",
       "latest_utm_m           25982\n",
       "latest_utm_s           25090\n",
       "latest_utm_t           26578\n",
       "model                      0\n",
       "name                   50503\n",
       "nocache                    0\n",
       "os                         0\n",
       "os_version                 0\n",
       "page                   53957\n",
       "pageP                  49183\n",
       "pageS                  48953\n",
       "pageUrl                35317\n",
       "refer_Host             33338\n",
       "referrHostUrl          65204\n",
       "referrer               33339\n",
       "referrerUrl            65204\n",
       "requestBtn             61402\n",
       "result                 64510\n",
       "screen_h                   0\n",
       "screen_r                2627\n",
       "screen_rh               2634\n",
       "screen_w                   0\n",
       "session_p               2907\n",
       "siteUrl                65204\n",
       "site_url               64691\n",
       "time                       0\n",
       "title                  33053\n",
       "tp                         0\n",
       "url                    33075\n",
       "url_path               33053\n",
       "dtype: int64"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.isnull().sum()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The rows with \"profile_set_once\" were exactly the mistake 31st dates that were deleted (9419 rows)\n",
    "Features that have null value only at \"profile_set_once\" type: \n",
    "browser, browser_v, event, ip, is_fd, is_ft, model, os, os_version, screen_h, screen_w\n",
    "if we consider event, all these features including time, dist_id might be useful"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Conversion Rate (the percentage of users who take a desired action) Analyses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "$pageview                32620\n",
       "btnClick                 13866\n",
       "index_leave              10394\n",
       "demo_leave                3411\n",
       "about_leave               1032\n",
       "courses_leave              906\n",
       "formSubmit                 791\n",
       "courses_play_leave         747\n",
       "click_send_cellphone       600\n",
       "verify_cellphone_code      563\n",
       "clickSubmit                513\n",
       "page_close                 230\n",
       "Name: event, dtype: int64"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['event'].value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "11708"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nall = df.dist_id.nunique()\n",
    "nall"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "11587"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nview = df_view.dist_id.nunique()\n",
    "nview"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "6946"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nileave = df_ileave.dist_id.nunique()\n",
    "nileave"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "4501"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nclick = df_btnclick.dist_id.nunique()\n",
    "nclick"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1436"
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ndleave = df_dleave.dist_id.nunique()\n",
    "ndleave"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "712"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "naleave = df_aleave.dist_id.nunique()\n",
    "naleave"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "692"
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "ncleave = df_cleave.dist_id.nunique()\n",
    "ncleave"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "370"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "npleave = df_playleave.dist_id.nunique()\n",
    "npleave"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "501"
      ]
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nsend = df_send.dist_id.nunique()\n",
    "nsend"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "472"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nverify = df_verify.dist_id.nunique()\n",
    "nverify"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count     563\n",
       "unique      3\n",
       "top        正确\n",
       "freq      528\n",
       "Name: result, dtype: object"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_verify['result'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "471"
      ]
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_verify[df_verify['result']=='正确'].dist_id.nunique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Only one user from 472 users has wrong verification code, and never has correct verification code"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "497"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nform = df_form.dist_id.nunique()\n",
    "nform"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "461"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nsubmit = df_submit.dist_id.nunique()\n",
    "nsubmit"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "97"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "nclose = df_close.dist_id.nunique()\n",
    "nclose"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "conversation rate of click send cellphone:\n",
      "0.04279125384352579\n"
     ]
    }
   ],
   "source": [
    "print(\"conversation rate of click send cellphone:\")\n",
    "print(nsend/nall)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "conversation rate of verify cellphone code:\n",
      "0.040314314998291766\n"
     ]
    }
   ],
   "source": [
    "print(\"conversation rate of verify cellphone code:\")\n",
    "print(nverify/nall)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The conversation rate from verify cellphone code to form submit increase: it is not neccessary to send verification code for form submit"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "conversation rate of form submit:\n",
      "0.04244960710625213\n"
     ]
    }
   ],
   "source": [
    "print(\"conversation rate of form submit:\")\n",
    "print(nform/nall)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "conversation rate of click submit:\n",
      "0.0393747864707892\n"
     ]
    }
   ],
   "source": [
    "print(\"conversation rate of click submit:\")\n",
    "print(nsubmit/nall)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "conversation rate of demo leave:\n",
      "0.12265117868124359\n"
     ]
    }
   ],
   "source": [
    "print(\"conversation rate of demo leave:\")\n",
    "print(ndleave/nall)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAnoAAAHFCAYAAABl3lQxAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAAPYQAAD2EBqD+naQAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAIABJREFUeJzs3Xtcj/f/P/DHu9O7w7sDKSrvFCqHUDmGlNNyFpsZTcgw5JTT+jibMxtj5jjlY8I+G2Zby7nmkJYmjJBWZJpyWE2s0/v1+8Ov6+ut8GYoV4/77fa+3VzX63Vdr+d12W0et9frfb0vhRBCgIiIiIhkR6+8CyAiIiKiV4NBj4iIiEimGPSIiIiIZIpBj4iIiEimGPSIiIiIZIpBj4iIiEimGPSIiIiIZIpBj4iIiEimGPSIiIiIZIpBj4gqvLNnz2Lo0KFwdnaGsbExVCoVvLy8sHTpUty5c6e8y6twbty4gTlz5iApKalU25w5c6BQKMqhKsDJyQkKhUL6mJmZwcvLC59//jle9CVN9+/fx5w5cxATE/NyiyWSCQY9IqrQNm7ciKZNmyIhIQFTpkxBdHQ0du/ejX79+mHdunUYNmxYeZdY4dy4cQNz584tM+h98MEHiIuLK4eqHmrTpg3i4uIQFxeHrVu3wtTUFGPHjsWiRYte6Hz379/H3LlzGfSInsCgvAsgInqSuLg4jBo1Cp07d8aePXugVCqlts6dO2PSpEmIjo4uxwr/veLiYhQVFWld26tUs2ZN1KxZ87WMVRYrKyu0atVK2u7UqRMcHR2xfv16/Oc//ym3uojkijN6RFRhLVy4EAqFAhs2bCgzCBkZGaFXr17StkajwdKlS1GvXj0olUrY2toiKCgI169f1zrOz88P7u7uSEhIgI+PD0xNTVG7dm0sXrwYGo0GAJCdnQ0jIyPMnDmz1LgXL16EQqHAqlWrpH1//vknRo4ciZo1a8LIyAjOzs6YO3cuioqKpD7p6elQKBRYunQp5s+fD2dnZyiVShw5cgQajQbz58+Hm5sbTExMYGVlhcaNG+Ozzz6Tjr9y5QqGDh0KFxcXmJqawsHBAT179sS5c+ekPjExMWjevDkAYOjQodIy6Zw5cwCUvXT7Mu/b87KwsICrqytu3ryptT87OxujR49GgwYNoFKpYGtriw4dOuDo0aNa99PGxgYAMHfuXOlahwwZIvVJSUnBwIEDYWtrC6VSifr162PNmjUvVCvRG0kQEVVARUVFwtTUVLRs2VLnY0aMGCEAiJCQEBEdHS3WrVsnbGxshFqtFtnZ2VI/X19fYW1tLVxcXMS6devEgQMHxOjRowUAsWXLFqlfnz59hFqtFsXFxVrjTJ06VRgZGYlbt24JIYTIzMwUarVa1KpVS6xfv14cPHhQfPzxx0KpVIohQ4ZIx6WlpQkAwsHBQbRv31588803Yv/+/SItLU0sWrRI6Ovri9mzZ4tDhw6J6OhosXLlSjFnzhzp+NjYWDFp0iTxzTffiNjYWLF7924REBAgTExMxMWLF4UQQuTk5Ijw8HABQMyYMUPExcWJuLg4kZGRIYQQYvbs2eLx//W/7Pv2JLVq1RLdu3fX2ldYWChq1KghGjVqpLX/4sWLYtSoUWLHjh0iJiZG/PDDD2LYsGFCT09PHDlyRAghxD///COio6MFADFs2DDpWq9cuSKEEOL8+fPC0tJSNGrUSPz3v/8V+/fvF5MmTRJ6enpa95VIzhj0iKhC+vPPPwUA8d577+nUPzk5WQAQo0eP1tofHx8vAIj//Oc/0j5fX18BQMTHx2v1bdCggfD395e29+7dKwCI/fv3S/uKioqEvb29ePvtt6V9I0eOFCqVSly9elXrfMuXLxcAxPnz54UQ/xf06tSpIwoKCrT69ujRQ3h4eOh0rY/WUlBQIFxcXMTEiROl/QkJCQKACA8PL3XM40HvVdy3J6lVq5bo1q2bKCwsFIWFheLq1ati+PDhwtDQUPzwww/PvNbCwkLRsWNH0adPH2l/dna2ACBmz55d6hh/f39Rs2ZNkZOTo7U/JCREGBsbizt37jyzZqI3HZduiUgWjhw5AgBay3YA0KJFC9SvXx+HDh3S2l+jRg20aNFCa1/jxo1x9epVabtr166oUaMGwsPDpX379u3DjRs3EBwcLO374Ycf0L59e9jb26OoqEj6dO3aFQAQGxurNU6vXr1gaGhYqs4zZ85g9OjR2LdvH3Jzc0tdY1FRERYuXIgGDRrAyMgIBgYGMDIyQkpKCpKTk591i8r0Ku7b00RFRcHQ0BCGhoaoVasWNm7ciNWrV6N79+6l+q5btw5eXl4wNjaGgYEBDA0NcejQIZ2u9Z9//sGhQ4fQp08fmJqaav29dOvWDf/88w9OnjypU81EbzIGPSKqkKpVqwZTU1OkpaXp1P/27dsAADs7u1Jt9vb2UnsJa2vrUv2USiUePHggbRsYGGDQoEHYvXs3/vrrLwBAREQE7Ozs4O/vL/W7efMmvv/+eynAlHwaNmwIALh165bWOGXVGBYWhuXLl+PkyZPo2rUrrK2t0bFjR5w6dUrqExoaipkzZyIgIADff/894uPjkZCQgCZNmmjV/TxexX17mrZt2yIhIQEnT57E1q1b4eTkhJCQEBw7dkyr36effopRo0ahZcuW+Pbbb3Hy5EkkJCSgS5cuOo11+/ZtFBUVYfXq1aX+Xrp16wag9N8LkRzxqVsiqpD09fXRsWNH/PTTT7h+/foznxQtCSCZmZml+t64cQPVqlV7oTqGDh2KZcuWYceOHejfvz/27t2LCRMmQF9fX+pTrVo1NG7cGAsWLCjzHPb29lrbZf2OnYGBAUJDQxEaGoq//voLBw8exH/+8x/4+/sjIyMDpqam+OqrrxAUFISFCxdqHXvr1i1YWVm90PW9qvv2JJaWlmjWrBkAoGXLlmjZsiWaNGmC0aNHIykpCXp6D+cfvvrqK/j5+WHt2rVax//99986jVOlShXo6+tj0KBBGDNmTJl9nJ2d/8WVEL0ZOKNHRBVWWFgYhBAYPnw4CgoKSrUXFhbi+++/BwB06NABwMOA8KiEhAQkJyejY8eOL1RD/fr10bJlS4SHhyMyMhL5+fkYOnSoVp8ePXrgt99+Q506ddCsWbNSn8eD3rNYWVnhnXfewZgxY3Dnzh2kp6cDeBgQH3/6+Mcff8Qff/yhta+kjy4zX6/qvunKxcUFU6dOxblz57Bz505pf1nXevbs2VK/AfikazU1NUX79u1x+vRpNG7cuMy/l7JmJ4nkhjN6RFRheXt7Y+3atRg9ejSaNm2KUaNGoWHDhigsLMTp06exYcMGuLu7o2fPnnBzc8OIESOwevVq6OnpoWvXrkhPT8fMmTOhVqsxceLEF64jODgYI0eOxI0bN9C6dWu4ublptc+bNw8HDhxA69atMW7cOLi5ueGff/5Beno6oqKisG7dumfOSPbs2RPu7u5o1qwZbGxscPXqVaxcuRK1atWCi4sLgIeBMiIiAvXq1UPjxo2RmJiIZcuWlTp3nTp1YGJigm3btqF+/fpQqVSwt7cvM3C+yvumq8mTJ2PdunWYO3cu3n33Xejr66NHjx74+OOPMXv2bPj6+uLSpUuYN28enJ2dtX6yxtzcHLVq1cJ3332Hjh07omrVqqhWrRqcnJzw2WefoW3btvDx8cGoUaPg5OSEv//+G1euXMH333+Pw4cPv/JrIyp35f00CBHRsyQlJYnBgwcLR0dHYWRkJMzMzISnp6eYNWuWyMrKkvoVFxeLJUuWCFdXV2FoaCiqVasm3n//femnRUr4+vqKhg0blhpn8ODBolatWqX25+TkCBMTEwFAbNy4scwas7Ozxbhx44Szs7MwNDQUVatWFU2bNhXTp08X9+7dE0L831O3y5YtK3X8J598Ilq3bi2qVasmjIyMhKOjoxg2bJhIT0+X+ty9e1cMGzZM2NraClNTU9G2bVtx9OhR4evrK3x9fbXOt337dlGvXj1haGio9VRqWT+v8qru2+PK+nmVEmvWrNH6mZb8/HwxefJk4eDgIIyNjYWXl5fYs2dPmWMdPHhQeHp6CqVSKQCIwYMHS21paWkiODhYODg4CENDQ2FjYyNat24t5s+f/8x6ieRAIcQLvmCQiIiIiCo0fkePiIiISKYY9IiIiIhkikGPiIiISKYY9IiIiIhkikGPiIiISKYY9IiIiIhkij+YXMloNBrcuHED5ubmZb6GiYiIiCoeIQT+/vtv2NvbS68K1AWDXiVz48YNqNXq8i6DiIiIXkBGRsYz37TzKAa9Ssbc3BzAw/9QLCwsyrkaIiIi0kVubi7UarX077iuGPQqmZLlWgsLCwY9IiKiN8zzfu2KD2MQERERyRSDHhEREZFMMegRERERyRSDHhEREZFMMegRERERyRSDHhEREZFMMegRERERyRSDHhEREZFMMegRERERyRSDHhEREZFMMegRERERyRSDHhEREZFMMegRERERyRSDHhEREZFMGZR3AVQ+1hy+AmMzVXmXQUREJBsTO7uWdwmlcEaPiIiISKYY9IiIiIhkikGPiIiISKYY9IiIiIhkikGPiIiISKYY9F6zmJgYKBQK/PXXX+VdChEREckcg95r1rp1a2RmZsLS0rK8SyEiIiKZ4+/ovWZGRkaoUaNGeZdBRERElcAbOaPn5+eHkJAQhISEwMrKCtbW1pgxYwaEEFKfr776Cs2aNYO5uTlq1KiBgQMHIisrS+s8e/fuhYuLC0xMTNC+fXts2bKl1LLqiRMn0K5dO5iYmECtVmPcuHHIy8srs65Lly5BoVDg4sWLWvs//fRTODk5QQhR5tLt08ZYvXo1GjVqJPXds2cPFAoF1qxZI+3z9/dHWFjYC9xJIiIikrM3MugBwJYtW2BgYID4+HisWrUKK1aswKZNm6T2goICfPzxxzhz5gz27NmDtLQ0DBkyRGpPT0/HO++8g4CAACQlJWHkyJGYPn261hjnzp2Dv78/+vbti7Nnz2Lnzp04duwYQkJCyqzJzc0NTZs2xbZt27T2R0ZGYuDAgVAoFKWOedYYfn5+OH/+PG7dugUAiI2NRbVq1RAbGwsAKCoqwokTJ+Dr61tmTfn5+cjNzdX6EBERUeWgEI9Og70h/Pz8kJWVhfPnz0vh6aOPPsLevXtx4cKFMo9JSEhAixYt8Pfff0OlUuGjjz7Cjz/+iHPnzkl9ZsyYgQULFuDu3buwsrJCUFAQTExMsH79eqnPsWPH4Ovri7y8PBgbG5caZ8WKFfj888+RmpoKALh8+TLc3Nxw/vx5NGjQADExMWjfvr3OYyiVStja2mLdunV4++234enpif79+2PFihW4efMm4uLi0K5dO9y9excqVelXms2ZMwdz584ttX/h7kS+Ao2IiOglepWvQMvNzYWlpSVycnJgYWGh83Fv7Ixeq1attGbIvL29kZKSguLiYgDA6dOn0bt3b9SqVQvm5ubw8/MDAFy7dg3Aw2XW5s2ba52zRYsWWtuJiYmIiIiASqWSPv7+/tBoNEhLSyuzrvfeew9Xr17FyZMnAQDbtm2Dh4cHGjRoUGb/Z42hUCjQrl07xMTE4K+//sL58+fx4Ycfori4GMnJyYiJiYGXl1eZIQ8AwsLCkJOTI30yMjKecWeJiIhILmT5MEZeXh7eeustvPXWW/jqq69gY2ODa9euwd/fHwUFBQAAIUSppdTHJzc1Gg1GjhyJcePGlRrD0dGxzLHt7OzQvn17REZGolWrVti+fTtGjhz5xFp1GcPPzw8bNmzA0aNH0aRJE1hZWaFdu3aIjY1FTEyMFGLLolQqoVQqn9hORERE8vXGBr2SGbNHt11cXKCvr4+LFy/i1q1bWLx4MdRqNQDg1KlTWv3r1auHqKgorX2P9/Hy8sL58+dRt27d56otMDAQ06ZNw4ABA5Camor33nvviX11GcPPzw/jx4/HN998I4U6X19fHDx4ECdOnMD48eOfqz4iIiKqHN7YpduMjAyEhobi0qVL2L59O1avXi0FHkdHRxgZGWH16tX4/fffsXfvXnz88cdax48cORIXL17EtGnTcPnyZXz99deIiIgAAGmmb9q0aYiLi8OYMWOQlJSElJQU7N27F2PHjn1qbX379kVubi5GjRqF9u3bw8HB4Yl9dRnD3d0d1tbW2LZtmxT0/Pz8sGfPHjx48ABt27Z93ttHRERElcAbG/SCgoLw4MEDtGjRAmPGjMHYsWMxYsQIAICNjQ0iIiLwv//9Dw0aNMDixYuxfPlyreOdnZ3xzTffYNeuXWjcuDHWrl0rPXVbstTZuHFjxMbGIiUlBT4+PvD09MTMmTNhZ2f31NosLCzQs2dPnDlzBoGBgU/tq8sYCoVCeqrWx8dHOs7S0hKenp7P9aVMIiIiqjze2KduPTw8sHLlypd63gULFmDdunWyfmCh5KkdPnVLRET0clXEp27f2O/ovQxffPEFmjdvDmtraxw/fhzLli174m/kEREREb1pKnXQS0lJwfz583Hnzh04Ojpi0qRJfMMEERERycYbuXRLL45Lt0RERK9GRVy6fWMfxiAiIiKip2PQIyIiIpKpSv0dvcpsTIe6/FkWIiIimeOMHhEREZFMMegRERERyRSDHhEREZFMMegRERERyRQfxqik1hy+wt/RI6JX6lX+phgR6YYzekREREQyxaBHREREJFMMekREREQyxaBHREREJFMMekREREQyVaGCnp+fHyZMmPCvzpGeng6FQoGkpKSXVFX5jEFERET0b1Won1fZtWsXDA0Ny7sMIiIiIlmoUEGvatWq5V0CERERkWxU6KVbJycnLFy4EMHBwTA3N4ejoyM2bNigdcwvv/wCT09PGBsbo1mzZjh9+nSp8164cAHdunWDSqVC9erVMWjQINy6dQsAkJ2djRo1amDhwoVS//j4eBgZGWH//v061/60MQAgOjoabdu2hZWVFaytrdGjRw+kpqZK7d7e3vjoo4+0zpmdnQ1DQ0McOXIEAFBQUICpU6fCwcEBZmZmaNmyJWJiYnSukYiIiCqXChX0yvLJJ59IAW706NEYNWoULl68CADIy8tDjx494ObmhsTERMyZMweTJ0/WOj4zMxO+vr7w8PDAqVOnEB0djZs3b+Ldd98FANjY2GDz5s2YM2cOTp06hXv37uH999/H6NGj8dZbb+lU47PGKKk1NDQUCQkJOHToEPT09NCnTx9oNBoAQGBgILZv3w4hhHTMzp07Ub16dfj6+gIAhg4diuPHj2PHjh04e/Ys+vXrhy5duiAlJeXFbzARERHJlkI8mizKmZ+fHzw8PLBy5UoAD2f0fHx8sHXrVgCAEAI1atTA3Llz8eGHH2LDhg0ICwtDRkYGTE1NAQDr1q3DqFGjcPr0aXh4eGDWrFmIj4/Hvn37pHGuX78OtVqNS5cuwdX14St6xowZg4MHD6J58+Y4c+YMEhISYGxsXGad6enpcHZ2fu4xHpWdnQ1bW1ucO3cO7u7uyM7Ohr29PQ4fPgwfHx8AQOvWrdG2bVssXboUqampcHFxwfXr12Fvby+dp1OnTmjRooXWjOSj8vPzkZ+fL23n5uZCrVZj4e5EvgKNiF4pvgKN6OXJzc2FpaUlcnJyYGFhofNxFX5Gr3HjxtKfFQoFatSogaysLABAcnIymjRpIoU84OES6KMSExNx5MgRqFQq6VOvXj0A0Fo6Xb58OYqKivD1119j27ZtTwx5ZdFljNTUVAwcOBC1a9eGhYUFnJ2dAQDXrl0D8HBmsXPnzti2bRsAIC0tDXFxcQgMDAQA/PrrrxBCwNXVVWuc2NhYret43KJFi2BpaSl91Gq1ztdFREREb7YK9TBGWR5/ClehUEjLnbpMRmo0GvTs2RNLliwp1WZnZyf9+ffff8eNGzeg0Whw9epVrYD5Msbo2bMn1Go1Nm7cCHt7e2g0Gri7u6OgoEDqGxgYiPHjx2P16tWIjIxEw4YN0aRJE2kMfX19JCYmQl9fX2sMlerJM3NhYWEIDQ2Vtktm9IiIiEj+KnzQe5oGDRpg69atePDgAUxMTAAAJ0+e1Orj5eWFb7/9Fk5OTjAwKPtyCwoKEBgYiP79+6NevXoYNmwYzp07h+rVq+tUx7PGuH37NpKTk7F+/XppWfbYsWOl+gUEBGDkyJGIjo5GZGQkBg0aJLV5enqiuLgYWVlZ0jl0oVQqoVQqde5PRERE8lHhl26fZuDAgdDT08OwYcNw4cIFREVFYfny5Vp9xowZgzt37mDAgAH45Zdf8Pvvv2P//v0IDg5GcXExAGD69OnIycnBqlWrMHXqVNSvXx/Dhg3TuY5njVGlShVYW1tjw4YNuHLlCg4fPqw1y1bCzMwMvXv3xsyZM5GcnIyBAwdKba6urggMDERQUBB27dqFtLQ0JCQkYMmSJYiKinrBO0hERERy9kYHPZVKhe+//x4XLlyAp6cnpk+fXmr51N7eHsePH0dxcTH8/f3h7u6O8ePHw9LSEnp6eoiJicHKlSuxdetWWFhYQE9PD1u3bsWxY8ewdu1anep41hh6enrYsWMHEhMT4e7ujokTJ2LZsmVlniswMBBnzpyBj48PHB0dtdrCw8MRFBSESZMmwc3NDb169UJ8fDyXYomIiKhMFeqpW3r1Sp7a4VO3RPSq8albopdHtk/dEhEREdGLYdAjIiIikikGPSIiIiKZYtAjIiIikikGPSIiIiKZeqN/MJle3JgOdZ/rqR0iIiJ683BGj4iIiEimGPSIiIiIZIpBj4iIiEimGPSIiIiIZIpBj4iIiEim+NRtJbXm8BW+65Zkh+9WJSLSxhk9IiIiIpli0CMiIiKSKQY9IiIiIpli0CMiIiKSKQY9IiIiIpmqFEHPz88PEyZMKO8yAABDhgxBQECAtP08tcXExEChUOCvv/56VeURERGRjPDnVf4/JycnTJgw4bUHwl27dsHQ0PC1jklERESVA4NeOatatWp5l0BEREQyVSmWbgGgqKgIISEhsLKygrW1NWbMmAEhBICHy6dXr17FxIkToVAooFAoAAARERGwsrLCvn37UL9+fahUKnTp0gWZmZlPHev8+fPo3r07LCwsYG5uDh8fH6SmppbZ9/Gl2/z8fEydOhVqtRpKpRIuLi748ssvyzz2wYMH6N69O1q1aoU7d+68yG0hIiIiGas0QW/Lli0wMDBAfHw8Vq1ahRUrVmDTpk0AHi6f1qxZE/PmzUNmZqZWkLt//z6WL1+OrVu34ueff8a1a9cwefLkJ47zxx9/oF27djA2Nsbhw4eRmJiI4OBgFBUV6VRnUFAQduzYgVWrViE5ORnr1q2DSlX6DRY5OTl46623UFBQgEOHDj1xZjA/Px+5ublaHyIiIqocKs3SrVqtxooVK6BQKODm5oZz585hxYoVGD58OKpWrQp9fX2Ym5ujRo0aWscVFhZi3bp1qFOnDgAgJCQE8+bNe+I4a9asgaWlJXbs2CF9987VVbfXMl2+fBlff/01Dhw4gE6dOgEAateuXarfzZs30b9/f9SpUwfbt2+HkZHRE8+5aNEizJ07V6fxiYiISF4qzYxeq1atpCVZAPD29kZKSgqKi4ufepypqakU8gDAzs4OWVlZT+yflJQEHx+fF3rAIikpCfr6+vD19X1qv06dOqF27dr4+uuvnxryACAsLAw5OTnSJyMj47nrIiIiojdTpQl6L+rxwKZQKKTv9pXFxMTkhcfS9dju3bvj6NGjuHDhwjP7KpVKWFhYaH2IiIiocqg0Qe/kyZOltl1cXKCvrw8AMDIyeubsni4aN26Mo0ePorCw8LmPbdSoETQaDWJjY5/ab/HixRg8eDA6duyoU9gjIiKiyqnSBL2MjAyEhobi0qVL2L59O1avXo3x48dL7U5OTvj555/xxx9/4NatWy88TkhICHJzc/Hee+/h1KlTSElJwdatW3Hp0qVnHuvk5ITBgwcjODgYe/bsQVpaGmJiYvD111+X6rt8+XIEBgaiQ4cOuHjx4gvXS0RERPJVaYJeUFAQHjx4gBYtWmDMmDEYO3YsRowYIbXPmzcP6enpqFOnDmxsbF54HGtraxw+fBj37t2Dr68vmjZtio0bN+r8nb21a9finXfewejRo1GvXj0MHz4ceXl5ZfZdsWIF3n33XXTo0AGXL19+4ZqJiIhInhTiaV84I9nJzc2FpaUlFu5OhLFZ6Z9tIXqTTeys2xPuRERvmpJ/v3Nycp7r+/aVZkaPiIiIqLJh0CMiIiKSKQY9IiIiIpli0CMiIiKSKQY9IiIiIpmqNO+6JW1jOtTlWzKIiIhkjjN6RERERDLFoEdEREQkUwx6RERERDLFoEdEREQkU3wYo5Jac/iK7F+BxtdhERFRZccZPSIiIiKZYtAjIiIikikGPSIiIiKZYtAjIiIikikGPSIiIiKZqtBBz8/PDxMmTCjvMsqkUCiwZ8+e8i6DiIiI6IkqdNAjIiIiohfHoEdEREQkUxUm6OXl5SEoKAgqlQp2dnb45JNPSvUpKCjA1KlT4eDgADMzM7Rs2RIxMTFSe0REBKysrPDDDz/Azc0NpqameOedd5CXl4ctW7bAyckJVapUwdixY1FcXCwdd/fuXQQFBaFKlSowNTVF165dkZKS8lz1//HHH+jfvz+qVKkCa2tr9O7dG+np6VJ7QkICOnfujGrVqsHS0hK+vr749ddfpfYBAwbgvffe0zpnYWEhqlWrhvDwcACAEAJLly5F7dq1YWJigiZNmuCbb755rjqJiIio8qgwQW/KlCk4cuQIdu/ejf379yMmJgaJiYlafYYOHYrjx49jx44dOHv2LPr164cuXbpohbL79+9j1apV2LFjB6KjoxETE4O+ffsiKioKUVFR2Lp1KzZs2KAVkIYMGYJTp05h7969iIuLgxAC3bp1Q2FhoU61379/H+3bt4dKpcLPP/+MY8eOQaVSoUuXLigoKAAA/P333xg8eDCOHj2KkydPwsXFBd26dcPff/8NAAgMDMTevXtx79496bz79u1DXl4e3n77bQDAjBkzEB4ejrVr1+L8+fOYOHEi3n//fcTGxr7YTSciIiJZUwghRHkXce/ePVhbW+O///0v+vfvDwC4c+cOatasiREjRmDlypVbNQi4AAAgAElEQVRITU2Fi4sLrl+/Dnt7e+nYTp06oUWLFli4cCEiIiIwdOhQXLlyBXXq1AEAfPjhh9i6dStu3rwJlerhK7+6dOkCJycnrFu3DikpKXB1dcXx48fRunVrAMDt27ehVquxZcsW9OvXr8yaFQoFdu/ejYCAAGzevBlLly5FcnIyFAoFgIezj1ZWVtizZw/eeuutUscXFxejSpUqiIyMRI8ePVBYWAh7e3t8+umnGDRoEABg4MCBKCoqwtdff428vDxUq1YNhw8fhre3t3SeDz74APfv30dkZGSZdebn5yM/P1/azs3NhVqtxsLdiXwFGhER0RsiNzcXlpaWyMnJgYWFhc7HVYh33aampqKgoEArwFStWhVubm7S9q+//gohBFxdtf/xzs/Ph7W1tbRtamoqhTwAqF69OpycnKSQV7IvKysLAJCcnAwDAwO0bNlSare2toabmxuSk5N1qj8xMRFXrlyBubm51v5//vkHqampAICsrCzMmjULhw8fxs2bN1FcXIz79+/j2rVrAABDQ0P069cP27Ztw6BBg5CXl4fvvvtOCnAXLlzAP//8g86dO2uNUVBQAE9PzyfWtmjRIsydO1en6yAiIiJ5qRBBT5dJRY1GA319fSQmJkJfX1+r7dEQZ2hoqNWmUCjK3KfRaJ46thBCmp3TpbamTZti27ZtpdpsbGwAPFwezs7OxsqVK1GrVi0olUp4e3tLS7vAw+VbX19fZGVl4cCBAzA2NkbXrl2lMQDgxx9/hIODg9YYSqXyibWFhYUhNDRU2i6Z0SMiIiL5qxBBr27dujA0NMTJkyfh6OgI4OEDEpcvX4avry8AwNPTE8XFxcjKyoKPj89LG7tBgwYoKipCfHy81tLt5cuXUb9+fZ3O4eXlhZ07d8LW1vaJ06lHjx7FF198gW7dugEAMjIycOvWLa0+rVu3hlqtxs6dO/HTTz+hX79+MDIykupUKpW4du2adE90oVQqnxoEiYiISL4qxMMYKpUKw4YNw5QpU3Do0CH89ttvGDJkCPT0/q88V1dXBAYGIigoCLt27UJaWhoSEhKwZMkSREVFvfDYLi4u6N27N4YPH45jx47hzJkzeP/99+Hg4IDevXvrdI7AwEBUq1YNvXv3xtGjR5GWlobY2FiMHz8e169fB/AwzG7duhXJycmIj49HYGAgTExMtM6jUCgwcOBArFu3DgcOHMD7778vtZmbm2Py5MmYOHEitmzZgtTUVJw+fRpr1qzBli1bXvj6iYiISL4qRNADgGXLlqFdu3bo1asXOnXqhLZt26Jp06ZafcLDwxEUFIRJkybBzc0NvXr1Qnx8/L9eigwPD0fTpk3Ro0cPeHt7QwiBqKioUku+T2Jqaoqff/4Zjo6O6Nu3L+rXr4/g4GA8ePBAmuHbvHkz7t69C09PTwwaNAjjxo2Dra1tqXMFBgbiwoULcHBwQJs2bbTaPv74Y8yaNQuLFi1C/fr14e/vj++//x7Ozs7/6vqJiIhInirEU7f0+pQ8tcOnbomIiN4cL/rUbYWZ0SMiIiKil4tBj4iIiEimGPSIiIiIZIpBj4iIiEimGPSIiIiIZKpC/GAyvX5jOtR9rqd2iIiI6M3DGT0iIiIimWLQIyIiIpIpBj0iIiIimWLQIyIiIpIpBj0iIiIimeJTt5XUmsNXXuu7bvneWSIiotePM3pEREREMsWgR0RERCRTDHpEREREMsWgR0RERCRTDHpEREREMvVGBL309HQoFAokJSWVdykAKl49RERERGV5I4Le66RQKLBnz57yLoOIiIjoX2PQIyIiIpKpChH0oqOj0bZtW1hZWcHa2ho9evRAampqqX4XL15E69atYWxsjIYNGyImJkarPTY2Fi1atIBSqYSdnR0++ugjFBUVSe1OTk5YuXKl1jEeHh6YM2eO1A4Affr0gUKhkLZ1ceHCBXTr1g0qlQrVq1fHoEGDcOvWLZ2v0dvbGx999JHWObOzs2FoaIgjR44AAAoKCjB16lQ4ODjAzMwMLVu2LHUPiIiIiEpUiKCXl5eH0NBQJCQk4NChQ9DT00OfPn2g0Wi0+k2ZMgWTJk3C6dOn0bp1a/Tq1Qu3b98GAPzxxx/o1q0bmjdvjjNnzmDt2rX48ssvMX/+fJ3rSEhIAACEh4cjMzNT2n6WzMxM+Pr6wsPDA6dOnUJ0dDRu3ryJd999V+drDAwMxPbt2yGEkI7ZuXMnqlevDl9fXwDA0KFDcfz4cezYsQNnz55Fv3790KVLF6SkpDyxtvz8fOTm5mp9iIiIqHKoEK9Ae/vtt7W2v/zyS9ja2uLChQtwd3eX9oeEhEh9165di+joaHz55ZeYOnUqvvjiC6jVanz++edQKBSoV68ebty4gWnTpmHWrFnQ03t2prWxsQEAWFlZoUaNGjrXv3btWnh5eWHhwoXSvs2bN0OtVuPy5ctwdXV95jX2798fEydOxLFjx+Dj4wMAiIyMxMCBA6Gnp4fU1FRs374d169fh729PQBg8uTJiI6ORnh4uNbYj1q0aBHmzp2r87UQERGRfFSIGb3U1FQMHDgQtWvXhoWFBZydnQEA165d0+rn7e0t/dnAwADNmjVDcnIyACA5ORne3t5QKBRSnzZt2uDevXu4fv36K60/MTERR44cgUqlkj716tWTrk2Xa7SxsUHnzp2xbds2AEBaWhri4uIQGBgIAPj1118hhICrq6vWOLGxsWUuc5cICwtDTk6O9MnIyHhl94GIiIgqlgoxo9ezZ0+o1Wps3LgR9vb20Gg0cHd3R0FBwTOPLQl2QgitkFey79E+enp6WkujAFBYWPiv69doNOjZsyeWLFlSqs3Ozg6AbtcYGBiI8ePHY/Xq1YiMjETDhg3RpEkTaQx9fX0kJiZCX19fawyVSvXE2pRKJZRK5b++RiIiInrzlHvQu337NpKTk7F+/XppyfLYsWNl9j158iTatWsHACgqKkJiYiJCQkIAAA0aNMC3336rFfhOnDgBc3NzODg4AHg4a5aZmSmdLzc3F2lpaVpjGBoaori4+LmuwcvLC99++y2cnJxgYFD6lup6jQEBARg5ciSio6MRGRmJQYMGSW2enp4oLi5GVlaWdA4iIiKipyn3pdsqVarA2toaGzZswJUrV3D48GGEhoaW2XfNmjXYvXs3Ll68iDFjxuDu3bsIDg4GAIwePRoZGRkYO3YsLl68iO+++w6zZ89GaGio9P28Dh06YOvWrTh69Ch+++03DB48uNTsmJOTEw4dOoQ///wTd+/e1ekaxowZgzt37mDAgAH45Zdf8Pvvv2P//v0IDg5GcXGxztdoZmaG3r17Y+bMmUhOTsbAgQOlNldXVwQGBiIoKAi7du1CWloaEhISsGTJEkRFRelUJxEREVUu5R709PT0sGPHDiQmJsLd3R0TJ07EsmXLyuy7ePFiLFmyBE2aNMHRo0fx3XffoVq1agAABwcHREVF4ZdffkGTJk3w4YcfYtiwYZgxY4Z0fFhYGNq1a4cePXqgW7duCAgIQJ06dbTG+OSTT3DgwAGo1Wp4enrqdA329vY4fvw4iouL4e/vD3d3d4wfPx6WlpbQ09N7rmsMDAzEmTNn4OPjA0dHR6228PBwBAUFYdKkSXBzc0OvXr0QHx8PtVqtU51ERERUuSjE419aI1nLzc2FpaUlFu5OhLHZk7/b97JN7Oz62sYiIiKSm5J/v3NycmBhYaHzceU+o0dERERErwaDHhEREZFMMegRERERyRSDHhEREZFMMegRERERyVS5/2AylY8xHeo+11M7RERE9ObhjB4RERGRTDHoEREREckUgx4RERGRTDHoEREREckUH8aopNYcvvLaXoHG158RERGVD87oEREREckUgx4RERGRTDHoEREREckUgx4RERGRTDHoEREREckUg94LSE9Ph0KhQFJSUnmXQkRERPREDHpEREREMiX7oFdQUFDeJRARERGVi9ca9DQaDZYsWYK6detCqVTC0dERCxYskNrPnTuHDh06wMTEBNbW1hgxYgTu3bsntfv5+WHChAla5wwICMCQIUOkbScnJ8yfPx9DhgyBpaUlhg8fjoKCAoSEhMDOzg7GxsZwcnLCokWLpGNycnIwYsQI2NrawsLCAh06dMCZM2ee69ouXLiAbt26QaVSoXr16hg0aBBu3boltUdHR6Nt27awsrKCtbU1evTogdTUVKnd29sbH330kdY5s7OzYWhoiCNHjgB4GFqnTp0KBwcHmJmZoWXLloiJiXmuOomIiKjyeK1BLywsDEuWLMHMmTNx4cIFREZGonr16gCA+/fvo0uXLqhSpQoSEhLwv//9DwcPHkRISMhzj7Ns2TK4u7sjMTERM2fOxKpVq7B37158/fXXuHTpEr766is4OTkBAIQQ6N69O/78809ERUUhMTERXl5e6NixI+7cuaPTeJmZmfD19YWHhwdOnTqF6Oho3Lx5E++++67UJy8vD6GhoUhISMChQ4egp6eHPn36QKPRAAACAwOxfft2CCGkY3bu3Inq1avD19cXADB06FAcP34cO3bswNmzZ9GvXz906dIFKSkpz32PiIiISP4U4tFk8Qr9/fffsLGxweeff44PPvigVPvGjRsxbdo0ZGRkwMzMDAAQFRWFnj174saNG6hevTr8/Pzg4eGBlStXSscFBATAysoKERERAB7O6Hl6emL37t1Sn3HjxuH8+fM4ePAgFAqF1riHDx9Gnz59kJWVBaVSKe2vW7cupk6dihEjRpSqNT09Hc7Ozjh9+jQ8PDwwa9YsxMfHY9++fVKf69evQ61W49KlS3B1Lf0KsOzsbNja2uLcuXNwd3dHdnY27O3tcfjwYfj4+AAAWrdujbZt22Lp0qVITU2Fi4sLrl+/Dnt7e+k8nTp1QosWLbBw4cIy73t+fj7y8/Ol7dzcXKjVaizcnchXoBEREb0hcnNzYWlpiZycHFhYWOh83Gub0UtOTkZ+fj46duz4xPYmTZpIIQ8A2rRpA41Gg0uXLj3XWM2aNdPaHjJkCJKSkuDm5oZx48Zh//79UltiYiLu3bsHa2trqFQq6ZOWlqa1tPo0iYmJOHLkiNbx9erVAwDpHKmpqRg4cCBq164NCwsLODs7AwCuXbsGALCxsUHnzp2xbds2AEBaWhri4uIQGBgIAPj1118hhICrq6vWOLGxsU+tc9GiRbC0tJQ+arVap2siIiKiN5/B6xrIxMTkqe1CiFKzbSVK9uvp6eHxCcjCwsJS/R8NiwDg5eWFtLQ0/PTTTzh48CDeffdddOrUCd988w00Gg3s7OzK/K6blZXVU2suodFo0LNnTyxZsqRUm52dHQCgZ8+eUKvV2LhxI+zt7aHRaODu7q71sEhgYCDGjx+P1atXIzIyEg0bNkSTJk2kMfT19ZGYmAh9fX2tMVSqJ8/MhYWFITQ0VNoumdEjIiIi+XttQc/FxQUmJiY4dOhQmUu3DRo0wJYtW5CXlycFtePHj0NPT09a+rSxsUFmZqZ0THFxMX777Te0b9/+meNbWFigf//+6N+/P9555x106dIFd+7cgZeXF/78808YGBhI39t7Xl5eXvj222/h5OQEA4PSt/T27dtITk7G+vXrpWXZY8eOleoXEBCAkSNHIjo6GpGRkRg0aJDU5unpieLiYmRlZUnn0IVSqdRakiYiIqLK47Ut3RobG2PatGmYOnUq/vvf/yI1NRUnT57El19+CeDhbJaxsTEGDx6M3377DUeOHMHYsWMxaNAg6YGNDh064Mcff8SPP/6IixcvYvTo0fjrr7+eOfaKFSuwY8cOXLx4EZcvX8b//vc/1KhRA1ZWVujUqRO8vb0REBCAffv2IT09HSdOnMCMGTNw6tQpna5tzJgxuHPnDgYMGIBffvkFv//+O/bv34/g4GAUFxejSpUqsLa2xoYNG3DlyhUcPnxYa5athJmZGXr37o2ZM2ciOTkZAwcOlNpcXV0RGBiIoKAg7Nq1C2lpaUhISMCSJUsQFRWlU51ERERUubzWp25nzpyJSZMmYdasWahfvz769++PrKwsAICpqSn27duHO3fuoHnz5njnnXfQsWNHfP7559LxwcHBGDx4MIKCguDr6wtnZ2edZvNUKhWWLFmCZs2aoXnz5khPT0dUVBT09PSgUCgQFRWFdu3aITg4GK6urnjvvfeQnp4uBcxnsbe3x/Hjx1FcXAx/f3+4u7tj/PjxsLS0hJ6eHvT09LBjxw4kJibC3d0dEydOxLJly8o8V2BgIM6cOQMfHx84OjpqtYWHhyMoKAiTJk2Cm5sbevXqhfj4eC7FEhERUZle21O3VDGUPLXDp26JiIjeHBX+qVsiIiIier0Y9IiIiIhkikGPiIiISKYY9IiIiIhkikGPiIiISKZe2w8mU8UypkPd53pqh4iIiN48nNEjIiIikikGPSIiIiKZYtAjIiIikikGPSIiIiKZYtAjIiIikik+dVtJrTl85aW965bvsiUiIqqYOKNHREREJFMMekREREQyxaBHREREJFMMekREREQyxaBHREREJFMVPuhFRETAysrqlY6hUCiwZ88eAEB6ejoUCgWSkpJ0Pv511EhERET0vCp80CMiIiKiF8OgR0RERCRTzxX0vvnmGzRq1AgmJiawtrZGp06dkJeXJ7WHh4ejfv36MDY2Rr169fDFF19IbSVLort27UL79u1hamqKJk2aIC4uTmuMiIgIODo6wtTUFH369MHt27efWdf169fx3nvvoWrVqjAzM0OzZs0QHx8vtX///fdo2rQpjI2NUbt2bcydOxdFRUU6XXNMTAwUCgV+/PFHNGnSBMbGxmjZsiXOnTtXqu++fftQv359qFQqdOnSBZmZmVKbRqPBvHnzULNmTSiVSnh4eCA6Ovq578+JEyfQrl07mJiYQK1WY9y4cVp/B0REREQldA56mZmZGDBgAIKDg5GcnIyYmBj07dsXQggAwMaNGzF9+nQsWLAAycnJWLhwIWbOnIktW7ZonWf69OmYPHkykpKS4OrqigEDBkihKz4+HsHBwRg9ejSSkpLQvn17zJ8//6l13bt3D76+vrhx4wb27t2LM2fOYOrUqdBoNAAehq/3338f48aNw4ULF7B+/XpERERgwYIFz3WjpkyZguXLlyMhIQG2trbo1asXCgsLpfb79+9j+fLl2Lp1K37++Wdcu3YNkydPlto/++wzfPLJJ1i+fDnOnj0Lf39/9OrVCykpKTrfn3PnzsHf3x99+/bF2bNnsXPnThw7dgwhISFPrDs/Px+5ublaHyIiIqokhI4SExMFAJGenl5mu1qtFpGRkVr7Pv74Y+Ht7S2EECItLU0AEJs2bZLaz58/LwCI5ORkIYQQAwYMEF26dNE6R//+/YWlpeUT61q/fr0wNzcXt2/fLrPdx8dHLFy4UGvf1q1bhZ2dnbQNQOzevVurztOnTwshhDhy5IgAIHbs2CH1v337tjAxMRE7d+4UQggRHh4uAIgrV65IfdasWSOqV68ubdvb24sFCxZo1dG8eXMxevRone/PoEGDxIgRI7TOcfToUaGnpycePHhQ5vXPnj1bACj1Wbg7UXy6/9JL+RAREdGrlZOTIwCInJyc5zpO5xm9Jk2aoGPHjmjUqBH69euHjRs34u7duwCA7OxsZGRkYNiwYVCpVNJn/vz5SE1N1TpP48aNpT/b2dkBALKysgAAycnJ8Pb21ur/+PbjkpKS4OnpiapVq5bZnpiYiHnz5mnVNXz4cGRmZuL+/fu6Xr5WHVWrVoWbmxuSk5OlfaampqhTp47WtZVcV25uLm7cuIE2bdponbNNmzZa5wCefn8SExMRERGhdS3+/v7QaDRIS0srs+6wsDDk5ORIn4yMDJ2vmYiIiN5sBrp21NfXx4EDB3DixAns378fq1evxvTp0xEfHw9TU1MAD5dvW7ZsWeq4RxkaGkp/VigUACAts4r/vwz8PExMTJ7artFoMHfuXPTt27dUm7Gx8XOP96iS+gHt6yppe/x6Hu0PPLzex/c97f5oNBqMHDkS48aNK1WLo6NjmTUqlUoolcpnXQoRERHJkM5BD3gYPNq0aYM2bdpg1qxZqFWrFnbv3o3Q0FA4ODjg999/R2Bg4AsX06BBA5w8eVJr3+Pbj2vcuDE2bdqEO3fulDmr5+XlhUuXLqFu3bovXFdJHSVh6u7du7h8+TLq1aun07EWFhawt7fHsWPH0K5dO2n/iRMn0KJFC51r8PLywvnz5//1tRAREVHloHPQi4+Px6FDh/DWW2/B1tYW8fHxyM7ORv369QEAc+bMwbhx42BhYYGuXbsiPz8fp06dwt27dxEaGqrTGOPGjUPr1q2xdOlSBAQEYP/+/VpPppZlwIABWLhwIQICArBo0SLY2dnh9OnTsLe3h7e3N2bNmoUePXpArVajX79+0NPTw9mzZ3Hu3LlnPujxqHnz5sHa2hrVq1fH9OnTUa1aNQQEBOh8/JQpUzB79mzUqVMHHh4eCA8PR1JSErZt26bzOaZNm4ZWrVphzJgxGD58OMzMzJCcnIwDBw5g9erVOp+HiIiIKgedv6NnYWGBn3/+Gd26dYOrqytmzJiBTz75BF27dgUAfPDBB9i0aRMiIiLQqFEj+Pr6IiIiAs7OzjoX06pVK2zatAmrV6+Gh4cH9u/fjxkzZjz1GCMjI+zfvx+2trbo1q0bGjVqhMWLF0tLxv7+/vjhhx9w4MABNG/eHK1atcKnn36KWrVq6VwXACxevBjjx49H06ZNkZmZib1798LIyEjn48eNG4dJkyZh0qRJaNSoEaKjo7F37164uLjofI7GjRsjNjYWKSkp8PHxgaenJ2bOnCl9l4+IiIjoUQrxIl+Mq0RiYmLQvn173L17VxavOcvNzYWlpSUW7k6EsZnqpZxzYmfXl3IeIiIiKlvJv985OTmwsLDQ+Ti+GYOIiIhIphj0iIiIiGTquZ66rYz8/Pxe6GdfiIiIiMobZ/SIiIiIZIpBj4iIiEimuHRbSY3pUPe5ntohIiKiNw9n9IiIiIhkikGPiIiISKYY9IiIiIhkikGPiIiISKb4MEYltebwFb4CjYiISOY4o0dEREQkUwx6RERERDLFoEdEREQkUwx6RERERDLFoEdEREQkU+Ua9IQQGDFiBKpWrQqFQoGkpKTyLOel8PPzw4QJE176eSMiImBlZfXSz0tERETyVa5BLzo6GhEREfjhhx+QmZkJd3f38iynQuvfvz8uX74sbc+ZMwceHh7lWBERERFVdOX6O3qpqamws7ND69atX/gcQggUFxfDwEDePwloYmICExOT8i6DiIiI3iDlNqM3ZMgQjB07FteuXYNCoYCTkxMAID8/H+PGjYOtrS2MjY3Rtm1bJCQkSMfFxMRAoVBg3759aNasGZRKJY4ePSrNcG3evBmOjo5QqVQYNWoUiouLsXTpUtSoUQO2trZYsGDBU+uKiYlBixYtYGZmBisrK7Rp0wZXr16Vag4ICNDqP2HCBPj5+WntKyoqQkhICKysrGBtbY0ZM2ZACCG1Ozk5Yf78+QgKCoJKpUKtWrXw3XffITs7G71794ZKpUKjRo1w6tQp6ZhHl24jIiIwd+5cnDlzBgqFAgqFAhEREc/7V0BEREQyV25B77PPPsO8efNQs2ZNZGZmSmFu6tSp+Pbbb7Flyxb8+uuvqFu3Lvz9/XHnzh2t46dOnYpFixYhOTkZjRs3BvBwhvCnn35CdHQ0tm/fjs2bN6N79+64fv06YmNjsWTJEsyYMQMnT54ss6aioiIEBATA19cXZ8+eRVxcHEaMGAGFQvFc17ZlyxYYGBggPj4eq1atwooVK7Bp0yatPitWrECbNm1w+vRpdO/eHYMGDUJQUBDef/996bqDgoK0AmKJ/v37Y9KkSWjYsCEyMzORmZmJ/v37P1eNREREJH/ltt5paWkJc3Nz6Ovro0aNGgCAvLw8rF27FhEREejatSsAYOPGjThw4AC+/PJLTJkyRTp+3rx56Ny5s9Y5NRoNNm/eDHNzczRo0ADt27fHpUuXEBUVBT09Pbi5uWHJkiWIiYlBq1atStWUm5uLnJwc9OjRA3Xq1AEA1K9f/7mvTa1WY8WKFVAoFHBzc8O5c+ewYsUKDB8+XOrTrVs3jBw5EgAwa9YsrF27Fs2bN0e/fv0AANOmTYO3tzdu3rwp3Z8SJiYmUKlUMDAwKNX2uPz8fOTn52tdIxEREVUOFernVVJTU1FYWIg2bdpI+wwNDdGiRQskJydr9W3WrFmp452cnGBubi5tV69eHQ0aNICenp7WvqysrDLHr1q1KoYMGQJ/f3/07NkTn332GTIzM5/7Olq1aqU1C+jt7Y2UlBQUFxdL+0pmIUtqAoBGjRqV2vekWnW1aNEiWFpaSh+1Wv2vzkdERERvjgoV9EqWKR9fKhVClNpnZmZW6nhDQ0OtbYVCUeY+jUbzxBrCw8MRFxeH1q1bY+fOnXB1dZWWevX09EotpRYWFj7jqsr2aF0l11bWvqfVqouwsDDk5ORIn4yMjH91PiIiInpzVKigV7duXRgZGeHYsWPSvsLCQpw6deqFllBflKenJ8LCwnDixAm4u7sjMjISAGBjY1Nqhq+s3/57/DuAJ0+ehIuLC/T19V9ajUZGRlozhE+iVCphYWGh9SEiIqLKoUIFPTMzM4waNQpTpkxBdHQ0Lly4gOHDh+P+/fsYNmzYKx8/LS0NYWFhiIuLw9Wr/6+9e4+qKe//AP4+nTp1usotlUiSyrhGRENyaZhxmWbM0yhyv1NuqRkql1Azch23xuQW1jM8GDQuQzXowYgGRUOkPOVHhoqIOvv3h9VZc6YylerU7v1aa6817f397v3ZX5nztvf+7nMfJ0+exB9//KEMma6urrh8+TJ27tyJ27dvIygoCDdu3Cixn4yMDMyZMwcpKSnYu3cv1q9fDx8fnyqt1dLSEvfu3UNiYiKys7NVnsMjIgZP8yIAACAASURBVCIiAtT8Hr3SrFy5EgqFAqNGjUJeXh66du2KEydOwNjYuNqPrauri1u3bmHHjh148uQJTE1NMWPGDOWkCTc3NyxatAh+fn549eoVxo0bh9GjR+P69esq+xk9ejRevnwJR0dHSKVSzJw5E5MmTarSWj/77DP85z//Qd++ffHs2TNERkZizJgxVXoMIiIiqtskQmnv7yDRys3NhZGREZYfTICOnn6V7HP2AJsq2Q8RERGVrvjzOycnp0KPYdWqW7dEREREVHUY9IiIiIhEikGPiIiISKQY9IiIiIhEikGPiIiISKRq3etVqGZMd7Xmy5OJiIhEjlf0iIiIiESKQY+IiIhIpBj0iIiIiESKQY+IiIhIpBj0iIiIiESKs27rqe/O3KmS77rl99wSERHVXryiR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIsWgR0RERCRS9S7oxcbGQiKR4NmzZ8p1hw4dgrW1NaRSKXx9fdVYnaoxY8Zg+PDh6i6DiIiI6qh693qVnj17IisrC0ZGRsp1kydPxtixYzFr1iwYGBiosToiIiKiqlOvgt6bN28gk8nQrFkz5brnz5/j0aNHcHNzg5mZmRqrIyIiIqpatfLW7ZYtW2Bubg6FQqGyfujQofD29lb+fOTIETg4OEBHRwdWVlZYvHgxCgsLldslEgk2b96MYcOGQU9PD8uWLVO5dRsbG6u8gufq6gqJRIJjx47B0NAQ+/fvVzn2kSNHoKenh7y8vFJrVigUCA0NhbW1NbS1tdGiRQuEhIQot1+/fh2urq6Qy+Vo1KgRJk2ahOfPnyu3FxUVYc6cOWjQoAEaNWoEPz8/CIKgcgxBEBAWFgYrKyvI5XJ07NixRJ1ERERExWpl0BsxYgSys7MRExOjXPf06VOcOHECnp6eAIATJ07Ay8sLs2bNQnJyMrZs2YLt27erhCsACAoKwrBhw3D9+nWMGzdOZVvPnj2RkpICADhw4ACysrIwYMAAeHh4IDIyUqVtZGQkPv/88zJv7QYEBCA0NBSLFi1CcnIy9uzZAxMTEwBAfn4+PvroIxgbG+O3337Djz/+iF9++QUzZsxQ9l+1ahV++OEHbNu2DefOncOff/6JgwcPqhxj4cKFiIyMxKZNm5CUlITZs2fDy8sLcXFxZY5lQUEBcnNzVRYiIiKqHyTC3y8b1RLDhg1D48aNsW3bNgDA1q1bERQUhAcPHkAqlaJ3794YNGgQAgIClH12794NPz8/ZGZmAnh7Rc/X1xerV69WtomNjUXfvn3x9OlTNGjQAM+ePYOxsTFiYmLg4uICALh06RJ69uyJ9PR0mJmZITs7G2ZmZjh16hT69OlTota8vDw0adIEGzZswIQJE0psj4iIwIIFC5CRkQE9PT0AQHR0NIYMGYLMzEyYmJjAzMwMPj4+WLBgAQCgsLAQrVq1goODAw4dOoQXL16gcePGOHPmDJycnJT7njBhAvLz87Fnz55SxzE4OBiLFy8usX75wQR+BRoREVEdkZubCyMjI+Tk5MDQ0LDc/WrlFT0A8PT0xIEDB1BQUAAAiIqKgoeHB6RSKQAgISEBS5Ysgb6+vnKZOHEisrKykJ+fr9xP165dK3xsR0dHtGvXDjt37gQA7Nq1Cy1atEDv3r1LbX/z5k0UFBSgX79+ZW7v2LGjMuQBQK9evaBQKJCSkoKcnBxkZWWpBDhNTU2V2pOTk/Hq1SsMGDBA5Zx37tyJ1NTUMs8lICAAOTk5yiUjI6NCY0FERER1V62djDFkyBAoFAocO3YM3bp1w9mzZxEeHq7crlAosHjxYri7u5foq6Ojo/zvv4aripgwYQI2bNgAf39/REZGYuzYsZBIJKW2lcvl79yXIAhl9i1r/d8VP6947NgxmJubq2zT1tYus5+2tvY7txMREZF41dorenK5HO7u7oiKisLevXthY2MDBwcH5fYuXbogJSUF1tbWJRYNjfc/LS8vL6Snp2PdunVISkpSmQTyd23atIFcLsfp06dL3W5vb4/ExES8ePFCue78+fPQ0NCAjY0NjIyMYGpqigsXLii3FxYWIiEhQWUf2traSE9PL3G+FhYW732+REREJD619ooe8Pb27ZAhQ5CUlAQvLy+VbYGBgfjkk09gYWGBESNGQENDA9euXcP169exbNmy9z62sbEx3N3dMX/+fAwcOBDNmzcvs62Ojg4WLFgAPz8/yGQy9OrVC48fP0ZSUhLGjx8PT09PBAUFwdvbG8HBwXj8+DFmzpyJUaNGKSds+Pj4YOXKlWjTpg3s7OwQHh6u8lJnAwMDzJs3D7Nnz4ZCoYCzszNyc3MRHx8PfX39dwZRIiIiqp9qddBzdXVFw4YNkZKSgpEjR6psc3Nzw9GjR7FkyRKEhYVBS0sLtra2pU6GqKzx48djz549JWbrlmbRokXQ1NREYGAgMjMzYWpqiilTpgAAdHV1ceLECfj4+KBbt27Q1dXFZ599pnIreu7cucjKysKYMWOgoaGBcePG4dNPP0VOTo6yzdKlS9G0aVOsWLECd+/eRYMGDdClSxd89dVXVXbOREREJB61dtZtbRAVFQUfHx9kZmZCJpOpu5wqUTxrh7NuiYiI6o7Kzrqt1Vf01CU/Px/37t3DihUrMHnyZNGEPCIiIqpfau1kDHUKCwtDp06dYGJiovKePiIiIqK6hEGvFMHBwXjz5g1Onz4Nff33v71JREREpA4MekREREQixWf06qnprtYVepiTiIiI6h5e0SMiIiISKQY9IiIiIpFi0CMiIiISKQY9IiIiIpFi0CMiIiISKc66rae+O3Pnvb8CjV9/RkREVLvxih4RERGRSDHoEREREYkUgx4RERGRSDHoEREREYkUgx4RERGRSNX6oJeWlgaJRILExEQAQGxsLCQSCZ49e1au/i4uLvD19a3OElVs374dDRo0qJZ9SyQSHDp0qFr2TUREROJT64Pe3/Xs2RNZWVkwMjJSdyk1LisrC4MGDQJQMgATERER/V2de4+eTCZDs2bN1F2GWtTX8yYiIqLKqRVX9BQKBUJDQ2FtbQ1tbW20aNECISEhpbYt7dbt+fPn0adPH+jq6sLY2Bhubm54+vRpqf2PHz8OIyMj7Ny5s9TtT58+haenJ5o0aQK5XI42bdogMjKyzGMnJiZCIpEgLS1NZT+HDh2CjY0NdHR0MGDAAGRkZCi3BQcHo1OnTvjhhx/QokUL6OvrY+rUqSgqKkJYWBiaNWuGpk2blhiDv966bdWqFQCgc+fOkEgkcHFxKfV8iIiIqP6qFVf0AgICEBERgdWrV8PZ2RlZWVm4detWufomJiaiX79+GDduHNatWwdNTU3ExMSgqKioRNt9+/Zh0qRJ2LVrF4YNG1bq/hYtWoTk5GT8/PPPaNy4Me7cuYOXL19W6Hzy8/MREhKCHTt2QCaTYdq0afDw8MD58+eVbVJTU/Hzzz/j+PHjSE1Nxeeff4579+7BxsYGcXFxiI+Px7hx49CvXz/06NGjxDEuXboER0dH/PLLL2jXrh1kMlmFaiQiIiLxU3vQy8vLw9q1a7FhwwZ4e3sDAFq3bg1nZ+dy9Q8LC0PXrl2xceNG5bp27dqVaLdx40Z89dVXOHz4MPr27Vvm/tLT09G5c2d07doVAGBpaVmBs3nrzZs32LBhA7p37w4A2LFjB+zs7JThDHh7FfOHH36AgYEB7O3t0bdvX6SkpCA6OhoaGhpo27YtQkNDERsbW2rQa9KkCQCgUaNG77ylW1BQgIKCAuXPubm5FT4fIiIiqpvUfuv25s2bKCgoQL9+/SrVv/iK3rscOHAAvr6+OHny5DtDHgBMnToV+/btQ6dOneDn54f4+PgK16SpqakMigBga2uLBg0a4ObNm8p1lpaWMDAwUP5sYmICe3t7aGhoqKx79OhRhY//VytWrICRkZFysbCweK/9ERERUd2h9qAnl8urvX+nTp3QpEkTREZGQhCEd7YdNGgQ7t+/D19fX2RmZqJfv36YN28eAChD2F/38ebNm1L3I5FI3rlOS0urxLbS1ikUinfW+08CAgKQk5OjXP76rCARERGJm9qDXps2bSCXy3H69OlK9e/QocM/9m3dujViYmJw+PBhzJw58x/32aRJE4wZMwa7d+/GmjVrsHXrVuV64O1rToqV9nqTwsJCXL58WflzSkoKnj17Bltb23KdU3kUP5NX2rOIf6WtrQ1DQ0OVhYiIiOoHtQc9HR0dLFiwAH5+fti5cydSU1Nx4cIFbNu2rVz9AwIC8Ntvv2HatGm4du0abt26hU2bNiE7O1ulnY2NDWJiYpS3ccsSGBiIw4cP486dO0hKSsLRo0dhZ2cHALC2toaFhQWCg4Pxxx9/4NixY1i1alWJfWhpaWHmzJm4ePEirly5grFjx6JHjx7K5/OqQtOmTSGXy3H8+HH83//9H3Jycqps30RERCQOag96wNuZrnPnzkVgYCDs7Ozwr3/9q9zPptnY2ODkyZP4/fff4ejoCCcnJxw+fBiamiXnmbRt2xZnzpzB3r17MXfu3FL3J5PJEBAQgA4dOqB3796QSqXYt28fgLcBbu/evbh16xY6duyI0NBQLFu2rMQ+dHV1sWDBAowcORJOTk6Qy+XKfVQVTU1NrFu3Dlu2bIGZmVmZs4iJiIio/pII//TQGolKbm4ujIyMsPxgAnT09N9rX7MH2FRRVURERPQuxZ/fOTk5FXoMq1Zc0SMiIiKiqsegR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIqX277ol9Zjuas2XJxMREYkcr+gRERERiRSDHhEREZFIMegRERERiRSDHhEREZFIMegRERERiRRn3dZT3525U6nvuuX32xIREdUdvKJHREREJFIMekREREQixaBHREREJFIMekREREQixaBHREREJFKiDHqWlpZYs2ZNtR7DxcUFvr6+1XoMIiIiovchyqBHRERERAx6RERERKJV54Kei4sLZsyYgRkzZqBBgwZo1KgRFi5cCEEQyuwTHh6O9u3bQ09PDxYWFpg2bRqeP38OAHjx4gUMDQ2xf/9+lT5HjhyBnp4e8vLyylXX69ev4efnB3Nzc+jp6aF79+6IjY1Vbn/y5Am+/PJLNG/eHLq6umjfvj327t2r3L5lyxaYm5tDoVCo7Hfo0KHw9vZWqcvBwQE6OjqwsrLC4sWLUVhYWK4aiYiIqH6pc0EPAHbs2AFNTU1cvHgR69atw+rVq/H999+X2V5DQwPr1q3DjRs3sGPHDpw5cwZ+fn4AAD09PXh4eCAyMlKlT2RkJD7//HMYGBiUq6axY8fi/Pnz2LdvH65du4YRI0bgo48+wu3btwEAr169goODA44ePYobN25g0qRJGDVqFC5evAgAGDFiBLKzsxETE6Pc59OnT3HixAl4enoCAE6cOAEvLy/MmjULycnJ2LJlC7Zv346QkJAy6yooKEBubq7KQkRERPWDRHjXpbBayMXFBY8ePUJSUhIkEgkAwN/fHz/99BOSk5MBvJ2M4evrW+ZkiR9//BFTp05FdnY2AODSpUvo2bMn0tPTYWZmhuzsbJiZmeHUqVPo06dPmXV06tQJa9asQWpqKtq0aYMHDx7AzMxM2aZ///5wdHTE8uXLS93Hxx9/DDs7O3z77bcAgGHDhqFx48bYtm0bAGDr1q0ICgrCgwcPIJVK0bt3bwwaNAgBAQHKfezevRt+fn7IzMws9RjBwcFYvHhxifXLDybwK9CIiIjqiNzcXBgZGSEnJweGhobl7lcnr+j16NFDGfIAwMnJCbdv30ZRUVGp7WNiYjBgwACYm5vDwMAAo0ePxpMnT/DixQsAgKOjI9q1a4edO3cCAHbt2oUWLVqgd+/e5arnypUrEAQBNjY20NfXVy5xcXFITU0FABQVFSEkJAQdOnRAo0aNoK+vj5MnTyI9PV25H09PTxw4cAAFBQUAgKioKHh4eEAqlQIAEhISsGTJEpVjTJw4EVlZWcjPzy+1toCAAOTk5CiXjIyMcp0TERER1X2a6i6gut2/fx+DBw/GlClTsHTpUjRs2BDnzp3D+PHj8ebNG2W7CRMmYMOGDfD390dkZCTGjh2rEibfRaFQQCqVIiEhQRnKiunrv71qtmrVKqxevRpr1qxRPi/o6+uL169fK9sOGTIECoUCx44dQ7du3XD27FmEh4erHGfx4sVwd3cvUYOOjk6ptWlra0NbW7tc50FERETiUieD3oULF0r83KZNmxIhCwAuX76MwsJCrFq1Choaby9g/vvf/y7RzsvLC35+fli3bh2SkpJUJkD8k86dO6OoqAiPHj3Chx9+WGqbs2fPYtiwYfDy8gLwNrTdvn0bdnZ2yjZyuRzu7u6IiorCnTt3YGNjAwcHB+X2Ll26ICUlBdbW1uWujYiIiOqvOhn0MjIyMGfOHEyePBlXrlzB+vXrsWrVqlLbtm7dGoWFhVi/fj2GDBmC8+fPY/PmzSXaGRsbw93dHfPnz8fAgQPRvHnzctdjY2MDT09PjB49GqtWrULnzp2RnZ2NM2fOoH379hg8eDCsra1x4MABxMfHw9jYGOHh4Xj48KFK0APe3r4dMmQIkpKSlKGwWGBgID755BNYWFhgxIgR0NDQwLVr13D9+nUsW7as3PUSERFR/VAnn9EbPXo0Xr58CUdHR0yfPh0zZ87EpEmTSm3bqVMnhIeHIzQ0FB988AGioqKwYsWKUtuOHz8er1+/xrhx4ypcU2RkJEaPHo25c+eibdu2GDp0KC5evAgLCwsAwKJFi9ClSxe4ubnBxcUFzZo1w/Dhw0vsx9XVFQ0bNkRKSgpGjhypss3NzQ1Hjx7FqVOn0K1bN/To0QPh4eFo2bJlheslIiIi8auTs26LZ7tWtaioKPj4+CAzMxMymazK918bFM/a4axbIiKiuqOys27r5K3bqpafn4979+5hxYoVmDx5smhDHhEREdUvdfLWbVULCwtDp06dYGJiovKOOiIiIqK6rM7duqX3w1u3REREdU+9emEyEREREf0zPqNXT013ta7QvwiIiIio7uEVPSIiIiKRYtAjIiIiEikGPSIiIiKRYtAjIiIiEikGPSIiIiKR4qzbeuq7M3eU79Hju/GIiIjEiVf0iIiIiESKQY+IiIhIpBj0iIiIiESKQY+IiIhIpBj0iIiIiESKQa8apaWlQSKRIDExUd2lEBERUT3EoEdEREQkUgx6RERERCLFoFcFFAoFQkNDYW1tDW1tbbRo0QIhISGlto2Li4OjoyO0tbVhamoKf39/FBYWKrfv378f7du3h1wuR6NGjdC/f3+8ePFCuT0yMhJ2dnbQ0dGBra0tNm7cWO3nR0RERHUTvxmjCgQEBCAiIgKrV6+Gs7MzsrKycOvWrRLt/ve//2Hw4MEYM2YMdu7ciVu3bmHixInQ0dFBcHAwsrKy8OWXXyIsLAyffvop8vLycPbsWQiCAACIiIhAUFAQNmzYgM6dO+Pq1auYOHEi9PT04O3tXdOnTURERLUcg957ysvLw9q1a7FhwwZl2GrdujWcnZ2Rlpam0nbjxo2wsLDAhg0bIJFIYGtri8zMTCxYsACBgYHIyspCYWEh3N3d0bJlSwBA+/btlf2XLl2KVatWwd3dHQDQqlUrJCcnY8uWLWUGvYKCAhQUFCh/zs3NrcrTJyIiolqMt27f082bN1FQUIB+/fqVq62TkxMkEolyXa9evfD8+XM8ePAAHTt2RL9+/dC+fXuMGDECERERePr0KQDg8ePHyMjIwPjx46Gvr69cli1bhtTU1DKPuWLFChgZGSkXCwuL9z9pIiIiqhMY9N6TXC4vd1tBEFRCXvE6AJBIJJBKpTh16hR+/vln2NvbY/369Wjbti3u3bsHhUIB4O3t28TEROVy48YNXLhwocxjBgQEICcnR7lkZGRU4iyJiIioLmLQe09t2rSBXC7H6dOn/7Gtvb094uPjleEOAOLj42FgYABzc3MAbwNfr169sHjxYly9ehUymQwHDx6EiYkJzM3NcffuXVhbW6ssrVq1KvOY2traMDQ0VFmIiIiofuAzeu9JR0cHCxYsgJ+fH2QyGXr16oXHjx8jKSmpxO3cadOmYc2aNZg5cyZmzJiBlJQUBAUFYc6cOdDQ0MDFixdx+vRpDBw4EE2bNsXFixfx+PFj2NnZAQCCg4Mxa9YsGBoaYtCgQSgoKMDly5fx9OlTzJkzRx2nT0RERLUYg14VWLRoETQ1NREYGIjMzEyYmppiypQpJdqZm5sjOjoa8+fPR8eOHdGwYUOMHz8eCxcuBAAYGhri119/xZo1a5Cbm4uWLVti1apVGDRoEABgwoQJ0NXVxTfffAM/Pz/o6emhffv28PX1rdHzJSIiorpBIvz1PiKJXm5uLoyMjLD8YAJ09PQBALMH2Ki5KiIiInqX4s/vnJycCj2GxWf0iIiIiESKQY+IiIhIpBj0iIiIiESKQY+IiIhIpBj0iIiIiESKr1epp6a7WvPlyURERCLHK3pEREREIsWgR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIsWgR0RERCRSDHpEREREIqWp7gKoZgmCAADIzc1VcyVERERUXsWf28Wf4+XFoFfPPHnyBABgYWGh5kqIiIioovLy8mBkZFTu9gx69UzDhg0BAOnp6RX6RaH3l5ubCwsLC2RkZMDQ0FDd5dQ7HH/14dirD8devapy/AVBQF5eHszMzCrUj0GvntHQePtYppGREf/Sq4mhoSHHXo04/urDsVcfjr16VdX4V+YCDSdjEBEREYkUgx4RERGRSEmDg4OD1V0E1SypVAoXFxdoavLOfU3j2KsXx199OPbqw7FXL3WPv0So6DxdIiIiIqoTeOuWiIiISKQY9IiIiIhEikGPiIiISKQY9IiIiIhEikFPhDZu3IhWrVpBR0cHDg4OOHv27DvbHzhwAPb29tDW1oa9vT0OHjxYQ5WKT0XGPiIiAh9++CGMjY1hbGyM/v3749KlSzVYrbhU9Pe+2L59+yCRSDB8+PBqrlDcKjr+z549w/Tp02FqagodHR3Y2dkhOjq6hqoVl4qO/Zo1a9C2bVvI5XJYWFhg9uzZePXqVQ1VKx6//vorhgwZAjMzM0gkEhw6dOgf+8TFxcHBwQE6OjqwsrLC5s2bq79QgURl3759gpaWlhARESEkJycLPj4+gp6ennD//v1S28fHxwtSqVRYvny5cPPmTWH58uWCpqamcOHChRquvO6r6NiPHDlS+O6774SrV68KN2/eFMaOHSsYGRkJDx48qOHK676Kjn2xtLQ0wdzcXPjwww+FYcOG1VC14lPR8S8oKBC6du0qDB48WDh37pyQlpYmnD17VkhMTKzhyuu+io797t27BW1tbSEqKkq4d++ecOLECcHU1FTw9fWt4crrvujoaOHrr78WDhw4IAAQDh48+M72d+/eFXR1dQUfHx8hOTlZiIiIELS0tIT9+/dXa50MeiLj6OgoTJkyRWWdra2t4O/vX2r7L774Qvjoo49U1rm5uQkeHh7VVqNYVXTs/66wsFAwMDAQduzYUR3liVplxr6wsFDo1auX8P333wve3t4Meu+houO/adMmwcrKSnj9+nVNlCdqFR376dOnC66urirr5syZIzg7O1dbjfVBeYKen5+fYGtrq7Ju8uTJQo8ePaqzNIG3bkXk9evXSEhIwMCBA1XWDxw4EPHx8aX2+e9//1uivZubW5ntqXSVGfu/y8/Px5s3b9CwYcPqKFG0Kjv2S5YsQZMmTTB+/PjqLlHUKjP+P/30E5ycnDB9+nSYmJjggw8+wPLly1FUVFQTJYtGZcbe2dkZCQkJysdE7t69i+joaHz88cfVXm99V9bn7eXLl/HmzZtqOy5fky0i2dnZKCoqgomJicp6ExMTPHz4sNQ+Dx8+rFB7Kl1lxv7v/P39YW5ujv79+1dHiaJVmbE/f/48tm3bhsTExJooUdQqM/53797FmTNn4OnpiejoaNy+fRvTp09HYWEhAgMDa6JsUajM2Ht4eODx48dwdnaGIAgoLCzE1KlT4e/vXxMl12tlfd4WFhYiOzsbpqam1XJcBj0RkkgkKj8LglBi3fu0p7JVdizDwsKwd+9exMbGQkdHp7rKE7Xyjn1eXh68vLwQERGBxo0b11R5oleR332FQoGmTZti69atkEqlcHBwQGZmJr755hsGvUqoyNjHxsYiJCQEGzduRPfu3XHnzh34+PjA1NQUixYtqoly67XS/qxKW1+VGPREpHHjxpBKpSX+Jffo0aMS/4oo1qxZswq1p9JVZuyLffvtt1i+fDl++eUXdOjQoTrLFKWKjn1qairS0tIwZMgQ5TqFQgEA0NTUREpKClq3bl29RYtIZX73TU1NoaWlBalUqlxnZ2eHhw8f4vXr15DJZNVas1hUZuwXLVqEUaNGYcKECQCA9u3b48WLF5g0aRK+/vpraGjwia7qUtbnraamJho1alRtx+WfqIjIZDI4ODjg1KlTKutPnTqFnj17ltrHycmpRPuTJ0+W2Z5KV5mxB4BvvvkGS5cuxfHjx9G1a9fqLlOUKjr2tra2uH79OhITE5XL0KFD0bdvXyQmJsLCwqKmSheFyvzu9+rVC3fu3FEGbAD4448/YGpqypBXAZUZ+/z8/BJhTiqVQng7ObPaaqWyP2+7du0KLS2t6jtwtU71oBpXPNV+27ZtQnJysuDr6yvo6ekJaWlpgiAIwqhRo1RmY50/f16QSqXCypUrhZs3bworV67k61UqqaJjHxoaKshkMmH//v1CVlaWcsnLy1PXKdRZFR37v+Os2/dT0fFPT08X9PX1hRkzZggpKSnC0aNHhaZNmwrLli1T1ynUWRUd+6CgIMHAwEDYYLRURwAABR5JREFUu3evcPfuXeHkyZNC69athS+++EJdp1Bn5eXlCVevXhWuXr0qABDCw8OFq1evKl9t4+/vL4waNUrZvvj1KrNnzxaSk5OFbdu28fUqVDnfffed0LJlS0EmkwldunQR4uLilNv69OkjeHt7q7T/8ccfhbZt2wpaWlqCra2tcODAgRquWDwqMvYtW7YUAJRYgoKCar5wEajo7/1fMei9v4qOf3x8vNC9e3dBW1tbsLKyEkJCQoTCwsIarlocKjL2b968EYKDg4XWrVsLOjo6goWFhTBt2jTh6dOnaqi8bouJiSn1/+HF4+3t7S306dNHpU9sbKzQuXNnQSaTCZaWlsKmTZuqvU6JIPBaLREREZEY8Rk9IiIiIpFi0CMiIiISKQY9IiIiIpFi0CMiIiISKQY9IiIiIpFi0CMiIiISKQY9IiIiIpFi0CMiIiISKQY9IiICALi4uMDX11fdZRBRFWLQIyIiIhIpBj0iolpAEASEhYXBysoKcrkcHTt2xP79+6FQKNC8eXNs3rxZpf2VK1cgkUhw9+5dAEBOTg4mTZqEpk2bwtDQEK6urvj999+V7YODg9GpUyfs2rULlpaWMDIygoeHB/Ly8gAAY8aMQVxcHNauXQuJRAKJRIK0tLQaO38iqh4MekREtcDChQsRGRmJTZs2ISkpCbNnz4aXlxfOnj0LDw8PREVFqbTfs2cPnJycYGVlBUEQ8PHHH+Phw4eIjo5GQkICunTpgn79+uHPP/9U9klNTcWhQ4dw9OhRHD16FHFxcVi5ciUAYO3atXBycsLEiRORlZWFrKwsWFhY1OgYEFHV01R3AURE9d2LFy8QHh6OM2fOwMnJCQBgZWWFc+fOYcuWLZg/fz7Cw8Nx//59tGzZEgqFAvv27cNXX30FAIiJicH169fx6NEjaGtrAwC+/fZbHDp0CPv378ekSZMAAAqFAtu3b4eBgQEAYNSoUTh9+jRCQkJgZGQEmUwGXV1dNGvWTA2jQETVgUGPiEjNkpOT8erVKwwYMEBl/evXr9G5c2d07twZtra22Lt3L/z9/REXF4dHjx7hiy++AAAkJCTg+fPnaNSokUr/ly9fIjU1VfmzpaWlMuQBgKmpKR49elSNZ0ZE6sagR0SkZgqFAgBw7NgxmJubq2wrvkLn6emJPXv2wN/fH3v27IGbmxsaN26s7G9qaorY2NgS+27QoIHyv7W0tFS2SSQS5bGJSJwY9IiI1Mze3h7a2tpIT09Hnz59Sm0zcuRILFy4EAkJCdi/fz82bdqk3NalSxc8fPgQmpqasLS0rHQdMpkMRUVFle5PRLUPgx4RkZoZGBhg3rx5mD17NhQKBZydnZGbm4v4+Hjo6+vD29sbrVq1Qs+ePTF+/HgUFhZi2LBhyv79+/eHk5MThg8fjtDQULRt2xaZmZmIjo7G8OHD0bVr13LVYWlpiYsXLyItLQ36+vpo2LAhNDQ4Z4+oLuPfYCKiWmDp0qUIDAzEihUrYGdnBzc3Nxw5cgStWrVStvH09MTvv/8Od3d3yOVy5XqJRILo6Gj07t0b48aNg42NDTw8PJCWlgYTE5Ny1zBv3jxIpVLY29ujSZMmSE9Pr9JzJKKaJxEEQVB3EURERERU9XhFj4iIiEikGPSIiIiIRIpBj4iIiEikGPSIiIiIRIpBj4iIiEikGPSIiIiIRIpBj4iIiEikGPSIiIiIRIpBj4iIiEikGPSIiIiIRIpBj4iIiEikGPSIiIiIROr/AfoIObnMySpuAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import matplotlib.pyplot as plt; plt.rcdefaults()\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    " \n",
    "objects = ('close','play leave','click submit','verify code','form submit','send cellphone', 'course leave', \n",
    "           'about leave', 'demo leave', 'btn click', 'index leave','page view')\n",
    "y_pos = np.arange(len(objects))\n",
    "performance = [nclose/nall,npleave/nall,nsubmit/nall,nverify/nall,nform/nall,nsend/nall,ncleave/nall,\n",
    "               naleave/nall,ndleave/nall,nclick/nall,nileave/nall,nview/nall]\n",
    " \n",
    "plt.barh(y_pos, performance, align='center', alpha=0.5)\n",
    "plt.yticks(y_pos, objects)\n",
    "plt.xlabel('event')\n",
    "plt.title('Conversation Rate') \n",
    "plt.savefig('conversationrate.png',bbox_inches=\"tight\",dpi=500)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The key factors that bottleneck the conversion rate is sign up/send celpphone verification"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can also look into why users view the page but never click"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [],
   "source": [
    "#create a new data frame to check the user read page but do not click\n",
    "df_vtc = df_view[~df_view.dist_id.isin(df_btnclick.dist_id)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count                                         9441\n",
       "unique                                        7088\n",
       "top       651397ce6ca369703bfa0f67342058c26cc1f4b9\n",
       "freq                                            32\n",
       "Name: dist_id, dtype: object"
      ]
     },
     "execution_count": 47,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_vtc['dist_id'].describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Among the user viewd page but do not click: most user only view once and never click"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "神策数据 | Sensors Data - 国内领先的用户行为分析产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     5633\n",
      "介绍 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              676\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－demo                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     368\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－B轮融资发布会                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  245\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动-视频列表                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     177\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       113\n",
      "数据模型 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            105\n",
      "JavaScript SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  104\n",
      "可视化埋点 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           103\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动-网址构建工具                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    97\n",
      "weixin://private/setresult/SCENE_FETCHQUEUE&eyJmdW5jIjoibG9nIiwicGFyYW1zIjp7Im1zZyI6Il9ydW5PbjNyZEFwaUxpc3QgOiBtZW51OnNoYXJlOnRpbWVsaW5lLG1lbnU6c2hhcmU6YXBwbWVzc2FnZSxvblZvaWNlUmVjb3JkRW5kLG9uVm9pY2VQbGF5QmVnaW4sb25Wb2ljZVBsYXlFbmQsb25Mb2NhbEltYWdlVXBsb2FkUHJvZ3Jlc3Msb25JbWFnZURvd25sb2FkUHJvZ3Jlc3Msb25Wb2ljZVVwbG9hZFByb2dyZXNzLG9uVm9pY2VEb3dubG9hZFByb2dyZXNzLG1lbnU6c2V0Zm9udCxtZW51OnNoYXJlOndlaWJvLG1lbnU6c2hhcmU6ZW1haWwsd3hkb3dubG9hZDpzdGF0ZV9jaGFuZ2UsaGRPbkRldmljZVN0YXRlQ2hhbmdlZCxhY3Rpdml0eTpz      93\n",
      "事件分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             89\n",
      "Android SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      84\n",
      "惠州网站建设|惠州网站设计|惠州网站制作|网站设计-微斯诺科技                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           81\n",
      "数据接入 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             76\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－关于                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        74\n",
      "数据格式 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             72\n",
      "如何准确的标识用户 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        64\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－视频播放                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      61\n",
      "漏斗分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             54\n",
      "iOS SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          51\n",
      "用户分群 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             49\n",
      "weixin://private/setresult/SCENE_HANDLEMSGFROMWX&eyJfX2Vycl9jb2RlIjoiY2I0MDQifQ==                                                                                                                                                                                                                                                                                                                                                                                                                                         49\n",
      "留存分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             48\n",
      "自定义查询 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            45\n",
      "Java SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         43\n",
      "用户路径分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           36\n",
      "查询 API · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           34\n",
      "数据清理工具使用说明 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       32\n",
      "PHP SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          30\n",
      "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        ... \n",
      "电商类产品 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             6\n",
      "数据接入基本原则 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          5\n",
      "书签和数据概览 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           5\n",
      "推荐分享 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              5\n",
      "从外部 Kafka 接入数据的方案 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 5\n",
      "权限管理 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              5\n",
      "Ruby SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          5\n",
      "关于我们 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              4\n",
      "HdfsImporter · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      4\n",
      "数据接入 API · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          4\n",
      "产品视频 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              4\n",
      "第三方登录 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             3\n",
      "基础指标解释和配置 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         3\n",
      "导入实时查看 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            3\n",
      "企业服务类产品 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           3\n",
      "典型场景数据接入方案 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        3\n",
      "微信小程序 SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         3\n",
      "多项目 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               3\n",
      "神策分析相关名词 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          3\n",
      "功能 API · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            3\n",
      "CustomUserSegmenter 使用说明 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                          3\n",
      "APICloud SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      3\n",
      "订阅实时数据 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            3\n",
      "查询抽样 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              3\n",
      "数据导入常见问题 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          2\n",
      "Java SDK Demo · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     2\n",
      "分析师事件权限设置工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       1\n",
      "导入辅助工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            1\n",
      "进阶使用场景 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            1\n",
      "Sensor Analytics - help you implement data drivers                                                                                                                                                                                                                                                                                                                                                                                                                                                                         1\n",
      "Name: title, Length: 97, dtype: int64\n"
     ]
    }
   ],
   "source": [
    "print(df_vtc.title.value_counts(dropna=False))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count                                        32620\n",
       "unique                                       11587\n",
       "top       08ba9b365da9b395ab2a03ed1a76b97e01716a39\n",
       "freq                                           152\n",
       "Name: dist_id, dtype: object"
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_view['dist_id'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "神策数据 | Sensors Data - 国内领先的用户行为分析产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     13700\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－demo                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     4148\n",
      "介绍 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              3542\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       2455\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－B轮融资发布会                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  1899\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－关于                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       1183\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动-视频列表                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     1129\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动－视频播放                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      830\n",
      "数据模型 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             232\n",
      "JavaScript SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   214\n",
      "事件分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             152\n",
      "数据格式 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             150\n",
      "可视化埋点 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            148\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动-网址构建工具                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    147\n",
      "weixin://private/setresult/SCENE_FETCHQUEUE&eyJmdW5jIjoibG9nIiwicGFyYW1zIjp7Im1zZyI6Il9ydW5PbjNyZEFwaUxpc3QgOiBtZW51OnNoYXJlOnRpbWVsaW5lLG1lbnU6c2hhcmU6YXBwbWVzc2FnZSxvblZvaWNlUmVjb3JkRW5kLG9uVm9pY2VQbGF5QmVnaW4sb25Wb2ljZVBsYXlFbmQsb25Mb2NhbEltYWdlVXBsb2FkUHJvZ3Jlc3Msb25JbWFnZURvd25sb2FkUHJvZ3Jlc3Msb25Wb2ljZVVwbG9hZFByb2dyZXNzLG9uVm9pY2VEb3dubG9hZFByb2dyZXNzLG1lbnU6c2V0Zm9udCxtZW51OnNoYXJlOndlaWJvLG1lbnU6c2hhcmU6ZW1haWwsd3hkb3dubG9hZDpzdGF0ZV9jaGFuZ2UsaGRPbkRldmljZVN0YXRlQ2hhbmdlZCxhY3Rpdml0eTpz      142\n",
      "数据接入 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             139\n",
      "Android SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      132\n",
      "电商类产品 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            120\n",
      "iOS SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          118\n",
      "神策分析|Sensors Analytics-帮你实现数据驱动-JavaScript SDK 自动生成工具                                                                                                                                                                                                                                                                                                                                                                                                                                                                     110\n",
      "整体使用流程 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           100\n",
      "如何准确的标识用户 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         96\n",
      "惠州网站建设|惠州网站设计|惠州网站制作|网站设计-微斯诺科技                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            81\n",
      "漏斗分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              78\n",
      "用户分群 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              76\n",
      "Java SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          67\n",
      "留存分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              67\n",
      "weixin://private/setresult/SCENE_HANDLEMSGFROMWX&eyJfX2Vycl9jb2RlIjoiY2I0MDQifQ==                                                                                                                                                                                                                                                                                                                                                                                                                                          60\n",
      "自定义查询 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             58\n",
      "用户路径分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            50\n",
      "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        ...  \n",
      "数据接入 API · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           7\n",
      "功能 API · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             7\n",
      "订阅实时数据 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             7\n",
      "微信小程序 SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          7\n",
      "关于我们 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               6\n",
      "从外部 Kafka 接入数据的方案 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  6\n",
      "数据接入基本原则 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           6\n",
      "Ruby SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           6\n",
      "推荐分享 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               5\n",
      "CustomUserSegmenter 使用说明 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                           5\n",
      "第三方登录 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              5\n",
      "APICloud SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       4\n",
      "Java SDK Demo · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      4\n",
      "基础指标解释和配置 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          3\n",
      "元数据创建工具使用说明 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        3\n",
      "查询抽样 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               3\n",
      "3 神策数据 | Sensors Data - 国内领先的用户行为分析产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       3\n",
      "数据校验及元数据创建 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         2\n",
      "导入辅助工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             2\n",
      "3 神策分析|Sensors Analytics-帮你实现数据驱动－产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        2\n",
      "3 神策分析|Sensors Analytics-帮你实现数据驱动－demo                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      1\n",
      "神策分析 | Sensors Analytics - 帮你实现数据驱动－B 轮融资发布会                                                                                                                                                                                                                                                                                                                                                                                                                                                                                1\n",
      "C SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              1\n",
      "分析师事件权限设置工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        1\n",
      "4 介绍 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               1\n",
      "进阶使用场景 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             1\n",
      "3 神策分析|Sensors Analytics-帮你实现数据驱动－关于                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        1\n",
      "其他辅助工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             1\n",
      "导入状态 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               1\n",
      "Sensor Analytics - help you implement data drivers                                                                                                                                                                                                                                                                                                                                                                                                                                                                          1\n",
      "Name: title, Length: 108, dtype: int64\n"
     ]
    }
   ],
   "source": [
    "print(df_view.title.value_counts(dropna=False))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Compare the view data frame and view but not click dataframe:\n",
    "Most users stpped at the main page, people seems to have much interest in demo and product than B round of financing conference"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Possible useful feature: session_r, session_rh, session_page_url, pageStayTime, pagePosition, pageUrl, latest_utm_s, latest_utm_s, latest_utm_t"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "https://www.sensorsdata.cn/                                                                                                                                                                                                                                                                                                                                                                             16910\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                                                                                                                                                                     5419\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                 4837\n",
       "https://sensorsdata.cn/                                                                                                                                                                                                                                                                                                                                                                                  4289\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96%E6%95%B0%E6%8D%AE&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                                                                                                                                                   2365\n",
       "https://www.sensorsdata.cn/demo.html                                                                                                                                                                                                                                                                                                                                                                     1717\n",
       "https://www.sensorsdata.cn/index.html                                                                                                                                                                                                                                                                                                                                                                    1010\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                                                                                                                                                 953\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mfeed&utm_term=%E9%A6%96%E9%A1%B5-%E9%80%9A%E7%94%A8%E8%AF%8D-%E4%B8%89%E5%9B%BE-%E5%9B%BE1&utm_content=%E9%80%9A%E7%94%A8%E8%AF%8D-%E4%B8%89%E5%9B%BE&utm_campaign=%E9%A6%96%E9%A1%B5                                                                                                                                                            924\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                  741\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%AD%90%E5%95%86%E5%8A%A1%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%B5%E5%95%86%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                575\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96%E5%88%86%E6%9E%90&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                                                                                                                                                    525\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%A4%A7%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                         511\n",
       "https://sensorsdata.cn/demo.html                                                                                                                                                                                                                                                                                                                                                                          510\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%2D%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                         486\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E4%BA%A7%E5%93%81%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                450\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E6%95%B0%E6%8D%AE%E7%BB%9F%E8%AE%A1&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E7%BB%9F%E8%AE%A1&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                430\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                  384\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%97%85%E6%B8%B8%E5%A4%A7%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8%2D%E5%A4%A7%E6%95%B0%E6%8D%AE%2D%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                             384\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%2D%E4%BA%A7%E5%93%81&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                           368\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E8%81%9A%E7%B1%BB%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                  357\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=app%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8%2DAPP%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                                                357\n",
       "https://sensorsdata.cn/?ch=demo                                                                                                                                                                                                                                                                                                                                                                           318\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E7%B3%BB%E7%BB%9F&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%2D%E4%BA%A7%E5%93%81&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                           315\n",
       "https://www.sensorsdata.cn/product.html                                                                                                                                                                                                                                                                                                                                                                   313\n",
       "https://sensorsdata.cn/index.html                                                                                                                                                                                                                                                                                                                                                                         308\n",
       "https://sensorsdata.cn/b-round.html                                                                                                                                                                                                                                                                                                                                                                       304\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%AE%A2%E6%88%B7%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                  289\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=app%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2DAPP%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                                                277\n",
       "https://www.sensorsdata.cn/courses/                                                                                                                                                                                                                                                                                                                                                                       253\n",
       "                                                                                                                                                                                                                                                                                                                                                                                                        ...  \n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%A4%9A%E7%BB%B4%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E7%B3%BB%E7%BB%9F&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E4%BA%A7%E5%93%81&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%95%86%E8%A1%8C%E4%B8%9A%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E7%94%B5%E5%95%86&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%A4%A7%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%20%E5%B9%B3%E5%8F%B0&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E4%BA%A7%E5%93%81&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                     1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E8%A7%A3%E5%86%B3%E6%96%B9%E6%A1%88&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E6%96%B9%E6%A1%88&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E5%85%AC%E5%8F%B8&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E5%85%AC%E5%8F%B8&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                 1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_term=%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                              1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7&utm_content=%E9%80%9A%E7%94%A8-%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                    1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E8%81%9A%E7%B1%BB%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                      1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e5%a4%a7%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d&from=groupmessage&isappinstalled=1                                                                                                                                       1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7&utm_content=%E9%80%9A%E7%94%A8-%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E5%88%86%E6%9E%90-%E7%B3%BB%E7%BB%9F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                             1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                      1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A7%81%E6%9C%89%E5%8C%96%E9%83%A8%E7%BD%B2&utm_content=&utm_campaign=%E5%87%A4%E5%B7%A2%E5%A4%B4%E6%9D%A1                                                                                                                                                                                                                           1\n",
       "https://sensorsdata.cn/b-round.html?from=groupmessage                                                                                                                                                                                                                                                                                                                                                       1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                    1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%9B%B4%E6%92%AD%E5%B9%B3%E5%8F%B0%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e5%ad%98%e5%82%a8&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%a4%84%e7%90%86&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                                                                                                                                                   1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%95%86%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E4%BA%A7%E5%93%81&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_term=%E4%BA%A7%E5%93%81%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                   1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E9%87%87%E9%9B%86&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E9%87%87%E9%9B%86&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                      1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=App%E8%BF%90%E8%90%A5&utm_content=%E9%80%9A%E7%94%A8-APP%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                                                    1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%AE%A2%E6%88%B7%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8-%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                                      1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E8%BF%90%E8%90%A5%20%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                              1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_campaign=%e7%a5%9e%e7%ad%96-%e7%a7%bb%e5%8a%a8%e6%8e%a8%e5%b9%bf&utm_content=%e9%80%9a%e7%94%a8%e8%af%8d-M&utm_term=app%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90#|src_%E8%8B%B9%E6%9E%9Capp%E6%A0%B9%E6%8D%AE%E6%95%B0%E6%8D%AE%E7%94%9F%E6%88%90%E6%9B%B2%E7%BA%BF%E5%9B%BE%E5%BD%A2|sa_tb&word=app%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90        1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%9C%A8%E7%BA%BF%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E4%BA%A7%E5%93%81&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_campaign=%E7%A5%9E%E7%AD%96-%E7%A7%BB%E5%8A%A8%E6%8E%A8%E5%B9%BF&utm_content=%E9%80%9A%E7%94%A8%E8%AF%8D-M&utm_term=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E8%BD%AF%E4%BB%B6%E4%B8%8B%E8%BD%BD                                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90%e6%a8%a1%e5%9e%8b&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90-%e5%85%b6%e4%bb%96&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                                                                                                              1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%95%86%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E7%94%B5%E5%95%86&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%95%86%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                 1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%88%86%E6%9E%90%E5%A4%A7%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8-%E5%A4%A7%E6%95%B0%E6%8D%AE-%E5%85%B6%E4%BB%96&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                                                                                                                                   1\n",
       "Name: session_p, Length: 669, dtype: int64"
      ]
     },
     "execution_count": 51,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.session_p.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "https://www.baidu.com/baidu.php                                                                                                                                                                             24908\n",
       "                                                                                                                                                                                                            16034\n",
       "https://www.baidu.com/link                                                                                                                                                                                   4998\n",
       "https://www.baidu.com/s                                                                                                                                                                                      1919\n",
       "https://www.google.com.hk/                                                                                                                                                                                    907\n",
       "https://www.google.com/                                                                                                                                                                                       783\n",
       "http://36kr.com/                                                                                                                                                                                              654\n",
       "https://www.sensorsdata.cn/                                                                                                                                                                                   371\n",
       "https://sensorsdata.cn/                                                                                                                                                                                       328\n",
       "https://www.google.co.jp/                                                                                                                                                                                     266\n",
       "https://www.sensorsdata.cn/manual/                                                                                                                                                                            200\n",
       "http://www.sensorsdata.cn/                                                                                                                                                                                    155\n",
       "https://www.sensorsdata.cn/manual/use_feature_video.html                                                                                                                                                      113\n",
       "http://www.itjuzi.com/company/16088                                                                                                                                                                           108\n",
       "https://www.sensorsdata.cn/manual/js_sdk.html                                                                                                                                                                 104\n",
       "https://link.zhihu.com/?target=https%3A//www.sensorsdata.cn                                                                                                                                                    98\n",
       "https://www.sensorsdata.cn/manual/event_ana.html                                                                                                                                                               89\n",
       "http://www.baidu.com/baidu.php?sc.7aTK00jwDwyKypmLhdEg8w50FJ0BMPOYV4r5HF1rrlnp7z0Di6zsomBfv6LjpPDYiHWM4m_9M06nuxWX5vctX9jotLfXoLKi6xRFseEIG1o5bLoVe9aVB_yqlzaYy4cXr7qShDjDMz62rAxRlUMUgPJ08rCD4IDXszL4h-       79\n",
       "https://link.zhihu.com/?target=https%3A//sensorsdata.cn/                                                                                                                                                       77\n",
       "https://www.sensorsdata.cn/manual/java_sdk.html                                                                                                                                                                77\n",
       "https://m.baidu.com/?from=844b&vit=fps                                                                                                                                                                         76\n",
       "https://www.sensorsdata.cn/demo.html                                                                                                                                                                           74\n",
       "https://www.sogou.com/link?url=DSOYnZeCC_reF_V0215oSdRkvO5tusgbxcLO2TQn7Ac.&query=%E7%A5%9E%E7%AD%96%E6%95%B0%E6%8D%AE                                                                                         74\n",
       "http://www.baidu.com/link?url=cqJ-HumjNapy4uRvaPvhHq05o4UMeVX_T3jLa0rkymicU1ZegoRzBQd8Or6cD1h4&wd=&eqid=f18597fa000314990000000658c261fc                                                                       70\n",
       "https://www.baidu.com/                                                                                                                                                                                         70\n",
       "http://www.woshipm.com/pmd/314444.html                                                                                                                                                                         70\n",
       "https://www.sensorsdata.cn/manual/query.html                                                                                                                                                                   70\n",
       "http://www.baidu.com/baidu.php?sc.IBTK00jyNUHxgmbNsRNO9pwmCW85unoZ3RhY2LA2yYSIy_P_a2rpHF5Zfm3aK0gihACpb2uofjfdgZRsOOEuvUOyAkfOXqqepIc29omYi45Xz8W9GLtwRV3z95qkf9L8sUUhSJZy8T3JHqCw07_EkWHGsnIy6WlObvKeJa       67\n",
       "http://www.woshipm.com/operate/409320.html                                                                                                                                                                     61\n",
       "https://www.sogou.com/link?url=DSOYnZeCC_reF_V0215oSdRkvO5tusgbxcLO2TQn7Ac.&query=%E7%A5%9E%E7%AD%96                                                                                                           59\n",
       "                                                                                                                                                                                                            ...  \n",
       "https://m.baidu.com/baidu.php?sc.xBTK00j_KTV_8t_F3ugkr5Sf7t91AJFhfTHVFw1ffJt8LkudsNJ71t2BO7L_ePYE6hQrUpXBL9bLTDtbfbsQko6xUcJh2wziW8fhfnXJDvT2GF0PWP0buQu5_6kfE8D2BTjRMNNxm9XC-KInwEVtxOTMZWHJF7WUbDbPqlw        1\n",
       "https://m.baidu.com/baidu.php?sc.JaTK00jxqNNmOUxPriS2KCCQ3TmDA9vfLWlJ3HhlHcG-sZbX5-30g3q8OC8vFPDsYszB4cX0mL92i9F9KAfSigiP4Vbz_5qoS2p0g96UqDbH8btdamFgOuvLJp3rEzOAxMj_268nhyVIo-EHdpRmeIBsLhEEBgbgpUuUJ2R        1\n",
       "https://m.sogou.com/bill_cpc?v=1&p=WJhHUrma919tBXwiae6Kh2ktzTGQkSvghM87wEGblOBAwZrgLWkMBr2xdI4GJXpCDWwqzAgfxMkCzAKgWwTcnaOjyF7qJpX7xv7VctjBWau87X3pMWbEsHdssd@jbm6fLIkrsKcp0r5VHKqEcdavMmPUdNz2PL7l5EE@t        1\n",
       "https://wap.sogou.com/bill_cpc?v=1&p=WJhHUFC711lYCb6IbUfOyAtpBJYhSGry2nK95sd96BkyjZ3IpZsciieYcJ@cXwblUOwQuR$eGGRvkYuxojfw4h9PZtRykvOPyVLS3A4xqlO@vUGEGgpQTXTsKt@smdGHTAGsiebK@1xXMauH@tW0c7$RZYgh6DCXde4        1\n",
       "https://m.baidu.com/baidu.php?sc.5iTK00KLHPINx0K4TjQ06skCj7vBWm4eDX5eWcMgbxH3tV_-f7AYShnjlghIcmt-7O5wddKt-L3qQkM3tJbpCMh63Cw26Gu_y9-GxaTewukv_cLY6a5XEfr1-EUKhh9uDeMK6tX3D8CVVWTQm4XULVaT19zUuyBUfH7ICKt        1\n",
       "https://m.baidu.com/baidu.php?sc.060000jGh81MTAUtHpuQhmpi4_tE_9sg2emywr4ZliEqfpNqBEb-Irex86MbzRtJ7GPH_t0MC6zbdiUfBtW5mc3RS2WdvoNQej16RSMNIKraZddA94FcSM32UER98P942fdr6YmfNTjb4_kkMlM8Tqjd599NrqZuZsI36jL        1\n",
       "https://m.baidu.com/from=1000539d/bd_page_type=1/ssid=0/uid=0/pu=usm%401%2Csz%401320_2001%2Cta%40iphone_1_10.2_3_602/baiduid=87FF2EDB78C4D54F293287F76A737CE4/w=0_10_/t=iphone/l=1/tc?ref=www_iphone&lid        1\n",
       "https://m.baidu.com/from=1012852r/bd_page_type=1/ssid=0/uid=0/pu=usm%401%2Csz%40320_1004%2Cta%40iphone_2_7.0_11_8.6/baiduid=C43444F17C1CE3FF36456170EB7D0AA7/w=0_10_/t=iphone/l=1/tc?ref=www_iphone&lid=        1\n",
       "https://m.baidu.com/baidu.php?sc.5z6K00jOXyLs0Ah5Ihs7VmW2bzdOtFNik7rJxtbjGHDOxiSONBsFIUY6aE_2amlSz7SMoMINdLH7KQohZVi89-KOQDDzlCfJAr3CHRPe5n142kKtsVkvvIVIIyovrEKDFjuxWqBv69IR_vC54TRxf20bBSutFfZwZBpA5CQ        1\n",
       "http://www.baidu.com/baidu.php?sc.K00000a8hhZIFVKni8B5AsXdF3mFZdEr4PiTUYVVZA018ccyK0sMC_TcxcD2MechCn_pk0Wc6RwvK3ci6BFhANeEhOPAL8arRy0LdNsFFigZ18aiBYjFigq0ubc9xRTLtxQ8KjMit9HUY4fZ0KWGB07JUKQgRMIpF4x4o4        1\n",
       "https://m.sogou.com/bill_cpc?v=1&p=WJedU0C711lYCYQ92VBxfjB6O0J9hOlTV@@WnYr9P2A3Pa$ZZ5OhAv2AnD6iRYpVV3BnQBRYfGRw8ekJmoVy9ykQe9vgAl1JZYJY65xBNNGhdjZ@s@WMETsTRqffjMWXOsiDxMtL80dDGXCFQIXGaCYudTYulnCML4Oze        1\n",
       "http://m.sogou.com/web/searchList.jsp?keyword=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&uID=HSX5kGtcESSYoCOD&dp=1&pid=sogou-mobb-d2dc6368837861b4-0007&v=5&w=1282&htpos=11&s_from=hint_last&htindex=1&htdbg=i        1\n",
       "https://wap.sogou.com/bill_cpc?v=1&p=WJhHUFLw919YBKBhJPOU0AO9CmB9lP4GBKB@N6alv$ZDZtipdLtLLt0MJanippT1H243SP7aeQmVyejm9y75xyg5S$hvJHrB33PXtMxnmJ0nhPXu8gsKdDCEeBvmohtaINdKZSwEWs@akCVIMKb6W5gP0ttTlKEZKK2        1\n",
       "https://wap.sogou.com/bill_cpc?v=1&p=WJh26bdrV99UeiLd0gWTSIpIZHIttTjjOisBg8NrnalvnZQe9UVTiMBmVd6KmBXapQTnI2J3eVJw@kQr2xwUetwAIawexLJ0JqkJVoa88ASAwMEjNdEXKNdD4DsQ4mRXONrrrM070zq4bi@Nz0ht2OI5IdHFS4E7KIO        1\n",
       "https://m.baidu.com/from=2001a/bd_page_type=1/ssid=0/uid=0/pu=usm%402%2Csz%40320_1003%2Cta%40iphone_2_5.1_1_11.4/baiduid=E0A5F5F89F62B823EBE43FB226B15439/w=0_10_/t=iphone/l=3/tc?ref=www_iphone&lid=878        1\n",
       "https://m.baidu.com/baidu.php?sc.5iTK00KLHPINx0K4TKHfOKvi3ZbWpDNgdkJJ7nngEvcYaqSehQhpBXt8ER6KO7ZljYD2Wonfe3A3l0qdSuhRDBtVE3mtaurvcIeArWo3GCbt8m5Rbvq7Jg7qG74vH9Y1V2uf9K0dN1ttmVShaPBM6ZuWwuMNebOLlGoNlM9        1\n",
       "https://m.baidu.com/baidu.php?sc.dzTK00KNNEU476x5n_LtejgAodJ_dzUWqKsUDl4QB7tEgRNZZ1A2SjjAhKtd0qWo-xOofWCgkjFansV5Ps7UgrXFWjCGUtBpm2UwPB3nB7Y8lkjod2YlV_iqBR1VB3S6o_xtqI-5T0wPiMHGLD4AUbVAS15zA18teFYntVi        1\n",
       "https://m.baidu.com/from=1000539d/s?word=%E7%A5%9E%E7%AD%96%E6%95%B0%E6%8D%AE%E6%80%8E%E4%B9%88%E7%94%A8&rq=%E7%A5%9E%E7%AD%96%E6%95%B0%E6%8D%AE&sa=brs_5&rsf=4&pqid=14668821531038309651&rqid=146688215        1\n",
       "https://m.baidu.com/baidu.php?url=Dz6K00jryFP_QGxCox3PTg2wfRGnO_6Rds3LJCotkGF2TV4nsuErJ4xw1Af-O_YYz7YBZLs14sreeCY3hE8omWw4WihMJery9GWBCsvME4TzXVrOZsxXXks5a0hk8EL6E_dIgFZ3ShY8OZc1GDeCmVSXvdxE8JeV1VucXu        1\n",
       "https://wap.sogou.com/bill_cpc?v=1&p=WJhHUFVs11lUiPhgJ$BVCULqQbJ9h6jzNcEHL3xwFwk2JGvj6nxfNc6Hi202gSoovCoLJIAYU56aj3yhwjSlY6jj7qn8wVY9YujrPVDoBQ5AFsrWdETsTKWp$df0Fhrq2C@JhrgqEvM5bdvTI@guEsFIOGj5bh@LOf2        1\n",
       "http://cpro.baidu.com/cpro/ui/uijs.php?en=mywWUA71T1YsFh7sT7qGujYsFhPh5Hn4FhPC5H0huAbqniuGTdq9TZ0qnauJp1YYnH0krAR4nvm4PjmzPHThp1Y-fYD-wbf-fbR-wDf-fWT-wjm-fYR-wWmhp10qFRPKFRuDFRF7FRwDFRcLFRfvFRP7FRmvFh        1\n",
       "https://m.baidu.com/baidu.php?sc.060000awvWtUrzip4eQWWFVdv92zA6UW_wGiwujybBK7fmGINzZFHcLaG4Lx8-VcEHhE1DO-uzoBECYXNG9MRt_81UefHIy3aLMj6pxLNa8QB7HBssHCKI4CIgdWS0IVqV-DY0PdeAOnlaoVcpycV4fEl8XtaWWkXVB5_f3        1\n",
       "https://m.sogou.com/bill_cpc?v=1&p=WJhHUbds989YONnUJoYAijEoQGoy3U5FMjciXTCSJjb9k6j$QV0lmFAiA2eNpODzrOLzGG4U@Zj9LxVFVDyljl6ya9AN6$UrjenUoSaTIbMYuajOi@KWd@OdOI8bw7@XtkKK1zUEO1tsNAziiN4czXp1@Qh9faK5WZWa@        1\n",
       "https://m.baidu.com/baidu.php?sc.kzTK00KViRCvFKCtUPQP9MV_oQYNKP4jSd0aR7umF2F5ofK_Q8Ug1G1wvGy069ZS9W1z1rt3bYLccKVLWmei8c3Tjju3ilrUNQGznoUA9M_4z7kk5Z20x0PfAj5ylU7S54pMRYQ4Xxy_YdgpGnAEgH8LOwg-fFzDOjdFJ8F        1\n",
       "https://m.baidu.com/baidu.php?sc.JaTK000f_Pak3IFPgduTTKNNp0omYZDq3TMISJbMUJXN58l8ujwdNY-d6ht-mp2C4IAmd4nWtb9IzBxCAnZWN1D7kXdY5IzU3eXAPKtAJO6UIJLhheqMMcDocXBPiDDduSlV4ueE0keeOka8ab-5QbZeZXP1GibL8WjxGZD        1\n",
       "https://m.baidu.com/baidu.php?sc.0s0000KlmKuCTsdU2fsEI-RREmvQAZtu6KsEH48oxrHg6N1p_deL10Q2AP7WcuVdNCpYFOEpUJwckmW1v1NmqqRcFYMxoo-9oLg_8bK7K3WHqlHleHNJ5VzhCgXouZBut2FLb8rjLJlH5Wog-8q0qqqiXf9I6tQHKli9kCe        1\n",
       "https://m.baidu.com/baidu.php?sc.5iTK00KLHPINx0K4TPbQc1r3Vo-fzNfTqCHEnREebtuWDJrgIrQN_TT4ORazAo8A4HzhM84_3OJcHan3sneDJ4DQQ-711L2d5d4D5dtnzf6PKKV2ICDqogQbVfI-0objmVjquJd2pr6MNb8zvKIZvarGze9_trvXdskoDC3        1\n",
       "http://wap.sogou.com/waprdt?query=%B4%F3%CA%FD%BE%DD%D3%A6%D3%C3&clickid=a4280a1437541fb88878a99d045a5b7c                                                                                                       1\n",
       "http://m.sogou.com/bill_cpc?v=1&p=WJhVUbMa919YBQJA66gOX9J6bzcJIaPtBXd2B0t9rGSpV3f81NX2b4YeMhGEucsSeIezz4QVKcltOoJYhRQjhGXJkz0VwYJT8FU$kk0jYvnc9ina20oRbdiETT8spi0vNbPL$5F0jiP0J1t5qXN3DEKL0ON42Mf5l2I@ss        1\n",
       "https://m.baidu.com/from=1000953f/bd_page_type=1/ssid=0/uid=0/pu=sz%401320_1002%2Cta%40iphone_2_4.4_2_7.3%2Cusm%400/baiduid=9568A5C7123BAE5C5C17A633D5F0A68D/w=0_10_/t=iphone/l=3/tc?ref=www_iphone&lid=        1\n",
       "Name: screen_r, Length: 2089, dtype: int64"
      ]
     },
     "execution_count": 52,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.screen_r.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "www.baidu.com                             33510\n",
       "                                          16028\n",
       "www.sensorsdata.cn                         2047\n",
       "www.sogou.com                              1743\n",
       "m.baidu.com                                1467\n",
       "36kr.com                                   1453\n",
       "www.google.com.hk                           926\n",
       "www.google.com                              817\n",
       "www.so.com                                  578\n",
       "sensorsdata.cn                              569\n",
       "link.zhihu.com                              447\n",
       "www.google.co.jp                            252\n",
       "cn.bing.com                                 250\n",
       "m.sogou.com                                 214\n",
       "wap.sogou.com                               199\n",
       "www.woshipm.com                             142\n",
       "image.baidu.com                             117\n",
       "class.sanjieke.cn                           112\n",
       "www.itjuzi.com                              108\n",
       "passport.36kr.com                            78\n",
       "googleads.g.doubleclick.net                  76\n",
       "wenku.baidu.com                              72\n",
       "youxuan.baidu.com                            63\n",
       "www.sanjieke.cn                              56\n",
       "www.google.com.ph                            55\n",
       "www.mulumu.com                               54\n",
       "qiye.aliyun.com                              54\n",
       "zhidao.baidu.com                             54\n",
       "mp.weixinbridge.com                          53\n",
       "zhengbangchuangyi.cloud.sensorsdata.cn       49\n",
       "                                          ...  \n",
       "www.tianyancha.com                            4\n",
       "rong.36kr.com                                 3\n",
       "hao.199it.com                                 3\n",
       "wap.baidu.com                                 3\n",
       "www.jiuzhilan.com                             3\n",
       "vincentt.baijia.baidu.com                     3\n",
       "ch.cloud.sensorsdata.cn                       3\n",
       "www.3lian.com                                 3\n",
       "h5.wps.cn                                     2\n",
       "uc.36kr.com                                   2\n",
       "www.xfz.cn                                    2\n",
       "dp.g.doubleclick.net                          2\n",
       "ad.bytedance.net                              2\n",
       "www.google.co.kr                              2\n",
       "datadang.com                                  2\n",
       "huaban.com                                    2\n",
       "geek.csdn.net                                 2\n",
       "sd.int.jumei.com                              2\n",
       "sensors.ymt360.com                            2\n",
       "bohui.cloud.sensorsdata.cn                    2\n",
       "data.gotokeep.com                             2\n",
       "duckduckgo.com                                1\n",
       "sas.foneshare.cn                              1\n",
       "m.sp.sm.cn                                    1\n",
       "data.corp.36kr.com                            1\n",
       "haomaiyi.cloud.sensorsdata.cn                 1\n",
       "lnkd.in                                       1\n",
       "cache.baiducontent.com                        1\n",
       "www.imgeek.org                                1\n",
       "www.google.co.zm                              1\n",
       "Name: screen_rh, Length: 139, dtype: int64"
      ]
     },
     "execution_count": 53,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.screen_rh.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "session_page_url extract referrer data to session_r, and further clean the data to session_rh. \n",
    "We can see how the session_r/session_rh classify as empty"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2                          https://sensorsdata.cn/?ch=demo\n",
       "3                          https://sensorsdata.cn/?ch=demo\n",
       "4                          https://sensorsdata.cn/?ch=demo\n",
       "8                          https://sensorsdata.cn/?ch=demo\n",
       "15                    https://www.sensorsdata.cn/demo.html\n",
       "16                    https://www.sensorsdata.cn/demo.html\n",
       "17                         https://sensorsdata.cn/?ch=demo\n",
       "23                         https://sensorsdata.cn/?ch=demo\n",
       "25                         https://sensorsdata.cn/?ch=demo\n",
       "31                    https://www.sensorsdata.cn/demo.html\n",
       "32                         https://sensorsdata.cn/?ch=demo\n",
       "33                    https://www.sensorsdata.cn/demo.html\n",
       "34                    https://www.sensorsdata.cn/demo.html\n",
       "35                    https://www.sensorsdata.cn/demo.html\n",
       "38                    https://www.sensorsdata.cn/demo.html\n",
       "39                    https://www.sensorsdata.cn/demo.html\n",
       "40                    https://www.sensorsdata.cn/demo.html\n",
       "41                    https://www.sensorsdata.cn/demo.html\n",
       "42                    https://www.sensorsdata.cn/demo.html\n",
       "43                    https://www.sensorsdata.cn/demo.html\n",
       "44                         https://sensorsdata.cn/?ch=demo\n",
       "45                         https://sensorsdata.cn/?ch=demo\n",
       "46                         https://sensorsdata.cn/?ch=demo\n",
       "47                    https://www.sensorsdata.cn/demo.html\n",
       "48                    https://www.sensorsdata.cn/demo.html\n",
       "49                    https://www.sensorsdata.cn/demo.html\n",
       "50                    https://www.sensorsdata.cn/demo.html\n",
       "54                    https://www.sensorsdata.cn/demo.html\n",
       "55                    https://www.sensorsdata.cn/demo.html\n",
       "56                    https://www.sensorsdata.cn/demo.html\n",
       "                               ...                        \n",
       "74976                          https://www.sensorsdata.cn/\n",
       "74994                          https://www.sensorsdata.cn/\n",
       "74995                          https://www.sensorsdata.cn/\n",
       "74996                          https://www.sensorsdata.cn/\n",
       "74997                          https://www.sensorsdata.cn/\n",
       "75001                          https://www.sensorsdata.cn/\n",
       "75002                          https://www.sensorsdata.cn/\n",
       "75003                          https://www.sensorsdata.cn/\n",
       "75004                          https://www.sensorsdata.cn/\n",
       "75005                          https://www.sensorsdata.cn/\n",
       "75006                          https://www.sensorsdata.cn/\n",
       "75007                          https://www.sensorsdata.cn/\n",
       "75008                          https://www.sensorsdata.cn/\n",
       "75009                          https://www.sensorsdata.cn/\n",
       "75010                          https://www.sensorsdata.cn/\n",
       "75031                  https://sensorsdata.cn/b-round.html\n",
       "75032                              https://sensorsdata.cn/\n",
       "75040    https://www.sensorsdata.cn/?utm_source=baidu&u...\n",
       "75041    https://www.sensorsdata.cn/?utm_source=baidu&u...\n",
       "75049                          https://www.sensorsdata.cn/\n",
       "75050                          https://www.sensorsdata.cn/\n",
       "75051                          https://www.sensorsdata.cn/\n",
       "75052                          https://www.sensorsdata.cn/\n",
       "75053                          https://www.sensorsdata.cn/\n",
       "75054                          https://www.sensorsdata.cn/\n",
       "75064                          https://www.sensorsdata.cn/\n",
       "75065                          https://www.sensorsdata.cn/\n",
       "75067                          https://www.sensorsdata.cn/\n",
       "75072    https://www.sensorsdata.cn/?utm_source=baidu&u...\n",
       "75075                  https://sensorsdata.cn/b-round.html\n",
       "Name: session_p, Length: 16034, dtype: object"
      ]
     },
     "execution_count": 54,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['session_p'].loc[df['screen_r'] == '']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "most of empty session_r and session_rh are directly from sensordata website, a few have utm_s: baidu"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "baidu                 36085\n",
       "NaN                   25090\n",
       "sogou                  1943\n",
       "sales4c                 441\n",
       "wechat                  432\n",
       "google                  393\n",
       "admin                   374\n",
       "sanjieke.cn             273\n",
       "next.36kr.com            68\n",
       "sunwenliang              65\n",
       "mulumu.com               57\n",
       "tianguang                56\n",
       "liuyaozhou               38\n",
       "liujinbo1                38\n",
       "gaoxiaoqing              34\n",
       "zhihu                    34\n",
       "hao.caibaojian.com       33\n",
       "sina                     31\n",
       "admin10                  22\n",
       "toutiao.io               20\n",
       "analytics_test           15\n",
       "shenyulong               15\n",
       "guohongyao               11\n",
       "demo                     11\n",
       "linhuiyong               10\n",
       "yupan                     9\n",
       "email                     9\n",
       "sunjiaqian                7\n",
       "qiye.36kr.com             7\n",
       "gongxinrong               4\n",
       "zhoushunzhou              4\n",
       "hzcaibin                  4\n",
       "23h5                      4\n",
       "diaopeng                  4\n",
       "liquantao                 3\n",
       "wangcheng                 3\n",
       "zhangyuejiao              2\n",
       "lijiong                   2\n",
       "prd_luzhaobo              2\n",
       "xueting                   2\n",
       "dichang                   2\n",
       "Jeremy                    2\n",
       "sidashidai                2\n",
       "liyizi                    2\n",
       "xiangc                    1\n",
       "xiuxin                    1\n",
       "jonson                    1\n",
       "zhangji                   1\n",
       "wangxuelin                1\n",
       "quqianshun                1\n",
       "lingchentian              1\n",
       "huangkan                  1\n",
       "lul                       1\n",
       "fuyu                      1\n",
       "Name: latest_utm_s, dtype: int64"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.latest_utm_s.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "latest_utm_s has 25090 empty, they come from sesordata website directly\n",
    "considering the number, we can bin this feature as baidu and not baidu"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "cpc                   34623\n",
       "NaN                   25982\n",
       "mcpc                   3255\n",
       "mfeed                   934\n",
       "default                 538\n",
       "answer                  133\n",
       "banner                   67\n",
       "hao.caibaojian.com       33\n",
       "production               27\n",
       "sidonghui                24\n",
       "toutiao.io               20\n",
       "referral                 15\n",
       "youjian                   8\n",
       "lixinya                   6\n",
       "customer_m                5\n",
       "sidashidai                2\n",
       "edm                       1\n",
       "Name: latest_utm_m, dtype: int64"
      ]
     },
     "execution_count": 56,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.latest_utm_m.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "NaN             26578\n",
       "神策               7529\n",
       "用户画像             5349\n",
       "神策数据             3393\n",
       "数据分析             1419\n",
       "首页-通用词-三图-图1      934\n",
       "大数据分析             813\n",
       "用户分析              812\n",
       "神策分析              677\n",
       "电子商务数据            662\n",
       "聚类分析              511\n",
       "网站运营数据分析          506\n",
       "网站数据统计            494\n",
       "产品数据分析            489\n",
       "用户画像分析            455\n",
       "旅游大数据             411\n",
       "app数据             406\n",
       "数据分析系统            345\n",
       "客户画像              310\n",
       "app数据分析           293\n",
       "用户行为              288\n",
       "app分析             283\n",
       "数据挖掘              279\n",
       "数据可视化             250\n",
       "日志分析系统            248\n",
       "大数据应用             246\n",
       "电商数据分析            243\n",
       "数据分析公司            242\n",
       "数据统计平台            231\n",
       "数据分析平台            227\n",
       "                ...  \n",
       "运营商数据分析             2\n",
       "网站流量统计              2\n",
       "跨屏分析                2\n",
       "数据分析工具有哪些           2\n",
       "精益运营                2\n",
       "用户画像建模              2\n",
       "用户日志分析              2\n",
       "银行用户画像标签            2\n",
       "用户行为挖掘              2\n",
       "数据统计分析系统            2\n",
       "产业大数据分析             2\n",
       "电商精细化运营             2\n",
       "分析运营数据              2\n",
       "多数据整合               2\n",
       "营运数据分析              2\n",
       "数据分析法方法             2\n",
       "金融精准营销              2\n",
       "国内大数据分析             2\n",
       "访客数据分析              2\n",
       "用户行为日志分析            2\n",
       "广告效果监测系统            2\n",
       "神测数据                2\n",
       "用户画像平台              2\n",
       "网站用户行为分析            2\n",
       "数据收集分析系统            2\n",
       "提高转化率               1\n",
       "游戏用户留存率             1\n",
       "互联网行业数据分析           1\n",
       "数据多维分析              1\n",
       "私有化部署               1\n",
       "Name: latest_utm_t, Length: 297, dtype: int64"
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.latest_utm_t.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "NaN                            25770\n",
       "通用词                            22180\n",
       "品牌词                            11929\n",
       "S-通用词                           1917\n",
       "神策-移动推广                          998\n",
       "首页                               934\n",
       "G-通用词                            391\n",
       "用户行为                             285\n",
       "caroline                         133\n",
       "gamedemo                         133\n",
       "vtrack                           118\n",
       "ebizdemo                         109\n",
       "test_fll_gxq_zgq                  73\n",
       "financedemo                       72\n",
       "spring                            68\n",
       "xingshulin_standalone             65\n",
       "golddemo                          60\n",
       "凤巢头条                              57\n",
       "数据分析                              44\n",
       "trial                             34\n",
       "jiedaibao-standalone              29\n",
       "about                             27\n",
       "皇冠子链                              26\n",
       "李彦敏                               24\n",
       "edudemo                           22\n",
       "courses                           21\n",
       "用户画像                              16\n",
       "ch                                13\n",
       "yeshen-cluster                    11\n",
       "zhibodemo                         10\n",
       "ivymobi                           10\n",
       "salestest                          8\n",
       "zhangjunfeng                       8\n",
       "iranshao                           7\n",
       "vipkid-standalone                  7\n",
       "sagreen                            6\n",
       "36kr_standalone                    5\n",
       "caicheng-standalone                5\n",
       "huangbaoche-standalone             5\n",
       "%E9%80%9A%E7%94%A8%E8%AF%8D        4\n",
       "wangba-standalone                  4\n",
       "qiyukf                             4\n",
       "jrq-standalone                     4\n",
       "test-ztx-jsl-fjj                   3\n",
       "8win_standalone                    3\n",
       "jumei-cluster                      2\n",
       "数据采集                               2\n",
       "ymt-cluster                        2\n",
       "通用词\\                               2\n",
       "flowerplus                         2\n",
       "keep-cluster                       2\n",
       "qingchengfit                       2\n",
       "yiwu-standalone                    2\n",
       "kupai-standalone                   2\n",
       "fxiaoke-cluster                    1\n",
       "haomaiyi                           1\n",
       "bqbianli-standalone                1\n",
       "Name: latest_utm_campaign, dtype: int64"
      ]
     },
     "execution_count": 58,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.latest_utm_campaign.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "NaN                                                                          26910\n",
       "品牌-神策                                                                        11678\n",
       "通用-用户画像                                                                       5529\n",
       "通用-数据分析                                                                       3136\n",
       "通用-数据分析-产品                                                                    1403\n",
       "通用-数据分析-行业                                                                    1242\n",
       "通用-数据分析-运营                                                                    1042\n",
       "通用-用户分析                                                                        983\n",
       "通用词-三图                                                                         934\n",
       "通用-APP运营                                                                       913\n",
       "通用词-M                                                                          795\n",
       "通用-电商运营                                                                        730\n",
       "通用-用户行为分析                                                                      696\n",
       "通用-用户画像-产品                                                                     684\n",
       "通用-数据处理                                                                        658\n",
       "通用-数据可视化                                                                       653\n",
       "通用-数据统计                                                                        589\n",
       "通用-用户留存                                                                        487\n",
       "通用-网站运营                                                                        455\n",
       "通用-大数据-行业                                                                      407\n",
       "通用-数据分析-公司                                                                     388\n",
       "通用-大数据-其他                                                                      384\n",
       "通用-用户画像-功能                                                                     331\n",
       "通用-数据系统                                                                        323\n",
       "品牌-神策-英文                                                                       315\n",
       "通用-用户行为分析-行业                                                                   306\n",
       "通用-多维分析                                                                        250\n",
       "通用-数据统计-产品                                                                     244\n",
       "通用-埋点                                                                          222\n",
       "通用-数据分析-互联网                                                                    212\n",
       "                                                                             ...  \n",
       "通用-用户留存-提升                                                                     142\n",
       "通用-数据分析法                                                                       134\n",
       "通用-大数据-方案                                                                      102\n",
       "通用-用户分析-产品                                                                     102\n",
       "通用-数据分析-方案                                                                      92\n",
       "通用-数据指标                                                                         84\n",
       "通用-数据分析-电商                                                                      64\n",
       "通用-增长黑客                                                                         57\n",
       "通用-可视化分析                                                                        53\n",
       "品牌-神策-产品词                                                                       52\n",
       "通用-用户分群                                                                         37\n",
       "right                                                                           36\n",
       "top                                                                             31\n",
       "通用-大数据-公司                                                                       31\n",
       "通用-数据驱动                                                                         28\n",
       "通用-访客分析                                                                         26\n",
       "通用-渠道追踪                                                                         21\n",
       "通用-个性化营销                                                                        18\n",
       "通用-数据仓库                                                                         18\n",
       "通用-精准营销                                                                         16\n",
       "通用-大数据-产品                                                                       14\n",
       "通用-用户细分                                                                          8\n",
       "品牌-神策-拼音                                                                         8\n",
       "通用-用户画像-应用                                                                       5\n",
       "%E9%80%9A%E7%%20...                                                              5\n",
       "品牌-                                                                              5\n",
       "%E9%80%9A%E7%94%A8-%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E5%88%86%E6%9E%90        4\n",
       "通用-跨屏分析                                                                          2\n",
       "通用-用户行为分析-产品                                                                     2\n",
       "通用-转化优化                                                                          1\n",
       "Name: latest_utm_content, Length: 69, dtype: int64"
      ]
     },
     "execution_count": 59,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.latest_utm_content.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['source'] = df['latest_utm_s'].fillna('sensordata')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "df.source[~df.source.isin(['baidu','sensordata'])] = 'others'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "baidu         36085\n",
       "sensordata    25090\n",
       "others         4498\n",
       "Name: source, dtype: int64"
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.source.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['medium'] = df['latest_utm_m'].fillna('ukmedium')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [],
   "source": [
    "df.medium[~df.medium.isin(['cpc','ukmedium'])] = 'others'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "cpc         34623\n",
       "ukmedium    25982\n",
       "others       5068\n",
       "Name: medium, dtype: int64"
      ]
     },
     "execution_count": 65,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.medium.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['content'] = df['latest_utm_content'].fillna('ukcontent')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {},
   "outputs": [],
   "source": [
    "df.content[df.content.str.contains('数据')] = 'data'\n",
    "df.content[~df.content.isin(['data','ukcontent'])] = 'others'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "ukcontent    26910\n",
       "others       26828\n",
       "data         11935\n",
       "Name: content, dtype: int64"
      ]
     },
     "execution_count": 68,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.content.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "https://www.sensorsdata.cn/demo.html                                                                                                                                                                                                                                                  4377\n",
       "https://www.sensorsdata.cn/                                                                                                                                                                                                                                                           3857\n",
       "https://www.sensorsdata.cn/index.html                                                                                                                                                                                                                                                 1832\n",
       "https://www.sensorsdata.cn/product.html                                                                                                                                                                                                                                               1640\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                              1526\n",
       "https://www.sensorsdata.cn/about.html                                                                                                                                                                                                                                                 1485\n",
       "https://sensorsdata.cn/                                                                                                                                                                                                                                                               1318\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                                                  1235\n",
       "https://sensorsdata.cn/demo.html                                                                                                                                                                                                                                                      1222\n",
       "https://www.sensorsdata.cn/courses/                                                                                                                                                                                                                                                   1063\n",
       "https://sensorsdata.cn/?ch=demo                                                                                                                                                                                                                                                        948\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96%E6%95%B0%E6%8D%AE&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                                 544\n",
       "https://sensorsdata.cn/index.html                                                                                                                                                                                                                                                      430\n",
       "https://sensorsdata.cn/about.html                                                                                                                                                                                                                                                      361\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                              303\n",
       "https://sensorsdata.cn/product.html                                                                                                                                                                                                                                                    291\n",
       "https://www.sensorsdata.cn/courses/index.html                                                                                                                                                                                                                                          272\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                               271\n",
       "https://sensorsdata.cn/courses/                                                                                                                                                                                                                                                        261\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%AD%90%E5%95%86%E5%8A%A1%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%B5%E5%95%86%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                             223\n",
       "https://www.sensorsdata.cn/courses/play.html?v=first                                                                                                                                                                                                                                   215\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%A4%A7%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                      168\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mfeed&utm_term=%E9%A6%96%E9%A1%B5-%E9%80%9A%E7%94%A8%E8%AF%8D-%E4%B8%89%E5%9B%BE-%E5%9B%BE1&utm_content=%E9%80%9A%E7%94%A8%E8%AF%8D-%E4%B8%89%E5%9B%BE&utm_campaign=%E9%A6%96%E9%A1%B5                                         168\n",
       "https://www.sensorsdata.cn/b-round.html                                                                                                                                                                                                                                                167\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E4%BA%A7%E5%93%81%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                             151\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E6%95%B0%E6%8D%AE%E7%BB%9F%E8%AE%A1&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E7%BB%9F%E8%AE%A1&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                             137\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%2D%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D      128\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E8%81%9A%E7%B1%BB%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                               128\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                               128\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%97%85%E6%B8%B8%E5%A4%A7%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8%2D%E5%A4%A7%E6%95%B0%E6%8D%AE%2D%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                          128\n",
       "                                                                                                                                                                                                                                                                                      ... \n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%B5%B7%E7%9B%97%E6%8C%87%E6%A0%87%E6%B3%95&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%E6%B3%95&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                               1\n",
       "https://www.sensorsdata.cn/about.html?utm_source=wechat&utm_medium=cpc&utm_campaign=about&winzoom=1                                                                                                                                                                                      1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E8%AE%BF%E5%AE%A2%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%2D%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                          1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E4%BA%92%E8%81%94%E7%BD%91%E4%BA%BA%E7%89%A9%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%2D%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                 1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_term=%E7%BD%91%E7%BB%9C%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%2D%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D       1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_campaign=%e7%a5%9e%e7%ad%96-%e7%a7%bb%e5%8a%a8%e6%8e%a8%e5%b9%bf&utm_content=%e9%80%9a%e7%94%a8%e8%af%8d-M&utm_term=%e9%87%91%e8%9e%8d%e5%a4%a7%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90                                     1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e7%94%a8%e6%88%b7%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e7%94%a8%e6%88%b7%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                                1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E6%97%A5%E5%BF%97%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D           1\n",
       "https://www.sensorsdata.cn/?utm_source=google&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E5%A4%84%E7%90%86&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%A4%84%E7%90%86&utm_campaign=G-%E9%80%9A%E7%94%A8%E8%AF%8D                                                                1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e7%94%a8%e6%88%b7%e8%a1%8c%e4%b8%ba%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e7%94%a8%e6%88%b7%e8%a1%8c%e4%b8%ba%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                            1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%e6%89%8b%e6%9c%ba%e7%94%a8%e6%88%b7%e8%a1%8c%e4%b8%ba%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90-%e4%ba%a7%e5%93%81&utm_campaign=%e9%80%9a%e7%94%a8%e8%af%8d            1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E4%BA%A7%E4%B8%9A%E5%A4%A7%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                      1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%95%86%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90%2D%E7%94%B5%E5%95%86&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D        1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96%E5%88%86%E6%9E%90%E5%B7%A5%E5%85%B7&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96%2D%E4%BA%A7%E5%93%81%E8%AF%8D&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                   1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%A4%9A%E6%95%B0%E6%8D%AE%E6%95%B4%E5%90%88&utm_content=%E9%80%9A%E7%94%A8%2D%E5%A4%9A%E7%BB%B4%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                        1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90%e5%b7%a5%e5%85%b7&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90-%e4%ba%a7%e5%93%81&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                           1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%88%86%E6%9E%90%E8%BF%90%E8%90%A5%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8%2D%E7%BD%91%E7%AB%99%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=google&utm_medium=cpc&utm_term=%E5%A4%9A%E7%BB%B4%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E5%A4%9A%E7%BB%B4%E5%88%86%E6%9E%90&utm_campaign=G-%E9%80%9A%E7%94%A8%E8%AF%8D                                                                1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%E5%B9%B3%E5%8F%B0&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%2D%E4%BA%A7%E5%93%81&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                          1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%99%BD%E9%A2%86%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%2D%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                          1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%e7%bd%91%e7%ab%99%e6%b5%81%e9%87%8f%e7%bb%9f%e8%ae%a1&utm_content=%e9%80%9a%e7%94%a8-%e7%bd%91%e7%ab%99%e8%bf%90%e8%90%a5&utm_campaign=%e9%80%9a%e7%94%a8%e8%af%8d                                                 1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_campaign=%e7%a5%9e%e7%ad%96-%e7%a7%bb%e5%8a%a8%e6%8e%a8%e5%b9%bf&utm_content=%e9%80%9a%e7%94%a8%e8%af%8d-M&utm_term=%e6%95%b0%e6%8d%ae%e5%9f%8b%e7%82%b9                                                                1\n",
       "https://sensorsdata.cn/?utm_source=sanjieke.cn&winzoom=1                                                                                                                                                                                                                                 1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%9B%BD%E5%86%85%E6%95%B0%E6%8D%AE%E5%8F%AF%E8%A7%86%E5%8C%96%E5%85%AC%E5%8F%B8&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E5%8F%AF%E8%A7%86%E5%8C%96&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D           1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E9%93%B6%E8%A1%8C%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%E6%A0%87%E7%AD%BE&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%2D%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D        1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%97%A5%E5%BF%97%E5%88%86%E6%9E%90%E7%B3%BB%E7%BB%9F&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E7%B3%BB%E7%BB%9F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                 1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_campaign=%e7%a5%9e%e7%ad%96-%e7%a7%bb%e5%8a%a8%e6%8e%a8%e5%b9%bf&utm_content=%e9%80%9a%e7%94%a8%e8%af%8d-M&utm_term=%e7%94%a8%e6%88%b7%e7%94%bb%e5%83%8f                                                                 1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E8%90%A5%E9%94%80%E4%B8%AA%E6%80%A7%E5%8C%96&utm_content=%E9%80%9A%E7%94%A8%2D%E4%B8%AA%E6%80%A7%E5%8C%96%E8%90%A5%E9%94%80&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E6%95%B0%E6%8D%AE%E7%B3%BB%E7%BB%9F%E5%BB%BA%E8%AE%BE&utm_content=%E9%80%9A%E7%94%A8%2D%E6%95%B0%E6%8D%AE%E7%B3%BB%E7%BB%9F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e8%81%9a%e7%b1%bb%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                                1\n",
       "Name: pageUrl, Length: 500, dtype: int64"
      ]
     },
     "execution_count": 69,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.pageUrl.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "NaN     49183\n",
       " 1.0    10679\n",
       " 2.0     4032\n",
       " 3.0      898\n",
       " 4.0      881\n",
       "Name: pageP, dtype: int64"
      ]
     },
     "execution_count": 70,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.pageP.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "index_leave    881\n",
       "Name: event, dtype: int64"
      ]
     },
     "execution_count": 71,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['event'].loc[df['pageP'] == 4.0].value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "PageUrl and PageP has the same information: which specific page interested"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count    1.672000e+04\n",
       "mean     6.681742e+03\n",
       "std      5.343221e+04\n",
       "min      3.300000e-02\n",
       "25%      5.390750e+00\n",
       "50%      2.057950e+01\n",
       "75%      2.261860e+02\n",
       "max      2.918014e+06\n",
       "Name: pageS, dtype: float64"
      ]
     },
     "execution_count": 72,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.pageS.describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Total number of rows in btnclick: 13866; posible features with not too much null values.\n",
    "latest_r                  78\n",
    "latest_rh                 78\n",
    "latest_utm_campaign     5227\n",
    "latest_utm_content      5451\n",
    "latest_utm_m            5263\n",
    "latest_utm_s            5069\n",
    "latest_utm_t            5383\n",
    "page                    2150\n",
    "pageUrl                    0\n",
    "screen_h                   0\n",
    "screen_r                   0\n",
    "screen_rh                  0\n",
    "screen_w                   0\n",
    "session_p                  2"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "index            7964\n",
       "demo             2242\n",
       "NaN              2150\n",
       "about             816\n",
       "courses_index     694\n",
       "Name: page, dtype: int64"
      ]
     },
     "execution_count": 73,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_btnclick.page.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "787"
      ]
     },
     "execution_count": 74,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_btnclick.loc[df_btnclick['page']=='demo'].dist_id.nunique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "request     2967\n",
       "demo        2783\n",
       "document    2067\n",
       "product     1942\n",
       "b-round     1245\n",
       "about        925\n",
       "blog         803\n",
       "viedo        550\n",
       "logo         508\n",
       "mail          76\n",
       "Name: name, dtype: int64"
      ]
     },
     "execution_count": 75,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_btnclick.name.value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1268"
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_btnclick.loc[df_btnclick['name']=='demo'].dist_id.nunique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "on the demo page, there were around 500 users did not click on anything or continue"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "btnclick has 2242 demo in page and 2783 demo in name, while demo leave has 3411 items"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_cts = df_btnclick[~df_btnclick.dist_id.isin(df_send.dist_id)].loc[df_btnclick['page']=='demo']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "479"
      ]
     },
     "execution_count": 78,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_cts.dist_id.nunique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_stc = df_send[~df_send.dist_id.isin(df_btnclick.loc[df_btnclick['page']=='demo'].dist_id)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "193"
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_stc.dist_id.nunique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "478 users click on demo but do not register\n",
    "193 users register but never click on demo"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_dts = df_dleave[~df_dleave.dist_id.isin(df_send.dist_id)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1027"
      ]
     },
     "execution_count": 82,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_dts.dist_id.nunique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_std = df_send[~df_send.dist_id.isin(df_dleave.dist_id)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "92"
      ]
     },
     "execution_count": 84,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_std.dist_id.nunique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "1027 users go to demo but do not register\n",
    "92 users register but never go to demo"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "First, some people don't click on demo page: have no interst first\n",
    "Second, some click on demo but decide not to continue to register"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Total number of rows in page view: 32620"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "https://www.sensorsdata.cn/demo.html                                                                                                                                                                                                                                                3231\n",
       "https://www.sensorsdata.cn/                                                                                                                                                                                                                                                         2810\n",
       "https://www.sensorsdata.cn/product.html                                                                                                                                                                                                                                             2118\n",
       "https://www.sensorsdata.cn/manual/                                                                                                                                                                                                                                                  1921\n",
       "https://www.sensorsdata.cn/b-round.html                                                                                                                                                                                                                                             1287\n",
       "https://www.sensorsdata.cn/index.html                                                                                                                                                                                                                                               1164\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                            1025\n",
       "https://www.sensorsdata.cn/about.html                                                                                                                                                                                                                                                950\n",
       "https://sensorsdata.cn/                                                                                                                                                                                                                                                              927\n",
       "https://sensorsdata.cn/demo.html                                                                                                                                                                                                                                                     886\n",
       "https://www.sensorsdata.cn/manual/index.html                                                                                                                                                                                                                                         800\n",
       "https://www.sensorsdata.cn/courses/                                                                                                                                                                                                                                                  724\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                                                 667\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mfeed&utm_term=%E9%A6%96%E9%A1%B5-%E9%80%9A%E7%94%A8%E8%AF%8D-%E4%B8%89%E5%9B%BE-%E5%9B%BE1&utm_content=%E9%80%9A%E7%94%A8%E8%AF%8D-%E4%B8%89%E5%9B%BE&utm_campaign=%E9%A6%96%E9%A1%B5                                       603\n",
       "https://sensorsdata.cn/b-round.html                                                                                                                                                                                                                                                  453\n",
       "https://sensorsdata.cn/?ch=demo                                                                                                                                                                                                                                                      448\n",
       "https://sensorsdata.cn/manual/                                                                                                                                                                                                                                                       399\n",
       "https://sensorsdata.cn/product.html                                                                                                                                                                                                                                                  346\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                            318\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96%E6%95%B0%E6%8D%AE&utm_content=%E5%93%81%E7%89%8C%2D%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                               310\n",
       "https://sensorsdata.cn/index.html                                                                                                                                                                                                                                                    277\n",
       "https://www.sensorsdata.cn/manual/#                                                                                                                                                                                                                                                  263\n",
       "https://www.sensorsdata.cn/courses/play.html?v=first                                                                                                                                                                                                                                 235\n",
       "https://www.sensorsdata.cn/courses/index.html                                                                                                                                                                                                                                        231\n",
       "https://sensorsdata.cn/about.html                                                                                                                                                                                                                                                    216\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                             198\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%B5%E5%AD%90%E5%95%86%E5%8A%A1%E6%95%B0%E6%8D%AE&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%B5%E5%95%86%E8%BF%90%E8%90%A5&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                           166\n",
       "https://sensorsdata.cn/courses/                                                                                                                                                                                                                                                      163\n",
       "https://www.sensorsdata.cn/courses/play.html?v=segmentiont                                                                                                                                                                                                                           137\n",
       "http://localhost:8080/b-round.html                                                                                                                                                                                                                                                   137\n",
       "                                                                                                                                                                                                                                                                                    ... \n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%BD%91%E7%AB%99%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90                                                                                                          1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e7%94%a8%e6%88%b7%e6%95%b0%e6%8d%ae&utm_content=%e9%80%9a%e7%94%a8-%e7%94%a8%e6%88%b7%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                              1\n",
       "https://www.sensorsdata.cn/manual/event_ana.html#d-                                                                                                                                                                                                                                    1\n",
       "https://www.sensorsdata.cn/manual/vtrack_intro.html#11-连接管理界面                                                                                                                                                                                                                          1\n",
       "https://www.sensorsdata.cn/manual/edu_case_core_measure.html#                                                                                                                                                                                                                          1\n",
       "file:///D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/user_identify.html                                                                                                                     1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E6%8C%96%E6%8E%98&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                           1\n",
       "https://sensorsdata.cn/manual/func_api.html?winzoom=1                                                                                                                                                                                                                                  1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%9B%B4%E6%92%AD%E5%B9%B3%E5%8F%B0%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90-%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D          1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e8%bf%90%e8%90%a5%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90%e5%b7%a5%e5%85%b7&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90-%e4%ba%a7%e5%93%81&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d       1\n",
       "https://www.sensorsdata.cn/manual/debug_mode.html#                                                                                                                                                                                                                                     1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e5%ad%98%e5%82%a8&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%a4%84%e7%90%86&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                              1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%99%BD%E9%A2%86%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F&utm_content=%E9%80%9A%E7%94%A8%2D%E7%94%A8%E6%88%B7%E7%94%BB%E5%83%8F%2D%E8%A1%8C%E4%B8%9A&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                        1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e5%a4%a7%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d&from=groupmessage&isappinstalled=1                  1\n",
       "https://www.sensorsdata.cn/manual/sdk_manual.html?winzoom=1                                                                                                                                                                                                                            1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E5%B9%BF%E5%91%8A%E6%95%88%E6%9E%9C%E7%9B%91%E6%B5%8B&utm_content=%E9%80%9A%E7%94%A8-%E5%B9%BF%E5%91%8A%E4%BC%98%E5%8C%96&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                               1\n",
       "https://sensorsdata.cn/manual/track_manager.html                                                                                                                                                                                                                                       1\n",
       "https://www.sensorsdata.cn/share/share.html?utm_campaign=keep-cluster&utm_medium=default&utm_source=lingchentian                                                                                                                                                                       1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_campaign=%e7%a5%9e%e7%ad%96-%e7%a7%bb%e5%8a%a8%e6%8e%a8%e5%b9%bf&utm_content=%e9%80%9a%e7%94%a8%e8%af%8d-M&utm_term=%e7%94%a8%e6%88%b7%e6%95%b0%e6%8d%ae%e5%88%86%e6%9e%90                                            1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%e7%bd%91%e7%ab%99%e6%b5%81%e9%87%8f%e7%bb%9f%e8%ae%a1&utm_content=%e9%80%9a%e7%94%a8-%e7%bd%91%e7%ab%99%e8%bf%90%e8%90%a5&utm_campaign=%e9%80%9a%e7%94%a8%e8%af%8d                                               1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%A5%9E%E7%AD%96%E5%88%86%E6%9E%90&utm_content=%E5%93%81%E7%89%8C-%E7%A5%9E%E7%AD%96&utm_campaign=%E5%93%81%E7%89%8C%E8%AF%8D                                                                                   1\n",
       "https://www.sensorsdata.cn/share/sa_recommend.html?utm_campaign=jrq-standalone&utm_medium=production&utm_source=zhoushunzhou                                                                                                                                                           1\n",
       "http://www.sensorsdata.cn/demo.html                                                                                                                                                                                                                                                    1\n",
       "https://sensorsdata.cn/manual/user_ana.html                                                                                                                                                                                                                                            1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%8f%90%e9%ab%98%e8%bd%ac%e5%8c%96%e7%8e%87&utm_content=%e9%80%9a%e7%94%a8-%e8%bd%ac%e5%8c%96%e4%bc%98%e5%8c%96&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                     1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=cpc&utm_term=%E7%94%A8%E6%88%B7%E7%95%99%E5%AD%98%E7%8E%87&utm_content=%E9%80%9A%E7%94%A8-%E7%94%A8%E6%88%B7%E7%95%99%E5%AD%98&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                                        1\n",
       "file:///E:/www.sensorsdata.cn/manual/java_sdk_demo.html                                                                                                                                                                                                                                1\n",
       "https://www.sensorsdata.cn/?utm_source=baidu&utm_medium=mcpc&utm_term=%E4%BA%A7%E5%93%81%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_content=%E9%80%9A%E7%94%A8-%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90&utm_campaign=%E9%80%9A%E7%94%A8%E8%AF%8D                                              1\n",
       "https://www.sensorsdata.cn/?utm_source=sogou&utm_medium=mcpc&utm_term=%e6%95%b0%e6%8d%ae%e4%bb%93%e5%ba%93&utm_content=%e9%80%9a%e7%94%a8-%e6%95%b0%e6%8d%ae%e4%bb%93%e5%ba%93&utm_campaign=S-%e9%80%9a%e7%94%a8%e8%af%8d                                                              1\n",
       "https://www.sensorsdata.cn/manual/data_model.html#2-event-%E5%AE%9E%E4%BD%93                                                                                                                                                                                                           1\n",
       "Name: url, Length: 1153, dtype: int64"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_view.url.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "/                                                                                                                                                                     12243\n",
       "/demo.html                                                                                                                                                             4183\n",
       "/manual/                                                                                                                                                               2634\n",
       "/product.html                                                                                                                                                          2473\n",
       "/b-round.html                                                                                                                                                          1907\n",
       "/index.html                                                                                                                                                            1474\n",
       "/about.html                                                                                                                                                            1186\n",
       "/manual/index.html                                                                                                                                                      917\n",
       "/courses/                                                                                                                                                               900\n",
       "/courses/play.html                                                                                                                                                      832\n",
       "/manual/data_model.html                                                                                                                                                 232\n",
       "/courses/index.html                                                                                                                                                     231\n",
       "/manual/js_sdk.html                                                                                                                                                     216\n",
       "/manual/data_schema.html                                                                                                                                                156\n",
       "/manual/event_ana.html                                                                                                                                                  151\n",
       "/tools/url_create.html                                                                                                                                                  147\n",
       "/manual/vtrack_intro.html                                                                                                                                               147\n",
       "/manual/android_sdk.html                                                                                                                                                131\n",
       "/manual/ios_sdk.html                                                                                                                                                    120\n",
       "/manual/eb_case.html                                                                                                                                                    119\n",
       "/manual/data_import.html                                                                                                                                                112\n",
       "/tools/code_auto/                                                                                                                                                       110\n",
       "/manual/use_steps.html                                                                                                                                                  101\n",
       "/D:/xampp/htdocs/%E5%BE%AE%E6%96%AF%E8%AF%BA%E7%A7%91%E6%8A%80%E6%9C%89%E9%99%90%E5%85%AC%E5%8F%B8%E5%AE%98%E7%BD%91/%E7%A8%8B%E5%BA%8F/data.html                        98\n",
       "/manual/user_identify.html                                                                                                                                               98\n",
       "/manual/funnel.html                                                                                                                                                      76\n",
       "/manual/user_segmentation.html                                                                                                                                           76\n",
       "/manual/java_sdk.html                                                                                                                                                    70\n",
       "/manual/retention.html                                                                                                                                                   62\n",
       "/manual/query.html                                                                                                                                                       57\n",
       "                                                                                                                                                                      ...  \n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/about.html                       1\n",
       "/basic_term.html                                                                                                                                                          1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/query.html                       1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/event_ana.html                   1\n",
       "/manual/android_sdk_faq.html                                                                                                                                              1\n",
       "/funnel.html                                                                                                                                                              1\n",
       "/manual/b2b_homepage_case_data_feed.html                                                                                                                                  1\n",
       "/manual/loading_progress.html                                                                                                                                             1\n",
       "/D:/x-certificate!/%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E5%88%86%E6%9E%90/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/changelog.html                       1\n",
       "/W:/DayDir/201703/2017-03-12[0]/sensorsdata%E4%B8%93%E9%A2%98%E5%88%86%E6%9E%90/sensorsdata_manual_doc/use_guide.html                                                     1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/import_tool.html                 1\n",
       "/R:/MyTemp/sensorsdata/retention.html                                                                                                                                     1\n",
       "/W:/DayDir/201703/2017-03-12[0]/sensorsdata%E4%B8%93%E9%A2%98%E5%88%86%E6%9E%90/sensorsdata_manual_doc/use_steps.html                                                     1\n",
       "/R:/MyTemp/sensorsdata/funnel.html                                                                                                                                        1\n",
       "/R:/MyTemp/sensorsdata/batch_importer.html                                                                                                                                1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/api.html                         1\n",
       "/R:/MyTemp/sensorsdata/sampling_query.html                                                                                                                                1\n",
       "/E:/www.sensorsdata.cn/manual/java_sdk_demo.html                                                                                                                          1\n",
       "/R:/MyTemp/sensorsdata/about.html                                                                                                                                         1\n",
       "/R:/MyTemp/sensorsdata/user_segmentation.html                                                                                                                             1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/android_sdk_faq.html             1\n",
       "/manual/access_control_tool.html                                                                                                                                          1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/web_channel_tracking.html        1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/data_model.html                  1\n",
       "/R:/MyTemp/sensorsdata/event_ana.html                                                                                                                                     1\n",
       "/D:/x-certificate!/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/mp_sdk.html                      1\n",
       "/C:/Users/Sam/Desktop/%E4%BB%8B%E7%BB%8D%20%C2%B7%20Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C.html                                                       1\n",
       "/manual/other_tools.html                                                                                                                                                  1\n",
       "/D:/x-certificate!/%E7%94%A8%E6%88%B7%E8%A1%8C%E4%B8%BA%E5%88%86%E6%9E%90/Sensors%20Analytics%20%E4%BD%BF%E7%94%A8%E6%89%8B%E5%86%8C/about.html                           1\n",
       "/manual/accessories.html                                                                                                                                                  1\n",
       "Name: url_path, Length: 170, dtype: int64"
      ]
     },
     "execution_count": 86,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_view.url_path.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "神策数据 | Sensors Data - 国内领先的用户行为分析产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     13700\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动－demo                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     4148\n",
       "介绍 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              3542\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动－产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       2455\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动－B轮融资发布会                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  1899\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动－关于                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       1183\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动-视频列表                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     1129\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动－视频播放                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      830\n",
       "数据模型 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             232\n",
       "JavaScript SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   214\n",
       "事件分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             152\n",
       "数据格式 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             150\n",
       "可视化埋点 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            148\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动-网址构建工具                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    147\n",
       "weixin://private/setresult/SCENE_FETCHQUEUE&eyJmdW5jIjoibG9nIiwicGFyYW1zIjp7Im1zZyI6Il9ydW5PbjNyZEFwaUxpc3QgOiBtZW51OnNoYXJlOnRpbWVsaW5lLG1lbnU6c2hhcmU6YXBwbWVzc2FnZSxvblZvaWNlUmVjb3JkRW5kLG9uVm9pY2VQbGF5QmVnaW4sb25Wb2ljZVBsYXlFbmQsb25Mb2NhbEltYWdlVXBsb2FkUHJvZ3Jlc3Msb25JbWFnZURvd25sb2FkUHJvZ3Jlc3Msb25Wb2ljZVVwbG9hZFByb2dyZXNzLG9uVm9pY2VEb3dubG9hZFByb2dyZXNzLG1lbnU6c2V0Zm9udCxtZW51OnNoYXJlOndlaWJvLG1lbnU6c2hhcmU6ZW1haWwsd3hkb3dubG9hZDpzdGF0ZV9jaGFuZ2UsaGRPbkRldmljZVN0YXRlQ2hhbmdlZCxhY3Rpdml0eTpz      142\n",
       "数据接入 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             139\n",
       "Android SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      132\n",
       "电商类产品 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            120\n",
       "iOS SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          118\n",
       "神策分析|Sensors Analytics-帮你实现数据驱动-JavaScript SDK 自动生成工具                                                                                                                                                                                                                                                                                                                                                                                                                                                                     110\n",
       "整体使用流程 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           100\n",
       "如何准确的标识用户 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         96\n",
       "惠州网站建设|惠州网站设计|惠州网站制作|网站设计-微斯诺科技                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            81\n",
       "漏斗分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              78\n",
       "用户分群 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              76\n",
       "Java SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          67\n",
       "留存分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              67\n",
       "weixin://private/setresult/SCENE_HANDLEMSGFROMWX&eyJfX2Vycl9jb2RlIjoiY2I0MDQifQ==                                                                                                                                                                                                                                                                                                                                                                                                                                          60\n",
       "自定义查询 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             58\n",
       "用户路径分析 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            50\n",
       "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        ...  \n",
       "数据接入 API · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           7\n",
       "功能 API · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             7\n",
       "订阅实时数据 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             7\n",
       "微信小程序 SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          7\n",
       "关于我们 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               6\n",
       "从外部 Kafka 接入数据的方案 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  6\n",
       "数据接入基本原则 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           6\n",
       "Ruby SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           6\n",
       "推荐分享 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               5\n",
       "CustomUserSegmenter 使用说明 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                           5\n",
       "第三方登录 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              5\n",
       "APICloud SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       4\n",
       "Java SDK Demo · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      4\n",
       "基础指标解释和配置 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          3\n",
       "元数据创建工具使用说明 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        3\n",
       "查询抽样 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               3\n",
       "3 神策数据 | Sensors Data - 国内领先的用户行为分析产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       3\n",
       "数据校验及元数据创建 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         2\n",
       "导入辅助工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             2\n",
       "3 神策分析|Sensors Analytics-帮你实现数据驱动－产品                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        2\n",
       "3 神策分析|Sensors Analytics-帮你实现数据驱动－demo                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      1\n",
       "神策分析 | Sensors Analytics - 帮你实现数据驱动－B 轮融资发布会                                                                                                                                                                                                                                                                                                                                                                                                                                                                                1\n",
       "C SDK · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              1\n",
       "分析师事件权限设置工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        1\n",
       "4 介绍 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               1\n",
       "进阶使用场景 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             1\n",
       "3 神策分析|Sensors Analytics-帮你实现数据驱动－关于                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        1\n",
       "其他辅助工具 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             1\n",
       "导入状态 · Sensors Analytics 使用手册                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               1\n",
       "Sensor Analytics - help you implement data drivers                                                                                                                                                                                                                                                                                                                                                                                                                                                                          1\n",
       "Name: title, Length: 108, dtype: int64"
      ]
     },
     "execution_count": 87,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_view.title.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "www.sensorsdata.cn                        12634\n",
       "                                           7091\n",
       "www.baidu.com                              6284\n",
       "sensorsdata.cn                             2764\n",
       "m.baidu.com                                 816\n",
       "www.sogou.com                               352\n",
       "36kr.com                                    208\n",
       "www.google.com.hk                           166\n",
       "www.google.com                              156\n",
       "localhost                                   154\n",
       "m.sogou.com                                 147\n",
       "link.zhihu.com                              146\n",
       "wap.sogou.com                               144\n",
       "image.baidu.com                              67\n",
       "www.so.com                                   67\n",
       "www.google.co.jp                             48\n",
       "ebizdemo.cloud.sensorsdata.cn                41\n",
       "googleads.g.doubleclick.net                  41\n",
       "www.woshipm.com                              34\n",
       "cn.bing.com                                  33\n",
       "zhidao.baidu.com                             23\n",
       "data.isoubu.com                              21\n",
       "sensors.ishansong.com                        21\n",
       "sensorswww.cloud.sensorsdata.cn              20\n",
       "youxuan.baidu.com                            20\n",
       "zhengbangchuangyi.cloud.sensorsdata.cn       20\n",
       "data.corp.36kr.com                           17\n",
       "wapbaike.baidu.com                           17\n",
       "so.m.sm.cn                                   16\n",
       "class.sanjieke.cn                            15\n",
       "wenku.baidu.com                              15\n",
       "sensors.jiedaibao.com                        15\n",
       "www.itjuzi.com                               15\n",
       "tongji.yeshen.com                            14\n",
       "www.google.com.tw                            14\n",
       "www.sanjieke.cn                              14\n",
       "mp.weixinbridge.com                          14\n",
       "c.tieba.baidu.com                            14\n",
       "yandex.ru                                    12\n",
       "saasdemo.cloud.sensorsdata.cn                12\n",
       "cpro.baidu.com                               11\n",
       "sd.int.jumei.com                             11\n",
       "Name: ch, dtype: int64"
      ]
     },
     "execution_count": 88,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_view.ch.value_counts()[df_view['ch'].value_counts()>10]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "www.sensorsdata.cn                        12634\n",
       "                                           7091\n",
       "www.baidu.com                              6284\n",
       "sensorsdata.cn                             2764\n",
       "m.baidu.com                                 816\n",
       "www.sogou.com                               352\n",
       "36kr.com                                    208\n",
       "www.google.com.hk                           166\n",
       "www.google.com                              156\n",
       "localhost                                   154\n",
       "m.sogou.com                                 147\n",
       "link.zhihu.com                              146\n",
       "wap.sogou.com                               144\n",
       "image.baidu.com                              67\n",
       "www.so.com                                   67\n",
       "www.google.co.jp                             48\n",
       "ebizdemo.cloud.sensorsdata.cn                41\n",
       "googleads.g.doubleclick.net                  41\n",
       "www.woshipm.com                              34\n",
       "cn.bing.com                                  33\n",
       "zhidao.baidu.com                             23\n",
       "data.isoubu.com                              21\n",
       "sensors.ishansong.com                        21\n",
       "sensorswww.cloud.sensorsdata.cn              20\n",
       "youxuan.baidu.com                            20\n",
       "zhengbangchuangyi.cloud.sensorsdata.cn       20\n",
       "data.corp.36kr.com                           17\n",
       "wapbaike.baidu.com                           17\n",
       "so.m.sm.cn                                   16\n",
       "class.sanjieke.cn                            15\n",
       "wenku.baidu.com                              15\n",
       "sensors.jiedaibao.com                        15\n",
       "www.itjuzi.com                               15\n",
       "tongji.yeshen.com                            14\n",
       "www.google.com.tw                            14\n",
       "www.sanjieke.cn                              14\n",
       "mp.weixinbridge.com                          14\n",
       "c.tieba.baidu.com                            14\n",
       "yandex.ru                                    12\n",
       "saasdemo.cloud.sensorsdata.cn                12\n",
       "cpro.baidu.com                               11\n",
       "sd.int.jumei.com                             11\n",
       "Name: refer_Host, dtype: int64"
      ]
     },
     "execution_count": 89,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_view.refer_Host.value_counts()[df_view['refer_Host'].value_counts()>10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "refer_Host same as ch"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "www.baidu.com                             14770\n",
       "                                           8361\n",
       "www.sensorsdata.cn                         1054\n",
       "m.baidu.com                                 994\n",
       "36kr.com                                    790\n",
       "www.sogou.com                               735\n",
       "www.google.com.hk                           445\n",
       "www.google.com                              372\n",
       "sensorsdata.cn                              293\n",
       "www.so.com                                  234\n",
       "link.zhihu.com                              189\n",
       "m.sogou.com                                 165\n",
       "wap.sogou.com                               150\n",
       "cn.bing.com                                 122\n",
       "www.google.co.jp                            122\n",
       "www.woshipm.com                              64\n",
       "image.baidu.com                              61\n",
       "class.sanjieke.cn                            50\n",
       "www.itjuzi.com                               49\n",
       "googleads.g.doubleclick.net                  43\n",
       "wenku.baidu.com                              28\n",
       "passport.36kr.com                            27\n",
       "zhengbangchuangyi.cloud.sensorsdata.cn       27\n",
       "www.sanjieke.cn                              26\n",
       "mp.weixinbridge.com                          25\n",
       "zhidao.baidu.com                             24\n",
       "so.m.sm.cn                                   23\n",
       "www.mulumu.com                               22\n",
       "youxuan.baidu.com                            22\n",
       "www.google.com.tw                            21\n",
       "www.google.com.sg                            20\n",
       "mail.alibaba-inc.com                         20\n",
       "www.google.com.ph                            20\n",
       "www.linear.vc                                19\n",
       "a.youdao.com                                 18\n",
       "www.google.com.au                            18\n",
       "wapbaike.baidu.com                           17\n",
       "mail.qq.com                                  17\n",
       "qiye.aliyun.com                              16\n",
       "saasdemo.cloud.sensorsdata.cn                14\n",
       "ebizdemo.cloud.sensorsdata.cn                14\n",
       "c.tieba.baidu.com                            14\n",
       "next.36kr.com                                14\n",
       "www.oneapm.com                               14\n",
       "hippter.com                                  12\n",
       "www.digitaling.com                           12\n",
       "cpro.baidu.com                               12\n",
       "google.gg-g.org                              12\n",
       "www.google.nl                                11\n",
       "www.tongdao.io                               11\n",
       "www.qichacha.com                             11\n",
       "wisd.sogou.com                               11\n",
       "Name: screen_rh, dtype: int64"
      ]
     },
     "execution_count": 90,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_view.screen_rh.value_counts()[df_view['screen_rh'].value_counts()>10]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Session referrer host similar to refer_Host and ch, but more null values\n",
    "Same as the analysis on btnclick and page view, use latest_utm"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Analysis on the reason for demo leave\n",
    "- Note that we can find utm_source on other data frame to see if we can find not null values"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {},
   "outputs": [],
   "source": [
    "# If you do NOT have geoip2 library installed\n",
    "# Uncomment and run the code below\n",
    "\n",
    "#import sys\n",
    "#!{sys.executable} -m pip install geoip2"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 92,
   "metadata": {},
   "outputs": [],
   "source": [
    "import geoip2.database"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "metadata": {},
   "outputs": [],
   "source": [
    "# read library from local file\n",
    "reader = geoip2.database.Reader('./data/GeoLite2-Country_20180501/GeoLite2-Country.mmdb')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "metadata": {},
   "outputs": [],
   "source": [
    "# example usage of geoip2 \n",
    "response = reader.country('219.135.131.99')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'CN'"
      ]
     },
     "execution_count": 95,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "response.country.iso_code"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "ip address has 8296 unrecognized value"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Define CN: user has ip address in China\n",
    "#df['CN'] = df['ip'].apply(lambda row: reader.country(row).country.iso_code == 'CN')\n",
    "CN=[]\n",
    "for i in range(len(df['ip'])):\n",
    "    try:\n",
    "        CN.append ((reader.country(df.loc[i,'ip']).country.iso_code == 'CN') * 1)\n",
    "    except:\n",
    "        CN.append(0)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['CN'] = CN"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 98,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1    56401\n",
       "0     9272\n",
       "Name: CN, dtype: int64"
      ]
     },
     "execution_count": 98,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.CN.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "metadata": {},
   "outputs": [],
   "source": [
    "import geoip2.database\n",
    "# read library from local file\n",
    "reader = geoip2.database.Reader('./data/GeoLite2-City_20180501/GeoLite2-City.mmdb')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "metadata": {},
   "outputs": [],
   "source": [
    "CT=[]\n",
    "for i in range(len(df['ip'])):\n",
    "    try:\n",
    "        CT.append (reader.city(df.loc[i,'ip']).city.name) \n",
    "    except:\n",
    "        CT.append('0')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['CT'] = CT"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Beijing           20185\n",
       "0                  8296\n",
       "Shanghai           7196\n",
       "Guangzhou          7063\n",
       "Hangzhou           4183\n",
       "Shenzhen           3736\n",
       "Chengdu            1973\n",
       "Nanjing            1817\n",
       "Haidian            1558\n",
       "Wuhan              1184\n",
       "NaN                1027\n",
       "Tianjin             569\n",
       "Hefei               463\n",
       "Shenyang            375\n",
       "Zhengzhou           297\n",
       "Jinan               284\n",
       "Fuzhou              278\n",
       "Changsha            275\n",
       "Suzhou              260\n",
       "Wenzhou             239\n",
       "Chongqing           236\n",
       "Hebei               195\n",
       "Shantou             175\n",
       "Jinghe              166\n",
       "Xi'an               162\n",
       "Xiamen              148\n",
       "Foshan              129\n",
       "Zhuhai              124\n",
       "Dongguan            122\n",
       "Ürümqi              114\n",
       "                  ...  \n",
       "London                1\n",
       "Shiqi                 1\n",
       "Jiaozuo               1\n",
       "São Paulo             1\n",
       "Ordos                 1\n",
       "Hoest                 1\n",
       "Kunyang               1\n",
       "Cheung Sha Wan        1\n",
       "Dongyang              1\n",
       "Selden                1\n",
       "Jiekou                1\n",
       "Nchelenge             1\n",
       "Korolev               1\n",
       "Redwood City          1\n",
       "Kazan’                1\n",
       "Chiang Mai            1\n",
       "Danyang               1\n",
       "Huai Khwang           1\n",
       "Hippolytushoef        1\n",
       "Pesaro                1\n",
       "Zhangjiakou           1\n",
       "Wafangdian            1\n",
       "Neutral Bay           1\n",
       "Pizhou                1\n",
       "Burnaby               1\n",
       "Depok                 1\n",
       "Kuala Lumpur          1\n",
       "Montpellier           1\n",
       "Walnut                1\n",
       "Guildford             1\n",
       "Name: CT, Length: 242, dtype: int64"
      ]
     },
     "execution_count": 102,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['CT'].value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['weekend'] = ((df.day == '2017-03-11') | (df.day == '2017-03-12')) * 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {},
   "outputs": [],
   "source": [
    "# define sign up column with users have form submit behavior\n",
    "ind = df.dist_id.isin(df_form.dist_id) *1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {},
   "outputs": [],
   "source": [
    "df['signup'] = ind.tolist()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 106,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_select = df.copy()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 107,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_select['freq'] = df_select.groupby('dist_id')['dist_id'].transform('count')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 108,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0    57297\n",
       "1     8376\n",
       "Name: weekend, dtype: int64"
      ]
     },
     "execution_count": 108,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_select.weekend.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 109,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0    53029\n",
       "1    12644\n",
       "Name: signup, dtype: int64"
      ]
     },
     "execution_count": 109,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_select.signup.value_counts(dropna=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 110,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count    65673.000000\n",
       "mean        25.265467\n",
       "std         36.783402\n",
       "min          1.000000\n",
       "25%          5.000000\n",
       "50%         13.000000\n",
       "75%         30.000000\n",
       "max        254.000000\n",
       "Name: freq, dtype: float64"
      ]
     },
     "execution_count": 110,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_select['freq'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 111,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "browser                    0\n",
       "browser_v                  0\n",
       "ch                     33338\n",
       "day                        0\n",
       "dist_id                    0\n",
       "event                      0\n",
       "from_url               64691\n",
       "ip                         0\n",
       "isMsg                  65204\n",
       "isSuccess              64882\n",
       "is_fd                      0\n",
       "is_ft                      0\n",
       "latest_ch              57136\n",
       "latest_r                 811\n",
       "latest_rh                811\n",
       "latest_utm_campaign    25770\n",
       "latest_utm_content     26910\n",
       "latest_utm_m           25982\n",
       "latest_utm_s           25090\n",
       "latest_utm_t           26578\n",
       "model                      0\n",
       "name                   50503\n",
       "nocache                    0\n",
       "os                         0\n",
       "os_version                 0\n",
       "page                   53957\n",
       "pageP                  49183\n",
       "pageS                  48953\n",
       "pageUrl                35317\n",
       "refer_Host             33338\n",
       "referrHostUrl          65204\n",
       "referrer               33339\n",
       "referrerUrl            65204\n",
       "requestBtn             61402\n",
       "result                 64510\n",
       "screen_h                   0\n",
       "screen_r                2627\n",
       "screen_rh               2634\n",
       "screen_w                   0\n",
       "session_p               2907\n",
       "siteUrl                65204\n",
       "site_url               64691\n",
       "time                       0\n",
       "title                  33053\n",
       "tp                         0\n",
       "url                    33075\n",
       "url_path               33053\n",
       "source                     0\n",
       "medium                     0\n",
       "content                    0\n",
       "CN                         0\n",
       "CT                      1027\n",
       "weekend                    0\n",
       "signup                     0\n",
       "freq                       0\n",
       "dtype: int64"
      ]
     },
     "execution_count": 111,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_select.isnull().sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 112,
   "metadata": {},
   "outputs": [],
   "source": [
    "selected_columns = [u'dist_id',u'event',u'browser',u'browser_v',u'day', u'is_fd', \n",
    "                    u'is_ft', u'ip', u'latest_utm_s',u'latest_utm_m',u'latest_utm_content',u'model', u'os', \n",
    "                    u'os_version',u'pageS', u'pageP',u'time', u'CN', u'CT',u'source', u'medium',u'content',\n",
    "                    u'weekend',u'freq',u'signup']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 113,
   "metadata": {},
   "outputs": [],
   "source": [
    "cleaned_data_csv = 'data/cleaned_data.csv'\n",
    "df_select[selected_columns].to_csv(cleaned_data_csv, index=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 114,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>dist_id</th>\n",
       "      <th>latest_utm_s</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>75079</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75080</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75081</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75082</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75083</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75084</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75085</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75086</th>\n",
       "      <td>215110e7713ef7435524bf321fa894e411338c40</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75088</th>\n",
       "      <td>1b384ff8574084ef4a7356a8cd0c36350286e576</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75090</th>\n",
       "      <td>3b23eacd700848ff085ec5877df695456bfe6bb3</td>\n",
       "      <td>baidu</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                        dist_id latest_utm_s\n",
       "75079  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75080  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75081  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75082  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75083  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75084  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75085  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75086  215110e7713ef7435524bf321fa894e411338c40         None\n",
       "75088  1b384ff8574084ef4a7356a8cd0c36350286e576         None\n",
       "75090  3b23eacd700848ff085ec5877df695456bfe6bb3        baidu"
      ]
     },
     "execution_count": 114,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_select[['dist_id','latest_utm_s']].tail(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Try to check if we can use the first time source for anlysis, seems to be the same"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 115,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1    514\n",
       "0     86\n",
       "Name: CN, dtype: int64"
      ]
     },
     "execution_count": 115,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAisAAAGbCAYAAAAFjNDAAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAAPYQAAD2EBqD+naQAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAGt9JREFUeJzt3X9sVfd9//GXZweHMnzHj2DjxV2RFkXNIFPmVgTSJdlCTBA/FnVTslFZiZTRZqRhLKCqLJrKHxOOkjRkU9YoZVuT/oi8P9JslWgontaxIiAldGwhzaJOTRWj4DhZ3Gvgiwyj9/vH1Ks4kDYGij+Yx0M6ku85n2O/j4TxU8f3XjfUarVaAAAK9UvjPQAAwM8iVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhN4z3AmfjJT36S119/PVOnTk1DQ8N4jwMAvA+1Wi2HDx9Oe3t7fumX3v/9kgsyVl5//fV0dHSM9xgAwBno7+/P5Zdf/r7XX5CxMnXq1CT/d7EtLS3jPA0A8H4MDw+no6Oj/nP8/bogY+Wnv/ppaWkRKwBwgRnrUzg8wRYAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCK1jTeAzA2H/rs1vEegfPoRw8sHe8RAMadOysAQNHECgBQNLECABRNrAAARRMrAEDRxhQrGzduTENDw6itra2tfrxWq2Xjxo1pb2/P5MmTc+ONN+all14a9TmGhobS3d2dSqWSSqWS7u7u/PjHPz43VwMATDhjvrPyG7/xGzl06FB9e/HFF+vHHnzwwTzyyCN57LHHsnfv3rS1teXmm2/O4cOH62tWrlyZ/fv3Z9u2bdm2bVv279+f7u7uc3M1AMCEM+b3WWlqahp1N+WnarVaHn300dx///35+Mc/niR56qmn0tramqeffjqf+tSn8vLLL2fbtm3Zs2dP5s+fnyTZsmVLFixYkFdeeSVXXnnlWV4OADDRjPnOyg9+8IO0t7dnzpw5+cM//MP88Ic/TJK8+uqrGRgYSFdXV31tc3NzbrjhhuzatStJsnv37lQqlXqoJMm1116bSqVSX3M6IyMjGR4eHrUBABeHMcXK/Pnz8+Uvfznf+ta3smXLlgwMDGThwoX5n//5nwwMDCRJWltbR53T2tpaPzYwMJBZs2ad8nlnzZpVX3M6PT099ee4VCqVdHR0jGVsAOACNqZYWbJkSX7/938/8+bNy6JFi7J16/+99ftTTz1VX9PQ0DDqnFqtNmrfu4+fbs27bdiwIdVqtb719/ePZWwA4AJ2Vi9dnjJlSubNm5cf/OAH9eexvPsOyeDgYP1uS1tbW954441TPs+bb755yh2Zd2pubk5LS8uoDQC4OJxVrIyMjOTll1/O7NmzM2fOnLS1taWvr69+/Pjx49mxY0cWLlyYJFmwYEGq1Wq++93v1tc8//zzqVar9TUAAO80plcDrV+/PsuXL88HP/jBDA4O5i//8i8zPDycO+64Iw0NDVm7dm02bdqUK664IldccUU2bdqUD3zgA1m5cmWS5MMf/nBuueWWrFq1Kk888USS5JOf/GSWLVvmlUAAwGmNKVYOHjyYP/qjP8pbb72Vyy67LNdee2327NmTX/u1X0uSfOYzn8mxY8eyevXqDA0NZf78+dm+fXumTp1a/xxf+9rXsmbNmvqrhlasWJHHHnvsHF4SADCRNNRqtdp4DzFWw8PDqVQqqVarF93zVz702a3jPQLn0Y8eWDreIwCcM2f689vfBgIAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKdVaz09PSkoaEha9eure8bGRnJvffem5kzZ2bKlClZsWJFDh48OOq81157LcuXL8+UKVMyc+bMrFmzJsePHz+bUQCACeqMY2Xv3r354he/mKuvvnrU/rVr1+bZZ59Nb29vdu7cmSNHjmTZsmU5efJkkuTkyZNZunRpjh49mp07d6a3tzfPPPNM1q1bd3ZXAgBMSGcUK0eOHMknPvGJbNmyJdOmTavvr1ar+bu/+7t8/vOfz6JFi3LNNdfkq1/9al588cX88z//c5Jk+/bt+f73v5+vfvWrueaaa7Jo0aJ8/vOfz5YtWzI8PHzarzcyMpLh4eFRGwBwcTijWLnnnnuydOnSLFq0aNT+ffv25cSJE+nq6qrva29vz9y5c7Nr164kye7duzN37ty0t7fX1yxevDgjIyPZt2/fab9eT09PKpVKfevo6DiTsQGAC9CYY6W3tzff+9730tPTc8qxgYGBTJo0adTdliRpbW3NwMBAfU1ra+uo49OmTcukSZPqa95tw4YNqVar9a2/v3+sYwMAF6imsSzu7+/Pn/7pn2b79u259NJL3/d5tVotDQ0N9cfv/Pi91rxTc3NzmpubxzIqADBBjOnOyr59+zI4OJjOzs40NTWlqakpO3bsyF//9V+nqakpra2tOX78eIaGhkadNzg4WL+b0tbWdsodlKGhoZw4ceKUOy4AAGOKlZtuuikvvvhi9u/fX98+8pGP5BOf+ET940suuSR9fX31cw4dOpQDBw5k4cKFSZIFCxbkwIEDOXToUH3N9u3b09zcnM7OznN0WQDARDGmXwNNnTo1c+fOHbVvypQpmTFjRn3/XXfdlXXr1mXGjBmZPn161q9fn3nz5tWfjNvV1ZWrrroq3d3deeihh/L2229n/fr1WbVqVVpaWs7RZQEAE8WYYuX92Lx5c5qamnLbbbfl2LFjuemmm/Lkk0+msbExSdLY2JitW7dm9erVue666zJ58uSsXLkyDz/88LkeBQCYABpqtVptvIcYq+Hh4VQqlVSr1YvubsyHPrt1vEfgPPrRA0vHewSAc+ZMf37720AAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cYUK48//niuvvrqtLS0pKWlJQsWLMhzzz1XPz4yMpJ77703M2fOzJQpU7JixYocPHhw1Od47bXXsnz58kyZMiUzZ87MmjVrcvz48XNzNQDAhDOmWLn88svzwAMP5IUXXsgLL7yQ3/3d383v/d7v5aWXXkqSrF27Ns8++2x6e3uzc+fOHDlyJMuWLcvJkyeTJCdPnszSpUtz9OjR7Ny5M729vXnmmWeybt26c39lAMCE0FCr1Wpn8wmmT5+ehx56KH/wB3+Qyy67LF/5yldy++23J0lef/31dHR05Jvf/GYWL16c5557LsuWLUt/f3/a29uTJL29vbnzzjszODiYlpaW9/U1h4eHU6lUUq1W3/c5E8WHPrt1vEfgPPrRA0vHewSAc+ZMf36f8XNWTp48md7e3hw9ejQLFizIvn37cuLEiXR1ddXXtLe3Z+7cudm1a1eSZPfu3Zk7d249VJJk8eLFGRkZyb59+97za42MjGR4eHjUBgBcHMYcKy+++GJ++Zd/Oc3Nzbn77rvz7LPP5qqrrsrAwEAmTZqUadOmjVrf2tqagYGBJMnAwEBaW1tHHZ82bVomTZpUX3M6PT09qVQq9a2jo2OsYwMAF6gxx8qVV16Z/fv3Z8+ePfmTP/mT3HHHHfn+97//nutrtVoaGhrqj9/58XutebcNGzakWq3Wt/7+/rGODQBcoJrGesKkSZPy67/+60mSj3zkI9m7d2/+6q/+KrfffnuOHz+eoaGhUXdXBgcHs3DhwiRJW1tbnn/++VGfb2hoKCdOnDjljss7NTc3p7m5eayjAgATwFm/z0qtVsvIyEg6OztzySWXpK+vr37s0KFDOXDgQD1WFixYkAMHDuTQoUP1Ndu3b09zc3M6OzvPdhQAYAIa052VP//zP8+SJUvS0dGRw4cPp7e3N//6r/+abdu2pVKp5K677sq6desyY8aMTJ8+PevXr8+8efOyaNGiJElXV1euuuqqdHd356GHHsrbb7+d9evXZ9WqVRfdq3oAgPdnTLHyxhtvpLu7O4cOHUqlUsnVV1+dbdu25eabb06SbN68OU1NTbntttty7Nix3HTTTXnyySfT2NiYJGlsbMzWrVuzevXqXHfddZk8eXJWrlyZhx9++NxfGQAwIZz1+6yMB++zwsXC+6wAE8l5f58VAIDzQawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRtTrPT09OSjH/1opk6dmlmzZuXWW2/NK6+8MmrNyMhI7r333sycOTNTpkzJihUrcvDgwVFrXnvttSxfvjxTpkzJzJkzs2bNmhw/fvzsrwYAmHDGFCs7duzIPffckz179qSvry//+7//m66urhw9erS+Zu3atXn22WfT29ubnTt35siRI1m2bFlOnjyZJDl58mSWLl2ao0ePZufOnent7c0zzzyTdevWndsrAwAmhIZarVY705PffPPNzJo1Kzt27Mj111+farWayy67LF/5yldy++23J0lef/31dHR05Jvf/GYWL16c5557LsuWLUt/f3/a29uTJL29vbnzzjszODiYlpaWU77OyMhIRkZG6o+Hh4fT0dGRarV62vUT2Yc+u3W8R+A8+tEDS8d7BIBzZnh4OJVKZcw/v8/qOSvVajVJMn369CTJvn37cuLEiXR1ddXXtLe3Z+7cudm1a1eSZPfu3Zk7d249VJJk8eLFGRkZyb59+077dXp6elKpVOpbR0fH2YwNAFxAzjhWarVa7rvvvnzsYx/L3LlzkyQDAwOZNGlSpk2bNmpta2trBgYG6mtaW1tHHZ82bVomTZpUX/NuGzZsSLVarW/9/f1nOjYAcIFpOtMTP/3pT+c///M/s3Pnzp+7tlarpaGhof74nR+/15p3am5uTnNz85mOCgBcwM7ozsq9996bb3zjG/n2t7+dyy+/vL6/ra0tx48fz9DQ0Kj1g4OD9bspbW1tp9xBGRoayokTJ0654wIAMKZYqdVq+fSnP52vf/3r+Zd/+ZfMmTNn1PHOzs5ccskl6evrq+87dOhQDhw4kIULFyZJFixYkAMHDuTQoUP1Ndu3b09zc3M6OzvP5loAgAloTL8Guueee/L000/nn/7pnzJ16tT6HZJKpZLJkyenUqnkrrvuyrp16zJjxoxMnz4969evz7x587Jo0aIkSVdXV6666qp0d3fnoYceyttvv53169dn1apVF90rewCAn29MsfL4448nSW688cZR+7/0pS/lzjvvTJJs3rw5TU1Nue2223Ls2LHcdNNNefLJJ9PY2JgkaWxszNatW7N69epcd911mTx5clauXJmHH3747K8GAJhwzup9VsbLmb5OeyLwPisXF++zAkwk4/I+KwAAv2hiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGOOlX/7t3/L8uXL097enoaGhvzjP/7jqOO1Wi0bN25Me3t7Jk+enBtvvDEvvfTSqDVDQ0Pp7u5OpVJJpVJJd3d3fvzjH5/dlQAAE9KYY+Xo0aP5zd/8zTz22GOnPf7ggw/mkUceyWOPPZa9e/emra0tN998cw4fPlxfs3Llyuzfvz/btm3Ltm3bsn///nR3d5/5VQAAE1bTWE9YsmRJlixZctpjtVotjz76aO6///58/OMfT5I89dRTaW1tzdNPP51PfepTefnll7Nt27bs2bMn8+fPT5Js2bIlCxYsyCuvvJIrr7zyLC4HAJhozulzVl599dUMDAykq6urvq+5uTk33HBDdu3alSTZvXt3KpVKPVSS5Nprr02lUqmvebeRkZEMDw+P2gCAi8M5jZWBgYEkSWtr66j9ra2t9WMDAwOZNWvWKefOmjWrvubdenp66s9vqVQq6ejoOJdjAwAF+4W8GqihoWHU41qtNmrfu4+fbs07bdiwIdVqtb719/ef24EBgGKN+TkrP0tbW1uS/7t7Mnv27Pr+wcHB+t2Wtra2vPHGG6ec++abb55yR+anmpub09zcfC5HBQAuEOf0zsqcOXPS1taWvr6++r7jx49nx44dWbhwYZJkwYIFqVar+e53v1tf8/zzz6dardbXAAD81JjvrBw5ciT//d//XX/86quvZv/+/Zk+fXo++MEPZu3atdm0aVOuuOKKXHHFFdm0aVM+8IEPZOXKlUmSD3/4w7nllluyatWqPPHEE0mST37yk1m2bJlXAgEApxhzrLzwwgv5nd/5nfrj++67L0lyxx135Mknn8xnPvOZHDt2LKtXr87Q0FDmz5+f7du3Z+rUqfVzvva1r2XNmjX1Vw2tWLHiPd+3BQC4uDXUarXaeA8xVsPDw6lUKqlWq2lpaRnvcc6rD31263iPwHn0oweWjvcIAOfMmf789reBAICiiRUAoGhiBQAo2jl9nxUAzsLGynhPwPm0sTreE1ww3FkBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKNa6x84QtfyJw5c3LppZems7Mz3/nOd8ZzHACgQOMWK//wD/+QtWvX5v7778+///u/57d/+7ezZMmSvPbaa+M1EgBQoKbx+sKPPPJI7rrrrvzxH/9xkuTRRx/Nt771rTz++OPp6ekZtXZkZCQjIyP1x9VqNUkyPDx8/gYuxE9G/t94j8B5dDH+G7+ojdTGewLOp4vw+/un/6fVamP8t14bByMjI7XGxsba17/+9VH716xZU7v++utPWf+5z32ulsRms9lsNtsE2Pr7+8fUDeNyZ+Wtt97KyZMn09raOmp/a2trBgYGTlm/YcOG3HffffXHP/nJT/L2229nxowZaWho+IXPy/gaHh5OR0dH+vv709LSMt7jAOeQ7++LS61Wy+HDh9Pe3j6m88bt10BJTgmNWq122vhobm5Oc3PzqH2/8iu/8gudjfK0tLT4zwwmKN/fF49KpTLmc8blCbYzZ85MY2PjKXdRBgcHT7nbAgBc3MYlViZNmpTOzs709fWN2t/X15eFCxeOx0gAQKEaN27cuHE8vnBLS0v+4i/+Ir/6q7+aSy+9NJs2bcq3v/3tfOlLX/IrHk7R2NiYG2+8MU1N4/qbS+AXwPc3P09DrTbW1w+dO1/4whfy4IMP5tChQ5k7d242b96c66+/frzGAQAKNK6xAgDw8/jbQABA0cQKAFA0sQIAFE2sAABFEysAQNG8qB2A8+bgwYN5/PHHs2vXrgwMDKShoSGtra1ZuHBh7r777nR0dIz3iBTIS5e54PT39+dzn/tc/v7v/368RwHGYOfOnVmyZEk6OjrS1dWV1tbW1Gq1DA4Opq+vL/39/Xnuuedy3XXXjfeoFEascMH5j//4j/zWb/1WTp48Od6jAGPw0Y9+NB/72MeyefPm0x7/sz/7s+zcuTN79+49z5NROrFCcb7xjW/8zOM//OEPs27dOrECF5jJkydn//79ufLKK097/L/+679yzTXX5NixY+d5MkrnOSsU59Zbb01DQ0N+Vkc3NDScx4mAc2H27NnZtWvXe8bK7t27M3v27PM8FRcCsUJxZs+enb/5m7/Jrbfeetrj+/fvT2dn53meCjhb69evz9133519+/bl5ptvTmtraxoaGjIwMJC+vr787d/+bR599NHxHpMCiRWK09nZme9973vvGSs/764LUKbVq1dnxowZ2bx5c5544on6r3IbGxvT2dmZL3/5y7ntttvGeUpK5DkrFOc73/lOjh49mltuueW0x48ePZoXXnghN9xww3meDDhXTpw4kbfeeitJMnPmzFxyySXjPBElEysAQNG8gy0AUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABF+/9SuJEr0ttTywAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df_select['CN'].loc[df_select['event'] == 'click_send_cellphone'].value_counts(dropna=False).plot.bar()\n",
    "df_select['CN'].loc[df_select['event'] == 'click_send_cellphone'].value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 116,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1    441\n",
       "0     72\n",
       "Name: CN, dtype: int64"
      ]
     },
     "execution_count": 116,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAisAAAGbCAYAAAAFjNDAAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAAPYQAAD2EBqD+naQAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAF8hJREFUeJzt3W9snXX9//FXbVmZcz3uD+uo9BtJJERSMFgIbiCgjI5lYxJjIBlZIEEUB8zJFuMkBrzDCP+GBiGICgpivQFTksFcjYgsGziGUwZKYsSsCyuFMFu279LNcn43vj9OKAOh29z5bHs8kivpua7PtfO+knV95uo5Zw3VarUaAIBCfajeAwAA/CdiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAitZU7wH2xptvvpmXX34548ePT0NDQ73HAQA+gGq1mjfeeCNtbW350Ic++P2SgzJWXn755bS3t9d7DABgL/T29uaYY475wOsPylgZP358kv+72JaWljpPAwB8EIODg2lvb6/9HP+gDspYeetXPy0tLWIFAA4yo30JhxfYAgBFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNGa6j0Ao/Pxb62s9wgcQP+8cXa9RwCoO3dWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIq2T7GybNmyNDQ0ZNGiRbV9Q0NDufrqqzN58uSMGzcuc+fOzZYtW0act3nz5px//vkZN25cJk+enIULF2bXrl37MgoAcIja61hZv359fvjDH+akk04asX/RokVZsWJFuru7s2bNmmzfvj1z5szJ8PBwkmR4eDizZ8/Ojh07smbNmnR3d+ehhx7K4sWL9+1KAIBD0l7Fyvbt23PxxRfnnnvuyYQJE2r7BwYG8uMf/zi33nprZsyYkZNPPjkPPPBAnnvuufz2t79NkqxevTovvPBCHnjggZx88smZMWNGbr311txzzz0ZHBzcP1cFABwy9ipWrrzyysyePTszZswYsX/Dhg3ZvXt3urq6avva2trS0dGRtWvXJknWrVuXjo6OtLW11dbMnDkzQ0ND2bBhw7s+39DQUAYHB0dsAMDhoWm0J3R3d+fZZ5/N+vXr9zjW19eXMWPGjLjbkiStra3p6+urrWltbR1xfMKECRkzZkxtzTstW7Ys3/3ud0c7KgBwCBjVnZXe3t58/etfzwMPPJAjjzzyA59XrVbT0NBQe/z2r99rzdstXbo0AwMDta23t3c0YwMAB7FRxcqGDRvS39+fzs7ONDU1pampKU888US+//3vp6mpKa2trdm1a1e2bds24rz+/v7a3ZSpU6fucQdl27Zt2b179x53XN7S3NyclpaWERsAcHgYVaycc845ee6557Jx48badsopp+Tiiy+ufX3EEUekp6ends7WrVuzadOmTJ8+PUkybdq0bNq0KVu3bq2tWb16dZqbm9PZ2bmfLgsAOFSM6jUr48ePT0dHx4h948aNy6RJk2r7L7vssixevDiTJk3KxIkTs2TJkpx44om1F+N2dXXlhBNOyPz583PzzTfn9ddfz5IlS3L55Ze7YwIA7GHUL7B9P8uXL09TU1MuvPDC7Ny5M+ecc07uu+++NDY2JkkaGxuzcuXKLFiwIKeffnrGjh2befPm5ZZbbtnfowAAh4CGarVarfcQozU4OJhKpZKBgYHD7m7Mx7+1st4jcAD988bZ9R4BYL/Z25/f/m8gAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGijipW77rorJ510UlpaWtLS0pJp06blscceqx0fGhrK1VdfncmTJ2fcuHGZO3dutmzZMuLP2Lx5c84///yMGzcukydPzsKFC7Nr1679czUAwCFnVLFyzDHH5MYbb8wzzzyTZ555Jp///OfzhS98Ic8//3ySZNGiRVmxYkW6u7uzZs2abN++PXPmzMnw8HCSZHh4OLNnz86OHTuyZs2adHd356GHHsrixYv3/5UBAIeEhmq1Wt2XP2DixIm5+eab86UvfSlHHXVU7r///lx00UVJkpdffjnt7e159NFHM3PmzDz22GOZM2dOent709bWliTp7u7OpZdemv7+/rS0tHyg5xwcHEylUsnAwMAHPudQ8fFvraz3CBxA/7xxdr1HANhv9vbn916/ZmV4eDjd3d3ZsWNHpk2blg0bNmT37t3p6uqqrWlra0tHR0fWrl2bJFm3bl06OjpqoZIkM2fOzNDQUDZs2PCezzU0NJTBwcERGwBweBh1rDz33HP5yEc+kubm5lxxxRVZsWJFTjjhhPT19WXMmDGZMGHCiPWtra3p6+tLkvT19aW1tXXE8QkTJmTMmDG1Ne9m2bJlqVQqta29vX20YwMAB6lRx8rxxx+fjRs35qmnnsrXvva1XHLJJXnhhRfec321Wk1DQ0Pt8du/fq8177R06dIMDAzUtt7e3tGODQAcpJpGe8KYMWPyiU98IklyyimnZP369fne976Xiy66KLt27cq2bdtG3F3p7+/P9OnTkyRTp07N008/PeLP27ZtW3bv3r3HHZe3a25uTnNz82hHBQAOAfv8OSvVajVDQ0Pp7OzMEUcckZ6entqxrVu3ZtOmTbVYmTZtWjZt2pStW7fW1qxevTrNzc3p7Ozc11EAgEPQqO6sfPvb386sWbPS3t6eN954I93d3fn973+fVatWpVKp5LLLLsvixYszadKkTJw4MUuWLMmJJ56YGTNmJEm6urpywgknZP78+bn55pvz+uuvZ8mSJbn88ssPu3f1AAAfzKhi5ZVXXsn8+fOzdevWVCqVnHTSSVm1alXOPffcJMny5cvT1NSUCy+8MDt37sw555yT++67L42NjUmSxsbGrFy5MgsWLMjpp5+esWPHZt68ebnlllv2/5UBAIeEff6clXrwOSscLnzOCnAoOeCfswIAcCCIFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAoo0qVpYtW5ZTTz0148ePz5QpU3LBBRfkxRdfHLFmaGgoV199dSZPnpxx48Zl7ty52bJly4g1mzdvzvnnn59x48Zl8uTJWbhwYXbt2rXvVwMAHHJGFStPPPFErrzyyjz11FPp6enJv//973R1dWXHjh21NYsWLcqKFSvS3d2dNWvWZPv27ZkzZ06Gh4eTJMPDw5k9e3Z27NiRNWvWpLu7Ow899FAWL168f68MADgkNFSr1erenvzqq69mypQpeeKJJ3LmmWdmYGAgRx11VO6///5cdNFFSZKXX3457e3tefTRRzNz5sw89thjmTNnTnp7e9PW1pYk6e7uzqWXXpr+/v60tLS87/MODg6mUqlkYGDgA60/lHz8WyvrPQIH0D9vnF3vEQD2m739+b1Pr1kZGBhIkkycODFJsmHDhuzevTtdXV21NW1tbeno6MjatWuTJOvWrUtHR0ctVJJk5syZGRoayoYNG971eYaGhjI4ODhiAwAOD3sdK9VqNddcc03OOOOMdHR0JEn6+voyZsyYTJgwYcTa1tbW9PX11da0traOOD5hwoSMGTOmtuadli1blkqlUtva29v3dmwA4CCz17Fy1VVX5S9/+Ut+8YtfvO/aarWahoaG2uO3f/1ea95u6dKlGRgYqG29vb17OzYAcJDZq1i5+uqr88gjj+Txxx/PMcccU9s/derU7Nq1K9u2bRuxvr+/v3Y3ZerUqXvcQdm2bVt27969xx2XtzQ3N6elpWXEBgAcHkYVK9VqNVdddVUefvjh/O53v8uxxx474nhnZ2eOOOKI9PT01PZt3bo1mzZtyvTp05Mk06ZNy6ZNm7J169bamtWrV6e5uTmdnZ37ci0AwCGoaTSLr7zyyjz44IP59a9/nfHjx9fukFQqlYwdOzaVSiWXXXZZFi9enEmTJmXixIlZsmRJTjzxxMyYMSNJ0tXVlRNOOCHz58/PzTffnNdffz1LlizJ5Zdf7o4JALCHUcXKXXfdlSQ5++yzR+y/9957c+mllyZJli9fnqamplx44YXZuXNnzjnnnNx3331pbGxMkjQ2NmblypVZsGBBTj/99IwdOzbz5s3LLbfcsu9XAwAccvbpc1bqxeescLjwOSvAoaQun7MCAPDfJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIo26lj5wx/+kPPPPz9tbW1paGjIr371qxHHq9Vqrr/++rS1tWXs2LE5++yz8/zzz49Ys23btsyfPz+VSiWVSiXz58/Pv/71r327EgDgkDTqWNmxY0c+9alP5Y477njX4zfddFNuu+223HHHHVm/fn2mTp2ac889N2+88UZtzbx587Jx48asWrUqq1atysaNGzN//vy9vwoA4JDVNNoTZs2alVmzZr3rsWq1mttvvz3XXnttvvjFLyZJfvrTn6a1tTUPPvhgvvrVr+avf/1rVq1alaeeeiqnnXZakuSee+7JtGnT8uKLL+b444/fh8sBAA41+/U1Ky+99FL6+vrS1dVV29fc3Jyzzjora9euTZKsW7culUqlFipJ8pnPfCaVSqW25p2GhoYyODg4YgMADg/7NVb6+vqSJK2trSP2t7a21o719fVlypQpe5w7ZcqU2pp3WrZsWe31LZVKJe3t7ftzbACgYP+VdwM1NDSMeFytVkfse+fxd1vzdkuXLs3AwEBt6+3t3b8DAwDFGvVrVv6TqVOnJvm/uydHH310bX9/f3/tbsvUqVPzyiuv7HHuq6++uscdmbc0Nzenubl5f44KABwk9uudlWOPPTZTp05NT09Pbd+uXbvyxBNPZPr06UmSadOmZWBgIH/84x9ra55++ukMDAzU1gAAvGXUd1a2b9+ev//977XHL730UjZu3JiJEyfmf/7nf7Jo0aLccMMNOe6443LcccflhhtuyIc//OHMmzcvSfLJT34y5513Xi6//PLcfffdSZKvfOUrmTNnjncCAQB7GHWsPPPMM/nc5z5Xe3zNNdckSS655JLcd999+eY3v5mdO3dmwYIF2bZtW0477bSsXr0648ePr53z85//PAsXLqy9a2ju3Lnv+bktAMDhraFarVbrPcRoDQ4OplKpZGBgIC0tLfUe54D6+LdW1nsEDqB/3ji73iMA7Dd7+/Pb/w0EABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRmuo9AAD/3/WVek/AgXT9QL0nOGi4swIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABStrrFy55135thjj82RRx6Zzs7OPPnkk/UcBwAoUN1i5Ze//GUWLVqUa6+9Nn/605/y2c9+NrNmzcrmzZvrNRIAUKCmej3xbbfdlssuuyxf/vKXkyS33357fvOb3+Suu+7KsmXLRqwdGhrK0NBQ7fHAwECSZHBw8MANXIg3h/633iNwAB2Of8cPa0PVek/AgXQYfn+/9W9atTrKv+vVOhgaGqo2NjZWH3744RH7Fy5cWD3zzDP3WH/ddddVk9hsNpvNZjsEtt7e3lF1Q13urLz22msZHh5Oa2vriP2tra3p6+vbY/3SpUtzzTXX1B6/+eabef311zNp0qQ0NDT81+elvgYHB9Pe3p7e3t60tLTUexxgP/L9fXipVqt544030tbWNqrz6vZroCR7hEa1Wn3X+Ghubk5zc/OIfR/96Ef/q7NRnpaWFv+YwSHK9/fho1KpjPqcurzAdvLkyWlsbNzjLkp/f/8ed1sAgMNbXWJlzJgx6ezsTE9Pz4j9PT09mT59ej1GAgAK1Xj99ddfX48nbmlpyXe+85187GMfy5FHHpkbbrghjz/+eO69916/4mEPjY2NOfvss9PUVNffXAL/Bb6/eT8N1epo3z+0/9x555256aabsnXr1nR0dGT58uU588wz6zUOAFCgusYKAMD78X8DAQBFEysAQNHECgBQNLECABRNrAAARfOmdgAOmC1btuSuu+7K2rVr09fXl4aGhrS2tmb69Om54oor0t7eXu8RKZC3LnPQ6e3tzXXXXZef/OQn9R4FGIU1a9Zk1qxZaW9vT1dXV1pbW1OtVtPf35+enp709vbmsccey+mnn17vUSmMWOGg8+c//zmf/vSnMzw8XO9RgFE49dRTc8YZZ2T58uXvevwb3/hG1qxZk/Xr1x/gySidWKE4jzzyyH88/o9//COLFy8WK3CQGTt2bDZu3Jjjjz/+XY//7W9/y8knn5ydO3ce4MkondesUJwLLrggDQ0N+U8d3dDQcAAnAvaHo48+OmvXrn3PWFm3bl2OPvroAzwVBwOxQnGOPvro/OAHP8gFF1zwrsc3btyYzs7OAzwVsK+WLFmSK664Ihs2bMi5556b1tbWNDQ0pK+vLz09PfnRj36U22+/vd5jUiCxQnE6Ozvz7LPPvmesvN9dF6BMCxYsyKRJk7J8+fLcfffdtV/lNjY2prOzMz/72c9y4YUX1nlKSuQ1KxTnySefzI4dO3Leeee96/EdO3bkmWeeyVlnnXWAJwP2l927d+e1115LkkyePDlHHHFEnSeiZGIFACiaT7AFAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaP8PqTyClLggKVoAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df_select['CN'].loc[df_select['event'] == 'clickSubmit'].value_counts(dropna=False).plot.bar()\n",
    "df_select['CN'].loc[df_select['event'] == 'clickSubmit'].value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 117,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1    493\n",
       "0     70\n",
       "Name: CN, dtype: int64"
      ]
     },
     "execution_count": 117,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAisAAAGbCAYAAAAFjNDAAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAAPYQAAD2EBqD+naQAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvhp/UCwAAGslJREFUeJzt3X9sXeVh//GPZxOTZvFdfhA7Hu4abQiVJUzMrYJDB2wEhyg/hqoJtlQWSCwtCyXLSFQ1Q1MzaUoQUMImVsSyrdBS5v1B2SqlpPG0LmuUhIZ02QhlqFOpcESMYbh2kkVOZu73j325wiS0OEnjJ87rJR3J95zn+D5HiuO3nnvudV21Wq0GAKBQPzfeEwAA+EnECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFK1hvCdwOt5+++289tprmTp1aurq6sZ7OgDAB1CtVnP48OG0trbm537ug6+XnJex8tprr6WtrW28pwEAnIbe3t5ceumlH3j8eRkrU6dOTfJ/F9vU1DTOswEAPoihoaG0tbXVfo9/UOdlrLzz0k9TU5NYAYDzzFhv4XCDLQBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUbUyxsmHDhtTV1Y3aWlpaaser1Wo2bNiQ1tbWTJ48Oddff31efPHFUd9jYGAgXV1dqVQqqVQq6erqyo9//OOzczUAwIQz5pWVX/3VX82hQ4dq2wsvvFA7dv/99+ehhx7KI488kr1796alpSU33nhjDh8+XBuzYsWK7N+/P9u2bcu2bduyf//+dHV1nZ2rAQAmnDF/KFxDQ8Oo1ZR3VKvVPPzww7n33nvzyU9+MknyxBNPpLm5OU899VQ+85nP5KWXXsq2bduyZ8+ezJ8/P0myZcuWdHR05OWXX87ll19+yuccHh7O8PBw7fHQ0NBYpw0AnKfGvLLygx/8IK2trZkzZ05+93d/Nz/84Q+TJK+88kr6+vrS2dlZG9vY2Jjrrrsuu3btSpLs3r07lUqlFipJcvXVV6dSqdTGnMqmTZtqLxtVKhV/FwgALiBjipX58+fnK1/5Sr71rW9ly5Yt6evry4IFC/Lf//3f6evrS5I0NzePOqe5ubl2rK+vL7NmzTrp+86aNas25lTWr1+fwcHB2tbb2zuWaQMA57ExvQy0ePHi2tfz5s1LR0dHfvmXfzlPPPFErr766iQnf95/tVodte9Ufw/gvWPeq7GxMY2NjWOZKgAwQZzRW5enTJmSefPm5Qc/+EHtPpb3rpD09/fXVltaWlry+uuvn/R93njjjZNWZAAAkjOMleHh4bz00kuZPXt25syZk5aWlvT09NSOHz9+PDt27MiCBQuSJB0dHRkcHMx3v/vd2pjnnnsug4ODtTEAAO82ppeB1q1bl2XLluXDH/5w+vv782d/9mcZGhrKbbfdlrq6uqxZsyYbN27MZZddlssuuywbN27Mhz70oaxYsSJJ8tGPfjQ33XRTVq5cmcceeyxJ8ulPfzpLly5933cCMdpHPr91vKfAOfSj+5aM9xQAxt2YYuXgwYP5vd/7vbz55pu55JJLcvXVV2fPnj35pV/6pSTJ5z73uRw7diyrVq3KwMBA5s+fn+3bt2fq1Km17/G1r30tq1evrr1raPny5XnkkUfO4iUBABNJXbVarY73JMZqaGgolUolg4ODaWpqGu/pnFNWVi4sVlaAieR0f3/720AAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFO6NY2bRpU+rq6rJmzZravuHh4dx9992ZOXNmpkyZkuXLl+fgwYOjznv11VezbNmyTJkyJTNnzszq1atz/PjxM5kKADBBnXas7N27N3/1V3+VK6+8ctT+NWvW5Jlnnkl3d3d27tyZI0eOZOnSpRkZGUmSjIyMZMmSJTl69Gh27tyZ7u7uPP3001m7du2ZXQkAMCGdVqwcOXIkn/rUp7Jly5ZMmzattn9wcDB/8zd/ky9+8YtZuHBhrrrqqjz55JN54YUX8k//9E9Jku3bt+f73/9+nnzyyVx11VVZuHBhvvjFL2bLli0ZGho6O1cFAEwYpxUrd911V5YsWZKFCxeO2r9v376cOHEinZ2dtX2tra2ZO3dudu3alSTZvXt35s6dm9bW1tqYRYsWZXh4OPv27Tvl8w0PD2doaGjUBgBcGBrGekJ3d3e+973vZe/evScd6+vry6RJk0attiRJc3Nz+vr6amOam5tHHZ82bVomTZpUG/NemzZtyp/+6Z+OdaoAwAQwppWV3t7e/OEf/mGefPLJXHzxxR/4vGq1mrq6utrjd3/9fmPebf369RkcHKxtvb29Y5k2AHAeG1Os7Nu3L/39/Wlvb09DQ0MaGhqyY8eO/MVf/EUaGhrS3Nyc48ePZ2BgYNR5/f39tdWUlpaWk1ZQBgYGcuLEiZNWXN7R2NiYpqamURsAcGEYU6zccMMNeeGFF7J///7a9rGPfSyf+tSnal9fdNFF6enpqZ1z6NChHDhwIAsWLEiSdHR05MCBAzl06FBtzPbt29PY2Jj29vazdFkAwEQxpntWpk6dmrlz547aN2XKlMyYMaO2/4477sjatWszY8aMTJ8+PevWrcu8efNqN+N2dnbmiiuuSFdXVx544IG89dZbWbduXVauXGnFBAA4yZhvsP1pNm/enIaGhtxyyy05duxYbrjhhjz++OOpr69PktTX12fr1q1ZtWpVrrnmmkyePDkrVqzIgw8+eLanAgBMAHXVarU63pMYq6GhoVQqlQwODl5wqzEf+fzW8Z4C59CP7lsy3lMAOGtO9/e3vw0EABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQtDHFyqOPPporr7wyTU1NaWpqSkdHR5599tna8eHh4dx9992ZOXNmpkyZkuXLl+fgwYOjvserr76aZcuWZcqUKZk5c2ZWr16d48ePn52rAQAmnDHFyqWXXpr77rsvzz//fJ5//vn81m/9Vn77t387L774YpJkzZo1eeaZZ9Ld3Z2dO3fmyJEjWbp0aUZGRpIkIyMjWbJkSY4ePZqdO3emu7s7Tz/9dNauXXv2rwwAmBDqqtVq9Uy+wfTp0/PAAw/kd37nd3LJJZfkq1/9am699dYkyWuvvZa2trZ885vfzKJFi/Lss89m6dKl6e3tTWtra5Kku7s7t99+e/r7+9PU1PSBnnNoaCiVSiWDg4Mf+JyJ4iOf3zreU+Ac+tF9S8Z7CgBnzen+/j7te1ZGRkbS3d2do0ePpqOjI/v27cuJEyfS2dlZG9Pa2pq5c+dm165dSZLdu3dn7ty5tVBJkkWLFmV4eDj79u173+caHh7O0NDQqA0AuDCMOVZeeOGF/PzP/3waGxtz55135plnnskVV1yRvr6+TJo0KdOmTRs1vrm5OX19fUmSvr6+NDc3jzo+bdq0TJo0qTbmVDZt2pRKpVLb2traxjptAOA8NeZYufzyy7N///7s2bMnf/AHf5Dbbrst3//+9993fLVaTV1dXe3xu79+vzHvtX79+gwODta23t7esU4bADhPNYz1hEmTJuVXfuVXkiQf+9jHsnfv3vz5n/95br311hw/fjwDAwOjVlf6+/uzYMGCJElLS0uee+65Ud9vYGAgJ06cOGnF5d0aGxvT2Ng41qkCABPAGX/OSrVazfDwcNrb23PRRRelp6enduzQoUM5cOBALVY6Ojpy4MCBHDp0qDZm+/btaWxsTHt7+5lOBQCYgMa0svLHf/zHWbx4cdra2nL48OF0d3fnX/7lX7Jt27ZUKpXccccdWbt2bWbMmJHp06dn3bp1mTdvXhYuXJgk6ezszBVXXJGurq488MADeeutt7Ju3bqsXLnygntXDwDwwYwpVl5//fV0dXXl0KFDqVQqufLKK7Nt27bceOONSZLNmzenoaEht9xyS44dO5Ybbrghjz/+eOrr65Mk9fX12bp1a1atWpVrrrkmkydPzooVK/Lggw+e/SsDACaEM/6clfHgc1a4UPicFWAiOeefswIAcC6IFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKNKVY2bdqUj3/845k6dWpmzZqVm2++OS+//PKoMcPDw7n77rszc+bMTJkyJcuXL8/BgwdHjXn11VezbNmyTJkyJTNnzszq1atz/PjxM78aAGDCGVOs7NixI3fddVf27NmTnp6e/O///m86Oztz9OjR2pg1a9bkmWeeSXd3d3bu3JkjR45k6dKlGRkZSZKMjIxkyZIlOXr0aHbu3Jnu7u48/fTTWbt27dm9MgBgQqirVqvV0z35jTfeyKxZs7Jjx45ce+21GRwczCWXXJKvfvWrufXWW5Mkr732Wtra2vLNb34zixYtyrPPPpulS5emt7c3ra2tSZLu7u7cfvvt6e/vT1NT00993qGhoVQqlQwODn6g8RPJRz6/dbynwDn0o/uWjPcUAM6a0/39fUb3rAwODiZJpk+fniTZt29fTpw4kc7OztqY1tbWzJ07N7t27UqS7N69O3Pnzq2FSpIsWrQow8PD2bdv3ymfZ3h4OENDQ6M2AODCcNqxUq1Wc8899+QTn/hE5s6dmyTp6+vLpEmTMm3atFFjm5ub09fXVxvT3Nw86vi0adMyadKk2pj32rRpUyqVSm1ra2s73WkDAOeZ046Vz372s/mP//iP/N3f/d1PHVutVlNXV1d7/O6v32/Mu61fvz6Dg4O1rbe393SnDQCcZ04rVu6+++584xvfyLe//e1ceumltf0tLS05fvx4BgYGRo3v7++vraa0tLSctIIyMDCQEydOnLTi8o7GxsY0NTWN2gCAC8OYYqVareazn/1svv71r+ef//mfM2fOnFHH29vbc9FFF6Wnp6e279ChQzlw4EAWLFiQJOno6MiBAwdy6NCh2pjt27ensbEx7e3tZ3ItAMAE1DCWwXfddVeeeuqp/OM//mOmTp1aWyGpVCqZPHlyKpVK7rjjjqxduzYzZszI9OnTs27dusybNy8LFy5MknR2duaKK65IV1dXHnjggbz11ltZt25dVq5cacUEADjJmGLl0UcfTZJcf/31o/Z/+ctfzu23354k2bx5cxoaGnLLLbfk2LFjueGGG/L444+nvr4+SVJfX5+tW7dm1apVueaaazJ58uSsWLEiDz744JlfDQAw4ZzR56yMF5+zwoXC56wAE8m4fM4KAMDPmlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhjjpV//dd/zbJly9La2pq6urr8wz/8w6jj1Wo1GzZsSGtrayZPnpzrr78+L7744qgxAwMD6erqSqVSSaVSSVdXV3784x+f2ZUAABPSmGPl6NGj+bVf+7U88sgjpzx+//3356GHHsojjzySvXv3pqWlJTfeeGMOHz5cG7NixYrs378/27Zty7Zt27J///50dXWd/lUAABNWw1hPWLx4cRYvXnzKY9VqNQ8//HDuvffefPKTn0ySPPHEE2lubs5TTz2Vz3zmM3nppZeybdu27NmzJ/Pnz0+SbNmyJR0dHXn55Zdz+eWXn8HlAAATzVm9Z+WVV15JX19fOjs7a/saGxtz3XXXZdeuXUmS3bt3p1Kp1EIlSa6++upUKpXamPcaHh7O0NDQqA0AuDCc1Vjp6+tLkjQ3N4/a39zcXDvW19eXWbNmnXTurFmzamPea9OmTbX7WyqVStra2s7mtAGAgv1M3g1UV1c36nG1Wh21773HTzXm3davX5/BwcHa1tvbe3YnDAAUa8z3rPwkLS0tSf5v9WT27Nm1/f39/bXVlpaWlrz++usnnfvGG2+ctCLzjsbGxjQ2Np7NqQIA54mzurIyZ86ctLS0pKenp7bv+PHj2bFjRxYsWJAk6ejoyODgYL773e/Wxjz33HMZHBysjQEAeMeYV1aOHDmS//qv/6o9fuWVV7J///5Mnz49H/7wh7NmzZps3Lgxl112WS677LJs3LgxH/rQh7JixYokyUc/+tHcdNNNWblyZR577LEkyac//eksXbrUO4EAgJOMOVaef/75/OZv/mbt8T333JMkue222/L444/nc5/7XI4dO5ZVq1ZlYGAg8+fPz/bt2zN16tTaOV/72teyevXq2ruGli9f/r6f2wIAXNjqqtVqdbwnMVZDQ0OpVCoZHBxMU1PTeE/nnPrI57eO9xQ4h35035LxngLAWXO6v7/9bSAAoGhiBQAomlgBAIomVgCAookVAKBoYgUAKJpYAQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGhiBQAoWsN4TwCA/29DZbxnwLm0YXC8Z3DesLICABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFEysAQNHECgBQNLECABRNrAAARRMrAEDRxAoAUDSxAgAUTawAAEUTKwBA0cQKAFA0sQIAFE2sAABFG9dY+dKXvpQ5c+bk4osvTnt7e77zne+M53QAgAKNW6z8/d//fdasWZN77703//Zv/5bf+I3fyOLFi/Pqq6+O15QAgAI1jNcTP/TQQ7njjjvy+7//+0mShx9+ON/61rfy6KOPZtOmTaPGDg8PZ3h4uPZ4cHAwSTI0NHTuJlyIt4f/Z7ynwDl0If4bv6ANV8d7BpxLF+DP9zv/p1WrY/y3Xh0Hw8PD1fr6+urXv/71UftXr15dvfbaa08a/4UvfKGaxGaz2Ww22wTYent7x9QN47Ky8uabb2ZkZCTNzc2j9jc3N6evr++k8evXr88999xTe/z222/nrbfeyowZM1JXV/czny/ja2hoKG1tbent7U1TU9N4Twc4i/x8X1iq1WoOHz6c1tbWMZ03bi8DJTkpNKrV6injo7GxMY2NjaP2/cIv/MLPdG6Up6mpyX9mMEH5+b5wVCqVMZ8zLjfYzpw5M/X19SetovT395+02gIAXNjGJVYmTZqU9vb29PT0jNrf09OTBQsWjMeUAIBC1W/YsGHDeDxxU1NT/uRP/iS/+Iu/mIsvvjgbN27Mt7/97Xz5y1/2Eg8nqa+vz/XXX5+GhnF95RL4GfDzzU9TV62O9f1DZ8+XvvSl3H///Tl06FDmzp2bzZs359prrx2v6QAABRrXWAEA+Gn8bSAAoGhiBQAomlgBAIomVgCAookVAKBo3tQOwDlz8ODBPProo9m1a1f6+vpSV1eX5ubmLFiwIHfeeWfa2trGe4oUyFuXOe/09vbmC1/4Qv72b/92vKcCjMHOnTuzePHitLW1pbOzM83NzalWq+nv709PT096e3vz7LPP5pprrhnvqVIYscJ559///d/z67/+6xkZGRnvqQBj8PGPfzyf+MQnsnnz5lMe/6M/+qPs3Lkze/fuPcczo3RiheJ84xvf+InHf/jDH2bt2rViBc4zkydPzv79+3P55Zef8vh//ud/5qqrrsqxY8fO8cwonXtWKM7NN9+curq6/KSOrqurO4czAs6G2bNnZ9euXe8bK7t3787s2bPP8aw4H4gVijN79uz85V/+ZW6++eZTHt+/f3/a29vP8ayAM7Vu3brceeed2bdvX2688cY0Nzenrq4ufX196enpyV//9V/n4YcfHu9pUiCxQnHa29vzve99731j5aetugBlWrVqVWbMmJHNmzfnscceq72UW19fn/b29nzlK1/JLbfcMs6zpETuWaE43/nOd3L06NHcdNNNpzx+9OjRPP/887nuuuvO8cyAs+XEiRN58803kyQzZ87MRRddNM4zomRiBQAomk+wBQCKJlYAgKKJFQCgaGIFACiaWAEAiiZWAICiiRUAoGj/D+jLkxgZj0TxAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "df_select['CN'].loc[df_select['event'] == 'verify_cellphone_code'].value_counts(dropna=False).plot.bar()\n",
    "df_select['CN'].loc[df_select['event'] == 'verify_cellphone_code'].value_counts(dropna=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Ip address in or not in China, did not influence sign up rate. Users interested in this website can even sign up or use Chinese cellphone number even in abroad. "
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}